00010000:00010000:0.0:1746129558.271436:0:4385:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6c0bc00, rc 0) 00000100:00100000:0.0:1746129558.271494:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f958000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ada2ffba-8920-4ecb-8068-68caa9806978+34:1962:x1830948733725440:12345-192.168.202.4@tcp:101:cat.0 Request processed in 199us (287us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129558.271501:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15196 00000100:00100000:0.0:1746129558.280278:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129558.280397:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129558.280441:0:8417:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733725952 00000100:00100000:0.0:1746129558.280450:0:8417:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733725952 00002000:00100000:0.0:1746129558.280500:0:8417:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3ef:0x0] (3862528->3866623) req@ffff880135725180 x1830948733725952/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:299/0 lens 488/0 e 0 to 0 dl 1746129569 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129558.280510:0:8417:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135725180 with x1830948733725952 ext(3862528->3866623) 00002000:00010000:0.0:1746129558.280515:0:8417:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135725180 00000100:00100000:0.0:1746129558.280551:0:8417:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7297 00000100:00100000:0.0:1746129558.280559:0:8417:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135725180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:1963:x1830948733725952:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:0.0:1746129558.280735:0:8417:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135725180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:1963:x1830948733725952:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 177us (338us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746129558.280741:0:8417:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7297 00002000:00100000:0.0:1746129558.280746:0:8417:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3ef:0x0] (3862528->3866623) req@ffff880135725180 x1830948733725952/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:299/0 lens 488/4536 e 0 to 0 dl 1746129569 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129558.280754:0:8417:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135725180 with x1830948733725952 ext(3862528->3866623) 00002000:00010000:0.0:1746129558.280756:0:8417:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135725180 00000100:00100000:0.0:1746129558.285730:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129558.288991:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129558.300781:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129558.301343:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129558.301366:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129558.306372:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129558.310403:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129558.317923:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129558.321359:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129558.340917:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129558.341020:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129558.342360:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129558.345721:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129558.345748:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129558.347343:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00002000:00010000:0.0:1746129558.348461:0:4385:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3f5:0x0] updating lvb mtime: 1746129558 -> 1746129559 00002000:00010000:0.0:1746129558.348464:0:4385:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3f5:0x0] updating lvb atime: 1746129558 -> 1746129559 00002000:00010000:0.0:1746129558.348466:0:4385:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3f5:0x0] updating lvb ctime: 1746129558 -> 1746129559 00000100:00100000:0.0:1746129558.348481:0:4385:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094eff480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:4385:1830948737356288:192.168.202.4@tcp:106: 00010000:00010000:0.0:1746129558.348514:0:4385:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f5edc00/0x40a459093b067849 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f1f9c6 expref: 42 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129558.348526:0:4385:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f5edc00/0x40a459093b067849 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f1f9c6 expref: 42 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129558.348540:0:4385:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f5edc00, rc 0) 00000100:00100000:0.0:1746129558.348578:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bf7f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ada2ffba-8920-4ecb-8068-68caa9806978+41:1960:x1830948733728128:12345-192.168.202.4@tcp:101:cat.0 Request processed in 6921us (7673us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129558.348585:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15200 00000100:00100000:0.0:1746129558.358252:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129558.358357:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129558.374841:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129558.387971:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129558.388167:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129558.388600:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129558.406385:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129558.407167:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129558.407184:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733730816 00000100:00100000:0.0:1746129558.407187:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733730816 00010000:00010000:0.0:1746129558.407204:0:9823:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012ba8e600/0x40a459093b067850 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2527232->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f1f9cd expref: 37 pid: 7148 timeout: 913 lvb_type: 0 00000100:00100000:0.0:1746129558.407235:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7743 00000100:00100000:0.0:1746129558.407240:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c078380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ada2ffba-8920-4ecb-8068-68caa9806978+37:1963:x1830948733730816:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129558.407248:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129558.407263:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012ba8e600/0x40a459093b067850 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2527232->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f1f9cd expref: 37 pid: 7148 timeout: 913 lvb_type: 0 00010000:00010000:0.0:1746129558.407273:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012ba8e600/0x40a459093b067850 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2527232->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f1f9cd expref: 37 pid: 7148 timeout: 913 lvb_type: 0 00010000:00010000:0.0:1746129558.407286:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ba8e600/0x40a459093b067850 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2527232->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f1f9cd expref: 37 pid: 7148 timeout: 913 lvb_type: 0 00010000:00010000:0.0:1746129558.407324:0:9823:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129558.407325:0:9823:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129558.407330:0:9823:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880136438200/0x40a459093b067857 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5144576->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f1f9d4 expref: 36 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129558.407336:0:9823:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136438200/0x40a459093b067857 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5144576->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f1f9d4 expref: 36 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129558.407344:0:9823:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129558.407345:0:9823:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129558.407348:0:9823:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880090a1ea00/0x40a459093b067865 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f1f9e2 expref: 22 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129558.407355:0:9823:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090a1ea00/0x40a459093b067865 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f1f9e2 expref: 22 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129558.407374:0:9823:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880090a1ea00/0x40a459093b067865 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f1f9e2 expref: 22 pid: 4385 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129558.407385:0:9823:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c07b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9823:1830948737357056:192.168.202.4@tcp:105: 00010000:00010000:0.0:1746129558.407471:0:9823:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880136438200/0x40a459093b067857 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5144576->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f1f9d4 expref: 36 pid: 7148 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129558.407479:0:9823:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c078e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9823:1830948737357184:192.168.202.4@tcp:105: 00000100:00100000:0.0:1746129558.407496:0:9823:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a6ce8000 going to sleep for 11 seconds 00000100:00100000:0.0:1746129558.413647:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129558.413711:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129558.418070:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129558.429453:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129558.434702:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129558.440624:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129558.451012:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129558.451331:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129558.451377:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129558.483839:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129558.499249:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129558.509575:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00080000:0.0:1746129558.509843:0:7097:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746129558.513911:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129558.516094:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129558.519503:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129558.519631:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129558.519720:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129558.521148:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129558.524367:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129558.528709:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129558.543280:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129558.546837:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129558.546879:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129558.546906:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129558.546934:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129558.547030:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129558.547054:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129558.547362:0:22481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15212 00000100:00100000:0.0:1746129558.547368:0:22481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f325880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:068dab75-d300-4ead-a742-d14572ad1e50+13:1963:x1830948733735808:12345-192.168.202.4@tcp:1:mirror_io.0 00010000:00010000:0.0:1746129558.547384:0:22481:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a6cdaa00/0x40a459093b0678ea lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129558.547393:0:22481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f385c00/0x40a459093b0677a1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f1f972 expref: 35 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129558.547409:0:22481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090a1fe00/0x40a459093b06789d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f1f9fe expref: 13 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129558.547415:0:22481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008e0a6e00/0x40a459093b0677a8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f1f979 expref: 22 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129558.547420:0:22481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129558.547421:0:22481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129558.547431:0:22481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6cdaa00/0x40a459093b0678ea lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129558.547447:0:22481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008e0a6e00/0x40a459093b0677a8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1f979 expref: 22 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129558.547453:0:22481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008e0a6e00/0x40a459093b0677a8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1f979 expref: 22 pid: 8412 timeout: 913 lvb_type: 1 00000100:00100000:0.0:1746129558.547460:0:22481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136015c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:22481:1830948737358336:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129558.550469:0:22481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090a1fe00/0x40a459093b06789d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1f9fe expref: 13 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129558.550479:0:22481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090a1fe00/0x40a459093b06789d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1f9fe expref: 13 pid: 4385 timeout: 913 lvb_type: 1 00000100:00100000:0.0:1746129558.550488:0:22481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136014700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:22481:1830948737359616:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129558.550512:0:22481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f385c00/0x40a459093b0677a1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f1f972 expref: 35 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129558.550519:0:22481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f385c00/0x40a459093b0677a1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f1f972 expref: 35 pid: 8412 timeout: 913 lvb_type: 0 00000100:00100000:0.0:1746129558.550526:0:22481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136015880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:22481:1830948737359744:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129558.550539:0:22481:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a6ce8d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746129558.561132:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129558.561173:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129558.561201:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129558.561216:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129558.561371:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129558.561396:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129558.561410:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129558.561419:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129558.563608:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129558.563698:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129558.563723:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129558.567324:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129558.568367:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129558.568945:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129558.569185:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129558.571854:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129558.571901:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129558.577895:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129558.584059:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129558.584089:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129558.584119:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129558.584133:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129558.584215:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129558.614858:0:8410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15219 00000100:00100000:0.0:1746129558.614866:0:8410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+57:3303:x1830948737362304:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129558.615027:0:8410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+58:3303:x1830948737362304:12345-0@lo:2:osp-syn-0-0.0 Request processed in 163us (1393us total) trans 21474841151 rc 0/0 00000100:00100000:0.0:1746129558.615033:0:8410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15219 00000100:00100000:0.0:1746129558.615045:0:8410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15220 00000100:00100000:0.0:1746129558.615049:0:8410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+53:3303:x1830948737361152:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746129558.615130:0:8410:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746129558.615133:0:8410:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb mtime from disk: 1746129523 -> 1746129523 00002000:00010000:0.0:1746129558.615135:0:8410:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb atime from disk: 1746129523 -> 1746129523 00002000:00010000:0.0:1746129558.615137:0:8410:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb ctime from disk: 1746129524 -> 1746129524 00002000:00010000:0.0:1746129558.615138:0:8410:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1746129558.615159:0:8410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+54:3303:x1830948737361152:12345-0@lo:2:osp-syn-1-0.0 Request processed in 109us (1493us total) trans 17179873925 rc 0/0 00000100:00100000:0.0:1746129558.615164:0:8410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15220 00000100:00100000:0.0:1746129558.615174:0:8410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15221 00000100:00100000:0.0:1746129558.615178:0:8410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+53:3303:x1830948737361664:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129558.615250:0:8410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+54:3303:x1830948737361664:12345-0@lo:2:osp-syn-1-0.0 Request processed in 71us (1563us total) trans 17179873926 rc 0/0 00000100:00100000:0.0:1746129558.615255:0:8410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15221 00000100:00100000:0.0:1746129558.615263:0:8410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15222 00000100:00100000:0.0:1746129558.615268:0:8410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+57:3303:x1830948737362176:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129558.616357:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800947bf100/2, rc 0, transno 17179873925 00000100:00100000:0.0:1746129558.616364:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1830948737361152:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129558.616373:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800947bd180/2, rc 0, transno 17179873926 00000100:00100000:0.0:1746129558.616376:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1830948737361664:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129558.616385:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800947bf480/2, rc 0, transno 17179873924 00000100:00100000:0.0:1746129558.616388:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1830948737361280:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129558.616399:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800947bf800/2, rc 0, transno 21474841151 00000100:00100000:0.0:1746129558.616407:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1830948737362304:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129558.616472:0:3302:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1746129558.616483:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f958a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737362816:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129558.616512:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746129558.616546:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800947bd500/2, rc 0, transno 17179873931 00000100:00100000:0.0:1746129558.616549:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1830948737360768:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129558.617716:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880136014700/2, rc 0, transno 21474841154 00000100:00100000:0.0:1746129558.617721:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136014700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1830948737362688:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129558.617729:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800947bce00/2, rc 0, transno 21474841152 00000100:00100000:0.0:1746129558.617731:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1830948737361792:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129558.617830:0:8410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+60:3303:x1830948737362176:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2561us (4121us total) trans 21474841157 rc 0/0 00000100:00100000:0.0:1746129558.617835:0:8410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15222 00000100:00100000:0.0:1746129558.617942:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000004:00080000:0.0:1746129558.617961:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800947bed80/2, rc 0, transno 21474841157 00000100:00100000:0.0:1746129558.617963:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1830948737362176:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129558.622189:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129558.624648:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129558.627239:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129558.650142:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129558.657520:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129558.657591:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129558.663279:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129558.663374:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129558.663387:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129558.663410:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129558.663431:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733741184 00000100:00100000:0.0:1746129558.663433:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733741184 00000100:00100000:0.0:1746129558.663448:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733741312 00000100:00100000:0.0:1746129558.663450:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733741312 00000100:00100000:0.0:1746129558.663461:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15235 00000100:00100000:0.0:1746129558.663465:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013145f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ada2ffba-8920-4ecb-8068-68caa9806978+35:1962:x1830948733741184:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129558.663471:0:4385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129558.663478:0:4385:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a6cda200/0x40a459093b06797d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f1fa59 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746129558.663492:0:4385:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3ee:0x0] initial LVB size: 2097152, mtime: 0x6813d296, atime: 0x6813d296, ctime: 0x6813d296, blocks: 0x821 00010000:00010000:0.0:1746129558.663499:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129558.663500:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129558.663504:0:4385:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6cda200/0x40a459093b06797d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f1fa59 expref: 36 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129558.663513:0:4385:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a6cda200/0x40a459093b06797d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f1fa59 expref: 36 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129558.663525:0:4385:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6cda200, rc 0) 00000100:00100000:0.0:1746129558.663542:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013145f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ada2ffba-8920-4ecb-8068-68caa9806978+36:1962:x1830948733741184:12345-192.168.202.4@tcp:101:cat.0 Request processed in 77us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129558.663547:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15235 00000100:00100000:0.0:1746129558.663556:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15237 00000100:00100000:0.0:1746129558.663560:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013145d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ada2ffba-8920-4ecb-8068-68caa9806978+35:1962:x1830948733741312:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129558.663805:0:4385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129558.663812:0:4385:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a6cdbc00/0x40a459093b06798b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f1fa60 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746129558.663823:0:4385:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3ef:0x0] initial LVB size: 5146336, mtime: 0x6813d297, atime: 0x6813d296, ctime: 0x6813d297, blocks: 0x1791 00010000:00010000:0.0:1746129558.663830:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129558.663831:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129558.663835:0:4385:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6cdbc00/0x40a459093b06798b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f1fa60 expref: 36 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129558.663843:0:4385:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a6cdbc00/0x40a459093b06798b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f1fa60 expref: 36 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129558.663849:0:4385:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6cdbc00, rc 0) 00000100:00100000:0.0:1746129558.663865:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013145d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ada2ffba-8920-4ecb-8068-68caa9806978+36:1962:x1830948733741312:12345-192.168.202.4@tcp:101:cat.0 Request processed in 305us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129558.664196:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15237 00000100:00100000:0.0:1746129558.681290:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129558.681379:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129558.681401:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129558.681460:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129558.681504:0:31519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733741696 00000100:00100000:0.0:1746129558.681513:0:31519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733741696 00002000:00100000:0.0:1746129558.681563:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3ec:0x0] (0->1048575) req@ffff88012e87df80 x1830948733741696/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:299/0 lens 488/0 e 0 to 0 dl 1746129569 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129558.681573:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e87df80 with x1830948733741696 ext(0->1048575) 00002000:00010000:0.0:1746129558.681580:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e87df80 00000100:00100000:0.0:1746129558.681597:0:31519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733741952 00000100:00100000:0.0:1746129558.681600:0:31519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733741952 00002000:00100000:0.0:1746129558.681614:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff88012e87f800 x1830948733741952/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:299/0 lens 488/0 e 0 to 0 dl 1746129569 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129558.681620:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e87f800 with x1830948733741952 ext(1048576->2097151) 00002000:00010000:0.0:1746129558.681622:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e87f800 00000100:00100000:0.0:1746129558.681630:0:31519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733742208 00000100:00100000:0.0:1746129558.681631:0:31519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733742208 00002000:00100000:0.0:1746129558.681641:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f4:0x0] (1048576->2097151) req@ffff88012e87dc00 x1830948733742208/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:299/0 lens 488/0 e 0 to 0 dl 1746129569 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129558.681647:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e87dc00 with x1830948733742208 ext(1048576->2097151) 00002000:00010000:0.0:1746129558.681649:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e87dc00 00000100:00100000:0.0:1746129558.681655:0:31519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733742464 00000100:00100000:0.0:1746129558.681657:0:31519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733742464 00002000:00100000:0.0:1746129558.681665:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3ee:0x0] (1048576->2097151) req@ffff8800a07aed80 x1830948733742464/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:299/0 lens 488/0 e 0 to 0 dl 1746129569 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129558.681671:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a07aed80 with x1830948733742464 ext(1048576->2097151) 00002000:00010000:0.0:1746129558.681674:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a07aed80 00000100:00100000:0.0:1746129558.681685:0:31519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7311 00000100:00100000:0.0:1746129558.681691:0:31519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e87df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ada2ffba-8920-4ecb-8068-68caa9806978+37:1963:x1830948733741696:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129558.705725:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129558.705760:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129558.706222:0:31521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e87f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ada2ffba-8920-4ecb-8068-68caa9806978+46:1963:x1830948733741952:12345-192.168.202.4@tcp:3:cat.0 Request processed in 24238us (24841us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129558.706229:0:31521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7312 00002000:00100000:0.0:1746129558.706240:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff88012e87f800 x1830948733741952/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:299/0 lens 488/440 e 0 to 0 dl 1746129569 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129558.706249:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e87f800 with x1830948733741952 ext(1048576->2097151) 00002000:00010000:0.0:1746129558.706253:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e87f800 00000100:00100000:0.0:1746129558.726746:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129558.733191:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129558.738609:0:8412:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15244 00000100:00100000:0.0:1746129558.738618:0:8412:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132c27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+58:3302:x1830948737363968:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129558.738755:0:8412:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132c27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+60:3302:x1830948737363968:12345-0@lo:2:osp-syn-1-0.0 Request processed in 138us (2398us total) trans 17179873934 rc 0/0 00000100:00100000:0.0:1746129558.738761:0:8412:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15244 00000100:00100000:0.0:1746129558.738771:0:8412:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15246 00000100:00100000:0.0:1746129558.738776:0:8412:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132c24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+66:3302:x1830948737364992:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746129558.738845:0:8412:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746129558.738848:0:8412:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1746129558.738850:0:8412:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746129558.738852:0:8412:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746129558.738853:0:8412:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1746129558.738875:0:8412:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132c24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+66:3302:x1830948737364992:12345-0@lo:2:osp-syn-0-0.0 Request processed in 99us (2474us total) trans 21474841163 rc 0/0 00000100:00100000:0.0:1746129558.738881:0:8412:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15246 00000100:00100000:0.0:1746129558.738891:0:8412:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15248 00000100:00100000:0.0:1746129558.738896:0:8412:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132c25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+60:3302:x1830948737364096:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129558.738978:0:8412:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132c25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+60:3302:x1830948737364096:12345-0@lo:2:osp-syn-1-0.0 Request processed in 81us (2509us total) trans 17179873937 rc 0/0 00000100:00100000:0.0:1746129558.738983:0:8412:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15248 00000100:00100000:0.0:1746129558.738995:0:8412:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15250 00000100:00100000:0.0:1746129558.739000:0:8412:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013577ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+65:3302:x1830948737365120:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129558.739088:0:8412:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013577ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+66:3302:x1830948737365120:12345-0@lo:2:osp-syn-0-0.0 Request processed in 80us (2566us total) trans 21474841165 rc 0/0 00000100:00100000:0.0:1746129558.739094:0:8412:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15250 00000004:00080000:0.0:1746129558.739145:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009feed880/2, rc 0, transno 17179873936 00000100:00100000:0.0:1746129558.739150:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009feed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737363584:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129558.739159:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095625f80/2, rc 0, transno 17179873937 00000100:00100000:0.0:1746129558.739162:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095625f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737364096:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129558.739172:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095627480/2, rc 0, transno 21474841164 00000100:00100000:0.0:1746129558.739181:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095627480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737364608:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129558.739188:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e389880/2, rc 0, transno 21474841165 00000100:00100000:0.0:1746129558.739191:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e389880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737365120:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129558.739197:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009feece00/2, rc 0, transno 17179873935 00000100:00100000:0.0:1746129558.739200:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009feece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737363456:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129558.739206:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009feef800/2, rc 0, transno 17179873934 00000100:00100000:0.0:1746129558.739209:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009feef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737363968:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129558.739216:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095625880/2, rc 0, transno 21474841162 00000100:00100000:0.0:1746129558.739218:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095625880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737364480:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129558.739225:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e388e00/2, rc 0, transno 21474841163 00000100:00100000:0.0:1746129558.739228:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e388e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737364992:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129558.739282:0:3301:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1746129558.739291:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a07ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737365376:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129558.739344:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129558.739369:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737365376 00000100:00100000:0.0:1746129558.739376:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737365376 00000100:00100000:0.0:1746129558.739399:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15251 00000100:00100000:0.0:1746129558.739403:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a07aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+66:3301:x1830948737365376:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129558.739498:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a07aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+67:3301:x1830948737365376:12345-0@lo:2:osp-syn-0-0.0 Request processed in 94us (153us total) trans 21474841166 rc 0/0 00000100:00100000:0.0:1746129558.739503:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15251 00000004:00080000:0.0:1746129558.739525:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a07ae300/2, rc 0, transno 21474841166 00000100:00100000:0.0:1746129558.739528:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a07ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737365376:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129558.739542:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129558.739558:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009feefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737363840:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129558.739575:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129558.739584:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095624000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737364352:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129558.739598:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129558.739607:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e38aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737364864:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129558.739621:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746129558.739638:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009feed500/2, rc 0, transno 17179873932 00000100:00100000:0.0:1746129558.739641:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009feed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737363200:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129558.739650:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009feef480/2, rc 0, transno 17179873933 00000100:00100000:0.0:1746129558.739652:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009feef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737363712:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129558.739660:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095627800/2, rc 0, transno 21474841160 00000100:00100000:0.0:1746129558.739662:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095627800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737364224:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129558.739675:0:8411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737363328 00000100:00100000:0.0:1746129558.739677:0:8411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737363328 00000100:00100000:0.0:1746129558.739691:0:8411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737363840 00000100:00100000:0.0:1746129558.739693:0:8411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737363840 00000100:00100000:0.0:1746129558.739701:0:8411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737364352 00000100:00100000:0.0:1746129558.739703:0:8411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737364352 00000100:00100000:0.0:1746129558.739711:0:8411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737364864 00000100:00100000:0.0:1746129558.739712:0:8411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737364864 00000100:00100000:0.0:1746129558.739721:0:8411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15252 00000100:00100000:0.0:1746129558.739725:0:8411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a07adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+60:3300:x1830948737363328:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746129558.739803:0:8411:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746129558.739805:0:8411:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb mtime from disk: 1746129558 -> 1746129558 00002000:00010000:0.0:1746129558.739808:0:8411:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb atime from disk: 1746129558 -> 1746129558 00002000:00010000:0.0:1746129558.739810:0:8411:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb ctime from disk: 1746129558 -> 1746129558 00002000:00010000:0.0:1746129558.739812:0:8411:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746129558.739833:0:8411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a07adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+61:3300:x1830948737363328:12345-0@lo:2:osp-syn-1-0.0 Request processed in 108us (291us total) trans 17179873938 rc 0/0 00000100:00100000:0.0:1746129558.739839:0:8411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15252 00000100:00100000:0.0:1746129558.739849:0:8411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15253 00000100:00100000:0.0:1746129558.739853:0:8411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a07af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+60:3300:x1830948737363840:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129558.739925:0:8411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a07af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+61:3300:x1830948737363840:12345-0@lo:2:osp-syn-1-0.0 Request processed in 71us (348us total) trans 17179873939 rc 0/0 00000100:00100000:0.0:1746129558.739931:0:8411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15253 00000100:00100000:0.0:1746129558.739940:0:8411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15254 00000100:00100000:0.0:1746129558.739944:0:8411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a07adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+68:3300:x1830948737364352:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746129558.740014:0:8411:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746129558.740016:0:8411:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb mtime from disk: 1746129558 -> 1746129558 00002000:00010000:0.0:1746129558.740018:0:8411:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb atime from disk: 1746129558 -> 1746129558 00002000:00010000:0.0:1746129558.740020:0:8411:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb ctime from disk: 1746129558 -> 1746129558 00002000:00010000:0.0:1746129558.740022:0:8411:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746129558.740039:0:8411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a07adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+69:3300:x1830948737364352:12345-0@lo:2:osp-syn-0-0.0 Request processed in 95us (440us total) trans 21474841167 rc 0/0 00000100:00100000:0.0:1746129558.740044:0:8411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15254 00000100:00100000:0.0:1746129558.740053:0:8411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15255 00000100:00100000:0.0:1746129558.740057:0:8411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800912aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+68:3300:x1830948737364864:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129558.740130:0:8411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800912aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+69:3300:x1830948737364864:12345-0@lo:2:osp-syn-0-0.0 Request processed in 73us (508us total) trans 21474841168 rc 0/0 00000100:00100000:0.0:1746129558.740136:0:8411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15255 00000004:00080000:0.0:1746129558.740156:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009feec000/2, rc 0, transno 17179873938 00000100:00100000:0.0:1746129558.740159:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009feec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737363328:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129558.740166:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009feefb80/2, rc 0, transno 17179873939 00000100:00100000:0.0:1746129558.740168:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009feefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737363840:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129558.740174:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095624000/2, rc 0, transno 21474841167 00000100:00100000:0.0:1746129558.740177:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095624000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737364352:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129558.740183:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e38aa00/2, rc 0, transno 21474841168 00000100:00100000:0.0:1746129558.740186:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e38aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737364864:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129558.742678:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095625180/2, rc 0, transno 21474841161 00000100:00100000:0.0:1746129558.742688:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095625180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737364736:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129558.743308:0:2271:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094efd180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:2271:1830948737365248:192.168.202.4@tcp:105: 00010000:00010000:0.0:1746129558.743346:0:2271:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136b3f600/0x40a459093b067999 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f1fa6e expref: 291 pid: 2271 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1746129558.743366:0:2271:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009efb5e00/0x40a459093b0679a0 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.4@tcp remote: 0xda91008773f1fa6e expref: 290 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129558.743401:0:2271:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009efb5e00, rc 0) 00000100:00100000:0.0:1746129558.743653:0:2271:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094efce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ada2ffba-8920-4ecb-8068-68caa9806978+291:31892:x1830948733742720:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 48119us (48249us total) trans 8589945063 rc 0/0 00000100:00100000:0.0:1746129558.743662:0:2271:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11012 00000100:00100000:0.0:1746129558.747287:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129558.755015:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733744000 00000100:00100000:0.0:1746129558.755026:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733744000 00002000:00100000:0.0:1746129558.755077:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff880094efc700 x1830948733744000/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:299/0 lens 488/0 e 0 to 0 dl 1746129569 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129558.755087:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094efc700 with x1830948733744000 ext(1048576->2097151) 00002000:00010000:0.0:1746129558.755092:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094efc700 00000100:00100000:0.0:1746129558.755114:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7315 00000100:00100000:0.0:1746129558.755129:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094efc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+44:1961:x1830948733744000:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129558.777515:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129558.778330:0:31521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2283 00000100:00100000:0.0:1746129558.778338:0:31521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800903a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+30:1961:x1830948733745536:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129558.782062:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129558.782108:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129558.782142:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129558.799599:0:31521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800903a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+32:1961:x1830948733745536:12345-192.168.202.4@tcp:3:cat.0 Request processed in 21261us (21420us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129558.799608:0:31521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2283 00002000:00100000:0.0:1746129558.799617:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff8800903a2a00 x1830948733745536/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:299/0 lens 488/440 e 0 to 0 dl 1746129569 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129558.799626:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800903a2a00 with x1830948733745536 ext(1048576->2097151) 00010000:00010000:0.0:1746129558.799633:0:31521:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800936de000/0x40a459093b0679ed lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fa98 expref: 32 pid: 22481 timeout: 914 lvb_type: 1 00010000:00010000:0.0:1746129558.799645:0:31521:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800936de000/0x40a459093b0679ed lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fa98 expref: 32 pid: 22481 timeout: 914 lvb_type: 1 00002000:00010000:0.0:1746129558.799651:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800903a2a00 00000100:00100000:0.0:1746129558.812464:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129558.817640:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129558.825493:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129558.826881:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129558.835417:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129558.838581:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129558.841788:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129558.841821:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129558.844764:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129558.844814:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129558.846637:0:14545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733748352 00000100:00100000:0.0:1746129558.846641:0:14545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733748352 00000100:00100000:0.0:1746129558.846665:0:14545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 213 00000100:00100000:0.0:1746129558.846671:0:14545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095b4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8b5f81a-2f18-4d7f-accf-308742f5a04f+15:1962:x1830948733748352:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:0.0:1746129558.846703:0:14545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095b4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8b5f81a-2f18-4d7f-accf-308742f5a04f+15:1962:x1830948733748352:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 32us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129558.846708:0:14545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 213 00000100:00100000:0.0:1746129558.851577:0:8415:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ada2ffba-8920-4ecb-8068-68caa9806978+47:1963:x1830948733747712:12345-192.168.202.4@tcp:4:multiop.0 Request processed in 9302us (9749us total) trans 17179873940 rc 0/0 00000100:00100000:0.0:1746129558.851587:0:8415:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2286 00002000:00100000:0.0:1746129558.851594:0:8415:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3f3:0x0] (1368064->1884159) req@ffff88009fbadc00 x1830948733747712/t17179873940(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:299/0 lens 488/448 e 0 to 0 dl 1746129569 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129558.851601:0:8415:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbadc00 with x1830948733747712 ext(1368064->1884159) 00010000:00010000:0.0:1746129558.851609:0:8415:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012e0fd800/0x40a459093b067a10 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1368064->1884159) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fabb expref: 47 pid: 8410 timeout: 914 lvb_type: 0 00010000:00010000:0.0:1746129558.851622:0:8415:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012e0fd800/0x40a459093b067a10 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1368064->1884159) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fabb expref: 47 pid: 8410 timeout: 914 lvb_type: 0 00002000:00010000:0.0:1746129558.851629:0:8415:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fbadc00 00000100:00100000:0.0:1746129558.856631:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129558.860406:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129558.862096:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129558.873369:0:8415:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ada2ffba-8920-4ecb-8068-68caa9806978+36:1962:x1830948733749376:12345-192.168.202.4@tcp:3:cat.0 Request processed in 16565us (16736us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129558.873382:0:8415:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7322 00002000:00100000:0.0:1746129558.873391:0:8415:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3ef:0x0] (2097152->3145727) req@ffff88009fbae680 x1830948733749376/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:299/0 lens 488/440 e 0 to 0 dl 1746129569 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129558.873400:0:8415:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbae680 with x1830948733749376 ext(2097152->3145727) 00010000:00010000:0.0:1746129558.873407:0:8415:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a6cdbc00/0x40a459093b06798b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fa60 expref: 36 pid: 4385 timeout: 914 lvb_type: 1 00010000:00010000:0.0:1746129558.873429:0:8415:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a6cdbc00/0x40a459093b06798b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fa60 expref: 36 pid: 4385 timeout: 914 lvb_type: 1 00002000:00010000:0.0:1746129558.873436:0:8415:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fbae680 00000100:00100000:0.0:1746129558.873813:0:31520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbaea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+30:1963:x1830948733749632:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 13240us (13411us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129558.873819:0:31520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7323 00002000:00100000:0.0:1746129558.873824:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff88009fbaea00 x1830948733749632/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:299/0 lens 488/440 e 0 to 0 dl 1746129569 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129558.873830:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbaea00 with x1830948733749632 ext(1048576->2097151) 00002000:00010000:0.0:1746129558.873833:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fbaea00 00000100:00100000:0.0:1746129558.877786:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129558.878713:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129558.885076:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129558.885099:0:31520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733750272 00000100:00100000:0.0:1746129558.885105:0:31520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733750272 00002000:00100000:0.0:1746129558.885148:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3f5:0x0] (2211840->3145727) req@ffff88009fbaf800 x1830948733750272/t0(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:299/0 lens 488/0 e 0 to 0 dl 1746129569 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129558.885163:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbaf800 with x1830948733750272 ext(2211840->3145727) 00010000:00010000:0.0:1746129558.885171:0:31520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880136438200/0x40a459093b067a1e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2211840->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fac9 expref: 30 pid: 8410 timeout: 914 lvb_type: 0 00010000:00010000:0.0:1746129558.885183:0:31520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880136438200/0x40a459093b067a1e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2211840->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fac9 expref: 30 pid: 8410 timeout: 914 lvb_type: 0 00002000:00010000:0.0:1746129558.885189:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fbaf800 00000100:00100000:0.0:1746129558.885205:0:31520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2287 00000100:00100000:0.0:1746129558.885212:0:31520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+30:1963:x1830948733750272:12345-192.168.202.4@tcp:4:multiop.0 00000100:00100000:0.0:1746129558.891972:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129558.909269:0:31520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+32:1963:x1830948733750272:12345-192.168.202.4@tcp:4:multiop.0 Request processed in 24050us (24187us total) trans 17179873941 rc 0/0 00000100:00100000:0.0:1746129558.909280:0:31520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2287 00002000:00100000:0.0:1746129558.909290:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3f5:0x0] (2211840->3145727) req@ffff88009fbaf800 x1830948733750272/t17179873941(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:299/0 lens 488/448 e 0 to 0 dl 1746129569 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129558.909310:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbaf800 with x1830948733750272 ext(2211840->3145727) 00010000:00010000:0.0:1746129558.909321:0:31520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880136438200/0x40a459093b067a1e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2211840->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fac9 expref: 32 pid: 8410 timeout: 914 lvb_type: 0 00010000:00010000:0.0:1746129558.909336:0:31520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880136438200/0x40a459093b067a1e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2211840->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fac9 expref: 32 pid: 8410 timeout: 914 lvb_type: 0 00002000:00010000:0.0:1746129558.909342:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fbaf800 00000100:00100000:0.0:1746129558.917191:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129558.921493:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129558.929023:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129558.935507:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129558.939852:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129558.939882:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129558.939909:0:8415:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733752064 00000100:00100000:0.0:1746129558.939916:0:8415:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733752064 00002000:00100000:0.0:1746129558.939966:0:8415:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3ef:0x0] (3170304->4194303) req@ffff88009f325880 x1830948733752064/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:299/0 lens 488/0 e 0 to 0 dl 1746129569 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129558.939976:0:8415:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f325880 with x1830948733752064 ext(3170304->4194303) 00010000:00010000:0.0:1746129558.939986:0:8415:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f379600/0x40a459093b067a33 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3170303) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fade expref: 23 pid: 8412 timeout: 914 lvb_type: 0 00010000:00010000:0.0:1746129558.940000:0:8415:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f379600/0x40a459093b067a33 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3170303) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fade expref: 23 pid: 8412 timeout: 914 lvb_type: 0 00002000:00010000:0.0:1746129558.940007:0:8415:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f325880 00000100:00100000:0.0:1746129558.940038:0:8415:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733752192 00000100:00100000:0.0:1746129558.940041:0:8415:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733752192 00002000:00100000:0.0:1746129558.940055:0:8415:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3f5:0x0] (2097152->3145727) req@ffff88012ea92a00 x1830948733752192/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:299/0 lens 488/0 e 0 to 0 dl 1746129569 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129558.940062:0:8415:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ea92a00 with x1830948733752192 ext(2097152->3145727) 00002000:00010000:0.0:1746129558.940066:0:8415:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ea92a00 00000100:00100000:0.0:1746129558.965654:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129558.974762:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129558.974814:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129558.975008:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129558.986143:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129558.986205:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129558.986272:0:14547:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733753856 00000100:00100000:0.0:1746129558.986281:0:14547:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733753856 00000100:00100000:0.0:1746129558.986368:0:14547:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11017 00000100:00100000:0.0:1746129558.986377:0:14547:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009feed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ada2ffba-8920-4ecb-8068-68caa9806978+291:31900:x1830948733753856:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:0.0:1746129558.986403:0:14547:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129558.986436:0:14547:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f384a00/0x40a459093b067a56 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f1fb01 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129558.986558:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f385600/0x40a459093b067a5d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129558.986573:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f385600/0x40a459093b067a5d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129558.986584:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f385600/0x40a459093b067a5d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129558.986597:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f384600/0x40a459093b067a64 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129558.986602:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f384600/0x40a459093b067a64 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129558.986606:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f384600/0x40a459093b067a64 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129558.989219:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f385800/0x40a459093b067a6b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129558.989234:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f385800/0x40a459093b067a6b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129558.989247:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f385800/0x40a459093b067a6b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00000004:00200000:0.0:1746129558.989258:0:14547:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:0.0:1746129558.989372:0:14547:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f385600/0x40a459093b067a5d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129558.989379:0:14547:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f385600/0x40a459093b067a5d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129558.989384:0:14547:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f385600/0x40a459093b067a5d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129558.989388:0:14547:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f385600 already unused, calling callback (ffffffffa136e690) 00010000:00010000:0.0:1746129558.989391:0:14547:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f385600/0x40a459093b067a5d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129558.989397:0:14547:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f385600/0x40a459093b067a5d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129558.989409:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880132ef8f00) 00010000:00010000:0.0:1746129558.989411:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129558.989415:0:14547:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f385600/0x40a459093b067a5d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129558.989433:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f385600/0x40a459093b067a5d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129558.989458:0:14547:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f384600/0x40a459093b067a64 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129558.989462:0:14547:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f384600/0x40a459093b067a64 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129558.989471:0:14547:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f384600/0x40a459093b067a64 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129558.989475:0:14547:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f384600 already unused, calling callback (ffffffffa136e690) 00010000:00010000:0.0:1746129558.989478:0:14547:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f384600/0x40a459093b067a64 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129558.989482:0:14547:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f384600/0x40a459093b067a64 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129558.989489:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f9f3000) 00010000:00010000:0.0:1746129558.989491:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129558.989493:0:14547:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f384600/0x40a459093b067a64 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129558.989497:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f384600/0x40a459093b067a64 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129558.989545:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f384a00/0x40a459093b067a56 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f1fb01 expref: 294 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129558.989557:0:14547:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f385800/0x40a459093b067a6b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f1fb01 expref: 293 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129558.989563:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009c36a600) 00010000:00010000:0.0:1746129558.989564:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746129558.989567:0:14547:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f385800, rc 0) 00000100:00100000:0.0:1746129558.989627:0:14547:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009feed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ada2ffba-8920-4ecb-8068-68caa9806978+293:31900:x1830948733753856:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 3250us (3420us total) trans 8589945067 rc 0/0 00000100:00100000:0.0:1746129558.989642:0:14547:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11017 00000100:00100000:0.0:1746129558.990671:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+45:1962:x1830948733753216:12345-192.168.202.4@tcp:3:cat.0 Request processed in 15204us (15854us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129558.990679:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7329 00002000:00100000:0.0:1746129558.990688:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f5:0x0] (3145728->4194303) req@ffff880091b04e00 x1830948733753216/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:299/0 lens 488/440 e 0 to 0 dl 1746129569 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129558.990697:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091b04e00 with x1830948733753216 ext(3145728->4194303) 00002000:00010000:0.0:1746129558.990702:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091b04e00 00000100:00100000:0.0:1746129558.999206:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129559.002962:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129559.003015:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00080000:0.0:1746129559.003202:0:7097:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1746129559.003206:0:7097:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746129559.011184:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129559.011229:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129559.011258:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129559.020637:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129559.020693:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00080000:0.0:1746129559.022375:0:7097:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746129559.025782:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129559.031446:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129559.031511:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129559.031601:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129559.044625:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129559.053124:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129559.071240:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00080000:0.0:1746129559.072791:0:7097:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746129559.093492:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129559.118733:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129559.123164:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129559.128832:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129559.161477:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129559.161518:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129559.162040:0:14547:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733757952 00000100:00100000:0.0:1746129559.162050:0:14547:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733757952 00000100:00100000:0.0:1746129559.162100:0:14547:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11019 00000100:00100000:0.0:1746129559.162109:0:14547:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f95bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ada2ffba-8920-4ecb-8068-68caa9806978+295:31908:x1830948733757952:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129559.162134:0:14547:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129559.162152:0:14547:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0fca00/0x40a459093b067ab8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f1fb2b expref: -99 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129559.162254:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0fde00/0x40a459093b067abf lrc: 3/1,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129559.162269:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0fde00/0x40a459093b067abf lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129559.162280:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0fde00/0x40a459093b067abf lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00000004:00200000:0.0:1746129559.162290:0:14547:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:0.0:1746129559.162971:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0fca00/0x40a459093b067ab8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f1fb2b expref: 298 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129559.162997:0:14547:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0fde00/0x40a459093b067abf lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f1fb2b expref: 297 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129559.163006:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009c36a600) 00010000:00010000:0.0:1746129559.163009:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1746129559.163013:0:14547:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e0fde00, rc 0) 00000100:00100000:0.0:1746129559.163067:0:14547:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f95bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ada2ffba-8920-4ecb-8068-68caa9806978+297:31908:x1830948733757952:12345-192.168.202.4@tcp:101:cat.0 Request processed in 959us (1600us total) trans 8589945072 rc 0/0 00000100:00100000:0.0:1746129559.163074:0:14547:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11019 00000100:00100000:0.0:1746129559.163243:0:8412:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733758080 00000100:00100000:0.0:1746129559.163248:0:8412:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733758080 00000100:00100000:0.0:1746129559.163273:0:8412:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15276 00000100:00100000:0.0:1746129559.163278:0:8412:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f958380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+25:31902:x1830948733758080:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:0.0:1746129559.163288:0:8412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129559.163321:0:8412:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e0fc600/0x40a459093b067acd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f1fb32 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129559.163341:0:8412:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f379800/0x40a459093b067a48 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f1faf3 expref: 35 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129559.163350:0:8412:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880136439c00/0x40a459093b067a4f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f1fafa expref: 26 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129559.163357:0:8412:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129559.163358:0:8412:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129559.163362:0:8412:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e0fc600/0x40a459093b067acd lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [3145728->3231743] (req 3145728->3231743) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f1fb32 expref: 26 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129559.163392:0:8412:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880136439c00/0x40a459093b067a4f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fafa expref: 26 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129559.163404:0:8412:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880136439c00/0x40a459093b067a4f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fafa expref: 26 pid: 8412 timeout: 914 lvb_type: 0 00000100:00100000:0.0:1746129559.163434:0:8412:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f95ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8412:1830948737368576:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129559.163498:0:8412:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f379800/0x40a459093b067a48 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f1faf3 expref: 35 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129559.163506:0:8412:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f379800/0x40a459093b067a48 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f1faf3 expref: 35 pid: 8412 timeout: 914 lvb_type: 0 00000100:00100000:0.0:1746129559.163515:0:8412:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f958000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8412:1830948737368704:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129559.163533:0:8412:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009cdf3f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746129559.164284:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129559.169694:0:2271:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733758336 00000100:00100000:0.0:1746129559.169709:0:2271:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733758336 00000100:00100000:0.0:1746129559.169771:0:2271:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11020 00000100:00100000:0.0:1746129559.169779:0:2271:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013145e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ada2ffba-8920-4ecb-8068-68caa9806978+297:31911:x1830948733758336:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:0.0:1746129559.169800:0:2271:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129559.169820:0:2271:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009faee000/0x40a459093b067ad4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f1fb39 expref: -99 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129559.169921:0:2271:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009faee200/0x40a459093b067adb lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129559.169936:0:2271:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0fd600/0x40a459093b0679d8 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f1fa83 expref: 12 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129559.169944:0:2271:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f385800/0x40a459093b067a6b lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f1fb01 expref: 298 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129559.169952:0:2271:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b811400/0x40a459093b067aa3 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f1fb1d expref: 12 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129559.169958:0:2271:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009faee200/0x40a459093b067adb lrc: 6/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129559.169992:0:2271:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009b811400/0x40a459093b067aa3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fb1d expref: 12 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129559.170002:0:2271:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b811400/0x40a459093b067aa3 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fb1d expref: 12 pid: 14547 timeout: 914 lvb_type: 0 00000100:00100000:0.0:1746129559.170015:0:2271:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013145df80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:2271:1830948737368832:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129559.170111:0:2271:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f385800/0x40a459093b067a6b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fb01 expref: 298 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129559.170120:0:2271:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f385800/0x40a459093b067a6b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fb01 expref: 298 pid: 14547 timeout: 914 lvb_type: 0 00000100:00100000:0.0:1746129559.170128:0:2271:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013145f800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:2271:1830948737368960:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129559.170154:0:2271:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0fd600/0x40a459093b0679d8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fa83 expref: 12 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129559.170160:0:2271:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0fd600/0x40a459093b0679d8 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fa83 expref: 12 pid: 14547 timeout: 914 lvb_type: 0 00000100:00100000:0.0:1746129559.170168:0:2271:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013145ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:2271:1830948737369088:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129559.170188:0:2271:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009cdf3b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746129559.180399:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129559.180430:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129559.180489:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129559.180511:0:7086:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733758464 00000100:00100000:0.0:1746129559.180517:0:7086:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733758464 00010000:00010000:0.0:1746129559.180552:0:7086:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880136439c00/0x40a459093b067a4f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fafa expref: 27 pid: 8412 timeout: 914 lvb_type: 0 00000100:00100000:0.0:1746129559.180576:0:7086:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733758720 00000100:00100000:0.0:1746129559.180578:0:7086:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733758720 00010000:00010000:0.0:1746129559.180588:0:7086:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f379800/0x40a459093b067a48 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f1faf3 expref: 36 pid: 8412 timeout: 914 lvb_type: 0 00000100:00100000:0.0:1746129559.180604:0:7086:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7784 00000100:00100000:0.0:1746129559.180611:0:7086:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013145ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+27:1961:x1830948733758464:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129559.180623:0:7086:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129559.180647:0:7086:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880136439c00/0x40a459093b067a4f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fafa expref: 27 pid: 8412 timeout: 914 lvb_type: 0 00010000:00010000:0.0:1746129559.180658:0:7086:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880136439c00/0x40a459093b067a4f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fafa expref: 27 pid: 8412 timeout: 914 lvb_type: 0 00010000:00010000:0.0:1746129559.180680:0:7086:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136439c00/0x40a459093b067a4f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fafa expref: 27 pid: 8412 timeout: 914 lvb_type: 0 00010000:00010000:0.0:1746129559.182852:0:7086:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129559.182904:0:7086:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013145ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+25:1961:x1830948733758464:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 2289us (2481us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129559.182913:0:7086:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7784 00000100:00100000:0.0:1746129559.182941:0:7086:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7785 00000100:00100000:0.0:1746129559.182950:0:7086:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013145c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ada2ffba-8920-4ecb-8068-68caa9806978+36:1963:x1830948733758720:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129559.182963:0:7086:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129559.182984:0:7086:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f379800/0x40a459093b067a48 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f1faf3 expref: 36 pid: 8412 timeout: 914 lvb_type: 0 00010000:00010000:0.0:1746129559.182994:0:7086:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f379800/0x40a459093b067a48 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f1faf3 expref: 36 pid: 8412 timeout: 914 lvb_type: 0 00010000:00010000:0.0:1746129559.183013:0:7086:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f379800/0x40a459093b067a48 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f1faf3 expref: 36 pid: 8412 timeout: 914 lvb_type: 0 00010000:00010000:0.0:1746129559.183021:0:7086:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129559.183023:0:7086:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129559.183029:0:7086:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012e0fc600/0x40a459093b067acd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3231743) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f1fb32 expref: 24 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129559.183037:0:7086:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e0fc600/0x40a459093b067acd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3231743) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f1fb32 expref: 24 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129559.183065:0:7086:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012e0fc600/0x40a459093b067acd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3231743) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f1fb32 expref: 24 pid: 8412 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129559.183076:0:7086:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013145e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7086:1830948737369344:192.168.202.4@tcp:105: 00000100:00100000:0.0:1746129559.183128:0:7086:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009cdf39c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129559.183336:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129559.183348:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129559.183369:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129559.183383:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733758848 00000100:00100000:0.0:1746129559.183389:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733758848 00010000:00010000:0.0:1746129559.183406:0:9823:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b811400/0x40a459093b067aa3 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fb1d expref: 13 pid: 14547 timeout: 914 lvb_type: 0 00000100:00100000:0.0:1746129559.183436:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733759104 00000100:00100000:0.0:1746129559.183438:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733759104 00010000:00010000:0.0:1746129559.183447:0:9823:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0fd600/0x40a459093b0679d8 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fa83 expref: 14 pid: 14547 timeout: 914 lvb_type: 0 00000100:00100000:0.0:1746129559.183457:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733758976 00000100:00100000:0.0:1746129559.183458:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733758976 00010000:00010000:0.0:1746129559.183466:0:9823:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f385800/0x40a459093b067a6b lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fb01 expref: 299 pid: 14547 timeout: 914 lvb_type: 0 00000100:00100000:0.0:1746129559.183475:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7786 00000100:00100000:0.0:1746129559.183479:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6ce3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+14:1960:x1830948733758848:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129559.183486:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129559.183490:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009b811400/0x40a459093b067aa3 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fb1d expref: 14 pid: 14547 timeout: 914 lvb_type: 0 00010000:00010000:0.0:1746129559.183497:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009b811400/0x40a459093b067aa3 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fb1d expref: 14 pid: 14547 timeout: 914 lvb_type: 0 00010000:00010000:0.0:1746129559.183509:0:9823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009c36a600) 00010000:00010000:0.0:1746129559.183515:0:9823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009faee200/0x40a459093b067adb lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129559.183522:0:9823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009faee200/0x40a459093b067adb lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129559.183527:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129559.183544:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6ce3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+14:1960:x1830948733758848:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 64us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129559.183549:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7786 00000100:00100000:0.0:1746129559.183558:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7787 00000100:00100000:0.0:1746129559.183561:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013145f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+13:1960:x1830948733759104:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129559.183567:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129559.183570:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0fd600/0x40a459093b0679d8 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fa83 expref: 13 pid: 14547 timeout: 914 lvb_type: 0 00010000:00010000:0.0:1746129559.183577:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0fd600/0x40a459093b0679d8 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fa83 expref: 13 pid: 14547 timeout: 914 lvb_type: 0 00010000:00010000:0.0:1746129559.183585:0:9823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009c36a600) 00010000:00010000:0.0:1746129559.183587:0:9823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009faee200/0x40a459093b067adb lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129559.183592:0:9823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009faee200/0x40a459093b067adb lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129559.183595:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129559.183605:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013145f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+13:1960:x1830948733759104:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 44us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129559.183609:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7787 00000100:00100000:0.0:1746129559.183617:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7788 00000100:00100000:0.0:1746129559.183621:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013145fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ada2ffba-8920-4ecb-8068-68caa9806978+299:1960:x1830948733758976:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129559.183626:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129559.183629:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f385800/0x40a459093b067a6b lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fb01 expref: 299 pid: 14547 timeout: 914 lvb_type: 0 00010000:00010000:0.0:1746129559.183636:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f385800/0x40a459093b067a6b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fb01 expref: 299 pid: 14547 timeout: 914 lvb_type: 0 00010000:00010000:0.0:1746129559.183645:0:9823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009c36a600) 00010000:00010000:0.0:1746129559.183648:0:9823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009faee200/0x40a459093b067adb lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129559.183653:0:9823:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009faee200/0x40a459093b067adb lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129559.183658:0:9823:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009faee200/0x40a459093b067adb lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129559.183669:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129559.183678:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013145fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ada2ffba-8920-4ecb-8068-68caa9806978+299:1960:x1830948733758976:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 57us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129559.183683:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7788 00010000:00010000:0.0:1746129559.183767:0:2271:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b811400/0x40a459093b067aa3 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fb1d expref: 12 pid: 14547 timeout: 914 lvb_type: 0 00000100:00100000:0.0:1746129559.183780:0:2271:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013145df80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:2271:1830948737368832:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129559.183789:0:2271:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f385800/0x40a459093b067a6b lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fb01 expref: 298 pid: 14547 timeout: 914 lvb_type: 0 00000100:00100000:0.0:1746129559.183803:0:2271:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013145f800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:2271:1830948737368960:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129559.183811:0:2271:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0fd600/0x40a459093b0679d8 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fa83 expref: 11 pid: 14547 timeout: 914 lvb_type: 0 00000100:00100000:0.0:1746129559.183818:0:2271:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013145ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:2271:1830948737369088:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129559.183839:0:2271:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009faee200/0x40a459093b067adb lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129559.183846:0:2271:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009faee200/0x40a459093b067adb lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129559.183851:0:2271:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009faee200/0x40a459093b067adb lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00000004:00200000:0.0:1746129559.183869:0:2271:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:0.0:1746129559.183997:0:2271:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009faee000/0x40a459093b067ad4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f1fb39 expref: 299 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129559.184008:0:2271:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009faee200/0x40a459093b067adb lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f1fb39 expref: 298 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129559.184014:0:2271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009c36a600) 00010000:00010000:0.0:1746129559.184016:0:2271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746129559.184018:0:2271:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009faee200, rc 0) 00000100:00100000:0.0:1746129559.184040:0:2271:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013145e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ada2ffba-8920-4ecb-8068-68caa9806978+298:31911:x1830948733758336:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 14263us (19761us total) trans 8589945073 rc 0/0 00000100:00100000:0.0:1746129559.184046:0:2271:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11020 00000100:00100000:0.0:1746129559.184115:0:8412:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800903a0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8412:1830948737369216:192.168.202.4@tcp:106: 00010000:00010000:0.0:1746129559.184133:0:8412:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095eb8a00/0x40a459093b067ae2 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f1fb40 expref: 48 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129559.184142:0:8412:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095eb8a00/0x40a459093b067ae2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f1fb40 expref: 48 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129559.184149:0:8412:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095eb8a00, rc 0) 00000100:00100000:0.0:1746129559.184168:0:8412:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013145dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ada2ffba-8920-4ecb-8068-68caa9806978+47:1962:x1830948733758592:12345-192.168.202.4@tcp:101:cat.0 Request processed in 3165us (3772us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129559.184174:0:8412:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15277 00000100:00100000:0.0:1746129559.192819:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129559.192873:0:7086:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013145e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7086:1830948737369344:192.168.202.4@tcp:105: 00010000:00010000:0.0:1746129559.192898:0:7086:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129559.192946:0:7086:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013145c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ada2ffba-8920-4ecb-8068-68caa9806978+35:1963:x1830948733758720:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 9997us (12455us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129559.192957:0:7086:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7785 00000100:00100000:0.0:1746129559.193905:0:31520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733759360 00000100:00100000:0.0:1746129559.193914:0:31520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733759360 00002000:00100000:0.0:1746129559.193957:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3ef:0x0] (3227648->3231743) req@ffff88013145ea00 x1830948733759360/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:300/0 lens 488/0 e 0 to 0 dl 1746129570 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129559.193967:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013145ea00 with x1830948733759360 ext(3227648->3231743) 00002000:00010000:0.0:1746129559.193972:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013145ea00 00000100:00100000:0.0:1746129559.193998:0:21463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7336 00000100:00100000:0.0:1746129559.194005:0:21463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013145ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+25:1963:x1830948733759360:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:0.0:1746129559.194162:0:21463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013145ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+25:1963:x1830948733759360:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 157us (1354us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746129559.194168:0:21463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7336 00002000:00100000:0.0:1746129559.194173:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3ef:0x0] (3227648->3231743) req@ffff88013145ea00 x1830948733759360/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:300/0 lens 488/4536 e 0 to 0 dl 1746129570 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129559.194180:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013145ea00 with x1830948733759360 ext(3227648->3231743) 00002000:00010000:0.0:1746129559.194183:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013145ea00 00000100:00100000:0.0:1746129559.198359:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129559.199476:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129559.199897:0:8412:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733759744 00000100:00100000:0.0:1746129559.199907:0:8412:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733759744 00000100:00100000:0.0:1746129559.199953:0:8412:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15278 00000100:00100000:0.0:1746129559.199961:0:8412:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013145c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ada2ffba-8920-4ecb-8068-68caa9806978+47:31911:x1830948733759744:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:0.0:1746129559.199979:0:8412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129559.199996:0:8412:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129bcfc00/0x40a459093b067af0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f1fb47 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129559.200023:0:8412:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d811200/0x40a459093b067984 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f1fa52 expref: 48 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129559.200031:0:8412:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800936de200/0x40a459093b0679f4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f1fa9f expref: 31 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129559.200036:0:8412:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129559.200037:0:8412:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129559.200040:0:8412:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129bcfc00/0x40a459093b067af0 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [1384448->1548287] (req 1384448->1548287) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f1fb47 expref: 48 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129559.200068:0:8412:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800936de200/0x40a459093b0679f4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fa9f expref: 31 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129559.200078:0:8412:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800936de200/0x40a459093b0679f4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fa9f expref: 31 pid: 22481 timeout: 914 lvb_type: 1 00000100:00100000:0.0:1746129559.200089:0:8412:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013145e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8412:1830948737369472:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129559.200166:0:8412:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d811200/0x40a459093b067984 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fa52 expref: 48 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129559.200174:0:8412:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d811200/0x40a459093b067984 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fa52 expref: 48 pid: 7149 timeout: 914 lvb_type: 1 00000100:00100000:0.0:1746129559.200182:0:8412:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013145f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8412:1830948737369600:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129559.200199:0:8412:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009cdf3b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746129559.200662:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129559.200741:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129559.200936:0:21463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733760000 00000100:00100000:0.0:1746129559.200940:0:21463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733760000 00002000:00100000:0.0:1746129559.200967:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3ec:0x0] (0->1048575) req@ffff88013145df80 x1830948733760000/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:300/0 lens 488/0 e 0 to 0 dl 1746129570 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129559.200976:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013145df80 with x1830948733760000 ext(0->1048575) 00002000:00010000:0.0:1746129559.200980:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013145df80 00000100:00100000:0.0:1746129559.200993:0:21463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733760256 00000100:00100000:0.0:1746129559.200996:0:21463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733760256 00002000:00100000:0.0:1746129559.201006:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff88013145f100 x1830948733760256/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:300/0 lens 488/0 e 0 to 0 dl 1746129570 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129559.201013:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013145f100 with x1830948733760256 ext(1048576->2097151) 00002000:00010000:0.0:1746129559.201016:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013145f100 00000100:00100000:0.0:1746129559.201028:0:21463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7337 00000100:00100000:0.0:1746129559.201033:0:21463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013145df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ada2ffba-8920-4ecb-8068-68caa9806978+35:1962:x1830948733760000:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:0.0:1746129559.203647:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7338 00000100:00100000:0.0:1746129559.203661:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013145f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+49:1962:x1830948733760256:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:0.0:1746129559.226770:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129559.226786:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129559.226885:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129559.226911:0:15749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733760384 00000100:00100000:0.0:1746129559.226919:0:15749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733760384 00010000:00010000:0.0:1746129559.226955:0:15749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800936de200/0x40a459093b0679f4 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fa9f expref: 32 pid: 22481 timeout: 914 lvb_type: 1 00000100:00100000:0.0:1746129559.226980:0:15749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733760512 00000100:00100000:0.0:1746129559.226981:0:15749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733760512 00010000:00010000:0.0:1746129559.226991:0:15749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d811200/0x40a459093b067984 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fa52 expref: 51 pid: 7149 timeout: 914 lvb_type: 1 00000100:00100000:0.0:1746129559.227005:0:15749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7789 00000100:00100000:0.0:1746129559.227012:0:15749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013145ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+32:1960:x1830948733760384:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129559.227026:0:15749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129559.227049:0:15749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800936de200/0x40a459093b0679f4 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fa9f expref: 32 pid: 22481 timeout: 914 lvb_type: 1 00010000:00010000:0.0:1746129559.227062:0:15749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800936de200/0x40a459093b0679f4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fa9f expref: 32 pid: 22481 timeout: 914 lvb_type: 1 00010000:00010000:0.0:1746129559.227088:0:15749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129559.227128:0:15749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013145ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+32:1960:x1830948733760384:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 116us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129559.227134:0:15749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7789 00000100:00100000:0.0:1746129559.227150:0:15749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7790 00000100:00100000:0.0:1746129559.227155:0:15749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013145d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ada2ffba-8920-4ecb-8068-68caa9806978+51:1960:x1830948733760512:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129559.227161:0:15749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129559.227168:0:15749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d811200/0x40a459093b067984 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fa52 expref: 51 pid: 7149 timeout: 914 lvb_type: 1 00010000:00010000:0.0:1746129559.227175:0:15749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d811200/0x40a459093b067984 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fa52 expref: 51 pid: 7149 timeout: 914 lvb_type: 1 00010000:00010000:0.0:1746129559.227186:0:15749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129559.227188:0:15749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129559.227195:0:15749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129bcfc00/0x40a459093b067af0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1384448->1548287) gid 0 flags: 0x50080000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f1fb47 expref: 51 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129559.227202:0:15749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129bcfc00/0x40a459093b067af0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1384448->1548287) gid 0 flags: 0x50080000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f1fb47 expref: 51 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129559.227231:0:15749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880129bcfc00/0x40a459093b067af0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1384448->1548287) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f1fb47 expref: 51 pid: 8412 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129559.227243:0:15749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ca86300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15749:1830948737369728:192.168.202.4@tcp:105: 00000100:00100000:0.0:1746129559.227316:0:15749:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009cdf30c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129559.227343:0:2271:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733760768 00000100:00100000:0.0:1746129559.227345:0:2271:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733760768 00000100:00100000:0.0:1746129559.227367:0:2271:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11021 00000100:00100000:0.0:1746129559.227372:0:2271:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+12:31914:x1830948733760768:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129559.227391:0:2271:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129559.227404:0:2271:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009011fe00/0x40a459093b067af7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f1fb4e expref: -99 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129559.227511:0:2271:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009011e600/0x40a459093b067afe lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129559.227522:0:2271:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009011e600/0x40a459093b067afe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129559.227531:0:2271:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009011e600/0x40a459093b067afe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129559.227542:0:2271:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009011f200/0x40a459093b067b05 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129559.227546:0:2271:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009011f200/0x40a459093b067b05 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129559.227551:0:2271:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009011f200/0x40a459093b067b05 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129559.230761:0:2271:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009011e400/0x40a459093b067b0c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129559.230781:0:2271:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009011e400/0x40a459093b067b0c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129559.230793:0:2271:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009011e400/0x40a459093b067b0c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00000004:00200000:0.0:1746129559.230806:0:2271:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:0.0:1746129559.230902:0:2271:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009011e600/0x40a459093b067afe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129559.230909:0:2271:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009011e600/0x40a459093b067afe lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129559.230914:0:2271:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009011e600/0x40a459093b067afe lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129559.230920:0:2271:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009011e600 already unused, calling callback (ffffffffa136e690) 00010000:00010000:0.0:1746129559.230924:0:2271:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009011e600/0x40a459093b067afe lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129559.230929:0:2271:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009011e600/0x40a459093b067afe lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129559.230940:0:2271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880132ef8f00) 00010000:00010000:0.0:1746129559.230944:0:2271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129559.230947:0:2271:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009011e600/0x40a459093b067afe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129559.230952:0:2271:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009011e600/0x40a459093b067afe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129559.230970:0:2271:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009011f200/0x40a459093b067b05 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129559.230978:0:2271:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009011f200/0x40a459093b067b05 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129559.230982:0:2271:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009011f200/0x40a459093b067b05 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129559.230985:0:2271:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009011f200 already unused, calling callback (ffffffffa136e690) 00010000:00010000:0.0:1746129559.230987:0:2271:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009011f200/0x40a459093b067b05 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129559.230991:0:2271:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009011f200/0x40a459093b067b05 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129559.230996:0:2271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800900d1300) 00010000:00010000:0.0:1746129559.230999:0:2271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129559.231000:0:2271:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009011f200/0x40a459093b067b05 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129559.231004:0:2271:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009011f200/0x40a459093b067b05 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129559.231054:0:2271:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009011fe00/0x40a459093b067af7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f1fb4e expref: 15 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129559.231064:0:2271:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009011e400/0x40a459093b067b0c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f1fb4e expref: 14 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129559.231070:0:2271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009c36a600) 00010000:00010000:0.0:1746129559.231071:0:2271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746129559.231074:0:2271:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009011e400, rc 0) 00000100:00100000:0.0:1746129559.231135:0:2271:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+14:31914:x1830948733760768:12345-192.168.202.4@tcp:101:cat.0 Request processed in 3761us (4248us total) trans 8589945075 rc 0/0 00000100:00100000:0.0:1746129559.231145:0:2271:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11021 00010000:00010000:0.0:1746129559.231218:0:8412:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800936de200/0x40a459093b0679f4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fa9f expref: 31 pid: 22481 timeout: 914 lvb_type: 1 00000100:00100000:0.0:1746129559.231230:0:8412:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013145e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8412:1830948737369472:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129559.231244:0:8412:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d811200/0x40a459093b067984 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fa52 expref: 51 pid: 7149 timeout: 914 lvb_type: 1 00000100:00100000:0.0:1746129559.231252:0:8412:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013145f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8412:1830948737369600:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129559.231276:0:8412:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129bcfc00/0x40a459093b067af0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1384448->1548287) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f1fb47 expref: 50 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129559.231285:0:8412:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129bcfc00, rc 0) 00000100:00100000:0.0:1746129559.231325:0:8412:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013145c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ada2ffba-8920-4ecb-8068-68caa9806978+50:31911:x1830948733759744:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 31365us (31850us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129559.231332:0:8412:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15278 00000100:00100000:0.0:1746129559.235458:0:21463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013145df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ada2ffba-8920-4ecb-8068-68caa9806978+35:1962:x1830948733760000:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 34412us (34784us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129559.235470:0:21463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7337 00002000:00100000:0.0:1746129559.235483:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3ec:0x0] (0->1048575) req@ffff88013145df80 x1830948733760000/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:300/0 lens 488/440 e 0 to 0 dl 1746129570 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129559.235493:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013145df80 with x1830948733760000 ext(0->1048575) 00002000:00010000:0.0:1746129559.235499:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013145df80 00000100:00100000:0.0:1746129559.236173:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013145f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+48:1962:x1830948733760256:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 32515us (35431us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129559.236179:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7338 00002000:00100000:0.0:1746129559.236184:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff88013145f100 x1830948733760256/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:300/0 lens 488/440 e 0 to 0 dl 1746129570 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129559.236191:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013145f100 with x1830948733760256 ext(1048576->2097151) 00002000:00010000:0.0:1746129559.236194:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013145f100 00000100:00100000:0.0:1746129559.239800:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129559.239826:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129559.239867:0:15749:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ca86300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15749:1830948737369728:192.168.202.4@tcp:105: 00010000:00010000:0.0:1746129559.240480:0:15749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129559.240511:0:8412:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733760896 00000100:00100000:0.0:1746129559.240517:0:8412:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733760896 00000100:00100000:0.0:1746129559.240676:0:8412:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15279 00000100:00100000:0.0:1746129559.240779:0:8412:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+31:1963:x1830948733760896:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129559.240797:0:8412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129559.240814:0:8412:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009011f800/0x40a459093b067b1a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f1fb55 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129559.240862:0:8412:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ca86300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8412:1830948737369856:192.168.202.4@tcp:106: 00000100:00100000:0.0:1746129559.241536:0:8412:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009cdf30c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129559.241566:0:15749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013145d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ada2ffba-8920-4ecb-8068-68caa9806978+47:1960:x1830948733760512:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 14410us (14778us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129559.241575:0:15749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7790 00000100:00100000:0.0:1746129559.241763:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733761152 00000100:00100000:0.0:1746129559.241768:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733761152 00002000:00100000:0.0:1746129559.241796:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f4:0x0] (1384448->1388543) req@ffff88009ca85880 x1830948733761152/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:300/0 lens 488/0 e 0 to 0 dl 1746129570 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129559.241950:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca85880 with x1830948733761152 ext(1384448->1388543) 00002000:00010000:0.0:1746129559.241955:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ca85880 00000100:00100000:0.0:1746129559.241970:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7339 00000100:00100000:0.0:1746129559.241976:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+47:1963:x1830948733761152:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:0.0:1746129559.242107:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+47:1963:x1830948733761152:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 131us (2279us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746129559.242113:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7339 00002000:00100000:0.0:1746129559.242118:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f4:0x0] (1384448->1388543) req@ffff88009ca85880 x1830948733761152/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:300/0 lens 488/4536 e 0 to 0 dl 1746129570 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129559.242124:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca85880 with x1830948733761152 ext(1384448->1388543) 00002000:00010000:0.0:1746129559.242127:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ca85880 00002000:00010000:0.0:1746129559.257622:0:8412:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb mtime: 1746129558 -> 1746129559 00002000:00010000:0.0:1746129559.257628:0:8412:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb atime: 1746129558 -> 1746129559 00002000:00010000:0.0:1746129559.257630:0:8412:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb ctime: 1746129558 -> 1746129559 00000100:00100000:0.0:1746129559.257655:0:8412:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ca86300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8412:1830948737369856:192.168.202.4@tcp:106: 00010000:00010000:0.0:1746129559.257686:0:8412:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009011f800/0x40a459093b067b1a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f1fb55 expref: 32 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129559.257700:0:8412:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009011f800/0x40a459093b067b1a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f1fb55 expref: 32 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129559.257711:0:8412:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009011f800, rc 0) 00000100:00100000:0.0:1746129559.257754:0:8412:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+31:1963:x1830948733760896:12345-192.168.202.4@tcp:101:cat.0 Request processed in 16976us (17961us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129559.257764:0:8412:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15279 00000100:00100000:0.0:1746129559.261331:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129559.261369:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129559.261395:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733761408 00000100:00100000:0.0:1746129559.261404:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733761408 00002000:00100000:0.0:1746129559.261465:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f4:0x0] (1544192->1548287) req@ffff88009ca86300 x1830948733761408/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:300/0 lens 488/0 e 0 to 0 dl 1746129570 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129559.261475:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca86300 with x1830948733761408 ext(1544192->1548287) 00002000:00010000:0.0:1746129559.261480:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ca86300 00000100:00100000:0.0:1746129559.261497:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733761536 00000100:00100000:0.0:1746129559.261500:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733761536 00002000:00100000:0.0:1746129559.261510:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f4:0x0] (1048576->1384447) req@ffff88013145f800 x1830948733761536/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:300/0 lens 488/0 e 0 to 0 dl 1746129570 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129559.261516:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013145f800 with x1830948733761536 ext(1048576->1384447) 00002000:00010000:0.0:1746129559.261519:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013145f800 00000100:00100000:0.0:1746129559.261530:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7340 00000100:00100000:0.0:1746129559.261537:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+48:1962:x1830948733761408:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:0.0:1746129559.264098:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+48:1962:x1830948733761408:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 2552us (2767us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746129559.264109:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7340 00002000:00100000:0.0:1746129559.264118:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f4:0x0] (1544192->1548287) req@ffff88009ca86300 x1830948733761408/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:300/0 lens 488/4536 e 0 to 0 dl 1746129570 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129559.264127:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca86300 with x1830948733761408 ext(1544192->1548287) 00002000:00010000:0.0:1746129559.264132:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ca86300 00000100:00100000:0.0:1746129559.264159:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7341 00000100:00100000:0.0:1746129559.264167:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013145f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+47:1962:x1830948733761536:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:0.0:1746129559.265237:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129559.265262:0:8412:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733761792 00000100:00100000:0.0:1746129559.265270:0:8412:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733761792 00000100:00100000:0.0:1746129559.265325:0:8412:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15280 00000100:00100000:0.0:1746129559.265333:0:8412:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013145e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+31:31914:x1830948733761792:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129559.265344:0:8412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129559.265363:0:8412:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009011f000/0x40a459093b067b21 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f1fb5c expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129559.265390:0:8412:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129bcfc00/0x40a459093b067af0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1384448->1548287) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f1fb47 expref: 48 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129559.265398:0:8412:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129559.265400:0:8412:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129559.265403:0:8412:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009011f000/0x40a459093b067b21 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f1fb5c expref: 32 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129559.265447:0:8412:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129bcfc00/0x40a459093b067af0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1384448->1548287) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fb47 expref: 48 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129559.265461:0:8412:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129bcfc00/0x40a459093b067af0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1384448->1548287) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fb47 expref: 48 pid: 8412 timeout: 914 lvb_type: 0 00000100:00100000:0.0:1746129559.265473:0:8412:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e87c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8412:1830948737369984:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129559.265532:0:8412:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009cdf30c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129559.271430:0:8412:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e87c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8412:1830948737369984:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129559.271464:0:8412:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009011f000/0x40a459093b067b21 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f1fb5c expref: 32 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129559.271480:0:8412:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009011f000, rc 0) 00000100:00100000:0.0:1746129559.271525:0:8412:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013145e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+32:31914:x1830948733761792:12345-192.168.202.4@tcp:101:cat.0 Request processed in 6193us (6292us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129559.271534:0:8412:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15280 00000100:00100000:0.0:1746129559.278677:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129559.278708:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733761920 00000100:00100000:0.0:1746129559.278717:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733761920 00002000:00100000:0.0:1746129559.278761:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f4:0x0] (1384448->1548287) req@ffff88012e87c000 x1830948733761920/t0(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:300/0 lens 488/0 e 0 to 0 dl 1746129570 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129559.278771:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e87c000 with x1830948733761920 ext(1384448->1548287) 00010000:00010000:0.0:1746129559.278782:0:25745:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880129bcfc00/0x40a459093b067af0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1384448->1548287) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fb47 expref: 47 pid: 8412 timeout: 914 lvb_type: 0 00010000:00010000:0.0:1746129559.278796:0:25745:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880129bcfc00/0x40a459093b067af0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1384448->1548287) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fb47 expref: 47 pid: 8412 timeout: 914 lvb_type: 0 00002000:00010000:0.0:1746129559.278802:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012e87c000 00000100:00100000:0.0:1746129559.278822:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2293 00000100:00100000:0.0:1746129559.278829:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e87c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+47:1963:x1830948733761920:12345-192.168.202.4@tcp:4:multiop.0 00000100:00100000:0.0:1746129559.287399:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129559.305280:0:8412:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15283 00000100:00100000:0.0:1746129559.305287:0:8412:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013577d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ada2ffba-8920-4ecb-8068-68caa9806978+51:1963:x1830948733762560:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129559.305309:0:8412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129559.305316:0:8412:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009011e800/0x40a459093b067b36 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f1fb71 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129559.305340:0:8412:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e87ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8412:1830948737370368:192.168.202.4@tcp:106: 00000100:00100000:0.0:1746129559.306021:0:8412:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009cdf30c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129559.306037:0:15749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733762688 00000100:00100000:0.0:1746129559.306041:0:15749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733762688 00010000:00010000:0.0:1746129559.306059:0:15749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129bcfc00/0x40a459093b067af0 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1384448->1548287) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fb47 expref: 53 pid: 8412 timeout: 914 lvb_type: 0 00000100:00100000:0.0:1746129559.306081:0:15749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7791 00000100:00100000:0.0:1746129559.306087:0:15749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013577c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ada2ffba-8920-4ecb-8068-68caa9806978+53:1960:x1830948733762688:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129559.306095:0:15749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129559.306116:0:15749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129bcfc00/0x40a459093b067af0 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1384448->1548287) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fb47 expref: 53 pid: 8412 timeout: 914 lvb_type: 0 00010000:00010000:0.0:1746129559.306128:0:15749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129bcfc00/0x40a459093b067af0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1384448->1548287) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fb47 expref: 53 pid: 8412 timeout: 914 lvb_type: 0 00010000:00010000:0.0:1746129559.306149:0:15749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129559.306150:0:15749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129559.306158:0:15749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009011f000/0x40a459093b067b21 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f1fb5c expref: 31 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129559.306165:0:15749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009011f000/0x40a459093b067b21 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f1fb5c expref: 31 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129559.306191:0:15749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009011f000/0x40a459093b067b21 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f1fb5c expref: 31 pid: 8412 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129559.306199:0:15749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e87d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15749:1830948737370496:192.168.202.4@tcp:105: 00000100:00100000:0.0:1746129559.306219:0:15749:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009cdf3b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746129559.311149:0:8412:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e87ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8412:1830948737370368:192.168.202.4@tcp:106: 00010000:00010000:0.0:1746129559.311187:0:8412:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009011e800/0x40a459093b067b36 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f1fb71 expref: 53 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129559.311202:0:8412:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009011e800/0x40a459093b067b36 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f1fb71 expref: 53 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129559.311216:0:8412:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009011e800, rc 0) 00000100:00100000:0.0:1746129559.311259:0:8412:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013577d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ada2ffba-8920-4ecb-8068-68caa9806978+52:1963:x1830948733762560:12345-192.168.202.4@tcp:101:cat.0 Request processed in 5972us (6291us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129559.311268:0:8412:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15283 00000100:00100000:0.0:1746129559.311325:0:15749:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e87d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15749:1830948737370496:192.168.202.4@tcp:105: 00010000:00010000:0.0:1746129559.311335:0:15749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129559.311352:0:15749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013577c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ada2ffba-8920-4ecb-8068-68caa9806978+51:1960:x1830948733762688:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 5265us (6356us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129559.311360:0:15749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7791 00000100:00100000:0.0:1746129559.312616:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129559.314361:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129559.322914:0:21463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733763200 00000100:00100000:0.0:1746129559.322923:0:21463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733763200 00002000:00100000:0.0:1746129559.322961:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->3231743) req@ffff880094eff480 x1830948733763200/t0(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:300/0 lens 488/0 e 0 to 0 dl 1746129570 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129559.322970:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094eff480 with x1830948733763200 ext(3145728->3231743) 00010000:00010000:0.0:1746129559.322978:0:21463:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012e0fc600/0x40a459093b067acd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3231743) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fb32 expref: 25 pid: 8412 timeout: 914 lvb_type: 0 00010000:00010000:0.0:1746129559.322992:0:21463:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012e0fc600/0x40a459093b067acd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3231743) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fb32 expref: 25 pid: 8412 timeout: 914 lvb_type: 0 00002000:00010000:0.0:1746129559.322999:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094eff480 00000100:00100000:0.0:1746129559.323017:0:21463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2295 00000100:00100000:0.0:1746129559.323024:0:21463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+25:1963:x1830948733763200:12345-192.168.202.4@tcp:4:cat.0 00000100:00100000:0.0:1746129559.326164:0:21463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+27:1963:x1830948733763200:12345-192.168.202.4@tcp:4:cat.0 Request processed in 3133us (3387us total) trans 21474841170 rc 0/0 00000100:00100000:0.0:1746129559.326176:0:21463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2295 00002000:00100000:0.0:1746129559.326188:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->3231743) req@ffff880094eff480 x1830948733763200/t21474841170(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:300/0 lens 488/448 e 0 to 0 dl 1746129570 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129559.326198:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094eff480 with x1830948733763200 ext(3145728->3231743) 00010000:00010000:0.0:1746129559.326208:0:21463:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012e0fc600/0x40a459093b067acd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3231743) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fb32 expref: 27 pid: 8412 timeout: 914 lvb_type: 0 00010000:00010000:0.0:1746129559.326222:0:21463:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012e0fc600/0x40a459093b067acd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3231743) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fb32 expref: 27 pid: 8412 timeout: 914 lvb_type: 0 00002000:00010000:0.0:1746129559.326228:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094eff480 00000100:00100000:0.0:1746129559.326788:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e87d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+32:1962:x1830948733762944:12345-192.168.202.4@tcp:3:cat.0 Request processed in 14043us (14172us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129559.326796:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7342 00002000:00100000:0.0:1746129559.326801:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f4:0x0] (1048576->2097151) req@ffff88012e87d880 x1830948733762944/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:300/0 lens 488/440 e 0 to 0 dl 1746129570 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129559.326808:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e87d880 with x1830948733762944 ext(1048576->2097151) 00002000:00010000:0.0:1746129559.326812:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e87d880 00000100:00100000:0.0:1746129559.329081:0:15749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733763328 00000100:00100000:0.0:1746129559.329091:0:15749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733763328 00010000:00010000:0.0:1746129559.329128:0:15749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012e0fc600/0x40a459093b067acd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3231743) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fb32 expref: 27 pid: 8412 timeout: 914 lvb_type: 0 00000100:00100000:0.0:1746129559.329171:0:15749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7792 00000100:00100000:0.0:1746129559.329179:0:15749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094efca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+27:1963:x1830948733763328:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129559.329195:0:15749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129559.329218:0:15749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012e0fc600/0x40a459093b067acd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3231743) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fb32 expref: 27 pid: 8412 timeout: 914 lvb_type: 0 00010000:00010000:0.0:1746129559.329230:0:15749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012e0fc600/0x40a459093b067acd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3231743) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fb32 expref: 27 pid: 8412 timeout: 914 lvb_type: 0 00010000:00010000:0.0:1746129559.329254:0:15749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e0fc600/0x40a459093b067acd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3231743) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fb32 expref: 27 pid: 8412 timeout: 914 lvb_type: 0 00010000:00010000:0.0:1746129559.329268:0:15749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129559.329270:0:15749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129559.329278:0:15749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800915d5e00/0x40a459093b067b3d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f1fb78 expref: 35 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129559.329286:0:15749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800915d5e00/0x40a459093b067b3d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f1fb78 expref: 35 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129559.329347:0:15749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800915d5e00/0x40a459093b067b3d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f1fb78 expref: 35 pid: 7149 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129559.329359:0:15749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e87ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15749:1830948737370752:192.168.202.4@tcp:105: 00000100:00100000:0.0:1746129559.329447:0:15749:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009cdf30c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129559.339833:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129559.339869:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129559.350044:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129559.354888:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129559.354931:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129559.354957:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129559.354973:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129559.354999:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129559.355023:0:31520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733764992 00000100:00100000:0.0:1746129559.355031:0:31520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733764992 00002000:00100000:0.0:1746129559.355079:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3f5:0x0] (3723264->4194303) req@ffff88012e87d180 x1830948733764992/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:300/0 lens 488/0 e 0 to 0 dl 1746129570 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129559.355089:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e87d180 with x1830948733764992 ext(3723264->4194303) 00002000:00010000:0.0:1746129559.355095:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e87d180 00000100:00100000:0.0:1746129559.355123:0:31520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733764352 00000100:00100000:0.0:1746129559.355125:0:31520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733764352 00002000:00100000:0.0:1746129559.355139:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3ef:0x0] (2097152->3145727) req@ffff88012e87d500 x1830948733764352/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:300/0 lens 488/0 e 0 to 0 dl 1746129570 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129559.355145:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e87d500 with x1830948733764352 ext(2097152->3145727) 00002000:00010000:0.0:1746129559.355149:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e87d500 00000100:00100000:0.0:1746129559.355157:0:31520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733764480 00000100:00100000:0.0:1746129559.355158:0:31520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733764480 00002000:00100000:0.0:1746129559.355166:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->4194303) req@ffff88012e87df80 x1830948733764480/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:300/0 lens 488/0 e 0 to 0 dl 1746129570 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129559.355171:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e87df80 with x1830948733764480 ext(3145728->4194303) 00002000:00010000:0.0:1746129559.355173:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e87df80 00000100:00100000:0.0:1746129559.355180:0:31520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733764864 00000100:00100000:0.0:1746129559.355181:0:31520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733764864 00002000:00100000:0.0:1746129559.355189:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3f5:0x0] (2097152->3723263) req@ffff88012e87f800 x1830948733764864/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:300/0 lens 504/0 e 0 to 0 dl 1746129570 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129559.355194:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e87f800 with x1830948733764864 ext(2097152->3723263) 00002000:00010000:0.0:1746129559.355197:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e87f800 00000100:00100000:0.0:1746129559.355207:0:31520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7344 00000100:00100000:0.0:1746129559.355214:0:31520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e87d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+9:1961:x1830948733764992:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129559.356266:0:8415:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7345 00000100:00100000:0.0:1746129559.356277:0:8415:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e87d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+28:1961:x1830948733764352:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129559.367157:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129559.389621:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129559.418849:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129559.433538:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00010000:00010000:0.0:1746129559.435408:0:9822:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746129559.442454:0:7086:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094efc000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7086:1830948737371008:192.168.202.4@tcp:105: 00000100:00100000:0.0:1746129559.442467:0:7086:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094efed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7086:1830948737371136:192.168.202.4@tcp:105: 00010000:00010000:0.0:1746129559.442497:0:7086:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129559.442546:0:7086:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+10:1960:x1830948733766144:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 7598us (9019us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129559.442558:0:7086:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7793 00000100:00100000:0.0:1746129559.457772:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129559.458798:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129559.470986:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129559.471051:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129559.471079:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733767552 00000100:00100000:0.0:1746129559.471088:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733767552 00000100:00100000:0.0:1746129559.471154:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15288 00000100:00100000:0.0:1746129559.471162:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ada2ffba-8920-4ecb-8068-68caa9806978+27:31921:x1830948733767552:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:0.0:1746129559.471182:0:7149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129559.471201:0:7149:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013698ca00/0x40a459093b067b9f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f1fba2 expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129559.471233:0:7149:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009011f000/0x40a459093b067b21 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f1fb5c expref: 13 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129559.471241:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129559.471243:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129559.471246:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013698ca00/0x40a459093b067b9f lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1691648->2097151] (req 1691648->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f1fba2 expref: 28 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129559.471278:0:7149:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009011f000/0x40a459093b067b21 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fb5c expref: 13 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129559.471291:0:7149:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009011f000/0x40a459093b067b21 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fb5c expref: 13 pid: 8412 timeout: 914 lvb_type: 0 00000100:00100000:0.0:1746129559.471333:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900f5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7149:1830948737371264:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129559.471421:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009cdf3b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746129559.488327:0:7086:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733767680 00000100:00100000:0.0:1746129559.489742:0:7086:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733767680 00000100:00100000:0.0:1746129559.501729:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129559.504521:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129559.509849:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129559.520663:0:15749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733768448 00000100:00100000:0.0:1746129559.520668:0:15749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733768448 00010000:00010000:0.0:1746129559.520688:0:15749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800936dee00/0x40a459093b0679fb lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1faa6 expref: 30 pid: 22481 timeout: 914 lvb_type: 1 00000100:00100000:0.0:1746129559.520708:0:15749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733768576 00000100:00100000:0.0:1746129559.520710:0:15749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733768576 00010000:00010000:0.0:1746129559.520719:0:15749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6cda200/0x40a459093b06797d lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fa59 expref: 40 pid: 4385 timeout: 914 lvb_type: 1 00000100:00100000:0.0:1746129559.520733:0:15749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7795 00000100:00100000:0.0:1746129559.520738:0:15749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800903a0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+30:1963:x1830948733768448:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129559.520747:0:15749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129559.520763:0:15749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800936dee00/0x40a459093b0679fb lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1faa6 expref: 30 pid: 22481 timeout: 914 lvb_type: 1 00010000:00010000:0.0:1746129559.520779:0:15749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800936dee00/0x40a459093b0679fb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1faa6 expref: 30 pid: 22481 timeout: 914 lvb_type: 1 00010000:00010000:0.0:1746129559.520796:0:15749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129559.520816:0:15749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800903a0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+30:1963:x1830948733768448:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 78us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129559.520821:0:15749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7795 00000100:00100000:0.0:1746129559.520835:0:15749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7796 00000100:00100000:0.0:1746129559.520838:0:15749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800903a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ada2ffba-8920-4ecb-8068-68caa9806978+40:1963:x1830948733768576:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129559.520843:0:15749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129559.520848:0:15749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a6cda200/0x40a459093b06797d lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fa59 expref: 40 pid: 4385 timeout: 914 lvb_type: 1 00010000:00010000:0.0:1746129559.520855:0:15749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a6cda200/0x40a459093b06797d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fa59 expref: 40 pid: 4385 timeout: 914 lvb_type: 1 00010000:00010000:0.0:1746129559.520864:0:15749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129559.520865:0:15749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129559.520870:0:15749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fe9fc00/0x40a459093b067bad lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1097727) gid 0 flags: 0x50080000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f1fbb0 expref: 40 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129559.520877:0:15749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fe9fc00/0x40a459093b067bad lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1097727) gid 0 flags: 0x50080000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f1fbb0 expref: 40 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129559.520895:0:15749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009fe9fc00/0x40a459093b067bad lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1097727) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f1fbb0 expref: 40 pid: 8410 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129559.520903:0:15749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900f5c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15749:1830948737372160:192.168.202.4@tcp:105: 00000100:00100000:0.0:1746129559.520930:0:15749:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009cdf33c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129559.532287:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129559.538393:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129559.538551:0:8410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15292 00000100:00100000:0.0:1746129559.538562:0:8410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ada2ffba-8920-4ecb-8068-68caa9806978+37:1962:x1830948733769216:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129559.538583:0:8410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129559.538603:0:8410:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013698c800/0x40a459093b067bbb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f1fbbe expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129559.538631:0:8410:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129559.538645:0:8410:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013698c800/0x40a459093b067bbb lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f1fbbe expref: 38 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129559.538656:0:8410:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013698c800/0x40a459093b067bbb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f1fbbe expref: 38 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129559.538671:0:8410:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013698c800, rc 0) 00000100:00100000:0.0:1746129559.538729:0:8410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ada2ffba-8920-4ecb-8068-68caa9806978+37:1962:x1830948733769216:12345-192.168.202.4@tcp:101:cat.0 Request processed in 168us (341us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129559.538735:0:8410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15292 00000100:00100000:0.0:1746129559.545526:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129559.549117:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129559.549152:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129559.549187:0:8412:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733769344 00000100:00100000:0.0:1746129559.549199:0:8412:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733769344 00000100:00100000:0.0:1746129559.549245:0:8412:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733769472 00000100:00100000:0.0:1746129559.549247:0:8412:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733769472 00000100:00100000:0.0:1746129559.549278:0:8412:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733769600 00000100:00100000:0.0:1746129559.549280:0:8412:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733769600 00000100:00100000:0.0:1746129559.550092:0:8412:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15293 00000100:00100000:0.0:1746129559.550102:0:8412:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+9:1960:x1830948733769344:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129559.550123:0:8412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129559.550142:0:8412:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013698c000/0x40a459093b067bc2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f1fbc5 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129559.550203:0:8412:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900f4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8412:1830948737372288:192.168.202.4@tcp:106: 00000100:00100000:0.0:1746129559.550285:0:8412:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009cdf3f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746129559.554006:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00002000:00010000:0.0:1746129559.554391:0:4385:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb mtime: 1746129558 -> 1746129560 00002000:00010000:0.0:1746129559.554394:0:4385:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb atime: 1746129558 -> 1746129560 00002000:00010000:0.0:1746129559.554396:0:4385:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb ctime: 1746129558 -> 1746129560 00000100:00100000:0.0:1746129559.554406:0:4385:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013577ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:4385:1830948737372416:192.168.202.4@tcp:106: 00010000:00010000:0.0:1746129559.554447:0:4385:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ba06400/0x40a459093b067bc9 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f1fbcc expref: 28 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129559.554456:0:4385:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ba06400/0x40a459093b067bc9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f1fbcc expref: 28 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129559.554466:0:4385:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ba06400, rc 0) 00000100:00100000:0.0:1746129559.554485:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+27:1960:x1830948733769472:12345-192.168.202.4@tcp:101:cat.0 Request processed in 3724us (5383us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129559.554495:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15294 00000100:00100000:0.0:1746129559.555975:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129559.557710:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129559.558354:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129559.559676:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129559.563760:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129559.564784:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129559.565874:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129559.566766:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129559.575160:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129559.577431:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129559.577456:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733771520 00000100:00100000:0.0:1746129559.577462:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733771520 00010000:00010000:0.0:1746129559.577483:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fe9f800/0x40a459093b067b75 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fb94 expref: 10 pid: 8410 timeout: 914 lvb_type: 0 00000100:00100000:0.0:1746129559.577502:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7800 00000100:00100000:0.0:1746129559.577507:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+10:1960:x1830948733771520:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129559.577514:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129559.577523:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fe9f800/0x40a459093b067b75 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fb94 expref: 10 pid: 8410 timeout: 914 lvb_type: 0 00010000:00010000:0.0:1746129559.577532:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fe9f800/0x40a459093b067b75 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fb94 expref: 10 pid: 8410 timeout: 914 lvb_type: 0 00010000:00010000:0.0:1746129559.577544:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fe9f800/0x40a459093b067b75 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fb94 expref: 10 pid: 8410 timeout: 914 lvb_type: 0 00010000:00010000:0.0:1746129559.578546:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129559.578581:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+9:1960:x1830948733771520:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 1071us (1149us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129559.578588:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7800 00000100:00100000:0.0:1746129559.583654:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129559.586037:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129559.591407:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129559.591464:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129559.605612:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129559.609238:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129559.613727:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00010000:00010000:0.0:1746129559.614736:0:14547:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff3f800/0x40a459093b067c1d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129559.614743:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff3f800/0x40a459093b067c1d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00000004:00200000:0.0:1746129559.614795:0:14547:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00000004:00200000:0.0:1746129559.614799:0:14547:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746129559.614818:0:14547:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff3f800/0x40a459093b067c1d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129559.614828:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff3f800/0x40a459093b067c1d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129559.614838:0:14547:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff3e200/0x40a459093b067c0f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129559.614844:0:14547:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff3e200/0x40a459093b067c0f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129559.614854:0:14547:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff3e200/0x40a459093b067c0f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129559.614860:0:14547:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ff3e200 already unused, calling callback (ffffffffa136e690) 00010000:00010000:0.0:1746129559.614863:0:14547:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff3e200/0x40a459093b067c0f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129559.614870:0:14547:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff3e200/0x40a459093b067c0f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129559.614878:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880132ef8f00) 00010000:00010000:0.0:1746129559.614881:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129559.614884:0:14547:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff3e200/0x40a459093b067c0f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129559.614889:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff3e200/0x40a459093b067c0f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129559.614902:0:14547:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff3f000/0x40a459093b067c16 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129559.614906:0:14547:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff3f000/0x40a459093b067c16 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129559.614911:0:14547:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff3f000/0x40a459093b067c16 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129559.614914:0:14547:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ff3f000 already unused, calling callback (ffffffffa136e690) 00010000:00010000:0.0:1746129559.614916:0:14547:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff3f000/0x40a459093b067c16 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129559.614919:0:14547:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff3f000/0x40a459093b067c16 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129559.614928:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f9f3800) 00010000:00010000:0.0:1746129559.614930:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129559.614932:0:14547:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff3f000/0x40a459093b067c16 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129559.614936:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff3f000/0x40a459093b067c16 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129559.614968:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff3ec00/0x40a459093b067c08 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f1fc0b expref: 8 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129559.614979:0:14547:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff3f800/0x40a459093b067c1d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f1fc0b expref: 7 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129559.614985:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009c36a600) 00010000:00010000:0.0:1746129559.614987:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746129559.614989:0:14547:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ff3f800, rc 0) 00000100:00100000:0.0:1746129559.615014:0:14547:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013575d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:068dab75-d300-4ead-a742-d14572ad1e50+7:31925:x1830948733772672:12345-192.168.202.4@tcp:101:mirror_io.0 Request processed in 9206us (9414us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129559.615021:0:14547:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11024 00000100:00100000:0.0:1746129559.619265:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129559.619661:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129559.619751:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129559.619784:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129559.619796:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129559.619821:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129559.619854:0:31503:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733773440 00000100:00100000:0.0:1746129559.619857:0:31503:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733773440 00000100:00100000:0.0:1746129559.619874:0:31503:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733773696 00000100:00100000:0.0:1746129559.619876:0:31503:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733773696 00000100:00100000:0.0:1746129559.619886:0:31503:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733773312 00000100:00100000:0.0:1746129559.619888:0:31503:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733773312 00000100:00100000:0.0:1746129559.619901:0:31503:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733773568 00000100:00100000:0.0:1746129559.619903:0:31503:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733773568 00000100:00100000:0.0:1746129559.619912:0:31503:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733773824 00000100:00100000:0.0:1746129559.619914:0:31503:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733773824 00000100:00100000:0.0:1746129559.620227:0:31503:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15305 00000100:00100000:0.0:1746129559.620234:0:31503:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013575f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:068dab75-d300-4ead-a742-d14572ad1e50+10:1961:x1830948733773696:12345-192.168.202.4@tcp:101:mirror_io.0 00010000:00010000:0.0:1746129559.620240:0:31503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129559.620248:0:31503:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013698c800/0x40a459093b067c32 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f1fc2e expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129559.620266:0:31503:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013698c800/0x40a459093b067c32 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f1fc2e expref: 11 pid: 31503 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129559.620274:0:31503:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013698c800/0x40a459093b067c32 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f1fc2e expref: 11 pid: 31503 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129559.620282:0:31503:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013698c800, rc 0) 00000100:00100000:0.0:1746129559.620948:0:31503:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013575f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:068dab75-d300-4ead-a742-d14572ad1e50+11:1961:x1830948733773696:12345-192.168.202.4@tcp:101:mirror_io.0 Request processed in 713us (1194us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129559.620953:0:31503:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15305 00000100:00100000:0.0:1746129559.627767:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129559.627801:0:14547:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733774080 00000100:00100000:0.0:1746129559.627809:0:14547:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733774080 00000100:00100000:0.0:1746129559.627854:0:14547:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11025 00000100:00100000:0.0:1746129559.627862:0:14547:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013575d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:068dab75-d300-4ead-a742-d14572ad1e50+7:31925:x1830948733774080:12345-192.168.202.4@tcp:101:mirror_io.0 00010000:00010000:0.0:1746129559.627885:0:14547:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129559.627904:0:14547:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013698d400/0x40a459093b067c4e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f1fc3c expref: -99 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129559.628004:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88013698c200/0x40a459093b067c55 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129559.628018:0:14547:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff3f800/0x40a459093b067c1d lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f1fc0b expref: 8 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129559.628024:0:14547:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013698c200/0x40a459093b067c55 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129559.628056:0:14547:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff3f800/0x40a459093b067c1d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fc0b expref: 8 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129559.628068:0:14547:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff3f800/0x40a459093b067c1d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fc0b expref: 8 pid: 14547 timeout: 914 lvb_type: 0 00000100:00100000:0.0:1746129559.628080:0:14547:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013575c000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14547:1830948737373824:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129559.628163:0:14547:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009cdf3780 going to sleep for 11 seconds 00000100:00100000:0.0:1746129559.631666:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129559.636948:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129559.641249:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129559.644771:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129559.646332:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129559.646377:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129559.646396:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129559.646457:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129559.646482:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129559.646498:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733774976 00000100:00100000:0.0:1746129559.646502:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733774976 00000100:00100000:0.0:1746129559.646520:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733775232 00000100:00100000:0.0:1746129559.646522:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733775232 00000100:00100000:0.0:1746129559.646533:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733774848 00000100:00100000:0.0:1746129559.646535:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733774848 00000100:00100000:0.0:1746129559.646543:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733775104 00000100:00100000:0.0:1746129559.646545:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733775104 00000100:00100000:0.0:1746129559.646554:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733775360 00000100:00100000:0.0:1746129559.646555:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733775360 00000100:00100000:0.0:1746129559.646567:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15310 00000100:00100000:0.0:1746129559.646572:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013575ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:068dab75-d300-4ead-a742-d14572ad1e50+8:1963:x1830948733774976:12345-192.168.202.4@tcp:1:mirror_io.0 00010000:00010000:0.0:1746129559.646591:0:7148:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88013698c000/0x40a459093b067c86 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129559.646602:0:7148:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88013698ca00/0x40a459093b067b9f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1691648->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f1fba2 expref: 22 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129559.646607:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129559.646608:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129559.646610:0:7148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013698c000/0x40a459093b067c86 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129559.646627:0:7148:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88013698ca00/0x40a459093b067b9f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1691648->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fba2 expref: 22 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129559.646635:0:7148:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88013698ca00/0x40a459093b067b9f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1691648->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fba2 expref: 22 pid: 7149 timeout: 914 lvb_type: 0 00000100:00100000:0.0:1746129559.646649:0:7148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ea93100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:7148:1830948737374336:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129559.646683:0:7148:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009cdf3f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746129559.646699:0:22480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15311 00000100:00100000:0.0:1746129559.646705:0:22480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013575ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:068dab75-d300-4ead-a742-d14572ad1e50+11:1963:x1830948733775232:12345-192.168.202.4@tcp:1:mirror_io.0 00010000:00010000:0.0:1746129559.646722:0:22480:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012ba06400/0x40a459093b067c8d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129559.646733:0:22480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800915d4a00/0x40a459093b067bb4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [3080192->3145727] (req 3080192->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f1fbb7 expref: 26 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129559.646740:0:22480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ff3e000/0x40a459093b067bd7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 5144576->5242879) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f1fbda expref: 35 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129559.646747:0:22480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f446000/0x40a459093b067be5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [5144576->18446744073709551615] (req 5144576->5242879) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f1fbe8 expref: 26 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129559.646752:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 3 00010000:00010000:0.0:1746129559.646753:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 3 00010000:00010000:0.0:1746129559.646755:0:22480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ba06400/0x40a459093b067c8d lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129559.646770:0:22480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f446000/0x40a459093b067be5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [5144576->18446744073709551615] (req 5144576->5242879) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fbe8 expref: 26 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129559.646778:0:22480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f446000/0x40a459093b067be5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [5144576->18446744073709551615] (req 5144576->5242879) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fbe8 expref: 26 pid: 4385 timeout: 914 lvb_type: 0 00000100:00100000:0.0:1746129559.646788:0:22480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ea93800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22480:1830948737374464:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129559.646814:0:22480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ff3e000/0x40a459093b067bd7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 5144576->5242879) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fbda expref: 35 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129559.646821:0:22480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ff3e000/0x40a459093b067bd7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 5144576->5242879) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fbda expref: 35 pid: 22480 timeout: 914 lvb_type: 0 00000100:00100000:0.0:1746129559.646827:0:22480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ea90380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22480:1830948737374592:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129559.646845:0:22480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800915d4a00/0x40a459093b067bb4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [3080192->3145727] (req 3080192->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fbb7 expref: 26 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129559.646852:0:22480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800915d4a00/0x40a459093b067bb4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [3080192->3145727] (req 3080192->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fbb7 expref: 26 pid: 7149 timeout: 914 lvb_type: 0 00000100:00100000:0.0:1746129559.646859:0:22480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ea90700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22480:1830948737374720:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129559.646871:0:22480:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009cdf33c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129559.646888:0:31503:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15312 00000100:00100000:0.0:1746129559.646893:0:31503:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013575d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:068dab75-d300-4ead-a742-d14572ad1e50+8:1963:x1830948733774848:12345-192.168.202.4@tcp:1:mirror_io.0 00010000:00010000:0.0:1746129559.646909:0:31503:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012bac9000/0x40a459093b067c94 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129559.646919:0:31503:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e0fc000/0x40a459093b067a17 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f1fac2 expref: 8 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129559.646929:0:31503:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ff3fe00/0x40a459093b067c39 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f1fc19 expref: 8 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129559.646936:0:31503:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880136438200/0x40a459093b067a79 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f1fb08 expref: 22 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129559.646942:0:31503:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129559.646943:0:31503:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129559.646945:0:31503:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012bac9000/0x40a459093b067c94 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129559.646960:0:31503:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880136438200/0x40a459093b067a79 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fb08 expref: 22 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129559.646967:0:31503:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880136438200/0x40a459093b067a79 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fb08 expref: 22 pid: 8410 timeout: 914 lvb_type: 1 00000100:00100000:0.0:1746129559.646975:0:31503:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ea90e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:31503:1830948737374848:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129559.646999:0:31503:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ff3fe00/0x40a459093b067c39 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fc19 expref: 8 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129559.647006:0:31503:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ff3fe00/0x40a459093b067c39 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fc19 expref: 8 pid: 11014 timeout: 914 lvb_type: 1 00000100:00100000:0.0:1746129559.647012:0:31503:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ea90000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:31503:1830948737374976:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129559.647033:0:31503:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012e0fc000/0x40a459093b067a17 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fac2 expref: 8 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129559.647041:0:31503:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012e0fc000/0x40a459093b067a17 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fac2 expref: 8 pid: 8410 timeout: 914 lvb_type: 0 00000100:00100000:0.0:1746129559.647048:0:31503:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ea93b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:31503:1830948737375104:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129559.647063:0:31503:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009cdf3b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746129559.647079:0:11014:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15313 00000100:00100000:0.0:1746129559.647085:0:11014:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013575c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:068dab75-d300-4ead-a742-d14572ad1e50+11:1963:x1830948733775104:12345-192.168.202.4@tcp:1:mirror_io.0 00010000:00010000:0.0:1746129559.647099:0:11014:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800915d4c00/0x40a459093b067c9b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129559.647108:0:11014:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fe9fc00/0x40a459093b067bad lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1097727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f1fbb0 expref: 35 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129559.647113:0:11014:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129559.647114:0:11014:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129559.647116:0:11014:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800915d4c00/0x40a459093b067c9b lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129559.647129:0:11014:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fe9fc00/0x40a459093b067bad lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1097727) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fbb0 expref: 35 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129559.647137:0:11014:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fe9fc00/0x40a459093b067bad lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1097727) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fbb0 expref: 35 pid: 8410 timeout: 914 lvb_type: 0 00000100:00100000:0.0:1746129559.647150:0:11014:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ea91f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11014:1830948737375232:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129559.647169:0:11014:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009cdf3600 going to sleep for 11 seconds 00000100:00100000:0.0:1746129559.655930:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129559.655953:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129559.655970:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129559.655982:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129559.656006:0:15749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733775616 00000100:00100000:0.0:1746129559.656014:0:15749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733775616 00010000:00010000:0.0:1746129559.656051:0:15749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800936dea00/0x40a459093b0679e6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fa91 expref: 27 pid: 22481 timeout: 914 lvb_type: 1 00000100:00100000:0.0:1746129559.656072:0:15749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733775488 00000100:00100000:0.0:1746129559.656074:0:15749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733775488 00010000:00010000:0.0:1746129559.656082:0:15749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ff3ea00/0x40a459093b067c24 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fc12 expref: 12 pid: 4699 timeout: 914 lvb_type: 1 00000100:00100000:0.0:1746129559.656093:0:15749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7803 00000100:00100000:0.0:1746129559.656098:0:15749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea91c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+27:1962:x1830948733775616:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129559.656111:0:15749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129559.656135:0:15749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800936dea00/0x40a459093b0679e6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fa91 expref: 27 pid: 22481 timeout: 914 lvb_type: 1 00010000:00010000:0.0:1746129559.656145:0:15749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800936dea00/0x40a459093b0679e6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fa91 expref: 27 pid: 22481 timeout: 914 lvb_type: 1 00010000:00010000:0.0:1746129559.656166:0:15749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800936dea00/0x40a459093b0679e6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fa91 expref: 27 pid: 22481 timeout: 914 lvb_type: 1 00010000:00010000:0.0:1746129559.656188:0:15749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129559.656225:0:15749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea91c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+26:1962:x1830948733775616:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 125us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129559.656231:0:15749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7803 00000100:00100000:0.0:1746129559.656247:0:15749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7804 00000100:00100000:0.0:1746129559.656251:0:15749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea92a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:068dab75-d300-4ead-a742-d14572ad1e50+12:1962:x1830948733775488:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129559.656261:0:15749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129559.656267:0:15749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ff3ea00/0x40a459093b067c24 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fc12 expref: 12 pid: 4699 timeout: 914 lvb_type: 1 00010000:00010000:0.0:1746129559.656274:0:15749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ff3ea00/0x40a459093b067c24 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fc12 expref: 12 pid: 4699 timeout: 914 lvb_type: 1 00010000:00010000:0.0:1746129559.656284:0:15749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ff3ea00/0x40a459093b067c24 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fc12 expref: 12 pid: 4699 timeout: 914 lvb_type: 1 00010000:00010000:0.0:1746129559.656323:0:15749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129559.656337:0:15749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea92a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:068dab75-d300-4ead-a742-d14572ad1e50+11:1962:x1830948733775488:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 85us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129559.656342:0:15749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7804 00000100:00100000:0.0:1746129559.656378:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129559.656392:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733775744 00000100:00100000:0.0:1746129559.656394:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733775744 00010000:00010000:0.0:1746129559.656405:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095eb8e00/0x40a459093b06796f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fa44 expref: 36 pid: 31503 timeout: 914 lvb_type: 1 00000100:00100000:0.0:1746129559.656439:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7805 00000100:00100000:0.0:1746129559.656443:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b05880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ada2ffba-8920-4ecb-8068-68caa9806978+36:1962:x1830948733775744:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129559.656450:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129559.656456:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095eb8e00/0x40a459093b06796f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fa44 expref: 36 pid: 31503 timeout: 914 lvb_type: 1 00010000:00010000:0.0:1746129559.656463:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095eb8e00/0x40a459093b06796f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fa44 expref: 36 pid: 31503 timeout: 914 lvb_type: 1 00010000:00010000:0.0:1746129559.656474:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095eb8e00/0x40a459093b06796f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fa44 expref: 36 pid: 31503 timeout: 914 lvb_type: 1 00010000:00010000:0.0:1746129559.656482:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129559.656484:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129559.656488:0:7085:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880095412400/0x40a459093b067c7f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129559.656497:0:7085:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095412400/0x40a459093b067c7f lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129559.656518:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129559.656531:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b05880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ada2ffba-8920-4ecb-8068-68caa9806978+35:1962:x1830948733775744:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 88us (152us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129559.656536:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7805 00000100:00100000:0.0:1746129559.656601:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129559.659849:0:31503:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ea90e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:31503:1830948737374848:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129559.660717:0:31503:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ea90000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:31503:1830948737374976:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129559.660725:0:31503:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ea93b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:31503:1830948737375104:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129559.660744:0:31503:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012bac9000/0x40a459093b067c94 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129559.662420:0:7086:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733776256 00000100:00100000:0.0:1746129559.662424:0:7086:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733776256 00000100:00100000:0.0:1746129559.662435:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733776768 00000100:00100000:0.0:1746129559.662437:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733776768 00010000:00010000:0.0:1746129559.662454:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012e0fc000/0x40a459093b067a17 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fac2 expref: 11 pid: 8410 timeout: 914 lvb_type: 0 00000100:00100000:0.0:1746129559.662473:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733776640 00000100:00100000:0.0:1746129559.662475:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733776640 00010000:00010000:0.0:1746129559.662483:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ff3fe00/0x40a459093b067c39 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fc19 expref: 9 pid: 11014 timeout: 914 lvb_type: 1 00000100:00100000:0.0:1746129559.662499:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7806 00000100:00100000:0.0:1746129559.662505:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+11:1960:x1830948733776768:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129559.662518:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129559.662540:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012e0fc000/0x40a459093b067a17 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fac2 expref: 11 pid: 8410 timeout: 914 lvb_type: 0 00010000:00010000:0.0:1746129559.662550:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012e0fc000/0x40a459093b067a17 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fac2 expref: 11 pid: 8410 timeout: 914 lvb_type: 0 00010000:00010000:0.0:1746129559.662573:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e0fc000/0x40a459093b067a17 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fac2 expref: 11 pid: 8410 timeout: 914 lvb_type: 0 00010000:00010000:0.0:1746129559.662590:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129559.662630:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+10:1960:x1830948733776768:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 125us (1738us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129559.662637:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7806 00000100:00100000:0.0:1746129559.662652:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7807 00000100:00100000:0.0:1746129559.662656:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094efe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:068dab75-d300-4ead-a742-d14572ad1e50+9:1960:x1830948733776640:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129559.662662:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129559.662669:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ff3fe00/0x40a459093b067c39 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fc19 expref: 9 pid: 11014 timeout: 914 lvb_type: 1 00010000:00010000:0.0:1746129559.662676:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ff3fe00/0x40a459093b067c39 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fc19 expref: 9 pid: 11014 timeout: 914 lvb_type: 1 00010000:00010000:0.0:1746129559.662686:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ff3fe00/0x40a459093b067c39 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fc19 expref: 9 pid: 11014 timeout: 914 lvb_type: 1 00010000:00010000:0.0:1746129559.662695:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129559.662709:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094efe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:068dab75-d300-4ead-a742-d14572ad1e50+8:1960:x1830948733776640:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 52us (1034us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129559.662714:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7807 00010000:00010000:0.0:1746129559.662740:0:7086:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f446000/0x40a459093b067be5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [5144576->18446744073709551615] (req 5144576->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fbe8 expref: 27 pid: 4385 timeout: 914 lvb_type: 0 00000100:00100000:0.0:1746129559.662753:0:7086:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7808 00000100:00100000:0.0:1746129559.662757:0:7086:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6ce2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+27:1960:x1830948733776256:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129559.662764:0:7086:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129559.662778:0:7086:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f446000/0x40a459093b067be5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [5144576->18446744073709551615] (req 5144576->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fbe8 expref: 27 pid: 4385 timeout: 914 lvb_type: 0 00010000:00010000:0.0:1746129559.662786:0:7086:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f446000/0x40a459093b067be5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [5144576->18446744073709551615] (req 5144576->5242879) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fbe8 expref: 27 pid: 4385 timeout: 914 lvb_type: 0 00010000:00010000:0.0:1746129559.662798:0:7086:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f446000/0x40a459093b067be5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [5144576->18446744073709551615] (req 5144576->5242879) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fbe8 expref: 27 pid: 4385 timeout: 914 lvb_type: 0 00010000:00010000:0.0:1746129559.662807:0:7086:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129559.662819:0:7086:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6ce2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+26:1960:x1830948733776256:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 62us (1959us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129559.662825:0:7086:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7808 00000100:00100000:0.0:1746129559.666063:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129559.666107:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129559.666131:0:15749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733776896 00000100:00100000:0.0:1746129559.666139:0:15749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733776896 00010000:00010000:0.0:1746129559.666174:0:15749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880136438200/0x40a459093b067a79 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fb08 expref: 25 pid: 8410 timeout: 914 lvb_type: 1 00000100:00100000:0.0:1746129559.666201:0:15749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7809 00000100:00100000:0.0:1746129559.666207:0:15749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b05880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ada2ffba-8920-4ecb-8068-68caa9806978+25:1962:x1830948733776896:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129559.666220:0:15749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129559.666240:0:15749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880136438200/0x40a459093b067a79 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fb08 expref: 25 pid: 8410 timeout: 914 lvb_type: 1 00010000:00010000:0.0:1746129559.666254:0:15749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880136438200/0x40a459093b067a79 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fb08 expref: 25 pid: 8410 timeout: 914 lvb_type: 1 00010000:00010000:0.0:1746129559.666274:0:15749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136438200/0x40a459093b067a79 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fb08 expref: 25 pid: 8410 timeout: 914 lvb_type: 1 00010000:00010000:0.0:1746129559.666287:0:15749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129559.666686:0:15749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129559.666690:0:15749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012bac9000/0x40a459093b067c94 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129559.666699:0:15749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012bac9000/0x40a459093b067c94 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129559.666725:0:15749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129559.666747:0:15749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b05880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ada2ffba-8920-4ecb-8068-68caa9806978+24:1962:x1830948733776896:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 539us (695us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129559.666753:0:15749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7809 00000100:00100000:0.0:1746129559.688028:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129559.688430:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129559.689021:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129559.695528:0:14547:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733777664 00000100:00100000:0.0:1746129559.695538:0:14547:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733777664 00000100:00100000:0.0:1746129559.695588:0:14547:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11028 00000100:00100000:0.0:1746129559.695596:0:14547:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013577c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:068dab75-d300-4ead-a742-d14572ad1e50+10:31925:x1830948733777664:12345-192.168.202.4@tcp:36:mirror_io.0 00010000:00010000:0.0:1746129559.695650:0:14547:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129559.695679:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095412200/0x40a459093b067c78 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f1fc4a expref: 10 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129559.695700:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009c36a600) 00010000:00010000:0.0:1746129559.695705:0:14547:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746129559.695736:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800915d4400/0x40a459093b067ca9 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129559.695749:0:14547:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009efb5e00/0x40a459093b0679a0 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.4@tcp remote: 0xda91008773f1fa6e expref: 300 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129559.695755:0:14547:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800936de400/0x40a459093b0679a7 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f1fa75 expref: 300 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129559.695761:0:14547:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0fd200/0x40a459093b0679df lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f1fa8a expref: 16 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129559.695768:0:14547:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0fde00/0x40a459093b067abf lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f1fb2b expref: 300 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129559.695773:0:14547:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009011e400/0x40a459093b067b0c lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f1fb4e expref: 16 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129559.695779:0:14547:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe9f400/0x40a459093b067b91 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f1fb9b expref: 300 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129559.695786:0:14547:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800915d4400/0x40a459093b067ca9 lrc: 9/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129559.695817:0:14547:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe9f400/0x40a459093b067b91 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fb9b expref: 300 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129559.695830:0:14547:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe9f400/0x40a459093b067b91 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fb9b expref: 300 pid: 14547 timeout: 915 lvb_type: 0 00000100:00100000:0.0:1746129559.695844:0:14547:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091b06680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14547:1830948737375488:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129559.696036:0:14547:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009011e400/0x40a459093b067b0c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fb4e expref: 16 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129559.696043:0:14547:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009011e400/0x40a459093b067b0c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fb4e expref: 16 pid: 2271 timeout: 915 lvb_type: 0 00000100:00100000:0.0:1746129559.696051:0:14547:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091b06300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14547:1830948737375616:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129559.696077:0:14547:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0fde00/0x40a459093b067abf lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fb2b expref: 300 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129559.696083:0:14547:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0fde00/0x40a459093b067abf lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fb2b expref: 300 pid: 14547 timeout: 915 lvb_type: 0 00000100:00100000:0.0:1746129559.696090:0:14547:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091b07b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14547:1830948737375744:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129559.696110:0:14547:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0fd200/0x40a459093b0679df lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fa8a expref: 16 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129559.696116:0:14547:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0fd200/0x40a459093b0679df lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fa8a expref: 16 pid: 2271 timeout: 915 lvb_type: 0 00000100:00100000:0.0:1746129559.696121:0:14547:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091b06a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14547:1830948737375872:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129559.696141:0:14547:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800936de400/0x40a459093b0679a7 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fa75 expref: 300 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129559.696147:0:14547:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800936de400/0x40a459093b0679a7 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fa75 expref: 300 pid: 16908 timeout: 915 lvb_type: 0 00000100:00100000:0.0:1746129559.696153:0:14547:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091b07800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14547:1830948737376000:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129559.696173:0:14547:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009efb5e00/0x40a459093b0679a0 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fa6e expref: 300 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129559.696178:0:14547:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009efb5e00/0x40a459093b0679a0 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fa6e expref: 300 pid: 2271 timeout: 915 lvb_type: 0 00000100:00100000:0.0:1746129559.696184:0:14547:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091b04e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14547:1830948737376128:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129559.696198:0:14547:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009cdf3d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746129559.702893:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129559.702915:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129559.702929:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129559.702942:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129559.702962:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129559.702985:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129559.703001:0:7086:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733777792 00000100:00100000:0.0:1746129559.703004:0:7086:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733777792 00010000:00010000:0.0:1746129559.703024:0:7086:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe9f400/0x40a459093b067b91 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fb9b expref: 302 pid: 14547 timeout: 915 lvb_type: 0 00000100:00100000:0.0:1746129559.703042:0:7086:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733777920 00000100:00100000:0.0:1746129559.703044:0:7086:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733777920 00010000:00010000:0.0:1746129559.703053:0:7086:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009011e400/0x40a459093b067b0c lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fb4e expref: 17 pid: 2271 timeout: 915 lvb_type: 0 00000100:00100000:0.0:1746129559.703060:0:7086:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733778432 00000100:00100000:0.0:1746129559.703063:0:7086:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733778432 00010000:00010000:0.0:1746129559.703069:0:7086:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800936de400/0x40a459093b0679a7 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fa75 expref: 303 pid: 16908 timeout: 915 lvb_type: 0 00000100:00100000:0.0:1746129559.703076:0:7086:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733778304 00000100:00100000:0.0:1746129559.703077:0:7086:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733778304 00010000:00010000:0.0:1746129559.703084:0:7086:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0fd200/0x40a459093b0679df lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fa8a expref: 18 pid: 2271 timeout: 915 lvb_type: 0 00000100:00100000:0.0:1746129559.703089:0:7086:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733778560 00000100:00100000:0.0:1746129559.703091:0:7086:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733778560 00010000:00010000:0.0:1746129559.703097:0:7086:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009efb5e00/0x40a459093b0679a0 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fa6e expref: 304 pid: 2271 timeout: 915 lvb_type: 0 00000100:00100000:0.0:1746129559.703104:0:7086:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7815 00000100:00100000:0.0:1746129559.703108:0:7086:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b05880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ada2ffba-8920-4ecb-8068-68caa9806978+304:1960:x1830948733777792:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129559.703116:0:7086:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129559.703120:0:7086:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe9f400/0x40a459093b067b91 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fb9b expref: 305 pid: 14547 timeout: 915 lvb_type: 0 00010000:00010000:0.0:1746129559.703130:0:7086:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe9f400/0x40a459093b067b91 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fb9b expref: 305 pid: 14547 timeout: 915 lvb_type: 0 00010000:00010000:0.0:1746129559.703152:0:7086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009c36a600) 00010000:00010000:0.0:1746129559.703157:0:7086:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800915d4400/0x40a459093b067ca9 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129559.703169:0:7086:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129559.703209:0:7086:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b05880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ada2ffba-8920-4ecb-8068-68caa9806978+305:1960:x1830948733777792:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 100us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129559.703215:0:7086:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7815 00000100:00100000:0.0:1746129559.703230:0:7086:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7817 00000100:00100000:0.0:1746129559.703234:0:7086:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013575c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ada2ffba-8920-4ecb-8068-68caa9806978+303:1963:x1830948733778432:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129559.703240:0:7086:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129559.703244:0:7086:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800936de400/0x40a459093b0679a7 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fa75 expref: 303 pid: 16908 timeout: 915 lvb_type: 0 00010000:00010000:0.0:1746129559.703251:0:7086:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800936de400/0x40a459093b0679a7 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fa75 expref: 303 pid: 16908 timeout: 915 lvb_type: 0 00010000:00010000:0.0:1746129559.703260:0:7086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009c36a600) 00010000:00010000:0.0:1746129559.703263:0:7086:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800915d4400/0x40a459093b067ca9 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129559.703268:0:7086:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129559.703278:0:7086:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013575c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ada2ffba-8920-4ecb-8068-68caa9806978+303:1963:x1830948733778432:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 44us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129559.703282:0:7086:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7817 00010000:00010000:0.0:1746129559.703388:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe9f400/0x40a459093b067b91 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fb9b expref: 302 pid: 14547 timeout: 915 lvb_type: 0 00000100:00100000:0.0:1746129559.703398:0:14547:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091b06680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14547:1830948737375488:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129559.703406:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009011e400/0x40a459093b067b0c lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fb4e expref: 17 pid: 2271 timeout: 915 lvb_type: 0 00000100:00100000:0.0:1746129559.703427:0:14547:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091b06300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14547:1830948737375616:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129559.703434:0:14547:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091b07b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14547:1830948737375744:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129559.703441:0:14547:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091b06a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14547:1830948737375872:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129559.703447:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800936de400/0x40a459093b0679a7 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fa75 expref: 301 pid: 16908 timeout: 915 lvb_type: 0 00000100:00100000:0.0:1746129559.703454:0:14547:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091b07800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14547:1830948737376000:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129559.703460:0:14547:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091b04e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14547:1830948737376128:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129559.703831:0:14547:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800915d4400/0x40a459093b067ca9 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00000100:00100000:0.0:1746129559.707477:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000004:00010000:0.0:1746129559.801514:0:14547:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88013577c700 reply state ffff88012db47400 transno 8589945085 ns: mdt-lustre-MDT0000_UUID lock: ffff8800915d4400/0x40a459093b067ca9 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00000100:00100000:0.0:1746129559.801533:0:14547:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1746129559.801658:0:14547:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013577c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:068dab75-d300-4ead-a742-d14572ad1e50+11:31925:x1830948733777664:12345-192.168.202.4@tcp:36:mirror_io.0 Request processed in 106057us (106181us total) trans 8589945085 rc 0/0 00000100:00100000:0.0:1746129559.801668:0:14547:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11028 00000001:00080000:0.0:1746129559.802355:0:14619:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945075 is committed 00000001:00080000:0.0:1746129559.802364:0:14619:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945073 is committed 00000001:00080000:0.0:1746129559.802376:0:14619:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945080 is committed 00000001:00080000:0.0:1746129559.802384:0:14619:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945078 is committed 00000001:00080000:0.0:1746129559.802399:0:14619:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945085 is committed 00000004:00080000:0.0:1746129559.802403:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2541 committed 00000004:00080000:0.0:1746129559.802419:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2515 committed 00000004:00080000:0.0:1746129559.802426:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2514 committed 00000004:00080000:0.0:1746129559.802427:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2513 committed 00000004:00080000:0.0:1746129559.802429:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2512 committed 00000004:00080000:0.0:1746129559.802431:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2540 committed 00000004:00080000:0.0:1746129559.802432:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2511 committed 00000004:00080000:0.0:1746129559.802434:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2539 committed 00000004:00080000:0.0:1746129559.802436:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2510 committed 00000004:00080000:0.0:1746129559.802437:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2538 committed 00000004:00080000:0.0:1746129559.802438:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2537 committed 00000004:00080000:0.0:1746129559.802439:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2536 committed 00000004:00080000:0.0:1746129559.802440:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2509 committed 00000004:00080000:0.0:1746129559.802442:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2508 committed 00000004:00080000:0.0:1746129559.802443:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2535 committed 00000004:00080000:0.0:1746129559.802444:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2534 committed 00000004:00080000:0.0:1746129559.802445:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2507 committed 00000001:00080000:0.0:1746129559.802452:0:14619:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945081 is committed 00000001:00080000:0.0:1746129559.802462:0:14619:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945084 is committed 00010000:00010000:0.0:1746129559.802500:0:3286:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800915d4400/0x40a459093b067ca9 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129559.802507:0:3286:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800915d4400/0x40a459093b067ca9 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129559.802513:0:3286:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800915d4400/0x40a459093b067ca9 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129559.802517:0:3286:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800915d4400 already unused, calling callback (ffffffffa136e690) 00010000:00010000:0.0:1746129559.802521:0:3286:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800915d4400/0x40a459093b067ca9 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129559.802527:0:3286:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800915d4400/0x40a459093b067ca9 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129559.802545:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009c36a600) 00010000:00010000:0.0:1746129559.802548:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746129559.802552:0:3286:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800915d4400/0x40a459093b067ca9 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129559.802556:0:3286:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800915d4400/0x40a459093b067ca9 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00000100:00100000:0.0:1746129559.802700:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009feee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737376256:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129559.802744:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129559.802783:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009feedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737376768:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129559.802797:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129559.802809:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009feee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737377280:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129559.802824:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129559.802837:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091b04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737377792:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129559.802850:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129559.802865:0:3301:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:0.0:1746129559.802870:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009feeed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737376640:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129559.802882:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129559.802899:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009feeca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737377152:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129559.802913:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129559.802924:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091b05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737377664:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129559.802937:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129559.802948:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091b07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737378176:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129559.802959:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129559.802980:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009feeea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737376384:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129559.802998:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129559.803008:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009feedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737376896:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129559.803020:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129559.803030:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091b04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737377408:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129559.803042:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129559.803052:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091b07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737377920:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129559.803066:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129559.803078:0:3302:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:0.0:1746129559.803081:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009feef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737376512:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129559.803094:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129559.803101:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009feec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737377024:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129559.803113:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129559.803119:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091b05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737377536:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129559.803130:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129559.803136:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091b06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737378048:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129559.803149:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129559.803169:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737376256 00000100:00100000:0.0:1746129559.803176:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737376256 00000100:00100000:0.0:1746129559.803215:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737376768 00000100:00100000:0.0:1746129559.803218:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737376768 00000100:00100000:0.0:1746129559.803225:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737377280 00000100:00100000:0.0:1746129559.803227:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737377280 00000100:00100000:0.0:1746129559.803236:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737377792 00000100:00100000:0.0:1746129559.803238:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737377792 00000100:00100000:0.0:1746129559.803245:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737376640 00000100:00100000:0.0:1746129559.803247:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737376640 00000100:00100000:0.0:1746129559.803254:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737377152 00000100:00100000:0.0:1746129559.803256:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737377152 00000100:00100000:0.0:1746129559.803262:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737377664 00000100:00100000:0.0:1746129559.803263:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737377664 00000100:00100000:0.0:1746129559.803269:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737378176 00000100:00100000:0.0:1746129559.803271:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737378176 00000100:00100000:0.0:1746129559.803276:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737376384 00000100:00100000:0.0:1746129559.803278:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737376384 00000100:00100000:0.0:1746129559.803283:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737376896 00000100:00100000:0.0:1746129559.803285:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737376896 00000100:00100000:0.0:1746129559.803311:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737377408 00000100:00100000:0.0:1746129559.803312:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737377408 00000100:00100000:0.0:1746129559.803320:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737377920 00000100:00100000:0.0:1746129559.803322:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737377920 00000100:00100000:0.0:1746129559.803328:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737376512 00000100:00100000:0.0:1746129559.803329:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737376512 00000100:00100000:0.0:1746129559.803335:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737377024 00000100:00100000:0.0:1746129559.803336:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737377024 00000100:00100000:0.0:1746129559.803341:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737377536 00000100:00100000:0.0:1746129559.803343:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737377536 00000100:00100000:0.0:1746129559.803349:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737378048 00000100:00100000:0.0:1746129559.803351:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737378048 00000100:00100000:0.0:1746129559.803360:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15315 00000100:00100000:0.0:1746129559.803366:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+12:3301:x1830948737376256:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129559.803632:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:3301:x1830948737376256:12345-0@lo:2:osp-syn-1-0.0 Request processed in 265us (886us total) trans 17179873947 rc 0/0 00000100:00100000:0.0:1746129559.803638:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15315 00000100:00100000:0.0:1746129559.803652:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15316 00000100:00100000:0.0:1746129559.803656:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+12:3301:x1830948737376768:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129559.803739:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:3301:x1830948737376768:12345-0@lo:2:osp-syn-1-0.0 Request processed in 82us (940us total) trans 17179873948 rc 0/0 00000100:00100000:0.0:1746129559.803747:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15316 00000100:00100000:0.0:1746129559.803756:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15317 00000100:00100000:0.0:1746129559.803760:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136014e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+75:3301:x1830948737377280:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129559.803917:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136014e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+76:3301:x1830948737377280:12345-0@lo:2:osp-syn-0-0.0 Request processed in 157us (1091us total) trans 21474841173 rc 0/0 00000100:00100000:0.0:1746129559.803922:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15317 00000100:00100000:0.0:1746129559.803930:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15318 00000100:00100000:0.0:1746129559.803933:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136015180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+75:3301:x1830948737377792:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129559.804003:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136015180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+76:3301:x1830948737377792:12345-0@lo:2:osp-syn-0-0.0 Request processed in 69us (1152us total) trans 21474841174 rc 0/0 00000100:00100000:0.0:1746129559.804008:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15318 00000100:00100000:0.0:1746129559.804017:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15319 00000100:00100000:0.0:1746129559.804021:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136014000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+12:3301:x1830948737376640:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746129559.804084:0:7148:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746129559.804087:0:7148:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb mtime from disk: 1746129523 -> 1746129523 00002000:00010000:0.0:1746129559.804089:0:7148:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb atime from disk: 1746129523 -> 1746129523 00002000:00010000:0.0:1746129559.804091:0:7148:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb ctime from disk: 1746129524 -> 1746129524 00002000:00010000:0.0:1746129559.804093:0:7148:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1746129559.804110:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136014000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:3301:x1830948737376640:12345-0@lo:2:osp-syn-1-0.0 Request processed in 89us (1226us total) trans 17179873949 rc 0/0 00000100:00100000:0.0:1746129559.804115:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15319 00000100:00100000:0.0:1746129559.804124:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15320 00000100:00100000:0.0:1746129559.804129:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136016680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+12:3301:x1830948737377152:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129559.804205:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136016680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:3301:x1830948737377152:12345-0@lo:2:osp-syn-1-0.0 Request processed in 76us (1290us total) trans 17179873950 rc 0/0 00000100:00100000:0.0:1746129559.804210:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15320 00000100:00100000:0.0:1746129559.804219:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15321 00000100:00100000:0.0:1746129559.804223:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136016d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+75:3301:x1830948737377664:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129559.804317:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136016d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+76:3301:x1830948737377664:12345-0@lo:2:osp-syn-0-0.0 Request processed in 94us (1378us total) trans 21474841175 rc 0/0 00000100:00100000:0.0:1746129559.804322:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15321 00000100:00100000:0.0:1746129559.804331:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15322 00000100:00100000:0.0:1746129559.804335:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136017480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+75:3301:x1830948737378176:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129559.804408:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136017480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+76:3301:x1830948737378176:12345-0@lo:2:osp-syn-0-0.0 Request processed in 72us (1447us total) trans 21474841176 rc 0/0 00000100:00100000:0.0:1746129559.804429:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15322 00000100:00100000:0.0:1746129559.804438:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15323 00000100:00100000:0.0:1746129559.804443:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bf7ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+12:3302:x1830948737376384:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129559.804527:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bf7ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:3302:x1830948737376384:12345-0@lo:2:osp-syn-1-0.0 Request processed in 84us (1528us total) trans 17179873951 rc 0/0 00000100:00100000:0.0:1746129559.804532:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15323 00000100:00100000:0.0:1746129559.804654:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15324 00000100:00100000:0.0:1746129559.804659:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136017100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+12:3302:x1830948737376896:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129559.804733:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136017100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:3302:x1830948737376896:12345-0@lo:2:osp-syn-1-0.0 Request processed in 74us (1712us total) trans 17179873952 rc 0/0 00000100:00100000:0.0:1746129559.804737:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15324 00000100:00100000:0.0:1746129559.804746:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15325 00000100:00100000:0.0:1746129559.804750:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136017b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+75:3302:x1830948737377408:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129559.804837:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136017b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+76:3302:x1830948737377408:12345-0@lo:2:osp-syn-0-0.0 Request processed in 86us (1793us total) trans 21474841177 rc 0/0 00000100:00100000:0.0:1746129559.804841:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15325 00000100:00100000:0.0:1746129559.804851:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15326 00000100:00100000:0.0:1746129559.804856:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136016300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+75:3302:x1830948737377920:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129559.804929:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136016300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+76:3302:x1830948737377920:12345-0@lo:2:osp-syn-0-0.0 Request processed in 73us (1862us total) trans 21474841178 rc 0/0 00000100:00100000:0.0:1746129559.804934:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15326 00000100:00100000:0.0:1746129559.804943:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15327 00000100:00100000:0.0:1746129559.804947:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136016a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+12:3302:x1830948737376512:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129559.805028:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136016a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:3302:x1830948737376512:12345-0@lo:2:osp-syn-1-0.0 Request processed in 80us (1932us total) trans 17179873953 rc 0/0 00000100:00100000:0.0:1746129559.805033:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15327 00000100:00100000:0.0:1746129559.805042:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15328 00000100:00100000:0.0:1746129559.805046:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136017800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+12:3302:x1830948737377024:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129559.805117:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136017800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:3302:x1830948737377024:12345-0@lo:2:osp-syn-1-0.0 Request processed in 70us (2002us total) trans 17179873954 rc 0/0 00000100:00100000:0.0:1746129559.805122:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15328 00000100:00100000:0.0:1746129559.805132:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15329 00000100:00100000:0.0:1746129559.805136:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136015880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+75:3302:x1830948737377536:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129559.805219:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136015880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+76:3302:x1830948737377536:12345-0@lo:2:osp-syn-0-0.0 Request processed in 82us (2087us total) trans 21474841179 rc 0/0 00000100:00100000:0.0:1746129559.805223:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15329 00000100:00100000:0.0:1746129559.805233:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15330 00000100:00100000:0.0:1746129559.805239:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cda7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+75:3302:x1830948737378048:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746129559.805322:0:7148:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746129559.805325:0:7148:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1746129559.805326:0:7148:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746129559.805328:0:7148:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746129559.805329:0:7148:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1746129559.805349:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cda7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+76:3302:x1830948737378048:12345-0@lo:2:osp-syn-0-0.0 Request processed in 110us (2199us total) trans 21474841180 rc 0/0 00000100:00100000:0.0:1746129559.805354:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15330 00000100:00100000:0.0:1746129559.813992:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129559.814069:0:3300:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1746129559.814081:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cda6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737378304:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129559.814131:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746129559.815530:0:14589:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 8 in progress, 0 in flight, 56 done 00000100:00100000:0.0:1746129559.815554:0:14547:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733778816 00000100:00100000:0.0:1746129559.815561:0:14547:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733778816 00000100:00100000:0.0:1746129559.815606:0:14547:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11029 00000100:00100000:0.0:1746129559.815613:0:14547:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cda5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:068dab75-d300-4ead-a742-d14572ad1e50+7:31925:x1830948733778816:12345-192.168.202.4@tcp:101:mirror_io.0 00010000:00010000:0.0:1746129559.815633:0:14547:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129559.815650:0:14547:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c47d000/0x40a459093b067cb0 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f1fc51 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129559.815707:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c47d000/0x40a459093b067cb0 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f1fc51 expref: 8 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129559.815720:0:14547:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c47d000/0x40a459093b067cb0 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f1fc51 expref: 8 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129559.815741:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009c36a600) 00010000:00010000:0.0:1746129559.815744:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746129559.815748:0:14547:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c47d000, rc 0) 00000100:00100000:0.0:1746129559.815802:0:14547:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cda5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:068dab75-d300-4ead-a742-d14572ad1e50+8:31925:x1830948733778816:12345-192.168.202.4@tcp:101:mirror_io.0 Request processed in 189us (1815us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129559.815808:0:14547:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11029 00000100:00100000:0.0:1746129559.820476:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00080000:0.0:1746129559.820563:0:7097:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1746129559.820569:0:7097:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746129559.820586:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737378304 00000100:00100000:0.0:1746129559.820596:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737378304 00000100:00100000:0.0:1746129559.820638:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15331 00000100:00100000:0.0:1746129559.820645:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cda4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+76:3300:x1830948737378304:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129559.820875:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cda4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+77:3300:x1830948737378304:12345-0@lo:2:osp-syn-0-0.0 Request processed in 230us (6742us total) trans 21474841181 rc 0/0 00000100:00100000:0.0:1746129559.820881:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15331 00000004:00080000:0.0:1746129559.820925:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012cda6680/2, rc 0, transno 21474841181 00000100:00100000:0.0:1746129559.820930:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cda6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737378304:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129559.831237:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733779456 00000100:00100000:0.0:1746129559.831248:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733779456 00000100:00100000:0.0:1746129559.831710:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4639 00000100:00100000:0.0:1746129559.831721:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:068dab75-d300-4ead-a742-d14572ad1e50+8:31925:x1830948733779456:12345-192.168.202.4@tcp:35:mirror_io.0 00000100:00100000:0.0:1746129559.831938:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:068dab75-d300-4ead-a742-d14572ad1e50+9:31925:x1830948733779456:12345-192.168.202.4@tcp:35:mirror_io.0 Request processed in 219us (815us total) trans 8589945087 rc 0/0 00000100:00100000:0.0:1746129559.832280:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4639 00000100:00100000:0.0:1746129559.846482:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129559.852727:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129559.852765:0:14547:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733779712 00000100:00100000:0.0:1746129559.852774:0:14547:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733779712 00000100:00100000:0.0:1746129559.852836:0:14547:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733779968 00000100:00100000:0.0:1746129559.852838:0:14547:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733779968 00000100:00100000:0.0:1746129559.852861:0:14547:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11030 00000100:00100000:0.0:1746129559.852868:0:14547:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cda4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+6:31933:x1830948733779712:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129559.852895:0:14547:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129559.852913:0:14547:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800947b8a00/0x40a459093b067cb7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f1fc58 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129559.857090:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800947b9800/0x40a459093b067cc5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129559.857113:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800947b9800/0x40a459093b067cc5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129559.857126:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800947b9800/0x40a459093b067cc5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129559.857139:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800947b9000/0x40a459093b067ccc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129559.857145:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800947b9000/0x40a459093b067ccc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129559.857150:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800947b9000/0x40a459093b067ccc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129559.857289:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800947b8e00/0x40a459093b067cd3 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129559.857318:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800947b8e00/0x40a459093b067cd3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129559.857324:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800947b8e00/0x40a459093b067cd3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00000004:00200000:0.0:1746129559.857337:0:14547:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:0.0:1746129559.857442:0:14547:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800947b9800/0x40a459093b067cc5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129559.857449:0:14547:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800947b9800/0x40a459093b067cc5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129559.857454:0:14547:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800947b9800/0x40a459093b067cc5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129559.857460:0:14547:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800947b9800 already unused, calling callback (ffffffffa136e690) 00010000:00010000:0.0:1746129559.857464:0:14547:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800947b9800/0x40a459093b067cc5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129559.857470:0:14547:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800947b9800/0x40a459093b067cc5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129559.857480:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880132ef8f00) 00010000:00010000:0.0:1746129559.857482:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129559.857486:0:14547:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800947b9800/0x40a459093b067cc5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129559.857491:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800947b9800/0x40a459093b067cc5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129559.857502:0:14547:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800947b9000/0x40a459093b067ccc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129559.857511:0:14547:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800947b9000/0x40a459093b067ccc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129559.857515:0:14547:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800947b9000/0x40a459093b067ccc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129559.857519:0:14547:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800947b9000 already unused, calling callback (ffffffffa136e690) 00010000:00010000:0.0:1746129559.857521:0:14547:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800947b9000/0x40a459093b067ccc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129559.857525:0:14547:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800947b9000/0x40a459093b067ccc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129559.857530:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800900d1200) 00010000:00010000:0.0:1746129559.857532:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129559.857534:0:14547:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800947b9000/0x40a459093b067ccc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129559.857538:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800947b9000/0x40a459093b067ccc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129559.857590:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800947b8a00/0x40a459093b067cb7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f1fc58 expref: 9 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129559.857602:0:14547:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800947b8e00/0x40a459093b067cd3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f1fc58 expref: 8 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129559.857608:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009c36a600) 00010000:00010000:0.0:1746129559.857610:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746129559.857612:0:14547:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800947b8e00, rc 0) 00000100:00100000:0.0:1746129559.857682:0:14547:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cda4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+8:31933:x1830948733779712:12345-192.168.202.4@tcp:101:cat.0 Request processed in 4813us (11208us total) trans 8589945088 rc 0/0 00000100:00100000:0.0:1746129559.857692:0:14547:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11030 00000100:00100000:0.0:1746129559.873686:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129559.873730:0:8411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733780224 00000100:00100000:0.0:1746129559.873739:0:8411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733780224 00000100:00100000:0.0:1746129559.873775:0:8411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733780736 00000100:00100000:0.0:1746129559.873777:0:8411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733780736 00000100:00100000:0.0:1746129559.873786:0:8411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733780352 00000100:00100000:0.0:1746129559.873788:0:8411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733780352 00000100:00100000:0.0:1746129559.873803:0:8411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15332 00000100:00100000:0.0:1746129559.873814:0:8411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013577d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+11:1963:x1830948733780224:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129559.873831:0:8411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129559.873851:0:8411:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c47d400/0x40a459093b067d04 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f1fc6d expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746129559.873877:0:8411:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3f3:0x0] initial LVB size: 2097152, mtime: 0x6813d297, atime: 0x6813d296, ctime: 0x6813d297, blocks: 0x821 00010000:00010000:0.0:1746129559.873894:0:8411:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129559.873897:0:8411:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129559.873905:0:8411:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c47d400/0x40a459093b067d04 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f1fc6d expref: 12 pid: 8411 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129559.873920:0:8411:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c47d400/0x40a459093b067d04 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f1fc6d expref: 12 pid: 8411 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129559.873929:0:8411:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c47d400, rc 0) 00000100:00100000:0.0:1746129559.875060:0:8411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013577d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+13:1963:x1830948733780224:12345-192.168.202.4@tcp:101:cat.0 Request processed in 1249us (1405us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129559.875069:0:8411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15332 00000100:00100000:0.0:1746129559.875087:0:8411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15335 00000100:00100000:0.0:1746129559.875095:0:8411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013577e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+28:1963:x1830948733780096:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129559.875102:0:8411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129559.875111:0:8411:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800947b8000/0x40a459093b067d2e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f1fc66 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746129559.875124:0:8411:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3ec:0x0] initial LVB size: 1048576, mtime: 0x6813d296, atime: 0x6813d296, ctime: 0x6813d296, blocks: 0x7bd 00010000:00010000:0.0:1746129559.875131:0:8411:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129559.875133:0:8411:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129559.875137:0:8411:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800947b8000/0x40a459093b067d2e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f1fc66 expref: 29 pid: 8411 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129559.875145:0:8411:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800947b8000/0x40a459093b067d2e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f1fc66 expref: 29 pid: 8411 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129559.875151:0:8411:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800947b8000, rc 0) 00000100:00100000:0.0:1746129559.875167:0:8411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013577e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+29:1963:x1830948733780096:12345-192.168.202.4@tcp:101:cat.0 Request processed in 75us (1454us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129559.875180:0:8411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15335 00000100:00100000:0.0:1746129559.889180:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733781376 00000100:00100000:0.0:1746129559.889190:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733781376 00000100:00100000:0.0:1746129559.889238:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15338 00000100:00100000:0.0:1746129559.889246:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013577e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ada2ffba-8920-4ecb-8068-68caa9806978+35:1961:x1830948733781376:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129559.891758:0:7148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129559.891779:0:7148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095cde000/0x40a459093b067d51 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f1fc9e expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129559.891809:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129559.891811:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129559.891819:0:7148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095cde000/0x40a459093b067d51 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f1fc9e expref: 36 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129559.891831:0:7148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095cde000/0x40a459093b067d51 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f1fc9e expref: 36 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129559.891840:0:7148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095cde000, rc 0) 00000100:00100000:0.0:1746129559.891883:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013577e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ada2ffba-8920-4ecb-8068-68caa9806978+36:1961:x1830948733781376:12345-192.168.202.4@tcp:101:cat.0 Request processed in 2638us (2742us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129559.891891:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15338 00000100:00100000:0.0:1746129559.891913:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733781632 00000100:00100000:0.0:1746129559.891919:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733781632 00000100:00100000:0.0:1746129559.891940:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733781760 00000100:00100000:0.0:1746129559.891942:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733781760 00000100:00100000:0.0:1746129559.891953:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733781888 00000100:00100000:0.0:1746129559.891954:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733781888 00000100:00100000:0.0:1746129559.891963:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733782016 00000100:00100000:0.0:1746129559.891965:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733782016 00000100:00100000:0.0:1746129559.891976:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15340 00000100:00100000:0.0:1746129559.891982:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013577f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ada2ffba-8920-4ecb-8068-68caa9806978+25:1960:x1830948733781632:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129559.891990:0:7148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129559.891998:0:7148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5b8e400/0x40a459093b067d58 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f1fcac expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129559.892008:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129559.892010:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129559.892014:0:7148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5b8e400/0x40a459093b067d58 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f1fcac expref: 26 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129559.892022:0:7148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5b8e400/0x40a459093b067d58 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f1fcac expref: 26 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129559.892029:0:7148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5b8e400, rc 0) 00000100:00100000:0.0:1746129559.893567:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013577f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ada2ffba-8920-4ecb-8068-68caa9806978+26:1960:x1830948733781632:12345-192.168.202.4@tcp:101:cat.0 Request processed in 1579us (1718us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129559.893576:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15340 00000100:00100000:0.0:1746129559.893599:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15343 00000100:00100000:0.0:1746129559.893607:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ada2ffba-8920-4ecb-8068-68caa9806978+25:1960:x1830948733782016:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129559.893616:0:7148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129559.893627:0:7148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5b8f400/0x40a459093b067d6d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f1fcc1 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129559.893643:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129559.893644:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129559.893649:0:7148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5b8f400/0x40a459093b067d6d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f1fcc1 expref: 26 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129559.893687:0:7148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5b8f400/0x40a459093b067d6d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f1fcc1 expref: 26 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129559.893694:0:7148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5b8f400, rc 0) 00000100:00100000:0.0:1746129559.893755:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ada2ffba-8920-4ecb-8068-68caa9806978+26:1960:x1830948733782016:12345-192.168.202.4@tcp:101:cat.0 Request processed in 150us (1839us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129559.893764:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15343 00000100:00100000:0.0:1746129559.894021:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129559.894042:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129559.894057:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129559.895376:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129559.896134:0:31521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7362 00000100:00100000:0.0:1746129559.896139:0:31521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cda4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+13:1962:x1830948733782784:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129559.899533:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129559.899635:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129559.899677:0:14547:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733783552 00000100:00100000:0.0:1746129559.899684:0:14547:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733783552 00000100:00100000:0.0:1746129559.899716:0:14547:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733783680 00000100:00100000:0.0:1746129559.899718:0:14547:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733783680 00000100:00100000:0.0:1746129559.899738:0:14547:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11034 00000100:00100000:0.0:1746129559.899745:0:14547:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cda6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ada2ffba-8920-4ecb-8068-68caa9806978+292:31936:x1830948733783552:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:0.0:1746129559.899767:0:14547:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129559.899770:0:14547:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1746129559.899795:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091a07e00/0x40a459093b067d19 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f1fc90 expref: 292 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129559.899812:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009c36a600) 00010000:00010000:0.0:1746129559.899816:0:14547:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746129559.899828:0:14547:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b8ee00/0x40a459093b067d74 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f1fcc8 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129559.899878:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6cafc00/0x40a459093b067d7b lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129559.899890:0:14547:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c47d000/0x40a459093b067cb0 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f1fc51 expref: 8 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129559.899896:0:14547:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6cafc00/0x40a459093b067d7b lrc: 4/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129559.899926:0:14547:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009c47d000/0x40a459093b067cb0 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fc51 expref: 8 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129559.899937:0:14547:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c47d000/0x40a459093b067cb0 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fc51 expref: 8 pid: 14547 timeout: 915 lvb_type: 0 00000100:00100000:0.0:1746129559.899950:0:14547:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cda7800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14547:1830948737378688:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129559.900014:0:14547:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4123e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746129559.900030:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11035 00000100:00100000:0.0:1746129559.900035:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cda5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ada2ffba-8920-4ecb-8068-68caa9806978+292:31938:x1830948733783680:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129559.900042:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129559.900048:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cad0a00/0x40a459093b067d82 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f1fccf expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129559.900078:0:14549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6cafc00/0x40a459093b067d7b lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129559.900084:0:14549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cad0a00/0x40a459093b067d82 lrc: 4/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f1fccf expref: 293 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129559.900094:0:14549:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6cafc00/0x40a459093b067d7b lrc: 4/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129559.900108:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cad0a00/0x40a459093b067d82 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f1fccf expref: 293 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129559.900117:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009c36a600) 00010000:00010000:0.0:1746129559.900120:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746129559.900122:0:14549:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6cafc00/0x40a459093b067d7b lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129559.900127:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cad0a00, rc 0) 00000100:00100000:0.0:1746129559.900148:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cda5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ada2ffba-8920-4ecb-8068-68caa9806978+293:31938:x1830948733783680:12345-192.168.202.4@tcp:101:cat.0 Request processed in 112us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129559.900154:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11035 00000100:00100000:0.0:1746129559.915989:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129559.916163:0:14547:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cda7800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14547:1830948737378688:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129559.916191:0:14547:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6cafc00/0x40a459093b067d7b lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 14547 initiator: MDT0 00000100:00100000:0.0:1746129559.916217:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733783808 00000100:00100000:0.0:1746129559.916223:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733783808 00010000:00010000:0.0:1746129559.916256:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c47d000/0x40a459093b067cb0 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fc51 expref: 9 pid: 14547 timeout: 915 lvb_type: 0 00000100:00100000:0.0:1746129559.916283:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7823 00000100:00100000:0.0:1746129559.916313:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009feed500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:068dab75-d300-4ead-a742-d14572ad1e50+9:1962:x1830948733783808:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129559.916327:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129559.916333:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009c47d000/0x40a459093b067cb0 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fc51 expref: 9 pid: 14547 timeout: 915 lvb_type: 0 00010000:00010000:0.0:1746129559.916348:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009c47d000/0x40a459093b067cb0 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fc51 expref: 9 pid: 14547 timeout: 915 lvb_type: 0 00010000:00010000:0.0:1746129559.916369:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c47d000/0x40a459093b067cb0 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fc51 expref: 9 pid: 14547 timeout: 915 lvb_type: 0 00010000:00010000:0.0:1746129559.916382:0:7085:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009c36a600) 00010000:00010000:0.0:1746129559.916387:0:7085:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6cafc00/0x40a459093b067d7b lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129559.916397:0:7085:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6cafc00/0x40a459093b067d7b lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290400000020 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129559.916403:0:7085:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6cafc00/0x40a459093b067d7b lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290400000020 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129559.916421:0:7085:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009cad0a00/0x40a459093b067d82 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f1fccf expref: 292 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129559.916437:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129559.916478:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009feed500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:068dab75-d300-4ead-a742-d14572ad1e50+8:1962:x1830948733783808:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 188us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129559.916486:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7823 00010000:00010000:0.0:1746129559.916506:0:14547:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6cafc00/0x40a459093b067d7b lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129559.916511:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6cafc00/0x40a459093b067d7b lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14547 initiator: MDT0 00000040:00080000:0.0:1746129559.917111:0:14547:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3345, 88 off281080 00000004:00080000:0.0:1746129559.917118:0:14547:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 815233823596ns, next at 776349687452ns, rc = 0 00000040:00080000:0.0:1746129559.917150:0:14547:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3371, 88 off283280 00000004:00080000:0.0:1746129559.917153:0:14547:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 815233859381ns, next at 776375382381ns, rc = 0 00000040:00080000:0.0:1746129559.917164:0:14547:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3372, 88 off283368 00000004:00080000:0.0:1746129559.917166:0:14547:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 815233872648ns, next at 776375382381ns, rc = 0 00000040:00080000:0.0:1746129559.917174:0:14547:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3346, 88 off281168 00000004:00080000:0.0:1746129559.917176:0:14547:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 815233882674ns, next at 776349687452ns, rc = 0 00000040:00080000:0.0:1746129559.917183:0:14547:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3347, 88 off281256 00000004:00080000:0.0:1746129559.917186:0:14547:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 815233892531ns, next at 776349687452ns, rc = 0 00000040:00080000:0.0:1746129559.917193:0:14547:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3373, 88 off283456 00000004:00080000:0.0:1746129559.917196:0:14547:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 815233902121ns, next at 776375382381ns, rc = 0 00000040:00080000:0.0:1746129559.917202:0:14547:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3374, 88 off283544 00000004:00080000:0.0:1746129559.917205:0:14547:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 815233911184ns, next at 776375382381ns, rc = 0 00000040:00080000:0.0:1746129559.917212:0:14547:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3375, 88 off283632 00000004:00080000:0.0:1746129559.917214:0:14547:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 815233920348ns, next at 776375382381ns, rc = 0 00000040:00080000:0.0:1746129559.917221:0:14547:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3348, 88 off281344 00000004:00080000:0.0:1746129559.917223:0:14547:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 815233929586ns, next at 776349687452ns, rc = 0 00000040:00080000:0.0:1746129559.917229:0:14547:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3376, 88 off283720 00000004:00080000:0.0:1746129559.917232:0:14547:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 815233937816ns, next at 776375382381ns, rc = 0 00000040:00080000:0.0:1746129559.917238:0:14547:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3349, 88 off281432 00000004:00080000:0.0:1746129559.917240:0:14547:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 815233946623ns, next at 776349687452ns, rc = 0 00000040:00080000:0.0:1746129559.917247:0:14547:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3377, 88 off283808 00000004:00080000:0.0:1746129559.917249:0:14547:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 815233955616ns, next at 776375382381ns, rc = 0 00000040:00080000:0.0:1746129559.917256:0:14547:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3350, 88 off281520 00000004:00080000:0.0:1746129559.917258:0:14547:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 815233964554ns, next at 776349687452ns, rc = 0 00000040:00080000:0.0:1746129559.917265:0:14547:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3351, 88 off281608 00000004:00080000:0.0:1746129559.917268:0:14547:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 815233974446ns, next at 776349687452ns, rc = 0 00000040:00080000:0.0:1746129559.917275:0:14547:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3352, 88 off281696 00000004:00080000:0.0:1746129559.917278:0:14547:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 815233984226ns, next at 776349687452ns, rc = 0 00000040:00080000:0.0:1746129559.917284:0:14547:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3353, 88 off281784 00000004:00080000:0.0:1746129559.917286:0:14547:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 815233992522ns, next at 776349687452ns, rc = 0 00000040:00080000:0.0:1746129559.917382:0:14547:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3378, 88 off283896 00000004:00080000:0.0:1746129559.917386:0:14547:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 815234092006ns, next at 776375382381ns, rc = 0 00000100:00100000:0.0:1746129559.934724:0:31521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cda4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+14:1962:x1830948733782784:12345-192.168.202.4@tcp:3:cat.0 Request processed in 38571us (39335us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129559.934738:0:31521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7362 00002000:00100000:0.0:1746129559.934753:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff88012cda4a80 x1830948733782784/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:300/0 lens 488/440 e 0 to 0 dl 1746129570 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129559.934763:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cda4a80 with x1830948733782784 ext(1048576->2097151) 00002000:00010000:0.0:1746129559.934769:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012cda4a80 00000100:00100000:0.0:1746129559.948710:0:21463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cda5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+29:1963:x1830948733782528:12345-192.168.202.4@tcp:3:cat.0 Request processed in 52872us (54676us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129559.948727:0:21463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7359 00002000:00100000:0.0:1746129559.948741:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3ec:0x0] (0->1048575) req@ffff88012cda5880 x1830948733782528/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:300/0 lens 488/440 e 0 to 0 dl 1746129570 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129559.948751:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cda5880 with x1830948733782528 ext(0->1048575) 00002000:00010000:0.0:1746129559.948758:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012cda5880 00000001:00080000:0.0:1746129559.949876:0:564:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841170 is committed 00000001:00080000:0.0:1746129559.949892:0:564:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841168 is committed 00000001:00080000:0.0:1746129559.949930:0:564:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841128 is committed 00000001:00080000:0.0:1746129559.949935:0:564:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841085 is committed 00000001:00080000:0.0:1746129559.949974:0:564:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841111 is committed 00000001:00080000:0.0:1746129559.950020:0:564:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841150 is committed 00000001:00080000:0.0:1746129559.950819:0:564:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841172 is committed 00000001:00080000:0.0:1746129559.950828:0:564:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841171 is committed 00000001:00080000:0.0:1746129559.950859:0:564:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841129 is committed 00000001:00080000:0.0:1746129559.983664:0:14619:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945092 is committed 00000004:00080000:0.0:1746129559.983672:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2549 committed 00000004:00080000:0.0:1746129559.983681:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2524 committed 00000004:00080000:0.0:1746129559.983687:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2523 committed 00000004:00080000:0.0:1746129559.983689:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2522 committed 00000004:00080000:0.0:1746129559.983690:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2521 committed 00000004:00080000:0.0:1746129559.983692:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2548 committed 00000004:00080000:0.0:1746129559.983694:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2520 committed 00000004:00080000:0.0:1746129559.983695:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2547 committed 00000004:00080000:0.0:1746129559.983696:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2519 committed 00000004:00080000:0.0:1746129559.983698:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2546 committed 00000004:00080000:0.0:1746129559.983700:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2545 committed 00000004:00080000:0.0:1746129559.983701:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2544 committed 00000004:00080000:0.0:1746129559.983704:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2518 committed 00000004:00080000:0.0:1746129559.983705:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2517 committed 00000004:00080000:0.0:1746129559.983707:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2543 committed 00000004:00080000:0.0:1746129559.983708:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2542 committed 00000004:00080000:0.0:1746129559.983710:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2516 committed 00000001:00080000:0.0:1746129559.983717:0:14619:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945088 is committed 00000001:00080000:0.0:1746129559.983722:0:14619:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945087 is committed 00000001:00080000:0.0:1746129559.983732:0:14619:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945091 is committed 00000100:00100000:0.0:1746129559.983885:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009feef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737379072:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129559.983927:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129559.983953:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009feec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737379584:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129559.983972:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129559.983984:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091b06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737380096:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129559.983999:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129559.984010:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136015180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737380608:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129559.984022:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129559.984038:0:3302:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:0.0:1746129559.984042:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009feef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737379200:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129559.984057:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129559.984068:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009feefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737379712:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129559.984080:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129559.984090:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136014a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737380224:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129559.984102:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129559.984111:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136014000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737380736:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129559.984123:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129559.984141:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009feece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737379328:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129559.984156:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129559.984165:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cda7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737379840:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129559.984177:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129559.984187:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136015500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737380352:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129559.984200:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129559.984209:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136016680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737380864:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129559.984221:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129559.984231:0:3300:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:0.0:1746129559.984235:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009feed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737379456:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129559.984247:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129559.984253:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091b06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737379968:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129559.984265:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129559.984271:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136014e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737380480:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129559.984282:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129559.984288:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136016d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737380992:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129559.984320:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129559.984342:0:8412:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737379072 00000100:00100000:0.0:1746129559.984350:0:8412:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737379072 00000100:00100000:0.0:1746129559.985206:0:8412:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737379584 00000100:00100000:0.0:1746129559.985211:0:8412:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737379584 00000100:00100000:0.0:1746129559.985223:0:8412:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737380096 00000100:00100000:0.0:1746129559.985225:0:8412:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737380096 00000100:00100000:0.0:1746129559.986188:0:8412:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15346 00000100:00100000:0.0:1746129559.986192:0:8412:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094064a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+21:3302:x1830948737380608:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129559.986345:0:8412:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094064a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+22:3302:x1830948737380608:12345-0@lo:2:osp-syn-0-0.0 Request processed in 151us (2321us total) trans 21474841182 rc 0/0 00000100:00100000:0.0:1746129559.986351:0:8412:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15346 00000100:00100000:0.0:1746129559.986363:0:8412:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15347 00000100:00100000:0.0:1746129559.986367:0:8412:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094066680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+21:3302:x1830948737379200:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746129559.986455:0:8412:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746129559.986457:0:8412:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb mtime from disk: 1746129560 -> 1746129560 00002000:00010000:0.0:1746129559.986459:0:8412:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb atime from disk: 1746129559 -> 1746129559 00002000:00010000:0.0:1746129559.986460:0:8412:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb ctime from disk: 1746129560 -> 1746129560 00002000:00010000:0.0:1746129559.986462:0:8412:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746129559.987243:0:8412:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094066680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+21:3302:x1830948737379200:12345-0@lo:2:osp-syn-1-0.0 Request processed in 875us (3184us total) trans 17179873957 rc 0/0 00000100:00100000:0.0:1746129559.987249:0:8412:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15347 00000100:00100000:0.0:1746129559.987261:0:8412:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15352 00000100:00100000:0.0:1746129559.987268:0:8412:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094064e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+20:3300:x1830948737379840:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129559.987377:0:8412:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094064e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+21:3300:x1830948737379840:12345-0@lo:2:osp-syn-1-0.0 Request processed in 110us (3198us total) trans 17179873960 rc 0/0 00000100:00100000:0.0:1746129559.987382:0:8412:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15352 00000100:00100000:0.0:1746129559.987392:0:8412:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15353 00000100:00100000:0.0:1746129559.987396:0:8412:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094064380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+21:3300:x1830948737380352:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746129559.987479:0:8412:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb size from disk: 5146336 -> 5146336 00002000:00010000:0.0:1746129559.987482:0:8412:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb mtime from disk: 1746129560 -> 1746129560 00002000:00010000:0.0:1746129559.987484:0:8412:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb atime from disk: 1746129560 -> 1746129560 00002000:00010000:0.0:1746129559.987486:0:8412:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb ctime from disk: 1746129559 -> 1746129559 00002000:00010000:0.0:1746129559.987487:0:8412:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb blocks from disk: 6033 -> 6033 00000100:00100000:0.0:1746129559.987506:0:8412:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094064380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+22:3300:x1830948737380352:12345-0@lo:2:osp-syn-0-0.0 Request processed in 110us (3305us total) trans 21474841185 rc 0/0 00000100:00100000:0.0:1746129559.987511:0:8412:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15353 00000100:00100000:0.0:1746129559.987521:0:8412:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15354 00000100:00100000:0.0:1746129559.987526:0:8412:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094064000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+21:3300:x1830948737380864:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746129559.987587:0:8412:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746129559.987589:0:8412:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1746129559.987591:0:8412:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746129559.987592:0:8412:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746129559.987594:0:8412:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1746129559.987613:0:8412:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094064000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+22:3300:x1830948737380864:12345-0@lo:2:osp-syn-0-0.0 Request processed in 87us (3391us total) trans 21474841186 rc 0/0 00000100:00100000:0.0:1746129559.987617:0:8412:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15354 00000100:00100000:0.0:1746129559.987626:0:8412:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15355 00000100:00100000:0.0:1746129559.987630:0:8412:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094066300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+20:3300:x1830948737379456:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746129559.989403:0:8412:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746129559.989406:0:8412:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb mtime from disk: 1746129523 -> 1746129523 00002000:00010000:0.0:1746129559.989408:0:8412:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb atime from disk: 1746129523 -> 1746129523 00002000:00010000:0.0:1746129559.989423:0:8412:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb ctime from disk: 1746129524 -> 1746129524 00002000:00010000:0.0:1746129559.989425:0:8412:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1746129559.989452:0:8412:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094066300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+21:3300:x1830948737379456:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1821us (5203us total) trans 17179873962 rc 0/0 00000100:00100000:0.0:1746129559.989458:0:8412:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15355 00000100:00100000:0.0:1746129559.989470:0:8412:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15360 00000100:00100000:0.0:1746129559.989475:0:8412:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800903a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+23:3303:x1830948737381120:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129559.990139:0:8412:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800903a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+23:3303:x1830948737381120:12345-0@lo:2:osp-syn-0-0.0 Request processed in 662us (2965us total) trans 21474841190 rc 0/0 00000100:00100000:0.0:1746129559.990144:0:8412:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15360 00000100:00100000:0.0:1746129559.990512:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733784064 00000100:00100000:0.0:1746129559.990517:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733784064 00000100:00100000:0.0:1746129559.990556:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4640 00000100:00100000:0.0:1746129559.990562:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+8:31933:x1830948733784064:12345-192.168.202.4@tcp:49:cat.0 00000100:00100000:0.0:1746129559.990660:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+8:31933:x1830948733784064:12345-192.168.202.4@tcp:49:cat.0 Request processed in 98us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129559.990665:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4640 00000100:00100000:0.0:1746129559.992404:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129559.999864:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129560.008731:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00080000:0.0:1746129560.009393:0:7097:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746129560.023172:0:31521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7366 00000100:00100000:0.0:1746129560.023185:0:31521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ada2ffba-8920-4ecb-8068-68caa9806978+28:1962:x1830948733785344:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129560.024633:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129560.025672:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733785728 00000100:00100000:0.0:1746129560.025681:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733785728 00000100:00100000:0.0:1746129560.025725:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15361 00000100:00100000:0.0:1746129560.025732:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c079500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ada2ffba-8920-4ecb-8068-68caa9806978+16:31936:x1830948733785728:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:0.0:1746129560.025746:0:4385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129560.025766:0:4385:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136b3f800/0x40a459093b067d97 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f1fcdd expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129560.025797:0:4385:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f446000/0x40a459093b067d35 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f1fc82 expref: 8 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129560.025805:0:4385:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095cdee00/0x40a459093b067d66 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f1fcba expref: 17 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129560.025812:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129560.025814:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129560.025817:0:4385:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136b3f800/0x40a459093b067d97 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [2535424->2936831] (req 2535424->2936831) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f1fcdd expref: 17 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129560.025849:0:4385:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095cdee00/0x40a459093b067d66 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fcba expref: 17 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129560.025861:0:4385:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095cdee00/0x40a459093b067d66 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fcba expref: 17 pid: 8412 timeout: 915 lvb_type: 1 00000100:00100000:0.0:1746129560.025880:0:4385:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c07ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:4385:1830948737381248:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129560.025957:0:4385:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f446000/0x40a459093b067d35 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fc82 expref: 8 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129560.025966:0:4385:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f446000/0x40a459093b067d35 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fc82 expref: 8 pid: 8412 timeout: 915 lvb_type: 1 00000100:00100000:0.0:1746129560.025974:0:4385:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c078a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:4385:1830948737381376:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129560.025993:0:4385:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1a12240 going to sleep for 11 seconds 00000100:00100000:0.0:1746129560.030116:0:21463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c079880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+12:1960:x1830948733784576:12345-192.168.202.4@tcp:3:cat.0 Request processed in 20695us (21382us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129560.030127:0:21463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7363 00002000:00100000:0.0:1746129560.030140:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff88009c079880 x1830948733784576/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:301/0 lens 488/440 e 0 to 0 dl 1746129571 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129560.030150:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c079880 with x1830948733784576 ext(1048576->2097151) 00002000:00010000:0.0:1746129560.030155:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c079880 00000100:00100000:0.0:1746129560.067370:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129560.067478:0:4385:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c078a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:4385:1830948737381376:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129560.091495:0:8414:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737381504 00000100:00100000:0.0:1746129560.091504:0:8414:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737381504 00000100:00100000:0.0:1746129560.091558:0:8414:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1746129560.091565:0:8414:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+23:3302:x1830948737381504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1746129560.091589:0:8414:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 510722048 pending 0 free 3852468224 avail 3827302400 00000100:00100000:0.0:1746129560.091633:0:8414:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+23:3302:x1830948737381504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129560.091639:0:8414:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1746129560.092289:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129560.092344:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129560.093017:0:8415:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ada2ffba-8920-4ecb-8068-68caa9806978+15:1962:x1830948733784832:12345-192.168.202.4@tcp:3:cat.0 Request processed in 71660us (71989us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129560.093026:0:8415:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7364 00002000:00100000:0.0:1746129560.093035:0:8415:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3ec:0x0] (0->1048575) req@ffff88009fbad880 x1830948733784832/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:301/0 lens 488/440 e 0 to 0 dl 1746129571 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129560.093044:0:8415:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbad880 with x1830948733784832 ext(0->1048575) 00002000:00010000:0.0:1746129560.093050:0:8415:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fbad880 00000100:00100000:0.0:1746129560.093065:0:8415:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733786240 00000100:00100000:0.0:1746129560.093069:0:8415:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733786240 00002000:00100000:0.0:1746129560.093092:0:8415:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3f4:0x0] (1048576->2097151) req@ffff88009c07a680 x1830948733786240/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:301/0 lens 488/0 e 0 to 0 dl 1746129571 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129560.093099:0:8415:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c07a680 with x1830948733786240 ext(1048576->2097151) 00002000:00010000:0.0:1746129560.093102:0:8415:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c07a680 00000100:00100000:0.0:1746129560.093132:0:8415:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7368 00000100:00100000:0.0:1746129560.093138:0:8415:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c07a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+12:1961:x1830948733786240:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129560.124078:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094efd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1830948737382272:0@lo:400:kworker.0 00000100:00100000:0.0:1746129560.124106:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129560.124123:0:3300:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1746129560.124126:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094efe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f03f6bde-e986-4df5-86c3-48805e205677:3300:1830948737381888:0@lo:400:kworker.0 00000100:00100000:0.0:1746129560.124144:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129560.124176:0:14543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737381888 00000100:00100000:0.0:1746129560.124179:0:14543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737381888 00000100:00100000:0.0:1746129560.124200:0:14543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1746129560.124204:0:14543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095b4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f03f6bde-e986-4df5-86c3-48805e205677+18:3300:x1830948737381888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746129560.124228:0:14543:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095b4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f03f6bde-e986-4df5-86c3-48805e205677+18:3300:x1830948737381888:12345-0@lo:400:kworker.0 Request processed in 23us (82us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129560.124232:0:14543:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1746129560.124259:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094efe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f03f6bde-e986-4df5-86c3-48805e205677:3300:1830948737381888:0@lo:400:kworker.0 00000100:00100000:0.0:1746129560.124276:0:15096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737382272 00000100:00100000:0.0:1746129560.124278:0:15096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737382272 00000100:00100000:0.0:1746129560.124290:0:15096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1746129560.124312:0:15096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c079c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1830948737382272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746129560.124332:0:15096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c079c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1830948737382272:12345-0@lo:400:kworker.0 Request processed in 19us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129560.124336:0:15096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1746129560.124349:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094efd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1830948737382272:0@lo:400:kworker.0 00000100:00100000:0.0:1746129560.128698:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129560.146781:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129560.146883:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129560.158493:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129560.158537:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129560.158564:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129560.158619:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129560.158646:0:21463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733787520 00000100:00100000:0.0:1746129560.158656:0:21463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733787520 00002000:00100000:0.0:1746129560.158703:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3ef:0x0] (2097152->3547135) req@ffff88009c079f80 x1830948733787520/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:301/0 lens 504/0 e 0 to 0 dl 1746129571 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129560.158719:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c079f80 with x1830948733787520 ext(2097152->3547135) 00002000:00010000:0.0:1746129560.158725:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c079f80 00000100:00100000:0.0:1746129560.158742:0:21463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733787776 00000100:00100000:0.0:1746129560.158744:0:21463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733787776 00002000:00100000:0.0:1746129560.158753:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3ef:0x0] (3547136->4194303) req@ffff88009c079180 x1830948733787776/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:301/0 lens 488/0 e 0 to 0 dl 1746129571 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129560.158760:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c079180 with x1830948733787776 ext(3547136->4194303) 00002000:00010000:0.0:1746129560.158762:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c079180 00000100:00100000:0.0:1746129560.158776:0:31520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733788032 00000100:00100000:0.0:1746129560.158778:0:31520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733788032 00002000:00100000:0.0:1746129560.158791:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3f5:0x0] (2097152->3145727) req@ffff88009c07b480 x1830948733788032/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:301/0 lens 488/0 e 0 to 0 dl 1746129571 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129560.158797:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c07b480 with x1830948733788032 ext(2097152->3145727) 00002000:00010000:0.0:1746129560.158800:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c07b480 00000100:00100000:0.0:1746129560.158809:0:31520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733788288 00000100:00100000:0.0:1746129560.158810:0:31520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733788288 00002000:00100000:0.0:1746129560.158817:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3f5:0x0] (3145728->4194303) req@ffff88009c078380 x1830948733788288/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:301/0 lens 488/0 e 0 to 0 dl 1746129571 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129560.158822:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c078380 with x1830948733788288 ext(3145728->4194303) 00002000:00010000:0.0:1746129560.158824:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c078380 00000100:00100000:0.0:1746129560.158835:0:31520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7372 00000100:00100000:0.0:1746129560.158842:0:31520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c079f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ada2ffba-8920-4ecb-8068-68caa9806978+15:1961:x1830948733787520:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129560.160789:0:21463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7373 00000100:00100000:0.0:1746129560.160802:0:21463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c079180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ada2ffba-8920-4ecb-8068-68caa9806978+16:1960:x1830948733787776:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129560.181189:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129560.181925:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733788416 00000100:00100000:0.0:1746129560.181936:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733788416 00000100:00100000:0.0:1746129560.181976:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15362 00000100:00100000:0.0:1746129560.181983:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bf7e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+8:1961:x1830948733788416:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129560.182003:0:4385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129560.182021:0:4385:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092fd2400/0x40a459093b067d9e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f1fce4 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129560.182076:0:4385:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c078700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:4385:1830948737382400:192.168.202.4@tcp:106: 00000100:00100000:0.0:1746129560.192318:0:4385:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1a12000 going to sleep for 11 seconds 00000100:00100000:0.0:1746129560.196676:0:31518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c07b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ada2ffba-8920-4ecb-8068-68caa9806978+28:1961:x1830948733788032:12345-192.168.202.4@tcp:3:cat.0 Request processed in 35124us (38110us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129560.196683:0:31518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7374 00002000:00100000:0.0:1746129560.196688:0:31518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3f5:0x0] (2097152->3145727) req@ffff88009c07b480 x1830948733788032/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:301/0 lens 488/440 e 0 to 0 dl 1746129571 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129560.196695:0:31518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c07b480 with x1830948733788032 ext(2097152->3145727) 00002000:00010000:0.0:1746129560.196698:0:31518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c07b480 00000100:00100000:0.0:1746129560.205719:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129560.205802:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129560.207041:0:31521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733788672 00000100:00100000:0.0:1746129560.207046:0:31521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733788672 00002000:00100000:0.0:1746129560.207079:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3ef:0x0] (2535424->2936831) req@ffff88009c079500 x1830948733788672/t0(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:301/0 lens 488/0 e 0 to 0 dl 1746129571 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129560.207089:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c079500 with x1830948733788672 ext(2535424->2936831) 00010000:00010000:0.0:1746129560.207097:0:31521:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880136b3f800/0x40a459093b067d97 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2535424->2936831) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fcdd expref: 15 pid: 4385 timeout: 915 lvb_type: 0 00010000:00010000:0.0:1746129560.207110:0:31521:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880136b3f800/0x40a459093b067d97 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2535424->2936831) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fcdd expref: 15 pid: 4385 timeout: 915 lvb_type: 0 00002000:00010000:0.0:1746129560.207118:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009c079500 00000100:00100000:0.0:1746129560.207138:0:31518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2302 00000100:00100000:0.0:1746129560.207145:0:31518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c079500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ada2ffba-8920-4ecb-8068-68caa9806978+15:1963:x1830948733788672:12345-192.168.202.4@tcp:4:cat.0 00000100:00100000:0.0:1746129560.207547:0:4699:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15364 00000100:00100000:0.0:1746129560.207554:0:4699:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c078700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ada2ffba-8920-4ecb-8068-68caa9806978+16:31938:x1830948733788800:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129560.207563:0:4699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129560.207577:0:4699:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092fd3e00/0x40a459093b067dac lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f1fcf2 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129560.207597:0:4699:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129560.207600:0:4699:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129560.207604:0:4699:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092fd3e00/0x40a459093b067dac lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f1fcf2 expref: 17 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129560.207613:0:4699:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092fd3e00/0x40a459093b067dac lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f1fcf2 expref: 17 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129560.207622:0:4699:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092fd3e00, rc 0) 00000100:00100000:0.0:1746129560.207640:0:4699:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c078700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ada2ffba-8920-4ecb-8068-68caa9806978+17:31938:x1830948733788800:12345-192.168.202.4@tcp:101:cat.0 Request processed in 87us (1839us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129560.207645:0:4699:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15364 00000100:00100000:0.0:1746129560.217948:0:31518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c079500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ada2ffba-8920-4ecb-8068-68caa9806978+17:1963:x1830948733788672:12345-192.168.202.4@tcp:4:cat.0 Request processed in 10792us (12219us total) trans 21474841191 rc 0/0 00000100:00100000:0.0:1746129560.217962:0:31518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2302 00002000:00100000:0.0:1746129560.217975:0:31518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3ef:0x0] (2535424->2936831) req@ffff88009c079500 x1830948733788672/t21474841191(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:301/0 lens 488/448 e 0 to 0 dl 1746129571 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129560.217984:0:31518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c079500 with x1830948733788672 ext(2535424->2936831) 00010000:00010000:0.0:1746129560.217995:0:31518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880136b3f800/0x40a459093b067d97 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2535424->2936831) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fcdd expref: 17 pid: 4385 timeout: 915 lvb_type: 0 00010000:00010000:0.0:1746129560.218011:0:31518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880136b3f800/0x40a459093b067d97 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2535424->2936831) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fcdd expref: 17 pid: 4385 timeout: 915 lvb_type: 0 00002000:00010000:0.0:1746129560.218018:0:31518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009c079500 00000100:00100000:0.0:1746129560.225431:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129560.234387:0:31518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733789312 00000100:00100000:0.0:1746129560.234400:0:31518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733789312 00002000:00100000:0.0:1746129560.234463:0:31518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->4194303) req@ffff88009fbadc00 x1830948733789312/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:301/0 lens 488/0 e 0 to 0 dl 1746129571 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129560.234472:0:31518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbadc00 with x1830948733789312 ext(3145728->4194303) 00002000:00010000:0.0:1746129560.234477:0:31518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fbadc00 00000100:00100000:0.0:1746129560.234504:0:31518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7376 00000100:00100000:0.0:1746129560.234510:0:31518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ada2ffba-8920-4ecb-8068-68caa9806978+17:1962:x1830948733789312:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129560.268915:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129560.269286:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129560.321288:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129560.322847:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129560.334792:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129560.362533:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129560.367636:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129560.369487:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129560.369514:0:4699:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733791872 00000100:00100000:0.0:1746129560.369520:0:4699:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733791872 00000100:00100000:0.0:1746129560.370056:0:4699:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15369 00000100:00100000:0.0:1746129560.370065:0:4699:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a77b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ada2ffba-8920-4ecb-8068-68caa9806978+26:31941:x1830948733791872:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:0.0:1746129560.370081:0:4699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129560.370097:0:4699:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095122400/0x40a459093b067df2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f1fd1c expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129560.370123:0:4699:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800912baa00/0x40a459093b067dc1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f1fd07 expref: 27 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129560.370131:0:4699:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ba8f200/0x40a459093b067deb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f1fd15 expref: 14 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129560.370138:0:4699:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129560.370139:0:4699:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129560.370142:0:4699:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095122400/0x40a459093b067df2 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [3919872->4194303] (req 3919872->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f1fd1c expref: 27 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129560.370175:0:4699:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012ba8f200/0x40a459093b067deb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fd15 expref: 14 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129560.370189:0:4699:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012ba8f200/0x40a459093b067deb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fd15 expref: 14 pid: 4385 timeout: 915 lvb_type: 0 00000100:00100000:0.0:1746129560.370206:0:4699:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a77b3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4699:1830948737383808:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129560.371713:0:4699:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800912baa00/0x40a459093b067dc1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fd07 expref: 27 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129560.371730:0:4699:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800912baa00/0x40a459093b067dc1 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fd07 expref: 27 pid: 4385 timeout: 915 lvb_type: 0 00000100:00100000:0.0:1746129560.371745:0:4699:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a77b0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4699:1830948737383936:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129560.371801:0:4699:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1a12b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746129560.378270:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129560.378751:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129560.378883:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129560.378924:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129560.378963:0:31520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733792512 00000100:00100000:0.0:1746129560.378971:0:31520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733792512 00002000:00100000:0.0:1746129560.379022:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3f5:0x0] (3145728->4194303) req@ffff8800a77b0700 x1830948733792512/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:301/0 lens 488/0 e 0 to 0 dl 1746129571 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129560.379032:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a77b0700 with x1830948733792512 ext(3145728->4194303) 00010000:00010000:0.0:1746129560.379042:0:31520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800912baa00/0x40a459093b067dc1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fd07 expref: 27 pid: 4385 timeout: 915 lvb_type: 0 00010000:00010000:0.0:1746129560.379054:0:31520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800912baa00/0x40a459093b067dc1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fd07 expref: 27 pid: 4385 timeout: 915 lvb_type: 0 00002000:00010000:0.0:1746129560.379066:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a77b0700 00000100:00100000:0.0:1746129560.379964:0:31520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733792384 00000100:00100000:0.0:1746129560.379970:0:31520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733792384 00002000:00100000:0.0:1746129560.379992:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->4194303) req@ffff8800a77b1c00 x1830948733792384/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:301/0 lens 488/0 e 0 to 0 dl 1746129571 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129560.380000:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a77b1c00 with x1830948733792384 ext(3145728->4194303) 00002000:00010000:0.0:1746129560.380003:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a77b1c00 00000100:00100000:0.0:1746129560.380018:0:31520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733792640 00000100:00100000:0.0:1746129560.380020:0:31520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733792640 00002000:00100000:0.0:1746129560.380030:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3f5:0x0] (2097152->3145727) req@ffff8800a77b0380 x1830948733792640/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:301/0 lens 488/0 e 0 to 0 dl 1746129571 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129560.380036:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a77b0380 with x1830948733792640 ext(2097152->3145727) 00010000:00010000:0.0:1746129560.380041:0:31520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012ba8f200/0x40a459093b067deb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fd15 expref: 14 pid: 4385 timeout: 915 lvb_type: 0 00010000:00010000:0.0:1746129560.380049:0:31520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012ba8f200/0x40a459093b067deb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fd15 expref: 14 pid: 4385 timeout: 915 lvb_type: 0 00002000:00010000:0.0:1746129560.380054:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a77b0380 00000100:00100000:0.0:1746129560.380060:0:31520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733792768 00000100:00100000:0.0:1746129560.380062:0:31520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733792768 00002000:00100000:0.0:1746129560.380069:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3f5:0x0] (3145728->4194303) req@ffff8800a77b2300 x1830948733792768/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:301/0 lens 488/0 e 0 to 0 dl 1746129571 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129560.380074:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a77b2300 with x1830948733792768 ext(3145728->4194303) 00010000:00010000:0.0:1746129560.380077:0:31520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012ba8f200/0x40a459093b067deb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fd15 expref: 15 pid: 4385 timeout: 915 lvb_type: 0 00010000:00010000:0.0:1746129560.380083:0:31520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012ba8f200/0x40a459093b067deb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fd15 expref: 15 pid: 4385 timeout: 915 lvb_type: 0 00002000:00010000:0.0:1746129560.380088:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a77b2300 00000100:00100000:0.0:1746129560.380097:0:31520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2307 00000100:00100000:0.0:1746129560.380103:0:31520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a77b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ada2ffba-8920-4ecb-8068-68caa9806978+27:1961:x1830948733792512:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:0.0:1746129560.381622:0:8417:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2308 00000100:00100000:0.0:1746129560.381632:0:8417:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a77b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+15:1962:x1830948733792640:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129560.384815:0:8415:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7378 00000100:00100000:0.0:1746129560.384825:0:8415:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a77b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+11:1962:x1830948733792384:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129560.403481:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129560.403522:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129560.403552:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129560.404179:0:31521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a77b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+14:1962:x1830948733792768:12345-192.168.202.4@tcp:3:cat.0 Request processed in 19665us (25250us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129560.404190:0:31521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2309 00002000:00100000:0.0:1746129560.404203:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f5:0x0] (3145728->4194303) req@ffff8800a77b2300 x1830948733792768/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:301/0 lens 488/440 e 0 to 0 dl 1746129571 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129560.404213:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a77b2300 with x1830948733792768 ext(3145728->4194303) 00010000:00010000:0.0:1746129560.404224:0:31521:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012ba8f200/0x40a459093b067deb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fd15 expref: 14 pid: 4385 timeout: 915 lvb_type: 0 00010000:00010000:0.0:1746129560.404242:0:31521:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012ba8f200/0x40a459093b067deb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fd15 expref: 14 pid: 4385 timeout: 915 lvb_type: 0 00002000:00010000:0.0:1746129560.404249:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a77b2300 00000100:00100000:0.0:1746129560.414138:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129560.421164:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129560.422973:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129560.422999:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733793792 00000100:00100000:0.0:1746129560.423002:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733793792 00000100:00100000:0.0:1746129560.423035:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15372 00000100:00100000:0.0:1746129560.423041:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a77b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+14:31933:x1830948733793792:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129560.423057:0:7148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129560.423068:0:7148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b3bf600/0x40a459093b067e07 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f1fd31 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129560.423457:0:7148:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095122400/0x40a459093b067df2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3919872->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f1fd1c expref: 25 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129560.423463:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129560.423465:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129560.423468:0:7148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b3bf600/0x40a459093b067e07 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f1fd31 expref: 15 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129560.423486:0:7148:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095122400/0x40a459093b067df2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3919872->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fd1c expref: 25 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129560.423500:0:7148:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095122400/0x40a459093b067df2 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3919872->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fd1c expref: 25 pid: 4699 timeout: 915 lvb_type: 0 00000100:00100000:0.0:1746129560.423508:0:7148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a77b3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:7148:1830948737384192:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129560.423534:0:7148:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1a12b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746129560.428965:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129560.438247:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129560.442841:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129560.447241:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00002000:00010000:0.0:1746129560.448490:0:7148:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3f5:0x0] updating lvb atime: 1746129559 -> 1746129561 00000100:00100000:0.0:1746129560.448506:0:7148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800903a1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:7148:1830948737384320:192.168.202.4@tcp:106: 00010000:00010000:0.0:1746129560.448535:0:7148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012ba8ee00/0x40a459093b067e0e lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f1fd38 expref: 29 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129560.448547:0:7148:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ba8ee00/0x40a459093b067e0e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f1fd38 expref: 29 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129560.448560:0:7148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ba8ee00, rc 0) 00000100:00100000:0.0:1746129560.448686:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a77b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ada2ffba-8920-4ecb-8068-68caa9806978+28:1962:x1830948733794432:12345-192.168.202.4@tcp:101:cat.0 Request processed in 5718us (5853us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129560.448692:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15373 00000100:00100000:0.0:1746129560.450560:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129560.452086:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129560.457456:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129560.458189:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129560.468097:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129560.470681:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129560.470826:0:14547:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733796096 00000100:00100000:0.0:1746129560.470834:0:14547:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733796096 00000100:00100000:0.0:1746129560.470892:0:14547:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11038 00000100:00100000:0.0:1746129560.470899:0:14547:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+8:31944:x1830948733796096:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:0.0:1746129560.470915:0:14547:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129560.470933:0:14547:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1bc00/0x40a459093b067e23 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f1fd4d expref: -99 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129560.471040:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1ae00/0x40a459093b067e2a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129560.471052:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1ae00/0x40a459093b067e2a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129560.471063:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1ae00/0x40a459093b067e2a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129560.471075:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1ac00/0x40a459093b067e31 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129560.471080:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1ac00/0x40a459093b067e31 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129560.471085:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1ac00/0x40a459093b067e31 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129560.471192:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1a600/0x40a459093b067e38 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129560.471201:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1a600/0x40a459093b067e38 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129560.471207:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1a600/0x40a459093b067e38 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00000004:00200000:0.0:1746129560.471215:0:14547:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:0.0:1746129560.471325:0:14547:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1ae00/0x40a459093b067e2a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129560.471331:0:14547:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1ae00/0x40a459093b067e2a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129560.471337:0:14547:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1ae00/0x40a459093b067e2a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129560.471342:0:14547:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ee1ae00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:0.0:1746129560.471346:0:14547:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1ae00/0x40a459093b067e2a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129560.471352:0:14547:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1ae00/0x40a459093b067e2a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129560.471362:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880132ef8f00) 00010000:00010000:0.0:1746129560.471364:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129560.471368:0:14547:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1ae00/0x40a459093b067e2a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129560.471373:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1ae00/0x40a459093b067e2a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129560.471389:0:14547:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1ac00/0x40a459093b067e31 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129560.471393:0:14547:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1ac00/0x40a459093b067e31 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129560.471401:0:14547:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1ac00/0x40a459093b067e31 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129560.471540:0:14547:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ee1ac00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:0.0:1746129560.471543:0:14547:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1ac00/0x40a459093b067e31 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129560.471548:0:14547:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1ac00/0x40a459093b067e31 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129560.471555:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008e7ead00) 00010000:00010000:0.0:1746129560.471557:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129560.471560:0:14547:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1ac00/0x40a459093b067e31 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129560.471564:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1ac00/0x40a459093b067e31 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129560.471600:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1bc00/0x40a459093b067e23 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f1fd4d expref: 11 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129560.471610:0:14547:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1a600/0x40a459093b067e38 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f1fd4d expref: 10 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129560.471616:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009c36a600) 00010000:00010000:0.0:1746129560.471617:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746129560.471620:0:14547:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ee1a600, rc 0) 00000100:00100000:0.0:1746129560.471670:0:14547:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+10:31944:x1830948733796096:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 766us (909us total) trans 8589945096 rc 0/0 00000100:00100000:0.0:1746129560.471677:0:14547:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11038 00000100:00100000:0.0:1746129560.474899:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129560.503794:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129560.508977:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129560.520744:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129560.532104:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129560.559127:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129560.577533:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129560.584872:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129560.597970:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129560.601969:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129560.602423:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7839 00000100:00100000:0.0:1746129560.602436:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa27480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+15:1962:x1830948733798784:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129560.602451:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129560.602477:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b3bf600/0x40a459093b067e07 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fd31 expref: 15 pid: 7148 timeout: 915 lvb_type: 0 00010000:00010000:0.0:1746129560.602490:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b3bf600/0x40a459093b067e07 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fd31 expref: 15 pid: 7148 timeout: 915 lvb_type: 0 00010000:00010000:0.0:1746129560.602514:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b3bf600/0x40a459093b067e07 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fd31 expref: 15 pid: 7148 timeout: 915 lvb_type: 0 00010000:00010000:0.0:1746129560.602541:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129560.602543:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129560.602550:0:7085:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800912bb000/0x40a459093b067e5b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2207743) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f1fd69 expref: 14 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129560.602558:0:7085:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800912bb000/0x40a459093b067e5b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2207743) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f1fd69 expref: 14 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129560.602592:0:7085:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800912bb000/0x40a459093b067e5b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2207743) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f1fd69 expref: 14 pid: 7148 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129560.602606:0:7085:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fa27b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7085:1830948737385984:192.168.202.4@tcp:105: 00000100:00100000:0.0:1746129560.602694:0:7085:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1a12000 going to sleep for 11 seconds 00000100:00100000:0.0:1746129560.605640:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129560.684557:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129560.695456:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129560.695521:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129560.709353:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129560.719887:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733800064 00000100:00100000:0.0:1746129560.719895:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733800064 00000100:00100000:0.0:1746129560.719937:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 769 00000100:00100000:0.0:1746129560.719944:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094efd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ada2ffba-8920-4ecb-8068-68caa9806978+297:1962:x1830948733800064:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129560.719956:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129560.719979:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e798600/0x40a459093b067e9a lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f1fd77 expref: 297 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129560.720007:0:7085:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009c36a600) 00010000:00010000:0.0:1746129560.720012:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129560.730844:0:14547:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733800576 00000100:00100000:0.0:1746129560.730855:0:14547:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733800576 00000100:00100000:0.0:1746129560.731249:0:14547:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11041 00000100:00100000:0.0:1746129560.731260:0:14547:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cda7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ada2ffba-8920-4ecb-8068-68caa9806978+296:31958:x1830948733800576:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:0.0:1746129560.731288:0:14547:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129560.731342:0:14547:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1ac00/0x40a459093b067eb6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f1fd8c expref: -99 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129560.732557:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1ae00/0x40a459093b067ebd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129560.732574:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1ae00/0x40a459093b067ebd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129560.732585:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1ae00/0x40a459093b067ebd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129560.732599:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1b200/0x40a459093b067ec4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129560.732605:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1b200/0x40a459093b067ec4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129560.732609:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1b200/0x40a459093b067ec4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129560.732719:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1a800/0x40a459093b067ecb lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129560.732728:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1a800/0x40a459093b067ecb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129560.732733:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1a800/0x40a459093b067ecb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00000004:00200000:0.0:1746129560.732741:0:14547:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:0.0:1746129560.732844:0:14547:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1ae00/0x40a459093b067ebd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129560.732850:0:14547:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1ae00/0x40a459093b067ebd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129560.732856:0:14547:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1ae00/0x40a459093b067ebd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129560.732861:0:14547:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ee1ae00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:0.0:1746129560.732865:0:14547:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1ae00/0x40a459093b067ebd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129560.732871:0:14547:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1ae00/0x40a459093b067ebd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129560.732881:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880132ef8f00) 00010000:00010000:0.0:1746129560.732884:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129560.732888:0:14547:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1ae00/0x40a459093b067ebd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129560.732893:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1ae00/0x40a459093b067ebd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129560.732931:0:14547:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1b200/0x40a459093b067ec4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129560.732936:0:14547:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1b200/0x40a459093b067ec4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129560.732941:0:14547:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1b200/0x40a459093b067ec4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129560.732945:0:14547:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ee1b200 already unused, calling callback (ffffffffa136e690) 00010000:00010000:0.0:1746129560.732947:0:14547:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1b200/0x40a459093b067ec4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129560.732952:0:14547:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1b200/0x40a459093b067ec4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129560.732961:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012eacb100) 00010000:00010000:0.0:1746129560.732963:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129560.732965:0:14547:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1b200/0x40a459093b067ec4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129560.732969:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1b200/0x40a459093b067ec4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129560.733019:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1ac00/0x40a459093b067eb6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f1fd8c expref: 299 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129560.733030:0:14547:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1a800/0x40a459093b067ecb lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f1fd8c expref: 298 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129560.733036:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009c36a600) 00010000:00010000:0.0:1746129560.733038:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746129560.733040:0:14547:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ee1a800, rc 0) 00000100:00100000:0.0:1746129560.734720:0:14547:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cda7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ada2ffba-8920-4ecb-8068-68caa9806978+298:31958:x1830948733800576:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 3452us (4263us total) trans 8589945102 rc 0/0 00000100:00100000:0.0:1746129560.734732:0:14547:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11041 00000100:00100000:0.0:1746129560.755780:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129560.763007:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129560.763056:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129560.763088:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129560.763118:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129560.763134:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129560.763168:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129560.763190:0:31521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733801216 00000100:00100000:0.0:1746129560.763197:0:31521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733801216 00002000:00100000:0.0:1746129560.763238:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3ef:0x0] (2097152->3674111) req@ffff880135726680 x1830948733801216/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:301/0 lens 504/0 e 0 to 0 dl 1746129571 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129560.763248:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135726680 with x1830948733801216 ext(2097152->3674111) 00002000:00010000:0.0:1746129560.763254:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135726680 00000100:00100000:0.0:1746129560.763274:0:31519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733801472 00000100:00100000:0.0:1746129560.763276:0:31519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733801472 00002000:00100000:0.0:1746129560.763289:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3ef:0x0] (3674112->4194303) req@ffff880135725880 x1830948733801472/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:301/0 lens 488/0 e 0 to 0 dl 1746129571 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129560.763336:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135725880 with x1830948733801472 ext(3674112->4194303) 00002000:00010000:0.0:1746129560.763339:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135725880 00000100:00100000:0.0:1746129560.763349:0:31519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733801728 00000100:00100000:0.0:1746129560.763352:0:31519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733801728 00002000:00100000:0.0:1746129560.763365:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f5:0x0] (2207744->3256319) req@ffff880135727b80 x1830948733801728/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:301/0 lens 488/0 e 0 to 0 dl 1746129571 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129560.763372:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135727b80 with x1830948733801728 ext(2207744->3256319) 00002000:00010000:0.0:1746129560.763375:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135727b80 00000100:00100000:0.0:1746129560.763385:0:31519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733801984 00000100:00100000:0.0:1746129560.763387:0:31519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733801984 00002000:00100000:0.0:1746129560.763396:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f5:0x0] (3256320->4194303) req@ffff880135725c00 x1830948733801984/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:301/0 lens 488/0 e 0 to 0 dl 1746129571 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129560.763413:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135725c00 with x1830948733801984 ext(3256320->4194303) 00002000:00010000:0.0:1746129560.763416:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135725c00 00000100:00100000:0.0:1746129560.763429:0:31519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7386 00000100:00100000:0.0:1746129560.763435:0:31519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135726680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+12:1962:x1830948733801216:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129560.763732:0:31521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7388 00000100:00100000:0.0:1746129560.763761:0:31521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135727b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+15:1962:x1830948733801728:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129560.778908:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135725880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+13:1962:x1830948733801472:12345-192.168.202.4@tcp:3:cat.0 Request processed in 15226us (15775us total) trans 0 rc 520192/520192 00000100:00100000:0.0:1746129560.778922:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7387 00002000:00100000:0.0:1746129560.778935:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ef:0x0] (3674112->4194303) req@ffff880135725880 x1830948733801472/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:301/0 lens 488/440 e 0 to 0 dl 1746129571 ref 1 fl Complete:/200/0 rc 520192/520192 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129560.778944:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135725880 with x1830948733801472 ext(3674112->4194303) 00002000:00010000:0.0:1746129560.778950:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135725880 00000100:00100000:0.0:1746129560.800630:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129560.811672:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129560.812656:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733802368 00000100:00100000:0.0:1746129560.812659:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733802368 00000100:00100000:0.0:1746129560.812698:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15385 00000100:00100000:0.0:1746129560.812703:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+12:31952:x1830948733802368:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129560.812712:0:7148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129560.812726:0:7148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ee1b200/0x40a459093b067eee lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f1fda8 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129560.812747:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129560.812749:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129560.812753:0:7148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ee1b200/0x40a459093b067eee lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f1fda8 expref: 13 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129560.812763:0:7148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ee1b200/0x40a459093b067eee lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f1fda8 expref: 13 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129560.812777:0:7148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ee1b200, rc 0) 00000100:00100000:0.0:1746129560.812834:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+13:31952:x1830948733802368:12345-192.168.202.4@tcp:101:cat.0 Request processed in 130us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129560.812841:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15385 00000100:00100000:0.0:1746129560.835660:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129560.838993:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129560.842897:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129560.842926:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733802880 00000100:00100000:0.0:1746129560.842933:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733802880 00000100:00100000:0.0:1746129560.846056:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129560.868461:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129560.869726:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129560.879653:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129560.880418:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129560.892681:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129560.893816:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129560.894857:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129560.894888:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129560.894904:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733805056 00000100:00100000:0.0:1746129560.894907:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733805056 00002000:00100000:0.0:1746129560.894933:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f5:0x0] (3145728->4194303) req@ffff88009c7db100 x1830948733805056/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:301/0 lens 488/0 e 0 to 0 dl 1746129571 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129560.894942:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7db100 with x1830948733805056 ext(3145728->4194303) 00002000:00010000:0.0:1746129560.894946:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c7db100 00000100:00100000:0.0:1746129560.894965:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733805312 00000100:00100000:0.0:1746129560.894967:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733805312 00002000:00100000:0.0:1746129560.894980:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->4194303) req@ffff88009c7d9c00 x1830948733805312/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:301/0 lens 488/0 e 0 to 0 dl 1746129571 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129560.894987:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7d9c00 with x1830948733805312 ext(3145728->4194303) 00002000:00010000:0.0:1746129560.894990:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c7d9c00 00000100:00100000:0.0:1746129560.895000:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7395 00000100:00100000:0.0:1746129560.895004:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+18:1960:x1830948733805312:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129560.903700:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129560.904561:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129560.905361:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129560.909935:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129560.910320:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129560.911352:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15391 00000100:00100000:0.0:1746129560.911360:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b550380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+17:1962:x1830948733805952:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129560.911367:0:4385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129560.911374:0:4385:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090913a00/0x40a459093b067f3b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f1fdd9 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129560.911388:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129560.911389:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129560.911399:0:4385:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090913a00/0x40a459093b067f3b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f1fdd9 expref: 18 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129560.911424:0:4385:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090913a00/0x40a459093b067f3b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f1fdd9 expref: 18 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129560.911434:0:4385:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090913a00, rc 0) 00000100:00100000:0.0:1746129560.911459:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b550380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+18:1962:x1830948733805952:12345-192.168.202.4@tcp:101:cat.0 Request processed in 101us (1167us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129560.911464:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15391 00000100:00100000:0.0:1746129560.915351:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129560.917781:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+20:1960:x1830948733805312:12345-192.168.202.4@tcp:3:cat.0 Request processed in 22774us (22891us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129560.917792:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7395 00002000:00100000:0.0:1746129560.917798:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->4194303) req@ffff88009c7d9c00 x1830948733805312/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:301/0 lens 488/440 e 0 to 0 dl 1746129571 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129560.917807:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7d9c00 with x1830948733805312 ext(3145728->4194303) 00002000:00010000:0.0:1746129560.917810:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c7d9c00 00000100:00100000:0.0:1746129560.920894:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129560.923064:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129560.926872:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129560.931544:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129560.935868:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129560.935959:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129560.940559:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129560.940630:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129560.940658:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129560.941681:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129560.956286:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129560.956365:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129560.965444:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129560.970347:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129560.977762:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129560.992479:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129560.998220:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129561.002423:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129561.010009:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129561.011471:0:11014:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15400 00000100:00100000:0.0:1746129561.011479:0:11014:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:068dab75-d300-4ead-a742-d14572ad1e50+6:1962:x1830948733810816:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:0.0:1746129561.011486:0:11014:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129561.011496:0:11014:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c664000/0x40a459093b067f96 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f1fe2d expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129561.011523:0:11014:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093edd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11014:1830948737389568:192.168.202.4@tcp:106: 00000100:00100000:0.0:1746129561.011545:0:11014:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1a12240 going to sleep for 11 seconds 00000100:00100000:0.0:1746129561.011572:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129561.011587:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733810944 00000100:00100000:0.0:1746129561.011590:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733810944 00000100:00100000:0.0:1746129561.011619:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15401 00000100:00100000:0.0:1746129561.011624:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093edc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:068dab75-d300-4ead-a742-d14572ad1e50+8:1962:x1830948733810944:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:0.0:1746129561.011629:0:4385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129561.011636:0:4385:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f37d200/0x40a459093b067f9d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f1fe34 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129561.011647:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129561.011649:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129561.011658:0:4385:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f37d200/0x40a459093b067f9d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f1fe34 expref: 9 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129561.011672:0:4385:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f37d200/0x40a459093b067f9d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f1fe34 expref: 9 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129561.011686:0:4385:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f37d200, rc 0) 00000100:00100000:0.0:1746129561.011705:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093edc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:068dab75-d300-4ead-a742-d14572ad1e50+9:1962:x1830948733810944:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 81us (132us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129561.011711:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15401 00000100:00100000:0.0:1746129561.011784:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129561.011799:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733811072 00000100:00100000:0.0:1746129561.011801:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733811072 00000100:00100000:0.0:1746129561.011814:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15402 00000100:00100000:0.0:1746129561.011818:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093edca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:068dab75-d300-4ead-a742-d14572ad1e50+8:1962:x1830948733811072:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:0.0:1746129561.011824:0:4385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129561.011830:0:4385:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f37d800/0x40a459093b067fa4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f1fe3b expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129561.011840:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129561.011841:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129561.011846:0:4385:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f37d800/0x40a459093b067fa4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f1fe3b expref: 9 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129561.011855:0:4385:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f37d800/0x40a459093b067fa4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f1fe3b expref: 9 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129561.011861:0:4385:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f37d800, rc 0) 00000100:00100000:0.0:1746129561.011874:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093edca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:068dab75-d300-4ead-a742-d14572ad1e50+9:1962:x1830948733811072:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 56us (90us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129561.011879:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15402 00000100:00100000:0.0:1746129561.018954:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129561.024875:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129561.029164:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129561.035936:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733811712 00000100:00100000:0.0:1746129561.035948:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733811712 00010000:00010000:0.0:1746129561.035989:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8d4c00/0x40a459093b067fc0 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fe42 expref: 10 pid: 2271 timeout: 916 lvb_type: 0 00000100:00100000:0.0:1746129561.036040:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7849 00000100:00100000:0.0:1746129561.036048:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094067800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:068dab75-d300-4ead-a742-d14572ad1e50+10:1962:x1830948733811712:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129561.036063:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129561.036069:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8d4c00/0x40a459093b067fc0 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fe42 expref: 10 pid: 2271 timeout: 916 lvb_type: 0 00010000:00010000:0.0:1746129561.036081:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8d4c00/0x40a459093b067fc0 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fe42 expref: 10 pid: 2271 timeout: 916 lvb_type: 0 00010000:00010000:0.0:1746129561.036102:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8d4c00/0x40a459093b067fc0 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fe42 expref: 10 pid: 2271 timeout: 916 lvb_type: 0 00010000:00010000:0.0:1746129561.036131:0:7085:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009c36a600) 00010000:00010000:0.0:1746129561.036137:0:7085:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880095e77000/0x40a459093b067fd5 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129561.036147:0:7085:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095e77000/0x40a459093b067fd5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129561.036153:0:7085:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095e77000/0x40a459093b067fd5 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129561.036186:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129561.036230:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094067800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:068dab75-d300-4ead-a742-d14572ad1e50+9:1962:x1830948733811712:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 182us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129561.036236:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7849 00000100:00100000:0.0:1746129561.040590:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129561.040670:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129561.044846:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129561.049484:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129561.049523:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129561.049552:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129561.049566:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129561.049583:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129561.049618:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129561.049639:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733812352 00000100:00100000:0.0:1746129561.049648:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733812352 00000100:00100000:0.0:1746129561.049683:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733812480 00000100:00100000:0.0:1746129561.049685:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733812480 00000100:00100000:0.0:1746129561.049696:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733812608 00000100:00100000:0.0:1746129561.049697:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733812608 00000100:00100000:0.0:1746129561.049706:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733812736 00000100:00100000:0.0:1746129561.049708:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733812736 00000100:00100000:0.0:1746129561.049719:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15407 00000100:00100000:0.0:1746129561.049726:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093edf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:068dab75-d300-4ead-a742-d14572ad1e50+8:1962:x1830948733812352:12345-192.168.202.4@tcp:1:lfs.0 00010000:00010000:0.0:1746129561.049772:0:7149:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012f37d600/0x40a459093b067fff lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129561.049790:0:7149:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800947b8000/0x40a459093b067d2e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f1fc66 expref: 12 pid: 8411 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129561.049798:0:7149:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095e76e00/0x40a459093b067fab lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f1fe18 expref: 8 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129561.049806:0:7149:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095cde000/0x40a459093b067d51 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f1fc9e expref: 18 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129561.049812:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129561.049814:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129561.049816:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f37d600/0x40a459093b067fff lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129561.049847:0:7149:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095cde000/0x40a459093b067d51 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fc9e expref: 18 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129561.049859:0:7149:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095cde000/0x40a459093b067d51 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fc9e expref: 18 pid: 7148 timeout: 916 lvb_type: 1 00000100:00100000:0.0:1746129561.049873:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012baed880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7149:1830948737390208:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129561.049962:0:7149:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095e76e00/0x40a459093b067fab lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fe18 expref: 8 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129561.049970:0:7149:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095e76e00/0x40a459093b067fab lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fe18 expref: 8 pid: 22481 timeout: 916 lvb_type: 1 00000100:00100000:0.0:1746129561.049977:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012baeed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7149:1830948737390336:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129561.050001:0:7149:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800947b8000/0x40a459093b067d2e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fc66 expref: 12 pid: 8411 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129561.050014:0:7149:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800947b8000/0x40a459093b067d2e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fc66 expref: 12 pid: 8411 timeout: 916 lvb_type: 1 00000100:00100000:0.0:1746129561.050022:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012baef100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7149:1830948737390464:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129561.050040:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1a12b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746129561.050057:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733812864 00000100:00100000:0.0:1746129561.050059:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733812864 00000100:00100000:0.0:1746129561.050072:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733812992 00000100:00100000:0.0:1746129561.050078:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733812992 00000100:00100000:0.0:1746129561.050088:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15408 00000100:00100000:0.0:1746129561.050092:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093edce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:068dab75-d300-4ead-a742-d14572ad1e50+9:1962:x1830948733812480:12345-192.168.202.4@tcp:1:lfs.0 00010000:00010000:0.0:1746129561.050111:0:4385:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012ebfcc00/0x40a459093b068006 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129561.050121:0:4385:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c47d400/0x40a459093b067d04 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f1fc6d expref: 15 pid: 8411 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129561.050128:0:4385:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009487f200/0x40a459093b067fb2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f1fe1f expref: 9 pid: 4699 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129561.050134:0:4385:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f447600/0x40a459093b067d4a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f1fca5 expref: 26 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129561.050138:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129561.050139:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129561.050141:0:4385:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ebfcc00/0x40a459093b068006 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129561.050156:0:4385:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f447600/0x40a459093b067d4a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fca5 expref: 26 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129561.050163:0:4385:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f447600/0x40a459093b067d4a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fca5 expref: 26 pid: 22480 timeout: 916 lvb_type: 1 00000100:00100000:0.0:1746129561.050171:0:4385:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012baec380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:4385:1830948737390592:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129561.050192:0:4385:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009487f200/0x40a459093b067fb2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fe1f expref: 9 pid: 4699 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129561.050198:0:4385:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009487f200/0x40a459093b067fb2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fe1f expref: 9 pid: 4699 timeout: 916 lvb_type: 1 00000100:00100000:0.0:1746129561.050205:0:4385:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012baeca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:4385:1830948737390848:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129561.050223:0:4385:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c47d400/0x40a459093b067d04 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fc6d expref: 15 pid: 8411 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129561.050228:0:4385:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c47d400/0x40a459093b067d04 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fc6d expref: 15 pid: 8411 timeout: 916 lvb_type: 1 00000100:00100000:0.0:1746129561.050234:0:4385:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012baeea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:4385:1830948737390976:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129561.050245:0:4385:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1a12240 going to sleep for 11 seconds 00000100:00100000:0.0:1746129561.050260:0:20577:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15411 00000100:00100000:0.0:1746129561.050265:0:20577:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093edd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:068dab75-d300-4ead-a742-d14572ad1e50+9:1962:x1830948733812864:12345-192.168.202.4@tcp:1:lfs.0 00010000:00010000:0.0:1746129561.050280:0:20577:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009f968600/0x40a459093b06801b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129561.050289:0:20577:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ba8fe00/0x40a459093b067ee7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f1fda1 expref: 18 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129561.050317:0:20577:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f37d200/0x40a459093b067f9d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f1fe34 expref: 9 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129561.050323:0:20577:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ee1b200/0x40a459093b067eee lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f1fda8 expref: 12 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129561.050327:0:20577:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129561.050328:0:20577:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129561.050330:0:20577:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f968600/0x40a459093b06801b lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129561.050342:0:20577:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ee1b200/0x40a459093b067eee lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fda8 expref: 12 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129561.050349:0:20577:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ee1b200/0x40a459093b067eee lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fda8 expref: 12 pid: 7148 timeout: 916 lvb_type: 0 00000100:00100000:0.0:1746129561.050356:0:20577:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012baee300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20577:1830948737391232:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129561.050372:0:20577:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f37d200/0x40a459093b067f9d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fe34 expref: 9 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129561.050825:0:20577:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f37d200/0x40a459093b067f9d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fe34 expref: 9 pid: 4385 timeout: 916 lvb_type: 1 00000100:00100000:0.0:1746129561.050835:0:20577:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012baedc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20577:1830948737391360:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129561.050859:0:20577:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012ba8fe00/0x40a459093b067ee7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fda1 expref: 18 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129561.050865:0:20577:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012ba8fe00/0x40a459093b067ee7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fda1 expref: 18 pid: 7148 timeout: 916 lvb_type: 0 00000100:00100000:0.0:1746129561.050872:0:20577:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012baed180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20577:1830948737391872:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129561.050883:0:20577:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1a12000 going to sleep for 11 seconds 00000100:00100000:0.0:1746129561.059770:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129561.059801:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129561.059832:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733813120 00000100:00100000:0.0:1746129561.059840:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733813120 00010000:00010000:0.0:1746129561.059885:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095cde000/0x40a459093b067d51 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fc9e expref: 19 pid: 7148 timeout: 916 lvb_type: 1 00000100:00100000:0.0:1746129561.060468:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733813376 00000100:00100000:0.0:1746129561.060471:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733813376 00010000:00010000:0.0:1746129561.060495:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800947b8000/0x40a459093b067d2e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fc66 expref: 13 pid: 8411 timeout: 916 lvb_type: 1 00000100:00100000:0.0:1746129561.060512:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7850 00000100:00100000:0.0:1746129561.060520:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6ce0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ada2ffba-8920-4ecb-8068-68caa9806978+19:1961:x1830948733813120:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129561.060532:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129561.060553:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095cde000/0x40a459093b067d51 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fc9e expref: 19 pid: 7148 timeout: 916 lvb_type: 1 00010000:00010000:0.0:1746129561.060564:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095cde000/0x40a459093b067d51 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fc9e expref: 19 pid: 7148 timeout: 916 lvb_type: 1 00010000:00010000:0.0:1746129561.061183:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095cde000/0x40a459093b067d51 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fc9e expref: 19 pid: 7148 timeout: 916 lvb_type: 1 00010000:00010000:0.0:1746129561.062336:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129561.062340:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129561.062346:0:7085:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f37d600/0x40a459093b067fff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129561.062356:0:7085:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f37d600/0x40a459093b067fff lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129561.062391:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129561.062435:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6ce0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ada2ffba-8920-4ecb-8068-68caa9806978+18:1961:x1830948733813120:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 1914us (2675us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129561.062443:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7850 00000100:00100000:0.0:1746129561.062525:0:20577:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012baedc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20577:1830948737391360:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129561.062534:0:20577:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012baed180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20577:1830948737391872:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129561.063754:0:4385:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012baec380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:4385:1830948737390592:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129561.066149:0:4385:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012baeca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:4385:1830948737390848:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129561.066161:0:4385:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012baeea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:4385:1830948737390976:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129561.066179:0:4385:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012ebfcc00/0x40a459093b068006 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129561.068264:0:20577:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012baee300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20577:1830948737391232:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129561.068286:0:20577:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009f968600/0x40a459093b06801b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129561.068355:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7860 00000100:00100000:0.0:1746129561.068362:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e955880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+13:1962:x1830948733814784:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129561.068369:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129561.068378:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ee1b200/0x40a459093b067eee lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fda8 expref: 13 pid: 7148 timeout: 916 lvb_type: 0 00010000:00010000:0.0:1746129561.068387:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ee1b200/0x40a459093b067eee lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fda8 expref: 13 pid: 7148 timeout: 916 lvb_type: 0 00010000:00010000:0.0:1746129561.068410:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ee1b200/0x40a459093b067eee lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fda8 expref: 13 pid: 7148 timeout: 916 lvb_type: 0 00010000:00010000:0.0:1746129561.068423:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129561.068424:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129561.068427:0:7085:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f968600/0x40a459093b06801b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129561.068437:0:7085:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f968600/0x40a459093b06801b lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129561.068453:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746129561.068460:0:20577:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009f968600/0x40a459093b06801b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129561.068466:0:20577:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f968600/0x40a459093b06801b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129561.068483:0:20577:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009f968600/0x40a459093b06801b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129561.068489:0:20577:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009f968600/0x40a459093b06801b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129561.068496:0:20577:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009f968600/0x40a459093b06801b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129561.068501:0:20577:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f968600 already unused, calling callback (ffffffffa086ed70) 00010000:00010000:0.0:1746129561.068505:0:20577:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f968600/0x40a459093b06801b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129561.068512:0:20577:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f968600/0x40a459093b06801b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129561.068524:0:20577:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009f968600/0x40a459093b06801b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129561.068530:0:20577:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f968600/0x40a459093b06801b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129561.068568:0:20577:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093edd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:068dab75-d300-4ead-a742-d14572ad1e50+6:1962:x1830948733812864:12345-192.168.202.4@tcp:1:lfs.0 Request processed in 18302us (18984us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129561.068577:0:20577:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15411 00000100:00100000:0.0:1746129561.068599:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e955880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+12:1962:x1830948733814784:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 238us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129561.068604:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7860 00000100:00100000:0.0:1746129561.068756:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733814528 00000100:00100000:0.0:1746129561.068759:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733814528 00010000:00010000:0.0:1746129561.068771:0:9823:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c47d400/0x40a459093b067d04 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fc6d expref: 17 pid: 8411 timeout: 916 lvb_type: 1 00000100:00100000:0.0:1746129561.068838:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7861 00000100:00100000:0.0:1746129561.068843:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e956a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+17:1962:x1830948733814528:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129561.068850:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129561.068859:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c47d400/0x40a459093b067d04 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fc6d expref: 17 pid: 8411 timeout: 916 lvb_type: 1 00010000:00010000:0.0:1746129561.068867:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c47d400/0x40a459093b067d04 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fc6d expref: 17 pid: 8411 timeout: 916 lvb_type: 1 00010000:00010000:0.0:1746129561.068884:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c47d400/0x40a459093b067d04 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fc6d expref: 17 pid: 8411 timeout: 916 lvb_type: 1 00010000:00010000:0.0:1746129561.068895:0:9823:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129561.068896:0:9823:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129561.068899:0:9823:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ebfcc00/0x40a459093b068006 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129561.068905:0:9823:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ebfcc00/0x40a459093b068006 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129561.068918:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129561.068930:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e956a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+16:1962:x1830948733814528:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 87us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129561.068935:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7861 00010000:00010000:0.0:1746129561.068951:0:4385:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012ebfcc00/0x40a459093b068006 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129561.068958:0:4385:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ebfcc00/0x40a459093b068006 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129561.068970:0:4385:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012ebfcc00/0x40a459093b068006 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129561.068976:0:4385:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012ebfcc00/0x40a459093b068006 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129561.068986:0:4385:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012ebfcc00/0x40a459093b068006 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129561.068991:0:4385:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ebfcc00 already unused, calling callback (ffffffffa086ed70) 00010000:00010000:0.0:1746129561.068993:0:4385:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012ebfcc00/0x40a459093b068006 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129561.068999:0:4385:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012ebfcc00/0x40a459093b068006 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129561.069008:0:4385:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012ebfcc00/0x40a459093b068006 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129561.069014:0:4385:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ebfcc00/0x40a459093b068006 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129561.069041:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093edce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:068dab75-d300-4ead-a742-d14572ad1e50+7:1962:x1830948733812480:12345-192.168.202.4@tcp:1:lfs.0 Request processed in 18947us (19517us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129561.069113:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15408 00000100:00100000:0.0:1746129561.090552:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129561.095839:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129561.102217:0:14547:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733815296 00000100:00100000:0.0:1746129561.102226:0:14547:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733815296 00000100:00100000:0.0:1746129561.102287:0:14547:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11047 00000100:00100000:0.0:1746129561.102431:0:14547:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094064000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:068dab75-d300-4ead-a742-d14572ad1e50+10:31964:x1830948733815296:12345-192.168.202.4@tcp:36:lfs.0 00010000:00010000:0.0:1746129561.102485:0:14547:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129561.102514:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095e77000/0x40a459093b067fd5 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f1fe49 expref: 10 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129561.102581:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009c36a600) 00010000:00010000:0.0:1746129561.102586:0:14547:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746129561.102616:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f969200/0x40a459093b068029 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129561.102629:0:14547:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6cafc00/0x40a459093b067d7b lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.4@tcp remote: 0xda91008773f1fcc8 expref: 298 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129561.102636:0:14547:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cad0a00/0x40a459093b067d82 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f1fccf expref: 298 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129561.102642:0:14547:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092f86e00/0x40a459093b067d90 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f1fcd6 expref: 15 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129561.102649:0:14547:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f556a00/0x40a459093b067ddd lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f1fd0e expref: 298 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129561.102655:0:14547:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1a600/0x40a459093b067e38 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f1fd4d expref: 15 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129561.102661:0:14547:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f969200/0x40a459093b068029 lrc: 8/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129561.102692:0:14547:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1a600/0x40a459093b067e38 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fd4d expref: 15 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129561.102703:0:14547:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1a600/0x40a459093b067e38 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fd4d expref: 15 pid: 14547 timeout: 916 lvb_type: 0 00000100:00100000:0.0:1746129561.102721:0:14547:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012baedc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14547:1830948737392000:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129561.103249:0:14547:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f556a00/0x40a459093b067ddd lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fd0e expref: 298 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129561.103258:0:14547:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f556a00/0x40a459093b067ddd lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fd0e expref: 298 pid: 2271 timeout: 916 lvb_type: 0 00000100:00100000:0.0:1746129561.103656:0:14547:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012baeea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14547:1830948737392128:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129561.103896:0:14547:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880092f86e00/0x40a459093b067d90 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fcd6 expref: 15 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129561.103905:0:14547:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880092f86e00/0x40a459093b067d90 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fcd6 expref: 15 pid: 16908 timeout: 916 lvb_type: 0 00000100:00100000:0.0:1746129561.103912:0:14547:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012baeca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14547:1830948737392256:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129561.103937:0:14547:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009cad0a00/0x40a459093b067d82 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fccf expref: 298 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129561.103943:0:14547:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cad0a00/0x40a459093b067d82 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fccf expref: 298 pid: 14549 timeout: 916 lvb_type: 0 00000100:00100000:0.0:1746129561.103950:0:14547:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012baec380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14547:1830948737392384:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129561.103968:0:14547:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6cafc00/0x40a459093b067d7b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fcc8 expref: 298 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129561.103978:0:14547:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6cafc00/0x40a459093b067d7b lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fcc8 expref: 298 pid: 14547 timeout: 916 lvb_type: 0 00000100:00100000:0.0:1746129561.103984:0:14547:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012baedf80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14547:1830948737392512:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129561.103998:0:14547:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1a12000 going to sleep for 11 seconds 00000100:00100000:0.0:1746129561.109107:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00080000:0.0:1746129561.109921:0:7097:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746129561.110975:0:20578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733815424 00000100:00100000:0.0:1746129561.110978:0:20578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733815424 00010000:00010000:0.0:1746129561.110993:0:20578:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1a600/0x40a459093b067e38 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fd4d expref: 15 pid: 14547 timeout: 916 lvb_type: 0 00000100:00100000:0.0:1746129561.111018:0:20578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7867 00000100:00100000:0.0:1746129561.111023:0:20578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094065180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+15:1962:x1830948733815424:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129561.111030:0:20578:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129561.111033:0:20578:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1a600/0x40a459093b067e38 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fd4d expref: 15 pid: 14547 timeout: 916 lvb_type: 0 00010000:00010000:0.0:1746129561.111041:0:20578:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1a600/0x40a459093b067e38 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fd4d expref: 15 pid: 14547 timeout: 916 lvb_type: 0 00010000:00010000:0.0:1746129561.111052:0:20578:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1a600/0x40a459093b067e38 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fd4d expref: 15 pid: 14547 timeout: 916 lvb_type: 0 00010000:00010000:0.0:1746129561.111060:0:20578:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009c36a600) 00010000:00010000:0.0:1746129561.111063:0:20578:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f969200/0x40a459093b068029 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129561.111068:0:20578:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129561.111087:0:20578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094065180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+14:1962:x1830948733815424:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 64us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129561.111092:0:20578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7867 00000100:00100000:0.0:1746129561.146524:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129561.150735:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129561.156157:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129561.156199:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129561.156230:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129561.156243:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129561.156255:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129561.156356:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129561.156415:0:22481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15430 00000100:00100000:0.0:1746129561.156423:0:22481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:068dab75-d300-4ead-a742-d14572ad1e50+7:1963:x1830948733816320:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:0.0:1746129561.156442:0:22481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129561.156460:0:22481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ebfce00/0x40a459093b068045 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f1fe73 expref: -99 pid: 22481 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746129561.156484:0:22481:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3ec:0x0] initial LVB size: 1048576, mtime: 0x6813d296, atime: 0x6813d296, ctime: 0x6813d296, blocks: 0x7bd 00010000:00010000:0.0:1746129561.156502:0:22481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129561.156503:0:22481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129561.156511:0:22481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ebfce00/0x40a459093b068045 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f1fe73 expref: 9 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129561.156525:0:22481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ebfce00/0x40a459093b068045 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f1fe73 expref: 9 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129561.156536:0:22481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ebfce00, rc 0) 00000100:00100000:0.0:1746129561.156597:0:22481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:068dab75-d300-4ead-a742-d14572ad1e50+9:1963:x1830948733816320:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 174us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129561.156606:0:22481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15430 00000100:00100000:0.0:1746129561.156621:0:22481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15433 00000100:00100000:0.0:1746129561.156626:0:22481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:068dab75-d300-4ead-a742-d14572ad1e50+7:1962:x1830948733816960:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:0.0:1746129561.156632:0:22481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129561.156640:0:22481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ebfd000/0x40a459093b06805a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f1fe96 expref: -99 pid: 22481 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746129561.156652:0:22481:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3f5:0x0] initial LVB size: 4194304, mtime: 0x6813d299, atime: 0x6813d299, ctime: 0x6813d299, blocks: 0x1029 00010000:00010000:0.0:1746129561.156660:0:22481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129561.156662:0:22481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129561.156666:0:22481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ebfd000/0x40a459093b06805a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f1fe96 expref: 9 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129561.156675:0:22481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012ebfd000/0x40a459093b06805a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f1fe96 expref: 9 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129561.156681:0:22481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ebfd000, rc 0) 00000100:00100000:0.0:1746129561.157121:0:22481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:068dab75-d300-4ead-a742-d14572ad1e50+8:1962:x1830948733816960:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 492us (874us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129561.157132:0:22481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15433 00000100:00100000:0.0:1746129561.168795:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129561.168847:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129561.168898:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129561.169585:0:21463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7402 00000100:00100000:0.0:1746129561.169592:0:21463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baeea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:068dab75-d300-4ead-a742-d14572ad1e50+9:1961:x1830948733817728:12345-192.168.202.4@tcp:3:lfs.0 00010000:00010000:0.0:1746129561.169607:0:21463:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012ebfca00/0x40a459093b06807d lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129561.169615:0:21463:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129561.169616:0:21463:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129561.169619:0:21463:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ebfca00/0x40a459093b06807d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129561.169626:0:21463:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ebfca00/0x40a459093b06807d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21463 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129561.224714:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129561.234218:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129561.234247:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129561.234261:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129561.234271:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129561.234284:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129561.236435:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129561.236484:0:22481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733819904 00000100:00100000:0.0:1746129561.236492:0:22481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733819904 00000100:00100000:0.0:1746129561.236523:0:22481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15441 00000100:00100000:0.0:1746129561.236529:0:22481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b553480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:068dab75-d300-4ead-a742-d14572ad1e50+11:1963:x1830948733819904:12345-192.168.202.4@tcp:2:lfs.0 00002000:00010000:0.0:1746129561.236605:0:22481:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb size from disk: 5146336 -> 5146336 00002000:00010000:0.0:1746129561.236608:0:22481:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb mtime from disk: 1746129561 -> 1746129561 00002000:00010000:0.0:1746129561.236610:0:22481:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb atime from disk: 1746129561 -> 1746129561 00002000:00010000:0.0:1746129561.236613:0:22481:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb ctime from disk: 1746129561 -> 1746129561 00002000:00010000:0.0:1746129561.236614:0:22481:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb blocks from disk: 6033 -> 6033 00000100:00100000:0.0:1746129561.236633:0:22481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b553480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:068dab75-d300-4ead-a742-d14572ad1e50+12:1963:x1830948733819904:12345-192.168.202.4@tcp:2:lfs.0 Request processed in 105us (199us total) trans 21474841208 rc 0/0 00000100:00100000:0.0:1746129561.236639:0:22481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15441 00000100:00100000:0.0:1746129561.241959:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129561.247969:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129561.270304:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800903a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737396224:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129561.270329:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129561.270341:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800903a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737396736:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129561.270358:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129561.270367:0:3300:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1746129561.270370:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800903a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737396352:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129561.270384:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129561.270390:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800903a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737396864:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129561.270414:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129561.270429:0:22481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737396224 00000100:00100000:0.0:1746129561.270432:0:22481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737396224 00000100:00100000:0.0:1746129561.271317:0:22481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15452 00000100:00100000:0.0:1746129561.271322:0:22481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b551c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+39:3300:x1830948737396352:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129561.271433:0:22481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b551c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+40:3300:x1830948737396352:12345-0@lo:2:osp-syn-0-0.0 Request processed in 111us (1047us total) trans 21474841211 rc 0/0 00000100:00100000:0.0:1746129561.271438:0:22481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15452 00000100:00100000:0.0:1746129561.271449:0:22481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15453 00000100:00100000:0.0:1746129561.271453:0:22481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b552a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+39:3300:x1830948737396864:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129561.271528:0:22481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b552a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+40:3300:x1830948737396864:12345-0@lo:2:osp-syn-0-0.0 Request processed in 74us (1113us total) trans 21474841212 rc 0/0 00000100:00100000:0.0:1746129561.271533:0:22481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15453 00000100:00100000:0.0:1746129561.271541:0:22481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15454 00000100:00100000:0.0:1746129561.271545:0:22481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b552d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+39:3300:x1830948737396224:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746129561.271613:0:22481:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb size from disk: 5146336 -> 5146336 00002000:00010000:0.0:1746129561.271616:0:22481:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb mtime from disk: 1746129561 -> 1746129561 00002000:00010000:0.0:1746129561.271618:0:22481:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb atime from disk: 1746129561 -> 1746129561 00002000:00010000:0.0:1746129561.271620:0:22481:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb ctime from disk: 1746129561 -> 1746129561 00002000:00010000:0.0:1746129561.271622:0:22481:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb blocks from disk: 6033 -> 6033 00000100:00100000:0.0:1746129561.271640:0:22481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b552d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+40:3300:x1830948737396224:12345-0@lo:2:osp-syn-0-0.0 Request processed in 94us (1311us total) trans 21474841213 rc 0/0 00000100:00100000:0.0:1746129561.271645:0:22481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15454 00000100:00100000:0.0:1746129561.271767:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129561.271789:0:2271:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733820544 00000100:00100000:0.0:1746129561.271792:0:2271:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733820544 00000100:00100000:0.0:1746129561.271816:0:2271:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11051 00000100:00100000:0.0:1746129561.271820:0:2271:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b553b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:068dab75-d300-4ead-a742-d14572ad1e50+6:31964:x1830948733820544:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:0.0:1746129561.271834:0:2271:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129561.271852:0:2271:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4f8f200/0x40a459093b0680b5 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f1fe9d expref: -99 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129561.271901:0:2271:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4f8f200/0x40a459093b0680b5 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f1fe9d expref: 7 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129561.271915:0:2271:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4f8f200/0x40a459093b0680b5 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f1fe9d expref: 7 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129561.271931:0:2271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009f469400) 00010000:00010000:0.0:1746129561.271933:0:2271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746129561.271936:0:2271:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4f8f200, rc 0) 00000100:00100000:0.0:1746129561.271966:0:2271:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b553b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:068dab75-d300-4ead-a742-d14572ad1e50+7:31964:x1830948733820544:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 144us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129561.271970:0:2271:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11051 00000004:00080000:0.0:1746129561.272066:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800903a0380/2, rc 0, transno 21474841211 00000100:00100000:0.0:1746129561.272076:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800903a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737396352:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129561.272085:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800903a3480/2, rc 0, transno 21474841212 00000100:00100000:0.0:1746129561.272087:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800903a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737396864:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129561.272094:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800903a0a80/2, rc 0, transno 21474841213 00000100:00100000:0.0:1746129561.272096:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800903a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737396224:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129561.273832:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800903a3b80/2, rc 0, transno 21474841216 00000100:00100000:0.0:1746129561.273836:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800903a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737396736:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129561.277420:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129561.301694:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129561.308997:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129561.309056:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129561.312079:0:2271:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733821696 00000100:00100000:0.0:1746129561.312086:0:2271:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733821696 00000100:00100000:0.0:1746129561.312119:0:2271:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11054 00000100:00100000:0.0:1746129561.312125:0:2271:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094efd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ada2ffba-8920-4ecb-8068-68caa9806978+290:31972:x1830948733821696:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:0.0:1746129561.312143:0:2271:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129561.312157:0:2271:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4f8fc00/0x40a459093b068109 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f1feb9 expref: -99 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129561.312418:0:2271:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091571c00/0x40a459093b068110 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129561.312429:0:2271:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f118600/0x40a459093b0680d1 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f1fea4 expref: 291 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129561.312436:0:2271:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ca0600/0x40a459093b0680fb lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f1feab expref: 7 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129561.312441:0:2271:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091571c00/0x40a459093b068110 lrc: 5/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129561.312473:0:2271:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ca0600/0x40a459093b0680fb lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1feab expref: 7 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129561.312484:0:2271:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ca0600/0x40a459093b0680fb lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1feab expref: 7 pid: 2271 timeout: 916 lvb_type: 0 00000100:00100000:0.0:1746129561.312496:0:2271:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b550000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:2271:1830948737397120:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129561.312580:0:2271:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f118600/0x40a459093b0680d1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fea4 expref: 291 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129561.312588:0:2271:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f118600/0x40a459093b0680d1 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fea4 expref: 291 pid: 14547 timeout: 916 lvb_type: 0 00000100:00100000:0.0:1746129561.312596:0:2271:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b550a80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:2271:1830948737397248:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129561.312614:0:2271:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093da8840 going to sleep for 11 seconds 00000100:00100000:0.0:1746129561.314526:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129561.315101:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129561.315146:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129561.315178:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129561.315216:0:2271:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b550000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:2271:1830948737397120:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129561.315224:0:2271:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b550a80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:2271:1830948737397248:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129561.315245:0:2271:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880091571c00/0x40a459093b068110 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00000100:00100000:0.0:1746129561.316126:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00010000:00010000:0.0:1746129561.316701:0:2271:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880091571c00/0x40a459093b068110 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129561.316709:0:2271:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091571c00/0x40a459093b068110 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00000004:00200000:0.0:1746129561.316728:0:2271:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:0.0:1746129561.316879:0:2271:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4f8fc00/0x40a459093b068109 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f1feb9 expref: 292 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129561.316897:0:2271:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091571c00/0x40a459093b068110 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f1feb9 expref: 291 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129561.316904:0:2271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009f469400) 00010000:00010000:0.0:1746129561.316906:0:2271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746129561.316908:0:2271:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091571c00, rc 0) 00000100:00100000:0.0:1746129561.316929:0:2271:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094efd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ada2ffba-8920-4ecb-8068-68caa9806978+291:31972:x1830948733821696:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 4805us (4988us total) trans 8589945117 rc 0/0 00000100:00100000:0.0:1746129561.316935:0:2271:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11054 00000100:00100000:0.0:1746129561.324950:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129561.337936:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129561.342488:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129561.342553:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129561.352272:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129561.352414:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129561.353373:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129561.353418:0:2271:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733823360 00000100:00100000:0.0:1746129561.353426:0:2271:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733823360 00000100:00100000:0.0:1746129561.353461:0:2271:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733823744 00000100:00100000:0.0:1746129561.353463:0:2271:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733823744 00000100:00100000:0.0:1746129561.353478:0:2271:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11058 00000100:00100000:0.0:1746129561.353483:0:2271:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093edf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ada2ffba-8920-4ecb-8068-68caa9806978+291:31976:x1830948733823360:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129561.353503:0:2271:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129561.353520:0:2271:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb26c00/0x40a459093b06814f lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f1fee3 expref: -99 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129561.359487:0:2271:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f118800/0x40a459093b06815d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129561.359516:0:2271:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb26c00/0x40a459093b06814f lrc: 4/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f1fee3 expref: 292 pid: 2271 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129561.361231:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00010000:00010000:0.0:1746129561.361475:0:16908:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.202.4@tcp) returned -22 from blocking AST (req@ffff880094efe300 x1830948737397376) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff88009f119000/0x40a459093b068141 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fed5 expref: 11 pid: 2271 timeout: 916 lvb_type: 0 00010000:00010000:0.0:1746129561.361493:0:16908:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f119000/0x40a459093b068141 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fed5 expref: 11 pid: 2271 timeout: 916 lvb_type: 0 00000100:00100000:0.0:1746129561.361515:0:16908:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094efe300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16908:1830948737397376:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129561.361612:0:16908:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094eff100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16908:1830948737397504:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129561.361633:0:16908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009f469400) 00010000:00010000:0.0:1746129561.361637:0:16908:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f118800/0x40a459093b06815d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129561.361645:0:16908:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f118800/0x40a459093b06815d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129561.361653:0:16908:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009f118800/0x40a459093b06815d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 16908 initiator: MDT0 00000100:00100000:0.0:1746129561.364075:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129561.364174:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00010000:00010000:0.0:1746129561.365099:0:16908:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f118800/0x40a459093b06815d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129561.365106:0:16908:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f118800/0x40a459093b06815d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 16908 initiator: MDT0 00000100:00100000:0.0:1746129561.397540:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129561.402574:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733824384 00000100:00100000:0.0:1746129561.402578:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733824384 00010000:00010000:0.0:1746129561.402593:0:9823:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e94d000/0x40a459093b06811e lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fec0 expref: 13 pid: 14547 timeout: 916 lvb_type: 0 00000100:00100000:0.0:1746129561.402606:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7875 00000100:00100000:0.0:1746129561.402611:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009402aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+13:1962:x1830948733824384:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129561.402620:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129561.402623:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012e94d000/0x40a459093b06811e lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fec0 expref: 13 pid: 14547 timeout: 916 lvb_type: 0 00010000:00010000:0.0:1746129561.402631:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012e94d000/0x40a459093b06811e lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fec0 expref: 13 pid: 14547 timeout: 916 lvb_type: 0 00010000:00010000:0.0:1746129561.402642:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e94d000/0x40a459093b06811e lrc: 0/0,0 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fec0 expref: 13 pid: 14547 timeout: 916 lvb_type: 0 00010000:00010000:0.0:1746129561.402650:0:9823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009f469400) 00010000:00010000:0.0:1746129561.402653:0:9823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f883200/0x40a459093b068187 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x40 rrc: 7 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129561.402658:0:9823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f883200/0x40a459093b068187 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x40 rrc: 7 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129561.402662:0:9823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb26c00/0x40a459093b06814f lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f1fee3 expref: 290 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129561.402667:0:9823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f883200/0x40a459093b068187 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x40 rrc: 7 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129561.402670:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129561.402694:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009402aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+12:1962:x1830948733824384:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 83us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129561.402699:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7875 00000001:00080000:0.0:1746129561.405006:0:14619:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945119 is committed 00000004:00080000:0.0:1746129561.405015:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2573 committed 00000004:00080000:0.0:1746129561.405022:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2551 committed 00000004:00080000:0.0:1746129561.405028:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2550 committed 00000004:00080000:0.0:1746129561.405030:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2549 committed 00000004:00080000:0.0:1746129561.405031:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2548 committed 00000004:00080000:0.0:1746129561.405033:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2572 committed 00000004:00080000:0.0:1746129561.405034:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2547 committed 00000004:00080000:0.0:1746129561.405035:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2571 committed 00000004:00080000:0.0:1746129561.405037:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2546 committed 00000004:00080000:0.0:1746129561.405038:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2570 committed 00000004:00080000:0.0:1746129561.405040:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2569 committed 00000004:00080000:0.0:1746129561.405042:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2568 committed 00000004:00080000:0.0:1746129561.405043:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2545 committed 00000004:00080000:0.0:1746129561.405044:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2544 committed 00000004:00080000:0.0:1746129561.405046:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2567 committed 00000004:00080000:0.0:1746129561.405047:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2566 committed 00000004:00080000:0.0:1746129561.405048:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2543 committed 00000001:00080000:0.0:1746129561.405057:0:14619:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945117 is committed 00000001:00080000:0.0:1746129561.405066:0:14619:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945114 is committed 00000100:00100000:0.0:1746129561.406796:0:4699:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15472 00000100:00100000:0.0:1746129561.406806:0:4699:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+43:3300:x1830948737398528:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129561.406883:0:4699:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+44:3300:x1830948737398528:12345-0@lo:2:osp-syn-1-0.0 Request processed in 82us (1274us total) trans 17179873991 rc 0/0 00000100:00100000:0.0:1746129561.406888:0:4699:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15472 00000100:00100000:0.0:1746129561.406896:0:4699:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15473 00000100:00100000:0.0:1746129561.406900:0:4699:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013577d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+46:3300:x1830948737399552:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129561.406968:0:4699:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013577d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+47:3300:x1830948737399552:12345-0@lo:2:osp-syn-0-0.0 Request processed in 67us (1324us total) trans 21474841221 rc 0/0 00000100:00100000:0.0:1746129561.406973:0:4699:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15473 00000100:00100000:0.0:1746129561.406982:0:4699:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15474 00000100:00100000:0.0:1746129561.406987:0:4699:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013577ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+46:3300:x1830948737398912:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746129561.407057:0:4699:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746129561.407060:0:4699:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb mtime from disk: 1746129561 -> 1746129561 00002000:00010000:0.0:1746129561.407061:0:4699:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb atime from disk: 1746129561 -> 1746129561 00002000:00010000:0.0:1746129561.407063:0:4699:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb ctime from disk: 1746129561 -> 1746129561 00002000:00010000:0.0:1746129561.407064:0:4699:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746129561.407079:0:4699:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013577ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+47:3300:x1830948737398912:12345-0@lo:2:osp-syn-0-0.0 Request processed in 92us (1454us total) trans 21474841222 rc 0/0 00000100:00100000:0.0:1746129561.407084:0:4699:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15474 00000004:00080000:0.0:1746129561.407118:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135724700/2, rc 0, transno 17179873991 00000100:00100000:0.0:1746129561.407123:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135724700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737398528:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129561.407132:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f37f100/2, rc 0, transno 21474841222 00000100:00100000:0.0:1746129561.407138:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f37f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737398912:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129561.407145:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f37df80/2, rc 0, transno 21474841221 00000100:00100000:0.0:1746129561.407147:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f37df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737399552:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129561.408833:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094eff100/2, rc 0, transno 17179873992 00000100:00100000:0.0:1746129561.408836:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094eff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737398016:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129561.410075:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129561.411559:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129561.411638:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129561.413559:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129561.413596:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129561.416710:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129561.419637:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129561.419694:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129561.419750:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129561.423395:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129561.424412:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129561.424879:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129561.424898:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129561.425863:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7876 00000100:00100000:0.0:1746129561.425869:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090168a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:068dab75-d300-4ead-a742-d14572ad1e50+10:1963:x1830948733826176:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129561.425879:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129561.425885:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f883200/0x40a459093b068187 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1feff expref: 10 pid: 2271 timeout: 916 lvb_type: 0 00010000:00010000:0.0:1746129561.425893:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f883200/0x40a459093b068187 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1feff expref: 10 pid: 2271 timeout: 916 lvb_type: 0 00010000:00010000:0.0:1746129561.425913:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f883200/0x40a459093b068187 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1feff expref: 10 pid: 2271 timeout: 916 lvb_type: 0 00010000:00010000:0.0:1746129561.425928:0:7085:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009f469400) 00010000:00010000:0.0:1746129561.425932:0:7085:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f883000/0x40a459093b0681a3 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129561.425939:0:7085:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f883000/0x40a459093b0681a3 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129561.425945:0:7085:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f883000/0x40a459093b0681a3 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129561.425960:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129561.425976:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090168a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:068dab75-d300-4ead-a742-d14572ad1e50+9:1963:x1830948733826176:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 108us (1564us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129561.425984:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7876 00000100:00100000:0.0:1746129561.425995:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7878 00000100:00100000:0.0:1746129561.425999:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090169f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:068dab75-d300-4ead-a742-d14572ad1e50+11:1961:x1830948733826432:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129561.426006:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129561.426020:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f969600/0x40a459093b068068 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fe8f expref: 11 pid: 8410 timeout: 916 lvb_type: 1 00010000:00010000:0.0:1746129561.426028:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f969600/0x40a459093b068068 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fe8f expref: 11 pid: 8410 timeout: 916 lvb_type: 1 00010000:00010000:0.0:1746129561.426040:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129561.426042:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129561.426045:0:7085:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b4e59200/0x40a459093b0681aa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3104768->3145727) gid 0 flags: 0x50080000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f1ff1b expref: 19 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129561.426052:0:7085:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4e59200/0x40a459093b0681aa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3104768->3145727) gid 0 flags: 0x50080000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f1ff1b expref: 19 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129561.426067:0:7085:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800b4e59200/0x40a459093b0681aa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3104768->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f1ff1b expref: 19 pid: 7148 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129561.426073:0:7085:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009016b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7085:1830948737400832:192.168.202.4@tcp:105: 00000100:00100000:0.0:1746129561.426090:0:7085:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093da89c0 going to sleep for 11 seconds 00010000:00010000:0.0:1746129561.426141:0:16908:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f883000/0x40a459093b0681a3 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129561.426147:0:16908:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f883000/0x40a459093b0681a3 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00000004:00200000:0.0:1746129561.426167:0:16908:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:0.0:1746129561.426363:0:16908:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f882600/0x40a459093b06819c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f1ff14 expref: 10 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129561.426374:0:16908:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f883000/0x40a459093b0681a3 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f1ff14 expref: 9 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129561.426379:0:16908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009f469400) 00010000:00010000:0.0:1746129561.426381:0:16908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1746129561.426383:0:16908:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f883000, rc 0) 00000100:00100000:0.0:1746129561.426411:0:16908:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009016a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:068dab75-d300-4ead-a742-d14572ad1e50+9:31978:x1830948733825536:12345-192.168.202.4@tcp:101:mirror_io.0 Request processed in 6343us (6717us total) trans 8589945120 rc 0/0 00000100:00100000:0.0:1746129561.426417:0:16908:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11064 00000100:00100000:0.0:1746129561.434174:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129561.434326:0:7085:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009016b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7085:1830948737400832:192.168.202.4@tcp:105: 00010000:00010000:0.0:1746129561.434346:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129561.436483:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090169f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:068dab75-d300-4ead-a742-d14572ad1e50+10:1961:x1830948733826432:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 10481us (11582us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129561.436491:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7878 00000100:00100000:0.0:1746129561.436800:0:8415:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7411 00000100:00100000:0.0:1746129561.436807:0:8415:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ada2ffba-8920-4ecb-8068-68caa9806978+19:1962:x1830948733827072:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:0.0:1746129561.436945:0:8415:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ada2ffba-8920-4ecb-8068-68caa9806978+19:1962:x1830948733827072:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 139us (322us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746129561.436950:0:8415:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7411 00002000:00100000:0.0:1746129561.436954:0:8415:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3ef:0x0] (3104768->3108863) req@ffff88009fa24000 x1830948733827072/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:302/0 lens 488/4536 e 0 to 0 dl 1746129572 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129561.436961:0:8415:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fa24000 with x1830948733827072 ext(3104768->3108863) 00002000:00010000:0.0:1746129561.436964:0:8415:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fa24000 00000100:00100000:0.0:1746129561.444604:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129561.445238:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129561.448048:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129561.448127:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129561.451650:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733828352 00000100:00100000:0.0:1746129561.451654:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733828352 00010000:00010000:0.0:1746129561.451675:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012ebfd000/0x40a459093b06805a lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fe96 expref: 10 pid: 22481 timeout: 916 lvb_type: 1 00000100:00100000:0.0:1746129561.451696:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7879 00000100:00100000:0.0:1746129561.451701:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009402b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:068dab75-d300-4ead-a742-d14572ad1e50+10:1960:x1830948733828352:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129561.451710:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129561.451724:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012ebfd000/0x40a459093b06805a lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fe96 expref: 10 pid: 22481 timeout: 916 lvb_type: 1 00010000:00010000:0.0:1746129561.451734:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012ebfd000/0x40a459093b06805a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fe96 expref: 10 pid: 22481 timeout: 916 lvb_type: 1 00010000:00010000:0.0:1746129561.451755:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129561.451756:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129561.451764:0:7085:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a9209000/0x40a459093b0681cd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2658303) gid 0 flags: 0x50080000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f1ff30 expref: 29 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129561.451771:0:7085:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a9209000/0x40a459093b0681cd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2658303) gid 0 flags: 0x50080000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f1ff30 expref: 29 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129561.451800:0:7085:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a9209000/0x40a459093b0681cd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2658303) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f1ff30 expref: 29 pid: 7148 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129561.451810:0:7085:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009016a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7085:1830948737401216:192.168.202.4@tcp:105: 00000100:00100000:0.0:1746129561.451847:0:7085:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093da8cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129561.464823:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129561.464926:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129561.464993:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129561.465911:0:8415:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2321 00000100:00100000:0.0:1746129561.465929:0:8415:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090168000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+19:1962:x1830948733828992:12345-192.168.202.4@tcp:4:multiop.0 00000100:00100000:0.0:1746129561.478286:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129561.492351:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129561.496349:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129561.498494:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129561.508796:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129561.516141:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129561.516284:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129561.520214:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129561.526048:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733831040 00000100:00100000:0.0:1746129561.526057:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733831040 00000100:00100000:0.0:1746129561.526114:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15488 00000100:00100000:0.0:1746129561.526122:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013577d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ada2ffba-8920-4ecb-8068-68caa9806978+19:31976:x1830948733831040:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129561.526143:0:7148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129561.526161:0:7148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095cda200/0x40a459093b0681f7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f1ff5a expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129561.526189:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129561.526191:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129561.526199:0:7148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095cda200/0x40a459093b0681f7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f1ff5a expref: 20 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129561.526214:0:7148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095cda200/0x40a459093b0681f7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f1ff5a expref: 20 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129561.526224:0:7148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095cda200, rc 0) 00000100:00100000:0.0:1746129561.526281:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013577d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ada2ffba-8920-4ecb-8068-68caa9806978+20:31976:x1830948733831040:12345-192.168.202.4@tcp:101:cat.0 Request processed in 159us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129561.526287:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15488 00000100:00100000:0.0:1746129561.528670:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129561.530955:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129561.532775:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129561.544214:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129561.557381:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129561.557446:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129561.571774:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129561.572265:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129561.572330:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129561.574652:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129561.577665:0:31523:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733832576 00000100:00100000:0.0:1746129561.577673:0:31523:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733832576 00002000:00100000:0.0:1746129561.577705:0:31523:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f5:0x0] (2658304->3706879) req@ffff880094f47800 x1830948733832576/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:302/0 lens 488/0 e 0 to 0 dl 1746129572 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129561.577718:0:31523:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094f47800 with x1830948733832576 ext(2658304->3706879) 00010000:00010000:0.0:1746129561.577724:0:31523:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a9209000/0x40a459093b0681cd lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2658303) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f1ff30 expref: 30 pid: 7148 timeout: 916 lvb_type: 0 00010000:00010000:0.0:1746129561.577733:0:31523:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a9209000/0x40a459093b0681cd lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2658303) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f1ff30 expref: 30 pid: 7148 timeout: 916 lvb_type: 0 00002000:00010000:0.0:1746129561.577739:0:31523:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094f47800 00000100:00100000:0.0:1746129561.577769:0:31523:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733833088 00000100:00100000:0.0:1746129561.577772:0:31523:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733833088 00002000:00100000:0.0:1746129561.577786:0:31523:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->4194303) req@ffff88009402a680 x1830948733833088/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:302/0 lens 488/0 e 0 to 0 dl 1746129572 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129561.577792:0:31523:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009402a680 with x1830948733833088 ext(3145728->4194303) 00002000:00010000:0.0:1746129561.577795:0:31523:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009402a680 00000100:00100000:0.0:1746129561.577807:0:31523:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2323 00000100:00100000:0.0:1746129561.577811:0:31523:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ada2ffba-8920-4ecb-8068-68caa9806978+30:1962:x1830948733832576:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129561.590090:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129561.603546:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129561.616124:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129561.628369:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129561.628424:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129561.637140:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129561.637190:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129561.639667:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129561.640734:0:31518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7425 00000100:00100000:0.0:1746129561.640752:0:31518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f449f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+22:1963:x1830948733834368:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129561.659040:0:31521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f44b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+22:1962:x1830948733834752:12345-192.168.202.4@tcp:3:cat.0 Request processed in 19231us (21836us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129561.659054:0:31521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7424 00002000:00100000:0.0:1746129561.659068:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f5:0x0] (3145728->4194303) req@ffff88008f44b100 x1830948733834752/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:302/0 lens 488/440 e 0 to 0 dl 1746129572 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129561.659078:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f44b100 with x1830948733834752 ext(3145728->4194303) 00002000:00010000:0.0:1746129561.659084:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f44b100 00000100:00100000:0.0:1746129561.663207:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129561.669143:0:31518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f449f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:1963:x1830948733834368:12345-192.168.202.4@tcp:3:cat.0 Request processed in 28388us (32002us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129561.669157:0:31518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7425 00002000:00100000:0.0:1746129561.669171:0:31518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3f5:0x0] (2097152->3145727) req@ffff88008f449f80 x1830948733834368/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:302/0 lens 488/440 e 0 to 0 dl 1746129572 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129561.669181:0:31518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f449f80 with x1830948733834368 ext(2097152->3145727) 00002000:00010000:0.0:1746129561.669187:0:31518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f449f80 00000100:00100000:0.0:1746129561.686478:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129561.688041:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129561.700910:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129561.712371:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129561.713022:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129561.713125:0:2271:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733836416 00000100:00100000:0.0:1746129561.713128:0:2271:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733836416 00000100:00100000:0.0:1746129561.713153:0:2271:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11067 00000100:00100000:0.0:1746129561.713158:0:2271:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f44b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ada2ffba-8920-4ecb-8068-68caa9806978+291:31986:x1830948733836416:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:0.0:1746129561.713169:0:2271:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129561.713186:0:2271:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef5e00/0x40a459093b06823d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f1ff84 expref: -99 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129561.713282:0:2271:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef4200/0x40a459093b068244 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129561.713320:0:2271:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef4200/0x40a459093b068244 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129561.713331:0:2271:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef4200/0x40a459093b068244 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129561.713344:0:2271:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef5600/0x40a459093b06824b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129561.713349:0:2271:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef5600/0x40a459093b06824b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129561.713355:0:2271:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef5600/0x40a459093b06824b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00000100:00100000:0.0:1746129561.718594:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129561.723952:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129561.727125:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129561.727762:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129561.734489:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129561.734541:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129561.738185:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129561.738578:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129561.738598:0:31520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733837824 00000100:00100000:0.0:1746129561.738601:0:31520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733837824 00002000:00100000:0.0:1746129561.738627:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3f5:0x0] (3829760->3833855) req@ffff880093edc700 x1830948733837824/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:302/0 lens 488/0 e 0 to 0 dl 1746129572 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129561.738635:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093edc700 with x1830948733837824 ext(3829760->3833855) 00002000:00010000:0.0:1746129561.738640:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093edc700 00000100:00100000:0.0:1746129561.738650:0:31520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7430 00000100:00100000:0.0:1746129561.738654:0:31520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093edc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+19:1963:x1830948733837824:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:0.0:1746129561.738800:0:31520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093edc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+19:1963:x1830948733837824:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 145us (221us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746129561.738806:0:31520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7430 00002000:00100000:0.0:1746129561.738811:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3f5:0x0] (3829760->3833855) req@ffff880093edc700 x1830948733837824/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:302/0 lens 488/4536 e 0 to 0 dl 1746129572 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129561.738817:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093edc700 with x1830948733837824 ext(3829760->3833855) 00002000:00010000:0.0:1746129561.738820:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093edc700 00000100:00100000:0.0:1746129561.742549:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129561.742602:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129561.744675:0:7086:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733838208 00000100:00100000:0.0:1746129561.744682:0:7086:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733838208 00010000:00010000:0.0:1746129561.744706:0:7086:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095cda200/0x40a459093b0681f7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1ff5a expref: 23 pid: 7148 timeout: 917 lvb_type: 0 00000100:00100000:0.0:1746129561.744864:0:7086:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7889 00000100:00100000:0.0:1746129561.744871:0:7086:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094028e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ada2ffba-8920-4ecb-8068-68caa9806978+23:1962:x1830948733838208:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129561.744882:0:7086:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129561.744900:0:7086:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095cda200/0x40a459093b0681f7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1ff5a expref: 23 pid: 7148 timeout: 917 lvb_type: 0 00010000:00010000:0.0:1746129561.744916:0:7086:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095cda200/0x40a459093b0681f7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1ff5a expref: 23 pid: 7148 timeout: 917 lvb_type: 0 00010000:00010000:0.0:1746129561.744936:0:7086:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095cda200/0x40a459093b0681f7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1ff5a expref: 23 pid: 7148 timeout: 917 lvb_type: 0 00010000:00010000:0.0:1746129561.744953:0:7086:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129561.744955:0:7086:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129561.744961:0:7086:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ce26000/0x40a459093b06826e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1052671) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f1ff99 expref: 22 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129561.744968:0:7086:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ce26000/0x40a459093b06826e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1052671) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f1ff99 expref: 22 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129561.744996:0:7086:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012ce26000/0x40a459093b06826e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1052671) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f1ff99 expref: 22 pid: 7148 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129561.745009:0:7086:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093edce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7086:1830948737403520:192.168.202.4@tcp:105: 00000100:00100000:0.0:1746129561.745069:0:7086:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093da8180 going to sleep for 11 seconds 00000100:00100000:0.0:1746129561.747241:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129561.748064:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129561.748084:0:31520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733838464 00000100:00100000:0.0:1746129561.748091:0:31520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733838464 00002000:00100000:0.0:1746129561.748131:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3f5:0x0] (4186112->4190207) req@ffff880093edf800 x1830948733838464/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:302/0 lens 488/0 e 0 to 0 dl 1746129572 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129561.748141:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093edf800 with x1830948733838464 ext(4186112->4190207) 00002000:00010000:0.0:1746129561.748148:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093edf800 00000100:00100000:0.0:1746129561.748162:0:31520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733838720 00000100:00100000:0.0:1746129561.748165:0:31520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733838720 00002000:00100000:0.0:1746129561.748177:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3ee:0x0] (1048576->1052671) req@ffff880093edce00 x1830948733838720/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:302/0 lens 488/0 e 0 to 0 dl 1746129572 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129561.748183:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093edce00 with x1830948733838720 ext(1048576->1052671) 00002000:00010000:0.0:1746129561.748186:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093edce00 00000100:00100000:0.0:1746129561.748767:0:31520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7431 00000100:00100000:0.0:1746129561.748774:0:31520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093edf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+19:1962:x1830948733838464:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:0.0:1746129561.748937:0:31520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093edf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+19:1962:x1830948733838464:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 163us (1706us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746129561.748943:0:31520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7431 00002000:00100000:0.0:1746129561.748949:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3f5:0x0] (4186112->4190207) req@ffff880093edf800 x1830948733838464/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:302/0 lens 488/4536 e 0 to 0 dl 1746129572 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129561.748956:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093edf800 with x1830948733838464 ext(4186112->4190207) 00002000:00010000:0.0:1746129561.748959:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093edf800 00000100:00100000:0.0:1746129561.748970:0:31520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7432 00000100:00100000:0.0:1746129561.748974:0:31520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093edce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ada2ffba-8920-4ecb-8068-68caa9806978+22:1962:x1830948733838720:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:0.0:1746129561.749044:0:31520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093edce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ada2ffba-8920-4ecb-8068-68caa9806978+22:1962:x1830948733838720:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 68us (980us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746129561.749049:0:31520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7432 00002000:00100000:0.0:1746129561.749052:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3ee:0x0] (1048576->1052671) req@ffff880093edce00 x1830948733838720/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:302/0 lens 488/4536 e 0 to 0 dl 1746129572 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129561.749065:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093edce00 with x1830948733838720 ext(1048576->1052671) 00002000:00010000:0.0:1746129561.749068:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093edce00 00000100:00100000:0.0:1746129561.753698:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4663 00000100:00100000:0.0:1746129561.753708:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094028700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+12:31983:x1830948733838976:12345-192.168.202.4@tcp:35:multiop.0 00000100:00100000:0.0:1746129561.754212:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094028700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+13:31983:x1830948733838976:12345-192.168.202.4@tcp:35:multiop.0 Request processed in 504us (1076us total) trans 8589945128 rc 0/0 00000100:00100000:0.0:1746129561.754220:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4663 00000100:00100000:0.0:1746129561.885381:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129561.890727:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129561.890842:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129561.897015:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129561.905146:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129561.907687:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129561.915465:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129561.924801:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129561.933233:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129561.945363:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129561.947378:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129561.953869:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129561.955859:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129561.956825:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129561.971200:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129561.971250:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129561.973617:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129561.984787:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129561.989355:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129562.003105:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129562.022733:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129562.022855:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129562.031740:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129562.047011:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129562.051777:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129562.053793:0:8411:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009402b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8411:1830948737404928:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129562.053812:0:8411:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009512ba00/0x40a459093b06831d lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f1ffe6 expref: 31 pid: 8411 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129562.053825:0:8411:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009512ba00, rc 0) 00000100:00100000:0.0:1746129562.053843:0:8411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009feec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ada2ffba-8920-4ecb-8068-68caa9806978+31:31995:x1830948733843712:12345-192.168.202.4@tcp:101:cat.0 Request processed in 6655us (6843us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129562.053848:0:8411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15502 00000100:00100000:0.0:1746129562.062630:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129562.062689:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129562.087283:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129562.093744:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129562.095441:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129562.095459:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129562.095497:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129562.096159:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129562.110224:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129562.120613:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129562.122635:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129562.131721:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129562.131861:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129562.138555:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129562.138602:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129562.138634:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129562.138649:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129562.138674:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129562.138690:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129562.141493:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129562.142339:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129562.143517:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129562.146638:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129562.147206:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129562.150772:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129562.159835:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129562.165814:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129562.165905:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129562.169411:0:16680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733849472 00000100:00100000:0.0:1746129562.169423:0:16680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733849472 00000100:00100000:0.0:1746129562.169467:0:16680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4666 00000100:00100000:0.0:1746129562.169476:0:16680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013577e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ada2ffba-8920-4ecb-8068-68caa9806978+299:32003:x1830948733849472:12345-192.168.202.4@tcp:35:multiop.0 00000100:00100000:0.0:1746129562.169686:0:16680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013577e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ada2ffba-8920-4ecb-8068-68caa9806978+301:32003:x1830948733849472:12345-192.168.202.4@tcp:35:multiop.0 Request processed in 210us (346us total) trans 8589945136 rc 0/0 00000100:00100000:0.0:1746129562.169693:0:16680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4666 00000100:00100000:0.0:1746129562.175795:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129562.177194:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129562.178369:0:31518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733850624 00000100:00100000:0.0:1746129562.178375:0:31518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733850624 00002000:00100000:0.0:1746129562.178409:0:31518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->4194303) req@ffff88009402ad80 x1830948733850624/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:303/0 lens 488/0 e 0 to 0 dl 1746129573 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129562.178417:0:31518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009402ad80 with x1830948733850624 ext(3145728->4194303) 00002000:00010000:0.0:1746129562.178420:0:31518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009402ad80 00000100:00100000:0.0:1746129562.178450:0:31518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7450 00000100:00100000:0.0:1746129562.178456:0:31518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009402ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+16:1962:x1830948733850624:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129562.180080:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733851392 00000100:00100000:0.0:1746129562.180086:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733851392 00000100:00100000:0.0:1746129562.180119:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4667 00000100:00100000:0.0:1746129562.180125:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094028e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ada2ffba-8920-4ecb-8068-68caa9806978+299:31995:x1830948733851392:12345-192.168.202.4@tcp:35:cat.0 00000100:00100000:0.0:1746129562.180317:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094028e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ada2ffba-8920-4ecb-8068-68caa9806978+300:31995:x1830948733851392:12345-192.168.202.4@tcp:35:cat.0 Request processed in 169us (247us total) trans 8589945137 rc 0/0 00000100:00100000:0.0:1746129562.180325:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4667 00000100:00100000:0.0:1746129562.222475:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129562.250638:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129562.264984:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00080000:0.0:1746129562.265232:0:7097:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746129562.270120:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129562.275919:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129562.275951:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129562.275983:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129562.275996:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129562.276022:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129562.292557:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129562.303023:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129562.303074:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129562.303371:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129562.307028:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129562.307054:0:15749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733853952 00000100:00100000:0.0:1746129562.307060:0:15749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733853952 00010000:00010000:0.0:1746129562.307123:0:15749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b52ea000/0x40a459093b0683da lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20072 expref: 9 pid: 4385 timeout: 917 lvb_type: 1 00000100:00100000:0.0:1746129562.307158:0:15749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7905 00000100:00100000:0.0:1746129562.307165:0:15749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e38aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:068dab75-d300-4ead-a742-d14572ad1e50+9:1961:x1830948733853952:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129562.307178:0:15749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129562.307249:0:15749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b52ea000/0x40a459093b0683da lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20072 expref: 9 pid: 4385 timeout: 917 lvb_type: 1 00010000:00010000:0.0:1746129562.307259:0:15749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b52ea000/0x40a459093b0683da lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20072 expref: 9 pid: 4385 timeout: 917 lvb_type: 1 00010000:00010000:0.0:1746129562.307280:0:15749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b52ea000/0x40a459093b0683da lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20072 expref: 9 pid: 4385 timeout: 917 lvb_type: 1 00010000:00010000:0.0:1746129562.307324:0:15749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129562.307421:0:15749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e38aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:068dab75-d300-4ead-a742-d14572ad1e50+8:1961:x1830948733853952:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 255us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129562.307432:0:15749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7905 00000100:00100000:0.0:1746129562.310236:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129562.310524:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129562.310544:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129562.313075:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733854336 00000100:00100000:0.0:1746129562.313083:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733854336 00000100:00100000:0.0:1746129562.313143:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 775 00000100:00100000:0.0:1746129562.313151:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa26680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+19:1963:x1830948733854336:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129562.313163:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129562.313185:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4ece00/0x40a459093b06840b lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20080 expref: 19 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129562.313199:0:7085:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009f469400) 00010000:00010000:0.0:1746129562.313203:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129562.313238:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa26680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+18:1963:x1830948733854336:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 88us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129562.313244:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 775 00000100:00100000:0.0:1746129562.321832:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129562.325981:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129562.326682:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129562.332200:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733855744 00000100:00100000:0.0:1746129562.332203:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733855744 00010000:00010000:0.0:1746129562.332218:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f5edc00/0x40a459093b06832b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fffb expref: 26 pid: 8411 timeout: 917 lvb_type: 1 00000100:00100000:0.0:1746129562.335436:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129562.335455:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129562.335476:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733856256 00000100:00100000:0.0:1746129562.335482:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733856256 00010000:00010000:0.0:1746129562.335516:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b52ebe00/0x40a459093b0683d3 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2006b expref: 11 pid: 4385 timeout: 917 lvb_type: 1 00000100:00100000:0.0:1746129562.335538:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733856384 00000100:00100000:0.0:1746129562.335540:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733856384 00010000:00010000:0.0:1746129562.335548:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f5ed200/0x40a459093b06836a lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 5144576->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20033 expref: 27 pid: 8411 timeout: 917 lvb_type: 0 00000100:00100000:0.0:1746129562.335562:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7912 00000100:00100000:0.0:1746129562.335568:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e389500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:068dab75-d300-4ead-a742-d14572ad1e50+11:1961:x1830948733856256:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129562.335580:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129562.335601:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b52ebe00/0x40a459093b0683d3 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2006b expref: 11 pid: 4385 timeout: 917 lvb_type: 1 00010000:00010000:0.0:1746129562.335611:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b52ebe00/0x40a459093b0683d3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2006b expref: 11 pid: 4385 timeout: 917 lvb_type: 1 00010000:00010000:0.0:1746129562.335633:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129562.335669:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e389500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:068dab75-d300-4ead-a742-d14572ad1e50+11:1961:x1830948733856256:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 101us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129562.335675:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7912 00000100:00100000:0.0:1746129562.335688:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7913 00000100:00100000:0.0:1746129562.335692:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e38b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ada2ffba-8920-4ecb-8068-68caa9806978+27:1961:x1830948733856384:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129562.335697:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129562.335702:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f5ed200/0x40a459093b06836a lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 5144576->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20033 expref: 27 pid: 8411 timeout: 917 lvb_type: 0 00010000:00010000:0.0:1746129562.335710:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f5ed200/0x40a459093b06836a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 5144576->5242879) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20033 expref: 27 pid: 8411 timeout: 917 lvb_type: 0 00010000:00010000:0.0:1746129562.335719:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129562.335729:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e38b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ada2ffba-8920-4ecb-8068-68caa9806978+27:1961:x1830948733856384:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 36us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129562.335734:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7913 00000100:00100000:0.0:1746129562.335775:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129562.338641:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129562.340962:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129562.342158:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129562.342834:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129562.343762:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129562.432658:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129562.439064:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129562.439168:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129562.439606:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129562.439873:0:8412:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733858304 00000100:00100000:0.0:1746129562.439876:0:8412:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733858304 00000100:00100000:0.0:1746129562.447621:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129562.455556:0:31519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733858688 00000100:00100000:0.0:1746129562.455564:0:31519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733858688 00002000:00100000:0.0:1746129562.455606:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f3:0x0] (1978368->2097151) req@ffff88009fa27800 x1830948733858688/t0(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:303/0 lens 488/0 e 0 to 0 dl 1746129573 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129562.455616:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fa27800 with x1830948733858688 ext(1978368->2097151) 00010000:00010000:0.0:1746129562.455625:0:31519:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008fbad600/0x40a459093b068339 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1978368->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20002 expref: 21 pid: 7149 timeout: 917 lvb_type: 0 00010000:00010000:0.0:1746129562.455638:0:31519:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008fbad600/0x40a459093b068339 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1978368->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20002 expref: 21 pid: 7149 timeout: 917 lvb_type: 0 00002000:00010000:0.0:1746129562.455645:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fa27800 00000100:00100000:0.0:1746129562.455671:0:31519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2329 00000100:00100000:0.0:1746129562.455678:0:31519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:1963:x1830948733858688:12345-192.168.202.4@tcp:4:multiop.0 00000100:00100000:0.0:1746129562.465675:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129562.471773:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129562.474994:0:2271:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733859328 00000100:00100000:0.0:1746129562.474998:0:2271:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733859328 00000100:00100000:0.0:1746129562.475041:0:2271:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11079 00000100:00100000:0.0:1746129562.475048:0:2271:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094028e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+19:32018:x1830948733859328:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129562.475071:0:2271:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129562.475255:0:2271:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d306200/0x40a459093b06849e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f200e2 expref: -99 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129562.475495:0:2271:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d306800/0x40a459093b0684a5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129562.475508:0:2271:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d306800/0x40a459093b0684a5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129562.475518:0:2271:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d306800/0x40a459093b0684a5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129562.475530:0:2271:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d306a00/0x40a459093b0684ac lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129562.475535:0:2271:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d306a00/0x40a459093b0684ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129562.475540:0:2271:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d306a00/0x40a459093b0684ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129562.475669:0:2271:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d307400/0x40a459093b0684b3 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129562.475682:0:2271:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d307400/0x40a459093b0684b3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129562.475687:0:2271:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d307400/0x40a459093b0684b3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00000004:00200000:0.0:1746129562.475695:0:2271:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:0.0:1746129562.475770:0:2271:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d306800/0x40a459093b0684a5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129562.475776:0:2271:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d306800/0x40a459093b0684a5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129562.475781:0:2271:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d306800/0x40a459093b0684a5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129562.475785:0:2271:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009d306800 already unused, calling callback (ffffffffa136e690) 00010000:00010000:0.0:1746129562.475789:0:2271:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d306800/0x40a459093b0684a5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129562.475795:0:2271:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d306800/0x40a459093b0684a5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129562.475804:0:2271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880132ef8f00) 00010000:00010000:0.0:1746129562.475807:0:2271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129562.475810:0:2271:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d306800/0x40a459093b0684a5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129562.475814:0:2271:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d306800/0x40a459093b0684a5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129562.475841:0:2271:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d306a00/0x40a459093b0684ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129562.475849:0:2271:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d306a00/0x40a459093b0684ac lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129562.475854:0:2271:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d306a00/0x40a459093b0684ac lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129562.475858:0:2271:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009d306a00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:0.0:1746129562.475861:0:2271:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d306a00/0x40a459093b0684ac lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129562.475864:0:2271:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d306a00/0x40a459093b0684ac lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129562.475870:0:2271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f469f00) 00010000:00010000:0.0:1746129562.475872:0:2271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129562.475874:0:2271:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d306a00/0x40a459093b0684ac lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129562.475879:0:2271:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d306a00/0x40a459093b0684ac lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129562.475917:0:2271:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d306200/0x40a459093b06849e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f200e2 expref: 22 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129562.475928:0:2271:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d307400/0x40a459093b0684b3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f200e2 expref: 21 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129562.475934:0:2271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009f469400) 00010000:00010000:0.0:1746129562.475936:0:2271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746129562.475938:0:2271:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d307400, rc 0) 00000100:00100000:0.0:1746129562.475994:0:2271:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094028e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:32018:x1830948733859328:12345-192.168.202.4@tcp:101:cat.0 Request processed in 945us (1068us total) trans 8589945145 rc 0/0 00000100:00100000:0.0:1746129562.476001:0:2271:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11079 00000100:00100000:0.0:1746129562.483205:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129562.483245:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129562.502206:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129562.502253:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129562.502316:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129562.512269:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129562.512536:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129562.527788:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129562.530715:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129562.537777:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129562.538383:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129562.561918:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129562.563326:0:22481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15536 00000100:00100000:0.0:1746129562.563336:0:22481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009507c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ada2ffba-8920-4ecb-8068-68caa9806978+25:32015:x1830948733861632:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129562.563360:0:22481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129562.563378:0:22481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090078800/0x40a459093b0684e4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2010c expref: -99 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129562.563420:0:22481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ee1be00/0x40a459093b068451 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1413120->1687551) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f200b1 expref: 13 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129562.563429:0:22481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129562.563430:0:22481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129562.563434:0:22481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090078800/0x40a459093b0684e4 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2010c expref: 26 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129562.563472:0:22481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ee1be00/0x40a459093b068451 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1413120->1687551) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f200b1 expref: 13 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129562.563486:0:22481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ee1be00/0x40a459093b068451 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1413120->1687551) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f200b1 expref: 13 pid: 22481 timeout: 917 lvb_type: 0 00000100:00100000:0.0:1746129562.563498:0:22481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009507ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:22481:1830948737411328:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129562.563593:0:22481:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093da83c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129562.566459:0:8411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733861888 00000100:00100000:0.0:1746129562.566467:0:8411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733861888 00000100:00100000:0.0:1746129562.566516:0:8411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733861760 00000100:00100000:0.0:1746129562.566518:0:8411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733861760 00000100:00100000:0.0:1746129562.566535:0:8411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15537 00000100:00100000:0.0:1746129562.566544:0:8411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f958e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+25:1962:x1830948733861888:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129562.566562:0:8411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129562.566579:0:8411:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090078e00/0x40a459093b0684eb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2011a expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129562.566634:0:8411:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009507ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8411:1830948737411456:192.168.202.4@tcp:106: 00000100:00100000:0.0:1746129562.566715:0:8411:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093da8900 going to sleep for 11 seconds 00000100:00100000:0.0:1746129562.566752:0:22481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009507ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:22481:1830948737411328:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129562.566774:0:22481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090078800/0x40a459093b0684e4 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2010c expref: 26 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129562.566786:0:22481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090078800, rc 0) 00000100:00100000:0.0:1746129562.566808:0:22481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009507c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ada2ffba-8920-4ecb-8068-68caa9806978+26:32015:x1830948733861632:12345-192.168.202.4@tcp:101:cat.0 Request processed in 3475us (4900us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129562.566815:0:22481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15536 00000100:00100000:0.0:1746129562.566833:0:22481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15538 00000100:00100000:0.0:1746129562.566837:0:22481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f95a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+14:1962:x1830948733861760:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129562.566845:0:22481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129562.566853:0:22481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fb26a00/0x40a459093b0684f2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20113 expref: -99 pid: 22481 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129562.566875:0:22481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009507ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:22481:1830948737411584:192.168.202.4@tcp:106: 00000100:00100000:0.0:1746129562.566895:0:22481:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093da83c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129562.567006:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129562.571743:0:22481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009507ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:22481:1830948737411584:192.168.202.4@tcp:106: 00010000:00010000:0.0:1746129562.571763:0:22481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fb26a00/0x40a459093b0684f2 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20113 expref: 17 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129562.571771:0:22481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fb26a00/0x40a459093b0684f2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20113 expref: 17 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129562.571783:0:22481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb26a00, rc 0) 00000100:00100000:0.0:1746129562.571805:0:22481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f95a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+16:1962:x1830948733861760:12345-192.168.202.4@tcp:101:cat.0 Request processed in 4968us (5521us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129562.571811:0:22481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15538 00000100:00100000:0.0:1746129562.571866:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129562.573853:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129562.574981:0:14547:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f95a680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14547:1830948737411712:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129562.576416:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129562.576541:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129562.576919:0:22481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733863040 00000100:00100000:0.0:1746129562.576922:0:22481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733863040 00000100:00100000:0.0:1746129562.576945:0:22481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15539 00000100:00100000:0.0:1746129562.576950:0:22481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009507e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+16:32018:x1830948733863040:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129562.576964:0:22481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129562.576978:0:22481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090079a00/0x40a459093b068515 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2012f expref: -99 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129562.576999:0:22481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ee1a800/0x40a459093b068458 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4313087) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f200b8 expref: 25 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129562.577006:0:22481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129562.577549:0:22481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129562.577553:0:22481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090079a00/0x40a459093b068515 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2012f expref: 17 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129562.577576:0:22481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ee1a800/0x40a459093b068458 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4313087) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f200b8 expref: 25 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129562.577586:0:22481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ee1a800/0x40a459093b068458 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4313087) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f200b8 expref: 25 pid: 22481 timeout: 917 lvb_type: 0 00000100:00100000:0.0:1746129562.577597:0:22481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009507c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:22481:1830948737412096:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129562.577640:0:22481:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093da83c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129562.577687:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129562.581206:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129562.583715:0:31519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733863936 00000100:00100000:0.0:1746129562.583719:0:31519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733863936 00002000:00100000:0.0:1746129562.583733:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3ef:0x0] (3383296->3387391) req@ffff88009fa25880 x1830948733863936/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:303/0 lens 488/0 e 0 to 0 dl 1746129573 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129562.583740:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fa25880 with x1830948733863936 ext(3383296->3387391) 00010000:00010000:0.0:1746129562.583744:0:31519:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009ee1a800/0x40a459093b068458 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4313087) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f200b8 expref: 29 pid: 22481 timeout: 917 lvb_type: 0 00010000:00010000:0.0:1746129562.583750:0:31519:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009ee1a800/0x40a459093b068458 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4313087) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f200b8 expref: 29 pid: 22481 timeout: 917 lvb_type: 0 00002000:00010000:0.0:1746129562.583755:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fa25880 00000100:00100000:0.0:1746129562.583777:0:31519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2334 00000100:00100000:0.0:1746129562.583782:0:31519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ada2ffba-8920-4ecb-8068-68caa9806978+29:1963:x1830948733863936:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:0.0:1746129562.583908:0:31519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ada2ffba-8920-4ecb-8068-68caa9806978+29:1963:x1830948733863936:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 124us (294us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746129562.583914:0:31519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2334 00002000:00100000:0.0:1746129562.583919:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3ef:0x0] (3383296->3387391) req@ffff88009fa25880 x1830948733863936/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:303/0 lens 488/4536 e 0 to 0 dl 1746129573 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129562.583925:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fa25880 with x1830948733863936 ext(3383296->3387391) 00010000:00010000:0.0:1746129562.583929:0:31519:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009ee1a800/0x40a459093b068458 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4313087) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f200b8 expref: 29 pid: 22481 timeout: 917 lvb_type: 0 00010000:00010000:0.0:1746129562.583936:0:31519:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009ee1a800/0x40a459093b068458 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4313087) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f200b8 expref: 29 pid: 22481 timeout: 917 lvb_type: 0 00002000:00010000:0.0:1746129562.583941:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fa25880 00000100:00100000:0.0:1746129562.591156:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129562.592733:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129562.592922:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129562.596973:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129562.600450:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129562.600510:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129562.600862:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129562.608880:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129562.614712:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129562.614984:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129562.619738:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129562.619762:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129562.619780:0:8415:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733866624 00000100:00100000:0.0:1746129562.619786:0:8415:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733866624 00002000:00100000:0.0:1746129562.619822:0:8415:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3f5:0x0] (3145728->3399679) req@ffff8800912adf80 x1830948733866624/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:303/0 lens 488/0 e 0 to 0 dl 1746129573 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129562.619832:0:8415:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800912adf80 with x1830948733866624 ext(3145728->3399679) 00002000:00010000:0.0:1746129562.619837:0:8415:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800912adf80 00000100:00100000:0.0:1746129562.619850:0:8415:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733866496 00000100:00100000:0.0:1746129562.619852:0:8415:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733866496 00002000:00100000:0.0:1746129562.619863:0:8415:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3f5:0x0] (2097152->3145727) req@ffff8800912afb80 x1830948733866496/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:303/0 lens 488/0 e 0 to 0 dl 1746129573 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129562.619869:0:8415:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800912afb80 with x1830948733866496 ext(2097152->3145727) 00002000:00010000:0.0:1746129562.619872:0:8415:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800912afb80 00000100:00100000:0.0:1746129562.619885:0:8415:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7470 00000100:00100000:0.0:1746129562.619891:0:8415:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800912adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ada2ffba-8920-4ecb-8068-68caa9806978+32:1963:x1830948733866624:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129562.621631:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800912ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+16:1963:x1830948733865728:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 12575us (12756us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129562.621641:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7467 00002000:00100000:0.0:1746129562.621650:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ef:0x0] (2097152->3145727) req@ffff8800912ac380 x1830948733865728/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:303/0 lens 488/440 e 0 to 0 dl 1746129573 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129562.621658:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800912ac380 with x1830948733865728 ext(2097152->3145727) 00002000:00010000:0.0:1746129562.621664:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800912ac380 00000100:00100000:0.0:1746129562.636335:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129562.636496:0:8411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800912ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+25:32018:x1830948733866880:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129562.636515:0:8411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129562.636531:0:8411:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880134b09a00/0x40a459093b068538 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20144 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129562.636560:0:8411:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094fef000/0x40a459093b068427 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3399680->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20087 expref: 32 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129562.636566:0:8411:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129562.636568:0:8411:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129562.636571:0:8411:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880134b09a00/0x40a459093b068538 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20144 expref: 26 pid: 8411 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129562.636601:0:8411:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094fef000/0x40a459093b068427 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3399680->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20087 expref: 32 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129562.636611:0:8411:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094fef000/0x40a459093b068427 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3399680->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20087 expref: 32 pid: 8412 timeout: 917 lvb_type: 0 00000100:00100000:1.0:1746129562.636622:0:8411:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094028380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8411:1830948737412992:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129562.636699:0:8411:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a6ce8a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746129562.639637:0:8411:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094028380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8411:1830948737412992:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129562.639674:0:8411:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880134b09a00/0x40a459093b068538 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20144 expref: 26 pid: 8411 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129562.639693:0:8411:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134b09a00, rc 0) 00000100:00100000:1.0:1746129562.639745:0:8411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800912ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+26:32018:x1830948733866880:12345-192.168.202.4@tcp:101:cat.0 Request processed in 3247us (3458us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129562.639760:0:8411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15542 00000100:00100000:0.0:1746129562.639916:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129562.646846:0:8411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733867136 00000100:00100000:1.0:1746129562.646860:0:8411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733867136 00000100:00100000:1.0:1746129562.646922:0:8411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15543 00000100:00100000:1.0:1746129562.646932:0:8411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f958380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ada2ffba-8920-4ecb-8068-68caa9806978+33:32015:x1830948733867136:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129562.646954:0:8411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129562.646972:0:8411:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880134b09000/0x40a459093b06853f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2014b expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129562.647000:0:8411:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129562.647002:0:8411:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129562.647007:0:8411:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880134b09000/0x40a459093b06853f lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2014b expref: 34 pid: 8411 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129562.647019:0:8411:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880134b09000/0x40a459093b06853f lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2014b expref: 34 pid: 8411 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129562.647030:0:8411:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134b09000, rc 0) 00000100:00100000:1.0:1746129562.647080:0:8411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f958380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ada2ffba-8920-4ecb-8068-68caa9806978+34:32015:x1830948733867136:12345-192.168.202.4@tcp:101:cat.0 Request processed in 150us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129562.647086:0:8411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15543 00000100:00100000:0.0:1746129562.656975:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129562.665557:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129562.668745:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129562.668786:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129562.670260:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129562.671557:0:8415:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7475 00000100:00100000:0.0:1746129562.671567:0:8415:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094028a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+16:1962:x1830948733868288:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:0.0:1746129562.697441:0:8415:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094028a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+16:1962:x1830948733868288:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 25862us (27173us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129562.697454:0:8415:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7475 00002000:00100000:0.0:1746129562.697467:0:8415:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->4194303) req@ffff880094028a80 x1830948733868288/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:303/0 lens 488/440 e 0 to 0 dl 1746129573 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129562.697477:0:8415:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094028a80 with x1830948733868288 ext(3145728->4194303) 00002000:00010000:0.0:1746129562.697483:0:8415:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094028a80 00000100:00100000:0.0:1746129562.702096:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129562.705410:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129562.707909:0:8411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733868544 00000100:00100000:1.0:1746129562.707924:0:8411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733868544 00000100:00100000:1.0:1746129562.707993:0:8411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15545 00000100:00100000:1.0:1746129562.708003:0:8411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f324700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+16:1961:x1830948733868544:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129562.708024:0:8411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129562.708043:0:8411:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095275200/0x40a459093b06854d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20159 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129562.708068:0:8411:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129562.708070:0:8411:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129562.708080:0:8411:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095275200/0x40a459093b06854d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20159 expref: 17 pid: 8411 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129562.708098:0:8411:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095275200/0x40a459093b06854d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20159 expref: 17 pid: 8411 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129562.708109:0:8411:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095275200, rc 0) 00000100:00100000:1.0:1746129562.708180:0:8411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f324700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+17:1961:x1830948733868544:12345-192.168.202.4@tcp:101:cat.0 Request processed in 177us (2778us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129562.708186:0:8411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15545 00000100:00100000:0.0:1746129562.712925:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129562.717717:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129562.729922:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129562.730049:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733869312 00000100:00100000:1.0:1746129562.730060:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733869312 00000100:00100000:1.0:1746129562.730205:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4672 00000100:00100000:1.0:1746129562.730215:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f327800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+22:32018:x1830948733869312:12345-192.168.202.4@tcp:35:cat.0 00000100:00100000:1.0:1746129562.730502:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f327800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+23:32018:x1830948733869312:12345-192.168.202.4@tcp:35:cat.0 Request processed in 288us (591us total) trans 8589945148 rc 0/0 00000100:00100000:1.0:1746129562.730509:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4672 00000100:00100000:0.0:1746129562.732037:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129562.738234:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129562.743753:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129562.743949:0:2271:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733869696 00000100:00100000:1.0:1746129562.743959:0:2271:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733869696 00000100:00100000:1.0:1746129562.744056:0:2271:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11082 00000100:00100000:1.0:1746129562.744064:0:2271:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f325c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:068dab75-d300-4ead-a742-d14572ad1e50+11:32026:x1830948733869696:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:1.0:1746129562.744089:0:2271:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129562.744107:0:2271:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095274e00/0x40a459093b068562 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2016e expref: -99 pid: 2271 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129562.744122:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00010000:00010000:1.0:1746129562.744170:0:2271:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095274400/0x40a459093b068569 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 2271 initiator: MDT0 00010000:00010000:1.0:1746129562.744184:0:2271:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095274400/0x40a459093b068569 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:1.0:1746129562.744197:0:2271:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095274400/0x40a459093b068569 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00010000:00010000:1.0:1746129562.744210:0:2271:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095275400/0x40a459093b068570 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 2271 initiator: MDT0 00010000:00010000:1.0:1746129562.744215:0:2271:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095275400/0x40a459093b068570 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:1.0:1746129562.744220:0:2271:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095275400/0x40a459093b068570 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00010000:00010000:1.0:1746129562.744500:0:2271:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095274c00/0x40a459093b068577 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 2271 initiator: MDT0 00010000:00010000:1.0:1746129562.744512:0:2271:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009363da00/0x40a459093b068500 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20121 expref: 22 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129562.744519:0:2271:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb26600/0x40a459093b06850e lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20128 expref: 304 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129562.744528:0:2271:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095274c00/0x40a459093b068577 lrc: 5/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:1.0:1746129562.744559:0:2271:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb26600/0x40a459093b06850e lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20128 expref: 304 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129562.744570:0:2271:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb26600/0x40a459093b06850e lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20128 expref: 304 pid: 2271 timeout: 918 lvb_type: 0 00000100:00100000:1.0:1746129562.744582:0:2271:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094029880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:2271:1830948737413760:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129562.744915:0:2271:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009363da00/0x40a459093b068500 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20121 expref: 22 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129562.744923:0:2271:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009363da00/0x40a459093b068500 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20121 expref: 22 pid: 14547 timeout: 918 lvb_type: 0 00000100:00100000:1.0:1746129562.744931:0:2271:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094028700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:2271:1830948737413888:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129562.745037:0:2271:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a6ce8a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746129562.747204:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129562.747255:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129562.747285:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733870208 00000100:00100000:0.0:1746129562.747326:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733870208 00000100:00100000:1.0:1746129562.747573:0:2271:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094029880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:2271:1830948737413760:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129562.747583:0:2271:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094028700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:2271:1830948737413888:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129562.747606:0:2271:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880095274c00/0x40a459093b068577 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00000100:00100000:0.0:1746129562.748499:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733870464 00000100:00100000:0.0:1746129562.748504:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733870464 00000100:00100000:0.0:1746129562.748561:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4674 00000100:00100000:0.0:1746129562.748567:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f326a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+23:23750:x1830948733870208:12345-192.168.202.4@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1746129562.748779:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f326a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+24:23750:x1830948733870208:12345-192.168.202.4@tcp:35:ldlm_bl.0 Request processed in 212us (1586us total) trans 8589945150 rc 0/0 00000100:00100000:0.0:1746129562.748784:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4674 00000100:00100000:0.0:1746129562.751343:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129562.752053:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00010000:00010000:1.0:1746129562.753718:0:2271:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880095274c00/0x40a459093b068577 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00010000:00010000:1.0:1746129562.753726:0:2271:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095274c00/0x40a459093b068577 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00000004:00200000:1.0:1746129562.753772:0:2271:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00000004:00200000:1.0:1746129562.753776:0:2271:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746129562.753794:0:2271:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880095274c00/0x40a459093b068577 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00010000:00010000:1.0:1746129562.753804:0:2271:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095274c00/0x40a459093b068577 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:1.0:1746129562.753813:0:2271:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095274400/0x40a459093b068569 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:1.0:1746129562.753819:0:2271:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095274400/0x40a459093b068569 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 2271 initiator: MDT0 00010000:00010000:1.0:1746129562.753824:0:2271:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095274400/0x40a459093b068569 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 2271 initiator: MDT0 00010000:00010000:1.0:1746129562.753829:0:2271:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095274400 already unused, calling callback (ffffffffa136e690) 00010000:00010000:1.0:1746129562.753832:0:2271:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095274400/0x40a459093b068569 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 2271 initiator: MDT0 00010000:00010000:1.0:1746129562.753839:0:2271:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095274400/0x40a459093b068569 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 2271 initiator: MDT0 00010000:00010000:1.0:1746129562.753846:0:2271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880132ef8f00) 00010000:00010000:1.0:1746129562.753849:0:2271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129562.753852:0:2271:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095274400/0x40a459093b068569 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 2271 initiator: MDT0 00010000:00010000:1.0:1746129562.753856:0:2271:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095274400/0x40a459093b068569 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 2271 initiator: MDT0 00010000:00010000:1.0:1746129562.753885:0:2271:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095275400/0x40a459093b068570 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:1.0:1746129562.753891:0:2271:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095275400/0x40a459093b068570 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 2271 initiator: MDT0 00010000:00010000:1.0:1746129562.753895:0:2271:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095275400/0x40a459093b068570 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 2271 initiator: MDT0 00010000:00010000:1.0:1746129562.753899:0:2271:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095275400 already unused, calling callback (ffffffffa136e690) 00010000:00010000:1.0:1746129562.753901:0:2271:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095275400/0x40a459093b068570 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 2271 initiator: MDT0 00010000:00010000:1.0:1746129562.753905:0:2271:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095275400/0x40a459093b068570 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 2271 initiator: MDT0 00010000:00010000:1.0:1746129562.753911:0:2271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009cffe800) 00010000:00010000:1.0:1746129562.753913:0:2271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129562.753915:0:2271:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095275400/0x40a459093b068570 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 2271 initiator: MDT0 00010000:00010000:1.0:1746129562.753920:0:2271:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095275400/0x40a459093b068570 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 2271 initiator: MDT0 00010000:00010000:1.0:1746129562.753952:0:2271:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095274e00/0x40a459093b068562 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2016e expref: 13 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129562.753963:0:2271:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095274c00/0x40a459093b068577 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2016e expref: 12 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129562.753969:0:2271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009f469400) 00010000:00010000:1.0:1746129562.753970:0:2271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746129562.753973:0:2271:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095274c00, rc 0) 00000100:00100000:1.0:1746129562.754010:0:2271:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f325c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:068dab75-d300-4ead-a742-d14572ad1e50+12:32026:x1830948733869696:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 9948us (10268us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129562.754017:0:2271:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11082 00000100:00100000:0.0:1746129562.756663:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129562.758594:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129562.758629:0:8411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733870976 00000100:00100000:0.0:1746129562.758632:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129562.758633:0:8411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733870976 00000100:00100000:1.0:1746129562.758661:0:8411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15549 00000100:00100000:1.0:1746129562.758666:0:8411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f327100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:068dab75-d300-4ead-a742-d14572ad1e50+9:1962:x1830948733870976:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:1.0:1746129562.758673:0:8411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129562.758680:0:8411:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095274200/0x40a459093b068585 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2017c expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129562.758720:0:8411:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094028700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8411:1830948737414016:192.168.202.4@tcp:106: 00000100:00100000:1.0:1746129562.758779:0:8411:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a6ce8a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746129562.758815:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129562.758846:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129562.763552:0:8411:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094028700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8411:1830948737414016:192.168.202.4@tcp:106: 00010000:00010000:1.0:1746129562.763895:0:8411:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095274200/0x40a459093b068585 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2017c expref: 11 pid: 8411 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129562.763910:0:8411:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095274200/0x40a459093b068585 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2017c expref: 11 pid: 8411 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129562.763941:0:8411:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095274200, rc 0) 00000100:00100000:1.0:1746129562.764000:0:8411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f327100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:068dab75-d300-4ead-a742-d14572ad1e50+10:1962:x1830948733870976:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 5332us (5406us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129562.764009:0:8411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15549 00000100:00100000:0.0:1746129562.766283:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129562.766815:0:2271:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733871616 00000100:00100000:1.0:1746129562.766825:0:2271:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733871616 00000100:00100000:1.0:1746129562.766883:0:2271:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11083 00000100:00100000:1.0:1746129562.766890:0:2271:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:068dab75-d300-4ead-a742-d14572ad1e50+12:32026:x1830948733871616:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:1.0:1746129562.766910:0:2271:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129562.766930:0:2271:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095275e00/0x40a459093b0685a1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20198 expref: -99 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129562.767031:0:2271:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880095274800/0x40a459093b0685a8 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 2271 initiator: MDT0 00010000:00010000:1.0:1746129562.767045:0:2271:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095274c00/0x40a459093b068577 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2016e expref: 13 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129562.767052:0:2271:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095274800/0x40a459093b0685a8 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:1.0:1746129562.767643:0:2271:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880095274c00/0x40a459093b068577 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2016e expref: 13 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129562.767655:0:2271:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880095274c00/0x40a459093b068577 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2016e expref: 13 pid: 2271 timeout: 918 lvb_type: 0 00000100:00100000:1.0:1746129562.767666:0:2271:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094028700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:2271:1830948737414144:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129562.767766:0:2271:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a6ce8a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746129562.769872:0:2271:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094028700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:2271:1830948737414144:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129562.769897:0:2271:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880095274800/0x40a459093b0685a8 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00000100:00100000:0.0:1746129562.771113:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00010000:00010000:1.0:1746129562.773651:0:2271:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880095274800/0x40a459093b0685a8 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00010000:00010000:1.0:1746129562.773658:0:2271:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095274800/0x40a459093b0685a8 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00000004:00200000:1.0:1746129562.773683:0:2271:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:1.0:1746129562.773835:0:2271:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095275e00/0x40a459093b0685a1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20198 expref: 14 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129562.773851:0:2271:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095274800/0x40a459093b0685a8 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20198 expref: 13 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129562.773859:0:2271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009f469400) 00010000:00010000:1.0:1746129562.773861:0:2271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746129562.773864:0:2271:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095274800, rc 0) 00000100:00100000:1.0:1746129562.773890:0:2271:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:068dab75-d300-4ead-a742-d14572ad1e50+13:32026:x1830948733871616:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 7001us (7616us total) trans 8589945152 rc 0/0 00000100:00100000:1.0:1746129562.773897:0:2271:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11083 00000100:00100000:0.0:1746129562.776540:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129562.776742:0:2271:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733871872 00000100:00100000:1.0:1746129562.776753:0:2271:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733871872 00000100:00100000:1.0:1746129562.776814:0:2271:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11084 00000100:00100000:1.0:1746129562.776823:0:2271:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:068dab75-d300-4ead-a742-d14572ad1e50+13:32026:x1830948733871872:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:1.0:1746129562.776850:0:2271:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129562.777091:0:2271:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095275a00/0x40a459093b0685b6 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2019f expref: -99 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129562.777182:0:2271:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095274200/0x40a459093b0685bd lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 2271 initiator: MDT0 00010000:00010000:1.0:1746129562.777197:0:2271:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095274800/0x40a459093b0685a8 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20198 expref: 14 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129562.777203:0:2271:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095274200/0x40a459093b0685bd lrc: 4/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:1.0:1746129562.777238:0:2271:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880095274800/0x40a459093b0685a8 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20198 expref: 14 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129562.777249:0:2271:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880095274800/0x40a459093b0685a8 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20198 expref: 14 pid: 2271 timeout: 918 lvb_type: 0 00000100:00100000:1.0:1746129562.777262:0:2271:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094028700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:2271:1830948737414272:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129562.779542:0:2271:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a6ce8a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746129562.785538:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129562.785765:0:20578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733872000 00000100:00100000:1.0:1746129562.785774:0:20578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733872000 00010000:00010000:1.0:1746129562.785818:0:20578:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095274800/0x40a459093b0685a8 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20198 expref: 15 pid: 2271 timeout: 918 lvb_type: 0 00000100:00100000:1.0:1746129562.785861:0:20578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7928 00000100:00100000:1.0:1746129562.785869:0:20578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947bd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:068dab75-d300-4ead-a742-d14572ad1e50+15:1963:x1830948733872000:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129562.785882:0:20578:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129562.785888:0:20578:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880095274800/0x40a459093b0685a8 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20198 expref: 15 pid: 2271 timeout: 918 lvb_type: 0 00010000:00010000:1.0:1746129562.785900:0:20578:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880095274800/0x40a459093b0685a8 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20198 expref: 15 pid: 2271 timeout: 918 lvb_type: 0 00010000:00010000:1.0:1746129562.785924:0:20578:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095274800/0x40a459093b0685a8 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20198 expref: 15 pid: 2271 timeout: 918 lvb_type: 0 00010000:00010000:1.0:1746129562.785960:0:20578:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009f469400) 00010000:00010000:1.0:1746129562.785964:0:20578:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880095274200/0x40a459093b0685bd lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00010000:00010000:1.0:1746129562.785983:0:20578:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095274200/0x40a459093b0685bd lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 2271 initiator: MDT0 00010000:00010000:1.0:1746129562.785990:0:20578:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095274200/0x40a459093b0685bd lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 2271 initiator: MDT0 00010000:00010000:1.0:1746129562.786012:0:20578:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129562.787107:0:20578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947bd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:068dab75-d300-4ead-a742-d14572ad1e50+14:1963:x1830948733872000:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 1231us (1571us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129562.787116:0:20578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7928 00000100:00100000:0.0:1746129562.796177:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129562.798774:0:8411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733872128 00000100:00100000:1.0:1746129562.798789:0:8411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733872128 00000100:00100000:1.0:1746129562.798862:0:8411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15553 00000100:00100000:1.0:1746129562.798871:0:8411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:068dab75-d300-4ead-a742-d14572ad1e50+10:1960:x1830948733872128:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:1.0:1746129562.798892:0:8411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129562.798911:0:8411:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095275600/0x40a459093b0685c4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f201a6 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129562.798974:0:8411:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094029880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8411:1830948737414400:192.168.202.4@tcp:106: 00000100:00100000:1.0:1746129562.799071:0:8411:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a6ce8000 going to sleep for 11 seconds 00000100:00100000:1.0:1746129562.803868:0:8411:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094029880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8411:1830948737414400:192.168.202.4@tcp:106: 00010000:00010000:1.0:1746129562.803911:0:8411:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095275600/0x40a459093b0685c4 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f201a6 expref: 11 pid: 8411 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129562.803927:0:8411:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095275600/0x40a459093b0685c4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f201a6 expref: 11 pid: 8411 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129562.803969:0:8411:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095275600, rc 0) 00000100:00100000:1.0:1746129562.804043:0:8411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:068dab75-d300-4ead-a742-d14572ad1e50+10:1960:x1830948733872128:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 5173us (7876us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129562.804053:0:8411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15553 00000100:00100000:0.0:1746129562.806418:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129562.814554:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129562.817654:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129562.817697:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129562.817735:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129562.817749:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129562.817775:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129562.817803:0:8411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733872512 00000100:00100000:0.0:1746129562.817803:0:8412:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733872640 00000100:00100000:1.0:1746129562.817812:0:8411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733872512 00000100:00100000:0.0:1746129562.817812:0:8412:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733872640 00000100:00100000:0.0:1746129562.817850:0:8412:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733872768 00000100:00100000:0.0:1746129562.817852:0:8412:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733872768 00000100:00100000:0.0:1746129562.817861:0:8412:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733873024 00000100:00100000:0.0:1746129562.817863:0:8412:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733873024 00000100:00100000:0.0:1746129562.817872:0:8412:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733872896 00000100:00100000:0.0:1746129562.817874:0:8412:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733872896 00000100:00100000:0.0:1746129562.817883:0:8412:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733873152 00000100:00100000:0.0:1746129562.817885:0:8412:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733873152 00000100:00100000:0.0:1746129562.817899:0:8412:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15554 00000100:00100000:0.0:1746129562.817906:0:8412:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:068dab75-d300-4ead-a742-d14572ad1e50+12:1963:x1830948733872640:12345-192.168.202.4@tcp:1:lfs.0 00010000:00010000:0.0:1746129562.817955:0:8412:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009c461e00/0x40a459093b0685e0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129562.817974:0:8412:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ee1aa00/0x40a459093b068497 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f200db expref: 32 pid: 8411 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129562.817982:0:8412:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e3a5c00/0x40a459093b06857e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20175 expref: 12 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129562.817995:0:8412:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094feee00/0x40a459093b0684c1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f200e9 expref: 25 pid: 8411 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129562.818002:0:8412:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129562.818004:0:8412:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129562.818007:0:8412:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c461e00/0x40a459093b0685e0 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129562.818040:0:8412:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094feee00/0x40a459093b0684c1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f200e9 expref: 25 pid: 8411 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129562.818052:0:8412:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094feee00/0x40a459093b0684c1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f200e9 expref: 25 pid: 8411 timeout: 918 lvb_type: 1 00000100:00100000:0.0:1746129562.818066:0:8412:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8412:1830948737414528:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129562.818146:0:8412:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012e3a5c00/0x40a459093b06857e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20175 expref: 12 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129562.818153:0:8412:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012e3a5c00/0x40a459093b06857e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20175 expref: 12 pid: 7148 timeout: 918 lvb_type: 1 00000100:00100000:0.0:1746129562.818160:0:8412:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8412:1830948737414656:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129562.818179:0:8412:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ee1aa00/0x40a459093b068497 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f200db expref: 32 pid: 8411 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129562.818190:0:8412:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ee1aa00/0x40a459093b068497 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f200db expref: 32 pid: 8411 timeout: 918 lvb_type: 0 00000100:00100000:0.0:1746129562.818196:0:8412:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8412:1830948737414784:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129562.818207:0:8412:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093da8900 going to sleep for 11 seconds 00000100:00100000:0.0:1746129562.818226:0:4699:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15555 00000100:00100000:0.0:1746129562.818230:0:4699:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:068dab75-d300-4ead-a742-d14572ad1e50+13:1962:x1830948733872512:12345-192.168.202.4@tcp:1:lfs.0 00010000:00010000:0.0:1746129562.818250:0:4699:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a6caec00/0x40a459093b0685e7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129562.818260:0:4699:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ebfce00/0x40a459093b068045 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f1fe73 expref: 13 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129562.818266:0:4699:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c031400/0x40a459093b068133 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f1fec7 expref: 16 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129562.818272:0:4699:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012e94c000/0x40a459093b0680df lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f1feb2 expref: 29 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129562.818277:0:4699:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129562.818279:0:4699:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129562.818281:0:4699:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6caec00/0x40a459093b0685e7 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129562.818314:0:4699:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012e94c000/0x40a459093b0680df lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1feb2 expref: 29 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129562.818322:0:4699:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012e94c000/0x40a459093b0680df lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1feb2 expref: 29 pid: 4385 timeout: 918 lvb_type: 0 00000100:00100000:0.0:1746129562.818331:0:4699:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4699:1830948737414912:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129562.818347:0:8410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15556 00000100:00100000:1.0:1746129562.818354:0:8410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:068dab75-d300-4ead-a742-d14572ad1e50+12:1962:x1830948733872768:12345-192.168.202.4@tcp:1:lfs.0 00010000:00010000:1.0:1746129562.818372:0:8410:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880095274000/0x40a459093b0685ee lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129562.818382:0:8410:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb26a00/0x40a459093b06852a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1392640->1404927) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20136 expref: 25 pid: 8411 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129562.818394:0:4699:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c031400/0x40a459093b068133 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fec7 expref: 16 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129562.818399:0:8410:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129562.818400:0:8410:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129562.818402:0:4699:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c031400/0x40a459093b068133 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fec7 expref: 16 pid: 8412 timeout: 918 lvb_type: 0 00010000:00010000:1.0:1746129562.818403:0:8410:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095274000/0x40a459093b0685ee lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129562.818410:0:4699:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095624000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4699:1830948737415040:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129562.818418:0:8410:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb26a00/0x40a459093b06852a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1392640->1404927) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20136 expref: 25 pid: 8411 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129562.818427:0:8410:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb26a00/0x40a459093b06852a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1392640->1404927) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20136 expref: 25 pid: 8411 timeout: 918 lvb_type: 0 00000100:00100000:1.0:1746129562.818435:0:8410:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094029880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8410:1830948737415168:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129562.818437:0:4699:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012ebfce00/0x40a459093b068045 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fe73 expref: 13 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129562.818444:0:4699:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012ebfce00/0x40a459093b068045 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fe73 expref: 13 pid: 22481 timeout: 918 lvb_type: 1 00000100:00100000:0.0:1746129562.818451:0:4699:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095624380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4699:1830948737415296:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129562.818460:0:8410:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a6ce8000 going to sleep for 11 seconds 00000100:00100000:0.0:1746129562.818468:0:4699:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093da89c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746129562.818476:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15557 00000100:00100000:1.0:1746129562.818482:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:068dab75-d300-4ead-a742-d14572ad1e50+13:1962:x1830948733873024:12345-192.168.202.4@tcp:1:lfs.0 00010000:00010000:1.0:1746129562.818500:0:4385:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880095274a00/0x40a459093b0685f5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129562.818511:0:4385:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090079a00/0x40a459093b068515 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2012f expref: 16 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129562.818518:0:4385:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012e3a4e00/0x40a459093b068593 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2018a expref: 13 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129562.818526:0:4385:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c4ed400/0x40a459093b068531 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2013d expref: 29 pid: 8411 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129562.818531:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129562.818532:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129562.818534:0:4385:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095274a00/0x40a459093b0685f5 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129562.818548:0:4385:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c4ed400/0x40a459093b068531 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2013d expref: 29 pid: 8411 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129562.818557:0:4385:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c4ed400/0x40a459093b068531 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2013d expref: 29 pid: 8411 timeout: 918 lvb_type: 0 00000100:00100000:1.0:1746129562.818566:0:4385:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094028000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:4385:1830948737415424:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129562.818593:0:4385:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012e3a4e00/0x40a459093b068593 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2018a expref: 13 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129562.818601:0:4385:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012e3a4e00/0x40a459093b068593 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2018a expref: 13 pid: 7148 timeout: 918 lvb_type: 1 00000100:00100000:1.0:1746129562.818608:0:4385:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009402b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:4385:1830948737415552:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129562.818629:0:4385:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090079a00/0x40a459093b068515 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2012f expref: 16 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129562.818638:0:4385:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090079a00/0x40a459093b068515 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2012f expref: 16 pid: 22481 timeout: 918 lvb_type: 0 00000100:00100000:1.0:1746129562.818645:0:4385:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094028700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:4385:1830948737415680:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129562.818662:0:8411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15558 00000100:00100000:1.0:1746129562.818666:0:4385:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a6ce8240 going to sleep for 11 seconds 00000100:00100000:0.0:1746129562.818668:0:8411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:068dab75-d300-4ead-a742-d14572ad1e50+13:1963:x1830948733872896:12345-192.168.202.4@tcp:1:lfs.0 00010000:00010000:0.0:1746129562.818684:0:8411:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880136056400/0x40a459093b0685fc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129562.820144:0:8411:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090078800/0x40a459093b0684e4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2010c expref: 29 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129562.820154:0:8411:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012e3a5400/0x40a459093b06858c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20183 expref: 13 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129562.820160:0:8411:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095275200/0x40a459093b06854d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20159 expref: 16 pid: 8411 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129562.820165:0:8411:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129562.820167:0:8411:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129562.820170:0:8411:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136056400/0x40a459093b0685fc lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129562.820192:0:8411:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095275200/0x40a459093b06854d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20159 expref: 16 pid: 8411 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129562.820201:0:8411:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095275200/0x40a459093b06854d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20159 expref: 16 pid: 8411 timeout: 918 lvb_type: 1 00000100:00100000:0.0:1746129562.820211:0:8411:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095624700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8411:1830948737416192:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129562.820285:0:8411:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012e3a5400/0x40a459093b06858c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20183 expref: 13 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129562.820305:0:8411:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012e3a5400/0x40a459093b06858c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20183 expref: 13 pid: 7148 timeout: 918 lvb_type: 1 00000100:00100000:0.0:1746129562.820317:0:8411:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095624a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8411:1830948737416320:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129562.820353:0:8411:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090078800/0x40a459093b0684e4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2010c expref: 29 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129562.820361:0:8411:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090078800/0x40a459093b0684e4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2010c expref: 29 pid: 22481 timeout: 918 lvb_type: 0 00000100:00100000:0.0:1746129562.820369:0:8411:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095624e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8411:1830948737416448:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129562.820383:0:8411:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093da8e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746129562.825166:0:4385:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094028000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:4385:1830948737415424:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129562.825180:0:4385:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009402b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:4385:1830948737415552:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129562.825424:0:4699:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4699:1830948737414912:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129562.825434:0:4699:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095624000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4699:1830948737415040:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129562.825441:0:4699:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095624380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4699:1830948737415296:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129562.825467:0:4699:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800a6caec00/0x40a459093b0685e7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129562.835596:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129562.836808:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129562.836829:0:14547:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733875200 00000100:00100000:0.0:1746129562.836832:0:14547:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733875200 00000100:00100000:0.0:1746129562.836861:0:14547:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11086 00000100:00100000:0.0:1746129562.836866:0:14547:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095625500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ada2ffba-8920-4ecb-8068-68caa9806978+304:32030:x1830948733875200:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:0.0:1746129562.836881:0:14547:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129562.836896:0:14547:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136056200/0x40a459093b06860a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f201b4 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129562.836981:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136056600/0x40a459093b068611 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129562.836997:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880136056600/0x40a459093b068611 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129562.837007:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136056600/0x40a459093b068611 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129562.837018:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136057800/0x40a459093b068618 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129562.837022:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880136057800/0x40a459093b068618 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129562.837027:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136057800/0x40a459093b068618 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129562.837123:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880095eec000/0x40a459093b06861f lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129562.837133:0:14547:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea5e000/0x40a459093b0685d2 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f201ad expref: 14 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129562.837139:0:14547:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095eec000/0x40a459093b06861f lrc: 4/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129562.837169:0:14547:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea5e000/0x40a459093b0685d2 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f201ad expref: 14 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129562.837177:0:14547:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea5e000/0x40a459093b0685d2 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f201ad expref: 14 pid: 2271 timeout: 918 lvb_type: 0 00000100:00100000:0.0:1746129562.837188:0:14547:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095625880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14547:1830948737416576:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129562.837255:0:14547:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093da8cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129562.837283:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129562.837360:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129562.837374:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129562.837400:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129562.837413:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129562.837428:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733873792 00000100:00100000:0.0:1746129562.837431:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733873792 00010000:00010000:0.0:1746129562.837454:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012ebfce00/0x40a459093b068045 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fe73 expref: 14 pid: 22481 timeout: 918 lvb_type: 1 00000100:00100000:0.0:1746129562.837470:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733873280 00000100:00100000:0.0:1746129562.837472:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733873280 00010000:00010000:0.0:1746129562.837483:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012e3a5c00/0x40a459093b06857e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20175 expref: 13 pid: 7148 timeout: 918 lvb_type: 1 00000100:00100000:0.0:1746129562.837492:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733873664 00000100:00100000:0.0:1746129562.837493:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733873664 00010000:00010000:0.0:1746129562.837501:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c031400/0x40a459093b068133 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fec7 expref: 17 pid: 8412 timeout: 918 lvb_type: 0 00000100:00100000:0.0:1746129562.837508:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733873408 00000100:00100000:0.0:1746129562.837510:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733873408 00010000:00010000:0.0:1746129562.837531:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ee1aa00/0x40a459093b068497 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f200db expref: 33 pid: 8411 timeout: 918 lvb_type: 0 00000100:00100000:0.0:1746129562.837539:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733874176 00000100:00100000:0.0:1746129562.837541:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733874176 00010000:00010000:0.0:1746129562.837551:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012e94c000/0x40a459093b0680df lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1feb2 expref: 30 pid: 4385 timeout: 918 lvb_type: 0 00000100:00100000:0.0:1746129562.837566:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7929 00000100:00100000:0.0:1746129562.837570:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095625c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:068dab75-d300-4ead-a742-d14572ad1e50+14:1961:x1830948733873792:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129562.837579:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129562.837596:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012ebfce00/0x40a459093b068045 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fe73 expref: 14 pid: 22481 timeout: 918 lvb_type: 1 00010000:00010000:0.0:1746129562.837606:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012ebfce00/0x40a459093b068045 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fe73 expref: 14 pid: 22481 timeout: 918 lvb_type: 1 00010000:00010000:0.0:1746129562.837623:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ebfce00/0x40a459093b068045 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fe73 expref: 14 pid: 22481 timeout: 918 lvb_type: 1 00010000:00010000:0.0:1746129562.837649:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129562.837669:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095625c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:068dab75-d300-4ead-a742-d14572ad1e50+13:1961:x1830948733873792:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 98us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129562.837675:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7929 00000100:00100000:0.0:1746129562.837691:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7930 00000100:00100000:0.0:1746129562.837695:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a46050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:068dab75-d300-4ead-a742-d14572ad1e50+13:1962:x1830948733873280:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129562.837703:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129562.837714:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012e3a5c00/0x40a459093b06857e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20175 expref: 13 pid: 7148 timeout: 918 lvb_type: 1 00010000:00010000:0.0:1746129562.837721:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012e3a5c00/0x40a459093b06857e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20175 expref: 13 pid: 7148 timeout: 918 lvb_type: 1 00010000:00010000:0.0:1746129562.837737:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e3a5c00/0x40a459093b06857e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20175 expref: 13 pid: 7148 timeout: 918 lvb_type: 1 00010000:00010000:0.0:1746129562.837746:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129562.837757:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a46050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:068dab75-d300-4ead-a742-d14572ad1e50+12:1962:x1830948733873280:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 62us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129562.837762:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7930 00000100:00100000:0.0:1746129562.837792:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7931 00000100:00100000:0.0:1746129562.837796:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095625f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+17:1962:x1830948733873664:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129562.837802:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129562.837809:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c031400/0x40a459093b068133 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fec7 expref: 17 pid: 8412 timeout: 918 lvb_type: 0 00010000:00010000:0.0:1746129562.837816:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c031400/0x40a459093b068133 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fec7 expref: 17 pid: 8412 timeout: 918 lvb_type: 0 00010000:00010000:0.0:1746129562.837827:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c031400/0x40a459093b068133 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fec7 expref: 17 pid: 8412 timeout: 918 lvb_type: 0 00010000:00010000:0.0:1746129562.837834:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129562.837846:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095625f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+16:1962:x1830948733873664:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 50us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129562.837851:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7931 00000100:00100000:0.0:1746129562.837861:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7932 00000100:00100000:0.0:1746129562.837866:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095626300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ada2ffba-8920-4ecb-8068-68caa9806978+33:1962:x1830948733873408:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129562.837871:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129562.837878:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ee1aa00/0x40a459093b068497 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f200db expref: 33 pid: 8411 timeout: 918 lvb_type: 0 00010000:00010000:0.0:1746129562.837885:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ee1aa00/0x40a459093b068497 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f200db expref: 33 pid: 8411 timeout: 918 lvb_type: 0 00010000:00010000:0.0:1746129562.837896:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ee1aa00/0x40a459093b068497 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f200db expref: 33 pid: 8411 timeout: 918 lvb_type: 0 00010000:00010000:0.0:1746129562.837903:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129562.837915:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095626300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ada2ffba-8920-4ecb-8068-68caa9806978+32:1962:x1830948733873408:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 50us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129562.837920:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7932 00000100:00100000:0.0:1746129562.837931:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7933 00000100:00100000:0.0:1746129562.837935:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095626680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ada2ffba-8920-4ecb-8068-68caa9806978+30:1962:x1830948733874176:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129562.837940:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129562.837946:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012e94c000/0x40a459093b0680df lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1feb2 expref: 30 pid: 4385 timeout: 918 lvb_type: 0 00010000:00010000:0.0:1746129562.837953:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012e94c000/0x40a459093b0680df lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1feb2 expref: 30 pid: 4385 timeout: 918 lvb_type: 0 00010000:00010000:0.0:1746129562.837963:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e94c000/0x40a459093b0680df lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1feb2 expref: 30 pid: 4385 timeout: 918 lvb_type: 0 00010000:00010000:0.0:1746129562.837975:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129562.837977:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129562.837981:0:7085:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a6caec00/0x40a459093b0685e7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129562.837988:0:7085:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6caec00/0x40a459093b0685e7 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129562.838004:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129562.838018:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095626680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ada2ffba-8920-4ecb-8068-68caa9806978+29:1962:x1830948733874176:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 83us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129562.838023:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7933 00000100:00100000:0.0:1746129562.838082:0:4385:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094028700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:4385:1830948737415680:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129562.838105:0:4385:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880095274a00/0x40a459093b0685f5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129562.838142:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129562.838154:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733873536 00000100:00100000:0.0:1746129562.838157:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733873536 00010000:00010000:0.0:1746129562.838168:0:9823:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094feee00/0x40a459093b0684c1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f200e9 expref: 27 pid: 8411 timeout: 918 lvb_type: 1 00000100:00100000:0.0:1746129562.838180:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7934 00000100:00100000:0.0:1746129562.838184:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095625c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+27:1961:x1830948733873536:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129562.838190:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129562.838197:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094feee00/0x40a459093b0684c1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f200e9 expref: 27 pid: 8411 timeout: 918 lvb_type: 1 00010000:00010000:0.0:1746129562.838206:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094feee00/0x40a459093b0684c1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f200e9 expref: 27 pid: 8411 timeout: 918 lvb_type: 1 00010000:00010000:0.0:1746129562.838217:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094feee00/0x40a459093b0684c1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f200e9 expref: 27 pid: 8411 timeout: 918 lvb_type: 1 00010000:00010000:0.0:1746129562.838225:0:9823:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129562.838227:0:9823:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129562.838230:0:9823:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c461e00/0x40a459093b0685e0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129562.838236:0:9823:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c461e00/0x40a459093b0685e0 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129562.838248:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129562.838261:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095625c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+26:1961:x1830948733873536:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 76us (119us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129562.838265:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7934 00000100:00100000:0.0:1746129562.838315:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129562.838326:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733873920 00000100:00100000:0.0:1746129562.838329:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733873920 00010000:00010000:0.0:1746129562.838338:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012e3a4e00/0x40a459093b068593 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2018a expref: 13 pid: 7148 timeout: 918 lvb_type: 1 00000100:00100000:0.0:1746129562.838350:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7935 00000100:00100000:0.0:1746129562.838354:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095626a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:068dab75-d300-4ead-a742-d14572ad1e50+13:1961:x1830948733873920:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129562.838360:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129562.838369:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012e3a4e00/0x40a459093b068593 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2018a expref: 13 pid: 7148 timeout: 918 lvb_type: 1 00010000:00010000:0.0:1746129562.838376:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012e3a4e00/0x40a459093b068593 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2018a expref: 13 pid: 7148 timeout: 918 lvb_type: 1 00010000:00010000:0.0:1746129562.838395:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e3a4e00/0x40a459093b068593 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2018a expref: 13 pid: 7148 timeout: 918 lvb_type: 1 00010000:00010000:0.0:1746129562.838405:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129562.838418:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095626a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:068dab75-d300-4ead-a742-d14572ad1e50+12:1961:x1830948733873920:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 63us (102us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129562.838423:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7935 00000100:00100000:0.0:1746129562.838461:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129562.838468:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733874304 00000100:00100000:0.0:1746129562.838471:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733874304 00010000:00010000:0.0:1746129562.838479:0:9823:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c4ed400/0x40a459093b068531 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2013d expref: 29 pid: 8411 timeout: 918 lvb_type: 0 00000100:00100000:0.0:1746129562.838490:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7936 00000100:00100000:0.0:1746129562.838494:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095626d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ada2ffba-8920-4ecb-8068-68caa9806978+29:1962:x1830948733874304:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129562.838499:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129562.838506:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c4ed400/0x40a459093b068531 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2013d expref: 29 pid: 8411 timeout: 918 lvb_type: 0 00010000:00010000:0.0:1746129562.838518:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c4ed400/0x40a459093b068531 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2013d expref: 29 pid: 8411 timeout: 918 lvb_type: 0 00010000:00010000:0.0:1746129562.838526:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c4ed400/0x40a459093b068531 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2013d expref: 29 pid: 8411 timeout: 918 lvb_type: 0 00010000:00010000:0.0:1746129562.838536:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129562.838550:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095626d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ada2ffba-8920-4ecb-8068-68caa9806978+28:1962:x1830948733874304:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 55us (88us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129562.838554:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7936 00000100:00100000:0.0:1746129562.838589:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129562.838598:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733874432 00000100:00100000:0.0:1746129562.838601:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733874432 00010000:00010000:0.0:1746129562.838611:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880134b09000/0x40a459093b06853f lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2014b expref: 32 pid: 8411 timeout: 918 lvb_type: 0 00000100:00100000:0.0:1746129562.838624:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7937 00000100:00100000:0.0:1746129562.838628:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a45c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ada2ffba-8920-4ecb-8068-68caa9806978+32:1960:x1830948733874432:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129562.838634:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746129562.840443:0:8410:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094029880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8410:1830948737415168:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129562.840462:0:8410:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880095274000/0x40a459093b0685ee lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129562.840486:0:4699:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a6caec00/0x40a459093b0685e7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129562.840493:0:4699:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a6caec00/0x40a459093b0685e7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129562.840511:0:4699:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a6caec00/0x40a459093b0685e7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129562.840518:0:4699:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6caec00/0x40a459093b0685e7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129562.840524:0:4699:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a6caec00/0x40a459093b0685e7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129562.840529:0:4699:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a6caec00 already unused, calling callback (ffffffffa086ed70) 00010000:00010000:1.0:1746129562.840532:0:4699:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a6caec00/0x40a459093b0685e7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129562.840538:0:4699:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a6caec00/0x40a459093b0685e7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129562.840547:0:4699:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a6caec00/0x40a459093b0685e7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129562.840553:0:4699:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a6caec00/0x40a459093b0685e7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129562.840598:0:4699:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:068dab75-d300-4ead-a742-d14572ad1e50+11:1962:x1830948733872512:12345-192.168.202.4@tcp:1:lfs.0 Request processed in 22367us (26056us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129562.842792:0:4699:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15555 00000100:00100000:1.0:1746129562.842962:0:8411:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095624700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8411:1830948737416192:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129562.842996:0:8411:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095624a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8411:1830948737416320:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129562.843019:0:8411:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095624e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8411:1830948737416448:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129562.843043:0:8411:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880136056400/0x40a459093b0685fc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129562.843076:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129562.843091:0:20578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733874688 00000100:00100000:1.0:1746129562.843097:0:20578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733874688 00010000:00010000:1.0:1746129562.843125:0:20578:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090079a00/0x40a459093b068515 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2012f expref: 16 pid: 22481 timeout: 918 lvb_type: 0 00000100:00100000:1.0:1746129562.843146:0:20578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7938 00000100:00100000:1.0:1746129562.843151:0:20578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094029880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+16:1960:x1830948733874688:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129562.843166:0:20578:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129562.843188:0:20578:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090079a00/0x40a459093b068515 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2012f expref: 16 pid: 22481 timeout: 918 lvb_type: 0 00010000:00010000:1.0:1746129562.843199:0:20578:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090079a00/0x40a459093b068515 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2012f expref: 16 pid: 22481 timeout: 918 lvb_type: 0 00010000:00010000:1.0:1746129562.843226:0:20578:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090079a00/0x40a459093b068515 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2012f expref: 16 pid: 22481 timeout: 918 lvb_type: 0 00010000:00010000:1.0:1746129562.843239:0:20578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129562.843240:0:20578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129562.843245:0:20578:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880095274a00/0x40a459093b0685f5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129562.843253:0:20578:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095274a00/0x40a459093b0685f5 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129562.843272:0:20578:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129562.843311:0:20578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094029880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+15:1960:x1830948733874688:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 142us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129562.843316:0:20578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7938 00010000:00010000:1.0:1746129562.843330:0:4385:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880095274a00/0x40a459093b0685f5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129562.843337:0:4385:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095274a00/0x40a459093b0685f5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129562.843354:0:4385:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880095274a00/0x40a459093b0685f5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129562.843360:0:4385:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880095274a00/0x40a459093b0685f5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129562.843371:0:4385:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880095274a00/0x40a459093b0685f5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129562.843376:0:4385:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095274a00 already unused, calling callback (ffffffffa086ed70) 00010000:00010000:1.0:1746129562.843380:0:4385:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880095274a00/0x40a459093b0685f5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129562.843396:0:4385:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880095274a00/0x40a459093b0685f5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129562.843404:0:4385:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880095274a00/0x40a459093b0685f5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129562.843408:0:4385:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095274a00/0x40a459093b0685f5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129562.843438:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:068dab75-d300-4ead-a742-d14572ad1e50+10:1962:x1830948733873024:12345-192.168.202.4@tcp:1:lfs.0 Request processed in 24957us (25702us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129562.843445:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15557 00000100:00100000:1.0:1746129562.843477:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129562.843488:0:7086:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733874944 00000100:00100000:1.0:1746129562.843491:0:7086:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733874944 00010000:00010000:1.0:1746129562.843500:0:7086:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012e3a5400/0x40a459093b06858c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20183 expref: 10 pid: 7148 timeout: 918 lvb_type: 1 00000100:00100000:1.0:1746129562.843513:0:7086:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7939 00000100:00100000:1.0:1746129562.843518:0:7086:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094028700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:068dab75-d300-4ead-a742-d14572ad1e50+10:1960:x1830948733874944:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129562.843525:0:7086:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129562.843534:0:7086:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012e3a5400/0x40a459093b06858c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20183 expref: 10 pid: 7148 timeout: 918 lvb_type: 1 00010000:00010000:1.0:1746129562.843541:0:7086:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012e3a5400/0x40a459093b06858c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20183 expref: 10 pid: 7148 timeout: 918 lvb_type: 1 00010000:00010000:1.0:1746129562.843552:0:7086:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e3a5400/0x40a459093b06858c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20183 expref: 10 pid: 7148 timeout: 918 lvb_type: 1 00010000:00010000:1.0:1746129562.843562:0:7086:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129562.843572:0:7086:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094028700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:068dab75-d300-4ead-a742-d14572ad1e50+9:1960:x1830948733874944:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 54us (95us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129562.843578:0:7086:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7939 00000100:00100000:1.0:1746129562.843606:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129562.843616:0:20578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733874560 00000100:00100000:1.0:1746129562.843618:0:20578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733874560 00010000:00010000:1.0:1746129562.843630:0:20578:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012e3a5200/0x40a459093b06859a lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20191 expref: 11 pid: 7148 timeout: 918 lvb_type: 1 00000100:00100000:1.0:1746129562.843643:0:20578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7940 00000100:00100000:1.0:1746129562.843647:0:20578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009402b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:068dab75-d300-4ead-a742-d14572ad1e50+11:1960:x1830948733874560:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129562.843655:0:20578:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129562.843669:0:20578:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012e3a5200/0x40a459093b06859a lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20191 expref: 11 pid: 7148 timeout: 918 lvb_type: 1 00010000:00010000:1.0:1746129562.843680:0:20578:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012e3a5200/0x40a459093b06859a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20191 expref: 11 pid: 7148 timeout: 918 lvb_type: 1 00010000:00010000:1.0:1746129562.843691:0:20578:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129562.843701:0:20578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009402b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:068dab75-d300-4ead-a742-d14572ad1e50+11:1960:x1830948733874560:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 54us (95us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129562.843706:0:20578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7940 00010000:00010000:0.0:1746129562.843757:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880134b09000/0x40a459093b06853f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2014b expref: 32 pid: 8411 timeout: 918 lvb_type: 0 00010000:00010000:0.0:1746129562.843768:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880134b09000/0x40a459093b06853f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2014b expref: 32 pid: 8411 timeout: 918 lvb_type: 0 00010000:00010000:0.0:1746129562.843784:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880134b09000/0x40a459093b06853f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2014b expref: 32 pid: 8411 timeout: 918 lvb_type: 0 00010000:00010000:0.0:1746129562.843794:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129562.843810:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a45c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ada2ffba-8920-4ecb-8068-68caa9806978+31:1960:x1830948733874432:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 5182us (5222us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129562.843817:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7937 00000100:00100000:1.0:1746129562.843860:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129562.843873:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733874816 00000100:00100000:1.0:1746129562.843876:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733874816 00010000:00010000:1.0:1746129562.843889:0:9823:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095275200/0x40a459093b06854d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20159 expref: 15 pid: 8411 timeout: 918 lvb_type: 1 00000100:00100000:1.0:1746129562.843915:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7941 00000100:00100000:1.0:1746129562.843920:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094028000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+15:1960:x1830948733874816:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129562.843927:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746129562.843934:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00010000:00010000:1.0:1746129562.843935:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095275200/0x40a459093b06854d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20159 expref: 15 pid: 8411 timeout: 918 lvb_type: 1 00010000:00010000:1.0:1746129562.843942:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095275200/0x40a459093b06854d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20159 expref: 15 pid: 8411 timeout: 918 lvb_type: 1 00000100:00100000:0.0:1746129562.843944:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733875328 00000100:00100000:0.0:1746129562.843947:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733875328 00010000:00010000:1.0:1746129562.843951:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095275200/0x40a459093b06854d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20159 expref: 15 pid: 8411 timeout: 918 lvb_type: 1 00010000:00010000:0.0:1746129562.843958:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090078800/0x40a459093b0684e4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2010c expref: 28 pid: 22481 timeout: 918 lvb_type: 0 00010000:00010000:1.0:1746129562.843961:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129562.843970:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7942 00000100:00100000:1.0:1746129562.843973:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094028000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+14:1960:x1830948733874816:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 53us (114us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129562.843974:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095625f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ada2ffba-8920-4ecb-8068-68caa9806978+28:1963:x1830948733875328:12345-192.168.202.4@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746129562.843978:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7941 00010000:00010000:0.0:1746129562.843980:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129562.843987:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090078800/0x40a459093b0684e4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2010c expref: 28 pid: 22481 timeout: 918 lvb_type: 0 00010000:00010000:0.0:1746129562.843994:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090078800/0x40a459093b0684e4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2010c expref: 28 pid: 22481 timeout: 918 lvb_type: 0 00010000:00010000:0.0:1746129562.844005:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090078800/0x40a459093b0684e4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2010c expref: 28 pid: 22481 timeout: 918 lvb_type: 0 00000100:00100000:1.0:1746129562.844006:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129562.844015:0:7086:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733875456 00000100:00100000:1.0:1746129562.844017:0:7086:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733875456 00010000:00010000:0.0:1746129562.844020:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129562.844022:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129562.844024:0:7085:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880136056400/0x40a459093b0685fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129562.844027:0:7086:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880134b09a00/0x40a459093b068538 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20144 expref: 27 pid: 8411 timeout: 918 lvb_type: 0 00010000:00010000:0.0:1746129562.844030:0:7085:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136056400/0x40a459093b0685fc lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129562.844038:0:7086:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7943 00010000:00010000:0.0:1746129562.844041:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129562.844042:0:7086:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132c27b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+27:1960:x1830948733875456:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129562.844048:0:7086:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746129562.844050:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095625f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ada2ffba-8920-4ecb-8068-68caa9806978+27:1963:x1830948733875328:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 76us (117us total) trans 0 rc 0/0 00010000:00010000:1.0:1746129562.844054:0:7086:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880134b09a00/0x40a459093b068538 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20144 expref: 27 pid: 8411 timeout: 918 lvb_type: 0 00000100:00100000:0.0:1746129562.844055:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7942 00010000:00010000:1.0:1746129562.844062:0:7086:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880134b09a00/0x40a459093b068538 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20144 expref: 27 pid: 8411 timeout: 918 lvb_type: 0 00010000:00010000:1.0:1746129562.844073:0:7086:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129562.844074:0:7086:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129562.844076:0:7086:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e3a5e00/0x40a459093b068603 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129562.844082:0:7086:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e3a5e00/0x40a459093b068603 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129562.844097:0:7086:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129562.844107:0:7086:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132c27b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+27:1960:x1830948733875456:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 64us (101us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129562.844111:0:14547:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095625880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14547:1830948737416576:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129562.844112:0:7086:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7943 00010000:00010000:1.0:1746129562.844127:0:8411:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880136056400/0x40a459093b0685fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129562.844128:0:14547:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880095eec000/0x40a459093b06861f lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746129562.844133:0:8411:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136056400/0x40a459093b0685fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129562.844148:0:8411:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880136056400/0x40a459093b0685fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129562.844154:0:8411:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880136056400/0x40a459093b0685fc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129562.844159:0:8411:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880136056400/0x40a459093b0685fc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129562.844163:0:8411:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880136056400 already unused, calling callback (ffffffffa086ed70) 00000100:00100000:0.0:1746129562.844164:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00010000:00010000:1.0:1746129562.844166:0:8411:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880136056400/0x40a459093b0685fc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129562.844171:0:8411:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880136056400/0x40a459093b0685fc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129562.844184:0:8411:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880136056400/0x40a459093b0685fc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129562.844189:0:8411:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136056400/0x40a459093b0685fc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129562.844204:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733875584 00000100:00100000:1.0:1746129562.844207:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733875584 00010000:00010000:1.0:1746129562.844217:0:9823:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea5e000/0x40a459093b0685d2 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f201ad expref: 15 pid: 2271 timeout: 918 lvb_type: 0 00000100:00100000:1.0:1746129562.844229:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7944 00000100:00100000:1.0:1746129562.844233:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a45850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:068dab75-d300-4ead-a742-d14572ad1e50+15:1960:x1830948733875584:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129562.844240:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129562.844244:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea5e000/0x40a459093b0685d2 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f201ad expref: 15 pid: 2271 timeout: 918 lvb_type: 0 00010000:00010000:1.0:1746129562.844251:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea5e000/0x40a459093b0685d2 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f201ad expref: 15 pid: 2271 timeout: 918 lvb_type: 0 00010000:00010000:1.0:1746129562.844263:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea5e000/0x40a459093b0685d2 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f201ad expref: 15 pid: 2271 timeout: 918 lvb_type: 0 00010000:00010000:1.0:1746129562.844273:0:9823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009f469400) 00010000:00010000:1.0:1746129562.844277:0:9823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880095eec000/0x40a459093b06861f lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746129562.844290:0:9823:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095eec000/0x40a459093b06861f lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746129562.844320:0:9823:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095eec000/0x40a459093b06861f lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746129562.844333:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129562.844350:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a45850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:068dab75-d300-4ead-a742-d14572ad1e50+14:1960:x1830948733875584:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 116us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129562.844355:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7944 00000100:00100000:1.0:1746129562.844407:0:8411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:068dab75-d300-4ead-a742-d14572ad1e50+8:1963:x1830948733872896:12345-192.168.202.4@tcp:1:lfs.0 Request processed in 25740us (26656us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129562.844413:0:8411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15558 00010000:00010000:0.0:1746129562.844797:0:14547:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880095eec000/0x40a459093b06861f lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129562.844804:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095eec000/0x40a459093b06861f lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00000004:00200000:0.0:1746129562.844819:0:14547:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:0.0:1746129562.844925:0:14547:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880095eec000/0x40a459093b06861f lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129562.844931:0:14547:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095eec000/0x40a459093b06861f lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129562.844939:0:14547:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095eec000/0x40a459093b06861f lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129562.844942:0:14547:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095eec000 already unused, calling callback (ffffffffa136e690) 00010000:00010000:0.0:1746129562.844945:0:14547:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095eec000/0x40a459093b06861f lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129562.844949:0:14547:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095eec000/0x40a459093b06861f lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129562.844956:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009f469400) 00010000:00010000:0.0:1746129562.844958:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746129562.844960:0:14547:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095eec000/0x40a459093b06861f lrc: 2/0,0 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129562.844964:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095eec000/0x40a459093b06861f lrc: 0/0,0 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129562.844978:0:14547:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136056600/0x40a459093b068611 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129562.844983:0:14547:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136056600/0x40a459093b068611 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129562.844986:0:14547:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880136056600/0x40a459093b068611 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129562.844990:0:14547:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880136056600 already unused, calling callback (ffffffffa136e690) 00010000:00010000:0.0:1746129562.844992:0:14547:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136056600/0x40a459093b068611 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129562.844996:0:14547:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136056600/0x40a459093b068611 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129562.845006:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880132ef8f00) 00010000:00010000:0.0:1746129562.845008:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129562.845010:0:14547:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880136056600/0x40a459093b068611 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129562.845014:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136056600/0x40a459093b068611 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129562.845022:0:14547:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136057800/0x40a459093b068618 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129562.845026:0:14547:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136057800/0x40a459093b068618 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129562.845030:0:14547:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880136057800/0x40a459093b068618 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129562.845034:0:14547:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880136057800 already unused, calling callback (ffffffffa136e690) 00010000:00010000:0.0:1746129562.845036:0:14547:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136057800/0x40a459093b068618 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129562.845045:0:14547:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136057800/0x40a459093b068618 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129562.845052:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880132c4e700) 00010000:00010000:0.0:1746129562.845053:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129562.845055:0:14547:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880136057800/0x40a459093b068618 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129562.845059:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136057800/0x40a459093b068618 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129562.845101:0:14547:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880136056200/0x40a459093b06860a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f201b4 expref: 306 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129562.845109:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136056200/0x40a459093b06860a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f201b4 expref: 306 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129562.845115:0:14547:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136056200, rc 0) 00000100:00100000:0.0:1746129562.845137:0:14547:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095625500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ada2ffba-8920-4ecb-8068-68caa9806978+305:32030:x1830948733875200:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 8270us (8329us total) trans 8589945154 rc 301/301 00000100:00100000:0.0:1746129562.845143:0:14547:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11086 00000100:00100000:0.0:1746129562.846717:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129562.848593:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129562.848624:0:14547:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733875840 00000100:00100000:0.0:1746129562.848634:0:14547:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733875840 00000100:00100000:0.0:1746129562.848711:0:14547:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11087 00000100:00100000:0.0:1746129562.848722:0:14547:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095626300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+23:32031:x1830948733875840:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:0.0:1746129562.848753:0:14547:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129562.848774:0:14547:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef4200/0x40a459093b06862d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f201bb expref: -99 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129562.848900:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef5600/0x40a459093b068634 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129562.848914:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef5600/0x40a459093b068634 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129562.848928:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef5600/0x40a459093b068634 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129562.848944:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef5e00/0x40a459093b06863b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746129562.849344:0:8410:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880095274000/0x40a459093b0685ee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129562.849354:0:8410:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095274000/0x40a459093b0685ee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129562.849375:0:8410:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880095274000/0x40a459093b0685ee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129562.849382:0:8410:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880095274000/0x40a459093b0685ee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129562.849432:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef5e00/0x40a459093b06863b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129562.849439:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef5e00/0x40a459093b06863b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746129562.849544:0:8410:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880095274000/0x40a459093b0685ee lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129562.849551:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d79600/0x40a459093b068642 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746129562.849555:0:8410:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095274000 already unused, calling callback (ffffffffa086ed70) 00010000:00010000:1.0:1746129562.849559:0:8410:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880095274000/0x40a459093b0685ee lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129562.849559:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094d79600/0x40a459093b068642 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129562.849565:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094d79600/0x40a459093b068642 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746129562.849566:0:8410:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880095274000/0x40a459093b0685ee lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1746129562.849573:0:14547:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:1.0:1746129562.849576:0:8410:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880095274000/0x40a459093b0685ee lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129562.849581:0:8410:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095274000/0x40a459093b0685ee lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129562.849625:0:8410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:068dab75-d300-4ead-a742-d14572ad1e50+8:1962:x1830948733872768:12345-192.168.202.4@tcp:1:lfs.0 Request processed in 31271us (31926us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129562.849634:0:8410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15556 00010000:00010000:0.0:1746129562.849653:0:14547:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d79600/0x40a459093b068642 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129562.849658:0:14547:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094d79600/0x40a459093b068642 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129562.849663:0:14547:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094d79600/0x40a459093b068642 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129562.849667:0:14547:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094d79600 already unused, calling callback (ffffffffa136e690) 00010000:00010000:0.0:1746129562.849670:0:14547:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094d79600/0x40a459093b068642 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129562.849674:0:14547:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094d79600/0x40a459093b068642 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129562.849681:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009f469400) 00010000:00010000:0.0:1746129562.849684:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746129562.849687:0:14547:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094d79600/0x40a459093b068642 lrc: 2/0,0 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129562.849691:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d79600/0x40a459093b068642 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129562.849702:0:14547:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef5600/0x40a459093b068634 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129562.849706:0:14547:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef5600/0x40a459093b068634 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129562.849709:0:14547:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef5600/0x40a459093b068634 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129562.849713:0:14547:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a6ef5600 already unused, calling callback (ffffffffa136e690) 00010000:00010000:0.0:1746129562.849715:0:14547:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef5600/0x40a459093b068634 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129562.849719:0:14547:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef5600/0x40a459093b068634 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129562.849723:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880132ef8f00) 00010000:00010000:0.0:1746129562.849724:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129562.849726:0:14547:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef5600/0x40a459093b068634 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129562.849730:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef5600/0x40a459093b068634 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129562.849736:0:14547:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef5e00/0x40a459093b06863b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129562.849740:0:14547:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef5e00/0x40a459093b06863b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129562.849745:0:14547:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef5e00/0x40a459093b06863b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129562.849748:0:14547:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a6ef5e00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:0.0:1746129562.849750:0:14547:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef5e00/0x40a459093b06863b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129562.849754:0:14547:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef5e00/0x40a459093b06863b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129562.849759:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880093dc3000) 00010000:00010000:0.0:1746129562.849761:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129562.849832:0:14547:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef5e00/0x40a459093b06863b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129562.849837:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef5e00/0x40a459093b06863b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129562.849866:0:14547:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef4200/0x40a459093b06862d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f201bb expref: 25 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129562.849872:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef4200/0x40a459093b06862d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f201bb expref: 25 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129562.849880:0:14547:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6ef4200, rc 0) 00000100:00100000:0.0:1746129562.849902:0:14547:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095626300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+24:32031:x1830948733875840:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 1184us (1319us total) trans 8589945155 rc 301/301 00000100:00100000:0.0:1746129562.849908:0:14547:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11087 00000100:00100000:0.0:1746129562.853907:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129562.857397:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129562.861707:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129562.868536:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129562.871942:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129562.872005:0:8410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733877120 00000100:00100000:1.0:1746129562.872013:0:8410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733877120 00000100:00100000:1.0:1746129562.872600:0:8410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15560 00000100:00100000:1.0:1746129562.872609:0:8410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095626d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+25:32031:x1830948733877120:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:1.0:1746129562.872626:0:8410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129562.872644:0:8410:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095275200/0x40a459093b068673 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f201c9 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746129562.872671:0:8410:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3f5:0x0] initial LVB size: 4194304, mtime: 0x6813d29b, atime: 0x6813d29a, ctime: 0x6813d29b, blocks: 0x1029 00010000:00010000:1.0:1746129562.872693:0:8410:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129562.872695:0:8410:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129562.872703:0:8410:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095275200/0x40a459093b068673 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2256896->2449407) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f201c9 expref: 26 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129562.872717:0:8410:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095275200/0x40a459093b068673 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2256896->2449407) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f201c9 expref: 26 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129562.872726:0:8410:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095275200, rc 0) 00000100:00100000:1.0:1746129562.873143:0:8410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095626d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+26:32031:x1830948733877120:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 534us (1202us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129562.873150:0:8410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15560 00000100:00100000:0.0:1746129562.875737:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129562.875932:0:8410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733877248 00000100:00100000:1.0:1746129562.875943:0:8410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733877248 00000100:00100000:1.0:1746129562.876005:0:8410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15561 00000100:00100000:1.0:1746129562.876013:0:8410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095627100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ada2ffba-8920-4ecb-8068-68caa9806978+27:1962:x1830948733877248:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129562.876037:0:8410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129562.876060:0:8410:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095274a00/0x40a459093b06867a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f201d0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746129562.876086:0:8410:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3ec:0x0] initial LVB size: 1048576, mtime: 0x6813d299, atime: 0x6813d299, ctime: 0x6813d299, blocks: 0x7bd 00010000:00010000:1.0:1746129562.876105:0:8410:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129562.876107:0:8410:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129562.876119:0:8410:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095274a00/0x40a459093b06867a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f201d0 expref: 28 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129562.876133:0:8410:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095274a00/0x40a459093b06867a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f201d0 expref: 28 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129562.876146:0:8410:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095274a00, rc 0) 00000100:00100000:1.0:1746129562.876191:0:8410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095627100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ada2ffba-8920-4ecb-8068-68caa9806978+28:1962:x1830948733877248:12345-192.168.202.4@tcp:101:cat.0 Request processed in 178us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129562.876196:0:8410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15561 00000100:00100000:0.0:1746129562.876279:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129562.883176:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129562.883668:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129562.884381:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129562.884576:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129562.885014:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129562.885121:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733878144 00000100:00100000:0.0:1746129562.885123:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733878144 00000100:00100000:0.0:1746129562.885145:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15565 00000100:00100000:0.0:1746129562.885150:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095625f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ada2ffba-8920-4ecb-8068-68caa9806978+30:1962:x1830948733877888:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129562.885157:0:4385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129562.885716:0:4385:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a6ef4200/0x40a459093b06869d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f201ec expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746129562.885733:0:4385:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3ef:0x0] initial LVB size: 5146336, mtime: 0x6813d29b, atime: 0x6813d29a, ctime: 0x6813d29b, blocks: 0x1791 00010000:00010000:0.0:1746129562.885743:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129562.885744:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129562.885749:0:4385:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6ef4200/0x40a459093b06869d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f201ec expref: 31 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129562.885758:0:4385:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a6ef4200/0x40a459093b06869d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f201ec expref: 31 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129562.885765:0:4385:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6ef4200, rc 0) 00000100:00100000:0.0:1746129562.885782:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095625f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ada2ffba-8920-4ecb-8068-68caa9806978+31:1962:x1830948733877888:12345-192.168.202.4@tcp:101:cat.0 Request processed in 632us (1402us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129562.885787:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15565 00000100:00100000:0.0:1746129562.885872:0:31520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733878016 00000100:00100000:0.0:1746129562.885875:0:31520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733878016 00002000:00100000:0.0:1746129562.885905:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3f5:0x0] (2256896->2260991) req@ffff880095624e00 x1830948733878016/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:303/0 lens 488/0 e 0 to 0 dl 1746129573 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129562.885915:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095624e00 with x1830948733878016 ext(2256896->2260991) 00002000:00010000:0.0:1746129562.885918:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095624e00 00000100:00100000:0.0:1746129562.885942:0:31520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7478 00000100:00100000:0.0:1746129562.885947:0:31520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095624e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+26:1961:x1830948733878016:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:0.0:1746129562.886085:0:31520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095624e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+26:1961:x1830948733878016:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 137us (1508us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746129562.886090:0:31520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7478 00002000:00100000:0.0:1746129562.886095:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3f5:0x0] (2256896->2260991) req@ffff880095624e00 x1830948733878016/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:303/0 lens 488/4536 e 0 to 0 dl 1746129573 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129562.886102:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095624e00 with x1830948733878016 ext(2256896->2260991) 00002000:00010000:0.0:1746129562.886104:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095624e00 00000100:00100000:0.0:1746129562.891216:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129562.892394:0:31520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733878400 00000100:00100000:1.0:1746129562.892402:0:31520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733878400 00002000:00100000:1.0:1746129562.892609:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3f5:0x0] (2445312->2449407) req@ffff880095624700 x1830948733878400/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:303/0 lens 488/0 e 0 to 0 dl 1746129573 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129562.892619:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095624700 with x1830948733878400 ext(2445312->2449407) 00002000:00010000:1.0:1746129562.892623:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095624700 00000100:00100000:1.0:1746129562.892709:0:31520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7479 00000100:00100000:1.0:1746129562.892718:0:31520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095624700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+26:1961:x1830948733878400:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:1.0:1746129562.893565:0:31520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095624700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+26:1961:x1830948733878400:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 847us (2357us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746129562.893572:0:31520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7479 00002000:00100000:1.0:1746129562.893578:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3f5:0x0] (2445312->2449407) req@ffff880095624700 x1830948733878400/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:303/0 lens 488/4536 e 0 to 0 dl 1746129573 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129562.893586:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095624700 with x1830948733878400 ext(2445312->2449407) 00002000:00010000:1.0:1746129562.893590:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095624700 00000100:00100000:0.0:1746129562.899409:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129562.914949:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129562.917354:0:31520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733878912 00000100:00100000:1.0:1746129562.917369:0:31520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733878912 00002000:00100000:1.0:1746129562.917430:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3ec:0x0] (0->1048575) req@ffff880095624000 x1830948733878912/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:303/0 lens 488/0 e 0 to 0 dl 1746129573 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129562.917448:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095624000 with x1830948733878912 ext(0->1048575) 00002000:00010000:1.0:1746129562.917460:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095624000 00000100:00100000:0.0:1746129562.919333:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7482 00000100:00100000:0.0:1746129562.919342:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f959880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+34:1962:x1830948733879424:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129562.920770:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129562.960647:0:14547:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733879936 00000100:00100000:0.0:1746129562.960654:0:14547:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733879936 00000100:00100000:0.0:1746129562.960884:0:14547:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11090 00000100:00100000:0.0:1746129562.960892:0:14547:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f959500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+25:32039:x1830948733879936:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129562.960912:0:14547:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129562.960927:0:14547:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095123400/0x40a459093b0686a4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f201fa expref: -99 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129562.961013:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095122a00/0x40a459093b0686ab lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129562.961023:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095122a00/0x40a459093b0686ab lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129562.961031:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095122a00/0x40a459093b0686ab lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129562.961041:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095122600/0x40a459093b0686b2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129562.961045:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095122600/0x40a459093b0686b2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129562.961050:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095122600/0x40a459093b0686b2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129562.961129:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095123800/0x40a459093b0686b9 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129562.961135:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095123800/0x40a459093b0686b9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129562.961140:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095123800/0x40a459093b0686b9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00000004:00200000:0.0:1746129562.961148:0:14547:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:0.0:1746129562.961208:0:14547:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095122a00/0x40a459093b0686ab lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129562.961213:0:14547:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095122a00/0x40a459093b0686ab lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129562.961217:0:14547:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095122a00/0x40a459093b0686ab lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129562.961223:0:14547:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095122a00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:0.0:1746129562.961226:0:14547:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095122a00/0x40a459093b0686ab lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129562.961231:0:14547:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095122a00/0x40a459093b0686ab lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129562.961239:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880132ef8f00) 00010000:00010000:0.0:1746129562.961242:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129562.961245:0:14547:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095122a00/0x40a459093b0686ab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129562.961249:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095122a00/0x40a459093b0686ab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129562.961273:0:14547:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095122600/0x40a459093b0686b2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129562.961278:0:14547:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095122600/0x40a459093b0686b2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129562.961282:0:14547:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095122600/0x40a459093b0686b2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129562.961289:0:14547:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095122600 already unused, calling callback (ffffffffa136e690) 00010000:00010000:0.0:1746129562.961416:0:14547:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095122600/0x40a459093b0686b2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129562.961422:0:14547:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095122600/0x40a459093b0686b2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129562.961428:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800952eb200) 00010000:00010000:0.0:1746129562.961430:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129562.961432:0:14547:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095122600/0x40a459093b0686b2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129562.961436:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095122600/0x40a459093b0686b2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746129562.962052:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095123400/0x40a459093b0686a4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f201fa expref: 28 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129562.962076:0:14547:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095123800/0x40a459093b0686b9 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f201fa expref: 27 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129562.962082:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009f469400) 00010000:00010000:1.0:1746129562.962083:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746129562.962085:0:14547:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095123800, rc 0) 00000100:00100000:1.0:1746129562.962128:0:14547:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f959500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+27:32039:x1830948733879936:12345-192.168.202.4@tcp:101:cat.0 Request processed in 1237us (1877us total) trans 8589945160 rc 0/0 00000100:00100000:1.0:1746129562.962134:0:14547:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11090 00000100:00100000:0.0:1746129562.972547:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129562.973146:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129562.976224:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129562.976241:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129562.976254:0:8410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733880320 00000100:00100000:1.0:1746129562.976257:0:8410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733880320 00000100:00100000:1.0:1746129562.976271:0:8410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733880448 00000100:00100000:1.0:1746129562.976273:0:8410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733880448 00000100:00100000:1.0:1746129562.976290:0:8410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15569 00000100:00100000:1.0:1746129562.976310:0:8410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132c27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+27:1963:x1830948733880320:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129562.976316:0:8410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129562.976323:0:8410:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008ebb3000/0x40a459093b0686d5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2020f expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129562.976332:0:8410:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129562.976334:0:8410:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129562.976338:0:8410:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008ebb3000/0x40a459093b0686d5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2020f expref: 28 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129562.976346:0:8410:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008ebb3000/0x40a459093b0686d5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2020f expref: 28 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129562.976353:0:8410:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ebb3000, rc 0) 00000100:00100000:1.0:1746129562.976367:0:8410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132c27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+28:1963:x1830948733880320:12345-192.168.202.4@tcp:101:cat.0 Request processed in 58us (144us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129562.976372:0:8410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15569 00000100:00100000:1.0:1746129562.976394:0:8410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15570 00000100:00100000:1.0:1746129562.976399:0:8410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132c24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+15:1963:x1830948733880448:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129562.976404:0:8410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129562.976410:0:8410:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008ebb2000/0x40a459093b0686dc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20216 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129562.976418:0:8410:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129562.976419:0:8410:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129562.976423:0:8410:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008ebb2000/0x40a459093b0686dc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20216 expref: 16 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129562.976431:0:8410:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008ebb2000/0x40a459093b0686dc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20216 expref: 16 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129562.976437:0:8410:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ebb2000, rc 0) 00000100:00100000:1.0:1746129562.976452:0:8410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132c24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+16:1963:x1830948733880448:12345-192.168.202.4@tcp:101:cat.0 Request processed in 53us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129562.976459:0:8410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15570 00000100:00100000:1.0:1746129562.976496:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129562.976507:0:8410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733880576 00000100:00100000:1.0:1746129562.976510:0:8410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733880576 00000100:00100000:1.0:1746129562.976523:0:8410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15571 00000100:00100000:1.0:1746129562.976527:0:8410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132c24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+16:1963:x1830948733880576:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129562.976532:0:8410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129562.976539:0:8410:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008ebb2400/0x40a459093b0686e3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2021d expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129562.976547:0:8410:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129562.976549:0:8410:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129562.976552:0:8410:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008ebb2400/0x40a459093b0686e3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2021d expref: 17 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129562.976559:0:8410:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008ebb2400/0x40a459093b0686e3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2021d expref: 17 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129562.976565:0:8410:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ebb2400, rc 0) 00000100:00100000:1.0:1746129562.976577:0:8410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132c24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+17:1963:x1830948733880576:12345-192.168.202.4@tcp:101:cat.0 Request processed in 50us (81us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129562.976582:0:8410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15571 00000100:00100000:0.0:1746129562.985260:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129562.995784:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129562.999394:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129562.999490:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129563.000900:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129563.000951:0:31519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733881344 00000100:00100000:0.0:1746129563.000958:0:31519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733881344 00002000:00100000:0.0:1746129563.000987:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff880090e6c000 x1830948733881344/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:304/0 lens 488/0 e 0 to 0 dl 1746129574 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129563.000995:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090e6c000 with x1830948733881344 ext(1048576->2097151) 00002000:00010000:0.0:1746129563.001000:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090e6c000 00000100:00100000:1.0:1746129563.007474:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7488 00000100:00100000:1.0:1746129563.007485:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+29:1963:x1830948733881344:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129563.013845:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00080000:0.0:1746129563.014962:0:7097:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746129563.023889:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129563.033221:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129563.034396:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+30:1963:x1830948733881344:12345-192.168.202.4@tcp:3:cat.0 Request processed in 26899us (33487us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129563.034405:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7488 00002000:00100000:0.0:1746129563.034414:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff880090e6c000 x1830948733881344/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:304/0 lens 488/440 e 0 to 0 dl 1746129574 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129563.034422:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090e6c000 with x1830948733881344 ext(1048576->2097151) 00002000:00010000:0.0:1746129563.034427:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090e6c000 00000100:00100000:0.0:1746129563.037529:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129563.038415:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129563.038470:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129563.038599:0:20578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7948 00000100:00100000:0.0:1746129563.038606:0:20578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e6d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+30:1960:x1830948733882496:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129563.038613:0:20578:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129563.038623:0:20578:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008ebb3000/0x40a459093b0686d5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2020f expref: 30 pid: 8410 timeout: 918 lvb_type: 1 00010000:00010000:0.0:1746129563.038630:0:20578:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008ebb3000/0x40a459093b0686d5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2020f expref: 30 pid: 8410 timeout: 918 lvb_type: 1 00010000:00010000:0.0:1746129563.038639:0:20578:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008ebb3000/0x40a459093b0686d5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2020f expref: 30 pid: 8410 timeout: 918 lvb_type: 1 00010000:00010000:0.0:1746129563.038649:0:20578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129563.038650:0:20578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129563.038653:0:20578:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880095ab1a00/0x40a459093b0686f1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1138688->2093055) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2022b expref: 33 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129563.038658:0:20578:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095ab1a00/0x40a459093b0686f1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1138688->2093055) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2022b expref: 33 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129563.038670:0:20578:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880095ab1a00/0x40a459093b0686f1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1138688->2093055) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2022b expref: 33 pid: 22480 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129563.038674:0:20578:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e6d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:20578:1830948737417344:192.168.202.4@tcp:105: 00000100:00100000:0.0:1746129563.038705:0:20578:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093da89c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129563.045521:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129563.045568:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129563.045638:0:20578:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e6d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:20578:1830948737417344:192.168.202.4@tcp:105: 00010000:00010000:0.0:1746129563.045658:0:20578:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129563.045702:0:20578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e6d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+29:1960:x1830948733882496:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 7097us (7230us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129563.045711:0:20578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7948 00000100:00100000:0.0:1746129563.045749:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129563.045798:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129563.045829:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129563.045985:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733883392 00000100:00100000:1.0:1746129563.045989:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733883392 00002000:00100000:1.0:1746129563.046008:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f4:0x0] (1138688->1142783) req@ffff880090e6df80 x1830948733883392/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:304/0 lens 488/0 e 0 to 0 dl 1746129574 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129563.046016:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090e6df80 with x1830948733883392 ext(1138688->1142783) 00010000:00010000:1.0:1746129563.046022:0:25745:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095ab1a00/0x40a459093b0686f1 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1138688->2093055) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2022b expref: 36 pid: 22480 timeout: 918 lvb_type: 0 00010000:00010000:1.0:1746129563.046032:0:25745:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095ab1a00/0x40a459093b0686f1 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1138688->2093055) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2022b expref: 36 pid: 22480 timeout: 918 lvb_type: 0 00002000:00010000:1.0:1746129563.046038:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880090e6df80 00000100:00100000:1.0:1746129563.046056:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2340 00000100:00100000:1.0:1746129563.046062:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+36:1961:x1830948733883392:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:1.0:1746129563.046212:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+36:1961:x1830948733883392:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 150us (412us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746129563.046218:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2340 00002000:00100000:1.0:1746129563.046223:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f4:0x0] (1138688->1142783) req@ffff880090e6df80 x1830948733883392/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:304/0 lens 488/4536 e 0 to 0 dl 1746129574 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129563.046229:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090e6df80 with x1830948733883392 ext(1138688->1142783) 00010000:00010000:1.0:1746129563.046233:0:25745:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095ab1a00/0x40a459093b0686f1 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1138688->2093055) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2022b expref: 36 pid: 22480 timeout: 918 lvb_type: 0 00010000:00010000:1.0:1746129563.046241:0:25745:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095ab1a00/0x40a459093b0686f1 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1138688->2093055) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2022b expref: 36 pid: 22480 timeout: 918 lvb_type: 0 00002000:00010000:1.0:1746129563.046246:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880090e6df80 00000100:00100000:1.0:1746129563.046256:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7489 00000100:00100000:1.0:1746129563.046260:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+35:1961:x1830948733883008:12345-192.168.202.4@tcp:3:multiop.0 00000100:00080000:0.0:1746129563.046350:0:7097:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746129563.046367:0:31519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7491 00000100:00100000:0.0:1746129563.046374:0:31519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ada2ffba-8920-4ecb-8068-68caa9806978+30:1960:x1830948733883776:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:1.0:1746129563.054847:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+36:1961:x1830948733883008:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 8583us (9276us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129563.054856:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7489 00002000:00100000:1.0:1746129563.054864:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f5:0x0] (2097152->3145727) req@ffff880090e6dc00 x1830948733883008/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:304/0 lens 488/440 e 0 to 0 dl 1746129574 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129563.054872:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090e6dc00 with x1830948733883008 ext(2097152->3145727) 00002000:00010000:1.0:1746129563.054877:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090e6dc00 00000100:00100000:0.0:1746129563.066013:0:31519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733884032 00000100:00100000:0.0:1746129563.066024:0:31519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733884032 00002000:00100000:0.0:1746129563.066072:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f4:0x0] (2088960->2093055) req@ffff88009f95a680 x1830948733884032/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:304/0 lens 488/0 e 0 to 0 dl 1746129574 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129563.066083:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f95a680 with x1830948733884032 ext(2088960->2093055) 00010000:00010000:0.0:1746129563.066094:0:31519:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095ab1a00/0x40a459093b0686f1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1138688->2093055) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2022b expref: 36 pid: 22480 timeout: 918 lvb_type: 0 00010000:00010000:0.0:1746129563.066108:0:31519:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095ab1a00/0x40a459093b0686f1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1138688->2093055) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2022b expref: 36 pid: 22480 timeout: 918 lvb_type: 0 00002000:00010000:0.0:1746129563.066115:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f95a680 00000100:00100000:0.0:1746129563.066148:0:31519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2341 00000100:00100000:0.0:1746129563.066155:0:31519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f95a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ada2ffba-8920-4ecb-8068-68caa9806978+36:1962:x1830948733884032:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:1.0:1746129563.066373:0:31519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f95a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ada2ffba-8920-4ecb-8068-68caa9806978+36:1962:x1830948733884032:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 216us (591us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746129563.066390:0:31519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2341 00002000:00100000:1.0:1746129563.066397:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f4:0x0] (2088960->2093055) req@ffff88009f95a680 x1830948733884032/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:304/0 lens 488/4536 e 0 to 0 dl 1746129574 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129563.066405:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f95a680 with x1830948733884032 ext(2088960->2093055) 00010000:00010000:1.0:1746129563.066411:0:31519:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095ab1a00/0x40a459093b0686f1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1138688->2093055) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2022b expref: 36 pid: 22480 timeout: 918 lvb_type: 0 00010000:00010000:1.0:1746129563.066421:0:31519:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095ab1a00/0x40a459093b0686f1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1138688->2093055) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2022b expref: 36 pid: 22480 timeout: 918 lvb_type: 0 00002000:00010000:1.0:1746129563.066428:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f95a680 00000100:00100000:0.0:1746129563.068922:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129563.068993:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00080000:0.0:1746129563.069634:0:7097:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746129563.093834:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129563.096608:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129563.096680:0:20578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733885056 00000100:00100000:1.0:1746129563.096688:0:20578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733885056 00010000:00010000:1.0:1746129563.096725:0:20578:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095ab1a00/0x40a459093b0686f1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1138688->2093055) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2022b expref: 36 pid: 22480 timeout: 918 lvb_type: 0 00000100:00100000:1.0:1746129563.096772:0:20578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7949 00000100:00100000:1.0:1746129563.096779:0:20578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e6f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ada2ffba-8920-4ecb-8068-68caa9806978+36:1963:x1830948733885056:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129563.096793:0:20578:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129563.096817:0:20578:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095ab1a00/0x40a459093b0686f1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1138688->2093055) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2022b expref: 36 pid: 22480 timeout: 918 lvb_type: 0 00010000:00010000:1.0:1746129563.096830:0:20578:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095ab1a00/0x40a459093b0686f1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1138688->2093055) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2022b expref: 36 pid: 22480 timeout: 918 lvb_type: 0 00010000:00010000:1.0:1746129563.096853:0:20578:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095ab1a00/0x40a459093b0686f1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1138688->2093055) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2022b expref: 36 pid: 22480 timeout: 918 lvb_type: 0 00010000:00010000:1.0:1746129563.096873:0:20578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129563.096875:0:20578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129563.096882:0:20578:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009efb3000/0x40a459093b0686f8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20232 expref: 28 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129563.096890:0:20578:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009efb3000/0x40a459093b0686f8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20232 expref: 28 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129563.096924:0:20578:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009efb3000/0x40a459093b0686f8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20232 expref: 28 pid: 22480 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129563.096937:0:20578:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880132c25880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:20578:1830948737417728:192.168.202.4@tcp:105: 00000100:00100000:1.0:1746129563.097013:0:20578:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a6ce8a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746129563.101564:0:20578:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880132c25880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:20578:1830948737417728:192.168.202.4@tcp:105: 00010000:00010000:1.0:1746129563.101588:0:20578:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129563.102115:0:20578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e6f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ada2ffba-8920-4ecb-8068-68caa9806978+35:1963:x1830948733885056:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 5332us (5511us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129563.102127:0:20578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7949 00000100:00100000:0.0:1746129563.104084:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129563.104129:0:31519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733885440 00000100:00100000:1.0:1746129563.104137:0:31519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733885440 00002000:00100000:1.0:1746129563.104177:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f4:0x0] (1048576->2097151) req@ffff880090e6f480 x1830948733885440/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:304/0 lens 488/0 e 0 to 0 dl 1746129574 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129563.104187:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090e6f480 with x1830948733885440 ext(1048576->2097151) 00002000:00010000:1.0:1746129563.104192:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090e6f480 00000100:00100000:1.0:1746129563.104225:0:31519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7493 00000100:00100000:1.0:1746129563.104232:0:31519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+29:1962:x1830948733885440:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129563.118046:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129563.122266:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129563.128629:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129563.129452:0:14547:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733886080 00000100:00100000:1.0:1746129563.129464:0:14547:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733886080 00000100:00100000:1.0:1746129563.129536:0:14547:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11091 00000100:00100000:1.0:1746129563.129546:0:14547:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+27:32043:x1830948733886080:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:1.0:1746129563.129575:0:14547:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129563.129593:0:14547:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095ff0e00/0x40a459093b06870d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20247 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129563.129697:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880095ff0600/0x40a459093b068714 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746129563.129712:0:14547:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea5ec00/0x40a459093b068665 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f201c2 expref: 308 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129563.129723:0:14547:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095123800/0x40a459093b0686b9 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f201fa expref: 28 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129563.129728:0:14547:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095ff0600/0x40a459093b068714 lrc: 5/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746129563.129761:0:14547:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880095123800/0x40a459093b0686b9 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f201fa expref: 28 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129563.129772:0:14547:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880095123800/0x40a459093b0686b9 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f201fa expref: 28 pid: 14547 timeout: 918 lvb_type: 0 00000100:00100000:1.0:1746129563.129784:0:14547:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880132c25880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14547:1830948737417856:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129563.129888:0:14547:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea5ec00/0x40a459093b068665 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f201c2 expref: 308 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129563.129896:0:14547:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea5ec00/0x40a459093b068665 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f201c2 expref: 308 pid: 14547 timeout: 918 lvb_type: 0 00000100:00100000:1.0:1746129563.129904:0:14547:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880132c26300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14547:1830948737417984:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129563.129923:0:14547:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a6ce8a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746129563.130062:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00080000:0.0:1746129563.132270:0:7097:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746129563.132404:0:14547:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880132c26300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14547:1830948737417984:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129563.132573:0:14547:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880132c25880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14547:1830948737417856:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129563.132603:0:14547:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880095ff0600/0x40a459093b068714 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00000100:00100000:0.0:1746129563.136073:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129563.136118:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129563.136378:0:20578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7951 00000100:00100000:1.0:1746129563.136398:0:20578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a45450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ada2ffba-8920-4ecb-8068-68caa9806978+309:1960:x1830948733886464:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129563.136406:0:20578:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129563.136411:0:20578:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea5ec00/0x40a459093b068665 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f201c2 expref: 309 pid: 14547 timeout: 918 lvb_type: 0 00010000:00010000:1.0:1746129563.136425:0:20578:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea5ec00/0x40a459093b068665 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f201c2 expref: 309 pid: 14547 timeout: 918 lvb_type: 0 00010000:00010000:1.0:1746129563.136437:0:20578:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea5ec00/0x40a459093b068665 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f201c2 expref: 309 pid: 14547 timeout: 918 lvb_type: 0 00010000:00010000:1.0:1746129563.136722:0:20578:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009f469400) 00010000:00010000:1.0:1746129563.136726:0:20578:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129563.136987:0:20578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a45450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ada2ffba-8920-4ecb-8068-68caa9806978+308:1960:x1830948733886464:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 590us (867us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129563.136995:0:20578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7951 00010000:00010000:0.0:1746129563.138275:0:14547:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880095ff0600/0x40a459093b068714 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129563.138284:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095ff0600/0x40a459093b068714 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00000004:00200000:0.0:1746129563.138332:0:14547:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:0.0:1746129563.138509:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095ff0e00/0x40a459093b06870d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20247 expref: 29 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129563.139161:0:14547:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095ff0600/0x40a459093b068714 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20247 expref: 28 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129563.139170:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009f469400) 00010000:00010000:0.0:1746129563.139177:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746129563.139180:0:14547:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095ff0600, rc 0) 00000100:00100000:0.0:1746129563.139225:0:14547:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+28:32043:x1830948733886080:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 9680us (10607us total) trans 8589945163 rc 0/0 00000100:00100000:0.0:1746129563.139234:0:14547:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11091 00000100:00100000:0.0:1746129563.147997:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129563.155195:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129563.155250:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129563.161808:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129563.162835:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129563.164817:0:31521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733887616 00000100:00100000:0.0:1746129563.164828:0:31521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733887616 00002000:00100000:0.0:1746129563.164865:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->4194303) req@ffff880132c24a80 x1830948733887616/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:304/0 lens 488/0 e 0 to 0 dl 1746129574 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129563.164880:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880132c24a80 with x1830948733887616 ext(3145728->4194303) 00002000:00010000:0.0:1746129563.164885:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880132c24a80 00000100:00100000:0.0:1746129563.164911:0:31521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7497 00000100:00100000:0.0:1746129563.164917:0:31521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132c24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+19:1961:x1830948733887616:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:1.0:1746129563.169563:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129563.169622:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129563.169638:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733887872 00000100:00100000:1.0:1746129563.169641:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733887872 00010000:00010000:1.0:1746129563.169657:0:7087:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008ebb2000/0x40a459093b0686dc lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20216 expref: 21 pid: 8410 timeout: 918 lvb_type: 1 00000100:00100000:1.0:1746129563.169678:0:7087:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7952 00000100:00100000:1.0:1746129563.169684:0:7087:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132c26300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:1960:x1830948733887872:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129563.169696:0:7087:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129563.169719:0:7087:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008ebb2000/0x40a459093b0686dc lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20216 expref: 21 pid: 8410 timeout: 918 lvb_type: 1 00010000:00010000:1.0:1746129563.169734:0:7087:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008ebb2000/0x40a459093b0686dc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20216 expref: 21 pid: 8410 timeout: 918 lvb_type: 1 00010000:00010000:1.0:1746129563.169759:0:7087:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129563.169788:0:7087:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132c26300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:1960:x1830948733887872:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 104us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129563.171169:0:7087:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7952 00000100:00100000:0.0:1746129563.179144:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129563.185003:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129563.190981:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129563.211124:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129563.235564:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129563.245621:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129563.245694:0:16680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733889280 00000100:00100000:1.0:1746129563.245703:0:16680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733889280 00000100:00100000:1.0:1746129563.245768:0:16680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4682 00000100:00100000:1.0:1746129563.245776:0:16680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f52450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+29:27693:x1830948733889280:12345-192.168.202.4@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746129563.246005:0:16680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f52450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+30:27693:x1830948733889280:12345-192.168.202.4@tcp:35:ldlm_bl.0 Request processed in 229us (394us total) trans 8589945165 rc 0/0 00000100:00100000:1.0:1746129563.246011:0:16680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4682 00000100:00100000:0.0:1746129563.250518:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129563.256078:0:4699:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733889664 00000100:00100000:1.0:1746129563.256087:0:4699:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733889664 00000100:00100000:1.0:1746129563.256134:0:4699:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733890176 00000100:00100000:1.0:1746129563.256136:0:4699:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733890176 00000100:00100000:0.0:1746129563.256369:0:22480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15580 00000100:00100000:0.0:1746129563.256377:0:22480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f95a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:068dab75-d300-4ead-a742-d14572ad1e50+9:1962:x1830948733889920:12345-192.168.202.4@tcp:101:mirror_io.0 00010000:00010000:0.0:1746129563.256394:0:22480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129563.256404:0:22480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b4e59600/0x40a459093b068753 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20278 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129563.256444:0:22480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22480:1830948737418624:192.168.202.4@tcp:106: 00000100:00100000:0.0:1746129563.256488:0:22480:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093da83c0 going to sleep for 11 seconds 00000100:00080000:0.0:1746129563.256502:0:7097:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1746129563.256505:0:7097:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746129563.256565:0:4699:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15581 00000100:00100000:1.0:1746129563.256571:0:4699:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f958380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:068dab75-d300-4ead-a742-d14572ad1e50+9:1962:x1830948733890176:12345-192.168.202.4@tcp:101:mirror_io.0 00010000:00010000:1.0:1746129563.256576:0:4699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129563.256583:0:4699:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095ea6e00/0x40a459093b06875a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20286 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129563.256593:0:4699:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129563.256596:0:4699:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129563.256600:0:4699:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095ea6e00/0x40a459093b06875a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20286 expref: 10 pid: 4699 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129563.256609:0:4699:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095ea6e00/0x40a459093b06875a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20286 expref: 10 pid: 4699 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129563.256615:0:4699:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095ea6e00, rc 0) 00000100:00100000:1.0:1746129563.256633:0:4699:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f958380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:068dab75-d300-4ead-a742-d14572ad1e50+10:1962:x1830948733890176:12345-192.168.202.4@tcp:101:mirror_io.0 Request processed in 64us (620us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129563.256638:0:4699:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15581 00000100:00100000:0.0:1746129563.258525:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129563.258593:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129563.258681:0:22480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22480:1830948737418624:192.168.202.4@tcp:106: 00010000:00010000:0.0:1746129563.258711:0:22480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b4e59600/0x40a459093b068753 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20278 expref: 10 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129563.258723:0:22480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b4e59600/0x40a459093b068753 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20278 expref: 10 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129563.258736:0:22480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4e59600, rc 0) 00000100:00100000:0.0:1746129563.258766:0:22480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f95a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:068dab75-d300-4ead-a742-d14572ad1e50+9:1962:x1830948733889920:12345-192.168.202.4@tcp:101:mirror_io.0 Request processed in 2390us (2773us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129563.258773:0:22480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15580 00000100:00100000:0.0:1746129563.258795:0:22480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733889792 00000100:00100000:0.0:1746129563.258800:0:22480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733889792 00000100:00100000:0.0:1746129563.258832:0:22480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733890048 00000100:00100000:0.0:1746129563.258834:0:22480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733890048 00000100:00100000:0.0:1746129563.258847:0:22480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15583 00000100:00100000:0.0:1746129563.258852:0:22480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:068dab75-d300-4ead-a742-d14572ad1e50+10:1962:x1830948733889792:12345-192.168.202.4@tcp:101:mirror_io.0 00010000:00010000:0.0:1746129563.258862:0:22480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129563.258873:0:22480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880134b08c00/0x40a459093b068768 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20271 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129563.258886:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129563.258889:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129563.258895:0:22480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880134b08c00/0x40a459093b068768 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20271 expref: 11 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129563.258907:0:22480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880134b08c00/0x40a459093b068768 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20271 expref: 11 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129563.258919:0:22480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134b08c00, rc 0) 00000100:00100000:0.0:1746129563.258934:0:22480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:068dab75-d300-4ead-a742-d14572ad1e50+11:1962:x1830948733889792:12345-192.168.202.4@tcp:101:mirror_io.0 Request processed in 82us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129563.258939:0:22480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15583 00000100:00100000:0.0:1746129563.258950:0:22480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15584 00000100:00100000:0.0:1746129563.258954:0:22480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:068dab75-d300-4ead-a742-d14572ad1e50+9:1962:x1830948733890048:12345-192.168.202.4@tcp:101:mirror_io.0 00010000:00010000:0.0:1746129563.258960:0:22480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129563.258967:0:22480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880134b08a00/0x40a459093b06876f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2027f expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129563.258976:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129563.258977:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129563.258980:0:22480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880134b08a00/0x40a459093b06876f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2027f expref: 10 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129563.258988:0:22480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880134b08a00/0x40a459093b06876f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2027f expref: 10 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129563.258994:0:22480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134b08a00, rc 0) 00000100:00100000:0.0:1746129563.259005:0:22480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:068dab75-d300-4ead-a742-d14572ad1e50+10:1962:x1830948733890048:12345-192.168.202.4@tcp:101:mirror_io.0 Request processed in 50us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129563.259009:0:22480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15584 00000100:00100000:0.0:1746129563.265599:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129563.279980:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129563.280187:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733890560 00000100:00100000:1.0:1746129563.280197:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733890560 00010000:00010000:1.0:1746129563.280238:0:9823:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090078800/0x40a459093b068745 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2025c expref: 17 pid: 14547 timeout: 918 lvb_type: 0 00000100:00100000:1.0:1746129563.280281:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7955 00000100:00100000:1.0:1746129563.280288:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947bf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:068dab75-d300-4ead-a742-d14572ad1e50+17:1963:x1830948733890560:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129563.280336:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129563.280342:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880090078800/0x40a459093b068745 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2025c expref: 17 pid: 14547 timeout: 918 lvb_type: 0 00010000:00010000:1.0:1746129563.280353:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880090078800/0x40a459093b068745 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2025c expref: 17 pid: 14547 timeout: 918 lvb_type: 0 00010000:00010000:1.0:1746129563.280375:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090078800/0x40a459093b068745 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2025c expref: 17 pid: 14547 timeout: 918 lvb_type: 0 00010000:00010000:1.0:1746129563.280418:0:9823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009f469400) 00010000:00010000:1.0:1746129563.280425:0:9823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9209000/0x40a459093b06877d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746129563.280435:0:9823:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9209000/0x40a459093b06877d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746129563.281207:0:9823:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9209000/0x40a459093b06877d lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746129563.281238:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129563.281287:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947bf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:068dab75-d300-4ead-a742-d14572ad1e50+16:1963:x1830948733890560:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 998us (1317us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129563.281316:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7955 00000100:00100000:0.0:1746129563.298766:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129563.304921:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129563.306687:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129563.306743:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129563.306759:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733891456 00000100:00100000:0.0:1746129563.306763:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733891456 00000100:00100000:0.0:1746129563.306782:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733891712 00000100:00100000:0.0:1746129563.306784:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733891712 00000100:00100000:0.0:1746129563.306794:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15586 00000100:00100000:0.0:1746129563.306799:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:068dab75-d300-4ead-a742-d14572ad1e50+10:1961:x1830948733891456:12345-192.168.202.4@tcp:1:mirror_io.0 00010000:00010000:0.0:1746129563.306820:0:7149:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880134b09e00/0x40a459093b0687ae lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129563.306830:0:7149:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095ab1a00/0x40a459093b068729 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1540096->1904639) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20255 expref: 16 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129563.306834:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129563.306836:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129563.306837:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880134b09e00/0x40a459093b0687ae lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129563.306851:0:7149:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095ab1a00/0x40a459093b068729 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1540096->1904639) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20255 expref: 16 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129563.306858:0:7149:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095ab1a00/0x40a459093b068729 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1540096->1904639) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20255 expref: 16 pid: 11014 timeout: 918 lvb_type: 0 00000100:00100000:0.0:1746129563.306867:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a77b3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7149:1830948737419264:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129563.306888:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093da83c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129563.306905:0:4699:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15587 00000100:00100000:0.0:1746129563.306910:0:4699:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a77b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:068dab75-d300-4ead-a742-d14572ad1e50+12:1961:x1830948733891712:12345-192.168.202.4@tcp:1:mirror_io.0 00010000:00010000:0.0:1746129563.306925:0:4699:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880134b09a00/0x40a459093b0687b5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129563.306934:0:4699:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095ab0a00/0x40a459093b0686ea lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20224 expref: 35 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129563.306940:0:4699:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095ea6e00/0x40a459093b06875a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20286 expref: 12 pid: 4699 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129563.306944:0:4699:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095ab1000/0x40a459093b068722 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2024e expref: 29 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129563.306949:0:4699:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129563.306950:0:4699:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129563.306952:0:4699:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880134b09a00/0x40a459093b0687b5 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129563.306965:0:4699:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095ab1000/0x40a459093b068722 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2024e expref: 29 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129563.306973:0:4699:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095ab1000/0x40a459093b068722 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2024e expref: 29 pid: 11014 timeout: 918 lvb_type: 0 00000100:00100000:0.0:1746129563.306980:0:4699:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a77b0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4699:1830948737419392:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129563.307004:0:4699:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095ea6e00/0x40a459093b06875a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20286 expref: 12 pid: 4699 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129563.307012:0:4699:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095ea6e00/0x40a459093b06875a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20286 expref: 12 pid: 4699 timeout: 918 lvb_type: 1 00000100:00100000:0.0:1746129563.307019:0:4699:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a77b3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4699:1830948737419520:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129563.307041:0:4699:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095ab0a00/0x40a459093b0686ea lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20224 expref: 35 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129563.307048:0:4699:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095ab0a00/0x40a459093b0686ea lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20224 expref: 35 pid: 22480 timeout: 918 lvb_type: 0 00000100:00100000:0.0:1746129563.307055:0:4699:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013577d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4699:1830948737419648:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129563.307069:0:4699:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093da89c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129563.307102:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129563.307112:0:22480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733891072 00000100:00100000:0.0:1746129563.307115:0:22480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733891072 00000100:00100000:0.0:1746129563.307145:0:22480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15588 00000100:00100000:0.0:1746129563.307149:0:22480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013577f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:068dab75-d300-4ead-a742-d14572ad1e50+11:1961:x1830948733891072:12345-192.168.202.4@tcp:1:mirror_io.0 00010000:00010000:0.0:1746129563.307165:0:22480:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800b4e59800/0x40a459093b0687bc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129563.307175:0:22480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095274a00/0x40a459093b06867a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f201d0 expref: 28 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129563.307181:0:22480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a9209c00/0x40a459093b068761 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20263 expref: 11 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129563.307188:0:22480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c031400/0x40a459093b0686c7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20201 expref: 16 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129563.307194:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129563.307195:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129563.307197:0:22480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4e59800/0x40a459093b0687bc lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129563.307212:0:22480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c031400/0x40a459093b0686c7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20201 expref: 16 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129563.307219:0:22480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c031400/0x40a459093b0686c7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20201 expref: 16 pid: 22480 timeout: 918 lvb_type: 1 00000100:00100000:0.0:1746129563.307226:0:22480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013577f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22480:1830948737419776:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129563.307254:0:22480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a9209c00/0x40a459093b068761 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20263 expref: 11 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129563.307260:0:22480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a9209c00/0x40a459093b068761 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20263 expref: 11 pid: 11014 timeout: 918 lvb_type: 1 00000100:00100000:0.0:1746129563.307266:0:22480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013577c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22480:1830948737419904:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129563.307283:0:22480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095274a00/0x40a459093b06867a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f201d0 expref: 28 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129563.307316:0:22480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095274a00/0x40a459093b06867a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f201d0 expref: 28 pid: 8410 timeout: 918 lvb_type: 1 00000100:00100000:0.0:1746129563.307324:0:22480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013577ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22480:1830948737420032:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129563.307354:0:22480:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093da8840 going to sleep for 11 seconds 00000100:00100000:0.0:1746129563.307399:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129563.309550:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129563.328015:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129563.328777:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a77b3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7149:1830948737419264:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129563.328804:0:7149:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880134b09e00/0x40a459093b0687ae lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129563.328860:0:4699:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a77b0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4699:1830948737419392:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129563.328888:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129563.328922:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129563.328938:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129563.329428:0:4699:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a77b3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4699:1830948737419520:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129563.329447:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129563.332619:0:4699:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013577d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4699:1830948737419648:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129563.332654:0:4699:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880134b09a00/0x40a459093b0687b5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129563.332697:0:22480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013577f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22480:1830948737419776:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129563.332725:0:22480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013577c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22480:1830948737419904:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129563.332746:0:22480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013577ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22480:1830948737420032:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129563.332762:0:22480:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800b4e59800/0x40a459093b0687bc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129563.332818:0:11014:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095625880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11014:1830948737420544:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129563.332841:0:11014:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095626d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11014:1830948737420672:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129563.332861:0:11014:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095627100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11014:1830948737420800:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129563.332873:0:11014:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880090078e00/0x40a459093b0687ca lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129563.333003:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7958 00000100:00100000:1.0:1746129563.333011:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a45050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+30:1960:x1830948733892224:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129563.333018:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129563.333035:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095ab1000/0x40a459093b068722 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2024e expref: 30 pid: 11014 timeout: 918 lvb_type: 0 00010000:00010000:1.0:1746129563.333044:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095ab1000/0x40a459093b068722 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2024e expref: 30 pid: 11014 timeout: 918 lvb_type: 0 00010000:00010000:1.0:1746129563.333055:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095ab1000/0x40a459093b068722 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2024e expref: 30 pid: 11014 timeout: 918 lvb_type: 0 00010000:00010000:1.0:1746129563.333068:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129563.335129:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129563.335150:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129563.335161:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129563.336108:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a45050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+30:1960:x1830948733892224:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 3097us (7167us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129563.336115:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7958 00000100:00100000:1.0:1746129563.338453:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7962 00000100:00100000:1.0:1746129563.338465:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013577ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+29:1962:x1830948733893120:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129563.338480:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129563.338502:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009efb3000/0x40a459093b0686f8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20232 expref: 29 pid: 22480 timeout: 918 lvb_type: 0 00010000:00010000:1.0:1746129563.338514:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009efb3000/0x40a459093b0686f8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20232 expref: 29 pid: 22480 timeout: 918 lvb_type: 0 00010000:00010000:1.0:1746129563.338534:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009efb3000/0x40a459093b0686f8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20232 expref: 28 pid: 22480 timeout: 918 lvb_type: 0 00010000:00010000:1.0:1746129563.338546:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129563.338564:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013577ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+27:1962:x1830948733893120:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 103us (3403us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129563.338570:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7962 00000100:00100000:0.0:1746129563.339810:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129563.340150:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129563.340170:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129563.340182:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733893376 00000100:00100000:1.0:1746129563.340185:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733893376 00000100:00100000:0.0:1746129563.340591:0:15749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733892608 00000100:00100000:0.0:1746129563.340595:0:15749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733892608 00010000:00010000:0.0:1746129563.340614:0:15749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095ab0a00/0x40a459093b0686ea lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20224 expref: 34 pid: 22480 timeout: 918 lvb_type: 0 00000100:00100000:0.0:1746129563.340640:0:15749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7963 00000100:00100000:0.0:1746129563.340646:0:15749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a44c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ada2ffba-8920-4ecb-8068-68caa9806978+34:1962:x1830948733892608:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129563.340657:0:15749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129563.340679:0:15749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095ab0a00/0x40a459093b0686ea lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20224 expref: 34 pid: 22480 timeout: 918 lvb_type: 0 00010000:00010000:0.0:1746129563.340690:0:15749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095ab0a00/0x40a459093b0686ea lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20224 expref: 34 pid: 22480 timeout: 918 lvb_type: 0 00010000:00010000:0.0:1746129563.340711:0:15749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095ab0a00/0x40a459093b0686ea lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20224 expref: 34 pid: 22480 timeout: 918 lvb_type: 0 00010000:00010000:0.0:1746129563.340731:0:15749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129563.340733:0:15749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129563.340738:0:15749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880134b09a00/0x40a459093b0687b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129563.340746:0:15749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880134b09a00/0x40a459093b0687b5 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129563.340767:0:15749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129563.340796:0:15749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a44c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ada2ffba-8920-4ecb-8068-68caa9806978+33:1962:x1830948733892608:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 149us (624us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129563.340802:0:15749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7963 00010000:00010000:0.0:1746129563.340829:0:4699:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880134b09a00/0x40a459093b0687b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129563.340837:0:4699:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880134b09a00/0x40a459093b0687b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129563.340855:0:4699:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880134b09a00/0x40a459093b0687b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129563.340867:0:4699:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880134b09a00/0x40a459093b0687b5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129563.340874:0:4699:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880134b09a00/0x40a459093b0687b5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129563.340880:0:4699:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880134b09a00 already unused, calling callback (ffffffffa086ed70) 00010000:00010000:0.0:1746129563.340884:0:4699:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880134b09a00/0x40a459093b0687b5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129563.340891:0:4699:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880134b09a00/0x40a459093b0687b5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129563.340901:0:4699:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880134b09a00/0x40a459093b0687b5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129563.340906:0:4699:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880134b09a00/0x40a459093b0687b5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129563.340942:0:4699:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a77b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:068dab75-d300-4ead-a742-d14572ad1e50+10:1961:x1830948733891712:12345-192.168.202.4@tcp:1:mirror_io.0 Request processed in 34032us (34198us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129563.340951:0:4699:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15587 00010000:00010000:1.0:1746129563.340984:0:7087:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c031400/0x40a459093b0686c7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20201 expref: 19 pid: 22480 timeout: 918 lvb_type: 1 00000100:00100000:1.0:1746129563.340998:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733892864 00000100:00100000:1.0:1746129563.341001:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733892864 00010000:00010000:1.0:1746129563.341013:0:7087:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880134b08c00/0x40a459093b068768 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20271 expref: 10 pid: 22480 timeout: 918 lvb_type: 1 00000100:00100000:0.0:1746129563.341013:0:15749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7965 00000100:00100000:0.0:1746129563.341018:0:15749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132c26300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+19:1962:x1830948733893376:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129563.341024:0:15749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746129563.341029:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733893248 00000100:00100000:1.0:1746129563.341032:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733893248 00010000:00010000:0.0:1746129563.341032:0:15749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c031400/0x40a459093b0686c7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20201 expref: 19 pid: 22480 timeout: 918 lvb_type: 1 00010000:00010000:0.0:1746129563.341040:0:15749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c031400/0x40a459093b0686c7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20201 expref: 19 pid: 22480 timeout: 918 lvb_type: 1 00010000:00010000:1.0:1746129563.341041:0:7087:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880134b08a00/0x40a459093b06876f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2027f expref: 13 pid: 22480 timeout: 918 lvb_type: 1 00010000:00010000:0.0:1746129563.341051:0:15749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c031400/0x40a459093b0686c7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20201 expref: 19 pid: 22480 timeout: 918 lvb_type: 1 00000100:00100000:1.0:1746129563.341052:0:7087:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7966 00000100:00100000:1.0:1746129563.341056:0:7087:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095624380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:068dab75-d300-4ead-a742-d14572ad1e50+10:1962:x1830948733892864:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129563.341060:0:15749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746129563.341061:0:7087:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129563.341070:0:7087:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880134b08c00/0x40a459093b068768 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20271 expref: 10 pid: 22480 timeout: 918 lvb_type: 1 00000100:00100000:0.0:1746129563.341074:0:15749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132c26300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+18:1962:x1830948733893376:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 56us (925us total) trans 0 rc 0/0 00010000:00010000:1.0:1746129563.341078:0:7087:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880134b08c00/0x40a459093b068768 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20271 expref: 10 pid: 22480 timeout: 918 lvb_type: 1 00000100:00100000:0.0:1746129563.341079:0:15749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7965 00010000:00010000:1.0:1746129563.341088:0:7087:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880134b08c00/0x40a459093b068768 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20271 expref: 10 pid: 22480 timeout: 918 lvb_type: 1 00010000:00010000:1.0:1746129563.341096:0:7087:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129563.341098:0:7087:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129563.341100:0:7087:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a95ede00/0x40a459093b0687c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129563.341106:0:7087:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a95ede00/0x40a459093b0687c3 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 22481 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129563.341115:0:15749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733893504 00000100:00100000:0.0:1746129563.341117:0:15749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733893504 00010000:00010000:1.0:1746129563.341126:0:7087:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746129563.341126:0:15749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a9209c00/0x40a459093b068761 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20263 expref: 14 pid: 11014 timeout: 918 lvb_type: 1 00000100:00100000:0.0:1746129563.341135:0:15749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7967 00000100:00100000:0.0:1746129563.341139:0:15749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095625c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:068dab75-d300-4ead-a742-d14572ad1e50+14:1962:x1830948733893248:12345-192.168.202.4@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746129563.341141:0:7087:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095624380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:068dab75-d300-4ead-a742-d14572ad1e50+9:1962:x1830948733892864:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 85us (157us total) trans 0 rc 0/0 00010000:00010000:0.0:1746129563.341143:0:15749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746129563.341146:0:7087:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7966 00010000:00010000:0.0:1746129563.341152:0:15749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880134b08a00/0x40a459093b06876f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2027f expref: 14 pid: 22480 timeout: 918 lvb_type: 1 00000100:00100000:1.0:1746129563.341155:0:7087:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7968 00000100:00100000:1.0:1746129563.341159:0:7087:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095627480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:068dab75-d300-4ead-a742-d14572ad1e50+14:1963:x1830948733893504:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129563.341160:0:15749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880134b08a00/0x40a459093b06876f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2027f expref: 14 pid: 22480 timeout: 918 lvb_type: 1 00010000:00010000:1.0:1746129563.341163:0:7087:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129563.341168:0:7087:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a9209c00/0x40a459093b068761 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20263 expref: 14 pid: 11014 timeout: 918 lvb_type: 1 00010000:00010000:0.0:1746129563.341171:0:15749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880134b08a00/0x40a459093b06876f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2027f expref: 14 pid: 22480 timeout: 918 lvb_type: 1 00010000:00010000:1.0:1746129563.341176:0:7087:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a9209c00/0x40a459093b068761 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20263 expref: 14 pid: 11014 timeout: 918 lvb_type: 1 00010000:00010000:0.0:1746129563.341179:0:15749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746129563.341184:0:7087:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a9209c00/0x40a459093b068761 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20263 expref: 13 pid: 11014 timeout: 918 lvb_type: 1 00000100:00100000:0.0:1746129563.341190:0:15749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095625c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:068dab75-d300-4ead-a742-d14572ad1e50+12:1962:x1830948733893248:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 52us (166us total) trans 0 rc 0/0 00010000:00010000:1.0:1746129563.341191:0:7087:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129563.341193:0:7087:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746129563.341195:0:15749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7967 00010000:00010000:1.0:1746129563.341196:0:7087:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b4e59800/0x40a459093b0687bc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129563.341201:0:7087:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4e59800/0x40a459093b0687bc lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129563.341213:0:7087:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129563.341224:0:7087:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095627480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:068dab75-d300-4ead-a742-d14572ad1e50+11:1963:x1830948733893504:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 65us (142us total) trans 0 rc 0/0 00010000:00010000:0.0:1746129563.341224:0:22480:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800b4e59800/0x40a459093b0687bc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129563.341229:0:7087:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7968 00010000:00010000:0.0:1746129563.341231:0:22480:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b4e59800/0x40a459093b0687bc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129563.341244:0:22480:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800b4e59800/0x40a459093b0687bc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129563.341252:0:22480:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4e59800/0x40a459093b0687bc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129563.341258:0:22480:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800b4e59800/0x40a459093b0687bc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129563.341263:0:22480:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b4e59800 already unused, calling callback (ffffffffa086ed70) 00010000:00010000:0.0:1746129563.341265:0:22480:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800b4e59800/0x40a459093b0687bc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129563.341271:0:22480:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800b4e59800/0x40a459093b0687bc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129563.341284:0:22480:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800b4e59800/0x40a459093b0687bc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129563.341289:0:22480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b4e59800/0x40a459093b0687bc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129563.342136:0:22480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013577f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:068dab75-d300-4ead-a742-d14572ad1e50+10:1961:x1830948733891072:12345-192.168.202.4@tcp:1:mirror_io.0 Request processed in 34982us (35029us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129563.342144:0:22480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15588 00000100:00100000:0.0:1746129563.343530:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129563.343574:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00010000:00010000:0.0:1746129563.344471:0:11014:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880090078e00/0x40a459093b0687ca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129563.344479:0:11014:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090078e00/0x40a459093b0687ca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129563.344501:0:11014:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880090078e00/0x40a459093b0687ca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129563.344507:0:11014:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880090078e00/0x40a459093b0687ca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129563.344514:0:11014:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880090078e00/0x40a459093b0687ca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129563.344520:0:11014:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090078e00 already unused, calling callback (ffffffffa086ed70) 00010000:00010000:0.0:1746129563.344524:0:11014:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880090078e00/0x40a459093b0687ca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129563.344535:0:11014:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880090078e00/0x40a459093b0687ca lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129563.344545:0:11014:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880090078e00/0x40a459093b0687ca lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129563.344550:0:11014:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090078e00/0x40a459093b0687ca lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129563.344610:0:11014:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013577e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:068dab75-d300-4ead-a742-d14572ad1e50+9:1961:x1830948733891584:12345-192.168.202.4@tcp:1:mirror_io.0 Request processed in 32988us (35069us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129563.344617:0:11014:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15590 00000100:00100000:1.0:1746129563.344696:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129563.344800:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733893888 00000100:00100000:0.0:1746129563.344805:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733893888 00010000:00010000:0.0:1746129563.344822:0:9823:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095ab1a00/0x40a459093b068729 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1540096->1904639) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20255 expref: 17 pid: 11014 timeout: 918 lvb_type: 0 00000100:00100000:0.0:1746129563.344847:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7971 00000100:00100000:0.0:1746129563.344852:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132c25880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+17:1960:x1830948733893888:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129563.344860:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129563.344870:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095ab1a00/0x40a459093b068729 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1540096->1904639) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20255 expref: 17 pid: 11014 timeout: 918 lvb_type: 0 00010000:00010000:0.0:1746129563.344879:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095ab1a00/0x40a459093b068729 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1540096->1904639) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20255 expref: 17 pid: 11014 timeout: 918 lvb_type: 0 00010000:00010000:0.0:1746129563.344894:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095ab1a00/0x40a459093b068729 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1540096->1904639) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20255 expref: 17 pid: 11014 timeout: 918 lvb_type: 0 00010000:00010000:0.0:1746129563.344903:0:9823:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129563.344904:0:9823:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129563.344907:0:9823:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880134b09e00/0x40a459093b0687ae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129563.344914:0:9823:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880134b09e00/0x40a459093b0687ae lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129563.344928:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746129563.344940:0:7149:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880134b09e00/0x40a459093b0687ae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129563.344947:0:7149:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880134b09e00/0x40a459093b0687ae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129563.344959:0:7149:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880134b09e00/0x40a459093b0687ae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129563.344965:0:7149:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880134b09e00/0x40a459093b0687ae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129563.344971:0:7149:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880134b09e00/0x40a459093b0687ae lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129563.344979:0:7149:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880134b09e00 already unused, calling callback (ffffffffa086ed70) 00010000:00010000:0.0:1746129563.344982:0:7149:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880134b09e00/0x40a459093b0687ae lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129563.344987:0:7149:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880134b09e00/0x40a459093b0687ae lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129563.344994:0:7149:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880134b09e00/0x40a459093b0687ae lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129563.344999:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880134b09e00/0x40a459093b0687ae lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129563.345760:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:068dab75-d300-4ead-a742-d14572ad1e50+8:1961:x1830948733891456:12345-192.168.202.4@tcp:1:mirror_io.0 Request processed in 38956us (39069us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129563.345766:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15586 00000100:00100000:0.0:1746129563.345795:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132c25880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+16:1960:x1830948733893888:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 943us (1100us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129563.345800:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7971 00000100:00100000:0.0:1746129563.349992:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129563.357107:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129563.357145:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129563.357514:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129563.358583:0:15749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733894400 00000100:00100000:0.0:1746129563.358588:0:15749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733894400 00010000:00010000:0.0:1746129563.358604:0:15749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095123200/0x40a459093b0682a6 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1ffae expref: 308 pid: 2271 timeout: 918 lvb_type: 0 00000100:00100000:0.0:1746129563.358620:0:15749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7975 00000100:00100000:0.0:1746129563.358625:0:15749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ada2ffba-8920-4ecb-8068-68caa9806978+308:1963:x1830948733894400:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129563.358630:0:15749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129563.358634:0:15749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880095123200/0x40a459093b0682a6 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1ffae expref: 308 pid: 2271 timeout: 918 lvb_type: 0 00010000:00010000:0.0:1746129563.358642:0:15749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880095123200/0x40a459093b0682a6 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1ffae expref: 308 pid: 2271 timeout: 918 lvb_type: 0 00010000:00010000:0.0:1746129563.358653:0:15749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095123200/0x40a459093b0682a6 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1ffae expref: 308 pid: 2271 timeout: 918 lvb_type: 0 00010000:00010000:0.0:1746129563.358664:0:15749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009f469400) 00010000:00010000:0.0:1746129563.358667:0:15749:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800945c2c00/0x40a459093b0687d1 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129563.358671:0:15749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129563.358687:0:15749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ada2ffba-8920-4ecb-8068-68caa9806978+307:1963:x1830948733894400:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 63us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129563.358692:0:15749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7975 00000100:00100000:1.0:1746129563.358923:0:7086:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733894656 00000100:00100000:1.0:1746129563.358926:0:7086:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733894656 00010000:00010000:1.0:1746129563.358940:0:7086:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb26c00/0x40a459093b06814f lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fee3 expref: 307 pid: 2271 timeout: 918 lvb_type: 0 00000100:00100000:1.0:1746129563.358953:0:7086:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7976 00000100:00100000:1.0:1746129563.358958:0:7086:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ada2ffba-8920-4ecb-8068-68caa9806978+307:1963:x1830948733894656:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129563.358963:0:7086:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129563.358967:0:7086:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb26c00/0x40a459093b06814f lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fee3 expref: 307 pid: 2271 timeout: 918 lvb_type: 0 00010000:00010000:1.0:1746129563.358974:0:7086:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb26c00/0x40a459093b06814f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fee3 expref: 307 pid: 2271 timeout: 918 lvb_type: 0 00010000:00010000:1.0:1746129563.358984:0:7086:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb26c00/0x40a459093b06814f lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f1fee3 expref: 307 pid: 2271 timeout: 918 lvb_type: 0 00010000:00010000:1.0:1746129563.358996:0:7086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009f469400) 00010000:00010000:1.0:1746129563.358999:0:7086:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800945c2c00/0x40a459093b0687d1 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746129563.359005:0:7086:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800945c2c00/0x40a459093b0687d1 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746129563.359011:0:7086:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800945c2c00/0x40a459093b0687d1 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746129563.359033:0:7086:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129563.359052:0:7086:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ada2ffba-8920-4ecb-8068-68caa9806978+306:1963:x1830948733894656:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 94us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129563.359057:0:7086:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7976 00000001:00080000:0.0:1746129563.395131:0:14619:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945163 is committed 00000001:00080000:0.0:1746129563.395148:0:14619:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945154 is committed 00000001:00080000:0.0:1746129563.395159:0:14619:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945120 is committed 00000001:00080000:0.0:1746129563.395164:0:14619:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945165 is committed 00000001:00080000:0.0:1746129563.395169:0:14619:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945152 is committed 00000001:00080000:0.0:1746129563.395207:0:14619:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945162 is committed 00000001:00080000:0.0:1746129563.395215:0:14619:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945156 is committed 00000001:00080000:0.0:1746129563.395230:0:14619:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945168 is committed 00000004:00080000:0.0:1746129563.395234:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2581 committed 00000004:00080000:0.0:1746129563.395242:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2560 committed 00000004:00080000:0.0:1746129563.395249:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2559 committed 00000004:00080000:0.0:1746129563.395251:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2558 committed 00000004:00080000:0.0:1746129563.395253:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2557 committed 00000004:00080000:0.0:1746129563.395254:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2580 committed 00000004:00080000:0.0:1746129563.395256:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2556 committed 00000004:00080000:0.0:1746129563.395258:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2579 committed 00000004:00080000:0.0:1746129563.395259:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2555 committed 00000004:00080000:0.0:1746129563.395261:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2578 committed 00000004:00080000:0.0:1746129563.395262:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2577 committed 00000004:00080000:0.0:1746129563.395263:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2576 committed 00000004:00080000:0.0:1746129563.395265:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2554 committed 00000004:00080000:0.0:1746129563.395266:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2553 committed 00000004:00080000:0.0:1746129563.395267:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2575 committed 00000004:00080000:0.0:1746129563.395268:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2574 committed 00000004:00080000:0.0:1746129563.395270:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2552 committed 00000100:00100000:0.0:1746129563.395485:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013577ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737421568:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129563.395547:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129563.395587:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a77b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737422080:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129563.395599:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129563.395615:0:3300:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1746129563.395618:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013577ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737421696:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129563.395629:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129563.395638:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a77b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737422208:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129563.395647:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129563.395667:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737421568 00000100:00100000:0.0:1746129563.395673:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737421568 00000100:00100000:0.0:1746129563.395708:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737422080 00000100:00100000:0.0:1746129563.395710:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737422080 00000100:00100000:0.0:1746129563.395718:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737421696 00000100:00100000:0.0:1746129563.395719:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737421696 00000100:00100000:0.0:1746129563.395726:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737422208 00000100:00100000:0.0:1746129563.395728:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737422208 00000100:00100000:0.0:1746129563.395739:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15591 00000100:00100000:0.0:1746129563.395745:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094efea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+53:3300:x1830948737421568:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129563.395940:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094efea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+54:3300:x1830948737421568:12345-0@lo:2:osp-syn-0-0.0 Request processed in 194us (392us total) trans 21474841234 rc 0/0 00000100:00100000:0.0:1746129563.395946:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15591 00000100:00100000:0.0:1746129563.395965:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15592 00000100:00100000:0.0:1746129563.395968:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+53:3300:x1830948737422080:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129563.396041:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+54:3300:x1830948737422080:12345-0@lo:2:osp-syn-0-0.0 Request processed in 72us (440us total) trans 21474841235 rc 0/0 00000100:00100000:0.0:1746129563.396046:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15592 00000100:00100000:0.0:1746129563.396057:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15593 00000100:00100000:0.0:1746129563.396061:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+53:3300:x1830948737421696:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129563.396135:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+54:3300:x1830948737421696:12345-0@lo:2:osp-syn-0-0.0 Request processed in 73us (504us total) trans 21474841236 rc 0/0 00000100:00100000:0.0:1746129563.396140:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15593 00000100:00100000:0.0:1746129563.396149:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15594 00000100:00100000:0.0:1746129563.396153:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+53:3300:x1830948737422208:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129563.396221:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+54:3300:x1830948737422208:12345-0@lo:2:osp-syn-0-0.0 Request processed in 67us (572us total) trans 21474841237 rc 0/0 00000100:00100000:0.0:1746129563.396225:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15594 00000100:00080000:0.0:1746129563.396248:0:7097:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1746129563.396281:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013577ed80/2, rc 0, transno 21474841236 00000100:00100000:0.0:1746129563.396289:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013577ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737421696:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129563.396326:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a77b0e00/2, rc 0, transno 21474841237 00000100:00100000:0.0:1746129563.396329:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a77b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737422208:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129563.396336:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013577ca80/2, rc 0, transno 21474841234 00000100:00100000:0.0:1746129563.396338:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013577ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737421568:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129563.396344:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a77b3480/2, rc 0, transno 21474841235 00000100:00100000:0.0:1746129563.396346:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a77b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737422080:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129563.396392:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737422592:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129563.396411:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129563.396443:0:8410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737422592 00000100:00100000:0.0:1746129563.396446:0:8410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737422592 00000100:00100000:0.0:1746129563.396461:0:8410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15595 00000100:00100000:0.0:1746129563.396465:0:8410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+54:3300:x1830948737422592:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129563.396544:0:8410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+55:3300:x1830948737422592:12345-0@lo:2:osp-syn-0-0.0 Request processed in 78us (132us total) trans 21474841238 rc 0/0 00000100:00100000:0.0:1746129563.396549:0:8410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15595 00000004:00080000:0.0:1746129563.396660:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c7da300/2, rc 0, transno 21474841238 00000100:00100000:0.0:1746129563.396664:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737422592:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129563.407889:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129563.417453:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129563.417494:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129563.417512:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129563.417527:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129563.417542:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129563.417587:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129563.417648:0:11014:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733895424 00000100:00100000:1.0:1746129563.417653:0:11014:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733895424 00000100:00100000:1.0:1746129563.417688:0:11014:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733895680 00000100:00100000:1.0:1746129563.417690:0:11014:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733895680 00000100:00100000:1.0:1746129563.418496:0:11014:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15609 00000100:00100000:1.0:1746129563.418504:0:11014:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800903a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:068dab75-d300-4ead-a742-d14572ad1e50+10:1963:x1830948733895168:12345-192.168.202.4@tcp:101:mirror_io.0 00010000:00010000:1.0:1746129563.418512:0:11014:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129563.418526:0:11014:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e0bb800/0x40a459093b0687f4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f202b0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746129563.418544:0:11014:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3ec:0x0] initial LVB size: 1048576, mtime: 0x6813d299, atime: 0x6813d299, ctime: 0x6813d299, blocks: 0x7bd 00010000:00010000:1.0:1746129563.418553:0:11014:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129563.418554:0:11014:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129563.418559:0:11014:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e0bb800/0x40a459093b0687f4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f202b0 expref: 11 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129563.418568:0:11014:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008e0bb800/0x40a459093b0687f4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f202b0 expref: 11 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129563.418575:0:11014:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e0bb800, rc 0) 00000100:00100000:1.0:1746129563.419594:0:11014:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800903a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:068dab75-d300-4ead-a742-d14572ad1e50+11:1963:x1830948733895168:12345-192.168.202.4@tcp:101:mirror_io.0 Request processed in 1090us (2152us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129563.419600:0:11014:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15609 00010000:00010000:0.0:1746129563.442696:0:9822:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746129563.853924:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129563.855508:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129563.855756:0:14545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733895936 00000100:00100000:1.0:1746129563.855767:0:14545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733895936 00000100:00100000:1.0:1746129563.855809:0:14545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 215 00000100:00100000:1.0:1746129563.855817:0:14545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8b5f81a-2f18-4d7f-accf-308742f5a04f+15:1962:x1830948733895936:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:1.0:1746129563.855880:0:14545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8b5f81a-2f18-4d7f-accf-308742f5a04f+15:1962:x1830948733895936:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 64us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129563.855887:0:14545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 215 00000100:00100000:0.0:1746129563.856277:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129563.856373:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129563.856409:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129563.856429:0:14547:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733896064 00000100:00100000:0.0:1746129563.856433:0:14547:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733896064 00000100:00100000:0.0:1746129563.856477:0:14547:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733896448 00000100:00100000:0.0:1746129563.856480:0:14547:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733896448 00000100:00100000:0.0:1746129563.856497:0:14547:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 191 00000100:00100000:0.0:1746129563.856502:0:14547:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013575f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ada2ffba-8920-4ecb-8068-68caa9806978+288:1963:x1830948733896064:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:0.0:1746129563.856556:0:14547:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013575f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ada2ffba-8920-4ecb-8068-68caa9806978+288:1963:x1830948733896064:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 54us (2642us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129563.856561:0:14547:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 191 00000100:00100000:0.0:1746129563.856576:0:14547:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 192 00000100:00100000:0.0:1746129563.856580:0:14547:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013575c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+6:1962:x1830948733896448:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:0.0:1746129563.856601:0:14547:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013575c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+6:1962:x1830948733896448:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 20us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129563.856606:0:14547:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 192 00000100:00100000:0.0:1746129563.856660:0:22480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733896320 00000100:00100000:0.0:1746129563.856663:0:22480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733896320 00000100:00100000:0.0:1746129563.856682:0:22480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733896192 00000100:00100000:0.0:1746129563.856683:0:22480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733896192 00000100:00100000:0.0:1746129563.856698:0:22480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 338 00000100:00100000:0.0:1746129563.856703:0:22480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013575fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ada2ffba-8920-4ecb-8068-68caa9806978+33:1963:x1830948733896320:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:0.0:1746129563.856728:0:22480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013575fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ada2ffba-8920-4ecb-8068-68caa9806978+33:1963:x1830948733896320:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 25us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129563.856733:0:22480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 338 00000100:00100000:0.0:1746129563.856742:0:22480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 339 00000100:00100000:0.0:1746129563.856746:0:22480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bf7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ada2ffba-8920-4ecb-8068-68caa9806978+27:1962:x1830948733896192:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:0.0:1746129563.856765:0:22480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bf7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ada2ffba-8920-4ecb-8068-68caa9806978+27:1962:x1830948733896192:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 19us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129563.856771:0:22480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 339 00000100:00100000:0.0:1746129563.858985:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129563.859023:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129563.860440:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129563.861042:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129563.861075:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129564.429653:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129564.442659:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129564.449168:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129564.449191:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129564.449217:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129564.449230:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129564.449242:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129564.449259:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129564.449287:0:31520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733897984 00000100:00100000:0.0:1746129564.449313:0:31520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733897984 00000100:00100000:0.0:1746129564.449380:0:31520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733898240 00000100:00100000:0.0:1746129564.449383:0:31520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733898240 00000100:00100000:0.0:1746129564.449397:0:31520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733898112 00000100:00100000:0.0:1746129564.449399:0:31520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733898112 00000100:00100000:0.0:1746129564.449409:0:31520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733898496 00000100:00100000:0.0:1746129564.449411:0:31520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733898496 00000100:00100000:0.0:1746129564.449423:0:31520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733898752 00000100:00100000:0.0:1746129564.449424:0:31520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733898752 00000100:00100000:0.0:1746129564.449430:0:31520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733898624 00000100:00100000:0.0:1746129564.449432:0:31520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733898624 00000100:00100000:0.0:1746129564.449442:0:31520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7503 00000100:00100000:0.0:1746129564.449449:0:31520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013575ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:068dab75-d300-4ead-a742-d14572ad1e50+12:1960:x1830948733897984:12345-192.168.202.4@tcp:3:mirror_io.0 00010000:00010000:0.0:1746129564.449486:0:31520:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880095fb0c00/0x40a459093b068825 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31520 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129564.449502:0:31520:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129564.449504:0:31520:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129564.449509:0:31520:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095fb0c00/0x40a459093b068825 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31520 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129564.449521:0:31520:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095fb0c00/0x40a459093b068825 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31520 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129564.450994:0:21463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7505 00000100:00100000:0.0:1746129564.451001:0:21463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013575c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:068dab75-d300-4ead-a742-d14572ad1e50+13:1960:x1830948733898112:12345-192.168.202.4@tcp:3:mirror_io.0 00010000:00010000:0.0:1746129564.451018:0:21463:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880095fb0400/0x40a459093b068833 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129564.451025:0:21463:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129564.451026:0:21463:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129564.451029:0:21463:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095fb0400/0x40a459093b068833 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129564.451036:0:21463:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095fb0400/0x40a459093b068833 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21463 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129564.451082:0:21725:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7506 00000100:00100000:0.0:1746129564.451087:0:21725:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013575ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:068dab75-d300-4ead-a742-d14572ad1e50+15:1960:x1830948733898496:12345-192.168.202.4@tcp:3:mirror_io.0 00010000:00010000:0.0:1746129564.451104:0:21725:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009c355000/0x40a459093b06883a lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129564.451110:0:21725:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129564.451111:0:21725:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129564.451114:0:21725:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c355000/0x40a459093b06883a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129564.451120:0:21725:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c355000/0x40a459093b06883a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21725 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129564.452057:0:8417:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7507 00000100:00100000:1.0:1746129564.452069:0:8417:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f958e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:068dab75-d300-4ead-a742-d14572ad1e50+15:1960:x1830948733898752:12345-192.168.202.4@tcp:3:mirror_io.0 00010000:00010000:1.0:1746129564.452092:0:8417:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88008e0ba600/0x40a459093b068841 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129564.452101:0:8417:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129564.452103:0:8417:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129564.452106:0:8417:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e0ba600/0x40a459093b068841 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129564.452115:0:8417:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e0ba600/0x40a459093b068841 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129564.452285:0:8416:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7508 00000100:00100000:1.0:1746129564.452291:0:8416:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f958380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:068dab75-d300-4ead-a742-d14572ad1e50+15:1960:x1830948733898624:12345-192.168.202.4@tcp:3:mirror_io.0 00010000:00010000:1.0:1746129564.452318:0:8416:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88008e0ba000/0x40a459093b068848 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8416 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129564.452325:0:8416:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129564.452326:0:8416:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129564.452329:0:8416:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e0ba000/0x40a459093b068848 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8416 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129564.452336:0:8416:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e0ba000/0x40a459093b068848 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8416 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129564.494471:0:31520:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880095fb0c00/0x40a459093b068825 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31520 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129564.494491:0:31520:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880095fb0c00/0x40a459093b068825 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31520 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129564.494500:0:31520:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880095fb0c00/0x40a459093b068825 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31520 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129564.494506:0:31520:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095fb0c00 already unused, calling callback (ffffffffa086ed70) 00010000:00010000:0.0:1746129564.494510:0:31520:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880095fb0c00/0x40a459093b068825 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31520 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129564.494518:0:31520:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880095fb0c00/0x40a459093b068825 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31520 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129564.494539:0:31520:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880095fb0c00/0x40a459093b068825 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31520 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129564.494546:0:31520:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095fb0c00/0x40a459093b068825 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31520 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129564.494658:0:31520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013575ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:068dab75-d300-4ead-a742-d14572ad1e50+14:1960:x1830948733897984:12345-192.168.202.4@tcp:3:mirror_io.0 Request processed in 45203us (45498us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129564.494667:0:31520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7503 00010000:00010000:1.0:1746129564.536665:0:8416:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88008e0ba000/0x40a459093b068848 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8416 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129564.536673:0:8416:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008e0ba000/0x40a459093b068848 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8416 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129564.536678:0:8416:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008e0ba000/0x40a459093b068848 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8416 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129564.536682:0:8416:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008e0ba000 already unused, calling callback (ffffffffa086ed70) 00010000:00010000:1.0:1746129564.536685:0:8416:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008e0ba000/0x40a459093b068848 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8416 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129564.536690:0:8416:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008e0ba000/0x40a459093b068848 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8416 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129564.536700:0:8416:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008e0ba000/0x40a459093b068848 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8416 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129564.536706:0:8416:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e0ba000/0x40a459093b068848 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8416 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129564.536749:0:8416:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f958380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:068dab75-d300-4ead-a742-d14572ad1e50+13:1960:x1830948733898624:12345-192.168.202.4@tcp:3:mirror_io.0 Request processed in 84457us (87488us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129564.536756:0:8416:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7508 00010000:00010000:1.0:1746129564.536999:0:21725:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009c355000/0x40a459093b06883a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129564.537006:0:21725:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009c355000/0x40a459093b06883a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129564.537011:0:21725:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009c355000/0x40a459093b06883a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129564.537015:0:21725:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c355000 already unused, calling callback (ffffffffa086ed70) 00010000:00010000:1.0:1746129564.537018:0:21725:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009c355000/0x40a459093b06883a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129564.537022:0:21725:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009c355000/0x40a459093b06883a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129564.537032:0:21725:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009c355000/0x40a459093b06883a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129564.537037:0:21725:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c355000/0x40a459093b06883a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21725 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129564.537077:0:21725:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013575ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:068dab75-d300-4ead-a742-d14572ad1e50+11:1960:x1830948733898496:12345-192.168.202.4@tcp:3:mirror_io.0 Request processed in 85989us (87845us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129564.537083:0:21725:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7506 00000100:00100000:0.0:1746129564.541264:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00080000:0.0:1746129564.541620:0:7097:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746129564.542867:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129564.546802:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129564.564045:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129564.582933:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129564.582960:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129564.582982:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129564.583005:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733900032 00000100:00100000:0.0:1746129564.583013:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733900032 00000100:00100000:0.0:1746129564.583051:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733900160 00000100:00100000:0.0:1746129564.583052:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733900160 00000100:00100000:0.0:1746129564.583288:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15616 00000100:00100000:0.0:1746129564.583444:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094efea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ada2ffba-8920-4ecb-8068-68caa9806978+21:1962:x1830948733900160:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129564.583450:0:7148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129564.583456:0:7148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c663200/0x40a459093b068880 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f202ef expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129564.583469:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129564.583471:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129564.583475:0:7148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c663200/0x40a459093b068880 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f202ef expref: 22 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129564.583483:0:7148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c663200/0x40a459093b068880 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f202ef expref: 22 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129564.583488:0:7148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c663200, rc 0) 00000100:00100000:0.0:1746129564.583504:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094efea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ada2ffba-8920-4ecb-8068-68caa9806978+22:1962:x1830948733900160:12345-192.168.202.4@tcp:101:cat.0 Request processed in 63us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129564.583698:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129564.583752:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129564.583764:0:11014:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733900288 00000100:00100000:1.0:1746129564.583768:0:11014:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733900288 00000100:00100000:0.0:1746129564.590408:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15616 00000100:00100000:1.0:1746129564.590544:0:11014:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15619 00000100:00100000:1.0:1746129564.590558:0:11014:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132c24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ada2ffba-8920-4ecb-8068-68caa9806978+29:1963:x1830948733900288:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129564.590578:0:11014:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129564.590594:0:11014:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880132dfde00/0x40a459093b0688c6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f202f6 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129564.590617:0:11014:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129564.590618:0:11014:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129564.590627:0:11014:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880132dfde00/0x40a459093b0688c6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f202f6 expref: 30 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129564.590641:0:11014:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880132dfde00/0x40a459093b0688c6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f202f6 expref: 30 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129564.590650:0:11014:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132dfde00, rc 0) 00000100:00100000:1.0:1746129564.590688:0:11014:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132c24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ada2ffba-8920-4ecb-8068-68caa9806978+30:1963:x1830948733900288:12345-192.168.202.4@tcp:101:cat.0 Request processed in 137us (6935us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129564.590693:0:11014:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15619 00000100:00100000:0.0:1746129564.590998:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129564.600786:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129564.600830:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129564.600857:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733901696 00000100:00100000:1.0:1746129564.600865:0:2271:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733901568 00000100:00100000:0.0:1746129564.600865:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733901696 00000100:00100000:1.0:1746129564.600871:0:2271:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733901568 00010000:00010000:0.0:1746129564.600900:0:7087:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880132f99800/0x40a459093b06889c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2030b expref: 9 pid: 16908 timeout: 919 lvb_type: 0 00000100:00100000:1.0:1746129564.601536:0:2271:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11102 00000100:00100000:1.0:1746129564.601547:0:2271:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+9:32061:x1830948733901568:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129564.601571:0:2271:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129564.601590:0:2271:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880132dfd600/0x40a459093b0688cd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20319 expref: -99 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129564.601697:0:2271:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4ed200/0x40a459093b0688d4 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 2271 initiator: MDT0 00010000:00010000:1.0:1746129564.601711:0:2271:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4ed200/0x40a459093b0688d4 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:1.0:1746129564.601722:0:2271:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4ed200/0x40a459093b0688d4 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00000004:00200000:1.0:1746129564.601731:0:2271:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:1.0:1746129564.601856:0:2271:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880132dfd600/0x40a459093b0688cd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20319 expref: 12 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129564.601881:0:2271:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4ed200/0x40a459093b0688d4 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20319 expref: 11 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129564.601888:0:2271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009f469400) 00010000:00010000:1.0:1746129564.601891:0:2271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1746129564.601894:0:2271:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880095f6c000/0x40a459093b0688bf lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746129564.601899:0:2271:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880095f6c000/0x40a459093b0688bf lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:1.0:1746129564.601904:0:2271:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c4ed200, rc 0) 00000100:00100000:1.0:1746129564.601957:0:2271:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+11:32061:x1830948733901568:12345-192.168.202.4@tcp:101:cat.0 Request processed in 412us (1181us total) trans 8589945173 rc 0/0 00000100:00100000:1.0:1746129564.601962:0:2271:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11102 00000100:00100000:0.0:1746129564.612589:0:2271:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733901952 00000100:00100000:0.0:1746129564.612599:0:2271:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733901952 00000100:00100000:0.0:1746129564.614453:0:2271:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11104 00000100:00100000:0.0:1746129564.614469:0:2271:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+9:32061:x1830948733901952:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129564.614496:0:2271:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129564.614518:0:2271:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9208400/0x40a459093b0688f0 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20327 expref: -99 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129564.614612:0:2271:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090079800/0x40a459093b0688f7 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129564.614627:0:2271:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f6c000/0x40a459093b0688bf lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20312 expref: 291 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129564.614634:0:2271:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090079800/0x40a459093b0688f7 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129564.614665:0:2271:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880095f6c000/0x40a459093b0688bf lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20312 expref: 291 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129564.614677:0:2271:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f6c000/0x40a459093b0688bf lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20312 expref: 291 pid: 14547 timeout: 919 lvb_type: 0 00000100:00100000:0.0:1746129564.614689:0:2271:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7d9500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:2271:1830948737424000:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129564.614844:0:2271:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093da83c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129564.615800:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129564.623517:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129564.623519:0:2271:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7d9500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:2271:1830948737424000:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129564.623547:0:2271:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880090079800/0x40a459093b0688f7 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 2271 initiator: MDT0 00010000:00010000:1.0:1746129564.623873:0:2271:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880090079800/0x40a459093b0688f7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 2271 initiator: MDT0 00010000:00010000:1.0:1746129564.623880:0:2271:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090079800/0x40a459093b0688f7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 2271 initiator: MDT0 00000004:00200000:1.0:1746129564.623926:0:2271:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00000004:00200000:1.0:1746129564.623930:0:2271:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746129564.623947:0:2271:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880090079800/0x40a459093b0688f7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 2271 initiator: MDT0 00010000:00010000:1.0:1746129564.623979:0:2271:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9208400/0x40a459093b0688f0 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20327 expref: 12 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129564.624575:0:2271:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880090079800/0x40a459093b0688f7 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20327 expref: 11 pid: 2271 timeout: 919 lvb_type: 0 00010000:00010000:1.0:1746129564.624584:0:2271:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090079800/0x40a459093b0688f7 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20327 expref: 11 pid: 2271 timeout: 919 lvb_type: 0 00010000:00010000:1.0:1746129564.624589:0:2271:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090079800, rc 0) 00000100:00100000:1.0:1746129564.624624:0:2271:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+11:32061:x1830948733901952:12345-192.168.202.4@tcp:101:cat.0 Request processed in 10162us (12116us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129564.624631:0:2271:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11104 00000100:00100000:0.0:1746129564.625648:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129564.625687:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129564.625759:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129564.625983:0:21725:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733902848 00000100:00100000:1.0:1746129564.625990:0:21725:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733902848 00002000:00100000:1.0:1746129564.626028:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ec:0x0] (0->1048575) req@ffff8800912ae680 x1830948733902848/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:305/0 lens 488/0 e 0 to 0 dl 1746129575 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129564.626044:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800912ae680 with x1830948733902848 ext(0->1048575) 00002000:00010000:1.0:1746129564.626048:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800912ae680 00000100:00100000:1.0:1746129564.626065:0:21725:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7509 00000100:00100000:1.0:1746129564.626071:0:21725:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800912ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ada2ffba-8920-4ecb-8068-68caa9806978+30:1960:x1830948733902848:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129564.629083:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129564.633987:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129564.634032:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129564.634061:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129564.634110:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129564.634145:0:8416:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733903360 00000100:00100000:0.0:1746129564.634156:0:8416:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733903360 00002000:00100000:0.0:1746129564.634209:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff880090e6ce00 x1830948733903360/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:305/0 lens 488/0 e 0 to 0 dl 1746129575 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129564.634219:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090e6ce00 with x1830948733903360 ext(1048576->2097151) 00002000:00010000:0.0:1746129564.634225:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090e6ce00 00000100:00100000:0.0:1746129564.634247:0:8416:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733903616 00000100:00100000:0.0:1746129564.634251:0:8416:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733903616 00002000:00100000:0.0:1746129564.634267:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3f4:0x0] (1048576->2097151) req@ffff880090e6d180 x1830948733903616/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:305/0 lens 488/0 e 0 to 0 dl 1746129575 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129564.634274:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090e6d180 with x1830948733903616 ext(1048576->2097151) 00002000:00010000:0.0:1746129564.634277:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090e6d180 00000100:00100000:0.0:1746129564.634290:0:8416:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733903872 00000100:00100000:0.0:1746129564.634321:0:8416:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733903872 00002000:00100000:0.0:1746129564.634340:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3ee:0x0] (1048576->2097151) req@ffff880090e6f100 x1830948733903872/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:305/0 lens 488/0 e 0 to 0 dl 1746129575 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129564.634347:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090e6f100 with x1830948733903872 ext(1048576->2097151) 00002000:00010000:0.0:1746129564.634351:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090e6f100 00000100:00100000:0.0:1746129564.634381:0:8416:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7510 00000100:00100000:0.0:1746129564.634392:0:8416:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ada2ffba-8920-4ecb-8068-68caa9806978+23:1961:x1830948733903360:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:1.0:1746129564.641725:0:2271:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733903104 00000100:00100000:1.0:1746129564.641737:0:2271:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733903104 00000100:00100000:1.0:1746129564.641793:0:2271:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11106 00000100:00100000:1.0:1746129564.641801:0:2271:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+11:32061:x1830948733903104:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129564.642045:0:2271:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129564.642065:0:2271:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094c34200/0x40a459093b06890c lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20335 expref: -99 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129564.642121:0:2271:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880132f99200/0x40a459093b068905 lrc: 2/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15096 initiator: MDT0 00010000:00010000:1.0:1746129564.642129:0:2271:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094c34200/0x40a459093b06890c lrc: 4/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20335 expref: 12 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129564.642148:0:2271:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff880132f99200/0x40a459093b068905 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 15096 initiator: MDT0 00010000:00010000:1.0:1746129564.642159:0:2271:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094c34200/0x40a459093b06890c lrc: 3/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20335 expref: 12 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129564.642171:0:2271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009f469400) 00010000:00010000:1.0:1746129564.642174:0:2271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746129564.642177:0:2271:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880094c34200/0x40a459093b06890c lrc: 3/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20335 expref: 12 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129564.642184:0:2271:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094c34200, rc 0) 00000100:00100000:1.0:1746129564.642230:0:2271:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+12:32061:x1830948733903104:12345-192.168.202.4@tcp:101:cat.0 Request processed in 429us (13162us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129564.642236:0:2271:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11106 00000100:00100000:1.0:1746129564.671928:0:21725:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800912ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ada2ffba-8920-4ecb-8068-68caa9806978+32:1960:x1830948733902848:12345-192.168.202.4@tcp:3:cat.0 Request processed in 45843us (46226us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129564.671943:0:21725:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7509 00002000:00100000:1.0:1746129564.671956:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ec:0x0] (0->1048575) req@ffff8800912ae680 x1830948733902848/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:305/0 lens 488/440 e 0 to 0 dl 1746129575 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129564.671966:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800912ae680 with x1830948733902848 ext(0->1048575) 00002000:00010000:1.0:1746129564.671973:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800912ae680 00000100:00100000:1.0:1746129564.686977:0:16908:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733904000 00000100:00100000:1.0:1746129564.686984:0:16908:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733904000 00000100:00100000:1.0:1746129564.687021:0:16908:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11107 00000100:00100000:1.0:1746129564.687029:0:16908:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ada2ffba-8920-4ecb-8068-68caa9806978+290:32060:x1830948733904000:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129564.687069:0:16908:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129564.687092:0:16908:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095122a00/0x40a459093b068913 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2033c expref: -99 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129564.687161:0:16908:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095122a00/0x40a459093b068913 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2033c expref: 291 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129564.687174:0:16908:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095122a00/0x40a459093b068913 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2033c expref: 291 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129564.687192:0:16908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009f469400) 00010000:00010000:1.0:1746129564.687196:0:16908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746129564.687199:0:16908:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880094c34200/0x40a459093b06890c lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20335 expref: 11 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129564.687206:0:16908:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095122a00, rc 0) 00000100:00100000:1.0:1746129564.687245:0:16908:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ada2ffba-8920-4ecb-8068-68caa9806978+291:32060:x1830948733904000:12345-192.168.202.4@tcp:101:cat.0 Request processed in 217us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129564.687251:0:16908:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11107 00000001:00080000:0.0:1746129564.706851:0:14619:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945173 is committed 00000001:00080000:0.0:1746129564.706864:0:14619:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945175 is committed 00000004:00080000:0.0:1746129564.706869:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2589 committed 00000004:00080000:0.0:1746129564.706877:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2569 committed 00000004:00080000:0.0:1746129564.706882:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2568 committed 00000004:00080000:0.0:1746129564.706884:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2567 committed 00000004:00080000:0.0:1746129564.706885:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2566 committed 00000004:00080000:0.0:1746129564.706887:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2588 committed 00000004:00080000:0.0:1746129564.706889:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2565 committed 00000004:00080000:0.0:1746129564.706890:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2587 committed 00000004:00080000:0.0:1746129564.706892:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2564 committed 00000004:00080000:0.0:1746129564.706893:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2586 committed 00000004:00080000:0.0:1746129564.706895:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2585 committed 00000004:00080000:0.0:1746129564.706896:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2584 committed 00000004:00080000:0.0:1746129564.706897:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2563 committed 00000004:00080000:0.0:1746129564.706899:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2562 committed 00000004:00080000:0.0:1746129564.706901:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2583 committed 00000004:00080000:0.0:1746129564.706902:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2582 committed 00000004:00080000:0.0:1746129564.706904:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2561 committed 00000001:00080000:0.0:1746129564.706909:0:14619:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945174 is committed 00000001:00080000:0.0:1746129564.706917:0:14619:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945170 is committed 00000100:00100000:0.0:1746129564.708131:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800903a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737425024:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129564.708176:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129564.708198:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ea91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737425536:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129564.708680:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129564.708922:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ea93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737426048:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129564.708923:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737424640:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129564.708945:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129564.708961:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ea90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737426560:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129564.708976:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129564.709001:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800903a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737424768:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129564.709017:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129564.709029:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ea93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737425280:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129564.709041:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129564.709042:0:4699:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737425024 00000100:00100000:1.0:1746129564.709048:0:4699:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737425024 00000100:00100000:0.0:1746129564.709050:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ea91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737425792:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129564.709061:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129564.709071:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ea90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737426304:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129564.709082:0:4699:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737425536 00000100:00100000:0.0:1746129564.709082:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129564.709084:0:4699:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737425536 00000100:00100000:1.0:1746129564.709094:0:4699:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737426048 00000100:00100000:0.0:1746129564.709094:0:3302:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:1.0:1746129564.709096:0:4699:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737426048 00000100:00100000:0.0:1746129564.709098:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800903a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737424896:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129564.709106:0:4699:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737426560 00000100:00100000:1.0:1746129564.709108:0:4699:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737426560 00000100:00100000:0.0:1746129564.709110:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129564.709115:0:4699:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737424768 00000100:00100000:1.0:1746129564.709116:0:4699:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737424768 00000100:00100000:0.0:1746129564.709118:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ea92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737425408:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129564.709122:0:4699:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737425280 00000100:00100000:1.0:1746129564.709123:0:4699:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737425280 00000100:00100000:1.0:1746129564.709129:0:4699:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737425792 00000100:00100000:0.0:1746129564.709129:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129564.709131:0:4699:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737425792 00000100:00100000:0.0:1746129564.709135:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ea92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737425920:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129564.709136:0:4699:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737426304 00000100:00100000:1.0:1746129564.709137:0:4699:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737426304 00000100:00100000:1.0:1746129564.709142:0:4699:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737424896 00000100:00100000:1.0:1746129564.709144:0:4699:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737424896 00000100:00100000:0.0:1746129564.709146:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129564.709149:0:4699:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737425408 00000100:00100000:0.0:1746129564.709151:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ea90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737426432:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129564.709152:0:4699:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737425408 00000100:00100000:1.0:1746129564.709157:0:4699:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737425920 00000100:00100000:1.0:1746129564.709158:0:4699:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737425920 00000100:00100000:0.0:1746129564.709165:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129564.709167:0:4699:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15620 00000100:00100000:1.0:1746129564.709174:0:4699:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+10:3300:x1830948737425024:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129564.709182:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737426432 00000100:00100000:0.0:1746129564.709184:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737426432 00000100:00100000:0.0:1746129564.709196:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15621 00000100:00100000:0.0:1746129564.709200:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+10:3300:x1830948737425536:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129564.709237:0:11014:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15622 00000100:00100000:0.0:1746129564.709240:0:11014:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+64:3300:x1830948737426048:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129564.709452:0:11014:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+65:3300:x1830948737426048:12345-0@lo:2:osp-syn-0-0.0 Request processed in 210us (505us total) trans 21474841243 rc 0/0 00000100:00100000:0.0:1746129564.709458:0:11014:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15622 00000100:00100000:0.0:1746129564.709472:0:11014:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15623 00000100:00100000:0.0:1746129564.709475:0:11014:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e87e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+64:3300:x1830948737426560:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129564.709556:0:11014:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e87e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+65:3300:x1830948737426560:12345-0@lo:2:osp-syn-0-0.0 Request processed in 79us (578us total) trans 21474841244 rc 0/0 00000100:00100000:0.0:1746129564.709589:0:11014:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15623 00000100:00100000:1.0:1746129564.710998:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15626 00000100:00100000:1.0:1746129564.711006:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e87ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+64:3302:x1830948737425792:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129564.711051:0:11014:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15627 00000100:00100000:0.0:1746129564.711057:0:11014:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e87ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+64:3302:x1830948737426304:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746129564.711121:0:7149:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746129564.711126:0:7149:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb mtime from disk: 1746129563 -> 1746129563 00002000:00010000:1.0:1746129564.711128:0:7149:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb atime from disk: 1746129563 -> 1746129563 00002000:00010000:1.0:1746129564.711130:0:7149:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb ctime from disk: 1746129563 -> 1746129563 00002000:00010000:1.0:1746129564.711132:0:7149:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746129564.711185:0:20577:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15628 00000100:00100000:1.0:1746129564.711191:0:20577:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e87f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+11:3302:x1830948737424896:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129564.711888:0:11014:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e87ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+66:3302:x1830948737426304:12345-0@lo:2:osp-syn-0-0.0 Request processed in 829us (2802us total) trans 21474841246 rc 0/0 00000100:00100000:0.0:1746129564.711894:0:11014:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15627 00000100:00100000:0.0:1746129564.711907:0:11014:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15629 00000100:00100000:0.0:1746129564.711911:0:11014:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e87dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+11:3302:x1830948737425408:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129564.711924:0:22480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15630 00000100:00100000:0.0:1746129564.711927:0:22480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e87ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+65:3302:x1830948737425920:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746129564.712132:0:22480:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb size from disk: 5146336 -> 5146336 00002000:00010000:0.0:1746129564.712135:0:22480:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb mtime from disk: 1746129563 -> 1746129563 00002000:00010000:0.0:1746129564.712136:0:22480:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb atime from disk: 1746129562 -> 1746129562 00002000:00010000:0.0:1746129564.712138:0:22480:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb ctime from disk: 1746129563 -> 1746129563 00002000:00010000:0.0:1746129564.712140:0:22480:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb blocks from disk: 6033 -> 6033 00000100:00100000:0.0:1746129564.712158:0:22480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e87ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+66:3302:x1830948737425920:12345-0@lo:2:osp-syn-0-0.0 Request processed in 230us (3011us total) trans 21474841247 rc 0/0 00000100:00100000:0.0:1746129564.712162:0:22480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15630 00000100:00100000:0.0:1746129564.712171:0:22480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15631 00000100:00100000:0.0:1746129564.712175:0:22480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+65:3302:x1830948737426432:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746129564.712231:0:22480:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746129564.712233:0:22480:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1746129564.712234:0:22480:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746129564.712236:0:22480:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746129564.712238:0:22480:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1746129564.712252:0:22480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+66:3302:x1830948737426432:12345-0@lo:2:osp-syn-0-0.0 Request processed in 76us (3086us total) trans 21474841248 rc 0/0 00000100:00100000:0.0:1746129564.712257:0:22480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15631 00000100:00100000:0.0:1746129564.712355:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129564.714653:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000004:00080000:0.0:1746129564.714695:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ea92a00/2, rc 0, transno 21474841247 00000100:00100000:0.0:1746129564.714704:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ea92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737425920:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129564.714712:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ea90700/2, rc 0, transno 21474841248 00000100:00100000:0.0:1746129564.714715:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ea90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737426432:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129564.714724:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ea90e00/2, rc 0, transno 21474841246 00000100:00100000:0.0:1746129564.714726:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ea90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737426304:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129564.714859:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ea93b80/2, rc 0, transno 21474841243 00000100:00100000:0.0:1746129564.714863:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ea93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737426048:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129564.714870:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ea90380/2, rc 0, transno 21474841244 00000100:00100000:0.0:1746129564.714873:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ea90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737426560:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129564.714876:0:3300:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1746129564.714886:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ceea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737426688:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129564.714917:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129564.714948:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4686 00000100:00100000:0.0:1746129564.714954:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ada2ffba-8920-4ecb-8068-68caa9806978+289:32060:x1830948733904256:12345-192.168.202.4@tcp:49:cat.0 00000100:00100000:1.0:1746129564.715231:0:8410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737426688 00000100:00100000:1.0:1746129564.715235:0:8410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737426688 00000100:00100000:1.0:1746129564.715256:0:8410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15632 00000100:00100000:1.0:1746129564.715260:0:8410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+66:3300:x1830948737426688:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129564.715455:0:8410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+67:3300:x1830948737426688:12345-0@lo:2:osp-syn-0-0.0 Request processed in 194us (536us total) trans 21474841249 rc 0/0 00000100:00100000:1.0:1746129564.715460:0:8410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15632 00000100:00100000:0.0:1746129564.716364:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ada2ffba-8920-4ecb-8068-68caa9806978+289:32060:x1830948733904256:12345-192.168.202.4@tcp:49:cat.0 Request processed in 1409us (1715us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129564.716380:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4686 00000100:00100000:0.0:1746129564.716401:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129564.716424:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800903a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737425152:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129564.716446:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129564.716458:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ea90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737425664:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129564.716471:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129564.716481:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ea90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737426176:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129564.716492:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129564.716512:0:8412:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737424640 00000100:00100000:0.0:1746129564.716516:0:8412:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737424640 00000100:00100000:0.0:1746129564.716531:0:8412:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737425152 00000100:00100000:0.0:1746129564.716532:0:8412:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737425152 00000100:00100000:0.0:1746129564.716538:0:8412:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737425664 00000100:00100000:0.0:1746129564.716540:0:8412:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737425664 00000100:00100000:0.0:1746129564.716546:0:8412:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737426176 00000100:00100000:0.0:1746129564.716548:0:8412:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737426176 00000100:00100000:0.0:1746129564.716556:0:8412:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15633 00000100:00100000:0.0:1746129564.716560:0:8412:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ced880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3301:x1830948737424640:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129564.716571:0:22481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15634 00000100:00100000:0.0:1746129564.716575:0:22481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+13:3301:x1830948737425152:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129564.716584:0:8411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15635 00000100:00100000:0.0:1746129564.716587:0:8411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ced500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+68:3301:x1830948737425664:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746129564.716698:0:8411:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3ec:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746129564.716702:0:8411:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ec:0x0] updating lvb mtime from disk: 1746129561 -> 1746129561 00002000:00010000:0.0:1746129564.716703:0:8411:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3ec:0x0] updating lvb atime from disk: 1746129561 -> 1746129561 00002000:00010000:0.0:1746129564.716705:0:8411:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ec:0x0] updating lvb ctime from disk: 1746129561 -> 1746129561 00002000:00010000:0.0:1746129564.716707:0:8411:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3ec:0x0] updating lvb blocks from disk: 1981 -> 1981 00000100:00100000:0.0:1746129564.716729:0:8411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ced500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+69:3301:x1830948737425664:12345-0@lo:2:osp-syn-0-0.0 Request processed in 141us (257us total) trans 21474841250 rc 0/0 00000100:00100000:0.0:1746129564.716737:0:8411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15635 00000100:00100000:0.0:1746129564.716748:0:8411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15636 00000100:00100000:0.0:1746129564.716752:0:8411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ceca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+68:3301:x1830948737426176:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129564.719231:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e87ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+69:3302:x1830948737425792:12345-0@lo:2:osp-syn-0-0.0 Request processed in 8214us (10156us total) trans 21474841245 rc 0/0 00000100:00100000:1.0:1746129564.719245:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15626 00000004:00080000:1.0:1746129564.719352:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ea91c00/2, rc 0, transno 21474841245 00000100:00100000:1.0:1746129564.719360:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ea91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737425792:0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746129564.719489:0:4699:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746129564.719493:0:4699:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb mtime from disk: 1746129523 -> 1746129523 00002000:00010000:1.0:1746129564.719495:0:4699:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb atime from disk: 1746129523 -> 1746129523 00002000:00010000:1.0:1746129564.719496:0:4699:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb ctime from disk: 1746129524 -> 1746129524 00002000:00010000:1.0:1746129564.719499:0:4699:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1746129564.719538:0:4699:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+14:3300:x1830948737425024:12345-0@lo:2:osp-syn-1-0.0 Request processed in 10362us (11361us total) trans 17179874012 rc 0/0 00000100:00100000:1.0:1746129564.719544:0:4699:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15620 00002000:00010000:1.0:1746129564.719755:0:4385:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746129564.719758:0:4385:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb mtime from disk: 1746129563 -> 1746129563 00002000:00010000:1.0:1746129564.719760:0:4385:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb atime from disk: 1746129562 -> 1746129562 00002000:00010000:1.0:1746129564.719762:0:4385:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb ctime from disk: 1746129563 -> 1746129563 00002000:00010000:1.0:1746129564.719764:0:4385:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746129564.719797:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e87e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+14:3302:x1830948737424768:12345-0@lo:2:osp-syn-1-0.0 Request processed in 10133us (10778us total) trans 17179874014 rc 0/0 00000100:00100000:1.0:1746129564.719803:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15624 00000100:00100000:1.0:1746129564.719944:0:31503:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e87c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+14:3302:x1830948737425280:12345-0@lo:2:osp-syn-1-0.0 Request processed in 10260us (10899us total) trans 17179874015 rc 0/0 00000100:00100000:1.0:1746129564.719950:0:31503:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15625 00002000:00010000:1.0:1746129564.720107:0:20577:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3f5:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746129564.720111:0:20577:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f5:0x0] updating lvb mtime from disk: 1746129563 -> 1746129563 00002000:00010000:1.0:1746129564.720113:0:20577:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f5:0x0] updating lvb atime from disk: 1746129562 -> 1746129562 00002000:00010000:1.0:1746129564.720114:0:20577:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f5:0x0] updating lvb ctime from disk: 1746129563 -> 1746129563 00002000:00010000:1.0:1746129564.720116:0:20577:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f5:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:1.0:1746129564.720143:0:20577:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e87f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+14:3302:x1830948737424896:12345-0@lo:2:osp-syn-1-0.0 Request processed in 8951us (11030us total) trans 17179874016 rc 0/0 00000100:00100000:1.0:1746129564.720153:0:20577:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15628 00000100:00100000:1.0:1746129564.720188:0:3302:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179874011 gen 2 00000004:00080000:1.0:1746129564.720195:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009feee300, transno 17179873947 00000004:00080000:1.0:1746129564.720205:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009feedf80, transno 17179873948 00000004:00080000:1.0:1746129564.720208:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009feeed80, transno 17179873949 00000004:00080000:1.0:1746129564.720210:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009feeca80, transno 17179873950 00000004:00080000:1.0:1746129564.720212:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009feeea00, transno 17179873951 00000004:00080000:1.0:1746129564.720214:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009feedc00, transno 17179873952 00000004:00080000:1.0:1746129564.720217:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009feef100, transno 17179873953 00000004:00080000:1.0:1746129564.720219:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009feec380, transno 17179873954 00000004:00080000:1.0:1746129564.720221:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009feef480, transno 17179873955 00000004:00080000:1.0:1746129564.720223:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009feec000, transno 17179873956 00000004:00080000:1.0:1746129564.720225:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009feef800, transno 17179873957 00000004:00080000:1.0:1746129564.720227:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009feefb80, transno 17179873958 00000004:00080000:1.0:1746129564.720229:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009feece00, transno 17179873959 00000004:00080000:1.0:1746129564.720232:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012cda7800, transno 17179873960 00000004:00080000:1.0:1746129564.720234:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091b06300, transno 17179873961 00000004:00080000:1.0:1746129564.720237:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009feed880, transno 17179873962 00000004:00080000:1.0:1746129564.720239:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e955f80, transno 17179873967 00000004:00080000:1.0:1746129564.720241:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e957480, transno 17179873968 00000004:00080000:1.0:1746129564.720244:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e956d80, transno 17179873969 00000004:00080000:1.0:1746129564.720247:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e954a80, transno 17179873970 00000004:00080000:1.0:1746129564.720249:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e957800, transno 17179873971 00000004:00080000:1.0:1746129564.720252:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e957b80, transno 17179873972 00000004:00080000:1.0:1746129564.720254:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e955500, transno 17179873973 00000004:00080000:1.0:1746129564.720256:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e954e00, transno 17179873974 00000004:00080000:1.0:1746129564.720259:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a07ae680, transno 17179873978 00000004:00080000:1.0:1746129564.720261:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a07ace00, transno 17179873979 00000004:00080000:1.0:1746129564.720265:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a07ad500, transno 17179873980 00000004:00080000:1.0:1746129564.720268:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a07aca80, transno 17179873981 00000004:00080000:1.0:1746129564.720270:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a07ac000, transno 17179873982 00000004:00080000:1.0:1746129564.720273:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a07ac380, transno 17179873983 00000004:00080000:1.0:1746129564.720275:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a07aed80, transno 17179873984 00000004:00080000:1.0:1746129564.720277:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a07afb80, transno 17179873985 00000004:00080000:1.0:1746129564.720280:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135725180, transno 17179873986 00000004:00080000:1.0:1746129564.720282:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135724a80, transno 17179873987 00000004:00080000:1.0:1746129564.720285:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094efe300, transno 17179873988 00000004:00080000:1.0:1746129564.720288:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c7d8000, transno 17179873989 00000004:00080000:1.0:1746129564.720290:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135724000, transno 17179873990 00000004:00080000:1.0:1746129564.720311:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135724700, transno 17179873991 00000004:00080000:1.0:1746129564.720314:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094eff100, transno 17179873992 00000004:00080000:1.0:1746129564.720316:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c7db480, transno 17179873993 00000004:00080000:1.0:1746129564.720318:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095627480, transno 17179874004 00000004:00080000:1.0:1746129564.720320:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095624a80, transno 17179874005 00000004:00080000:1.0:1746129564.720322:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095625c00, transno 17179874006 00000004:00080000:1.0:1746129564.720325:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095627b80, transno 17179874007 00000004:00080000:1.0:1746129564.720327:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095624380, transno 17179874008 00000004:00080000:1.0:1746129564.720329:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095625f80, transno 17179874009 00000004:00080000:1.0:1746129564.720331:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095627800, transno 17179874010 00000004:00080000:1.0:1746129564.720333:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095627100, transno 17179874011 00000100:00100000:1.0:1746129564.720339:0:3302:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff8800903a1880 x1830948737424896/t17179874016(17179874016) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746129580 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 00000004:00080000:1.0:1746129564.720348:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800903a1880/2, rc 0, transno 17179874016 00000100:00100000:1.0:1746129564.720353:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800903a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737424896:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746129564.720381:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800903a2300/2, rc 0, transno 17179874014 00000100:00100000:1.0:1746129564.720387:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800903a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737424768:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746129564.720402:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ea93480/2, rc 0, transno 17179874015 00000100:00100000:1.0:1746129564.720406:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ea93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737425280:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746129564.720785:0:14589:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 8 in progress, 5 in flight, 48 done 00000100:00100000:1.0:1746129564.720933:0:11014:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e87dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+14:3302:x1830948737425408:12345-0@lo:2:osp-syn-1-0.0 Request processed in 9020us (11801us total) trans 17179874017 rc 0/0 00000100:00100000:1.0:1746129564.720940:0:11014:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15629 00002000:00010000:1.0:1746129564.721094:0:8412:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746129564.721098:0:8412:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb mtime from disk: 1746129563 -> 1746129563 00002000:00010000:1.0:1746129564.721100:0:8412:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb atime from disk: 1746129562 -> 1746129562 00002000:00010000:1.0:1746129564.721102:0:8412:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb ctime from disk: 1746129562 -> 1746129562 00002000:00010000:1.0:1746129564.721104:0:8412:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746129564.721133:0:8412:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ced880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+14:3301:x1830948737424640:12345-0@lo:2:osp-syn-1-0.0 Request processed in 4571us (4731us total) trans 17179874018 rc 0/0 00000100:00100000:1.0:1746129564.721139:0:8412:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15633 00000100:00100000:0.0:1746129564.721443:0:8411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ceca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+68:3301:x1830948737426176:12345-0@lo:2:osp-syn-0-0.0 Request processed in 4688us (4946us total) trans 21474841251 rc 0/0 00000100:00100000:0.0:1746129564.721451:0:8411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15636 00000100:00100000:0.0:1746129564.721543:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129564.721671:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733904384 00000100:00100000:0.0:1746129564.721677:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733904384 00000100:00100000:0.0:1746129564.721709:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4687 00000100:00100000:0.0:1746129564.721715:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095f47850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+8:32057:x1830948733904384:12345-192.168.202.4@tcp:49:multiop.0 00000100:00100000:0.0:1746129564.721804:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095f47850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+8:32057:x1830948733904384:12345-192.168.202.4@tcp:49:multiop.0 Request processed in 89us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129564.721810:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4687 00000004:00080000:0.0:1746129564.721886:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880090e6ca80/2, rc 0, transno 17179874018 00000100:00100000:0.0:1746129564.721890:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737424640:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129564.721902:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ea90a80/2, rc 0, transno 21474841250 00000100:00100000:0.0:1746129564.721905:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ea90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737425664:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129564.721913:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ea90000/2, rc 0, transno 21474841251 00000100:00100000:0.0:1746129564.721915:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ea90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737426176:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129564.723894:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129564.725357:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129564.725384:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129564.725397:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129564.725409:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129564.725420:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129564.725450:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129564.725471:0:22480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733904512 00000100:00100000:0.0:1746129564.725477:0:22480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733904512 00000100:00100000:0.0:1746129564.725508:0:22480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733904640 00000100:00100000:0.0:1746129564.725510:0:22480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733904640 00000100:00100000:0.0:1746129564.725529:0:22480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733904768 00000100:00100000:0.0:1746129564.725530:0:22480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733904768 00000100:00100000:0.0:1746129564.725540:0:22480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733904896 00000100:00100000:0.0:1746129564.725541:0:22480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733904896 00000100:00100000:0.0:1746129564.725548:0:22480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733905024 00000100:00100000:0.0:1746129564.725550:0:22480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733905024 00000100:00100000:0.0:1746129564.725556:0:22480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733905152 00000100:00100000:0.0:1746129564.725557:0:22480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733905152 00000100:00100000:0.0:1746129564.725562:0:22480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733905280 00000100:00100000:0.0:1746129564.725564:0:22480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733905280 00000100:00100000:0.0:1746129564.725576:0:22480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15637 00000100:00100000:0.0:1746129564.725582:0:22480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ceed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+18:1960:x1830948733904512:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129564.725598:0:22480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129564.725613:0:22480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ce27400/0x40a459093b06891a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20343 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129564.725635:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129564.725637:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129564.725645:0:22480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ce27400/0x40a459093b06891a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20343 expref: 19 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129564.725661:0:22480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ce27400/0x40a459093b06891a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20343 expref: 19 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129564.725677:0:22480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ce27400, rc 0) 00000100:00100000:0.0:1746129564.725705:0:22480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ceed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+19:1960:x1830948733904512:12345-192.168.202.4@tcp:101:cat.0 Request processed in 124us (1817us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129564.725710:0:22480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15637 00000100:00100000:0.0:1746129564.725724:0:22480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15638 00000100:00100000:0.0:1746129564.725728:0:22480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+8:1960:x1830948733904640:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129564.725735:0:22480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129564.725743:0:22480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ce26000/0x40a459093b068921 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2034a expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129564.725753:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129564.725754:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129564.725758:0:22480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ce26000/0x40a459093b068921 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2034a expref: 9 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129564.725768:0:22480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012ce26000/0x40a459093b068921 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2034a expref: 9 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129564.725774:0:22480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ce26000, rc 0) 00000100:00100000:0.0:1746129564.725786:0:22480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+9:1960:x1830948733904640:12345-192.168.202.4@tcp:101:cat.0 Request processed in 58us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129564.725791:0:22480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15638 00000100:00100000:0.0:1746129564.725799:0:22480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15639 00000100:00100000:0.0:1746129564.725803:0:22480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+8:1960:x1830948733904768:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129564.725810:0:22480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129564.725815:0:22480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ce27800/0x40a459093b068928 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20351 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129564.725822:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129564.725824:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129564.725827:0:22480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ce27800/0x40a459093b068928 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20351 expref: 9 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129564.725835:0:22480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012ce27800/0x40a459093b068928 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20351 expref: 9 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129564.725841:0:22480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ce27800, rc 0) 00000100:00100000:0.0:1746129564.725853:0:22480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+9:1960:x1830948733904768:12345-192.168.202.4@tcp:101:cat.0 Request processed in 50us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129564.725858:0:22480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15639 00000100:00100000:0.0:1746129564.725865:0:22480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15640 00000100:00100000:0.0:1746129564.725869:0:22480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ced180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+18:1960:x1830948733904896:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129564.725873:0:22480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129564.725878:0:22480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095122400/0x40a459093b06892f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20358 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129564.725886:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129564.725887:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129564.725891:0:22480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095122400/0x40a459093b06892f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20358 expref: 19 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129564.725899:0:22480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095122400/0x40a459093b06892f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20358 expref: 19 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129564.725906:0:22480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095122400, rc 0) 00000100:00100000:0.0:1746129564.725917:0:22480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ced180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+19:1960:x1830948733904896:12345-192.168.202.4@tcp:101:cat.0 Request processed in 48us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129564.725921:0:22480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15640 00000100:00100000:0.0:1746129564.725929:0:22480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15641 00000100:00100000:0.0:1746129564.725932:0:22480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+18:1960:x1830948733905024:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129564.725936:0:22480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129564.725941:0:22480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095122e00/0x40a459093b068936 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2035f expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129564.725949:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129564.725950:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129564.725954:0:22480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095122e00/0x40a459093b068936 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2035f expref: 19 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129564.725961:0:22480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095122e00/0x40a459093b068936 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2035f expref: 19 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129564.725967:0:22480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095122e00, rc 0) 00000100:00100000:0.0:1746129564.725978:0:22480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+19:1960:x1830948733905024:12345-192.168.202.4@tcp:101:cat.0 Request processed in 46us (568us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129564.725983:0:22480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15641 00000100:00100000:0.0:1746129564.725990:0:22480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15642 00000100:00100000:0.0:1746129564.725994:0:22480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+8:1960:x1830948733905152:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129564.726000:0:22480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129564.726005:0:22480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095123800/0x40a459093b06893d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20366 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129564.726013:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129564.726014:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129564.726017:0:22480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095123800/0x40a459093b06893d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20366 expref: 9 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129564.726024:0:22480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095123800/0x40a459093b06893d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20366 expref: 9 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129564.726030:0:22480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095123800, rc 0) 00000100:00100000:0.0:1746129564.726041:0:22480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+9:1960:x1830948733905152:12345-192.168.202.4@tcp:101:cat.0 Request processed in 47us (620us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129564.726045:0:22480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15642 00000100:00100000:0.0:1746129564.726052:0:22480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15643 00000100:00100000:0.0:1746129564.726055:0:22480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+8:32057:x1830948733905280:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:0.0:1746129564.726059:0:22480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129564.726063:0:22480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095122000/0x40a459093b068944 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2036d expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129564.726077:0:22480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c031400/0x40a459093b068810 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f202d3 expref: 7 pid: 8411 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129564.726084:0:22480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095123800/0x40a459093b06893d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20366 expref: 9 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129564.726095:0:22480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e3a7800/0x40a459093b0688b1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20304 expref: 21 pid: 4699 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129564.726100:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129564.726102:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129564.726104:0:22480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095122000/0x40a459093b068944 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [3657728->3985407] (req 3657728->3985407) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2036d expref: 9 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129564.726129:0:22480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012e3a7800/0x40a459093b0688b1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20304 expref: 21 pid: 4699 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129564.726141:0:22480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012e3a7800/0x40a459093b0688b1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20304 expref: 21 pid: 4699 timeout: 920 lvb_type: 1 00000100:00100000:0.0:1746129564.726152:0:22480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093cef800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22480:1830948737426816:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129564.726210:0:22480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095123800/0x40a459093b06893d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20366 expref: 9 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129564.726218:0:22480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095123800/0x40a459093b06893d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20366 expref: 9 pid: 22480 timeout: 920 lvb_type: 1 00000100:00100000:0.0:1746129564.726225:0:22480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a77b1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22480:1830948737426944:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129564.726247:0:22480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c031400/0x40a459093b068810 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f202d3 expref: 7 pid: 8411 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129564.726260:0:22480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c031400/0x40a459093b068810 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f202d3 expref: 7 pid: 8411 timeout: 920 lvb_type: 1 00000100:00100000:0.0:1746129564.726267:0:22480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900f7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22480:1830948737427072:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129564.726278:0:22480:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093da8cc0 going to sleep for 11 seconds 00000100:00080000:0.0:1746129564.726310:0:7097:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746129564.727791:0:22481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+13:3301:x1830948737425152:12345-0@lo:2:osp-syn-1-0.0 Request processed in 8713us (8842us total) trans 17179874019 rc 0/0 00000100:00100000:1.0:1746129564.727807:0:22481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15634 00000004:00080000:1.0:1746129564.727865:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800903a1500/2, rc 0, transno 17179874019 00000100:00100000:1.0:1746129564.727872:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800903a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737425152:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129564.734943:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129564.735030:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129564.735220:0:22480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093cef800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22480:1830948737426816:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129564.735230:0:22480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a77b1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22480:1830948737426944:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129564.735238:0:22480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900f7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22480:1830948737427072:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129564.735275:0:22480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095122000/0x40a459093b068944 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [3657728->3985407] (req 3657728->3985407) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2036d expref: 9 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129564.735324:0:22480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095122000, rc 0) 00000100:00100000:0.0:1746129564.735381:0:22480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+9:32057:x1830948733905280:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 9312us (9918us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129564.735390:0:22480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15643 00000100:00100000:0.0:1746129564.736355:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733905408 00000100:00100000:0.0:1746129564.736363:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733905408 00010000:00010000:0.0:1746129564.736403:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012e3a7800/0x40a459093b0688b1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20304 expref: 22 pid: 4699 timeout: 920 lvb_type: 1 00000100:00100000:0.0:1746129564.736425:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733905536 00000100:00100000:0.0:1746129564.736427:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733905536 00010000:00010000:0.0:1746129564.736436:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c031400/0x40a459093b068810 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f202d3 expref: 8 pid: 8411 timeout: 920 lvb_type: 1 00000100:00100000:0.0:1746129564.736449:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7984 00000100:00100000:0.0:1746129564.736455:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132c24380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ada2ffba-8920-4ecb-8068-68caa9806978+22:1961:x1830948733905408:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129564.736469:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129564.736491:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012e3a7800/0x40a459093b0688b1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20304 expref: 22 pid: 4699 timeout: 920 lvb_type: 1 00010000:00010000:0.0:1746129564.736501:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012e3a7800/0x40a459093b0688b1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20304 expref: 22 pid: 4699 timeout: 920 lvb_type: 1 00010000:00010000:0.0:1746129564.736523:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e3a7800/0x40a459093b0688b1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20304 expref: 22 pid: 4699 timeout: 920 lvb_type: 1 00010000:00010000:0.0:1746129564.736533:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129564.736559:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132c24380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ada2ffba-8920-4ecb-8068-68caa9806978+21:1961:x1830948733905408:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 104us (1624us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129564.736564:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7984 00000100:00100000:0.0:1746129564.736576:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7985 00000100:00100000:0.0:1746129564.736581:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a44050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:068dab75-d300-4ead-a742-d14572ad1e50+8:1961:x1830948733905536:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129564.736587:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129564.736592:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c031400/0x40a459093b068810 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f202d3 expref: 8 pid: 8411 timeout: 920 lvb_type: 1 00010000:00010000:0.0:1746129564.736599:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c031400/0x40a459093b068810 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f202d3 expref: 8 pid: 8411 timeout: 920 lvb_type: 1 00010000:00010000:0.0:1746129564.736614:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c031400/0x40a459093b068810 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f202d3 expref: 8 pid: 8411 timeout: 920 lvb_type: 1 00010000:00010000:0.0:1746129564.736622:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129564.736633:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a44050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:068dab75-d300-4ead-a742-d14572ad1e50+7:1961:x1830948733905536:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 53us (1604us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129564.736639:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7985 00000100:00100000:0.0:1746129564.743124:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129564.750451:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129564.750480:0:8416:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733905920 00000100:00100000:0.0:1746129564.750489:0:8416:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733905920 00002000:00100000:0.0:1746129564.750536:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff8800900f4700 x1830948733905920/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:305/0 lens 488/0 e 0 to 0 dl 1746129575 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129564.750547:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800900f4700 with x1830948733905920 ext(1048576->2097151) 00002000:00010000:0.0:1746129564.750552:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800900f4700 00000100:00100000:0.0:1746129564.750573:0:8416:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7513 00000100:00100000:0.0:1746129564.750581:0:8416:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ada2ffba-8920-4ecb-8068-68caa9806978+21:1961:x1830948733905920:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129564.764003:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129564.764025:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129564.764038:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129564.764051:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129564.764072:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129564.764096:0:31522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733906176 00000100:00100000:0.0:1746129564.764104:0:31522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733906176 00002000:00100000:0.0:1746129564.764147:0:31522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3ec:0x0] (0->1048575) req@ffff8800900f6d80 x1830948733906176/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:305/0 lens 488/0 e 0 to 0 dl 1746129575 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129564.764157:0:31522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800900f6d80 with x1830948733906176 ext(0->1048575) 00002000:00010000:0.0:1746129564.764163:0:31522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800900f6d80 00000100:00100000:0.0:1746129564.764180:0:31522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733906432 00000100:00100000:0.0:1746129564.764183:0:31522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733906432 00002000:00100000:0.0:1746129564.764196:0:31522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff8800900f4000 x1830948733906432/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:305/0 lens 488/0 e 0 to 0 dl 1746129575 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129564.764202:0:31522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800900f4000 with x1830948733906432 ext(1048576->2097151) 00002000:00010000:0.0:1746129564.764206:0:31522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800900f4000 00000100:00100000:0.0:1746129564.764214:0:31522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733906688 00000100:00100000:0.0:1746129564.764216:0:31522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733906688 00002000:00100000:0.0:1746129564.764226:0:31522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f4:0x0] (1048576->2097151) req@ffff8800900f7100 x1830948733906688/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:305/0 lens 488/0 e 0 to 0 dl 1746129575 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129564.764232:0:31522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800900f7100 with x1830948733906688 ext(1048576->2097151) 00002000:00010000:0.0:1746129564.764235:0:31522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800900f7100 00000100:00100000:0.0:1746129564.764243:0:31522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733906944 00000100:00100000:0.0:1746129564.764245:0:31522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733906944 00002000:00100000:0.0:1746129564.764254:0:31522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3ee:0x0] (1048576->2097151) req@ffff8800900f4a80 x1830948733906944/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:305/0 lens 488/0 e 0 to 0 dl 1746129575 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129564.764260:0:31522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800900f4a80 with x1830948733906944 ext(1048576->2097151) 00002000:00010000:0.0:1746129564.764263:0:31522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800900f4a80 00000100:00100000:0.0:1746129564.764276:0:31522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7514 00000100:00100000:0.0:1746129564.764350:0:31522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:1960:x1830948733906176:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129564.764422:0:21725:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7515 00000100:00100000:0.0:1746129564.764427:0:21725:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+10:1960:x1830948733906432:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129564.765336:0:31520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7516 00000100:00100000:0.0:1746129564.765342:0:31520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+10:1960:x1830948733906688:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:1.0:1746129564.767469:0:22480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733907072 00000100:00100000:1.0:1746129564.767476:0:22480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733907072 00000100:00100000:1.0:1746129564.768131:0:22480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15644 00000100:00100000:1.0:1746129564.768137:0:22480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ada2ffba-8920-4ecb-8068-68caa9806978+30:32056:x1830948733907072:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:1.0:1746129564.768153:0:22480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129564.768171:0:22480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c461200/0x40a459093b06894b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20374 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129564.768195:0:22480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800947b8000/0x40a459093b068809 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f202c5 expref: 10 pid: 8411 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129564.768203:0:22480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095122400/0x40a459093b06892f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20358 expref: 21 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129564.768209:0:22480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880132dfde00/0x40a459093b0688c6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f202f6 expref: 31 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129564.768214:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129564.768215:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129564.768219:0:22480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c461200/0x40a459093b06894b lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [1265664->2097151] (req 1265664->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20374 expref: 31 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129564.768247:0:22480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880132dfde00/0x40a459093b0688c6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f202f6 expref: 31 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129564.768257:0:22480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880132dfde00/0x40a459093b0688c6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f202f6 expref: 31 pid: 11014 timeout: 920 lvb_type: 1 00000100:00100000:1.0:1746129564.768268:0:22480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880132c24000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22480:1830948737427328:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129564.769313:0:22480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095122400/0x40a459093b06892f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20358 expref: 21 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129564.769327:0:22480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095122400/0x40a459093b06892f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20358 expref: 21 pid: 22480 timeout: 920 lvb_type: 1 00000100:00100000:1.0:1746129564.769336:0:22480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880132c24380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22480:1830948737427456:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129564.769361:0:22480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800947b8000/0x40a459093b068809 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f202c5 expref: 10 pid: 8411 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129564.769399:0:22480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800947b8000/0x40a459093b068809 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f202c5 expref: 10 pid: 8411 timeout: 920 lvb_type: 1 00000100:00100000:1.0:1746129564.769406:0:22480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880132c25180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22480:1830948737427584:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129564.769422:0:22480:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c954540 going to sleep for 11 seconds 00000100:00100000:1.0:1746129564.770968:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129564.771606:0:31519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733907328 00000100:00100000:1.0:1746129564.771614:0:31519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733907328 00002000:00100000:1.0:1746129564.771659:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f5:0x0] (3657728->3661823) req@ffff880132c25880 x1830948733907328/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:305/0 lens 488/0 e 0 to 0 dl 1746129575 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129564.771670:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880132c25880 with x1830948733907328 ext(3657728->3661823) 00002000:00010000:1.0:1746129564.771676:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880132c25880 00000100:00100000:1.0:1746129564.771699:0:31519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7518 00000100:00100000:1.0:1746129564.771708:0:31519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132c25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+12:1962:x1830948733907328:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:1.0:1746129564.771902:0:31519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132c25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+12:1962:x1830948733907328:12345-192.168.202.4@tcp:3:cat.0 Request processed in 195us (939us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746129564.771912:0:31519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7518 00002000:00100000:1.0:1746129564.771917:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f5:0x0] (3657728->3661823) req@ffff880132c25880 x1830948733907328/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:305/0 lens 488/4536 e 0 to 0 dl 1746129575 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129564.771925:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880132c25880 with x1830948733907328 ext(3657728->3661823) 00002000:00010000:1.0:1746129564.771927:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880132c25880 00000100:00100000:1.0:1746129564.772083:0:7086:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f324380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7086:1830948737427200:192.168.202.4@tcp:105: 00010000:00010000:1.0:1746129564.772101:0:7086:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129564.772121:0:7086:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+11:1963:x1830948733905664:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 18941us (29009us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129564.772128:0:7086:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7986 00000100:00100000:0.0:1746129564.778938:0:8416:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ada2ffba-8920-4ecb-8068-68caa9806978+21:1961:x1830948733905920:12345-192.168.202.4@tcp:3:cat.0 Request processed in 28346us (28483us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129564.778950:0:8416:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7513 00002000:00100000:0.0:1746129564.778962:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff8800900f4700 x1830948733905920/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:305/0 lens 488/440 e 0 to 0 dl 1746129575 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129564.778972:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800900f4700 with x1830948733905920 ext(1048576->2097151) 00002000:00010000:0.0:1746129564.778978:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800900f4700 00000100:00100000:1.0:1746129564.786182:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129564.786231:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129564.786877:0:21725:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+10:1960:x1830948733906432:12345-192.168.202.4@tcp:3:cat.0 Request processed in 22447us (22848us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129564.786888:0:21725:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7515 00002000:00100000:1.0:1746129564.786900:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff8800900f4000 x1830948733906432/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:305/0 lens 488/440 e 0 to 0 dl 1746129575 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129564.786910:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800900f4000 with x1830948733906432 ext(1048576->2097151) 00002000:00010000:1.0:1746129564.786916:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800900f4000 00000100:00100000:1.0:1746129564.786970:0:22480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880132c24000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22480:1830948737427328:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129564.786980:0:22480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880132c24380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22480:1830948737427456:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129564.786989:0:22480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880132c25180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22480:1830948737427584:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129564.787021:0:22480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c461200/0x40a459093b06894b lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [1265664->2097151] (req 1265664->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20374 expref: 31 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129564.787037:0:22480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c461200, rc 0) 00000100:00100000:1.0:1746129564.787054:0:22480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ada2ffba-8920-4ecb-8068-68caa9806978+31:32056:x1830948733907072:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 18917us (22981us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129564.787060:0:22480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15644 00000100:00100000:1.0:1746129564.787085:0:7086:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733907456 00000100:00100000:1.0:1746129564.787090:0:7086:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733907456 00010000:00010000:1.0:1746129564.787112:0:7086:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880132dfde00/0x40a459093b0688c6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f202f6 expref: 31 pid: 11014 timeout: 920 lvb_type: 1 00000100:00100000:1.0:1746129564.787130:0:7086:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733907584 00000100:00100000:1.0:1746129564.787132:0:7086:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733907584 00010000:00010000:1.0:1746129564.787141:0:7086:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800947b8000/0x40a459093b068809 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f202c5 expref: 11 pid: 8411 timeout: 920 lvb_type: 1 00000100:00100000:1.0:1746129564.787154:0:7086:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7987 00000100:00100000:1.0:1746129564.787159:0:7086:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132c26300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ada2ffba-8920-4ecb-8068-68caa9806978+31:1963:x1830948733907456:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129564.787170:0:7086:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129564.787188:0:7086:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880132dfde00/0x40a459093b0688c6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f202f6 expref: 31 pid: 11014 timeout: 920 lvb_type: 1 00010000:00010000:1.0:1746129564.787197:0:7086:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880132dfde00/0x40a459093b0688c6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f202f6 expref: 31 pid: 11014 timeout: 920 lvb_type: 1 00010000:00010000:1.0:1746129564.787221:0:7086:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880132dfde00/0x40a459093b0688c6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f202f6 expref: 31 pid: 11014 timeout: 920 lvb_type: 1 00010000:00010000:1.0:1746129564.787234:0:7086:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129564.787247:0:7086:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132c26300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ada2ffba-8920-4ecb-8068-68caa9806978+30:1963:x1830948733907456:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 88us (1076us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129564.787253:0:7086:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7987 00000100:00100000:1.0:1746129564.787262:0:7086:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7988 00000100:00100000:1.0:1746129564.787267:0:7086:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009feee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:068dab75-d300-4ead-a742-d14572ad1e50+11:1963:x1830948733907584:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129564.787274:0:7086:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129564.787280:0:7086:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800947b8000/0x40a459093b068809 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f202c5 expref: 11 pid: 8411 timeout: 920 lvb_type: 1 00010000:00010000:1.0:1746129564.787287:0:7086:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800947b8000/0x40a459093b068809 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f202c5 expref: 11 pid: 8411 timeout: 920 lvb_type: 1 00010000:00010000:1.0:1746129564.787321:0:7086:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800947b8000/0x40a459093b068809 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f202c5 expref: 11 pid: 8411 timeout: 920 lvb_type: 1 00010000:00010000:1.0:1746129564.787329:0:7086:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129564.787342:0:7086:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009feee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:068dab75-d300-4ead-a742-d14572ad1e50+10:1963:x1830948733907584:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 76us (1111us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129564.787348:0:7086:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7988 00000100:00100000:1.0:1746129564.795660:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129564.795686:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129564.795709:0:21725:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733907840 00000100:00100000:1.0:1746129564.795717:0:21725:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733907840 00002000:00100000:1.0:1746129564.795761:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f4:0x0] (1048576->2097151) req@ffff88009feedf80 x1830948733907840/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:305/0 lens 488/0 e 0 to 0 dl 1746129575 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129564.795772:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009feedf80 with x1830948733907840 ext(1048576->2097151) 00002000:00010000:1.0:1746129564.795777:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009feedf80 00000100:00100000:1.0:1746129564.795792:0:21725:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733908096 00000100:00100000:1.0:1746129564.795794:0:21725:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733908096 00002000:00100000:1.0:1746129564.795805:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f5:0x0] (3981312->3985407) req@ffff88009feeed80 x1830948733908096/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:305/0 lens 488/0 e 0 to 0 dl 1746129575 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129564.795811:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009feeed80 with x1830948733908096 ext(3981312->3985407) 00002000:00010000:1.0:1746129564.795814:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009feeed80 00000100:00100000:1.0:1746129564.795824:0:21725:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7519 00000100:00100000:1.0:1746129564.795831:0:21725:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009feedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ada2ffba-8920-4ecb-8068-68caa9806978+21:1962:x1830948733907840:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:0.0:1746129564.804204:0:31520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+8:1960:x1830948733906688:12345-192.168.202.4@tcp:3:cat.0 Request processed in 38853us (40155us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129564.804215:0:31520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7516 00002000:00100000:0.0:1746129564.804226:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3f4:0x0] (1048576->2097151) req@ffff8800900f7100 x1830948733906688/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:305/0 lens 488/440 e 0 to 0 dl 1746129575 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129564.804236:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800900f7100 with x1830948733906688 ext(1048576->2097151) 00002000:00010000:0.0:1746129564.804242:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800900f7100 00000100:00100000:0.0:1746129564.812786:0:21725:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009feedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ada2ffba-8920-4ecb-8068-68caa9806978+21:1962:x1830948733907840:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 16945us (17124us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129564.812798:0:21725:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7519 00002000:00100000:0.0:1746129564.812811:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f4:0x0] (1048576->2097151) req@ffff88009feedf80 x1830948733907840/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:305/0 lens 488/440 e 0 to 0 dl 1746129575 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129564.812821:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009feedf80 with x1830948733907840 ext(1048576->2097151) 00002000:00010000:0.0:1746129564.812827:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009feedf80 00000100:00100000:0.0:1746129564.814674:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129564.814692:0:21725:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733908736 00000100:00100000:0.0:1746129564.814699:0:21725:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733908736 00002000:00100000:0.0:1746129564.814737:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ee:0x0] (1265664->1269759) req@ffff8800900f4380 x1830948733908736/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:305/0 lens 488/0 e 0 to 0 dl 1746129575 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129564.814745:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800900f4380 with x1830948733908736 ext(1265664->1269759) 00002000:00010000:0.0:1746129564.814749:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800900f4380 00000100:00100000:0.0:1746129564.814766:0:21725:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7521 00000100:00100000:0.0:1746129564.814772:0:21725:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ada2ffba-8920-4ecb-8068-68caa9806978+30:1963:x1830948733908736:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:0.0:1746129564.814917:0:21725:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ada2ffba-8920-4ecb-8068-68caa9806978+30:1963:x1830948733908736:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 145us (249us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746129564.814922:0:21725:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7521 00002000:00100000:0.0:1746129564.814927:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ee:0x0] (1265664->1269759) req@ffff8800900f4380 x1830948733908736/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:305/0 lens 488/4536 e 0 to 0 dl 1746129575 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129564.814935:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800900f4380 with x1830948733908736 ext(1265664->1269759) 00002000:00010000:0.0:1746129564.814938:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800900f4380 00000100:00100000:0.0:1746129564.825085:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129564.825125:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129564.825146:0:22480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733908864 00000100:00100000:0.0:1746129564.825154:0:22480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733908864 00000100:00100000:0.0:1746129564.825192:0:22480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15645 00000100:00100000:0.0:1746129564.825201:0:22480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+18:32061:x1830948733908864:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129564.825218:0:22480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129564.825235:0:22480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095ab1000/0x40a459093b068952 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2037b expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129564.825270:0:22480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c461200/0x40a459093b06894b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20374 expref: 29 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129564.825278:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129564.825280:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129564.825283:0:22480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095ab1000/0x40a459093b068952 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2037b expref: 19 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129564.825333:0:22480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c461200/0x40a459093b06894b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20374 expref: 29 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129564.825345:0:22480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c461200/0x40a459093b06894b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20374 expref: 29 pid: 22480 timeout: 920 lvb_type: 0 00000100:00100000:0.0:1746129564.825357:0:22480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900f7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22480:1830948737427840:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129564.825442:0:22480:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093da8c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746129564.825458:0:31520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733909120 00000100:00100000:0.0:1746129564.825461:0:31520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733909120 00002000:00100000:0.0:1746129564.825485:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3ee:0x0] (1048576->1265663) req@ffff8800900f6680 x1830948733909120/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:305/0 lens 488/0 e 0 to 0 dl 1746129575 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129564.825494:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800900f6680 with x1830948733909120 ext(1048576->1265663) 00010000:00010000:0.0:1746129564.825499:0:31520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009c461200/0x40a459093b06894b lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20374 expref: 30 pid: 22480 timeout: 920 lvb_type: 0 00010000:00010000:0.0:1746129564.825508:0:31520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009c461200/0x40a459093b06894b lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20374 expref: 30 pid: 22480 timeout: 920 lvb_type: 0 00002000:00010000:0.0:1746129564.825514:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800900f6680 00000100:00100000:0.0:1746129564.825526:0:31520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2344 00000100:00100000:0.0:1746129564.825531:0:31520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ada2ffba-8920-4ecb-8068-68caa9806978+30:1963:x1830948733909120:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:0.0:1746129564.827623:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129564.827646:0:21725:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733909376 00000100:00100000:0.0:1746129564.827652:0:21725:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733909376 00002000:00100000:0.0:1746129564.827680:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ee:0x0] (1929216->2097151) req@ffff880090e6ea00 x1830948733909376/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:305/0 lens 488/0 e 0 to 0 dl 1746129575 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129564.827689:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090e6ea00 with x1830948733909376 ext(1929216->2097151) 00010000:00010000:0.0:1746129564.827695:0:21725:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009c461200/0x40a459093b06894b lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20374 expref: 32 pid: 22480 timeout: 920 lvb_type: 0 00010000:00010000:0.0:1746129564.827708:0:21725:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009c461200/0x40a459093b06894b lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20374 expref: 32 pid: 22480 timeout: 920 lvb_type: 0 00002000:00010000:0.0:1746129564.827714:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880090e6ea00 00000100:00100000:0.0:1746129564.827746:0:21725:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2345 00000100:00100000:0.0:1746129564.827752:0:21725:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ada2ffba-8920-4ecb-8068-68caa9806978+32:1963:x1830948733909376:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:1.0:1746129564.829355:0:31520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ada2ffba-8920-4ecb-8068-68caa9806978+32:1963:x1830948733909120:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 3821us (4227us total) trans 0 rc 217088/217088 00000100:00100000:1.0:1746129564.829363:0:31520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2344 00002000:00100000:1.0:1746129564.829382:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3ee:0x0] (1048576->1265663) req@ffff8800900f6680 x1830948733909120/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:305/0 lens 488/440 e 0 to 0 dl 1746129575 ref 1 fl Complete:H/200/0 rc 217088/217088 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129564.829390:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800900f6680 with x1830948733909120 ext(1048576->1265663) 00010000:00010000:1.0:1746129564.829396:0:31520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009c461200/0x40a459093b06894b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20374 expref: 32 pid: 22480 timeout: 920 lvb_type: 0 00010000:00010000:1.0:1746129564.829407:0:31520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009c461200/0x40a459093b06894b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20374 expref: 32 pid: 22480 timeout: 920 lvb_type: 0 00002000:00010000:1.0:1746129564.829413:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800900f6680 00000100:00100000:1.0:1746129564.832091:0:21725:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ada2ffba-8920-4ecb-8068-68caa9806978+30:1963:x1830948733909376:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 4332us (4466us total) trans 0 rc 167936/167936 00000100:00100000:1.0:1746129564.832103:0:21725:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2345 00002000:00100000:1.0:1746129564.832115:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ee:0x0] (1929216->2097151) req@ffff880090e6ea00 x1830948733909376/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:305/0 lens 488/440 e 0 to 0 dl 1746129575 ref 1 fl Complete:H/200/0 rc 167936/167936 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129564.832125:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090e6ea00 with x1830948733909376 ext(1929216->2097151) 00010000:00010000:1.0:1746129564.832135:0:21725:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009c461200/0x40a459093b06894b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20374 expref: 30 pid: 22480 timeout: 920 lvb_type: 0 00010000:00010000:1.0:1746129564.832149:0:21725:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009c461200/0x40a459093b06894b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20374 expref: 30 pid: 22480 timeout: 920 lvb_type: 0 00002000:00010000:1.0:1746129564.832156:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880090e6ea00 00000100:00100000:0.0:1746129564.837873:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129564.837889:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129564.837918:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129564.837930:0:4699:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733909888 00000100:00100000:1.0:1746129564.837934:0:4699:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733909888 00000100:00100000:0.0:1746129564.837936:0:21725:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733909760 00000100:00100000:0.0:1746129564.837938:0:21725:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733909760 00000100:00100000:1.0:1746129564.837952:0:4699:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733910016 00000100:00100000:1.0:1746129564.837954:0:4699:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733910016 00002000:00100000:0.0:1746129564.837961:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ee:0x0] (1265664->2097151) req@ffff880093cef800 x1830948733909760/t0(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:305/0 lens 488/0 e 0 to 0 dl 1746129575 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:1.0:1746129564.837967:0:4699:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15647 00000100:00100000:1.0:1746129564.837972:0:4699:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ada2ffba-8920-4ecb-8068-68caa9806978+33:1962:x1830948733909888:12345-192.168.202.4@tcp:101:cat.0 00002000:00100000:0.0:1746129564.837972:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093cef800 with x1830948733909760 ext(1265664->2097151) 00010000:00010000:1.0:1746129564.837977:0:4699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129564.837978:0:21725:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009c461200/0x40a459093b06894b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20374 expref: 33 pid: 22480 timeout: 920 lvb_type: 0 00010000:00010000:1.0:1746129564.837983:0:4699:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f91a000/0x40a459093b068960 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20389 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129564.837987:0:21725:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009c461200/0x40a459093b06894b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1265664->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20374 expref: 33 pid: 22480 timeout: 920 lvb_type: 0 00002000:00010000:0.0:1746129564.837992:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093cef800 00000100:00100000:0.0:1746129564.838004:0:21725:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2346 00000100:00100000:1.0:1746129564.838008:0:4699:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009feeca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4699:1830948737428352:192.168.202.4@tcp:106: 00000100:00100000:0.0:1746129564.838009:0:21725:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ada2ffba-8920-4ecb-8068-68caa9806978+34:1960:x1830948733909760:12345-192.168.202.4@tcp:4:multiop.0 00000100:00100000:1.0:1746129564.838044:0:4699:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5ff8f00 going to sleep for 11 seconds 00000100:00100000:1.0:1746129564.838059:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15648 00000100:00100000:1.0:1746129564.838064:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a77b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ada2ffba-8920-4ecb-8068-68caa9806978+21:1963:x1830948733910016:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129564.838073:0:4385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129564.838083:0:4385:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f91aa00/0x40a459093b068967 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20390 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129564.838104:0:4385:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009feeea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:4385:1830948737428480:192.168.202.4@tcp:106: 00000100:00100000:1.0:1746129564.838122:0:4385:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5ff86c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746129564.840773:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129564.840795:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129564.840838:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00002000:00010000:1.0:1746129564.840886:0:4385:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3f5:0x0] updating lvb mtime: 1746129563 -> 1746129565 00002000:00010000:1.0:1746129564.840890:0:4385:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3f5:0x0] updating lvb atime: 1746129562 -> 1746129565 00002000:00010000:1.0:1746129564.840892:0:4385:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3f5:0x0] updating lvb ctime: 1746129563 -> 1746129565 00000100:00100000:1.0:1746129564.840913:0:4385:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009feeea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:4385:1830948737428480:192.168.202.4@tcp:106: 00010000:00010000:1.0:1746129564.840942:0:4385:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f91aa00/0x40a459093b068967 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20390 expref: 22 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129564.840955:0:4385:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f91aa00/0x40a459093b068967 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20390 expref: 22 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129564.840965:0:4385:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f91aa00, rc 0) 00000100:00100000:1.0:1746129564.840995:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a77b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ada2ffba-8920-4ecb-8068-68caa9806978+21:1963:x1830948733910016:12345-192.168.202.4@tcp:101:cat.0 Request processed in 2929us (3103us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129564.841002:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15648 00000100:00100000:1.0:1746129564.841030:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7991 00000100:00100000:1.0:1746129564.841034:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009feef100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ada2ffba-8920-4ecb-8068-68caa9806978+36:1963:x1830948733910144:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129564.841042:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129564.841054:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012e3a6600/0x40a459093b0688aa lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f202fd expref: 36 pid: 4699 timeout: 920 lvb_type: 1 00010000:00010000:1.0:1746129564.841063:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012e3a6600/0x40a459093b0688aa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f202fd expref: 36 pid: 4699 timeout: 920 lvb_type: 1 00002000:00010000:0.0:1746129564.841611:0:4699:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb mtime: 1746129563 -> 1746129565 00002000:00010000:0.0:1746129564.841614:0:4699:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb atime: 1746129563 -> 1746129565 00002000:00010000:0.0:1746129564.841616:0:4699:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb ctime: 1746129563 -> 1746129565 00000100:00100000:0.0:1746129564.841628:0:4699:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009feeca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4699:1830948737428352:192.168.202.4@tcp:106: 00010000:00010000:0.0:1746129564.841642:0:4699:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f91a000/0x40a459093b068960 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20389 expref: 36 pid: 4699 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129564.841650:0:4699:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f91a000/0x40a459093b068960 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20389 expref: 36 pid: 4699 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129564.841658:0:4699:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f91a000, rc 0) 00000100:00100000:0.0:1746129564.841675:0:4699:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ada2ffba-8920-4ecb-8068-68caa9806978+35:1962:x1830948733909888:12345-192.168.202.4@tcp:101:cat.0 Request processed in 3703us (3803us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129564.841680:0:4699:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15647 00000100:00100000:0.0:1746129564.841700:0:15749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7992 00000100:00100000:0.0:1746129564.841705:0:15749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6fd3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:068dab75-d300-4ead-a742-d14572ad1e50+10:1963:x1830948733910400:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129564.841711:0:15749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129564.842395:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e3a6600/0x40a459093b0688aa lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f202fd expref: 33 pid: 4699 timeout: 920 lvb_type: 1 00010000:00010000:1.0:1746129564.842408:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129564.842426:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009feef100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ada2ffba-8920-4ecb-8068-68caa9806978+32:1963:x1830948733910144:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 1391us (1629us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129564.842432:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7991 00010000:00010000:0.0:1746129564.843260:0:15749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090079a00/0x40a459093b0687fb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f202cc expref: 10 pid: 8411 timeout: 920 lvb_type: 1 00010000:00010000:0.0:1746129564.843825:0:15749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090079a00/0x40a459093b0687fb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f202cc expref: 10 pid: 8411 timeout: 920 lvb_type: 1 00010000:00010000:0.0:1746129564.844041:0:15749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090079a00/0x40a459093b0687fb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f202cc expref: 10 pid: 8411 timeout: 920 lvb_type: 1 00010000:00010000:0.0:1746129564.844066:0:15749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129564.844135:0:15749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6fd3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:068dab75-d300-4ead-a742-d14572ad1e50+9:1963:x1830948733910400:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 2430us (3296us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129564.844144:0:15749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7992 00000001:00080000:0.0:1746129564.846540:0:564:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841238 is committed 00000001:00080000:0.0:1746129564.846572:0:564:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841208 is committed 00000001:00080000:0.0:1746129564.846576:0:564:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841195 is committed 00000001:00080000:0.0:1746129564.846652:0:564:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841242 is committed 00000001:00080000:0.0:1746129564.846659:0:564:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841233 is committed 00000001:00080000:0.0:1746129564.846664:0:564:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841232 is committed 00000100:00100000:0.0:1746129564.850185:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129564.859553:0:21725:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ada2ffba-8920-4ecb-8068-68caa9806978+17:1960:x1830948733909760:12345-192.168.202.4@tcp:4:multiop.0 Request processed in 21530us (21620us total) trans 21474841252 rc 0/0 00000100:00100000:1.0:1746129564.859565:0:21725:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2346 00002000:00100000:1.0:1746129564.859577:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ee:0x0] (1265664->2097151) req@ffff880093cef800 x1830948733909760/t21474841252(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:305/0 lens 488/448 e 0 to 0 dl 1746129575 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129564.859586:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093cef800 with x1830948733909760 ext(1265664->2097151) 00010000:00010000:1.0:1746129564.859596:0:21725:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009c461200/0x40a459093b06894b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20374 expref: 17 pid: 22480 timeout: 920 lvb_type: 0 00010000:00010000:1.0:1746129564.859611:0:21725:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009c461200/0x40a459093b06894b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20374 expref: 17 pid: 22480 timeout: 920 lvb_type: 0 00002000:00010000:1.0:1746129564.859623:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093cef800 00000100:00100000:0.0:1746129564.860278:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129564.860361:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129564.863332:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129564.866696:0:21725:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733911040 00000100:00100000:1.0:1746129564.866705:0:21725:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733911040 00002000:00100000:1.0:1746129564.866743:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ef:0x0] (2097152->2105343) req@ffff88009ca84000 x1830948733911040/t0(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:305/0 lens 8680/0 e 0 to 0 dl 1746129575 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129564.866753:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca84000 with x1830948733911040 ext(2097152->2105343) 00010000:00010000:1.0:1746129564.866762:0:21725:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009ee7f600/0x40a459093b068959 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2105343) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20382 expref: 16 pid: 22480 timeout: 920 lvb_type: 0 00010000:00010000:1.0:1746129564.866775:0:21725:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009ee7f600/0x40a459093b068959 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2105343) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20382 expref: 16 pid: 22480 timeout: 920 lvb_type: 0 00002000:00010000:1.0:1746129564.866781:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ca84000 00000100:00100000:1.0:1746129564.866808:0:21725:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2348 00000100:00100000:1.0:1746129564.866815:0:21725:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ada2ffba-8920-4ecb-8068-68caa9806978+16:1962:x1830948733911040:12345-192.168.202.4@tcp:4:cat.0 00000100:00100000:1.0:1746129564.867848:0:21725:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ada2ffba-8920-4ecb-8068-68caa9806978+18:1962:x1830948733911040:12345-192.168.202.4@tcp:4:cat.0 Request processed in 1027us (7566us total) trans 21474841253 rc 0/0 00000100:00100000:1.0:1746129564.867856:0:21725:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2348 00002000:00100000:1.0:1746129564.867863:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ef:0x0] (2097152->2105343) req@ffff88009ca84000 x1830948733911040/t21474841253(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:305/0 lens 8680/448 e 0 to 0 dl 1746129575 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129564.867871:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca84000 with x1830948733911040 ext(2097152->2105343) 00010000:00010000:1.0:1746129564.867877:0:21725:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009ee7f600/0x40a459093b068959 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2105343) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20382 expref: 18 pid: 22480 timeout: 920 lvb_type: 0 00010000:00010000:1.0:1746129564.867892:0:21725:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009ee7f600/0x40a459093b068959 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2105343) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20382 expref: 18 pid: 22480 timeout: 920 lvb_type: 0 00002000:00010000:1.0:1746129564.867898:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ca84000 00000100:00100000:0.0:1746129564.868938:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129564.869005:0:21725:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733911808 00000100:00100000:1.0:1746129564.869012:0:21725:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733911808 00002000:00100000:1.0:1746129564.869041:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ee:0x0] (1048576->2097151) req@ffff88009ca85500 x1830948733911808/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:305/0 lens 488/0 e 0 to 0 dl 1746129575 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129564.869049:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca85500 with x1830948733911808 ext(1048576->2097151) 00002000:00010000:1.0:1746129564.869053:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ca85500 00000100:00100000:1.0:1746129564.869082:0:21725:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7522 00000100:00100000:1.0:1746129564.869088:0:21725:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca85500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+8:1963:x1830948733911808:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129564.870249:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129564.879106:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129564.885547:0:21725:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca85500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+8:1963:x1830948733911808:12345-192.168.202.4@tcp:3:cat.0 Request processed in 16448us (16601us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129564.885558:0:21725:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7522 00002000:00100000:1.0:1746129564.885572:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ee:0x0] (1048576->2097151) req@ffff88009ca85500 x1830948733911808/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:305/0 lens 488/440 e 0 to 0 dl 1746129575 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129564.885582:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca85500 with x1830948733911808 ext(1048576->2097151) 00002000:00010000:1.0:1746129564.885588:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ca85500 00000100:00100000:0.0:1746129564.897057:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129564.902420:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129564.902586:0:4699:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733912448 00000100:00100000:1.0:1746129564.902597:0:4699:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733912448 00000100:00100000:1.0:1746129564.902661:0:4699:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15651 00000100:00100000:1.0:1746129564.902670:0:4699:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca87100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ada2ffba-8920-4ecb-8068-68caa9806978+21:32060:x1830948733912448:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129564.902692:0:4699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129564.902710:0:4699:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c0ab400/0x40a459093b06897c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f203a5 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129564.902741:0:4699:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095122000/0x40a459093b068944 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3657728->3985407) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2036d expref: 7 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129564.902749:0:4699:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129564.902751:0:4699:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129564.902754:0:4699:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c0ab400/0x40a459093b06897c lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f203a5 expref: 22 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129564.902783:0:4699:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095122000/0x40a459093b068944 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3657728->3985407) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2036d expref: 7 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129564.902795:0:4699:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095122000/0x40a459093b068944 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3657728->3985407) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2036d expref: 7 pid: 22480 timeout: 920 lvb_type: 0 00000100:00100000:1.0:1746129564.902807:0:4699:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009feeea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4699:1830948737429120:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129564.902902:0:4699:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5ff86c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746129564.905511:0:4699:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009feeea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4699:1830948737429120:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129564.905543:0:4699:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c0ab400/0x40a459093b06897c lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f203a5 expref: 22 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129564.905561:0:4699:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c0ab400, rc 0) 00000100:00100000:1.0:1746129564.905615:0:4699:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca87100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ada2ffba-8920-4ecb-8068-68caa9806978+22:32060:x1830948733912448:12345-192.168.202.4@tcp:101:cat.0 Request processed in 2945us (3203us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129564.905624:0:4699:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15651 00000100:00100000:1.0:1746129564.926472:0:21725:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2351 00000100:00100000:1.0:1746129564.926490:0:21725:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013577d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+12:1962:x1830948733912704:12345-192.168.202.4@tcp:4:cat.0 00000100:00100000:1.0:1746129564.933354:0:21725:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013577d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+14:1962:x1830948733912704:12345-192.168.202.4@tcp:4:cat.0 Request processed in 6859us (13953us total) trans 17179874020 rc 0/0 00000100:00100000:1.0:1746129564.933378:0:21725:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2351 00002000:00100000:1.0:1746129564.933391:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f5:0x0] (3657728->3985407) req@ffff88013577d880 x1830948733912704/t17179874020(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:305/0 lens 488/448 e 0 to 0 dl 1746129575 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129564.933402:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013577d880 with x1830948733912704 ext(3657728->3985407) 00010000:00010000:1.0:1746129564.933413:0:21725:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095122000/0x40a459093b068944 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3657728->3985407) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2036d expref: 14 pid: 22480 timeout: 920 lvb_type: 0 00010000:00010000:1.0:1746129564.933427:0:21725:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095122000/0x40a459093b068944 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3657728->3985407) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2036d expref: 14 pid: 22480 timeout: 920 lvb_type: 0 00002000:00010000:1.0:1746129564.933434:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88013577d880 00000100:00100000:0.0:1746129564.942992:0:31520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f324700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+9:1963:x1830948733913088:12345-192.168.202.4@tcp:3:cat.0 Request processed in 29178us (30948us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129564.943003:0:31520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7525 00002000:00100000:0.0:1746129564.943016:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->4194303) req@ffff88009f324700 x1830948733913088/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:305/0 lens 488/440 e 0 to 0 dl 1746129575 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129564.943026:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f324700 with x1830948733913088 ext(3145728->4194303) 00002000:00010000:0.0:1746129564.943032:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f324700 00000100:00100000:1.0:1746129564.951958:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129564.952048:0:4699:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733913728 00000100:00100000:0.0:1746129564.952056:0:4699:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733913728 00000100:00100000:0.0:1746129564.952105:0:4699:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15652 00000100:00100000:0.0:1746129564.952111:0:4699:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bf7cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+13:32061:x1830948733913728:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129564.952129:0:4699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129564.952146:0:4699:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b4e59600/0x40a459093b068983 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f203ac expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129564.952174:0:4699:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129564.952178:0:4699:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b4e59600/0x40a459093b068983 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f203ac expref: 14 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129564.952189:0:4699:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b4e59600/0x40a459093b068983 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f203ac expref: 14 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129564.952199:0:4699:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4e59600, rc 0) 00000100:00100000:0.0:1746129564.952248:0:4699:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bf7cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+14:32061:x1830948733913728:12345-192.168.202.4@tcp:101:cat.0 Request processed in 137us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129564.952254:0:4699:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15652 00000100:00100000:0.0:1746129564.961605:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129564.976519:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129564.976596:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129564.976647:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129564.979195:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129564.979218:0:31521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733914880 00000100:00100000:0.0:1746129564.979224:0:31521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733914880 00002000:00100000:0.0:1746129564.979255:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f5:0x0] (2097152->3145727) req@ffff88013575f800 x1830948733914880/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:305/0 lens 488/0 e 0 to 0 dl 1746129575 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129564.979265:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013575f800 with x1830948733914880 ext(2097152->3145727) 00002000:00010000:0.0:1746129564.979270:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013575f800 00000100:00100000:0.0:1746129564.979282:0:31521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7529 00000100:00100000:0.0:1746129564.979287:0:31521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013575f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+10:1962:x1830948733914880:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:1.0:1746129564.979876:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129564.979898:0:31520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733915136 00000100:00100000:1.0:1746129564.979901:0:31520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733915136 00002000:00100000:1.0:1746129564.979919:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3f5:0x0] (3145728->4194303) req@ffff88009feeea00 x1830948733915136/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:305/0 lens 488/0 e 0 to 0 dl 1746129575 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129564.979933:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009feeea00 with x1830948733915136 ext(3145728->4194303) 00002000:00010000:1.0:1746129564.979936:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009feeea00 00000100:00100000:1.0:1746129564.979952:0:8417:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7530 00000100:00100000:1.0:1746129564.979957:0:8417:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009feeea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+11:1962:x1830948733915136:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129564.993149:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129565.007624:0:31521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013575f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+10:1962:x1830948733914880:12345-192.168.202.4@tcp:3:cat.0 Request processed in 28327us (28421us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129565.007634:0:31521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7529 00002000:00100000:1.0:1746129565.007643:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f5:0x0] (2097152->3145727) req@ffff88013575f800 x1830948733914880/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:305/0 lens 488/440 e 0 to 0 dl 1746129575 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129565.007651:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013575f800 with x1830948733914880 ext(2097152->3145727) 00002000:00010000:1.0:1746129565.007656:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013575f800 00000100:00100000:0.0:1746129565.010165:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00080000:0.0:1746129565.011433:0:7097:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746129565.015835:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.015951:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.015981:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00080000:0.0:1746129565.016457:0:7097:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746129565.018034:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.018466:0:15749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733916032 00000100:00100000:0.0:1746129565.018472:0:15749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733916032 00010000:00010000:0.0:1746129565.018497:0:15749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012db48800/0x40a459093b06896e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20397 expref: 19 pid: 22480 timeout: 920 lvb_type: 0 00000100:00100000:0.0:1746129565.018535:0:15749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7997 00000100:00100000:0.0:1746129565.018541:0:15749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009feec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ada2ffba-8920-4ecb-8068-68caa9806978+19:1963:x1830948733916032:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129565.018552:0:15749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129565.018572:0:15749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012db48800/0x40a459093b06896e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20397 expref: 19 pid: 22480 timeout: 920 lvb_type: 0 00010000:00010000:0.0:1746129565.018582:0:15749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012db48800/0x40a459093b06896e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20397 expref: 19 pid: 22480 timeout: 920 lvb_type: 0 00010000:00010000:0.0:1746129565.018745:0:15749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012db48800/0x40a459093b06896e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20397 expref: 19 pid: 22480 timeout: 920 lvb_type: 0 00010000:00010000:0.0:1746129565.018763:0:15749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129565.018765:0:15749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129565.018771:0:15749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094c09c00/0x40a459093b0689ad lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4034560->4104191) gid 0 flags: 0x60080000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f203ba expref: 18 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129565.018779:0:15749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094c09c00/0x40a459093b0689ad lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4034560->4104191) gid 0 flags: 0x60080000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f203ba expref: 18 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129565.018803:0:15749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094c09c00/0x40a459093b0689ad lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4034560->4104191) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f203ba expref: 18 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129565.018814:0:15749:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094c09c00/0x40a459093b0689ad lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4034560->4104191) gid 0 flags: 0x70000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f203ba expref: 18 pid: 22480 timeout: 920 lvb_type: 0 00000100:00100000:0.0:1746129565.018831:0:15749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e87ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15749:1830948737429888:192.168.202.4@tcp:105: 00000100:00100000:0.0:1746129565.019103:0:15749:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093da8e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746129565.019578:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.020841:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129565.020971:0:31521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733916416 00000100:00100000:1.0:1746129565.020975:0:31521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733916416 00002000:00100000:1.0:1746129565.021002:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3ef:0x0] (4034560->4038655) req@ffff88012e87ed80 x1830948733916416/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:306/0 lens 488/0 e 0 to 0 dl 1746129576 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129565.021012:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e87ed80 with x1830948733916416 ext(4034560->4038655) 00010000:00010000:1.0:1746129565.021017:0:31521:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094c09c00/0x40a459093b0689ad lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4034560->4104191) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f203ba expref: 19 pid: 22480 timeout: 920 lvb_type: 0 00010000:00010000:1.0:1746129565.021027:0:31521:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094c09c00/0x40a459093b0689ad lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4034560->4104191) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f203ba expref: 19 pid: 22480 timeout: 920 lvb_type: 0 00002000:00010000:1.0:1746129565.021033:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012e87ed80 00000100:00100000:1.0:1746129565.021158:0:31521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2352 00000100:00100000:1.0:1746129565.021164:0:31521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e87ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ada2ffba-8920-4ecb-8068-68caa9806978+19:1962:x1830948733916416:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:1.0:1746129565.021390:0:31521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e87ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ada2ffba-8920-4ecb-8068-68caa9806978+19:1962:x1830948733916416:12345-192.168.202.4@tcp:3:cat.0 Request processed in 224us (547us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746129565.021396:0:31521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2352 00002000:00100000:1.0:1746129565.021401:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3ef:0x0] (4034560->4038655) req@ffff88012e87ed80 x1830948733916416/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:306/0 lens 488/4536 e 0 to 0 dl 1746129576 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129565.021408:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e87ed80 with x1830948733916416 ext(4034560->4038655) 00010000:00010000:1.0:1746129565.021412:0:31521:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094c09c00/0x40a459093b0689ad lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4034560->4104191) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f203ba expref: 19 pid: 22480 timeout: 920 lvb_type: 0 00010000:00010000:1.0:1746129565.021421:0:31521:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094c09c00/0x40a459093b0689ad lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4034560->4104191) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f203ba expref: 19 pid: 22480 timeout: 920 lvb_type: 0 00002000:00010000:1.0:1746129565.021427:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012e87ed80 00000100:00100000:0.0:1746129565.022805:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129565.022855:0:31521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733916672 00000100:00100000:1.0:1746129565.022862:0:31521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733916672 00002000:00100000:1.0:1746129565.022888:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3ef:0x0] (4100096->4104191) req@ffff88012e87e680 x1830948733916672/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:306/0 lens 488/0 e 0 to 0 dl 1746129576 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129565.022895:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e87e680 with x1830948733916672 ext(4100096->4104191) 00010000:00010000:1.0:1746129565.022901:0:31521:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094c09c00/0x40a459093b0689ad lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4034560->4104191) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f203ba expref: 19 pid: 22480 timeout: 920 lvb_type: 0 00010000:00010000:1.0:1746129565.022912:0:31521:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094c09c00/0x40a459093b0689ad lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4034560->4104191) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f203ba expref: 19 pid: 22480 timeout: 920 lvb_type: 0 00002000:00010000:1.0:1746129565.022918:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012e87e680 00000100:00100000:1.0:1746129565.022944:0:31521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2353 00000100:00100000:1.0:1746129565.022950:0:31521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e87e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ada2ffba-8920-4ecb-8068-68caa9806978+19:1963:x1830948733916672:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:1.0:1746129565.023078:0:31521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e87e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ada2ffba-8920-4ecb-8068-68caa9806978+19:1963:x1830948733916672:12345-192.168.202.4@tcp:3:cat.0 Request processed in 127us (276us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746129565.023083:0:31521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2353 00002000:00100000:1.0:1746129565.023087:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3ef:0x0] (4100096->4104191) req@ffff88012e87e680 x1830948733916672/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:306/0 lens 488/4536 e 0 to 0 dl 1746129576 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129565.023094:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e87e680 with x1830948733916672 ext(4100096->4104191) 00010000:00010000:1.0:1746129565.023098:0:31521:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094c09c00/0x40a459093b0689ad lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4034560->4104191) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f203ba expref: 19 pid: 22480 timeout: 920 lvb_type: 0 00010000:00010000:1.0:1746129565.023106:0:31521:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094c09c00/0x40a459093b0689ad lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4034560->4104191) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f203ba expref: 19 pid: 22480 timeout: 920 lvb_type: 0 00002000:00010000:1.0:1746129565.023110:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012e87e680 00000100:00100000:0.0:1746129565.024585:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.024638:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129565.024991:0:31521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733916928 00000100:00100000:1.0:1746129565.024995:0:31521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733916928 00002000:00100000:1.0:1746129565.025018:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3ef:0x0] (4034560->4104191) req@ffff88012e87c700 x1830948733916928/t0(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:306/0 lens 488/0 e 0 to 0 dl 1746129576 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129565.025027:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e87c700 with x1830948733916928 ext(4034560->4104191) 00010000:00010000:1.0:1746129565.025035:0:31521:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094c09c00/0x40a459093b0689ad lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4034560->4104191) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f203ba expref: 19 pid: 22480 timeout: 920 lvb_type: 0 00010000:00010000:1.0:1746129565.025046:0:31521:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094c09c00/0x40a459093b0689ad lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4034560->4104191) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f203ba expref: 19 pid: 22480 timeout: 920 lvb_type: 0 00002000:00010000:1.0:1746129565.025058:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012e87c700 00000100:00100000:1.0:1746129565.025072:0:31521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2354 00000100:00100000:1.0:1746129565.025078:0:31521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e87c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ada2ffba-8920-4ecb-8068-68caa9806978+19:1960:x1830948733916928:12345-192.168.202.4@tcp:4:cat.0 00000100:00080000:0.0:1746129565.025180:0:7097:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746129565.028682:0:31521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e87c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ada2ffba-8920-4ecb-8068-68caa9806978+21:1960:x1830948733916928:12345-192.168.202.4@tcp:4:cat.0 Request processed in 3591us (4090us total) trans 21474841254 rc 0/0 00000100:00100000:1.0:1746129565.028695:0:31521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2354 00002000:00100000:1.0:1746129565.028706:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3ef:0x0] (4034560->4104191) req@ffff88012e87c700 x1830948733916928/t21474841254(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:306/0 lens 488/448 e 0 to 0 dl 1746129576 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129565.028716:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e87c700 with x1830948733916928 ext(4034560->4104191) 00010000:00010000:1.0:1746129565.028727:0:31521:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094c09c00/0x40a459093b0689ad lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4034560->4104191) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f203ba expref: 21 pid: 22480 timeout: 920 lvb_type: 0 00010000:00010000:1.0:1746129565.028742:0:31521:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094c09c00/0x40a459093b0689ad lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4034560->4104191) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f203ba expref: 21 pid: 22480 timeout: 920 lvb_type: 0 00002000:00010000:1.0:1746129565.028749:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012e87c700 00000100:00100000:0.0:1746129565.031935:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.038464:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129565.038603:0:31521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733917568 00000100:00100000:1.0:1746129565.038617:0:31521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733917568 00002000:00100000:1.0:1746129565.038668:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3ef:0x0] (4194304->5148671) req@ffff88012e87ea00 x1830948733917568/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:306/0 lens 488/0 e 0 to 0 dl 1746129576 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129565.038677:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e87ea00 with x1830948733917568 ext(4194304->5148671) 00002000:00010000:1.0:1746129565.038682:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e87ea00 00000100:00100000:1.0:1746129565.038876:0:31521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7531 00000100:00100000:1.0:1746129565.038886:0:31521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e87ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ada2ffba-8920-4ecb-8068-68caa9806978+21:1961:x1830948733917568:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129565.042169:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.046385:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129565.046990:0:31521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e87ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ada2ffba-8920-4ecb-8068-68caa9806978+20:1961:x1830948733917568:12345-192.168.202.4@tcp:3:cat.0 Request processed in 8104us (8533us total) trans 0 rc 954368/954368 00000100:00100000:1.0:1746129565.046998:0:31521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7531 00002000:00100000:1.0:1746129565.047006:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3ef:0x0] (4194304->5148671) req@ffff88012e87ea00 x1830948733917568/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:306/0 lens 488/440 e 0 to 0 dl 1746129576 ref 1 fl Complete:/200/0 rc 954368/954368 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129565.047015:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e87ea00 with x1830948733917568 ext(4194304->5148671) 00002000:00010000:1.0:1746129565.047019:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e87ea00 00000100:00100000:0.0:1746129565.062541:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.076239:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.076286:0:31522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733918592 00000100:00100000:0.0:1746129565.076310:0:31522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733918592 00002000:00100000:0.0:1746129565.076357:0:31522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3ef:0x0] (4194304->5148671) req@ffff880093cedf80 x1830948733918592/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:306/0 lens 488/0 e 0 to 0 dl 1746129576 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129565.076381:0:31522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093cedf80 with x1830948733918592 ext(4194304->5148671) 00002000:00010000:0.0:1746129565.076386:0:31522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093cedf80 00000100:00100000:0.0:1746129565.076416:0:31522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7533 00000100:00100000:0.0:1746129565.076424:0:31522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+9:1963:x1830948733918592:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129565.086411:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129565.094216:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129565.094241:0:4699:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733918848 00000100:00100000:1.0:1746129565.094250:0:4699:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733918848 00000100:00100000:1.0:1746129565.094325:0:4699:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15657 00000100:00100000:1.0:1746129565.094332:0:4699:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009feec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:068dab75-d300-4ead-a742-d14572ad1e50+6:1963:x1830948733918848:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:1.0:1746129565.094354:0:4699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129565.094381:0:4699:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a95ede00/0x40a459093b068a08 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f203e4 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129565.094404:0:4699:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129565.094406:0:4699:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129565.094414:0:4699:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a95ede00/0x40a459093b068a08 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f203e4 expref: 7 pid: 4699 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129565.094428:0:4699:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a95ede00/0x40a459093b068a08 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f203e4 expref: 7 pid: 4699 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129565.094440:0:4699:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a95ede00, rc 0) 00000100:00100000:1.0:1746129565.094482:0:4699:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009feec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:068dab75-d300-4ead-a742-d14572ad1e50+7:1963:x1830948733918848:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 151us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129565.094488:0:4699:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15657 00000100:00100000:1.0:1746129565.094515:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129565.094527:0:4699:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733918976 00000100:00100000:1.0:1746129565.094529:0:4699:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733918976 00000100:00100000:1.0:1746129565.094541:0:4699:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15658 00000100:00100000:1.0:1746129565.094545:0:4699:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009feef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:068dab75-d300-4ead-a742-d14572ad1e50+7:1962:x1830948733918976:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:1.0:1746129565.094551:0:4699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129565.094557:0:4699:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a95ec000/0x40a459093b068a0f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f203eb expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129565.094565:0:4699:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129565.094567:0:4699:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129565.094570:0:4699:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a95ec000/0x40a459093b068a0f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f203eb expref: 8 pid: 4699 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129565.094578:0:4699:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a95ec000/0x40a459093b068a0f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f203eb expref: 8 pid: 4699 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129565.094585:0:4699:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a95ec000, rc 0) 00000100:00100000:1.0:1746129565.094597:0:4699:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009feef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:068dab75-d300-4ead-a742-d14572ad1e50+8:1962:x1830948733918976:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 51us (82us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129565.094601:0:4699:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15658 00000100:00100000:1.0:1746129565.094653:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129565.094665:0:20577:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733919104 00000100:00100000:1.0:1746129565.094668:0:20577:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733919104 00000100:00100000:1.0:1746129565.094685:0:20577:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15659 00000100:00100000:1.0:1746129565.094690:0:20577:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009feefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:068dab75-d300-4ead-a742-d14572ad1e50+7:1963:x1830948733919104:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:1.0:1746129565.094697:0:20577:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129565.094706:0:20577:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a95ece00/0x40a459093b068a16 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f203f2 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129565.094717:0:20577:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129565.094718:0:20577:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129565.094723:0:20577:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a95ece00/0x40a459093b068a16 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f203f2 expref: 8 pid: 20577 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129565.094732:0:20577:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a95ece00/0x40a459093b068a16 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f203f2 expref: 8 pid: 20577 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129565.094738:0:20577:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a95ece00, rc 0) 00000100:00100000:1.0:1746129565.094750:0:20577:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009feefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:068dab75-d300-4ead-a742-d14572ad1e50+8:1963:x1830948733919104:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 59us (97us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129565.094755:0:20577:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15659 00000100:00080000:0.0:1746129565.095018:0:7097:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1746129565.095023:0:7097:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746129565.097739:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129565.099801:0:8414:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737430656 00000100:00100000:1.0:1746129565.099808:0:8414:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737430656 00000100:00100000:1.0:1746129565.099856:0:8414:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1746129565.099861:0:8414:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009507c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+14:3302:x1830948737430656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1746129565.099881:0:8414:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 543096832 pending 5111808 free 3852468224 avail 3836739584 00000100:00100000:1.0:1746129565.099921:0:8414:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009507c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+14:3302:x1830948737430656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 60us (1076us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129565.099927:0:8414:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1746129565.099974:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00080000:0.0:1746129565.100073:0:7097:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1746129565.103836:0:14586:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 9 in progress, 0 in flight, 54 done 00000100:00100000:0.0:1746129565.104589:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.104617:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.104643:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.104677:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129565.107858:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129565.107887:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.107993:0:20578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733920384 00000100:00100000:0.0:1746129565.107999:0:20578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733920384 00010000:00010000:0.0:1746129565.108027:0:20578:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a95ede00/0x40a459093b068a08 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f203e4 expref: 8 pid: 4699 timeout: 920 lvb_type: 1 00000100:00100000:0.0:1746129565.108262:0:20578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8002 00000100:00100000:0.0:1746129565.108270:0:20578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009feec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ada2ffba-8920-4ecb-8068-68caa9806978+20:1963:x1830948733920256:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129565.108283:0:20578:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746129565.108324:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00010000:00010000:0.0:1746129565.108327:0:20578:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094c08a00/0x40a459093b0689b4 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f203c1 expref: 20 pid: 22480 timeout: 920 lvb_type: 1 00010000:00010000:0.0:1746129565.108337:0:20578:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094c08a00/0x40a459093b0689b4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f203c1 expref: 20 pid: 22480 timeout: 920 lvb_type: 1 00000100:00100000:1.0:1746129565.108339:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733920512 00000100:00100000:1.0:1746129565.108342:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733920512 00010000:00010000:1.0:1746129565.108355:0:7087:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095ab1000/0x40a459093b068952 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2037b expref: 11 pid: 22480 timeout: 920 lvb_type: 0 00010000:00010000:0.0:1746129565.108359:0:20578:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129565.108383:0:7087:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8003 00000100:00100000:1.0:1746129565.108388:0:7087:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009feed880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:068dab75-d300-4ead-a742-d14572ad1e50+8:1960:x1830948733920384:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129565.108395:0:7087:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129565.108403:0:7087:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a95ede00/0x40a459093b068a08 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f203e4 expref: 8 pid: 4699 timeout: 920 lvb_type: 1 00000100:00100000:0.0:1746129565.108404:0:20578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009feec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ada2ffba-8920-4ecb-8068-68caa9806978+20:1963:x1830948733920256:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 135us (516us total) trans 0 rc 0/0 00010000:00010000:1.0:1746129565.108410:0:7087:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a95ede00/0x40a459093b068a08 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f203e4 expref: 8 pid: 4699 timeout: 920 lvb_type: 1 00000100:00100000:0.0:1746129565.108410:0:20578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8002 00010000:00010000:1.0:1746129565.108420:0:7087:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129565.108423:0:20578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8004 00000100:00100000:0.0:1746129565.108427:0:20578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009feee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+11:1963:x1830948733920512:12345-192.168.202.4@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746129565.108432:0:7087:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009feed880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:068dab75-d300-4ead-a742-d14572ad1e50+8:1960:x1830948733920384:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 45us (582us total) trans 0 rc 0/0 00010000:00010000:0.0:1746129565.108432:0:20578:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746129565.108437:0:7087:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8003 00010000:00010000:0.0:1746129565.108439:0:20578:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095ab1000/0x40a459093b068952 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2037b expref: 11 pid: 22480 timeout: 920 lvb_type: 0 00010000:00010000:0.0:1746129565.108446:0:20578:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095ab1000/0x40a459093b068952 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2037b expref: 11 pid: 22480 timeout: 920 lvb_type: 0 00010000:00010000:0.0:1746129565.108456:0:20578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129565.108458:0:20578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129565.108466:0:20578:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5a86800/0x40a459093b068a2b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1597440->2056191) gid 0 flags: 0x50080000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20400 expref: 11 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129565.108475:0:20578:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5a86800/0x40a459093b068a2b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1597440->2056191) gid 0 flags: 0x50080000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20400 expref: 11 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129565.108504:0:20578:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5a86800/0x40a459093b068a2b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1597440->2056191) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20400 expref: 11 pid: 22480 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129565.108517:0:20578:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093cee300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:20578:1830948737431168:192.168.202.4@tcp:105: 00000100:00100000:0.0:1746129565.108563:0:20578:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093da8c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746129565.108723:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.111032:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.111927:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.113679:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.115395:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.117198:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.117242:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129565.117434:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733921920 00000100:00100000:1.0:1746129565.117438:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733921920 00000100:00100000:1.0:1746129565.117473:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4693 00000100:00100000:1.0:1746129565.117478:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095f44c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+11:32068:x1830948733921920:12345-192.168.202.4@tcp:35:multiop.0 00000100:00100000:1.0:1746129565.117732:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095f44c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+12:32068:x1830948733921920:12345-192.168.202.4@tcp:35:multiop.0 Request processed in 253us (488us total) trans 8589945184 rc 0/0 00000100:00100000:1.0:1746129565.117738:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4693 00000100:00100000:0.0:1746129565.119876:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.119948:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.120104:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.120399:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.120482:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.120512:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129565.120754:0:4699:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15664 00000100:00100000:1.0:1746129565.120762:0:4699:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800903a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:068dab75-d300-4ead-a742-d14572ad1e50+10:1963:x1830948733922304:12345-192.168.202.4@tcp:1:lfs.0 00010000:00010000:1.0:1746129565.120817:0:4699:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009fb27000/0x40a459093b068a71 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129565.120826:0:4699:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095274a00/0x40a459093b0687ed lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f202be expref: 10 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129565.120833:0:4699:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ce27800/0x40a459093b068928 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20351 expref: 9 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129565.120840:0:4699:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c663200/0x40a459093b068880 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f202ef expref: 21 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129565.120845:0:4699:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129565.120846:0:4699:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129565.120848:0:4699:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb27000/0x40a459093b068a71 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129565.120862:0:4699:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c663200/0x40a459093b068880 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f202ef expref: 21 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129565.120869:0:4699:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c663200/0x40a459093b068880 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f202ef expref: 21 pid: 7148 timeout: 920 lvb_type: 1 00000100:00100000:1.0:1746129565.120882:0:4699:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009feec700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4699:1830948737431808:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129565.120978:0:8411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15665 00000100:00100000:0.0:1746129565.120984:0:8411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800903a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:068dab75-d300-4ead-a742-d14572ad1e50+9:1963:x1830948733922432:12345-192.168.202.4@tcp:1:lfs.0 00010000:00010000:0.0:1746129565.120998:0:8411:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009cfd6a00/0x40a459093b068a78 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129565.121007:0:8411:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5a86800/0x40a459093b068a2b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1597440->2056191) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20400 expref: 8 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129565.121013:0:8411:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129565.121014:0:8411:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129565.121016:0:8411:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cfd6a00/0x40a459093b068a78 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129565.121028:0:8411:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5a86800/0x40a459093b068a2b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1597440->2056191) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20400 expref: 8 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129565.121035:0:8411:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5a86800/0x40a459093b068a2b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1597440->2056191) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20400 expref: 8 pid: 22480 timeout: 920 lvb_type: 0 00000100:00100000:0.0:1746129565.121042:0:8411:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800903a3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8411:1830948737432192:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129565.121059:0:8411:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093da89c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129565.121078:0:8410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15667 00000100:00100000:0.0:1746129565.121082:0:8410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800903a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:068dab75-d300-4ead-a742-d14572ad1e50+10:1963:x1830948733922688:12345-192.168.202.4@tcp:1:lfs.0 00010000:00010000:0.0:1746129565.121096:0:8410:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009cfd6600/0x40a459093b068a86 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129565.121104:0:8410:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c0ab400/0x40a459093b06897c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f203a5 expref: 21 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129565.121110:0:8410:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a95ece00/0x40a459093b068a16 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f203f2 expref: 10 pid: 20577 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129565.121116:0:8410:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b4e59600/0x40a459093b068983 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f203ac expref: 9 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129565.121122:0:8410:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129565.121123:0:8410:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129565.121125:0:8410:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cfd6600/0x40a459093b068a86 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129565.121136:0:8410:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b4e59600/0x40a459093b068983 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f203ac expref: 9 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129565.121142:0:8410:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b4e59600/0x40a459093b068983 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f203ac expref: 9 pid: 4699 timeout: 920 lvb_type: 0 00000100:00100000:0.0:1746129565.121150:0:8410:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800903a0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8410:1830948737432448:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129565.121169:0:8410:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a95ece00/0x40a459093b068a16 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f203f2 expref: 10 pid: 20577 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129565.121181:0:8410:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a95ece00/0x40a459093b068a16 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f203f2 expref: 10 pid: 20577 timeout: 920 lvb_type: 1 00000100:00100000:0.0:1746129565.121188:0:8410:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800903a3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8410:1830948737432704:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129565.121203:0:8410:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c0ab400/0x40a459093b06897c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f203a5 expref: 21 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129565.121210:0:8410:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c0ab400/0x40a459093b06897c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f203a5 expref: 21 pid: 4699 timeout: 920 lvb_type: 0 00000100:00100000:0.0:1746129565.121216:0:8410:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800903a3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8410:1830948737432960:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129565.121226:0:8410:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093da8c00 going to sleep for 11 seconds 00010000:00010000:1.0:1746129565.121248:0:4699:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012ce27800/0x40a459093b068928 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20351 expref: 9 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129565.121257:0:4699:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012ce27800/0x40a459093b068928 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20351 expref: 9 pid: 22480 timeout: 920 lvb_type: 1 00000100:00100000:1.0:1746129565.121264:0:4699:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009feee300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4699:1830948737433088:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129565.121285:0:4699:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095274a00/0x40a459093b0687ed lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f202be expref: 10 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129565.121305:0:4699:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095274a00/0x40a459093b0687ed lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f202be expref: 10 pid: 7149 timeout: 920 lvb_type: 1 00000100:00100000:1.0:1746129565.121314:0:4699:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009feef100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4699:1830948737433216:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129565.121329:0:4699:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5ff83c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129565.124862:0:8411:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800903a3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8411:1830948737432192:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129565.124889:0:8411:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009cfd6a00/0x40a459093b068a78 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129565.124938:0:8410:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800903a0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8410:1830948737432448:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129565.124968:0:8410:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800903a3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8410:1830948737432704:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129565.124995:0:8410:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800903a3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8410:1830948737432960:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129565.125008:0:8410:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009cfd6600/0x40a459093b068a86 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129565.125224:0:4699:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009feec700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4699:1830948737431808:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129565.125233:0:4699:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009feee300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4699:1830948737433088:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129565.125244:0:4699:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009feef100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4699:1830948737433216:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129565.125261:0:4699:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009fb27000/0x40a459093b068a71 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129565.131212:0:14543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737433728 00000100:00100000:1.0:1746129565.131221:0:14543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737433728 00000100:00100000:1.0:1746129565.131259:0:14543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1746129565.131266:0:14543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f03f6bde-e986-4df5-86c3-48805e205677+18:3300:x1830948737433728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746129565.131338:0:14543:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f03f6bde-e986-4df5-86c3-48805e205677+18:3300:x1830948737433728:12345-0@lo:400:kworker.0 Request processed in 72us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129565.131344:0:14543:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1746129565.131676:0:12977:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737433600 00000100:00100000:0.0:1746129565.131679:0:12977:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737433600 00000100:00100000:0.0:1746129565.131710:0:12977:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:0.0:1746129565.131715:0:12977:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009507e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+13:3302:x1830948737433600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1746129565.131731:0:12977:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 541261824 pending 1703936 free 3853516800 avail 3851419648 00000100:00100000:0.0:1746129565.131767:0:12977:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009507e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+13:3302:x1830948737433600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 52us (997us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129565.131772:0:12977:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00080000:1.0:1746129565.132355:0:7097:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1746129565.132358:0:7097:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746129565.132659:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129565.132689:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129565.132703:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129565.132715:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129565.132727:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129565.132742:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733922816 00000100:00100000:1.0:1746129565.132745:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733922816 00010000:00010000:1.0:1746129565.132766:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012e3a7600/0x40a459093b068879 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f202e1 expref: 19 pid: 4699 timeout: 920 lvb_type: 1 00000100:00100000:1.0:1746129565.132784:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733923840 00000100:00100000:1.0:1746129565.132785:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733923840 00010000:00010000:1.0:1746129565.132793:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012ce27800/0x40a459093b068928 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20351 expref: 10 pid: 22480 timeout: 920 lvb_type: 1 00000100:00100000:1.0:1746129565.132807:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733924096 00000100:00100000:1.0:1746129565.132809:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733924096 00010000:00010000:1.0:1746129565.132823:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c0ab400/0x40a459093b06897c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f203a5 expref: 22 pid: 4699 timeout: 920 lvb_type: 0 00000100:00100000:1.0:1746129565.132830:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733924352 00000100:00100000:1.0:1746129565.132832:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733924352 00010000:00010000:1.0:1746129565.132841:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090078800/0x40a459093b068802 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f202b7 expref: 11 pid: 8411 timeout: 920 lvb_type: 1 00000100:00100000:1.0:1746129565.132849:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733923712 00000100:00100000:1.0:1746129565.132851:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733923712 00010000:00010000:1.0:1746129565.132859:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012ce27400/0x40a459093b06891a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20343 expref: 9 pid: 22480 timeout: 920 lvb_type: 1 00000100:00100000:1.0:1746129565.132869:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8006 00000100:00100000:1.0:1746129565.132873:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6fd3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ada2ffba-8920-4ecb-8068-68caa9806978+19:1961:x1830948733922816:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129565.132883:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129565.132907:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012e3a7600/0x40a459093b068879 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f202e1 expref: 19 pid: 4699 timeout: 920 lvb_type: 1 00010000:00010000:1.0:1746129565.132918:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012e3a7600/0x40a459093b068879 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f202e1 expref: 19 pid: 4699 timeout: 920 lvb_type: 1 00010000:00010000:1.0:1746129565.132941:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e3a7600/0x40a459093b068879 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f202e1 expref: 19 pid: 4699 timeout: 920 lvb_type: 1 00010000:00010000:1.0:1746129565.132960:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129565.132989:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6fd3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ada2ffba-8920-4ecb-8068-68caa9806978+18:1961:x1830948733922816:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 115us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129565.132994:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8006 00000100:00100000:1.0:1746129565.133024:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8009 00000100:00100000:1.0:1746129565.133027:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009feedc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:068dab75-d300-4ead-a742-d14572ad1e50+11:1960:x1830948733924352:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129565.133032:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129565.133039:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090078800/0x40a459093b068802 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f202b7 expref: 11 pid: 8411 timeout: 920 lvb_type: 1 00010000:00010000:1.0:1746129565.133047:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090078800/0x40a459093b068802 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f202b7 expref: 11 pid: 8411 timeout: 920 lvb_type: 1 00010000:00010000:1.0:1746129565.133058:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090078800/0x40a459093b068802 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f202b7 expref: 11 pid: 8411 timeout: 920 lvb_type: 1 00010000:00010000:1.0:1746129565.133065:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129565.133074:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009feedc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:068dab75-d300-4ead-a742-d14572ad1e50+10:1960:x1830948733924352:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 47us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129565.133081:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8009 00000100:00080000:1.0:1746129565.133093:0:7097:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746129565.133112:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129565.133126:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733923968 00000100:00100000:1.0:1746129565.133128:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733923968 00010000:00010000:1.0:1746129565.133137:0:7087:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095274a00/0x40a459093b0687ed lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f202be expref: 10 pid: 7149 timeout: 920 lvb_type: 1 00000100:00100000:1.0:1746129565.133149:0:7087:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8011 00000100:00100000:1.0:1746129565.133153:0:7087:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009feec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:068dab75-d300-4ead-a742-d14572ad1e50+10:1960:x1830948733923968:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129565.133159:0:7087:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129565.133166:0:7087:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095274a00/0x40a459093b0687ed lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f202be expref: 10 pid: 7149 timeout: 920 lvb_type: 1 00010000:00010000:1.0:1746129565.133173:0:7087:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095274a00/0x40a459093b0687ed lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f202be expref: 10 pid: 7149 timeout: 920 lvb_type: 1 00000100:00100000:0.0:1746129565.133254:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.133266:0:7086:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733924224 00000100:00100000:0.0:1746129565.133269:0:7086:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733924224 00010000:00010000:0.0:1746129565.133280:0:7086:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095275e00/0x40a459093b068872 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f202e8 expref: 21 pid: 8412 timeout: 920 lvb_type: 1 00000100:00100000:0.0:1746129565.133315:0:7086:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8012 00000100:00100000:0.0:1746129565.133320:0:7086:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800903a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ada2ffba-8920-4ecb-8068-68caa9806978+21:1960:x1830948733924224:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129565.133326:0:7086:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129565.133334:0:7086:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095275e00/0x40a459093b068872 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f202e8 expref: 21 pid: 8412 timeout: 920 lvb_type: 1 00010000:00010000:0.0:1746129565.133341:0:7086:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095275e00/0x40a459093b068872 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f202e8 expref: 21 pid: 8412 timeout: 920 lvb_type: 1 00010000:00010000:0.0:1746129565.133350:0:7086:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095275e00/0x40a459093b068872 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f202e8 expref: 21 pid: 8412 timeout: 920 lvb_type: 1 00010000:00010000:0.0:1746129565.133375:0:7086:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129565.133390:0:7086:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800903a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ada2ffba-8920-4ecb-8068-68caa9806978+20:1960:x1830948733924224:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 71us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129565.133395:0:7086:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8012 00000100:00100000:0.0:1746129565.133524:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.133535:0:7086:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733924608 00000100:00100000:0.0:1746129565.133538:0:7086:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733924608 00010000:00010000:0.0:1746129565.133548:0:7086:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012ce26000/0x40a459093b068921 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2034a expref: 9 pid: 22480 timeout: 920 lvb_type: 1 00000100:00100000:0.0:1746129565.133561:0:7086:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8013 00000100:00100000:0.0:1746129565.133565:0:7086:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6fd3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+9:1961:x1830948733924608:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129565.133571:0:7086:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129565.133577:0:7086:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012ce26000/0x40a459093b068921 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2034a expref: 9 pid: 22480 timeout: 920 lvb_type: 1 00010000:00010000:0.0:1746129565.133584:0:7086:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012ce26000/0x40a459093b068921 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2034a expref: 9 pid: 22480 timeout: 920 lvb_type: 1 00010000:00010000:0.0:1746129565.133594:0:7086:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ce26000/0x40a459093b068921 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2034a expref: 9 pid: 22480 timeout: 920 lvb_type: 1 00010000:00010000:0.0:1746129565.133603:0:7086:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129565.133604:0:7086:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129565.133609:0:7086:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5a87800/0x40a459093b068a6a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129565.133622:0:7086:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5a87800/0x40a459093b068a6a lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129565.133642:0:7086:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129565.133655:0:7086:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6fd3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+8:1961:x1830948733924608:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 90us (131us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129565.133661:0:7086:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8013 00000100:00100000:0.0:1746129565.133685:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.133696:0:7086:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733922944 00000100:00100000:0.0:1746129565.133699:0:7086:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733922944 00010000:00010000:0.0:1746129565.133708:0:7086:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008e0bb800/0x40a459093b0687f4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f202b0 expref: 10 pid: 11014 timeout: 920 lvb_type: 1 00000100:00100000:0.0:1746129565.133718:0:7086:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8014 00000100:00100000:0.0:1746129565.133722:0:7086:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800903a3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:068dab75-d300-4ead-a742-d14572ad1e50+10:1963:x1830948733922944:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129565.133728:0:7086:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129565.133735:0:7086:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008e0bb800/0x40a459093b0687f4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f202b0 expref: 10 pid: 11014 timeout: 920 lvb_type: 1 00010000:00010000:0.0:1746129565.133743:0:7086:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008e0bb800/0x40a459093b0687f4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f202b0 expref: 10 pid: 11014 timeout: 920 lvb_type: 1 00010000:00010000:0.0:1746129565.133755:0:7086:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e0bb800/0x40a459093b0687f4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f202b0 expref: 10 pid: 11014 timeout: 920 lvb_type: 1 00010000:00010000:0.0:1746129565.133764:0:7086:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129565.133766:0:7086:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129565.133769:0:7086:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880095eb9a00/0x40a459093b068a63 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129565.133775:0:7086:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095eb9a00/0x40a459093b068a63 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129565.133787:0:7086:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129565.133800:0:7086:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800903a3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:068dab75-d300-4ead-a742-d14572ad1e50+9:1963:x1830948733922944:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 77us (114us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129565.133805:0:7086:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8014 00000100:00100000:0.0:1746129565.133832:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.133847:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.133855:0:7086:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733923456 00000100:00100000:0.0:1746129565.133858:0:7086:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733923456 00010000:00010000:0.0:1746129565.133867:0:7086:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a95ec000/0x40a459093b068a0f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f203eb expref: 9 pid: 4699 timeout: 920 lvb_type: 1 00000100:00100000:0.0:1746129565.133877:0:7086:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8015 00000100:00100000:0.0:1746129565.133881:0:7086:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800903a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:068dab75-d300-4ead-a742-d14572ad1e50+9:1963:x1830948733923456:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129565.133887:0:7086:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129565.133895:0:7086:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a95ec000/0x40a459093b068a0f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f203eb expref: 9 pid: 4699 timeout: 920 lvb_type: 1 00010000:00010000:0.0:1746129565.133902:0:7086:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a95ec000/0x40a459093b068a0f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f203eb expref: 9 pid: 4699 timeout: 920 lvb_type: 1 00010000:00010000:0.0:1746129565.133911:0:7086:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a95ec000/0x40a459093b068a0f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f203eb expref: 9 pid: 4699 timeout: 920 lvb_type: 1 00010000:00010000:0.0:1746129565.133920:0:7086:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129565.133930:0:7086:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800903a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:068dab75-d300-4ead-a742-d14572ad1e50+8:1963:x1830948733923456:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 49us (82us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129565.133934:0:7086:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8015 00000100:00100000:0.0:1746129565.133956:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00010000:00010000:1.0:1746129565.134560:0:7087:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095274a00/0x40a459093b0687ed lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f202be expref: 10 pid: 7149 timeout: 920 lvb_type: 1 00010000:00010000:1.0:1746129565.134577:0:7087:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129565.134590:0:7087:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009feec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:068dab75-d300-4ead-a742-d14572ad1e50+8:1960:x1830948733923968:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 1436us (1476us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129565.134595:0:7087:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8011 00000100:00100000:1.0:1746129565.134671:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129565.134688:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733923072 00000100:00100000:1.0:1746129565.134691:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733923072 00010000:00010000:1.0:1746129565.134702:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c663200/0x40a459093b068880 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f202ef expref: 20 pid: 7148 timeout: 920 lvb_type: 1 00000100:00100000:1.0:1746129565.134715:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8016 00000100:00100000:1.0:1746129565.134719:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009feee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ada2ffba-8920-4ecb-8068-68caa9806978+20:1963:x1830948733923072:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129565.134725:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129565.134732:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c663200/0x40a459093b068880 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f202ef expref: 20 pid: 7148 timeout: 920 lvb_type: 1 00010000:00010000:1.0:1746129565.134740:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c663200/0x40a459093b068880 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f202ef expref: 20 pid: 7148 timeout: 920 lvb_type: 1 00010000:00010000:1.0:1746129565.134749:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c663200/0x40a459093b068880 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f202ef expref: 20 pid: 7148 timeout: 920 lvb_type: 1 00010000:00010000:1.0:1746129565.134756:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129565.134757:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129565.134760:0:7085:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb27000/0x40a459093b068a71 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129565.134770:0:7085:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb27000/0x40a459093b068a71 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129565.134783:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129565.134792:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009feee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ada2ffba-8920-4ecb-8068-68caa9806978+19:1963:x1830948733923072:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 72us (121us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129565.134796:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8016 00010000:00010000:1.0:1746129565.134809:0:4699:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009fb27000/0x40a459093b068a71 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129565.134815:0:4699:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb27000/0x40a459093b068a71 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129565.134826:0:4699:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009fb27000/0x40a459093b068a71 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129565.134831:0:4699:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb27000/0x40a459093b068a71 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129565.134836:0:4699:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009fb27000/0x40a459093b068a71 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129565.134841:0:4699:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fb27000 already unused, calling callback (ffffffffa086ed70) 00010000:00010000:1.0:1746129565.134843:0:4699:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009fb27000/0x40a459093b068a71 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129565.134852:0:4699:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009fb27000/0x40a459093b068a71 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129565.134860:0:4699:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009fb27000/0x40a459093b068a71 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129565.134865:0:4699:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb27000/0x40a459093b068a71 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129565.135312:0:7086:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733924480 00000100:00100000:0.0:1746129565.135317:0:7086:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733924480 00010000:00010000:0.0:1746129565.135332:0:7086:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094c08400/0x40a459093b0689bb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f203c8 expref: 10 pid: 22480 timeout: 920 lvb_type: 0 00000100:00100000:0.0:1746129565.135351:0:7086:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8017 00000100:00100000:0.0:1746129565.135356:0:7086:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800903a1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+10:1963:x1830948733924480:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129565.135374:0:7086:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129565.135384:0:7086:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094c08400/0x40a459093b0689bb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f203c8 expref: 10 pid: 22480 timeout: 920 lvb_type: 0 00010000:00010000:0.0:1746129565.135392:0:7086:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094c08400/0x40a459093b0689bb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f203c8 expref: 10 pid: 22480 timeout: 920 lvb_type: 0 00010000:00010000:0.0:1746129565.135403:0:7086:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094c08400/0x40a459093b0689bb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f203c8 expref: 10 pid: 22480 timeout: 920 lvb_type: 0 00010000:00010000:0.0:1746129565.135413:0:7086:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129565.135425:0:7086:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800903a1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+9:1963:x1830948733924480:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 69us (1468us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129565.135433:0:7086:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8017 00000100:00100000:0.0:1746129565.135463:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.135473:0:7086:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733923328 00000100:00100000:0.0:1746129565.135476:0:7086:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733923328 00010000:00010000:0.0:1746129565.135487:0:7086:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094c09a00/0x40a459093b0689c2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->5148671) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f203cf expref: 18 pid: 22480 timeout: 920 lvb_type: 0 00000100:00100000:0.0:1746129565.135499:0:7086:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8018 00000100:00100000:0.0:1746129565.135503:0:7086:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800903a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ada2ffba-8920-4ecb-8068-68caa9806978+18:1963:x1830948733923328:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129565.135509:0:7086:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129565.135515:0:7086:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094c09a00/0x40a459093b0689c2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5148671) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f203cf expref: 18 pid: 22480 timeout: 920 lvb_type: 0 00010000:00010000:0.0:1746129565.135523:0:7086:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094c09a00/0x40a459093b0689c2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5148671) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f203cf expref: 18 pid: 22480 timeout: 920 lvb_type: 0 00010000:00010000:0.0:1746129565.135533:0:7086:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094c09a00/0x40a459093b0689c2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5148671) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f203cf expref: 18 pid: 22480 timeout: 920 lvb_type: 0 00010000:00010000:0.0:1746129565.135541:0:7086:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129565.135542:0:7086:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129565.135545:0:7086:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880095eb8e00/0x40a459093b068a7f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129565.135550:0:7086:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095eb8e00/0x40a459093b068a7f lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129565.135582:0:7086:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129565.135592:0:7086:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800903a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ada2ffba-8920-4ecb-8068-68caa9806978+17:1963:x1830948733923328:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 88us (128us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129565.135597:0:7086:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8018 00000100:00100000:0.0:1746129565.135621:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.135665:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.135675:0:7086:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733924736 00000100:00100000:0.0:1746129565.135677:0:7086:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733924736 00010000:00010000:0.0:1746129565.135689:0:7086:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b4e59600/0x40a459093b068983 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f203ac expref: 8 pid: 4699 timeout: 920 lvb_type: 0 00000100:00100000:0.0:1746129565.135701:0:7086:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8019 00000100:00100000:0.0:1746129565.135705:0:7086:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6fd2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+8:1963:x1830948733924736:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129565.135710:0:7086:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129565.135720:0:7086:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b4e59600/0x40a459093b068983 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f203ac expref: 8 pid: 4699 timeout: 920 lvb_type: 0 00010000:00010000:0.0:1746129565.135728:0:7086:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b4e59600/0x40a459093b068983 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f203ac expref: 8 pid: 4699 timeout: 920 lvb_type: 0 00010000:00010000:0.0:1746129565.135738:0:7086:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b4e59600/0x40a459093b068983 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f203ac expref: 8 pid: 4699 timeout: 920 lvb_type: 0 00010000:00010000:0.0:1746129565.135748:0:7086:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129565.135758:0:7086:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6fd2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+7:1963:x1830948733924736:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 53us (93us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129565.135766:0:7086:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8019 00000100:00100000:1.0:1746129565.135825:0:4699:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800903a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:068dab75-d300-4ead-a742-d14572ad1e50+7:1963:x1830948733922304:12345-192.168.202.4@tcp:1:lfs.0 Request processed in 14127us (14782us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129565.135833:0:4699:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15664 00010000:00010000:0.0:1746129565.137229:0:8410:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009cfd6600/0x40a459093b068a86 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129565.137240:0:8410:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cfd6600/0x40a459093b068a86 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129565.137260:0:8410:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009cfd6600/0x40a459093b068a86 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129565.137266:0:8410:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009cfd6600/0x40a459093b068a86 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129565.137272:0:8410:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009cfd6600/0x40a459093b068a86 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129565.137276:0:8410:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009cfd6600 already unused, calling callback (ffffffffa086ed70) 00010000:00010000:0.0:1746129565.137279:0:8410:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009cfd6600/0x40a459093b068a86 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129565.137284:0:8410:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009cfd6600/0x40a459093b068a86 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129565.137756:0:8410:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009cfd6600/0x40a459093b068a86 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129565.137762:0:8410:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cfd6600/0x40a459093b068a86 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129565.137831:0:8410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800903a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:068dab75-d300-4ead-a742-d14572ad1e50+5:1963:x1830948733922688:12345-192.168.202.4@tcp:1:lfs.0 Request processed in 16744us (17314us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129565.137838:0:8410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15667 00000100:00100000:0.0:1746129565.150021:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00010000:00010000:1.0:1746129565.151158:0:8411:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009cfd6a00/0x40a459093b068a78 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129565.151168:0:8411:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cfd6a00/0x40a459093b068a78 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129565.151189:0:8411:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009cfd6a00/0x40a459093b068a78 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129565.151197:0:8411:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009cfd6a00/0x40a459093b068a78 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129565.151204:0:8411:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009cfd6a00/0x40a459093b068a78 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129565.151214:0:8411:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009cfd6a00 already unused, calling callback (ffffffffa086ed70) 00010000:00010000:1.0:1746129565.151218:0:8411:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009cfd6a00/0x40a459093b068a78 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129565.151226:0:8411:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009cfd6a00/0x40a459093b068a78 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129565.151237:0:8411:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009cfd6a00/0x40a459093b068a78 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129565.151242:0:8411:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cfd6a00/0x40a459093b068a78 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129565.151345:0:8411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800903a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:068dab75-d300-4ead-a742-d14572ad1e50+5:1963:x1830948733922432:12345-192.168.202.4@tcp:1:lfs.0 Request processed in 30360us (30944us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129565.151353:0:8411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15665 00000100:00100000:0.0:1746129565.152626:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.154594:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.154629:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.154689:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.155268:0:7086:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8022 00000100:00100000:0.0:1746129565.155277:0:7086:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a77b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ada2ffba-8920-4ecb-8068-68caa9806978+293:1963:x1830948733925248:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129565.155288:0:7086:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129565.155314:0:7086:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880095122a00/0x40a459093b068913 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2033c expref: 293 pid: 16908 timeout: 920 lvb_type: 0 00010000:00010000:0.0:1746129565.155323:0:7086:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880095122a00/0x40a459093b068913 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2033c expref: 293 pid: 16908 timeout: 920 lvb_type: 0 00010000:00010000:0.0:1746129565.155341:0:7086:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095122a00/0x40a459093b068913 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2033c expref: 293 pid: 16908 timeout: 920 lvb_type: 0 00010000:00010000:0.0:1746129565.155356:0:7086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009f469400) 00010000:00010000:0.0:1746129565.155360:0:7086:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880095eb8400/0x40a459093b068a8d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129565.155378:0:7086:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129565.155409:0:7086:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a77b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ada2ffba-8920-4ecb-8068-68caa9806978+292:1963:x1830948733925248:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 135us (820us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129565.155415:0:7086:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8022 00000100:00100000:0.0:1746129565.155429:0:7086:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8023 00000100:00100000:0.0:1746129565.155434:0:7086:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a77b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+13:1962:x1830948733925376:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129565.155439:0:7086:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129565.155442:0:7086:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094c34200/0x40a459093b06890c lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20335 expref: 13 pid: 2271 timeout: 920 lvb_type: 0 00010000:00010000:0.0:1746129565.155449:0:7086:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094c34200/0x40a459093b06890c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20335 expref: 13 pid: 2271 timeout: 920 lvb_type: 0 00010000:00010000:0.0:1746129565.155459:0:7086:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094c34200/0x40a459093b06890c lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20335 expref: 13 pid: 2271 timeout: 920 lvb_type: 0 00010000:00010000:0.0:1746129565.155465:0:7086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009f469400) 00010000:00010000:0.0:1746129565.155468:0:7086:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880095eb8400/0x40a459093b068a8d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129565.155472:0:7086:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129565.155482:0:7086:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a77b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+12:1962:x1830948733925376:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 49us (854us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129565.155486:0:7086:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8023 00000001:00080000:0.0:1746129565.179632:0:14619:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945184 is committed 00000001:00080000:0.0:1746129565.179648:0:14619:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945186 is committed 00000004:00080000:0.0:1746129565.179654:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2597 committed 00000004:00080000:0.0:1746129565.179661:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2578 committed 00000004:00080000:0.0:1746129565.179667:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2577 committed 00000004:00080000:0.0:1746129565.179669:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2576 committed 00000004:00080000:0.0:1746129565.179671:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2575 committed 00000004:00080000:0.0:1746129565.179672:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2596 committed 00000004:00080000:0.0:1746129565.179674:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2574 committed 00000004:00080000:0.0:1746129565.179676:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2595 committed 00000004:00080000:0.0:1746129565.179678:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2573 committed 00000004:00080000:0.0:1746129565.179679:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2594 committed 00000004:00080000:0.0:1746129565.179681:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2593 committed 00000004:00080000:0.0:1746129565.179682:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2592 committed 00000004:00080000:0.0:1746129565.179684:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2572 committed 00000004:00080000:0.0:1746129565.179685:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2571 committed 00000004:00080000:0.0:1746129565.179686:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2591 committed 00000004:00080000:0.0:1746129565.179688:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2590 committed 00000004:00080000:0.0:1746129565.179689:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2570 committed 00000001:00080000:0.0:1746129565.179704:0:14619:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945181 is committed 00000100:00100000:1.0:1746129565.179830:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009feedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737434880:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129565.179895:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129565.179931:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009feee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737435392:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129565.179953:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129565.179964:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f325f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737435904:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129565.179978:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129565.179996:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013145ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737436416:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129565.180009:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129565.180020:0:3301:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 5 async RPCs [0->1] 00000100:00100000:1.0:1746129565.180024:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f327100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737434752:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129565.180044:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737434880 00000100:00100000:1.0:1746129565.180051:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737434880 00000100:00100000:1.0:1746129565.180080:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737435392 00000100:00100000:1.0:1746129565.180082:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737435392 00000100:00100000:1.0:1746129565.180098:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737435904 00000100:00100000:1.0:1746129565.180100:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737435904 00000100:00100000:1.0:1746129565.180111:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737436416 00000100:00100000:1.0:1746129565.180112:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737436416 00000100:00100000:1.0:1746129565.180122:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737435008 00000100:00100000:1.0:1746129565.180123:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737435008 00000100:00100000:1.0:1746129565.180132:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737435520 00000100:00100000:1.0:1746129565.180134:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737435520 00000100:00100000:1.0:1746129565.180139:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737436032 00000100:00100000:1.0:1746129565.180141:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737436032 00000100:00100000:1.0:1746129565.180147:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737436544 00000100:00100000:1.0:1746129565.180149:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737436544 00000100:00100000:1.0:1746129565.180155:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737435136 00000100:00100000:1.0:1746129565.180156:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737435136 00000100:00100000:1.0:1746129565.180164:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737435648 00000100:00100000:1.0:1746129565.180165:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737435648 00000100:00100000:1.0:1746129565.180173:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15668 00000100:00100000:1.0:1746129565.180179:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ced880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+17:3301:x1830948737434880:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129565.180404:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ced880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+19:3301:x1830948737434880:12345-0@lo:2:osp-syn-1-0.0 Request processed in 224us (508us total) trans 17179874021 rc 0/0 00000100:00100000:1.0:1746129565.180409:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15668 00000100:00100000:1.0:1746129565.180420:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15670 00000100:00100000:1.0:1746129565.180424:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+19:3301:x1830948737435904:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129565.180525:0:8411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15671 00000100:00100000:0.0:1746129565.180531:0:8411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+20:3301:x1830948737436416:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129565.180534:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+20:3301:x1830948737435904:12345-0@lo:2:osp-syn-0-0.0 Request processed in 110us (555us total) trans 21474841256 rc 0/0 00000100:00100000:1.0:1746129565.180542:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15670 00000100:00100000:1.0:1746129565.180550:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15672 00000100:00100000:1.0:1746129565.180554:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009507d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+18:3302:x1830948737435008:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746129565.180605:0:8411:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746129565.180607:0:8411:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1746129565.180609:0:8411:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746129565.180611:0:8411:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746129565.180612:0:8411:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1746129565.180666:0:8411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+20:3301:x1830948737436416:12345-0@lo:2:osp-syn-0-0.0 Request processed in 136us (655us total) trans 21474841257 rc 0/0 00000100:00100000:0.0:1746129565.180671:0:8411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15671 00000100:00100000:0.0:1746129565.180681:0:8411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15673 00000100:00100000:0.0:1746129565.180685:0:8411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009507fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+19:3302:x1830948737435520:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129565.181476:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009507d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+19:3302:x1830948737435008:12345-0@lo:2:osp-syn-1-0.0 Request processed in 919us (1437us total) trans 17179874023 rc 0/0 00000100:00100000:1.0:1746129565.181483:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15672 00000100:00100000:1.0:1746129565.181495:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15675 00000100:00100000:1.0:1746129565.181500:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009507c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+20:3302:x1830948737436544:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129565.181584:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009507c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+20:3302:x1830948737436544:12345-0@lo:2:osp-syn-0-0.0 Request processed in 84us (1480us total) trans 21474841259 rc 0/0 00000100:00100000:1.0:1746129565.181589:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15675 00000100:00100000:1.0:1746129565.181599:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15677 00000100:00100000:1.0:1746129565.181604:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f959f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+19:3302:x1830948737435648:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129565.181694:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f959f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+21:3302:x1830948737435648:12345-0@lo:2:osp-syn-0-0.0 Request processed in 90us (1539us total) trans 21474841260 rc 0/0 00000100:00100000:1.0:1746129565.181700:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15677 00000100:00100000:1.0:1746129565.181740:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129565.181766:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009feec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737434624:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129565.181792:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129565.181801:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009feed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737435264:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129565.181816:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129565.181824:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009feef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737435776:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129565.181838:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129565.181846:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013145ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737436288:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129565.181863:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1746129565.181888:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013145ca80/2, rc 0, transno 21474841257 00000100:00100000:1.0:1746129565.181897:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013145ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737436416:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746129565.181906:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009feedc00/2, rc 0, transno 17179874021 00000100:00100000:1.0:1746129565.181910:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009feedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737434880:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746129565.181916:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009feee680/2, rc 0, transno 17179874022 00000100:00100000:1.0:1746129565.181918:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009feee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737435392:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746129565.181926:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f325f80/2, rc 0, transno 21474841256 00000100:00100000:1.0:1746129565.181929:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f325f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737435904:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746129565.181937:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f327100/2, rc 0, transno 21474841262 00000100:00100000:1.0:1746129565.181939:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f327100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737434752:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129565.181996:0:20577:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15681 00000100:00100000:1.0:1746129565.182002:0:20577:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132c25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+21:3301:x1830948737435264:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129565.182094:0:20577:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132c25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+22:3301:x1830948737435264:12345-0@lo:2:osp-syn-1-0.0 Request processed in 93us (277us total) trans 17179874027 rc 0/0 00000100:00100000:1.0:1746129565.182099:0:20577:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15681 00000004:00080000:1.0:1746129565.182123:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009feec700/2, rc 0, transno 17179874026 00000100:00100000:1.0:1746129565.182126:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009feec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737434624:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746129565.182131:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009feed880/2, rc 0, transno 17179874027 00000100:00100000:1.0:1746129565.182147:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009feed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737435264:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746129565.182155:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013145ed80/2, rc 0, transno 21474841263 00000100:00100000:1.0:1746129565.182158:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013145ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737436288:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746129565.182192:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009feef100/2, rc 0, transno 17179874028 00000100:00100000:1.0:1746129565.182196:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009feef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737435776:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129565.182373:0:8411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009507fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+21:3302:x1830948737435520:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1679us (2304us total) trans 17179874024 rc 0/0 00000100:00100000:0.0:1746129565.182381:0:8411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15673 00000100:00100000:0.0:1746129565.182859:0:8410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737436672 00000100:00100000:0.0:1746129565.182863:0:8410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737436672 00000100:00100000:0.0:1746129565.182889:0:8410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15684 00000100:00100000:0.0:1746129565.182893:0:8410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013577f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+22:3302:x1830948737436672:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129565.182989:0:8410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013577f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+23:3302:x1830948737436672:12345-0@lo:2:osp-syn-0-0.0 Request processed in 95us (190us total) trans 21474841264 rc 0/0 00000100:00100000:0.0:1746129565.182994:0:8410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15684 00000100:00100000:0.0:1746129565.185629:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.189835:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.192138:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.192174:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.192195:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129565.192229:0:8411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733925888 00000100:00100000:1.0:1746129565.192237:0:8411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733925888 00000100:00100000:0.0:1746129565.192278:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129565.192284:0:8411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15685 00000100:00100000:1.0:1746129565.192313:0:8411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013145c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:068dab75-d300-4ead-a742-d14572ad1e50+6:1963:x1830948733926016:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:1.0:1746129565.192330:0:8411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746129565.192332:0:22480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733926400 00000100:00100000:0.0:1746129565.192335:0:22480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733926400 00010000:00010000:1.0:1746129565.192348:0:8411:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095cdac00/0x40a459093b068aa9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20431 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746129565.192385:0:8411:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3f3:0x0] initial LVB size: 2097152, mtime: 0x6813d29b, atime: 0x6813d29a, ctime: 0x6813d29a, blocks: 0x821 00010000:00010000:1.0:1746129565.192404:0:8411:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129565.192406:0:8411:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129565.192415:0:8411:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095cdac00/0x40a459093b068aa9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20431 expref: 7 pid: 8411 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129565.192428:0:8411:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095cdac00/0x40a459093b068aa9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20431 expref: 7 pid: 8411 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129565.192439:0:8411:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095cdac00, rc 0) 00000100:00100000:1.0:1746129565.192480:0:8411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013145c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:068dab75-d300-4ead-a742-d14572ad1e50+7:1963:x1830948733926016:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 189us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129565.192488:0:8411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15685 00000100:00100000:0.0:1746129565.192494:0:22480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15687 00000100:00100000:0.0:1746129565.192499:0:22480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013145e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:068dab75-d300-4ead-a742-d14572ad1e50+6:1962:x1830948733926144:12345-192.168.202.4@tcp:101:lfs.0 00000100:00100000:1.0:1746129565.192503:0:8411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15688 00010000:00010000:0.0:1746129565.192505:0:22480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746129565.192508:0:8411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e955c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:068dab75-d300-4ead-a742-d14572ad1e50+6:1962:x1830948733926400:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:0.0:1746129565.192512:0:22480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095eb8400/0x40a459093b068ab7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20438 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129565.192514:0:8411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129565.192522:0:8411:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095cda000/0x40a459093b068abe lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20446 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746129565.192524:0:22480:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3f4:0x0] initial LVB size: 2097152, mtime: 0x6813d29b, atime: 0x6813d29a, ctime: 0x6813d29b, blocks: 0x821 00002000:00010000:1.0:1746129565.192534:0:8411:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3ef:0x0] initial LVB size: 5146336, mtime: 0x6813d29d, atime: 0x6813d29a, ctime: 0x6813d29d, blocks: 0x1791 00010000:00010000:1.0:1746129565.192542:0:8411:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129565.192543:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129565.192544:0:8411:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129565.192544:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129565.192548:0:8411:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095cda000/0x40a459093b068abe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20446 expref: 8 pid: 8411 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129565.192548:0:22480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095eb8400/0x40a459093b068ab7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20438 expref: 7 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129565.192557:0:8411:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095cda000/0x40a459093b068abe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20446 expref: 8 pid: 8411 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129565.192562:0:22480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095eb8400/0x40a459093b068ab7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20438 expref: 7 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129565.192564:0:8411:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095cda000, rc 0) 00010000:00010000:0.0:1746129565.192568:0:22480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095eb8400, rc 0) 00000100:00100000:1.0:1746129565.192578:0:8411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e955c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:068dab75-d300-4ead-a742-d14572ad1e50+8:1962:x1830948733926400:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 71us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129565.192583:0:22480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013145e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:068dab75-d300-4ead-a742-d14572ad1e50+7:1962:x1830948733926144:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 84us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129565.192584:0:8411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15688 00000100:00100000:0.0:1746129565.192588:0:22480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15687 00000100:00100000:0.0:1746129565.193037:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.193135:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.204894:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.204934:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.204978:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129565.205991:0:31519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7538 00000100:00100000:1.0:1746129565.205999:0:31519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e954000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:068dab75-d300-4ead-a742-d14572ad1e50+9:1960:x1830948733927296:12345-192.168.202.4@tcp:3:lfs.0 00010000:00010000:1.0:1746129565.206016:0:31519:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880095cda200/0x40a459093b068ae1 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129565.206023:0:31519:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129565.206024:0:31519:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129565.206026:0:31519:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095cda200/0x40a459093b068ae1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129565.206034:0:31519:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095cda200/0x40a459093b068ae1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31519 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129565.215947:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.216007:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.216027:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.216055:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.216070:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.216089:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129565.216125:0:31520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733927680 00000100:00100000:1.0:1746129565.216135:0:31520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733927680 00000100:00100000:0.0:1746129565.216343:0:21725:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733928192 00000100:00100000:1.0:1746129565.216344:0:31520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733928320 00000100:00100000:1.0:1746129565.216347:0:31520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733928320 00000100:00100000:0.0:1746129565.216347:0:21725:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733928192 00000100:00100000:1.0:1746129565.216378:0:31520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7539 00000100:00100000:0.0:1746129565.216385:0:21725:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7540 00000100:00100000:1.0:1746129565.216386:0:31520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e955f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:068dab75-d300-4ead-a742-d14572ad1e50+12:1961:x1830948733927936:12345-192.168.202.4@tcp:3:lfs.0 00000100:00100000:0.0:1746129565.216391:0:21725:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e955180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:068dab75-d300-4ead-a742-d14572ad1e50+12:1961:x1830948733927680:12345-192.168.202.4@tcp:3:lfs.0 00000100:00100000:0.0:1746129565.216412:0:8417:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7541 00000100:00100000:0.0:1746129565.216416:0:8417:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e957480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:068dab75-d300-4ead-a742-d14572ad1e50+12:1961:x1830948733927808:12345-192.168.202.4@tcp:3:lfs.0 00010000:00010000:1.0:1746129565.216930:0:31520:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880091798800/0x40a459093b068aef lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129565.217273:0:31520:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129565.217276:0:31520:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129565.217279:0:31520:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091798800/0x40a459093b068aef lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129565.217290:0:31520:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091798800/0x40a459093b068aef lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31520 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129565.220401:0:8417:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009cfd6400/0x40a459093b068b12 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129565.220419:0:8417:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129565.220421:0:8417:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129565.220426:0:8417:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cfd6400/0x40a459093b068b12 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129565.220438:0:8417:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cfd6400/0x40a459093b068b12 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129565.221953:0:21725:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009cfd6600/0x40a459093b068b19 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129565.221969:0:21725:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129565.221970:0:21725:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129565.221975:0:21725:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cfd6600/0x40a459093b068b19 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129565.221985:0:21725:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cfd6600/0x40a459093b068b19 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129565.239797:0:31519:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880095cda200/0x40a459093b068ae1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129565.239817:0:31519:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880095cda200/0x40a459093b068ae1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129565.239831:0:31519:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880095cda200/0x40a459093b068ae1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129565.239838:0:31519:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095cda200 already unused, calling callback (ffffffffa086ed70) 00010000:00010000:1.0:1746129565.239843:0:31519:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880095cda200/0x40a459093b068ae1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129565.239849:0:31519:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880095cda200/0x40a459093b068ae1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129565.239869:0:31519:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880095cda200/0x40a459093b068ae1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129565.239875:0:31519:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095cda200/0x40a459093b068ae1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31519 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129565.239976:0:31519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e954000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:068dab75-d300-4ead-a742-d14572ad1e50+12:1960:x1830948733927296:12345-192.168.202.4@tcp:3:lfs.0 Request processed in 33972us (34991us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129565.239986:0:31519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7538 00000100:00100000:0.0:1746129565.252759:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00010000:00010000:0.0:1746129565.258575:0:21725:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009cfd6600/0x40a459093b068b19 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129565.258593:0:21725:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009cfd6600/0x40a459093b068b19 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129565.258601:0:21725:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009cfd6600/0x40a459093b068b19 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129565.258609:0:21725:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009cfd6600 already unused, calling callback (ffffffffa086ed70) 00010000:00010000:0.0:1746129565.258614:0:21725:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009cfd6600/0x40a459093b068b19 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129565.258622:0:21725:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009cfd6600/0x40a459093b068b19 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129565.258642:0:21725:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009cfd6600/0x40a459093b068b19 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129565.258650:0:21725:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cfd6600/0x40a459093b068b19 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129565.258793:0:8417:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009cfd6400/0x40a459093b068b12 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129565.258803:0:8417:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009cfd6400/0x40a459093b068b12 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129565.258810:0:8417:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009cfd6400/0x40a459093b068b12 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129565.258814:0:8417:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009cfd6400 already unused, calling callback (ffffffffa086ed70) 00010000:00010000:1.0:1746129565.258817:0:8417:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009cfd6400/0x40a459093b068b12 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129565.258822:0:8417:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009cfd6400/0x40a459093b068b12 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129565.258833:0:8417:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009cfd6400/0x40a459093b068b12 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129565.258836:0:8417:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cfd6400/0x40a459093b068b12 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129565.261960:0:8417:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e957480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:068dab75-d300-4ead-a742-d14572ad1e50+11:1961:x1830948733927808:12345-192.168.202.4@tcp:3:lfs.0 Request processed in 45531us (45891us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129565.261972:0:8417:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7541 00000100:00100000:0.0:1746129565.263520:0:21725:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e955180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:068dab75-d300-4ead-a742-d14572ad1e50+10:1961:x1830948733927680:12345-192.168.202.4@tcp:3:lfs.0 Request processed in 47125us (47581us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129565.263530:0:21725:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7540 00000100:00100000:0.0:1746129565.266485:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.266656:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.266699:0:2271:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733929216 00000100:00100000:0.0:1746129565.266706:0:2271:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733929216 00000100:00100000:0.0:1746129565.266737:0:2271:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11119 00000100:00100000:0.0:1746129565.266742:0:2271:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e955500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ada2ffba-8920-4ecb-8068-68caa9806978+289:32075:x1830948733929216:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129565.266765:0:2271:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129565.266780:0:2271:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f384600/0x40a459093b068b4a lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20462 expref: -99 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129565.266870:0:2271:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f385600/0x40a459093b068b51 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129565.266884:0:2271:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f385600/0x40a459093b068b51 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129565.266894:0:2271:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f385600/0x40a459093b068b51 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00000004:00200000:0.0:1746129565.266921:0:2271:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00000004:00200000:0.0:1746129565.266925:0:2271:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746129565.266939:0:2271:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009f385600/0x40a459093b068b51 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129565.266959:0:2271:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f384600/0x40a459093b068b4a lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20462 expref: 291 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129565.266972:0:2271:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f385600/0x40a459093b068b51 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20462 expref: 290 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129565.266979:0:2271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009f469400) 00010000:00010000:0.0:1746129565.266982:0:2271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746129565.266985:0:2271:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f385600, rc 0) 00000100:00100000:0.0:1746129565.267010:0:2271:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e955500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ada2ffba-8920-4ecb-8068-68caa9806978+290:32075:x1830948733929216:12345-192.168.202.4@tcp:101:cat.0 Request processed in 268us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129565.267016:0:2271:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11119 00000100:00100000:1.0:1746129565.267173:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733929088 00000100:00100000:1.0:1746129565.267177:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733929088 00010000:00010000:1.0:1746129565.267196:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012db48e00/0x40a459093b068a55 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20415 expref: 9 pid: 15096 timeout: 920 lvb_type: 0 00000100:00100000:1.0:1746129565.267223:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8025 00000100:00100000:1.0:1746129565.267229:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e957b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:068dab75-d300-4ead-a742-d14572ad1e50+9:1962:x1830948733929088:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129565.267238:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129565.267242:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012db48e00/0x40a459093b068a55 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20415 expref: 9 pid: 15096 timeout: 920 lvb_type: 0 00010000:00010000:1.0:1746129565.267253:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012db48e00/0x40a459093b068a55 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20415 expref: 9 pid: 15096 timeout: 920 lvb_type: 0 00010000:00010000:1.0:1746129565.267266:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012db48e00/0x40a459093b068a55 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20415 expref: 9 pid: 15096 timeout: 920 lvb_type: 0 00010000:00010000:1.0:1746129565.267275:0:7085:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009f469400) 00010000:00010000:1.0:1746129565.267280:0:7085:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88012db48800/0x40a459093b068b43 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129565.267287:0:7085:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012db48800/0x40a459093b068b43 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129565.267317:0:7085:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012db48800/0x40a459093b068b43 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129565.267339:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129565.267360:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e957b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:068dab75-d300-4ead-a742-d14572ad1e50+8:1962:x1830948733929088:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 130us (879us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129565.267377:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8025 00010000:00010000:1.0:1746129565.267926:0:31520:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880091798800/0x40a459093b068aef lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129565.267936:0:31520:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880091798800/0x40a459093b068aef lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129565.267942:0:31520:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880091798800/0x40a459093b068aef lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129565.267946:0:31520:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091798800 already unused, calling callback (ffffffffa086ed70) 00010000:00010000:1.0:1746129565.267950:0:31520:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880091798800/0x40a459093b068aef lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129565.267955:0:31520:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880091798800/0x40a459093b068aef lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129565.267965:0:31520:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880091798800/0x40a459093b068aef lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129565.267972:0:31520:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091798800/0x40a459093b068aef lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31520 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129565.268003:0:31520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e955f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:068dab75-d300-4ead-a742-d14572ad1e50+8:1961:x1830948733927936:12345-192.168.202.4@tcp:3:lfs.0 Request processed in 51618us (51975us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129565.268010:0:31520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7539 00000100:00100000:0.0:1746129565.273135:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.273182:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.273203:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.273220:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.273242:0:8412:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733929728 00000100:00100000:0.0:1746129565.273250:0:8412:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733929728 00000100:00100000:0.0:1746129565.273290:0:8412:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733929984 00000100:00100000:0.0:1746129565.273307:0:8412:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733929984 00000100:00100000:0.0:1746129565.273318:0:8412:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733929600 00000100:00100000:0.0:1746129565.273320:0:8412:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733929600 00000100:00100000:0.0:1746129565.273331:0:8412:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15691 00000100:00100000:0.0:1746129565.273338:0:8412:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bf7c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ada2ffba-8920-4ecb-8068-68caa9806978+19:1962:x1830948733929728:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129565.273360:0:8412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129565.273391:0:8412:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f384400/0x40a459093b068b5f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20477 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129565.273418:0:8412:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129565.273420:0:8412:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129565.273429:0:8412:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f384400/0x40a459093b068b5f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20477 expref: 20 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129565.273493:0:8412:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f384400/0x40a459093b068b5f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20477 expref: 20 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129565.273505:0:8412:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f384400, rc 0) 00000100:00100000:0.0:1746129565.273542:0:8412:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bf7c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ada2ffba-8920-4ecb-8068-68caa9806978+20:1962:x1830948733929728:12345-192.168.202.4@tcp:101:cat.0 Request processed in 204us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129565.273547:0:8412:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15691 00000100:00100000:0.0:1746129565.273677:0:8412:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15692 00000100:00100000:0.0:1746129565.273681:0:8412:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135725180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ada2ffba-8920-4ecb-8068-68caa9806978+18:1962:x1830948733929984:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129565.273688:0:8412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129565.273697:0:8412:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f385e00/0x40a459093b068b66 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20485 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129565.273708:0:8412:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129565.273709:0:8412:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129565.273712:0:8412:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f385e00/0x40a459093b068b66 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20485 expref: 19 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129565.273721:0:8412:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f385e00/0x40a459093b068b66 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20485 expref: 19 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129565.273727:0:8412:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f385e00, rc 0) 00000100:00100000:0.0:1746129565.273738:0:8412:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135725180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ada2ffba-8920-4ecb-8068-68caa9806978+19:1962:x1830948733929984:12345-192.168.202.4@tcp:101:cat.0 Request processed in 57us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129565.273742:0:8412:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15692 00000100:00100000:0.0:1746129565.273750:0:8412:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15693 00000100:00100000:0.0:1746129565.273754:0:8412:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135724a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ada2ffba-8920-4ecb-8068-68caa9806978+18:1963:x1830948733929600:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129565.273758:0:8412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129565.273762:0:8412:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f384a00/0x40a459093b068b6d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20470 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129565.273769:0:8412:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129565.273770:0:8412:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129565.273774:0:8412:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f384a00/0x40a459093b068b6d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20470 expref: 19 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129565.273781:0:8412:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f384a00/0x40a459093b068b6d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20470 expref: 19 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129565.273792:0:8412:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f384a00, rc 0) 00000100:00100000:0.0:1746129565.273802:0:8412:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135724a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ada2ffba-8920-4ecb-8068-68caa9806978+19:1963:x1830948733929600:12345-192.168.202.4@tcp:101:cat.0 Request processed in 48us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129565.273806:0:8412:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15693 00000100:00100000:0.0:1746129565.273828:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.273838:0:8412:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733930240 00000100:00100000:0.0:1746129565.273840:0:8412:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733930240 00000100:00100000:0.0:1746129565.273851:0:8412:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15694 00000100:00100000:0.0:1746129565.273854:0:8412:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135724000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ada2ffba-8920-4ecb-8068-68caa9806978+20:1962:x1830948733930240:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129565.273859:0:8412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129565.273865:0:8412:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f384000/0x40a459093b068b74 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20493 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129565.273872:0:8412:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129565.273873:0:8412:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129565.273876:0:8412:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f384000/0x40a459093b068b74 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20493 expref: 21 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129565.273884:0:8412:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f384000/0x40a459093b068b74 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20493 expref: 21 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129565.273889:0:8412:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f384000, rc 0) 00000100:00100000:0.0:1746129565.273901:0:8412:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135724000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ada2ffba-8920-4ecb-8068-68caa9806978+21:1962:x1830948733930240:12345-192.168.202.4@tcp:101:cat.0 Request processed in 46us (72us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129565.273905:0:8412:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15694 00000100:00100000:0.0:1746129565.273949:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.273959:0:22480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733929856 00000100:00100000:0.0:1746129565.273961:0:22480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733929856 00000100:00100000:0.0:1746129565.273973:0:22480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15695 00000100:00100000:0.0:1746129565.273977:0:22480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135724700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ada2ffba-8920-4ecb-8068-68caa9806978+21:1963:x1830948733929856:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129565.273983:0:22480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129565.273989:0:22480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f384800/0x40a459093b068b7b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2047e expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129565.273998:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129565.273999:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129565.274003:0:22480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f384800/0x40a459093b068b7b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2047e expref: 22 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129565.274011:0:22480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f384800/0x40a459093b068b7b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2047e expref: 22 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129565.274016:0:22480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f384800, rc 0) 00000100:00100000:0.0:1746129565.274030:0:22480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135724700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ada2ffba-8920-4ecb-8068-68caa9806978+22:1963:x1830948733929856:12345-192.168.202.4@tcp:101:cat.0 Request processed in 52us (80us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129565.274034:0:22480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15695 00000100:00100000:0.0:1746129565.279371:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.283913:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.289909:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129565.290862:0:31520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733930752 00000100:00100000:1.0:1746129565.290873:0:31520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733930752 00002000:00100000:1.0:1746129565.290924:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3ec:0x0] (0->1048575) req@ffff88009feef480 x1830948733930752/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:306/0 lens 488/0 e 0 to 0 dl 1746129576 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129565.290935:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009feef480 with x1830948733930752 ext(0->1048575) 00002000:00010000:1.0:1746129565.290941:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009feef480 00000100:00100000:1.0:1746129565.290977:0:31520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7544 00000100:00100000:1.0:1746129565.290985:0:31520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009feef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ada2ffba-8920-4ecb-8068-68caa9806978+20:1963:x1830948733930752:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129565.293255:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.293287:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.293320:0:7086:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733931136 00000100:00100000:0.0:1746129565.293325:0:7086:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733931136 00010000:00010000:0.0:1746129565.293356:0:7086:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f385600/0x40a459093b068b51 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20462 expref: 291 pid: 2271 timeout: 920 lvb_type: 0 00000100:00100000:0.0:1746129565.293400:0:7086:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8026 00000100:00100000:0.0:1746129565.293407:0:7086:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009feef800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ada2ffba-8920-4ecb-8068-68caa9806978+291:1960:x1830948733931136:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129565.293420:0:7086:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129565.293425:0:7086:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f385600/0x40a459093b068b51 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20462 expref: 291 pid: 2271 timeout: 920 lvb_type: 0 00010000:00010000:0.0:1746129565.293436:0:7086:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f385600/0x40a459093b068b51 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20462 expref: 291 pid: 2271 timeout: 920 lvb_type: 0 00010000:00010000:0.0:1746129565.293456:0:7086:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f385600/0x40a459093b068b51 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20462 expref: 291 pid: 2271 timeout: 920 lvb_type: 0 00010000:00010000:0.0:1746129565.293485:0:7086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009f469400) 00010000:00010000:0.0:1746129565.293490:0:7086:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012db48c00/0x40a459093b068bac lrc: 3/0,1 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129565.293498:0:7086:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012db48c00/0x40a459093b068bac lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129565.293504:0:7086:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012db48c00/0x40a459093b068bac lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129565.293523:0:7086:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129565.293562:0:7086:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009feef800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ada2ffba-8920-4ecb-8068-68caa9806978+290:1960:x1830948733931136:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 156us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129565.293569:0:7086:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8026 00000100:00100000:0.0:1746129565.293597:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.293677:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129565.293739:0:31519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733931648 00000100:00100000:1.0:1746129565.293742:0:31519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733931648 00002000:00100000:1.0:1746129565.293759:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3ee:0x0] (1048576->2097151) req@ffff88009feece00 x1830948733931648/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:306/0 lens 488/0 e 0 to 0 dl 1746129576 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129565.293765:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009feece00 with x1830948733931648 ext(1048576->2097151) 00002000:00010000:1.0:1746129565.293768:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009feece00 00000100:00100000:1.0:1746129565.293778:0:31519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7546 00000100:00100000:1.0:1746129565.293782:0:31519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009feefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ada2ffba-8920-4ecb-8068-68caa9806978+23:1961:x1830948733931392:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129565.320008:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.320116:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129565.320994:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733931904 00000100:00100000:1.0:1746129565.320999:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733931904 00010000:00010000:1.0:1746129565.321020:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4020000/0x40a459093b068ab0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2042a expref: 9 pid: 8410 timeout: 920 lvb_type: 1 00000100:00100000:1.0:1746129565.321040:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8027 00000100:00100000:1.0:1746129565.321044:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6fd2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:068dab75-d300-4ead-a742-d14572ad1e50+9:1961:x1830948733931904:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129565.321055:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129565.321070:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b4020000/0x40a459093b068ab0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2042a expref: 9 pid: 8410 timeout: 920 lvb_type: 1 00010000:00010000:1.0:1746129565.321079:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b4020000/0x40a459093b068ab0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2042a expref: 9 pid: 8410 timeout: 920 lvb_type: 1 00010000:00010000:1.0:1746129565.321096:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b4020000/0x40a459093b068ab0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2042a expref: 9 pid: 8410 timeout: 920 lvb_type: 1 00010000:00010000:1.0:1746129565.321123:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129565.321144:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6fd2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:068dab75-d300-4ead-a742-d14572ad1e50+8:1961:x1830948733931904:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 100us (1148us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129565.321150:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8027 00000100:00100000:0.0:1746129565.326559:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.326588:0:16908:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733932288 00000100:00100000:0.0:1746129565.326597:0:16908:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733932288 00000100:00100000:0.0:1746129565.326650:0:16908:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11123 00000100:00100000:0.0:1746129565.326658:0:16908:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+8:32079:x1830948733932288:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:0.0:1746129565.326678:0:16908:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129565.326682:0:16908:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1746129565.326708:0:16908:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f850000/0x40a459093b068bba lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f204a1 expref: 8 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129565.326729:0:16908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009f469400) 00010000:00010000:0.0:1746129565.326733:0:16908:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746129565.326743:0:16908:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d107400/0x40a459093b068bc1 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f204a8 expref: -99 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129565.326791:0:16908:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d106600/0x40a459093b068bc8 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129565.326802:0:16908:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a60b3600/0x40a459093b068a94 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2041c expref: 7 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129565.326808:0:16908:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d106600/0x40a459093b068bc8 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129565.326835:0:16908:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a60b3600/0x40a459093b068a94 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2041c expref: 7 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129565.326848:0:16908:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a60b3600/0x40a459093b068a94 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2041c expref: 7 pid: 14549 timeout: 920 lvb_type: 0 00000100:00100000:0.0:1746129565.326858:0:16908:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093cee300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16908:1830948737437312:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129565.326928:0:16908:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b183cc00 going to sleep for 11 seconds 00000100:00100000:1.0:1746129565.328393:0:31520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009feef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ada2ffba-8920-4ecb-8068-68caa9806978+20:1963:x1830948733930752:12345-192.168.202.4@tcp:3:cat.0 Request processed in 37405us (38492us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129565.328400:0:31520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7544 00002000:00100000:1.0:1746129565.328405:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3ec:0x0] (0->1048575) req@ffff88009feef480 x1830948733930752/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:306/0 lens 488/440 e 0 to 0 dl 1746129576 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129565.328412:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009feef480 with x1830948733930752 ext(0->1048575) 00010000:00010000:1.0:1746129565.328421:0:31520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f384a00/0x40a459093b068b6d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20470 expref: 20 pid: 8412 timeout: 920 lvb_type: 1 00010000:00010000:1.0:1746129565.328433:0:31520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f384a00/0x40a459093b068b6d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20470 expref: 20 pid: 8412 timeout: 920 lvb_type: 1 00002000:00010000:1.0:1746129565.328440:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009feef480 00000100:00100000:0.0:1746129565.332144:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.337820:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.339357:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.339406:0:2271:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733932800 00000100:00100000:0.0:1746129565.339410:0:2271:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733932800 00000100:00100000:0.0:1746129565.339447:0:2271:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11125 00000100:00100000:0.0:1746129565.339453:0:2271:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+10:32082:x1830948733932800:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129565.339462:0:2271:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129565.339471:0:2271:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f851a00/0x40a459093b068bd6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f204b6 expref: -99 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129565.339802:0:2271:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f850e00/0x40a459093b068bdd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129565.339812:0:2271:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f850e00/0x40a459093b068bdd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129565.339823:0:2271:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f850e00/0x40a459093b068bdd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129565.339835:0:2271:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f851e00/0x40a459093b068be4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129565.339842:0:2271:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f851e00/0x40a459093b068be4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129565.339848:0:2271:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f851e00/0x40a459093b068be4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129565.339943:0:2271:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f851000/0x40a459093b068beb lrc: 3/1,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129565.339951:0:2271:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f851000/0x40a459093b068beb lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129565.339957:0:2271:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f851000/0x40a459093b068beb lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00000004:00200000:0.0:1746129565.339966:0:2271:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:0.0:1746129565.340067:0:2271:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f851000/0x40a459093b068beb lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129565.340074:0:2271:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f851000/0x40a459093b068beb lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129565.340081:0:2271:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f851000/0x40a459093b068beb lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129565.340086:0:2271:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f851000 already unused, calling callback (ffffffffa136e690) 00010000:00010000:0.0:1746129565.340089:0:2271:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f851000/0x40a459093b068beb lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129565.340096:0:2271:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f851000/0x40a459093b068beb lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129565.340106:0:2271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009f469400) 00010000:00010000:0.0:1746129565.340109:0:2271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746129565.340112:0:2271:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f851000/0x40a459093b068beb lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129565.340121:0:2271:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f851000/0x40a459093b068beb lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129565.340139:0:2271:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f850e00/0x40a459093b068bdd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129565.340144:0:2271:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f850e00/0x40a459093b068bdd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129565.340148:0:2271:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f850e00/0x40a459093b068bdd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129565.340153:0:2271:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f850e00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:0.0:1746129565.340155:0:2271:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f850e00/0x40a459093b068bdd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129565.340159:0:2271:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f850e00/0x40a459093b068bdd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129565.340165:0:2271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880132ef8f00) 00010000:00010000:0.0:1746129565.340167:0:2271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129565.340169:0:2271:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f850e00/0x40a459093b068bdd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129565.340173:0:2271:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f850e00/0x40a459093b068bdd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129565.340180:0:2271:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f851e00/0x40a459093b068be4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129565.340185:0:2271:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f851e00/0x40a459093b068be4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129565.340190:0:2271:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f851e00/0x40a459093b068be4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129565.340195:0:2271:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f851e00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:0.0:1746129565.340197:0:2271:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f851e00/0x40a459093b068be4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129565.340202:0:2271:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f851e00/0x40a459093b068be4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129565.340208:0:2271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a6d0e600) 00010000:00010000:0.0:1746129565.340209:0:2271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129565.340212:0:2271:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f851e00/0x40a459093b068be4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129565.340216:0:2271:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f851e00/0x40a459093b068be4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129565.340250:0:2271:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f851a00/0x40a459093b068bd6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f204b6 expref: 12 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129565.340257:0:2271:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f851a00/0x40a459093b068bd6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f204b6 expref: 12 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129565.340845:0:2271:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f851a00, rc 0) 00000100:00100000:0.0:1746129565.340910:0:2271:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+11:32082:x1830948733932800:12345-192.168.202.4@tcp:101:cat.0 Request processed in 1456us (1553us total) trans 8589945192 rc 301/301 00000100:00100000:0.0:1746129565.340916:0:2271:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11125 00000100:00100000:0.0:1746129565.341056:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.341077:0:7086:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733932928 00000100:00100000:0.0:1746129565.341080:0:7086:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733932928 00010000:00010000:0.0:1746129565.341100:0:7086:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f384a00/0x40a459093b068b6d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20470 expref: 20 pid: 8412 timeout: 920 lvb_type: 1 00000100:00100000:0.0:1746129565.341141:0:7086:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8029 00000100:00100000:0.0:1746129565.341146:0:7086:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ceca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ada2ffba-8920-4ecb-8068-68caa9806978+20:1963:x1830948733932928:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129565.341156:0:7086:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129565.341174:0:7086:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f384a00/0x40a459093b068b6d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20470 expref: 20 pid: 8412 timeout: 920 lvb_type: 1 00010000:00010000:0.0:1746129565.341184:0:7086:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f384a00/0x40a459093b068b6d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20470 expref: 20 pid: 8412 timeout: 920 lvb_type: 1 00010000:00010000:0.0:1746129565.341197:0:7086:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f384a00/0x40a459093b068b6d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20470 expref: 20 pid: 8412 timeout: 920 lvb_type: 1 00010000:00010000:0.0:1746129565.341208:0:7086:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129565.341210:0:7086:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129565.341217:0:7086:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012db48e00/0x40a459093b068bb3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2049a expref: 7 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129565.341224:0:7086:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012db48e00/0x40a459093b068bb3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2049a expref: 7 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129565.341249:0:7086:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012db48e00/0x40a459093b068bb3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2049a expref: 7 pid: 7148 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129565.341259:0:7086:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093cee300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7086:1830948737437440:192.168.202.4@tcp:105: 00000100:00100000:0.0:1746129565.341317:0:7086:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b183cf00 going to sleep for 11 seconds 00000100:00100000:1.0:1746129565.344822:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.344853:0:7086:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093cee300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7086:1830948737437440:192.168.202.4@tcp:105: 00010000:00010000:0.0:1746129565.344875:0:7086:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129565.344907:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.344917:0:7086:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ceca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ada2ffba-8920-4ecb-8068-68caa9806978+19:1963:x1830948733932928:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 3770us (3861us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129565.344927:0:7086:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8029 00000100:00100000:0.0:1746129565.344963:0:2271:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733933184 00000100:00100000:0.0:1746129565.344969:0:2271:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733933184 00000100:00100000:0.0:1746129565.344998:0:2271:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11126 00000100:00100000:0.0:1746129565.345003:0:2271:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132c26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+11:32082:x1830948733933184:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129565.345022:0:2271:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129565.346680:0:2271:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009584fe00/0x40a459093b068c00 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f204c4 expref: -99 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129565.346775:0:2271:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009584e800/0x40a459093b068c07 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129565.346786:0:2271:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009584e800/0x40a459093b068c07 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129565.346795:0:2271:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009584e800/0x40a459093b068c07 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00000100:00100000:0.0:1746129565.355672:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.355778:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.355799:0:7086:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733933312 00000100:00100000:0.0:1746129565.355805:0:7086:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733933312 00010000:00010000:0.0:1746129565.355834:0:7086:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f384400/0x40a459093b068b5f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20477 expref: 22 pid: 8412 timeout: 920 lvb_type: 1 00000100:00100000:0.0:1746129565.365348:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129565.370217:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.371961:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000001:00080000:0.0:1746129565.374277:0:14619:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945191 is committed 00000004:00080000:0.0:1746129565.374284:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2605 committed 00000004:00080000:0.0:1746129565.374291:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2587 committed 00000004:00080000:0.0:1746129565.374316:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2586 committed 00000004:00080000:0.0:1746129565.374318:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2585 committed 00000004:00080000:0.0:1746129565.374319:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2584 committed 00000004:00080000:0.0:1746129565.374320:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2604 committed 00000004:00080000:0.0:1746129565.374321:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2583 committed 00000004:00080000:0.0:1746129565.374323:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2603 committed 00000004:00080000:0.0:1746129565.374324:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2582 committed 00000004:00080000:0.0:1746129565.374325:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2602 committed 00000004:00080000:0.0:1746129565.374326:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2601 committed 00000004:00080000:0.0:1746129565.374328:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2600 committed 00000004:00080000:0.0:1746129565.374329:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2581 committed 00000004:00080000:0.0:1746129565.374330:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2580 committed 00000004:00080000:0.0:1746129565.374331:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2599 committed 00000004:00080000:0.0:1746129565.374332:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2598 committed 00000004:00080000:0.0:1746129565.374334:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2579 committed 00000001:00080000:0.0:1746129565.374343:0:14619:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945187 is committed 00000001:00080000:0.0:1746129565.374349:0:14619:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945190 is committed 00000001:00080000:0.0:1746129565.374354:0:14619:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945189 is committed 00010000:00010000:0.0:1746129565.374379:0:2271:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009584e800/0x40a459093b068c07 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129565.374386:0:2271:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009584e800/0x40a459093b068c07 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00000004:00200000:0.0:1746129565.374431:0:2271:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00000004:00200000:0.0:1746129565.374436:0:2271:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746129565.374451:0:2271:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009584e800/0x40a459093b068c07 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129565.374484:0:2271:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009584fe00/0x40a459093b068c00 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f204c4 expref: 12 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129565.374499:0:2271:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009584e800/0x40a459093b068c07 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f204c4 expref: 11 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129565.374505:0:2271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009f469400) 00010000:00010000:0.0:1746129565.374507:0:2271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1746129565.374510:0:2271:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009584e800, rc 0) 00000100:00100000:0.0:1746129565.374541:0:2271:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132c26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+11:32082:x1830948733933184:12345-192.168.202.4@tcp:101:cat.0 Request processed in 29536us (29633us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129565.374549:0:2271:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11126 00000100:00100000:1.0:1746129565.374737:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880132c24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737438592:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129565.374776:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129565.374797:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a77b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737439104:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129565.374810:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129565.374823:0:3301:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1746129565.374827:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009507ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737438464:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129565.374843:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129565.374854:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a77b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737438976:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129565.374867:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129565.374878:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095626d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737439488:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129565.374890:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129565.374907:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880132c24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737438720:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129565.374922:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129565.374931:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737439232:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129565.374942:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129565.374958:0:3302:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1746129565.374962:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a77b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737438848:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129565.374973:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129565.374983:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009feef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737439360:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129565.374995:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129565.375014:0:11014:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737438592 00000100:00100000:1.0:1746129565.375021:0:11014:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737438592 00000100:00100000:1.0:1746129565.375045:0:11014:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737439104 00000100:00100000:1.0:1746129565.375047:0:11014:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737439104 00000100:00100000:1.0:1746129565.375055:0:11014:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737438464 00000100:00100000:1.0:1746129565.375056:0:11014:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737438464 00000100:00100000:1.0:1746129565.375065:0:11014:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737438976 00000100:00100000:1.0:1746129565.375067:0:11014:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737438976 00000100:00100000:1.0:1746129565.375072:0:11014:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737439488 00000100:00100000:1.0:1746129565.375074:0:11014:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737439488 00000100:00100000:1.0:1746129565.375079:0:11014:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737438720 00000100:00100000:1.0:1746129565.375081:0:11014:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737438720 00000100:00100000:1.0:1746129565.375086:0:11014:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737439232 00000100:00100000:1.0:1746129565.375087:0:11014:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737439232 00000100:00100000:1.0:1746129565.375092:0:11014:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737438848 00000100:00100000:1.0:1746129565.375094:0:11014:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737438848 00000100:00100000:1.0:1746129565.375099:0:11014:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737439360 00000100:00100000:1.0:1746129565.375100:0:11014:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737439360 00000100:00100000:1.0:1746129565.375109:0:11014:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15700 00000100:00100000:1.0:1746129565.375114:0:11014:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095625880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+28:3301:x1830948737438592:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746129565.375313:0:11014:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746129565.375316:0:11014:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb mtime from disk: 1746129563 -> 1746129563 00002000:00010000:1.0:1746129565.375318:0:11014:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb atime from disk: 1746129562 -> 1746129562 00002000:00010000:1.0:1746129565.375320:0:11014:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb ctime from disk: 1746129562 -> 1746129562 00002000:00010000:1.0:1746129565.375322:0:11014:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746129565.375346:0:11014:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095625880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+29:3301:x1830948737438592:12345-0@lo:2:osp-syn-1-0.0 Request processed in 232us (569us total) trans 17179874029 rc 0/0 00000100:00100000:1.0:1746129565.375353:0:11014:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15700 00000100:00100000:1.0:1746129565.375374:0:11014:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15701 00000100:00100000:1.0:1746129565.375379:0:11014:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095627480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+28:3301:x1830948737439104:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129565.375451:0:11014:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095627480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+29:3301:x1830948737439104:12345-0@lo:2:osp-syn-1-0.0 Request processed in 72us (640us total) trans 17179874030 rc 0/0 00000100:00100000:1.0:1746129565.375456:0:11014:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15701 00000100:00100000:1.0:1746129565.375464:0:11014:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15702 00000100:00100000:1.0:1746129565.375468:0:11014:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095624a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+23:3301:x1830948737438464:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746129565.375559:0:11014:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3ec:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:1.0:1746129565.375561:0:11014:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ec:0x0] updating lvb mtime from disk: 1746129561 -> 1746129561 00002000:00010000:1.0:1746129565.375563:0:11014:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3ec:0x0] updating lvb atime from disk: 1746129561 -> 1746129561 00002000:00010000:1.0:1746129565.375565:0:11014:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ec:0x0] updating lvb ctime from disk: 1746129561 -> 1746129561 00002000:00010000:1.0:1746129565.375566:0:11014:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3ec:0x0] updating lvb blocks from disk: 1981 -> 1981 00000100:00100000:1.0:1746129565.375580:0:11014:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095624a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+24:3301:x1830948737438464:12345-0@lo:2:osp-syn-0-0.0 Request processed in 112us (736us total) trans 21474841265 rc 0/0 00000100:00100000:1.0:1746129565.375584:0:11014:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15702 00000100:00100000:1.0:1746129565.375591:0:11014:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15703 00000100:00100000:1.0:1746129565.375594:0:11014:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095625c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+28:3301:x1830948737438976:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746129565.375642:0:11014:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746129565.375644:0:11014:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb mtime from disk: 1746129523 -> 1746129523 00002000:00010000:1.0:1746129565.375645:0:11014:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb atime from disk: 1746129523 -> 1746129523 00002000:00010000:1.0:1746129565.375647:0:11014:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb ctime from disk: 1746129524 -> 1746129524 00002000:00010000:1.0:1746129565.375649:0:11014:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1746129565.375663:0:11014:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095625c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+29:3301:x1830948737438976:12345-0@lo:2:osp-syn-1-0.0 Request processed in 68us (795us total) trans 17179874031 rc 0/0 00000100:00100000:1.0:1746129565.375667:0:11014:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15703 00000100:00100000:1.0:1746129565.375674:0:11014:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15704 00000100:00100000:1.0:1746129565.375677:0:11014:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095627b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+28:3301:x1830948737439488:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129565.375734:0:11014:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095627b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+29:3301:x1830948737439488:12345-0@lo:2:osp-syn-1-0.0 Request processed in 55us (842us total) trans 17179874032 rc 0/0 00000100:00100000:1.0:1746129565.375738:0:11014:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15704 00000100:00100000:1.0:1746129565.375746:0:11014:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15705 00000100:00100000:1.0:1746129565.375750:0:11014:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095624380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+28:3302:x1830948737438720:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746129565.375810:0:11014:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746129565.375812:0:11014:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb mtime from disk: 1746129563 -> 1746129563 00002000:00010000:1.0:1746129565.375814:0:11014:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb atime from disk: 1746129562 -> 1746129562 00002000:00010000:1.0:1746129565.375815:0:11014:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb ctime from disk: 1746129563 -> 1746129563 00002000:00010000:1.0:1746129565.375817:0:11014:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746129565.375837:0:11014:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095624380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+29:3302:x1830948737438720:12345-0@lo:2:osp-syn-1-0.0 Request processed in 87us (914us total) trans 17179874033 rc 0/0 00000100:00100000:1.0:1746129565.375841:0:11014:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15705 00000100:00100000:1.0:1746129565.375849:0:11014:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15706 00000100:00100000:1.0:1746129565.375853:0:11014:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095625f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+28:3302:x1830948737439232:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129565.375919:0:11014:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095625f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+29:3302:x1830948737439232:12345-0@lo:2:osp-syn-1-0.0 Request processed in 66us (975us total) trans 17179874034 rc 0/0 00000100:00100000:1.0:1746129565.375924:0:11014:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15706 00000100:00100000:1.0:1746129565.375931:0:11014:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15707 00000100:00100000:1.0:1746129565.375935:0:11014:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095627800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+28:3302:x1830948737438848:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746129565.375995:0:11014:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3f5:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746129565.375997:0:11014:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f5:0x0] updating lvb mtime from disk: 1746129565 -> 1746129565 00002000:00010000:1.0:1746129565.375999:0:11014:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f5:0x0] updating lvb atime from disk: 1746129562 -> 1746129562 00002000:00010000:1.0:1746129565.376001:0:11014:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f5:0x0] updating lvb ctime from disk: 1746129565 -> 1746129565 00002000:00010000:1.0:1746129565.376002:0:11014:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f5:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:1.0:1746129565.376019:0:11014:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095627800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+29:3302:x1830948737438848:12345-0@lo:2:osp-syn-1-0.0 Request processed in 83us (1045us total) trans 17179874035 rc 0/0 00000100:00100000:1.0:1746129565.376024:0:11014:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15707 00000100:00100000:1.0:1746129565.376032:0:11014:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15708 00000100:00100000:1.0:1746129565.376036:0:11014:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095627100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+28:3302:x1830948737439360:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129565.376099:0:11014:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095627100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+29:3302:x1830948737439360:12345-0@lo:2:osp-syn-1-0.0 Request processed in 63us (1103us total) trans 17179874036 rc 0/0 00000100:00100000:1.0:1746129565.376104:0:11014:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15708 00000004:00080000:1.0:1746129565.376166:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a77b0e00/2, rc 0, transno 17179874035 00000100:00100000:1.0:1746129565.376171:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a77b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737438848:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746129565.376178:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009feef800/2, rc 0, transno 17179874036 00000100:00100000:1.0:1746129565.376181:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009feef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737439360:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746129565.376187:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880132c24380/2, rc 0, transno 17179874033 00000100:00100000:1.0:1746129565.376190:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880132c24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737438720:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746129565.376196:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880090e6f800/2, rc 0, transno 17179874034 00000100:00100000:1.0:1746129565.376198:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737439232:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746129565.376216:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009507ca80/2, rc 0, transno 21474841265 00000100:00100000:1.0:1746129565.376220:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009507ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737438464:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746129565.376226:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a77b1880/2, rc 0, transno 17179874031 00000100:00100000:1.0:1746129565.376229:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a77b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737438976:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746129565.376235:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095626d80/2, rc 0, transno 17179874032 00000100:00100000:1.0:1746129565.376237:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095626d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737439488:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746129565.376244:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880132c24000/2, rc 0, transno 17179874029 00000100:00100000:1.0:1746129565.376246:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880132c24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737438592:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746129565.376252:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a77b3480/2, rc 0, transno 17179874030 00000100:00100000:1.0:1746129565.376255:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a77b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737439104:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129565.376861:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013145dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737440000:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129565.376892:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129565.376908:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e956680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737440512:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129565.376922:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129565.376934:0:3300:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1746129565.376938:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009507fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737439616:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129565.376952:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129565.376960:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e957b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737440128:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129565.376972:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129565.376991:0:8412:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737440000 00000100:00100000:0.0:1746129565.376996:0:8412:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737440000 00000100:00100000:0.0:1746129565.377014:0:8412:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737440512 00000100:00100000:0.0:1746129565.377016:0:8412:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737440512 00000100:00100000:0.0:1746129565.377024:0:8412:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737439616 00000100:00100000:0.0:1746129565.377027:0:8412:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737439616 00000100:00100000:0.0:1746129565.377035:0:8412:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737440128 00000100:00100000:0.0:1746129565.377036:0:8412:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737440128 00000100:00100000:0.0:1746129565.377046:0:8412:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15709 00000100:00100000:0.0:1746129565.377050:0:8412:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094efed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+27:3300:x1830948737440000:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129565.377150:0:8412:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094efed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+28:3300:x1830948737440000:12345-0@lo:2:osp-syn-0-0.0 Request processed in 99us (257us total) trans 21474841266 rc 0/0 00000100:00100000:0.0:1746129565.377155:0:8412:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15709 00000100:00100000:0.0:1746129565.377165:0:8412:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15710 00000100:00100000:0.0:1746129565.377169:0:8412:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094efea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+27:3300:x1830948737440512:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129565.377235:0:8412:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094efea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+28:3300:x1830948737440512:12345-0@lo:2:osp-syn-0-0.0 Request processed in 66us (312us total) trans 21474841267 rc 0/0 00000100:00100000:0.0:1746129565.377241:0:8412:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15710 00000100:00100000:0.0:1746129565.377249:0:8412:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15711 00000100:00100000:0.0:1746129565.377252:0:8412:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094efe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+27:3300:x1830948737439616:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746129565.377333:0:8412:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746129565.377335:0:8412:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb mtime from disk: 1746129565 -> 1746129565 00002000:00010000:0.0:1746129565.377337:0:8412:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb atime from disk: 1746129565 -> 1746129565 00002000:00010000:0.0:1746129565.377339:0:8412:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb ctime from disk: 1746129565 -> 1746129565 00002000:00010000:0.0:1746129565.377341:0:8412:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:0.0:1746129565.377358:0:8412:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094efe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+28:3300:x1830948737439616:12345-0@lo:2:osp-syn-0-0.0 Request processed in 105us (405us total) trans 21474841268 rc 0/0 00000100:00100000:0.0:1746129565.377376:0:8412:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15711 00000100:00100000:0.0:1746129565.377385:0:8412:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15712 00000100:00100000:0.0:1746129565.377389:0:8412:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+27:3300:x1830948737440128:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129565.377458:0:8412:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+28:3300:x1830948737440128:12345-0@lo:2:osp-syn-0-0.0 Request processed in 68us (485us total) trans 21474841269 rc 0/0 00000100:00100000:0.0:1746129565.377464:0:8412:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15712 00000004:00080000:0.0:1746129565.377498:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009507fb80/2, rc 0, transno 21474841268 00000100:00100000:0.0:1746129565.377502:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009507fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737439616:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129565.377508:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e957b80/2, rc 0, transno 21474841269 00000100:00100000:0.0:1746129565.377511:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e957b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737440128:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129565.377517:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013145dc00/2, rc 0, transno 21474841266 00000100:00100000:0.0:1746129565.377520:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013145dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737440000:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129565.377526:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e956680/2, rc 0, transno 21474841267 00000100:00100000:0.0:1746129565.377528:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e956680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737440512:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129565.377631:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.377646:0:4699:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733933952 00000100:00100000:0.0:1746129565.377649:0:4699:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733933952 00000100:00100000:0.0:1746129565.377664:0:4699:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15713 00000100:00100000:0.0:1746129565.377668:0:4699:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:068dab75-d300-4ead-a742-d14572ad1e50+8:32069:x1830948733933952:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:0.0:1746129565.377677:0:4699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129565.377690:0:4699:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c031a00/0x40a459093b068c15 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f204d2 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129565.377713:0:4699:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a60b2600/0x40a459093b068ac5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2043f expref: 9 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129565.377723:0:4699:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f385e00/0x40a459093b068b66 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20485 expref: 18 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129565.377730:0:4699:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129565.377732:0:4699:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129565.377736:0:4699:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c031a00/0x40a459093b068c15 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f204d2 expref: 9 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129565.377760:0:4699:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f385e00/0x40a459093b068b66 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20485 expref: 18 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129565.377772:0:4699:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f385e00/0x40a459093b068b66 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20485 expref: 18 pid: 8412 timeout: 920 lvb_type: 1 00000100:00100000:0.0:1746129565.377782:0:4699:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7dbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4699:1830948737440640:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129565.377933:0:4699:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a60b2600/0x40a459093b068ac5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2043f expref: 9 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129565.377941:0:4699:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a60b2600/0x40a459093b068ac5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2043f expref: 9 pid: 7148 timeout: 920 lvb_type: 1 00000100:00100000:0.0:1746129565.377950:0:4699:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7d8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4699:1830948737440768:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129565.377967:0:4699:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a00780 going to sleep for 11 seconds 00000100:00100000:0.0:1746129565.377999:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.378046:0:2271:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733934080 00000100:00100000:0.0:1746129565.378049:0:2271:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733934080 00000100:00100000:0.0:1746129565.378071:0:2271:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11127 00000100:00100000:0.0:1746129565.378076:0:2271:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+11:32082:x1830948733934080:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129565.378085:0:2271:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129565.378096:0:2271:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092f87600/0x40a459093b068c1c lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f204d9 expref: -99 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129565.378143:0:2271:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092f87600/0x40a459093b068c1c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f204d9 expref: 12 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129565.378155:0:2271:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092f87600/0x40a459093b068c1c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f204d9 expref: 12 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129565.378170:0:2271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009f469400) 00010000:00010000:0.0:1746129565.378173:0:2271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746129565.378175:0:2271:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092f87600, rc 0) 00000100:00100000:0.0:1746129565.378193:0:2271:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+12:32082:x1830948733934080:12345-192.168.202.4@tcp:101:cat.0 Request processed in 117us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129565.378198:0:2271:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11127 00000100:00100000:1.0:1746129565.380936:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013145e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1830948737439872:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129565.381005:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129565.381037:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e954700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1830948737440384:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129565.381052:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129565.381070:0:3303:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1746129565.381075:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013145c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1830948737439744:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129565.381089:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129565.381099:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e955c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1830948737440256:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129565.381111:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129565.381139:0:20577:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737439872 00000100:00100000:1.0:1746129565.381146:0:20577:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737439872 00000100:00100000:1.0:1746129565.381177:0:20577:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737440384 00000100:00100000:1.0:1746129565.381179:0:20577:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737440384 00000100:00100000:1.0:1746129565.381188:0:20577:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737439744 00000100:00100000:1.0:1746129565.381190:0:20577:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737439744 00000100:00100000:1.0:1746129565.381198:0:20577:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737440256 00000100:00100000:1.0:1746129565.381199:0:20577:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737440256 00000100:00100000:1.0:1746129565.381209:0:20577:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15714 00000100:00100000:1.0:1746129565.381215:0:20577:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009402aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+31:3303:x1830948737439872:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129565.383809:0:20577:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009402aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+32:3303:x1830948737439872:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2593us (2804us total) trans 21474841273 rc 0/0 00000100:00100000:1.0:1746129565.383816:0:20577:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15714 00000100:00100000:1.0:1746129565.383830:0:20577:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15720 00000100:00100000:1.0:1746129565.383836:0:20577:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800903a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+10:1963:x1830948733934720:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129565.383842:0:20577:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129565.383849:0:20577:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095fc7400/0x40a459093b068c38 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f204f5 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129565.383871:0:20577:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094028000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20577:1830948737441152:192.168.202.4@tcp:106: 00000100:00100000:1.0:1746129565.383891:0:20577:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c954d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746129565.383908:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733934208 00000100:00100000:1.0:1746129565.383911:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733934208 00000100:00100000:1.0:1746129565.383934:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4694 00000100:00100000:1.0:1746129565.383938:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013577c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ada2ffba-8920-4ecb-8068-68caa9806978+290:32075:x1830948733934208:12345-192.168.202.4@tcp:49:cat.0 00000100:00100000:1.0:1746129565.383995:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013577c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ada2ffba-8920-4ecb-8068-68caa9806978+290:32075:x1830948733934208:12345-192.168.202.4@tcp:49:cat.0 Request processed in 56us (1744us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129565.384000:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4694 00000100:00100000:1.0:1746129565.384019:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15721 00000100:00100000:1.0:1746129565.384024:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800903a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+11:1963:x1830948733934848:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129565.384031:0:7149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129565.384038:0:7149:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095fc6a00/0x40a459093b068c3f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f204fc expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129565.384049:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129565.384056:0:7149:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095fc6a00/0x40a459093b068c3f lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f204fc expref: 12 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129565.384064:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095fc6a00/0x40a459093b068c3f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f204fc expref: 12 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129565.384072:0:7149:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095fc6a00, rc 0) 00000100:00100000:1.0:1746129565.384088:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800903a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+11:1963:x1830948733934848:12345-192.168.202.4@tcp:101:cat.0 Request processed in 64us (1705us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129565.384093:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15721 00000100:00100000:1.0:1746129565.384107:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15722 00000100:00100000:1.0:1746129565.384111:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800903a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+10:1963:x1830948733934976:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129565.384117:0:7149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129565.384123:0:7149:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095fc7c00/0x40a459093b068c46 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20503 expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129565.384133:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129565.384134:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129565.384141:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095fc7c00/0x40a459093b068c46 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20503 expref: 11 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129565.384151:0:7149:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095fc7c00/0x40a459093b068c46 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20503 expref: 11 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129565.384158:0:7149:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095fc7c00, rc 0) 00000100:00100000:1.0:1746129565.384172:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800903a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+11:1963:x1830948733934976:12345-192.168.202.4@tcp:101:cat.0 Request processed in 61us (1776us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129565.384180:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15722 00000100:00100000:1.0:1746129565.384191:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15723 00000100:00100000:1.0:1746129565.384195:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800903a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+11:1963:x1830948733935232:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129565.384201:0:7149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129565.384207:0:7149:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880132edde00/0x40a459093b068c4d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2050a expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129565.384216:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129565.384218:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129565.384221:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880132edde00/0x40a459093b068c4d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2050a expref: 12 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129565.384230:0:7149:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880132edde00/0x40a459093b068c4d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2050a expref: 12 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129565.384236:0:7149:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132edde00, rc 0) 00000100:00100000:1.0:1746129565.384247:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800903a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+12:1963:x1830948733935232:12345-192.168.202.4@tcp:101:cat.0 Request processed in 51us (1839us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129565.384251:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15723 00000100:00100000:0.0:1746129565.384667:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.384822:0:4699:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7dbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4699:1830948737440640:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129565.384835:0:4699:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a60b2600/0x40a459093b068ac5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2043f expref: 9 pid: 7148 timeout: 920 lvb_type: 1 00000100:00100000:0.0:1746129565.384844:0:4699:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7d8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4699:1830948737440768:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129565.384863:0:4699:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c031a00/0x40a459093b068c15 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f204d2 expref: 8 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129565.384871:0:4699:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c031a00, rc 0) 00000100:00100000:0.0:1746129565.384893:0:4699:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:068dab75-d300-4ead-a742-d14572ad1e50+8:32069:x1830948733933952:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 7224us (7264us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129565.384899:0:4699:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15713 00002000:00010000:1.0:1746129565.387189:0:20577:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb mtime: 1746129563 -> 1746129565 00002000:00010000:1.0:1746129565.387193:0:20577:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb atime: 1746129562 -> 1746129565 00002000:00010000:1.0:1746129565.387195:0:20577:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb ctime: 1746129563 -> 1746129566 00000100:00100000:1.0:1746129565.387210:0:20577:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094028000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20577:1830948737441152:192.168.202.4@tcp:106: 00010000:00010000:1.0:1746129565.387232:0:20577:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095fc7400/0x40a459093b068c38 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f204f5 expref: 11 pid: 20577 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129565.387249:0:20577:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095fc7400/0x40a459093b068c38 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f204f5 expref: 11 pid: 20577 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129565.387257:0:20577:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095fc7400, rc 0) 00000100:00100000:1.0:1746129565.387290:0:20577:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800903a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+10:1963:x1830948733934720:12345-192.168.202.4@tcp:101:cat.0 Request processed in 3454us (4930us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129565.387321:0:20577:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15720 00000100:00100000:0.0:1746129565.388149:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129565.389912:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129565.389930:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129565.389978:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129565.389990:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129565.390055:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.390101:0:8411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15725 00000100:00100000:0.0:1746129565.390108:0:8411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b550e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ada2ffba-8920-4ecb-8068-68caa9806978+20:32075:x1830948733935872:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129565.390116:0:8411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129565.390128:0:8411:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092f86800/0x40a459093b068c54 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20518 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129565.390153:0:8411:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5a87200/0x40a459093b068bf9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f204bd expref: 7 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129565.390160:0:8411:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129565.390162:0:8411:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129565.390165:0:8411:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092f86800/0x40a459093b068c54 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20518 expref: 21 pid: 8411 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129565.390193:0:8411:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5a87200/0x40a459093b068bf9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f204bd expref: 7 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129565.390205:0:8411:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5a87200/0x40a459093b068bf9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f204bd expref: 7 pid: 7148 timeout: 920 lvb_type: 0 00000100:00100000:0.0:1746129565.390215:0:8411:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7dbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8411:1830948737441408:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129565.390270:0:8412:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15726 00000100:00100000:0.0:1746129565.390276:0:8412:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b551c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:068dab75-d300-4ead-a742-d14572ad1e50+8:32069:x1830948733936000:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:0.0:1746129565.390282:0:8412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129565.390288:0:8412:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092f86400/0x40a459093b068c62 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2051f expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129565.390316:0:8412:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129565.390320:0:8412:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009584fe00/0x40a459093b068c5b lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [3674112->4091903] (req 3674112->4091903) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20511 expref: 11 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129565.390325:0:8412:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129565.390328:0:8412:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092f86400/0x40a459093b068c62 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2051f expref: 9 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129565.391268:0:8412:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009584fe00/0x40a459093b068c5b lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [3674112->4091903] (req 3674112->4091903) gid 0 flags: 0x60000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20511 expref: 12 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129565.391280:0:8412:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092f86400/0x40a459093b068c62 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2051f expref: 9 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129565.391288:0:8412:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092f86400, rc 0) 00000100:00100000:0.0:1746129565.391459:0:8412:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b551c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:068dab75-d300-4ead-a742-d14572ad1e50+9:32069:x1830948733936000:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 1182us (1467us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129565.391463:0:8412:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15726 00000100:00100000:0.0:1746129565.393981:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.394002:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.394283:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.394626:0:7086:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8037 00000100:00100000:0.0:1746129565.394634:0:7086:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:068dab75-d300-4ead-a742-d14572ad1e50+9:1962:x1830948733936512:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129565.394642:0:7086:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129565.394653:0:7086:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095cda000/0x40a459093b068abe lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20446 expref: 9 pid: 8411 timeout: 920 lvb_type: 1 00010000:00010000:0.0:1746129565.394664:0:7086:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095cda000/0x40a459093b068abe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20446 expref: 9 pid: 8411 timeout: 920 lvb_type: 1 00010000:00010000:0.0:1746129565.394687:0:7086:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095cda000/0x40a459093b068abe lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20446 expref: 9 pid: 8411 timeout: 920 lvb_type: 1 00010000:00010000:0.0:1746129565.394699:0:7086:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129565.394716:0:7086:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:068dab75-d300-4ead-a742-d14572ad1e50+8:1962:x1830948733936512:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 84us (713us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129565.394721:0:7086:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8037 00000100:00100000:0.0:1746129565.394733:0:7086:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8038 00000100:00100000:0.0:1746129565.394738:0:7086:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947bf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+11:1962:x1830948733936384:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129565.394744:0:7086:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129565.394752:0:7086:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095fc7c00/0x40a459093b068c46 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20503 expref: 11 pid: 7149 timeout: 920 lvb_type: 1 00010000:00010000:0.0:1746129565.394759:0:7086:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095fc7c00/0x40a459093b068c46 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20503 expref: 11 pid: 7149 timeout: 920 lvb_type: 1 00010000:00010000:0.0:1746129565.394770:0:7086:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095fc7c00/0x40a459093b068c46 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20503 expref: 11 pid: 7149 timeout: 920 lvb_type: 1 00010000:00010000:0.0:1746129565.394779:0:7086:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129565.394793:0:7086:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947bf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+10:1962:x1830948733936384:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 55us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129565.394802:0:7086:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8038 00000100:00100000:1.0:1746129565.395907:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.397846:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129565.398219:0:31520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733936896 00000100:00100000:1.0:1746129565.398225:0:31520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733936896 00002000:00100000:1.0:1746129565.398259:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3ef:0x0] (3674112->3678207) req@ffff8800947bed80 x1830948733936896/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:306/0 lens 488/0 e 0 to 0 dl 1746129576 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129565.398268:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800947bed80 with x1830948733936896 ext(3674112->3678207) 00010000:00010000:1.0:1746129565.398276:0:31520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009584fe00/0x40a459093b068c5b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3674112->4091903) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20511 expref: 10 pid: 22480 timeout: 920 lvb_type: 0 00010000:00010000:1.0:1746129565.398286:0:31520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009584fe00/0x40a459093b068c5b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3674112->4091903) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20511 expref: 10 pid: 22480 timeout: 920 lvb_type: 0 00002000:00010000:1.0:1746129565.398319:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800947bed80 00000100:00100000:1.0:1746129565.398335:0:31520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2356 00000100:00100000:1.0:1746129565.398340:0:31520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+10:1962:x1830948733936896:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:1.0:1746129565.398511:0:31520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+10:1962:x1830948733936896:12345-192.168.202.4@tcp:3:cat.0 Request processed in 171us (670us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746129565.398517:0:31520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2356 00002000:00100000:1.0:1746129565.398521:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3ef:0x0] (3674112->3678207) req@ffff8800947bed80 x1830948733936896/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:306/0 lens 488/4536 e 0 to 0 dl 1746129576 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129565.398528:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800947bed80 with x1830948733936896 ext(3674112->3678207) 00010000:00010000:1.0:1746129565.398531:0:31520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009584fe00/0x40a459093b068c5b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3674112->4091903) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20511 expref: 10 pid: 22480 timeout: 920 lvb_type: 0 00010000:00010000:1.0:1746129565.398538:0:31520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009584fe00/0x40a459093b068c5b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3674112->4091903) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20511 expref: 10 pid: 22480 timeout: 920 lvb_type: 0 00002000:00010000:1.0:1746129565.398543:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800947bed80 00000100:00100000:0.0:1746129565.402416:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129565.402497:0:31520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733937152 00000100:00100000:1.0:1746129565.402507:0:31520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733937152 00002000:00100000:1.0:1746129565.402548:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3ef:0x0] (4087808->4091903) req@ffff8800947bc000 x1830948733937152/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:306/0 lens 488/0 e 0 to 0 dl 1746129576 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129565.402556:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800947bc000 with x1830948733937152 ext(4087808->4091903) 00010000:00010000:1.0:1746129565.402564:0:31520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009584fe00/0x40a459093b068c5b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3674112->4091903) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20511 expref: 10 pid: 22480 timeout: 920 lvb_type: 0 00010000:00010000:1.0:1746129565.402573:0:31520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009584fe00/0x40a459093b068c5b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3674112->4091903) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20511 expref: 10 pid: 22480 timeout: 920 lvb_type: 0 00002000:00010000:1.0:1746129565.402583:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800947bc000 00000100:00100000:1.0:1746129565.402607:0:31520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2357 00000100:00100000:1.0:1746129565.402614:0:31520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+10:1961:x1830948733937152:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:1.0:1746129565.402819:0:31520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+10:1961:x1830948733937152:12345-192.168.202.4@tcp:3:cat.0 Request processed in 204us (413us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746129565.402826:0:31520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2357 00002000:00100000:1.0:1746129565.402832:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3ef:0x0] (4087808->4091903) req@ffff8800947bc000 x1830948733937152/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:306/0 lens 488/4536 e 0 to 0 dl 1746129576 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129565.402840:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800947bc000 with x1830948733937152 ext(4087808->4091903) 00010000:00010000:1.0:1746129565.402844:0:31520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009584fe00/0x40a459093b068c5b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3674112->4091903) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20511 expref: 10 pid: 22480 timeout: 920 lvb_type: 0 00010000:00010000:1.0:1746129565.402852:0:31520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009584fe00/0x40a459093b068c5b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3674112->4091903) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20511 expref: 10 pid: 22480 timeout: 920 lvb_type: 0 00002000:00010000:1.0:1746129565.402858:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800947bc000 00000100:00100000:0.0:1746129565.405438:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.405492:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129565.405723:0:31520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733937408 00000100:00100000:1.0:1746129565.405727:0:31520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733937408 00002000:00100000:1.0:1746129565.405753:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3ef:0x0] (3674112->4091903) req@ffff8800947bca80 x1830948733937408/t0(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:306/0 lens 488/0 e 0 to 0 dl 1746129576 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129565.405762:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800947bca80 with x1830948733937408 ext(3674112->4091903) 00010000:00010000:1.0:1746129565.405770:0:31520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009584fe00/0x40a459093b068c5b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3674112->4091903) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20511 expref: 10 pid: 22480 timeout: 920 lvb_type: 0 00010000:00010000:1.0:1746129565.405785:0:31520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009584fe00/0x40a459093b068c5b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3674112->4091903) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20511 expref: 10 pid: 22480 timeout: 920 lvb_type: 0 00002000:00010000:1.0:1746129565.405790:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800947bca80 00000100:00100000:1.0:1746129565.405802:0:31520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2358 00000100:00100000:1.0:1746129565.405806:0:31520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+10:1963:x1830948733937408:12345-192.168.202.4@tcp:4:cat.0 00000100:00100000:1.0:1746129565.414193:0:31520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+12:1963:x1830948733937408:12345-192.168.202.4@tcp:4:cat.0 Request processed in 8374us (8754us total) trans 21474841274 rc 0/0 00000100:00100000:1.0:1746129565.414207:0:31520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2358 00002000:00100000:1.0:1746129565.414220:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3ef:0x0] (3674112->4091903) req@ffff8800947bca80 x1830948733937408/t21474841274(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:306/0 lens 488/448 e 0 to 0 dl 1746129576 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129565.414229:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800947bca80 with x1830948733937408 ext(3674112->4091903) 00010000:00010000:1.0:1746129565.414240:0:31520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009584fe00/0x40a459093b068c5b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3674112->4091903) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20511 expref: 12 pid: 22480 timeout: 920 lvb_type: 0 00010000:00010000:1.0:1746129565.414253:0:31520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009584fe00/0x40a459093b068c5b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3674112->4091903) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20511 expref: 12 pid: 22480 timeout: 920 lvb_type: 0 00002000:00010000:1.0:1746129565.414259:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800947bca80 00000100:00100000:0.0:1746129565.415849:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.418202:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.421051:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.422468:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.422544:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.426236:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.426267:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.426324:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.426343:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129565.426402:0:22480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733938560 00000100:00100000:1.0:1746129565.426412:0:22480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733938560 00000100:00100000:1.0:1746129565.427017:0:22480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733938816 00000100:00100000:1.0:1746129565.427020:0:22480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733938816 00000100:00100000:0.0:1746129565.427034:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129565.427350:0:22480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15731 00000100:00100000:1.0:1746129565.427357:0:22480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f37fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:068dab75-d300-4ead-a742-d14572ad1e50+9:1962:x1830948733938816:12345-192.168.202.4@tcp:2:lfs.0 00002000:00010000:1.0:1746129565.427533:0:22480:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746129565.427536:0:22480:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb mtime from disk: 1746129565 -> 1746129565 00002000:00010000:1.0:1746129565.427538:0:22480:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb atime from disk: 1746129565 -> 1746129565 00002000:00010000:1.0:1746129565.427540:0:22480:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb ctime from disk: 1746129565 -> 1746129566 00002000:00010000:1.0:1746129565.427542:0:22480:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:1.0:1746129565.427568:0:22480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f37fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:068dab75-d300-4ead-a742-d14572ad1e50+10:1962:x1830948733938816:12345-192.168.202.4@tcp:2:lfs.0 Request processed in 212us (1299us total) trans 21474841275 rc 0/0 00000100:00100000:1.0:1746129565.427576:0:22480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15731 00000100:00100000:1.0:1746129565.427588:0:22480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15734 00000100:00100000:1.0:1746129565.427593:0:22480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f37c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:068dab75-d300-4ead-a742-d14572ad1e50+10:1962:x1830948733938688:12345-192.168.202.4@tcp:2:lfs.0 00002000:00010000:1.0:1746129565.427665:0:22480:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746129565.427667:0:22480:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb mtime from disk: 1746129565 -> 1746129565 00002000:00010000:1.0:1746129565.427669:0:22480:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb atime from disk: 1746129565 -> 1746129565 00002000:00010000:1.0:1746129565.427671:0:22480:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb ctime from disk: 1746129566 -> 1746129566 00002000:00010000:1.0:1746129565.427673:0:22480:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746129565.427691:0:22480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f37c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:068dab75-d300-4ead-a742-d14572ad1e50+11:1962:x1830948733938688:12345-192.168.202.4@tcp:2:lfs.0 Request processed in 97us (657us total) trans 17179874038 rc 0/0 00000100:00100000:1.0:1746129565.427697:0:22480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15734 00000100:00100000:1.0:1746129565.427753:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.427772:0:8412:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733938944 00000100:00100000:0.0:1746129565.427776:0:8412:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733938944 00000100:00100000:0.0:1746129565.427801:0:8412:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15735 00000100:00100000:0.0:1746129565.427806:0:8412:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b552300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:068dab75-d300-4ead-a742-d14572ad1e50+10:1962:x1830948733938944:12345-192.168.202.4@tcp:2:lfs.0 00002000:00010000:0.0:1746129565.428475:0:8412:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb size from disk: 5146336 -> 5146336 00002000:00010000:0.0:1746129565.428479:0:8412:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb mtime from disk: 1746129566 -> 1746129565 00002000:00010000:0.0:1746129565.428481:0:8412:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb atime from disk: 1746129562 -> 1746129565 00002000:00010000:0.0:1746129565.428483:0:8412:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb ctime from disk: 1746129566 -> 1746129566 00002000:00010000:0.0:1746129565.428485:0:8412:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb blocks from disk: 6033 -> 6033 00000100:00100000:0.0:1746129565.428505:0:8412:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b552300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:068dab75-d300-4ead-a742-d14572ad1e50+11:1962:x1830948733938944:12345-192.168.202.4@tcp:2:lfs.0 Request processed in 698us (751us total) trans 21474841277 rc 0/0 00000100:00100000:0.0:1746129565.428515:0:8412:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15735 00000100:00100000:0.0:1746129565.431329:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129565.431417:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129565.431492:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129565.431926:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.432130:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733939584 00000100:00100000:0.0:1746129565.432134:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733939584 00010000:00010000:0.0:1746129565.432152:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092f86400/0x40a459093b068c62 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2051f expref: 12 pid: 8412 timeout: 920 lvb_type: 0 00000100:00100000:0.0:1746129565.432169:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8044 00000100:00100000:0.0:1746129565.432174:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b551880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:068dab75-d300-4ead-a742-d14572ad1e50+12:1962:x1830948733939200:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129565.432182:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129565.432197:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012db48e00/0x40a459093b068bb3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2049a expref: 12 pid: 7148 timeout: 920 lvb_type: 0 00010000:00010000:0.0:1746129565.432205:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012db48e00/0x40a459093b068bb3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2049a expref: 12 pid: 7148 timeout: 920 lvb_type: 0 00010000:00010000:0.0:1746129565.432218:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012db48e00/0x40a459093b068bb3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2049a expref: 12 pid: 7148 timeout: 920 lvb_type: 0 00010000:00010000:0.0:1746129565.432230:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129565.432231:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129565.432235:0:7085:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d107c00/0x40a459093b068c69 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20526 expref: 10 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129565.432241:0:7085:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d107c00/0x40a459093b068c69 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20526 expref: 10 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129565.432262:0:7085:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009d107c00/0x40a459093b068c69 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20526 expref: 10 pid: 4699 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129565.432270:0:7085:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f37c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7085:1830948737443200:192.168.202.4@tcp:105: 00000100:00100000:0.0:1746129565.433040:0:7085:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a00180 going to sleep for 11 seconds 00000100:00100000:0.0:1746129565.436943:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.437403:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.437432:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.437513:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129565.437734:0:7085:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f37c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7085:1830948737443200:192.168.202.4@tcp:105: 00010000:00010000:1.0:1746129565.437755:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129565.437800:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b551880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:068dab75-d300-4ead-a742-d14572ad1e50+10:1962:x1830948733939200:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 5624us (6306us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129565.437810:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8044 00000100:00100000:1.0:1746129565.439054:0:31520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733940480 00000100:00100000:1.0:1746129565.439058:0:31520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733940480 00002000:00100000:1.0:1746129565.439077:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3ec:0x0] (0->1048575) req@ffff88009f37e300 x1830948733940480/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:306/0 lens 488/0 e 0 to 0 dl 1746129576 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129565.439084:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f37e300 with x1830948733940480 ext(0->1048575) 00010000:00010000:1.0:1746129565.439090:0:31520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009d107c00/0x40a459093b068c69 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20526 expref: 11 pid: 4699 timeout: 920 lvb_type: 0 00010000:00010000:1.0:1746129565.439100:0:31520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009d107c00/0x40a459093b068c69 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20526 expref: 11 pid: 4699 timeout: 920 lvb_type: 0 00002000:00010000:1.0:1746129565.439105:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f37e300 00000100:00100000:1.0:1746129565.439125:0:31520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2359 00000100:00100000:1.0:1746129565.439130:0:31520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f37e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+11:1960:x1830948733940480:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129565.450086:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733940608 00000100:00100000:0.0:1746129565.450095:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733940608 00000100:00100000:0.0:1746129565.450151:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15737 00000100:00100000:0.0:1746129565.450159:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ada2ffba-8920-4ecb-8068-68caa9806978+22:32078:x1830948733940608:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:0.0:1746129565.450224:0:4385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129565.450242:0:4385:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092f86600/0x40a459093b068c8c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20549 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129565.450272:0:4385:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b4020200/0x40a459093b068c77 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20534 expref: 9 pid: 8411 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129565.450280:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129565.450281:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129565.450284:0:4385:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092f86600/0x40a459093b068c8c lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [3145728->3457023] (req 3145728->3457023) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20549 expref: 23 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129565.450414:0:4385:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b4020200/0x40a459093b068c77 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20534 expref: 9 pid: 8411 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129565.450429:0:4385:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b4020200/0x40a459093b068c77 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20534 expref: 9 pid: 8411 timeout: 920 lvb_type: 0 00000100:00100000:1.0:1746129565.450442:0:4385:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f37c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:4385:1830948737443584:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129565.450500:0:4385:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a00480 going to sleep for 11 seconds 00000100:00100000:1.0:1746129565.454016:0:31520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f37e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+11:1960:x1830948733940480:12345-192.168.202.4@tcp:3:cat.0 Request processed in 14872us (16489us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129565.454031:0:31520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2359 00002000:00100000:1.0:1746129565.454044:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3ec:0x0] (0->1048575) req@ffff88009f37e300 x1830948733940480/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:306/0 lens 488/440 e 0 to 0 dl 1746129576 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129565.454054:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f37e300 with x1830948733940480 ext(0->1048575) 00010000:00010000:1.0:1746129565.454066:0:31520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009d107c00/0x40a459093b068c69 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20526 expref: 11 pid: 4699 timeout: 920 lvb_type: 0 00010000:00010000:1.0:1746129565.454079:0:31520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009d107c00/0x40a459093b068c69 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20526 expref: 11 pid: 4699 timeout: 920 lvb_type: 0 00002000:00010000:1.0:1746129565.454086:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f37e300 00000100:00100000:1.0:1746129565.457829:0:4385:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f37c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:4385:1830948737443584:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129565.457865:0:4385:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092f86600/0x40a459093b068c8c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [3145728->3457023] (req 3145728->3457023) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20549 expref: 23 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129565.457883:0:4385:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092f86600, rc 0) 00000100:00100000:1.0:1746129565.457937:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ada2ffba-8920-4ecb-8068-68caa9806978+23:32078:x1830948733940608:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 7778us (7906us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129565.457947:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15737 00000100:00100000:0.0:1746129565.461204:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129565.465396:0:31518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f37fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ada2ffba-8920-4ecb-8068-68caa9806978+21:1963:x1830948733939968:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 25569us (27990us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129565.465407:0:31518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7548 00002000:00100000:1.0:1746129565.465417:0:31518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff88009f37fb80 x1830948733939968/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:306/0 lens 488/440 e 0 to 0 dl 1746129576 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129565.465432:0:31518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f37fb80 with x1830948733939968 ext(1048576->2097151) 00002000:00010000:1.0:1746129565.465436:0:31518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f37fb80 00000100:00100000:0.0:1746129565.470164:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.470236:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129565.470663:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733940864 00000100:00100000:1.0:1746129565.470673:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733940864 00000100:00100000:1.0:1746129565.470800:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15738 00000100:00100000:1.0:1746129565.470809:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+7:32082:x1830948733940864:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129565.470828:0:4385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129565.470843:0:4385:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e0fd000/0x40a459093b068c93 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20550 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129565.470945:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129565.470947:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129565.470953:0:4385:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e0fd000/0x40a459093b068c93 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20550 expref: 8 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129565.470967:0:4385:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012e0fd000/0x40a459093b068c93 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20550 expref: 8 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129565.471071:0:4385:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e0fd000, rc 0) 00000100:00100000:1.0:1746129565.471251:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+8:32082:x1830948733940864:12345-192.168.202.4@tcp:101:cat.0 Request processed in 442us (1097us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129565.471257:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15738 00000100:00100000:0.0:1746129565.476202:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129565.478614:0:31518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733941248 00000100:00100000:1.0:1746129565.478630:0:31518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733941248 00002000:00100000:1.0:1746129565.478677:0:31518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3f5:0x0] (3452928->3457023) req@ffff88009fbaca80 x1830948733941248/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:306/0 lens 488/0 e 0 to 0 dl 1746129576 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129565.478693:0:31518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbaca80 with x1830948733941248 ext(3452928->3457023) 00002000:00010000:1.0:1746129565.478697:0:31518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fbaca80 00000100:00100000:1.0:1746129565.478720:0:31518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7550 00000100:00100000:1.0:1746129565.478726:0:31518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ada2ffba-8920-4ecb-8068-68caa9806978+21:1961:x1830948733941248:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:0.0:1746129565.478734:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129565.478774:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733941376 00000100:00100000:1.0:1746129565.478776:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733941376 00000100:00100000:1.0:1746129565.478805:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15739 00000100:00100000:1.0:1746129565.478809:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:068dab75-d300-4ead-a742-d14572ad1e50+9:32069:x1830948733941376:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:1.0:1746129565.478817:0:4385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129565.478834:0:4385:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e0fd800/0x40a459093b068c9a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20557 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129565.478860:0:4385:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092f86800/0x40a459093b068c54 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20518 expref: 21 pid: 8411 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129565.478869:0:4385:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e0fd000/0x40a459093b068c93 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20550 expref: 7 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129565.478876:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129565.478877:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129565.478880:0:4385:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e0fd800/0x40a459093b068c9a lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20557 expref: 10 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129565.479188:0:4385:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012e0fd000/0x40a459093b068c93 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20550 expref: 7 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129565.479206:0:4385:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012e0fd000/0x40a459093b068c93 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20550 expref: 7 pid: 4385 timeout: 920 lvb_type: 0 00000100:00100000:1.0:1746129565.479219:0:4385:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b552a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:4385:1830948737443968:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129565.479322:0:4385:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092f86800/0x40a459093b068c54 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20518 expref: 21 pid: 8411 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129565.479330:0:4385:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092f86800/0x40a459093b068c54 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20518 expref: 21 pid: 8411 timeout: 920 lvb_type: 0 00000100:00100000:1.0:1746129565.479338:0:4385:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b550e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:4385:1830948737444096:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129565.479394:0:4385:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c954b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746129565.479845:0:31518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ada2ffba-8920-4ecb-8068-68caa9806978+21:1961:x1830948733941248:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 1118us (3654us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746129565.479852:0:31518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7550 00002000:00100000:1.0:1746129565.479858:0:31518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3f5:0x0] (3452928->3457023) req@ffff88009fbaca80 x1830948733941248/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:306/0 lens 488/4536 e 0 to 0 dl 1746129576 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129565.480041:0:31518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbaca80 with x1830948733941248 ext(3452928->3457023) 00002000:00010000:1.0:1746129565.480046:0:31518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fbaca80 00000100:00100000:1.0:1746129565.480331:0:31520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733941632 00000100:00100000:1.0:1746129565.480337:0:31520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733941632 00002000:00100000:1.0:1746129565.480373:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff88009ca85180 x1830948733941632/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:306/0 lens 488/0 e 0 to 0 dl 1746129576 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129565.480388:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca85180 with x1830948733941632 ext(1048576->2097151) 00010000:00010000:1.0:1746129565.480394:0:31520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012e0fd000/0x40a459093b068c93 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20550 expref: 8 pid: 4385 timeout: 920 lvb_type: 0 00010000:00010000:1.0:1746129565.480405:0:31520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012e0fd000/0x40a459093b068c93 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20550 expref: 8 pid: 4385 timeout: 920 lvb_type: 0 00002000:00010000:1.0:1746129565.480411:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ca85180 00000100:00100000:1.0:1746129565.480430:0:31520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2360 00000100:00100000:1.0:1746129565.480436:0:31520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca85180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+8:1962:x1830948733941632:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:1.0:1746129565.482105:0:4385:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b552a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:4385:1830948737443968:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129565.487337:0:4385:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b550e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:4385:1830948737444096:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129565.487389:0:4385:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012e0fd800/0x40a459093b068c9a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20557 expref: 10 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129565.487402:0:4385:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e0fd800, rc 0) 00000100:00100000:1.0:1746129565.487445:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:068dab75-d300-4ead-a742-d14572ad1e50+10:32069:x1830948733941376:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 8633us (8711us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129565.487453:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15739 00000100:00100000:0.0:1746129565.487674:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.487893:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129565.491433:0:31520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca85180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+8:1962:x1830948733941632:12345-192.168.202.4@tcp:3:cat.0 Request processed in 10986us (11252us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129565.491447:0:31520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2360 00002000:00100000:1.0:1746129565.491459:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff88009ca85180 x1830948733941632/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:306/0 lens 488/440 e 0 to 0 dl 1746129576 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129565.491472:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca85180 with x1830948733941632 ext(1048576->2097151) 00010000:00010000:1.0:1746129565.491482:0:31520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012e0fd000/0x40a459093b068c93 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20550 expref: 8 pid: 4385 timeout: 920 lvb_type: 0 00010000:00010000:1.0:1746129565.491498:0:31520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012e0fd000/0x40a459093b068c93 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20550 expref: 8 pid: 4385 timeout: 920 lvb_type: 0 00002000:00010000:1.0:1746129565.491505:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ca85180 00000100:00100000:0.0:1746129565.499853:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733942656 00000100:00100000:0.0:1746129565.499856:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733942656 00000100:00100000:0.0:1746129565.499880:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15741 00000100:00100000:0.0:1746129565.499885:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135725180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+8:32082:x1830948733942656:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129565.499899:0:4385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129565.499910:0:4385:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092f86400/0x40a459093b068ca8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20565 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129565.499922:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129565.499923:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129565.499926:0:4385:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092f86400/0x40a459093b068ca8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20565 expref: 9 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129565.499935:0:4385:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092f86400/0x40a459093b068ca8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20565 expref: 9 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129565.499942:0:4385:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092f86400, rc 0) 00000100:00100000:0.0:1746129565.499981:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135725180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+9:32082:x1830948733942656:12345-192.168.202.4@tcp:101:cat.0 Request processed in 96us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129565.499987:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15741 00000100:00100000:1.0:1746129565.502047:0:31520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733942528 00000100:00100000:1.0:1746129565.502060:0:31520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733942528 00002000:00100000:1.0:1746129565.502111:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3f4:0x0] (1048576->2097151) req@ffff88009ca84e00 x1830948733942528/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:306/0 lens 488/0 e 0 to 0 dl 1746129576 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129565.502121:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca84e00 with x1830948733942528 ext(1048576->2097151) 00002000:00010000:1.0:1746129565.502126:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ca84e00 00000100:00100000:1.0:1746129565.502163:0:31520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7551 00000100:00100000:1.0:1746129565.502171:0:31520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca84e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ada2ffba-8920-4ecb-8068-68caa9806978+21:1962:x1830948733942528:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:0.0:1746129565.508815:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129565.513602:0:31520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca84e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ada2ffba-8920-4ecb-8068-68caa9806978+21:1962:x1830948733942528:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 11431us (14209us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129565.513611:0:31520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7551 00002000:00100000:1.0:1746129565.513621:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3f4:0x0] (1048576->2097151) req@ffff88009ca84e00 x1830948733942528/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:306/0 lens 488/440 e 0 to 0 dl 1746129576 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129565.513630:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca84e00 with x1830948733942528 ext(1048576->2097151) 00010000:00010000:1.0:1746129565.513638:0:31520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800b4020000/0x40a459093b068ca1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2055e expref: 21 pid: 8410 timeout: 920 lvb_type: 0 00010000:00010000:1.0:1746129565.513649:0:31520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800b4020000/0x40a459093b068ca1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2055e expref: 21 pid: 8410 timeout: 920 lvb_type: 0 00002000:00010000:1.0:1746129565.513655:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ca84e00 00000100:00100000:0.0:1746129565.527956:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.528069:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129565.528336:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733943296 00000100:00100000:1.0:1746129565.528346:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733943296 00000100:00100000:1.0:1746129565.528408:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733943424 00000100:00100000:1.0:1746129565.528410:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733943424 00000100:00100000:1.0:1746129565.528427:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15743 00000100:00100000:1.0:1746129565.528433:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbaed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+10:32082:x1830948733943296:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129565.528453:0:4385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129565.528469:0:4385:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800959de600/0x40a459093b068cb6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20573 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129565.528496:0:4385:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c031a00/0x40a459093b068c15 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f204d2 expref: 9 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129565.528503:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129565.528504:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129565.528508:0:4385:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800959de600/0x40a459093b068cb6 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20573 expref: 11 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129565.528711:0:4385:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c031a00/0x40a459093b068c15 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f204d2 expref: 9 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129565.528721:0:4385:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c031a00/0x40a459093b068c15 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f204d2 expref: 9 pid: 4699 timeout: 920 lvb_type: 0 00000100:00100000:1.0:1746129565.528737:0:4385:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b550e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:4385:1830948737444864:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129565.529385:0:4385:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c954900 going to sleep for 11 seconds 00000100:00100000:1.0:1746129565.529665:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.529855:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.531491:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129565.531494:0:4385:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b550e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:4385:1830948737444864:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129565.531522:0:4385:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800959de600/0x40a459093b068cb6 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20573 expref: 11 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129565.531535:0:4385:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800959de600, rc 0) 00000100:00100000:1.0:1746129565.531990:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbaed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+11:32082:x1830948733943296:12345-192.168.202.4@tcp:101:cat.0 Request processed in 3555us (4044us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129565.531997:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15743 00000100:00100000:0.0:1746129565.532327:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129565.532339:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733943936 00000100:00100000:1.0:1746129565.532343:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733943936 00000100:00100000:1.0:1746129565.532358:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15745 00000100:00100000:1.0:1746129565.532376:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094065180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:068dab75-d300-4ead-a742-d14572ad1e50+10:32069:x1830948733943936:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:1.0:1746129565.532389:0:4385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129565.532398:0:4385:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800959dfa00/0x40a459093b068cc4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20581 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129565.532413:0:4385:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800959de600/0x40a459093b068cb6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20573 expref: 10 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129565.532420:0:4385:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095fb0200/0x40a459093b068cbd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2057a expref: 18 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129565.532430:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129565.532432:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129565.532435:0:4385:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800959dfa00/0x40a459093b068cc4 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20581 expref: 11 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129565.532449:0:4385:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095fb0200/0x40a459093b068cbd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2057a expref: 18 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129565.532459:0:4385:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095fb0200/0x40a459093b068cbd lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2057a expref: 18 pid: 4699 timeout: 920 lvb_type: 0 00000100:00100000:1.0:1746129565.532467:0:4385:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b550e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:4385:1830948737445376:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129565.532515:0:4385:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800959de600/0x40a459093b068cb6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20573 expref: 10 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129565.532522:0:4385:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800959de600/0x40a459093b068cb6 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20573 expref: 10 pid: 4385 timeout: 920 lvb_type: 0 00000100:00100000:1.0:1746129565.532530:0:4385:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b552d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:4385:1830948737445504:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129565.532548:0:4385:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c954900 going to sleep for 11 seconds 00000100:00100000:1.0:1746129565.534749:0:4385:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b550e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:4385:1830948737445376:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129565.534756:0:4385:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b552d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:4385:1830948737445504:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129565.534780:0:4385:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800959dfa00/0x40a459093b068cc4 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20581 expref: 11 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129565.534798:0:4385:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800959dfa00, rc 0) 00000100:00100000:1.0:1746129565.534816:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094065180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:068dab75-d300-4ead-a742-d14572ad1e50+11:32069:x1830948733943936:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 2439us (2490us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129565.534824:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15745 00000100:00100000:0.0:1746129565.536663:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.536698:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129565.536753:0:31520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733944448 00000100:00100000:1.0:1746129565.536756:0:31520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733944448 00002000:00100000:1.0:1746129565.536771:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3ee:0x0] (1048576->2097151) req@ffff880094066a00 x1830948733944448/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:306/0 lens 488/0 e 0 to 0 dl 1746129576 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129565.536777:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094066a00 with x1830948733944448 ext(1048576->2097151) 00010000:00010000:1.0:1746129565.536781:0:31520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800959de600/0x40a459093b068cb6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20573 expref: 11 pid: 4385 timeout: 920 lvb_type: 0 00010000:00010000:1.0:1746129565.536791:0:31520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800959de600/0x40a459093b068cb6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20573 expref: 11 pid: 4385 timeout: 920 lvb_type: 0 00002000:00010000:1.0:1746129565.536856:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094066a00 00000100:00100000:1.0:1746129565.536886:0:31520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2362 00000100:00100000:1.0:1746129565.536894:0:31520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094066300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ada2ffba-8920-4ecb-8068-68caa9806978+19:1963:x1830948733944192:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:1.0:1746129565.551186:0:31520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094066300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ada2ffba-8920-4ecb-8068-68caa9806978+19:1963:x1830948733944192:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 14282us (14516us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129565.551198:0:31520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2362 00002000:00100000:1.0:1746129565.551209:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3ee:0x0] (1048576->2097151) req@ffff880094066300 x1830948733944192/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:306/0 lens 488/440 e 0 to 0 dl 1746129576 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129565.551224:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094066300 with x1830948733944192 ext(1048576->2097151) 00010000:00010000:1.0:1746129565.551234:0:31520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880095fb0200/0x40a459093b068cbd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2057a expref: 19 pid: 4699 timeout: 920 lvb_type: 0 00010000:00010000:1.0:1746129565.551246:0:31520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880095fb0200/0x40a459093b068cbd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2057a expref: 19 pid: 4699 timeout: 920 lvb_type: 0 00002000:00010000:1.0:1746129565.551252:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094066300 00000100:00100000:0.0:1746129565.552636:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.552660:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.552677:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.552693:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.552702:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.552719:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.553814:0:20577:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733945088 00000100:00100000:0.0:1746129565.553820:0:20577:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733945088 00000100:00100000:0.0:1746129565.553971:0:20577:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733945216 00000100:00100000:0.0:1746129565.553974:0:20577:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733945216 00000100:00100000:1.0:1746129565.554048:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15748 00000100:00100000:1.0:1746129565.554055:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094066680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+14:1960:x1830948733945088:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129565.554065:0:4385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129565.554074:0:4385:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ec79200/0x40a459093b068cd9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f205a4 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129565.554123:0:20577:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15750 00000100:00100000:0.0:1746129565.554129:0:20577:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094065500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+10:1960:x1830948733944704:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129565.554136:0:20577:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129565.554143:0:20577:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092f86200/0x40a459093b068ce7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2058f expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129565.554188:0:20577:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094065c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20577:1830948737445888:192.168.202.4@tcp:106: 00000100:00100000:0.0:1746129565.554212:0:20577:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a003c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746129565.554414:0:4385:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b552d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:4385:1830948737446144:192.168.202.4@tcp:106: 00000100:00100000:1.0:1746129565.554448:0:4385:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c954900 going to sleep for 11 seconds 00000100:00100000:0.0:1746129565.554809:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129565.558334:0:20577:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094065c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20577:1830948737445888:192.168.202.4@tcp:106: 00010000:00010000:1.0:1746129565.558353:0:20577:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092f86200/0x40a459093b068ce7 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2058f expref: 12 pid: 20577 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129565.558372:0:20577:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092f86200/0x40a459093b068ce7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2058f expref: 12 pid: 20577 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746129565.558402:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00010000:00010000:1.0:1746129565.559273:0:20577:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092f86200, rc 0) 00000100:00100000:1.0:1746129565.559314:0:20577:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094065500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+7:1960:x1830948733944704:12345-192.168.202.4@tcp:101:cat.0 Request processed in 5184us (6617us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129565.559320:0:20577:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15750 00002000:00010000:1.0:1746129565.559385:0:4385:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb mtime: 1746129565 -> 1746129566 00002000:00010000:1.0:1746129565.559388:0:4385:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb atime: 1746129565 -> 1746129566 00000100:00100000:1.0:1746129565.559401:0:4385:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b552d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:4385:1830948737446144:192.168.202.4@tcp:106: 00010000:00010000:1.0:1746129565.559419:0:4385:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ec79200/0x40a459093b068cd9 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f205a4 expref: 11 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129565.559429:0:4385:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ec79200/0x40a459093b068cd9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f205a4 expref: 11 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129565.559436:0:4385:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ec79200, rc 0) 00000100:00100000:1.0:1746129565.559455:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094066680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+10:1960:x1830948733945088:12345-192.168.202.4@tcp:101:cat.0 Request processed in 5402us (6776us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129565.559461:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15748 00000100:00100000:1.0:1746129565.562800:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129565.562850:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.562910:0:20577:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733945728 00000100:00100000:0.0:1746129565.562914:0:20577:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733945728 00000100:00100000:0.0:1746129565.562941:0:20577:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15753 00000100:00100000:0.0:1746129565.562947:0:20577:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b550e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:068dab75-d300-4ead-a742-d14572ad1e50+10:32069:x1830948733945728:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:0.0:1746129565.562956:0:20577:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129565.562976:0:20577:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092f87000/0x40a459093b068cfc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f205b9 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129565.562997:0:20577:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b4020e00/0x40a459093b068c70 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3796992->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2052d expref: 17 pid: 8411 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129565.563008:0:20577:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129565.563009:0:20577:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129565.563013:0:20577:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092f87000/0x40a459093b068cfc lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f205b9 expref: 11 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129565.563063:0:20577:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b4020e00/0x40a459093b068c70 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3796992->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2052d expref: 17 pid: 8411 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129565.563075:0:20577:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b4020e00/0x40a459093b068c70 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3796992->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2052d expref: 17 pid: 8411 timeout: 920 lvb_type: 0 00000100:00100000:0.0:1746129565.563086:0:20577:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094065880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20577:1830948737446528:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129565.563143:0:20577:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a00240 going to sleep for 11 seconds 00000100:00100000:0.0:1746129565.564162:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.564192:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.564212:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.564265:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129565.564558:0:31520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7552 00000100:00100000:1.0:1746129565.564566:0:31520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ada2ffba-8920-4ecb-8068-68caa9806978+21:1960:x1830948733946496:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129565.564836:0:8417:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7553 00000100:00100000:0.0:1746129565.564844:0:8417:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ada2ffba-8920-4ecb-8068-68caa9806978+21:1960:x1830948733946752:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129565.570069:0:20577:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094065880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20577:1830948737446528:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129565.570094:0:20577:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092f87000/0x40a459093b068cfc lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f205b9 expref: 11 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129565.570109:0:20577:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092f87000, rc 0) 00000100:00100000:0.0:1746129565.570134:0:20577:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b550e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:068dab75-d300-4ead-a742-d14572ad1e50+11:32069:x1830948733945728:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 7187us (7283us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129565.570141:0:20577:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15753 00000100:00100000:1.0:1746129565.583599:0:31520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ada2ffba-8920-4ecb-8068-68caa9806978+22:1960:x1830948733946496:12345-192.168.202.4@tcp:3:cat.0 Request processed in 19033us (19384us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129565.583606:0:31520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7552 00002000:00100000:1.0:1746129565.583613:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3f5:0x0] (2097152->3145727) req@ffff88012baef800 x1830948733946496/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:306/0 lens 488/440 e 0 to 0 dl 1746129576 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129565.583626:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012baef800 with x1830948733946496 ext(2097152->3145727) 00002000:00010000:1.0:1746129565.583630:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012baef800 00000100:00100000:0.0:1746129565.583929:0:8417:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ada2ffba-8920-4ecb-8068-68caa9806978+20:1960:x1830948733946752:12345-192.168.202.4@tcp:3:cat.0 Request processed in 19084us (19661us total) trans 0 rc 737280/737280 00000100:00100000:0.0:1746129565.583936:0:8417:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7553 00002000:00100000:0.0:1746129565.583942:0:8417:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3f5:0x0] (3457024->4194303) req@ffff88012baece00 x1830948733946752/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:306/0 lens 488/440 e 0 to 0 dl 1746129576 ref 1 fl Complete:/200/0 rc 737280/737280 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129565.583949:0:8417:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012baece00 with x1830948733946752 ext(3457024->4194303) 00002000:00010000:0.0:1746129565.583953:0:8417:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012baece00 00000100:00100000:0.0:1746129565.588494:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.590060:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.596084:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.600757:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.622891:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.628134:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.628197:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.628442:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.628560:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.629856:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.629875:0:2271:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733948928 00000100:00100000:0.0:1746129565.629878:0:2271:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733948928 00000100:00100000:0.0:1746129565.629913:0:2271:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11131 00000100:00100000:0.0:1746129565.629917:0:2271:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a07ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+11:32089:x1830948733948928:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:0.0:1746129565.629933:0:2271:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129565.629949:0:2271:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092f86800/0x40a459093b068d3b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f205dc expref: -99 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129565.630038:0:2271:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092f87e00/0x40a459093b068d42 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129565.630051:0:2271:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092f87e00/0x40a459093b068d42 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00000100:00100000:1.0:1746129565.630108:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129565.630123:0:22480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733948032 00000100:00100000:1.0:1746129565.630125:0:22480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733948032 00000100:00100000:1.0:1746129565.630151:0:22480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733948288 00000100:00100000:1.0:1746129565.630153:0:22480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733948288 00000100:00100000:1.0:1746129565.630166:0:22480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15760 00000100:00100000:1.0:1746129565.630171:0:22480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094065880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:068dab75-d300-4ead-a742-d14572ad1e50+12:1963:x1830948733948032:12345-192.168.202.4@tcp:2:lfs.0 00002000:00010000:1.0:1746129565.630260:0:22480:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3ec:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:1.0:1746129565.630263:0:22480:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ec:0x0] updating lvb mtime from disk: 1746129565 -> 1746129565 00002000:00010000:1.0:1746129565.630265:0:22480:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3ec:0x0] updating lvb atime from disk: 1746129565 -> 1746129565 00002000:00010000:1.0:1746129565.630267:0:22480:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ec:0x0] updating lvb ctime from disk: 1746129566 -> 1746129566 00002000:00010000:1.0:1746129565.630269:0:22480:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3ec:0x0] updating lvb blocks from disk: 1981 -> 1981 00000100:00100000:1.0:1746129565.630310:0:22480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094065880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:068dab75-d300-4ead-a742-d14572ad1e50+13:1963:x1830948733948032:12345-192.168.202.4@tcp:2:lfs.0 Request processed in 121us (1733us total) trans 21474841280 rc 0/0 00000100:00100000:1.0:1746129565.630315:0:22480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15760 00010000:00010000:0.0:1746129565.631087:0:2271:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092f87e00/0x40a459093b068d42 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129565.631104:0:2271:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092f86600/0x40a459093b068d49 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129565.631112:0:2271:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092f86600/0x40a459093b068d49 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129565.631118:0:2271:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092f86600/0x40a459093b068d49 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129565.631227:0:2271:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880092f86e00/0x40a459093b068d50 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129565.631235:0:2271:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092f86e00/0x40a459093b068d50 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129565.631240:0:2271:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092f86e00/0x40a459093b068d50 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00000004:00200000:0.0:1746129565.631253:0:2271:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:1.0:1746129565.631514:0:2271:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880092f86e00/0x40a459093b068d50 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:1.0:1746129565.631521:0:2271:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092f86e00/0x40a459093b068d50 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 2271 initiator: MDT0 00010000:00010000:1.0:1746129565.631526:0:2271:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092f86e00/0x40a459093b068d50 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 2271 initiator: MDT0 00010000:00010000:1.0:1746129565.631532:0:2271:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092f86e00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:1.0:1746129565.631537:0:2271:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092f86e00/0x40a459093b068d50 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 2271 initiator: MDT0 00010000:00010000:1.0:1746129565.631543:0:2271:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092f86e00/0x40a459093b068d50 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 2271 initiator: MDT0 00010000:00010000:1.0:1746129565.631554:0:2271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009f469400) 00010000:00010000:1.0:1746129565.631557:0:2271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746129565.631560:0:2271:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092f86e00/0x40a459093b068d50 lrc: 2/0,0 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 2271 initiator: MDT0 00010000:00010000:1.0:1746129565.631565:0:2271:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092f86e00/0x40a459093b068d50 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 2271 initiator: MDT0 00010000:00010000:1.0:1746129565.631591:0:2271:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092f87e00/0x40a459093b068d42 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:1.0:1746129565.631596:0:2271:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092f87e00/0x40a459093b068d42 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 2271 initiator: MDT0 00010000:00010000:1.0:1746129565.631600:0:2271:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092f87e00/0x40a459093b068d42 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 2271 initiator: MDT0 00010000:00010000:1.0:1746129565.631604:0:2271:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092f87e00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:1.0:1746129565.631606:0:2271:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092f87e00/0x40a459093b068d42 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 2271 initiator: MDT0 00010000:00010000:1.0:1746129565.631610:0:2271:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092f87e00/0x40a459093b068d42 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 2271 initiator: MDT0 00010000:00010000:1.0:1746129565.631616:0:2271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880132ef8f00) 00010000:00010000:1.0:1746129565.631618:0:2271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129565.631620:0:2271:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092f87e00/0x40a459093b068d42 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 2271 initiator: MDT0 00010000:00010000:1.0:1746129565.631627:0:2271:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092f87e00/0x40a459093b068d42 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 2271 initiator: MDT0 00010000:00010000:1.0:1746129565.631633:0:2271:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092f86600/0x40a459093b068d49 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:1.0:1746129565.631637:0:2271:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092f86600/0x40a459093b068d49 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 2271 initiator: MDT0 00010000:00010000:1.0:1746129565.631641:0:2271:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092f86600/0x40a459093b068d49 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 2271 initiator: MDT0 00010000:00010000:1.0:1746129565.631644:0:2271:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092f86600 already unused, calling callback (ffffffffa136e690) 00010000:00010000:1.0:1746129565.631646:0:2271:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092f86600/0x40a459093b068d49 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 2271 initiator: MDT0 00010000:00010000:1.0:1746129565.631650:0:2271:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092f86600/0x40a459093b068d49 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 2271 initiator: MDT0 00010000:00010000:1.0:1746129565.631655:0:2271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f0e7100) 00010000:00010000:1.0:1746129565.631657:0:2271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129565.631659:0:2271:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092f86600/0x40a459093b068d49 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 2271 initiator: MDT0 00010000:00010000:1.0:1746129565.631662:0:2271:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092f86600/0x40a459093b068d49 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 2271 initiator: MDT0 00010000:00010000:1.0:1746129565.631697:0:2271:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092f86800/0x40a459093b068d3b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f205dc expref: 13 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129565.631704:0:2271:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092f86800/0x40a459093b068d3b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f205dc expref: 13 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129565.631715:0:2271:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092f86800, rc 0) 00000100:00100000:1.0:1746129565.631755:0:2271:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a07ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+12:32089:x1830948733948928:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 1836us (1899us total) trans 8589945196 rc 301/301 00000100:00100000:1.0:1746129565.631761:0:2271:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11131 00000100:00100000:1.0:1746129565.637006:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129565.637053:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129565.637733:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129565.647954:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129565.648065:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129565.648101:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.648142:0:8417:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733950208 00000100:00100000:0.0:1746129565.648146:0:8417:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733950208 00002000:00100000:0.0:1746129565.648340:0:8417:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3ef:0x0] (2097152->3145727) req@ffff88012b551c00 x1830948733950208/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:306/0 lens 488/0 e 0 to 0 dl 1746129576 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129565.648348:0:8417:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b551c00 with x1830948733950208 ext(2097152->3145727) 00002000:00010000:0.0:1746129565.648354:0:8417:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b551c00 00000100:00100000:0.0:1746129565.648386:0:8417:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733950464 00000100:00100000:0.0:1746129565.648389:0:8417:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733950464 00002000:00100000:0.0:1746129565.648404:0:8417:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3f4:0x0] (2035712->2039807) req@ffff88012cda6680 x1830948733950464/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:306/0 lens 488/0 e 0 to 0 dl 1746129576 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129565.648411:0:8417:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cda6680 with x1830948733950464 ext(2035712->2039807) 00002000:00010000:0.0:1746129565.648414:0:8417:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012cda6680 00000100:00100000:0.0:1746129565.648427:0:8417:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7554 00000100:00100000:0.0:1746129565.648432:0:8417:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b551c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+11:1960:x1830948733950208:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129565.651227:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.651552:0:31519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733949952 00000100:00100000:0.0:1746129565.651561:0:31519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733949952 00002000:00100000:0.0:1746129565.651602:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->4194303) req@ffff8800a07ae680 x1830948733949952/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:306/0 lens 488/0 e 0 to 0 dl 1746129576 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129565.651611:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a07ae680 with x1830948733949952 ext(3145728->4194303) 00002000:00010000:0.0:1746129565.651616:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a07ae680 00000100:00100000:0.0:1746129565.651646:0:31519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7556 00000100:00100000:0.0:1746129565.651652:0:31519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a07ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ada2ffba-8920-4ecb-8068-68caa9806978+20:1962:x1830948733949952:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:0.0:1746129565.666524:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129565.667802:0:31519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a07ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ada2ffba-8920-4ecb-8068-68caa9806978+22:1962:x1830948733949952:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 16146us (16580us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129565.667811:0:31519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7556 00002000:00100000:1.0:1746129565.667821:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->4194303) req@ffff8800a07ae680 x1830948733949952/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:306/0 lens 488/440 e 0 to 0 dl 1746129576 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129565.667830:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a07ae680 with x1830948733949952 ext(3145728->4194303) 00002000:00010000:1.0:1746129565.667835:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a07ae680 00000100:00100000:0.0:1746129565.668504:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.669604:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.672529:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.672601:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129565.678885:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.678997:0:31519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733951360 00000100:00100000:0.0:1746129565.680541:0:31519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733951360 00002000:00100000:0.0:1746129565.680596:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3ee:0x0] (1175552->1179647) req@ffff88012cda7800 x1830948733951360/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:306/0 lens 488/0 e 0 to 0 dl 1746129576 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129565.680605:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cda7800 with x1830948733951360 ext(1175552->1179647) 00002000:00010000:0.0:1746129565.680611:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012cda7800 00000100:00100000:1.0:1746129565.680896:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.681167:0:31519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733951616 00000100:00100000:0.0:1746129565.681171:0:31519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733951616 00002000:00100000:0.0:1746129565.681186:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f5:0x0] (3145728->4194303) req@ffff88012cda7100 x1830948733951616/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:306/0 lens 488/0 e 0 to 0 dl 1746129576 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129565.681193:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cda7100 with x1830948733951616 ext(3145728->4194303) 00002000:00010000:0.0:1746129565.681196:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012cda7100 00000100:00100000:0.0:1746129565.681207:0:31519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7557 00000100:00100000:0.0:1746129565.681212:0:31519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cda7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ada2ffba-8920-4ecb-8068-68caa9806978+21:1962:x1830948733951360:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:0.0:1746129565.681431:0:31519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cda7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ada2ffba-8920-4ecb-8068-68caa9806978+21:1962:x1830948733951360:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 219us (2557us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746129565.681436:0:31519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7557 00002000:00100000:0.0:1746129565.681441:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3ee:0x0] (1175552->1179647) req@ffff88012cda7800 x1830948733951360/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:306/0 lens 488/4536 e 0 to 0 dl 1746129576 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129565.681452:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cda7800 with x1830948733951360 ext(1175552->1179647) 00002000:00010000:0.0:1746129565.681455:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012cda7800 00000100:00100000:0.0:1746129565.683570:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.683607:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.684076:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129565.684249:0:31520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733951872 00000100:00100000:1.0:1746129565.684257:0:31520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733951872 00000100:00100000:0.0:1746129565.686527:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00002000:00100000:1.0:1746129565.686892:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3f5:0x0] (2097152->3145727) req@ffff8800a07ac380 x1830948733951872/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:306/0 lens 488/0 e 0 to 0 dl 1746129576 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129565.686904:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a07ac380 with x1830948733951872 ext(2097152->3145727) 00002000:00010000:1.0:1746129565.686914:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a07ac380 00000100:00100000:1.0:1746129565.686942:0:31520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7561 00000100:00100000:1.0:1746129565.686952:0:31520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a07ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+10:1961:x1830948733951872:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129565.701581:0:31520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a07ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+10:1961:x1830948733951872:12345-192.168.202.4@tcp:3:cat.0 Request processed in 14621us (18007us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129565.701595:0:31520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7561 00002000:00100000:0.0:1746129565.701608:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3f5:0x0] (2097152->3145727) req@ffff8800a07ac380 x1830948733951872/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:306/0 lens 488/440 e 0 to 0 dl 1746129576 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129565.701618:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a07ac380 with x1830948733951872 ext(2097152->3145727) 00002000:00010000:0.0:1746129565.701624:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a07ac380 00000100:00100000:0.0:1746129565.706957:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.707550:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129565.707923:0:22480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15767 00000100:00100000:1.0:1746129565.707930:0:22480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a07aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ada2ffba-8920-4ecb-8068-68caa9806978+23:1960:x1830948733952896:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129565.707937:0:22480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129565.707951:0:22480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008ebb2800/0x40a459093b068d7a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f205ff expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129565.707978:0:22480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f37df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22480:1830948737448320:192.168.202.4@tcp:106: 00000100:00100000:1.0:1746129565.708645:0:22480:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c954900 going to sleep for 11 seconds 00000100:00100000:1.0:1746129565.710456:0:22480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f37df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22480:1830948737448320:192.168.202.4@tcp:106: 00010000:00010000:1.0:1746129565.710476:0:22480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008ebb2800/0x40a459093b068d7a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f205ff expref: 24 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129565.710485:0:22480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008ebb2800/0x40a459093b068d7a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f205ff expref: 24 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129565.710507:0:22480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ebb2800, rc 0) 00000100:00100000:1.0:1746129565.710536:0:22480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a07aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ada2ffba-8920-4ecb-8068-68caa9806978+23:1960:x1830948733952896:12345-192.168.202.4@tcp:101:cat.0 Request processed in 2607us (2986us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129565.710543:0:22480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15767 00000100:00100000:0.0:1746129565.716496:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.718725:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.718776:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.719517:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129565.719541:0:22480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733953280 00000100:00100000:1.0:1746129565.719549:0:22480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733953280 00000100:00100000:1.0:1746129565.719585:0:22480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733953536 00000100:00100000:1.0:1746129565.719588:0:22480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733953536 00000100:00100000:1.0:1746129565.719602:0:22480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15768 00000100:00100000:1.0:1746129565.719608:0:22480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f95a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+11:1960:x1830948733953280:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129565.719620:0:22480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129565.719636:0:22480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008ebb3c00/0x40a459093b068d81 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20606 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129565.719688:0:22480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f37df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22480:1830948737448448:192.168.202.4@tcp:106: 00000100:00100000:1.0:1746129565.719927:0:22480:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c954900 going to sleep for 11 seconds 00000100:00100000:0.0:1746129565.719999:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129565.721618:0:22480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f37df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22480:1830948737448448:192.168.202.4@tcp:106: 00010000:00010000:1.0:1746129565.721648:0:22480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008ebb3c00/0x40a459093b068d81 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20606 expref: 14 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129565.721660:0:22480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008ebb3c00/0x40a459093b068d81 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20606 expref: 14 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129565.721689:0:22480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ebb3c00, rc 0) 00000100:00100000:1.0:1746129565.721718:0:22480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f95a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+13:1960:x1830948733953280:12345-192.168.202.4@tcp:101:cat.0 Request processed in 2110us (2997us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129565.721726:0:22480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15768 00000100:00100000:0.0:1746129565.729622:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.734453:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129565.734784:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129565.735780:0:22480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15773 00000100:00100000:1.0:1746129565.735788:0:22480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f37df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ada2ffba-8920-4ecb-8068-68caa9806978+23:1961:x1830948733954176:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129565.735795:0:22480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129565.735805:0:22480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008ebb2400/0x40a459093b068da4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20629 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129565.735837:0:22480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f37f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22480:1830948737449088:192.168.202.4@tcp:106: 00000100:00100000:1.0:1746129565.735864:0:22480:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c954900 going to sleep for 11 seconds 00000100:00100000:1.0:1746129565.739662:0:22480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f37f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22480:1830948737449088:192.168.202.4@tcp:106: 00010000:00010000:1.0:1746129565.739681:0:22480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008ebb2400/0x40a459093b068da4 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20629 expref: 24 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129565.739690:0:22480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008ebb2400/0x40a459093b068da4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20629 expref: 24 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129565.740619:0:22480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ebb2400, rc 0) 00000100:00100000:1.0:1746129565.740641:0:22480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f37df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ada2ffba-8920-4ecb-8068-68caa9806978+23:1961:x1830948733954176:12345-192.168.202.4@tcp:101:cat.0 Request processed in 4854us (5857us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129565.740646:0:22480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15773 00000100:00100000:0.0:1746129565.744903:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.744943:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.744974:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.745002:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.745018:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.745042:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129565.745535:0:22480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15775 00000100:00100000:1.0:1746129565.745544:0:22480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009507d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ada2ffba-8920-4ecb-8068-68caa9806978+21:1961:x1830948733954304:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129565.745556:0:22480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129565.745567:0:22480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008ebb3600/0x40a459093b068db2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20630 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129565.745596:0:22480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f37f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22480:1830948737449344:192.168.202.4@tcp:106: 00000100:00100000:0.0:1746129565.745724:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15777 00000100:00100000:0.0:1746129565.745731:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009507c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+12:1961:x1830948733954560:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129565.745738:0:7148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129565.745744:0:7148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880137302600/0x40a459093b068dc0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2063e expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129565.745767:0:7148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e38a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7148:1830948737449600:192.168.202.4@tcp:106: 00000100:00100000:1.0:1746129565.746455:0:22480:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c954900 going to sleep for 11 seconds 00000100:00100000:0.0:1746129565.746580:0:7148:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a00180 going to sleep for 11 seconds 00000100:00100000:0.0:1746129565.746596:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15779 00000100:00100000:0.0:1746129565.746602:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e38aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+10:1961:x1830948733954816:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129565.746608:0:7149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129565.746616:0:7149:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012cd31a00/0x40a459093b068dce lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2064c expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129565.746639:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e389180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7149:1830948737449856:192.168.202.4@tcp:106: 00000100:00100000:0.0:1746129565.746657:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a00780 going to sleep for 11 seconds 00000100:00100000:0.0:1746129565.748571:0:7148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e38a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7148:1830948737449600:192.168.202.4@tcp:106: 00010000:00010000:0.0:1746129565.748600:0:7148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880137302600/0x40a459093b068dc0 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2063e expref: 14 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129565.748612:0:7148:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880137302600/0x40a459093b068dc0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2063e expref: 14 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129565.748632:0:7148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880137302600, rc 0) 00000100:00100000:0.0:1746129565.748659:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009507c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+13:1961:x1830948733954560:12345-192.168.202.4@tcp:101:cat.0 Request processed in 2929us (3656us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129565.748667:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15777 00000100:00100000:0.0:1746129565.748736:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e389180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7149:1830948737449856:192.168.202.4@tcp:106: 00010000:00010000:0.0:1746129565.748755:0:7149:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012cd31a00/0x40a459093b068dce lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2064c expref: 11 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129565.748763:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012cd31a00/0x40a459093b068dce lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2064c expref: 11 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129565.748771:0:7149:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cd31a00, rc 0) 00000100:00100000:0.0:1746129565.748786:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e38aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+10:1961:x1830948733954816:12345-192.168.202.4@tcp:101:cat.0 Request processed in 2185us (3744us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129565.748791:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15779 00000100:00100000:1.0:1746129565.750680:0:22480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f37f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22480:1830948737449344:192.168.202.4@tcp:106: 00010000:00010000:1.0:1746129565.750708:0:22480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008ebb3600/0x40a459093b068db2 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20630 expref: 22 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129565.750722:0:22480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008ebb3600/0x40a459093b068db2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20630 expref: 22 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129565.750740:0:22480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ebb3600, rc 0) 00000100:00100000:1.0:1746129565.750783:0:22480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009507d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ada2ffba-8920-4ecb-8068-68caa9806978+21:1961:x1830948733954304:12345-192.168.202.4@tcp:101:cat.0 Request processed in 5240us (5839us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129565.750790:0:22480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15775 00000100:00100000:0.0:1746129565.755486:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.758908:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.758942:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.758967:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.759003:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.764753:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.769096:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129565.773235:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8063 00000100:00100000:1.0:1746129565.773241:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095624a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+9:1963:x1830948733956352:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129565.773248:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129565.773270:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012cd7e200/0x40a459093b068d65 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f205ea expref: 9 pid: 31503 timeout: 921 lvb_type: 0 00010000:00010000:1.0:1746129565.773279:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012cd7e200/0x40a459093b068d65 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f205ea expref: 9 pid: 31503 timeout: 921 lvb_type: 0 00010000:00010000:1.0:1746129565.773493:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012cd7e200/0x40a459093b068d65 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f205ea expref: 9 pid: 31503 timeout: 921 lvb_type: 0 00010000:00010000:1.0:1746129565.773828:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129565.773878:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095624a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+8:1963:x1830948733956352:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 636us (919us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129565.773884:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8063 00000100:00100000:0.0:1746129565.775867:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.780683:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.784432:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.785852:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.793642:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.799431:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129565.799542:0:14551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733957504 00000100:00100000:1.0:1746129565.799554:0:14551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733957504 00000100:00100000:1.0:1746129565.799671:0:14551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4703 00000100:00100000:1.0:1746129565.799679:0:14551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+13:32089:x1830948733957504:12345-192.168.202.4@tcp:35:multiop.0 00000100:00100000:1.0:1746129565.799915:0:14551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+14:32089:x1830948733957504:12345-192.168.202.4@tcp:35:multiop.0 Request processed in 235us (495us total) trans 8589945202 rc 0/0 00000100:00100000:1.0:1746129565.799923:0:14551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4703 00000100:00100000:0.0:1746129565.819020:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129565.819194:0:2271:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733957760 00000100:00100000:1.0:1746129565.819205:0:2271:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733957760 00000100:00100000:0.0:1746129565.883391:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129565.883711:0:2271:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733958016 00000100:00100000:1.0:1746129565.883722:0:2271:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733958016 00000100:00100000:1.0:1746129565.883791:0:2271:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11133 00000100:00100000:1.0:1746129565.883800:0:2271:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ada2ffba-8920-4ecb-8068-68caa9806978+295:32099:x1830948733958016:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129565.883827:0:2271:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746129565.884093:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00010000:00010000:1.0:1746129565.884349:0:2271:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ebb2a00/0x40a459093b068e22 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2068b expref: -99 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129565.884465:0:2271:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ebb3000/0x40a459093b068e29 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 2271 initiator: MDT0 00010000:00010000:1.0:1746129565.884480:0:2271:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ebb3000/0x40a459093b068e29 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:1.0:1746129565.884491:0:2271:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ebb3000/0x40a459093b068e29 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00000004:00200000:1.0:1746129565.884502:0:2271:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:1.0:1746129565.884616:0:2271:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ebb2a00/0x40a459093b068e22 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2068b expref: 298 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129565.884645:0:2271:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ebb3000/0x40a459093b068e29 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2068b expref: 297 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129565.884654:0:2271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009f469400) 00010000:00010000:1.0:1746129565.884657:0:2271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1746129565.884660:0:2271:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ebb3000, rc 0) 00000100:00100000:1.0:1746129565.884712:0:2271:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ada2ffba-8920-4ecb-8068-68caa9806978+297:32099:x1830948733958016:12345-192.168.202.4@tcp:101:cat.0 Request processed in 913us (1355us total) trans 8589945204 rc 0/0 00000100:00100000:1.0:1746129565.884719:0:2271:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11133 00000100:00100000:0.0:1746129565.887547:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.887645:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.887768:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.887783:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.887804:0:22481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733958272 00000100:00100000:0.0:1746129565.887811:0:22481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733958272 00000100:00100000:0.0:1746129565.887845:0:22481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733958400 00000100:00100000:0.0:1746129565.887847:0:22481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733958400 00000100:00100000:0.0:1746129565.887857:0:22481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733958528 00000100:00100000:0.0:1746129565.887858:0:22481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733958528 00000100:00100000:0.0:1746129565.887867:0:22481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733958656 00000100:00100000:0.0:1746129565.887868:0:22481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733958656 00000100:00100000:0.0:1746129565.887880:0:22481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15787 00000100:00100000:0.0:1746129565.887887:0:22481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ada2ffba-8920-4ecb-8068-68caa9806978+23:1962:x1830948733958272:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129565.887905:0:22481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129565.887923:0:22481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012cd30800/0x40a459093b068e3e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20699 expref: -99 pid: 22481 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129565.887979:0:22481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136015180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:22481:1830948737451392:192.168.202.4@tcp:106: 00000100:00100000:0.0:1746129565.888057:0:22481:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a00780 going to sleep for 11 seconds 00000100:00100000:0.0:1746129565.888079:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15788 00000100:00100000:0.0:1746129565.888085:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ada2ffba-8920-4ecb-8068-68caa9806978+23:1963:x1830948733958400:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129565.888096:0:7148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129565.888107:0:7148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012cd30000/0x40a459093b068e45 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f206a0 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129565.888132:0:7148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136014a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:7148:1830948737451520:192.168.202.4@tcp:106: 00000100:00100000:0.0:1746129565.888153:0:7148:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a00180 going to sleep for 11 seconds 00000100:00100000:0.0:1746129565.888168:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15789 00000100:00100000:0.0:1746129565.888173:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ada2ffba-8920-4ecb-8068-68caa9806978+24:1962:x1830948733958528:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129565.888179:0:7149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129565.888186:0:7149:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012cd31000/0x40a459093b068e4c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f206a7 expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129565.888208:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136014000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7149:1830948737451648:192.168.202.4@tcp:106: 00000100:00100000:0.0:1746129565.888227:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a00600 going to sleep for 11 seconds 00000100:00100000:0.0:1746129565.888243:0:8411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15790 00000100:00100000:0.0:1746129565.888248:0:8411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ada2ffba-8920-4ecb-8068-68caa9806978+24:1963:x1830948733958656:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129565.888254:0:8411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129565.888261:0:8411:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012cd30a00/0x40a459093b068e53 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f206ae expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129565.888284:0:8411:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136015500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8411:1830948737451776:192.168.202.4@tcp:106: 00000100:00100000:0.0:1746129565.888335:0:8411:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a003c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129565.888525:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.888565:0:21463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733958784 00000100:00100000:0.0:1746129565.888568:0:21463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733958784 00002000:00100000:0.0:1746129565.888598:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->3698687) req@ffff880136016680 x1830948733958784/t0(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:306/0 lens 488/0 e 0 to 0 dl 1746129576 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129565.888607:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136016680 with x1830948733958784 ext(3145728->3698687) 00010000:00010000:0.0:1746129565.888613:0:21463:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094422000/0x40a459093b068df8 lrc: 6/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3698687) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2067d expref: 11 pid: 20577 timeout: 921 lvb_type: 0 00010000:00010000:0.0:1746129565.888626:0:21463:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094422000/0x40a459093b068df8 lrc: 6/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3698687) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2067d expref: 11 pid: 20577 timeout: 921 lvb_type: 0 00002000:00010000:0.0:1746129565.888632:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880136016680 00000100:00100000:0.0:1746129565.888646:0:21463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2368 00000100:00100000:0.0:1746129565.888651:0:21463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136016680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+11:1963:x1830948733958784:12345-192.168.202.4@tcp:4:multiop.0 00000100:00100000:0.0:1746129565.889121:0:20577:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095627b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20577:1830948737451264:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129565.889142:0:20577:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a6ef4200/0x40a459093b068e37 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [2789376->3145727] (req 2789376->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20692 expref: 25 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129565.889153:0:20577:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6ef4200, rc 0) 00000100:00100000:0.0:1746129565.889169:0:20577:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ada2ffba-8920-4ecb-8068-68caa9806978+25:32096:x1830948733958144:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 4250us (5077us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129565.889174:0:20577:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15786 00000100:00100000:1.0:1746129565.895014:0:2271:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733959040 00000100:00100000:1.0:1746129565.895023:0:2271:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733959040 00000100:00100000:1.0:1746129565.896906:0:2271:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11134 00000100:00100000:1.0:1746129565.896920:0:2271:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095625c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+14:32102:x1830948733959040:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129565.896944:0:2271:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129565.896963:0:2271:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ebb2400/0x40a459093b068e5a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f206b5 expref: -99 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129565.897077:0:2271:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ebb2000/0x40a459093b068e61 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 2271 initiator: MDT0 00010000:00010000:1.0:1746129565.897089:0:2271:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ebb2000/0x40a459093b068e61 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:1.0:1746129565.897101:0:2271:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ebb2000/0x40a459093b068e61 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00010000:00010000:1.0:1746129565.897113:0:2271:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ebb3600/0x40a459093b068e68 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 2271 initiator: MDT0 00010000:00010000:1.0:1746129565.897118:0:2271:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ebb3600/0x40a459093b068e68 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:1.0:1746129565.897124:0:2271:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ebb3600/0x40a459093b068e68 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00010000:00010000:1.0:1746129565.897242:0:2271:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ebb3a00/0x40a459093b068e6f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 2271 initiator: MDT0 00010000:00010000:1.0:1746129565.897250:0:2271:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ebb3a00/0x40a459093b068e6f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:1.0:1746129565.897256:0:2271:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ebb3a00/0x40a459093b068e6f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00000004:00200000:1.0:1746129565.897266:0:2271:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:1.0:1746129565.897390:0:2271:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ebb2000/0x40a459093b068e61 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:1.0:1746129565.897397:0:2271:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ebb2000/0x40a459093b068e61 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 2271 initiator: MDT0 00010000:00010000:1.0:1746129565.897402:0:2271:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008ebb2000/0x40a459093b068e61 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 2271 initiator: MDT0 00010000:00010000:1.0:1746129565.897407:0:2271:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008ebb2000 already unused, calling callback (ffffffffa136e690) 00010000:00010000:1.0:1746129565.897411:0:2271:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ebb2000/0x40a459093b068e61 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 2271 initiator: MDT0 00010000:00010000:1.0:1746129565.897417:0:2271:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ebb2000/0x40a459093b068e61 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 2271 initiator: MDT0 00010000:00010000:1.0:1746129565.897428:0:2271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880132ef8f00) 00010000:00010000:1.0:1746129565.897431:0:2271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129565.897435:0:2271:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008ebb2000/0x40a459093b068e61 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 2271 initiator: MDT0 00010000:00010000:1.0:1746129565.897439:0:2271:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ebb2000/0x40a459093b068e61 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 2271 initiator: MDT0 00010000:00010000:1.0:1746129565.897458:0:2271:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ebb3600/0x40a459093b068e68 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:1.0:1746129565.897463:0:2271:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ebb3600/0x40a459093b068e68 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 2271 initiator: MDT0 00010000:00010000:1.0:1746129565.897467:0:2271:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008ebb3600/0x40a459093b068e68 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 2271 initiator: MDT0 00010000:00010000:1.0:1746129565.897472:0:2271:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008ebb3600 already unused, calling callback (ffffffffa136e690) 00010000:00010000:1.0:1746129565.897474:0:2271:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ebb3600/0x40a459093b068e68 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 2271 initiator: MDT0 00010000:00010000:1.0:1746129565.897479:0:2271:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ebb3600/0x40a459093b068e68 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 2271 initiator: MDT0 00010000:00010000:1.0:1746129565.897484:0:2271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009cffe100) 00010000:00010000:1.0:1746129565.897486:0:2271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129565.897488:0:2271:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008ebb3600/0x40a459093b068e68 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 2271 initiator: MDT0 00010000:00010000:1.0:1746129565.897492:0:2271:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ebb3600/0x40a459093b068e68 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 2271 initiator: MDT0 00010000:00010000:1.0:1746129565.897525:0:2271:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ebb2400/0x40a459093b068e5a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f206b5 expref: 17 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129565.897536:0:2271:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ebb3a00/0x40a459093b068e6f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f206b5 expref: 16 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129565.897542:0:2271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009f469400) 00010000:00010000:1.0:1746129565.897545:0:2271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746129565.897547:0:2271:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ebb3a00, rc 0) 00000100:00100000:1.0:1746129565.897601:0:2271:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095625c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+16:32102:x1830948733959040:12345-192.168.202.4@tcp:101:cat.0 Request processed in 686us (2718us total) trans 8589945205 rc 0/0 00000100:00100000:1.0:1746129565.897607:0:2271:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11134 00000100:00100000:0.0:1746129565.897901:0:7148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136014a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:7148:1830948737451520:192.168.202.4@tcp:106: 00010000:00010000:0.0:1746129565.897931:0:7148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012cd30000/0x40a459093b068e45 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f206a0 expref: 25 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129565.897941:0:7148:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012cd30000/0x40a459093b068e45 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f206a0 expref: 25 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129565.897953:0:7148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cd30000, rc 0) 00000100:00100000:0.0:1746129565.897973:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ada2ffba-8920-4ecb-8068-68caa9806978+24:1963:x1830948733958400:12345-192.168.202.4@tcp:101:cat.0 Request processed in 9889us (10328us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129565.897980:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15788 00002000:00010000:0.0:1746129565.898017:0:7149:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb mtime: 1746129565 -> 1746129566 00002000:00010000:0.0:1746129565.898020:0:7149:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb atime: 1746129565 -> 1746129566 00000100:00100000:0.0:1746129565.898031:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136014000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7149:1830948737451648:192.168.202.4@tcp:106: 00010000:00010000:0.0:1746129565.898046:0:7149:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012cd31000/0x40a459093b068e4c lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f206a7 expref: 22 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129565.898055:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012cd31000/0x40a459093b068e4c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f206a7 expref: 22 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129565.898069:0:7149:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cd31000, rc 0) 00000100:00100000:0.0:1746129565.898092:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ada2ffba-8920-4ecb-8068-68caa9806978+21:1962:x1830948733958528:12345-192.168.202.4@tcp:101:cat.0 Request processed in 9918us (10323us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129565.898097:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15789 00000100:00100000:1.0:1746129565.903894:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129565.904622:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129565.904857:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129565.904992:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129565.905422:0:8412:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733959552 00000100:00100000:1.0:1746129565.905426:0:8412:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733959552 00000100:00100000:1.0:1746129565.905445:0:8412:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15793 00000100:00100000:1.0:1746129565.905450:0:8412:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f37d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+9:1963:x1830948733959424:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129565.905455:0:8412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129565.905467:0:8412:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008ebb2200/0x40a459093b068e84 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f206ca expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129565.905493:0:8412:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f37e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8412:1830948737452032:192.168.202.4@tcp:106: 00000100:00100000:0.0:1746129565.905675:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15794 00000100:00100000:0.0:1746129565.905687:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f37c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+15:1963:x1830948733959552:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129565.905698:0:7149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129565.905709:0:7149:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880132f99400/0x40a459093b068e92 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f206d1 expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129565.905762:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136014000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7149:1830948737452288:192.168.202.4@tcp:106: 00000100:00100000:1.0:1746129565.905895:0:8412:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c954900 going to sleep for 11 seconds 00000100:00100000:1.0:1746129565.905944:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.906094:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a00600 going to sleep for 11 seconds 00000100:00100000:1.0:1746129565.908101:0:20577:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733959808 00000100:00100000:1.0:1746129565.908106:0:20577:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733959808 00000100:00100000:1.0:1746129565.908130:0:20577:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15796 00000100:00100000:1.0:1746129565.908135:0:20577:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ada2ffba-8920-4ecb-8068-68caa9806978+21:32099:x1830948733959808:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129565.908143:0:20577:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129565.908153:0:20577:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008ebb2400/0x40a459093b068ea0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f206df expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129565.908178:0:20577:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f850600/0x40a459093b068c85 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20542 expref: 11 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129565.908184:0:20577:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129565.908186:0:20577:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129565.908189:0:20577:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008ebb2400/0x40a459093b068ea0 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f206df expref: 22 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129565.908211:0:20577:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f850600/0x40a459093b068c85 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20542 expref: 11 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129565.908221:0:20577:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f850600/0x40a459093b068c85 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20542 expref: 11 pid: 4385 timeout: 921 lvb_type: 0 00000100:00100000:1.0:1746129565.908232:0:20577:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fbaf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20577:1830948737452544:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129565.908262:0:20577:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c954000 going to sleep for 11 seconds 00000100:00100000:0.0:1746129565.908342:0:8412:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f37e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8412:1830948737452032:192.168.202.4@tcp:106: 00010000:00010000:0.0:1746129565.908373:0:8412:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008ebb2200/0x40a459093b068e84 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f206ca expref: 11 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129565.908383:0:8412:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008ebb2200/0x40a459093b068e84 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f206ca expref: 11 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129565.908393:0:8412:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ebb2200, rc 0) 00000100:00100000:0.0:1746129565.908414:0:8412:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f37d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+9:1963:x1830948733959424:12345-192.168.202.4@tcp:101:cat.0 Request processed in 2964us (3558us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129565.908419:0:8412:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15793 00000100:00100000:0.0:1746129565.909743:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136014000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7149:1830948737452288:192.168.202.4@tcp:106: 00010000:00010000:0.0:1746129565.909761:0:7149:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880132f99400/0x40a459093b068e92 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f206d1 expref: 16 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129565.909770:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880132f99400/0x40a459093b068e92 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f206d1 expref: 16 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129565.909778:0:7149:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132f99400, rc 0) 00000100:00100000:0.0:1746129565.909812:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f37c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+15:1963:x1830948733959552:12345-192.168.202.4@tcp:101:cat.0 Request processed in 4128us (4819us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129565.909818:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15794 00000100:00100000:0.0:1746129565.910429:0:20577:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fbaf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20577:1830948737452544:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129565.910445:0:20577:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008ebb2400/0x40a459093b068ea0 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f206df expref: 22 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129565.910456:0:20577:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ebb2400, rc 0) 00000100:00100000:0.0:1746129565.910473:0:20577:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ada2ffba-8920-4ecb-8068-68caa9806978+22:32099:x1830948733959808:12345-192.168.202.4@tcp:101:cat.0 Request processed in 2339us (2487us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129565.910479:0:20577:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15796 00000100:00100000:0.0:1746129565.911821:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733959936 00000100:00100000:0.0:1746129565.911828:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733959936 00010000:00010000:0.0:1746129565.911857:0:9823:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094422000/0x40a459093b068df8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3698687) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2067d expref: 13 pid: 20577 timeout: 921 lvb_type: 0 00000100:00100000:0.0:1746129565.911887:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733960064 00000100:00100000:0.0:1746129565.911890:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733960064 00010000:00010000:0.0:1746129565.911900:0:9823:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f850600/0x40a459093b068c85 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20542 expref: 12 pid: 4385 timeout: 921 lvb_type: 0 00000100:00100000:0.0:1746129565.911922:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8067 00000100:00100000:0.0:1746129565.911926:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7da300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:068dab75-d300-4ead-a742-d14572ad1e50+12:1962:x1830948733960064:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129565.911932:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129565.911946:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f850600/0x40a459093b068c85 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20542 expref: 12 pid: 4385 timeout: 921 lvb_type: 0 00010000:00010000:0.0:1746129565.911957:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f850600/0x40a459093b068c85 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20542 expref: 12 pid: 4385 timeout: 921 lvb_type: 0 00010000:00010000:0.0:1746129565.911974:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f850600/0x40a459093b068c85 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20542 expref: 12 pid: 4385 timeout: 921 lvb_type: 0 00010000:00010000:0.0:1746129565.911987:0:9823:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129565.911988:0:9823:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129565.911993:0:9823:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008ebb2400/0x40a459093b068ea0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f206df expref: 21 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129565.912000:0:9823:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008ebb2400/0x40a459093b068ea0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f206df expref: 21 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129565.912027:0:9823:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008ebb2400/0x40a459093b068ea0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f206df expref: 21 pid: 20577 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129565.912037:0:9823:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136014000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9823:1830948737452800:192.168.202.4@tcp:105: 00000100:00100000:1.0:1746129565.913235:0:9823:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a00600 going to sleep for 11 seconds 00000100:00100000:0.0:1746129565.914580:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.919096:0:15749:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095624380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15749:1830948737452672:192.168.202.4@tcp:105: 00010000:00010000:0.0:1746129565.919122:0:15749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129565.919174:0:15749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7d9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+13:1962:x1830948733959936:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 7252us (7379us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129565.919183:0:15749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8066 00000100:00100000:1.0:1746129565.919283:0:9823:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136014000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9823:1830948737452800:192.168.202.4@tcp:105: 00010000:00010000:1.0:1746129565.919326:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129565.919344:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7da300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:068dab75-d300-4ead-a742-d14572ad1e50+11:1962:x1830948733960064:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 7416us (7517us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129565.919351:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8067 00000100:00100000:1.0:1746129565.921408:0:31520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7566 00000100:00100000:1.0:1746129565.921417:0:31520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ada2ffba-8920-4ecb-8068-68caa9806978+23:1963:x1830948733960448:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:1.0:1746129565.921588:0:31520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ada2ffba-8920-4ecb-8068-68caa9806978+23:1963:x1830948733960448:12345-192.168.202.4@tcp:3:cat.0 Request processed in 172us (394us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746129565.921596:0:31520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7566 00002000:00100000:1.0:1746129565.921600:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3ef:0x0] (2789376->2793471) req@ffff88009c7d8000 x1830948733960448/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:306/0 lens 488/4536 e 0 to 0 dl 1746129576 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129565.921606:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7d8000 with x1830948733960448 ext(2789376->2793471) 00002000:00010000:1.0:1746129565.921608:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c7d8000 00000100:00100000:0.0:1746129565.921974:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129565.922160:0:21725:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733960960 00000100:00100000:1.0:1746129565.922163:0:21725:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733960960 00002000:00100000:1.0:1746129565.922181:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ec:0x0] (0->1048575) req@ffff880136014e00 x1830948733960960/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:306/0 lens 488/0 e 0 to 0 dl 1746129576 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129565.922188:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136014e00 with x1830948733960960 ext(0->1048575) 00002000:00010000:1.0:1746129565.922191:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136014e00 00000100:00100000:1.0:1746129565.922203:0:21725:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7568 00000100:00100000:1.0:1746129565.922207:0:21725:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136014e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+13:1960:x1830948733960960:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129565.932962:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.944178:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129565.945026:0:21725:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136014e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+13:1960:x1830948733960960:12345-192.168.202.4@tcp:3:cat.0 Request processed in 22815us (23049us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129565.945037:0:21725:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7568 00002000:00100000:1.0:1746129565.945046:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ec:0x0] (0->1048575) req@ffff880136014e00 x1830948733960960/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:306/0 lens 488/440 e 0 to 0 dl 1746129576 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129565.945056:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136014e00 with x1830948733960960 ext(0->1048575) 00002000:00010000:1.0:1746129565.945060:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136014e00 00000100:00100000:1.0:1746129565.945079:0:21725:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733961216 00000100:00100000:1.0:1746129565.945085:0:21725:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733961216 00002000:00100000:1.0:1746129565.945114:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f5:0x0] (2707456->3145727) req@ffff880136017800 x1830948733961216/t0(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:306/0 lens 488/0 e 0 to 0 dl 1746129576 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129565.945126:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136017800 with x1830948733961216 ext(2707456->3145727) 00010000:00010000:1.0:1746129565.945132:0:21725:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009c669000/0x40a459093b068df1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2707456->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20676 expref: 8 pid: 20577 timeout: 921 lvb_type: 0 00010000:00010000:1.0:1746129565.945144:0:21725:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009c669000/0x40a459093b068df1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2707456->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20676 expref: 8 pid: 20577 timeout: 921 lvb_type: 0 00002000:00010000:1.0:1746129565.945151:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880136017800 00000100:00100000:1.0:1746129565.945168:0:21725:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2369 00000100:00100000:1.0:1746129565.945175:0:21725:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136017800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+8:1962:x1830948733961216:12345-192.168.202.4@tcp:4:cat.0 00000100:00100000:0.0:1746129565.955333:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.957754:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129565.958053:0:11014:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733961472 00000100:00100000:1.0:1746129565.958060:0:11014:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733961472 00000100:00100000:1.0:1746129565.958102:0:11014:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15800 00000100:00100000:1.0:1746129565.958109:0:11014:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136016a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ada2ffba-8920-4ecb-8068-68caa9806978+23:32099:x1830948733961472:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129565.958121:0:11014:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129565.958133:0:11014:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008ebb2800/0x40a459093b068ebc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f206fb expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129565.958202:0:11014:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129565.958207:0:11014:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008ebb2800/0x40a459093b068ebc lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f206fb expref: 24 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129565.958216:0:11014:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008ebb2800/0x40a459093b068ebc lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f206fb expref: 24 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129565.958230:0:11014:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ebb2800, rc 0) 00000100:00100000:1.0:1746129565.958666:0:11014:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136016a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ada2ffba-8920-4ecb-8068-68caa9806978+24:32099:x1830948733961472:12345-192.168.202.4@tcp:101:cat.0 Request processed in 556us (913us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129565.958673:0:11014:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15800 00000100:00100000:0.0:1746129565.964563:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129565.964663:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733961600 00000100:00100000:1.0:1746129565.964673:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733961600 00010000:00010000:1.0:1746129565.964710:0:9823:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012e0fd800/0x40a459093b068c9a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20557 expref: 12 pid: 4385 timeout: 921 lvb_type: 0 00000100:00100000:1.0:1746129565.964738:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8068 00000100:00100000:1.0:1746129565.964745:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6fd1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:068dab75-d300-4ead-a742-d14572ad1e50+12:1962:x1830948733961600:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129565.964758:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129565.964782:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012e0fd800/0x40a459093b068c9a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20557 expref: 12 pid: 4385 timeout: 921 lvb_type: 0 00010000:00010000:1.0:1746129565.964793:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012e0fd800/0x40a459093b068c9a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20557 expref: 12 pid: 4385 timeout: 921 lvb_type: 0 00010000:00010000:1.0:1746129565.964816:0:9823:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129565.964818:0:9823:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129565.964825:0:9823:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091b4f200/0x40a459093b068eb5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f206f4 expref: 11 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129565.964834:0:9823:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091b4f200/0x40a459093b068eb5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f206f4 expref: 11 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129565.964847:0:9823:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129565.964848:0:9823:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129565.964852:0:9823:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008ebb2800/0x40a459093b068ebc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f206fb expref: 23 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129565.964857:0:9823:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008ebb2800/0x40a459093b068ebc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f206fb expref: 23 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129565.964889:0:9823:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008ebb2800/0x40a459093b068ebc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f206fb expref: 23 pid: 11014 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129565.964902:0:9823:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fbad180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9823:1830948737453184:192.168.202.4@tcp:105: 00010000:00010000:1.0:1746129565.965001:0:9823:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091b4f200/0x40a459093b068eb5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f206f4 expref: 11 pid: 20577 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129565.965009:0:9823:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fbac700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9823:1830948737453312:192.168.202.4@tcp:105: 00000100:00100000:1.0:1746129565.965026:0:9823:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c954000 going to sleep for 11 seconds 00000100:00100000:1.0:1746129565.966095:0:9823:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fbad180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9823:1830948737453184:192.168.202.4@tcp:105: 00000100:00100000:1.0:1746129565.966104:0:9823:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fbac700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9823:1830948737453312:192.168.202.4@tcp:105: 00010000:00010000:1.0:1746129565.966121:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129565.966148:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6fd1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:068dab75-d300-4ead-a742-d14572ad1e50+12:1962:x1830948733961600:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 1403us (1595us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129565.966155:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8068 00000100:00100000:0.0:1746129565.973539:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.973563:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.973590:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.973628:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129565.975891:0:31520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7571 00000100:00100000:1.0:1746129565.975904:0:31520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136015180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ada2ffba-8920-4ecb-8068-68caa9806978+22:1962:x1830948733962368:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:1.0:1746129565.976014:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733962496 00000100:00100000:1.0:1746129565.976020:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733962496 00010000:00010000:1.0:1746129565.976047:0:9823:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c669000/0x40a459093b068df1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2707456->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20676 expref: 11 pid: 20577 timeout: 921 lvb_type: 0 00000100:00100000:1.0:1746129565.976074:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8069 00000100:00100000:1.0:1746129565.976078:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f37e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+11:1962:x1830948733962496:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129565.976087:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129565.976104:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c669000/0x40a459093b068df1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2707456->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20676 expref: 11 pid: 20577 timeout: 921 lvb_type: 0 00010000:00010000:1.0:1746129565.976115:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c669000/0x40a459093b068df1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2707456->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20676 expref: 11 pid: 20577 timeout: 921 lvb_type: 0 00010000:00010000:1.0:1746129565.976139:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c669000/0x40a459093b068df1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2707456->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20676 expref: 11 pid: 20577 timeout: 921 lvb_type: 0 00010000:00010000:1.0:1746129565.976159:0:9823:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129565.976161:0:9823:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129565.976169:0:9823:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012cc0bc00/0x40a459093b068eae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2412543) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f206ed expref: 26 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129565.976176:0:9823:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012cc0bc00/0x40a459093b068eae lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2412543) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f206ed expref: 26 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129565.976209:0:9823:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012cc0bc00/0x40a459093b068eae lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2412543) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f206ed expref: 26 pid: 20577 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129565.976221:0:9823:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fbac700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9823:1830948737453440:192.168.202.4@tcp:105: 00000100:00100000:1.0:1746129565.976311:0:9823:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c954900 going to sleep for 11 seconds 00000100:00100000:1.0:1746129565.980184:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.987461:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129565.995694:0:31520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136015180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ada2ffba-8920-4ecb-8068-68caa9806978+22:1962:x1830948733962368:12345-192.168.202.4@tcp:3:cat.0 Request processed in 19780us (22089us total) trans 0 rc 917504/917504 00000100:00100000:0.0:1746129565.995707:0:31520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7571 00002000:00100000:0.0:1746129565.995720:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3ee:0x0] (1179648->2097151) req@ffff880136015180 x1830948733962368/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:306/0 lens 488/440 e 0 to 0 dl 1746129576 ref 1 fl Complete:/200/0 rc 917504/917504 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129565.995729:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136015180 with x1830948733962368 ext(1179648->2097151) 00002000:00010000:0.0:1746129565.995735:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136015180 00000100:00100000:1.0:1746129566.005232:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129566.005313:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00080000:1.0:1746129566.006061:0:7097:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746129566.010463:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129566.017088:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129566.017132:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129566.017162:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129566.017186:0:31520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733963776 00000100:00100000:0.0:1746129566.017195:0:31520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733963776 00002000:00100000:0.0:1746129566.017236:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3ef:0x0] (2097152->3502079) req@ffff88008f44aa00 x1830948733963776/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:307/0 lens 504/0 e 0 to 0 dl 1746129577 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129566.017246:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f44aa00 with x1830948733963776 ext(2097152->3502079) 00002000:00010000:0.0:1746129566.017251:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f44aa00 00000100:00100000:0.0:1746129566.017364:0:31520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7574 00000100:00100000:0.0:1746129566.017372:0:31520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f44ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ada2ffba-8920-4ecb-8068-68caa9806978+23:1962:x1830948733964032:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129566.018314:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129566.032226:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129566.035209:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129566.035320:0:2271:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733964928 00000100:00100000:1.0:1746129566.035328:0:2271:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733964928 00000100:00100000:1.0:1746129566.035399:0:2271:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11135 00000100:00100000:1.0:1746129566.035406:0:2271:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f448000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+16:32105:x1830948733964928:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:1.0:1746129566.035428:0:2271:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129566.035445:0:2271:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c47d000/0x40a459093b068eca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20709 expref: -99 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129566.035538:0:2271:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c460000/0x40a459093b068ed1 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 2271 initiator: MDT0 00010000:00010000:1.0:1746129566.035551:0:2271:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009584e800/0x40a459093b068c07 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f204c4 expref: 17 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129566.035557:0:2271:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a77f7600/0x40a459093b068e14 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20684 expref: 297 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129566.035562:0:2271:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ebb3a00/0x40a459093b068e6f lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f206b5 expref: 17 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129566.035568:0:2271:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c460000/0x40a459093b068ed1 lrc: 6/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:1.0:1746129566.035592:0:2271:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008ebb3a00/0x40a459093b068e6f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f206b5 expref: 17 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129566.035602:0:2271:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ebb3a00/0x40a459093b068e6f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f206b5 expref: 17 pid: 2271 timeout: 921 lvb_type: 0 00000100:00100000:1.0:1746129566.035610:0:2271:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fbaf480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:2271:1830948737453824:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129566.035673:0:2271:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a77f7600/0x40a459093b068e14 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20684 expref: 297 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129566.035681:0:2271:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a77f7600/0x40a459093b068e14 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20684 expref: 297 pid: 14549 timeout: 921 lvb_type: 0 00000100:00100000:1.0:1746129566.035689:0:2271:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fbae680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:2271:1830948737453952:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129566.035720:0:2271:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009584e800/0x40a459093b068c07 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f204c4 expref: 17 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129566.035727:0:2271:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009584e800/0x40a459093b068c07 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f204c4 expref: 17 pid: 2271 timeout: 921 lvb_type: 0 00000100:00100000:1.0:1746129566.035733:0:2271:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fbac700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:2271:1830948737454080:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129566.035747:0:2271:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c954cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746129566.040782:0:2271:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fbaf480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:2271:1830948737453824:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129566.045175:0:15749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8073 00000100:00100000:1.0:1746129566.045182:0:15749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095627100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+19:1962:x1830948733965440:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129566.045191:0:15749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129566.045195:0:15749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009584e800/0x40a459093b068c07 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f204c4 expref: 19 pid: 2271 timeout: 921 lvb_type: 0 00000100:00100000:0.0:1746129566.045621:0:31521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f44b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ada2ffba-8920-4ecb-8068-68caa9806978+27:1962:x1830948733964288:12345-192.168.202.4@tcp:3:cat.0 Request processed in 26493us (28456us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129566.045629:0:31521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7576 00002000:00100000:0.0:1746129566.045637:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f5:0x0] (2412544->3461119) req@ffff88008f44b480 x1830948733964288/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:307/0 lens 488/440 e 0 to 0 dl 1746129577 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129566.045646:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f44b480 with x1830948733964288 ext(2412544->3461119) 00002000:00010000:0.0:1746129566.045650:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f44b480 00000100:00100000:0.0:1746129566.045911:0:31518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f448700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ada2ffba-8920-4ecb-8068-68caa9806978+25:1962:x1830948733964544:12345-192.168.202.4@tcp:3:cat.0 Request processed in 26723us (27621us total) trans 0 rc 733184/733184 00000100:00100000:0.0:1746129566.045916:0:31518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7577 00002000:00100000:0.0:1746129566.045920:0:31518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3f5:0x0] (3461120->4194303) req@ffff88008f448700 x1830948733964544/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:307/0 lens 488/440 e 0 to 0 dl 1746129577 ref 1 fl Complete:/200/0 rc 733184/733184 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129566.045927:0:31518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f448700 with x1830948733964544 ext(3461120->4194303) 00002000:00010000:0.0:1746129566.045929:0:31518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f448700 00000100:00100000:0.0:1746129566.048043:0:31522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f44aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ada2ffba-8920-4ecb-8068-68caa9806978+22:1962:x1830948733963776:12345-192.168.202.4@tcp:3:cat.0 Request processed in 28957us (30953us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129566.048053:0:31522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7575 00002000:00100000:0.0:1746129566.048063:0:31522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3ef:0x0] (2097152->3502079) req@ffff88008f44aa00 x1830948733963776/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:307/0 lens 504/440 e 0 to 0 dl 1746129577 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129566.048072:0:31522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f44aa00 with x1830948733963776 ext(2097152->3502079) 00002000:00010000:0.0:1746129566.048077:0:31522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f44aa00 00010000:00010000:1.0:1746129566.049783:0:15749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009584e800/0x40a459093b068c07 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f204c4 expref: 19 pid: 2271 timeout: 921 lvb_type: 0 00010000:00010000:1.0:1746129566.049798:0:15749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009584e800/0x40a459093b068c07 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f204c4 expref: 19 pid: 2271 timeout: 921 lvb_type: 0 00010000:00010000:1.0:1746129566.049815:0:15749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009f469400) 00010000:00010000:1.0:1746129566.049818:0:15749:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c460000/0x40a459093b068ed1 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00010000:00010000:1.0:1746129566.049826:0:15749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c460000/0x40a459093b068ed1 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 2271 initiator: MDT0 00010000:00010000:1.0:1746129566.049832:0:15749:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c460000/0x40a459093b068ed1 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 2271 initiator: MDT0 00010000:00010000:1.0:1746129566.049878:0:15749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129566.049918:0:15749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095627100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+18:1962:x1830948733965440:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 4734us (7069us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129566.049927:0:15749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8073 00000100:00100000:0.0:1746129566.057718:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129566.061179:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129566.061863:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129566.061899:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129566.063906:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129566.069845:0:31520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733966464 00000100:00100000:0.0:1746129566.069852:0:31520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733966464 00002000:00100000:0.0:1746129566.069887:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3ef:0x0] (4194304->5148671) req@ffff880095624380 x1830948733966464/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:307/0 lens 488/0 e 0 to 0 dl 1746129577 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129566.069894:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095624380 with x1830948733966464 ext(4194304->5148671) 00002000:00010000:0.0:1746129566.069899:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095624380 00000100:00100000:0.0:1746129566.069924:0:31520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7579 00000100:00100000:0.0:1746129566.069930:0:31520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095624380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ada2ffba-8920-4ecb-8068-68caa9806978+22:1962:x1830948733966464:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129566.076406:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129566.083915:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129566.085562:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129566.087108:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129566.087145:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733967360 00000100:00100000:0.0:1746129566.087150:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733967360 00002000:00100000:0.0:1746129566.087178:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f5:0x0] (3092480->3096575) req@ffff88009fbaf480 x1830948733967360/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:307/0 lens 488/0 e 0 to 0 dl 1746129577 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129566.087187:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbaf480 with x1830948733967360 ext(3092480->3096575) 00002000:00010000:0.0:1746129566.087191:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fbaf480 00000100:00100000:0.0:1746129566.087216:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7581 00000100:00100000:0.0:1746129566.087222:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+12:1963:x1830948733967360:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:0.0:1746129566.087410:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+12:1963:x1830948733967360:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 187us (301us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746129566.087416:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7581 00002000:00100000:0.0:1746129566.087421:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f5:0x0] (3092480->3096575) req@ffff88009fbaf480 x1830948733967360/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:307/0 lens 488/4536 e 0 to 0 dl 1746129577 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129566.087427:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbaf480 with x1830948733967360 ext(3092480->3096575) 00002000:00010000:0.0:1746129566.087431:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fbaf480 00000100:00100000:0.0:1746129566.090977:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129566.091019:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129566.091058:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129566.099499:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129566.107595:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129566.116752:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129566.137424:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129566.157564:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129566.157759:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129566.157788:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129566.157817:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129566.160099:0:31521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7586 00000100:00100000:1.0:1746129566.160114:0:31521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+16:1963:x1830948733969280:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129566.198511:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129566.221425:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129566.230601:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129566.234651:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129566.236932:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129566.237022:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129566.237383:0:20577:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733970688 00000100:00100000:1.0:1746129566.237387:0:20577:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733970688 00000100:00100000:1.0:1746129566.237451:0:20577:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15811 00000100:00100000:1.0:1746129566.237457:0:20577:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f870700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ada2ffba-8920-4ecb-8068-68caa9806978+27:1963:x1830948733970688:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129566.237466:0:20577:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129566.237477:0:20577:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f229c00/0x40a459093b068f41 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20756 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129566.237528:0:20577:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7da300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20577:1830948737455360:192.168.202.4@tcp:106: 00000100:00100000:1.0:1746129566.237791:0:20577:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c954b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746129566.238459:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129566.238899:0:20577:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7da300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20577:1830948737455360:192.168.202.4@tcp:106: 00010000:00010000:1.0:1746129566.238924:0:20577:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f229c00/0x40a459093b068f41 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20756 expref: 28 pid: 20577 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129566.238935:0:20577:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f229c00/0x40a459093b068f41 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20756 expref: 28 pid: 20577 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129566.238959:0:20577:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f229c00, rc 0) 00000100:00100000:1.0:1746129566.238987:0:20577:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f870700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ada2ffba-8920-4ecb-8068-68caa9806978+27:1963:x1830948733970688:12345-192.168.202.4@tcp:101:cat.0 Request processed in 1530us (1964us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129566.238994:0:20577:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15811 00000100:00100000:0.0:1746129566.243030:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129566.247677:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129566.247790:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129566.247834:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129566.248222:0:20577:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733971712 00000100:00100000:1.0:1746129566.248227:0:20577:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733971712 00000100:00100000:1.0:1746129566.248256:0:20577:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15812 00000100:00100000:1.0:1746129566.248262:0:20577:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f871880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ada2ffba-8920-4ecb-8068-68caa9806978+27:32111:x1830948733971712:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:1.0:1746129566.248271:0:20577:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129566.248287:0:20577:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f228c00/0x40a459093b068f6b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20764 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129566.248332:0:20577:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008ebb2400/0x40a459093b068ea0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f206df expref: 28 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129566.248341:0:20577:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009363ca00/0x40a459093b068ea7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f206e6 expref: 14 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129566.248348:0:20577:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129566.248349:0:20577:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129566.248365:0:20577:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f228c00/0x40a459093b068f6b lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [765952->1011711] (req 765952->1011711) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20764 expref: 28 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129566.248396:0:20577:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009363ca00/0x40a459093b068ea7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f206e6 expref: 14 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129566.248408:0:20577:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009363ca00/0x40a459093b068ea7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f206e6 expref: 14 pid: 20577 timeout: 921 lvb_type: 0 00000100:00100000:1.0:1746129566.248421:0:20577:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7da300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20577:1830948737455488:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129566.248531:0:20577:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008ebb2400/0x40a459093b068ea0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f206df expref: 28 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129566.248544:0:20577:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008ebb2400/0x40a459093b068ea0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f206df expref: 28 pid: 20577 timeout: 921 lvb_type: 0 00000100:00100000:1.0:1746129566.248552:0:20577:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092fd0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20577:1830948737455616:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129566.248575:0:20577:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c954b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746129566.259347:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129566.259384:0:20578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733971840 00000100:00100000:0.0:1746129566.259393:0:20578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733971840 00010000:00010000:0.0:1746129566.259432:0:20578:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009363ca00/0x40a459093b068ea7 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f206e6 expref: 15 pid: 20577 timeout: 921 lvb_type: 0 00000100:00100000:0.0:1746129566.259472:0:20578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8077 00000100:00100000:0.0:1746129566.259480:0:20578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f871c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+15:1962:x1830948733971840:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129566.259494:0:20578:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129566.259516:0:20578:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009363ca00/0x40a459093b068ea7 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f206e6 expref: 15 pid: 20577 timeout: 921 lvb_type: 0 00010000:00010000:0.0:1746129566.259529:0:20578:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009363ca00/0x40a459093b068ea7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f206e6 expref: 15 pid: 20577 timeout: 921 lvb_type: 0 00010000:00010000:0.0:1746129566.259556:0:20578:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129566.259600:0:20578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f871c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+15:1962:x1830948733971840:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 120us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129566.259606:0:20578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8077 00010000:00010000:1.0:1746129566.259936:0:20577:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009363ca00/0x40a459093b068ea7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f206e6 expref: 14 pid: 20577 timeout: 921 lvb_type: 0 00000100:00100000:1.0:1746129566.259964:0:20577:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7da300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20577:1830948737455488:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129566.261491:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129566.265565:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129566.270809:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129566.272520:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129566.275002:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129566.289551:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129566.291782:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129566.300195:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129566.307013:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129566.307402:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129566.308452:0:21725:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7594 00000100:00100000:1.0:1746129566.308462:0:21725:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f873800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ada2ffba-8920-4ecb-8068-68caa9806978+30:1963:x1830948733974144:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129566.314603:0:31522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733974400 00000100:00100000:0.0:1746129566.314608:0:31522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733974400 00002000:00100000:0.0:1746129566.314832:0:31522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->4194303) req@ffff880095625500 x1830948733974400/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:307/0 lens 488/0 e 0 to 0 dl 1746129577 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129566.314841:0:31522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095625500 with x1830948733974400 ext(3145728->4194303) 00002000:00010000:0.0:1746129566.314847:0:31522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095625500 00000100:00100000:0.0:1746129566.314882:0:31522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7595 00000100:00100000:0.0:1746129566.314889:0:31522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095625500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ada2ffba-8920-4ecb-8068-68caa9806978+26:1963:x1830948733974400:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:1.0:1746129566.322867:0:21725:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f873800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ada2ffba-8920-4ecb-8068-68caa9806978+28:1963:x1830948733974144:12345-192.168.202.4@tcp:3:cat.0 Request processed in 14392us (15450us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129566.322880:0:21725:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7594 00002000:00100000:1.0:1746129566.322894:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f5:0x0] (3145728->4194303) req@ffff88009f873800 x1830948733974144/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:307/0 lens 488/440 e 0 to 0 dl 1746129577 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129566.322904:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f873800 with x1830948733974144 ext(3145728->4194303) 00002000:00010000:1.0:1746129566.322910:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f873800 00000100:00100000:0.0:1746129566.323783:0:31522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095625500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ada2ffba-8920-4ecb-8068-68caa9806978+26:1963:x1830948733974400:12345-192.168.202.4@tcp:3:cat.0 Request processed in 8892us (9393us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129566.323792:0:31522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7595 00002000:00100000:0.0:1746129566.323798:0:31522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->4194303) req@ffff880095625500 x1830948733974400/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:307/0 lens 488/440 e 0 to 0 dl 1746129577 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129566.323806:0:31522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095625500 with x1830948733974400 ext(3145728->4194303) 00002000:00010000:0.0:1746129566.323810:0:31522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095625500 00000100:00100000:0.0:1746129566.333649:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129566.346590:0:2271:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733975168 00000100:00100000:0.0:1746129566.346599:0:2271:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733975168 00000100:00100000:0.0:1746129566.347278:0:2271:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11139 00000100:00100000:0.0:1746129566.347286:0:2271:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095626680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:32119:x1830948733975168:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129566.347326:0:2271:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129566.347343:0:2271:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec78a00/0x40a459093b068f9c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20779 expref: -99 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129566.347462:0:2271:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec79c00/0x40a459093b068fa3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129566.347476:0:2271:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec79c00/0x40a459093b068fa3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129566.347486:0:2271:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec79c00/0x40a459093b068fa3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129566.347497:0:2271:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec79400/0x40a459093b068faa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129566.347502:0:2271:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec79400/0x40a459093b068faa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129566.347509:0:2271:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec79400/0x40a459093b068faa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129566.347616:0:2271:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec79800/0x40a459093b068fb1 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129566.347623:0:2271:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec79800/0x40a459093b068fb1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129566.347629:0:2271:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec79800/0x40a459093b068fb1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00000004:00200000:0.0:1746129566.347637:0:2271:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:0.0:1746129566.348116:0:2271:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec79c00/0x40a459093b068fa3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129566.348123:0:2271:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec79c00/0x40a459093b068fa3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129566.348133:0:2271:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec79c00/0x40a459093b068fa3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129566.348139:0:2271:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ec79c00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:0.0:1746129566.348143:0:2271:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec79c00/0x40a459093b068fa3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129566.348150:0:2271:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec79c00/0x40a459093b068fa3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129566.348161:0:2271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880132ef8f00) 00010000:00010000:0.0:1746129566.348164:0:2271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129566.348168:0:2271:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec79c00/0x40a459093b068fa3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129566.348175:0:2271:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec79c00/0x40a459093b068fa3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129566.348241:0:2271:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec79400/0x40a459093b068faa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129566.348247:0:2271:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec79400/0x40a459093b068faa lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129566.348251:0:2271:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec79400/0x40a459093b068faa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129566.348255:0:2271:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ec79400 already unused, calling callback (ffffffffa136e690) 00010000:00010000:0.0:1746129566.348258:0:2271:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec79400/0x40a459093b068faa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129566.348262:0:2271:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec79400/0x40a459093b068faa lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129566.348269:0:2271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880132c4e000) 00010000:00010000:0.0:1746129566.348271:0:2271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129566.348273:0:2271:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec79400/0x40a459093b068faa lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129566.348278:0:2271:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec79400/0x40a459093b068faa lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129566.348340:0:2271:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec78a00/0x40a459093b068f9c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20779 expref: 23 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129566.348351:0:2271:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec79800/0x40a459093b068fb1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20779 expref: 22 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129566.348373:0:2271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009f469400) 00010000:00010000:0.0:1746129566.348375:0:2271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746129566.348378:0:2271:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ec79800, rc 0) 00000100:00100000:0.0:1746129566.348422:0:2271:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095626680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+22:32119:x1830948733975168:12345-192.168.202.4@tcp:101:cat.0 Request processed in 1136us (1936us total) trans 8589945215 rc 0/0 00000100:00100000:0.0:1746129566.348428:0:2271:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11139 00000100:00100000:0.0:1746129566.352630:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129566.352664:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129566.352708:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129566.352819:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15814 00000100:00100000:0.0:1746129566.352828:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f870a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+14:1961:x1830948733975296:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129566.352847:0:7149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129566.352862:0:7149:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ec78000/0x40a459093b068fbf lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20780 expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129566.352912:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013145ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7149:1830948737456128:192.168.202.4@tcp:106: 00000100:00100000:0.0:1746129566.352981:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a00480 going to sleep for 11 seconds 00000100:00100000:0.0:1746129566.356369:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129566.358098:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129566.363859:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129566.367466:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129566.367518:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129566.368959:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135724e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7149:1830948737456512:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129566.368983:0:7149:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f581a00/0x40a459093b068fd4 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [3969024->4194303] (req 3969024->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20795 expref: 14 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129566.368992:0:7149:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f581a00, rc 0) 00000100:00100000:0.0:1746129566.369644:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e955880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+14:32116:x1830948733975936:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 4395us (5784us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129566.369651:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15817 00000100:00100000:0.0:1746129566.372537:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129566.383504:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129566.383559:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129566.384008:0:21725:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733976832 00000100:00100000:1.0:1746129566.384011:0:21725:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733976832 00002000:00100000:1.0:1746129566.385101:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ec:0x0] (0->1048575) req@ffff88012ea92d80 x1830948733976832/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:307/0 lens 488/0 e 0 to 0 dl 1746129577 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129566.385110:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ea92d80 with x1830948733976832 ext(0->1048575) 00002000:00010000:1.0:1746129566.385116:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ea92d80 00000100:00100000:1.0:1746129566.385154:0:21725:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7597 00000100:00100000:1.0:1746129566.385164:0:21725:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+15:1962:x1830948733976832:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:1.0:1746129566.395037:0:21725:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+15:1962:x1830948733976832:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 9862us (11464us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129566.395048:0:21725:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7597 00002000:00100000:1.0:1746129566.395061:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ec:0x0] (0->1048575) req@ffff88012ea92d80 x1830948733976832/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:307/0 lens 488/440 e 0 to 0 dl 1746129577 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129566.395071:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ea92d80 with x1830948733976832 ext(0->1048575) 00002000:00010000:1.0:1746129566.395077:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ea92d80 00000100:00100000:0.0:1746129566.395953:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129566.402021:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129566.404398:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129566.407802:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129566.410654:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129566.410720:0:21725:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733977600 00000100:00100000:1.0:1746129566.410727:0:21725:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733977600 00002000:00100000:1.0:1746129566.410765:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ef:0x0] (4513792->4517887) req@ffff880091b07800 x1830948733977600/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:307/0 lens 488/0 e 0 to 0 dl 1746129577 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129566.410774:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091b07800 with x1830948733977600 ext(4513792->4517887) 00010000:00010000:1.0:1746129566.410780:0:21725:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880132f99600/0x40a459093b068fdb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4517887) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2079c expref: 16 pid: 7149 timeout: 921 lvb_type: 0 00010000:00010000:1.0:1746129566.410792:0:21725:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880132f99600/0x40a459093b068fdb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4517887) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2079c expref: 16 pid: 7149 timeout: 921 lvb_type: 0 00002000:00010000:1.0:1746129566.410798:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091b07800 00000100:00100000:1.0:1746129566.410825:0:21725:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2376 00000100:00100000:1.0:1746129566.410831:0:21725:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+16:1962:x1830948733977600:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:1.0:1746129566.410987:0:21725:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+16:1962:x1830948733977600:12345-192.168.202.4@tcp:3:cat.0 Request processed in 156us (334us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746129566.410993:0:21725:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2376 00002000:00100000:1.0:1746129566.410998:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ef:0x0] (4513792->4517887) req@ffff880091b07800 x1830948733977600/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:307/0 lens 488/4536 e 0 to 0 dl 1746129577 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129566.411006:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091b07800 with x1830948733977600 ext(4513792->4517887) 00010000:00010000:1.0:1746129566.411010:0:21725:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880132f99600/0x40a459093b068fdb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4517887) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2079c expref: 16 pid: 7149 timeout: 921 lvb_type: 0 00010000:00010000:1.0:1746129566.411019:0:21725:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880132f99600/0x40a459093b068fdb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4517887) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2079c expref: 16 pid: 7149 timeout: 921 lvb_type: 0 00002000:00010000:1.0:1746129566.411024:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091b07800 00000100:00100000:0.0:1746129566.413847:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129566.429202:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129566.438636:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129566.438728:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129566.439211:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129566.439911:0:21725:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7600 00000100:00100000:1.0:1746129566.439917:0:21725:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+18:1963:x1830948733978496:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:1.0:1746129566.442955:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129566.452717:0:21725:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+19:1963:x1830948733978496:12345-192.168.202.4@tcp:3:cat.0 Request processed in 12788us (13977us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129566.452729:0:21725:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7600 00002000:00100000:1.0:1746129566.452742:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->4194303) req@ffff88009c7db800 x1830948733978496/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:307/0 lens 488/440 e 0 to 0 dl 1746129577 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129566.452751:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7db800 with x1830948733978496 ext(3145728->4194303) 00002000:00010000:1.0:1746129566.452757:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c7db800 00000100:00100000:0.0:1746129566.468874:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092fd0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+14:1962:x1830948733978880:12345-192.168.202.4@tcp:3:cat.0 Request processed in 24266us (25923us total) trans 0 rc 823296/823296 00000100:00100000:0.0:1746129566.468882:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7602 00002000:00100000:0.0:1746129566.468889:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f5:0x0] (3145728->3969023) req@ffff880092fd0a80 x1830948733978880/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:307/0 lens 488/440 e 0 to 0 dl 1746129577 ref 1 fl Complete:/200/0 rc 823296/823296 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129566.468896:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092fd0a80 with x1830948733978880 ext(3145728->3969023) 00002000:00010000:0.0:1746129566.468900:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092fd0a80 00000100:00100000:0.0:1746129566.472511:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00010000:00010000:2.0:1746129566.472982:0:2271:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd7e200/0x40a459093b068ff7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129566.473097:0:2271:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd7ec00/0x40a459093b068ffe lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129566.473107:0:2271:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c460000/0x40a459093b068ed1 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20709 expref: 20 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129566.473115:0:2271:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd7ec00/0x40a459093b068ffe lrc: 4/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129566.473148:0:2271:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009c460000/0x40a459093b068ed1 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20709 expref: 20 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129566.473159:0:2271:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c460000/0x40a459093b068ed1 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20709 expref: 20 pid: 2271 timeout: 921 lvb_type: 0 00000100:00100000:2.0:1746129566.473171:0:2271:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095625c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:2271:1830948737457536:192.168.202.4@tcp:104: 00000100:00080000:0.0:1746129566.473379:0:7097:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746129566.473859:0:2271:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800951de9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129566.475440:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129566.475554:0:2271:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095625c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:2271:1830948737457536:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129566.475580:0:2271:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd7ec00/0x40a459093b068ffe lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00000100:00100000:1.0:1746129566.477525:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129566.477819:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733979648 00000100:00100000:0.0:1746129566.477827:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733979648 00002000:00100000:0.0:1746129566.477863:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ef:0x0] (4194304->5148671) req@ffff880092fd0e00 x1830948733979648/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:307/0 lens 488/0 e 0 to 0 dl 1746129577 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129566.477873:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092fd0e00 with x1830948733979648 ext(4194304->5148671) 00002000:00010000:0.0:1746129566.477878:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092fd0e00 00000100:00100000:0.0:1746129566.478011:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7603 00000100:00100000:0.0:1746129566.478019:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092fd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+17:1962:x1830948733979648:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129566.483456:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129566.483815:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092fd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+17:1962:x1830948733979648:12345-192.168.202.4@tcp:3:cat.0 Request processed in 5795us (6288us total) trans 0 rc 954368/954368 00000100:00100000:0.0:1746129566.483822:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7603 00002000:00100000:0.0:1746129566.483832:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ef:0x0] (4194304->5148671) req@ffff880092fd0e00 x1830948733979648/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:307/0 lens 488/440 e 0 to 0 dl 1746129577 ref 1 fl Complete:/200/0 rc 954368/954368 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129566.483839:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092fd0e00 with x1830948733979648 ext(4194304->5148671) 00002000:00010000:0.0:1746129566.483844:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092fd0e00 00000100:00100000:2.0:1746129566.483902:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733979776 00000100:00100000:2.0:1746129566.483909:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733979776 00010000:00010000:2.0:1746129566.483935:0:9823:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c460000/0x40a459093b068ed1 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20709 expref: 22 pid: 2271 timeout: 921 lvb_type: 0 00000100:00100000:2.0:1746129566.483951:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8086 00000100:00100000:2.0:1746129566.483956:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7da300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+22:1963:x1830948733979776:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129566.483968:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129566.483973:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009c460000/0x40a459093b068ed1 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20709 expref: 22 pid: 2271 timeout: 921 lvb_type: 0 00010000:00010000:2.0:1746129566.483980:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009c460000/0x40a459093b068ed1 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20709 expref: 22 pid: 2271 timeout: 921 lvb_type: 0 00010000:00010000:2.0:1746129566.483998:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c460000/0x40a459093b068ed1 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20709 expref: 22 pid: 2271 timeout: 921 lvb_type: 0 00010000:00010000:2.0:1746129566.484019:0:9823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009f469400) 00010000:00010000:2.0:1746129566.484026:0:9823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd7ec00/0x40a459093b068ffe lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129566.484033:0:9823:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd7ec00/0x40a459093b068ffe lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129566.484038:0:9823:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd7ec00/0x40a459093b068ffe lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129566.484058:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129566.484073:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7da300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:1963:x1830948733979776:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 118us (628us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129566.484077:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8086 00000100:00100000:0.0:1746129566.488088:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129566.488131:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129566.488159:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129566.488160:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733980032 00000100:00100000:2.0:1746129566.488170:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733980032 00000100:00100000:0.0:1746129566.488194:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129566.488213:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733980544 00000100:00100000:0.0:1746129566.488213:0:8411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733980288 00000100:00100000:2.0:1746129566.488216:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733980544 00000100:00100000:0.0:1746129566.488217:0:8411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733980288 00000100:00100000:2.0:1746129566.488229:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733979904 00000100:00100000:2.0:1746129566.488231:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733979904 00000100:00100000:0.0:1746129566.488241:0:8411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15820 00000100:00100000:0.0:1746129566.488249:0:8411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013575d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:068dab75-d300-4ead-a742-d14572ad1e50+12:1963:x1830948733980032:12345-192.168.202.4@tcp:101:mirror_io.0 00000100:00100000:2.0:1746129566.488257:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15821 00000100:00100000:2.0:1746129566.488264:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013575e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:068dab75-d300-4ead-a742-d14572ad1e50+12:1963:x1830948733980544:12345-192.168.202.4@tcp:101:mirror_io.0 00010000:00010000:0.0:1746129566.488268:0:8411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129566.488271:0:7149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129566.488285:0:7149:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a6729200/0x40a459093b06900c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f207d4 expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129566.488285:0:8411:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095cda800/0x40a459093b069005 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f207b8 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129566.488321:0:11014:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15823 00010000:00010000:0.0:1746129566.488326:0:8411:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129566.488328:0:8411:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746129566.488331:0:11014:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bf7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:068dab75-d300-4ead-a742-d14572ad1e50+12:1963:x1830948733979904:12345-192.168.202.4@tcp:101:mirror_io.0 00010000:00010000:0.0:1746129566.488335:0:8411:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095cda800/0x40a459093b069005 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f207b8 expref: 14 pid: 8411 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129566.488337:0:11014:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129566.488345:0:11014:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ee1a600/0x40a459093b06901a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f207b1 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129566.488347:0:8411:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095cda800/0x40a459093b069005 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f207b8 expref: 14 pid: 8411 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129566.488366:0:8411:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095cda800, rc 0) 00000100:00100000:2.0:1746129566.488367:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095625c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7149:1830948737457664:192.168.202.4@tcp:106: 00010000:00010000:1.0:1746129566.488369:0:11014:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129566.488370:0:11014:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129566.488376:0:11014:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ee1a600/0x40a459093b06901a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f207b1 expref: 14 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129566.488385:0:11014:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ee1a600/0x40a459093b06901a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f207b1 expref: 14 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129566.488392:0:11014:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ee1a600, rc 0) 00000100:00100000:0.0:1746129566.488408:0:8411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013575d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:068dab75-d300-4ead-a742-d14572ad1e50+14:1963:x1830948733980032:12345-192.168.202.4@tcp:101:mirror_io.0 Request processed in 161us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129566.488412:0:11014:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bf7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:068dab75-d300-4ead-a742-d14572ad1e50+14:1963:x1830948733979904:12345-192.168.202.4@tcp:101:mirror_io.0 Request processed in 83us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129566.488413:0:8411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15820 00000100:00100000:1.0:1746129566.488419:0:11014:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15823 00000100:00100000:2.0:1746129566.488427:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800951de9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129566.488468:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129566.489127:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129566.489168:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129566.489243:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733980800 00000100:00100000:2.0:1746129566.489246:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733980800 00000100:00100000:2.0:1746129566.489266:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4710 00000100:00100000:2.0:1746129566.489270:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095564050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:32119:x1830948733980800:12345-192.168.202.4@tcp:35:cat.0 00000100:00100000:2.0:1746129566.489481:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095564050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+22:32119:x1830948733980800:12345-192.168.202.4@tcp:35:cat.0 Request processed in 209us (312us total) trans 8589945217 rc 0/0 00000100:00100000:2.0:1746129566.489486:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4710 00002000:00010000:2.0:1746129566.490272:0:7149:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3f5:0x0] updating lvb mtime: 1746129566 -> 1746129567 00002000:00010000:2.0:1746129566.490276:0:7149:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3f5:0x0] updating lvb atime: 1746129566 -> 1746129567 00002000:00010000:2.0:1746129566.490279:0:7149:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3f5:0x0] updating lvb ctime: 1746129566 -> 1746129567 00000100:00100000:2.0:1746129566.490321:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095625c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7149:1830948737457664:192.168.202.4@tcp:106: 00010000:00010000:2.0:1746129566.490345:0:7149:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a6729200/0x40a459093b06900c lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f207d4 expref: 14 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129566.490371:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a6729200/0x40a459093b06900c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f207d4 expref: 14 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129566.490380:0:7149:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6729200, rc 0) 00000100:00100000:2.0:1746129566.490406:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013575e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:068dab75-d300-4ead-a742-d14572ad1e50+13:1963:x1830948733980544:12345-192.168.202.4@tcp:101:mirror_io.0 Request processed in 2141us (2246us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129566.490411:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15821 00000100:00100000:2.0:1746129566.494440:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129566.501779:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129566.501829:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733981312 00000100:00100000:1.0:1746129566.501837:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733981312 00000100:00100000:1.0:1746129566.501883:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11142 00000100:00100000:0.0:1746129566.501886:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129566.501891:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013575c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ada2ffba-8920-4ecb-8068-68caa9806978+302:32125:x1830948733981312:12345-192.168.202.4@tcp:101:multiop.0 00000100:00100000:2.0:1746129566.501926:0:20578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733981440 00000100:00100000:2.0:1746129566.501932:0:20578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733981440 00010000:00010000:2.0:1746129566.501955:0:20578:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd7ec00/0x40a459093b068ffe lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f207aa expref: 12 pid: 2271 timeout: 921 lvb_type: 0 00010000:00010000:1.0:1746129566.502023:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129566.502038:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1b600/0x40a459093b06903d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f207e2 expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129566.502088:0:20578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8087 00000100:00100000:2.0:1746129566.502097:0:20578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6fd0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:068dab75-d300-4ead-a742-d14572ad1e50+12:1962:x1830948733981440:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129566.502107:0:20578:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129566.502111:0:20578:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd7ec00/0x40a459093b068ffe lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f207aa expref: 12 pid: 2271 timeout: 921 lvb_type: 0 00010000:00010000:2.0:1746129566.502121:0:20578:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd7ec00/0x40a459093b068ffe lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f207aa expref: 12 pid: 2271 timeout: 921 lvb_type: 0 00010000:00010000:2.0:1746129566.502140:0:20578:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd7ec00/0x40a459093b068ffe lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f207aa expref: 12 pid: 2271 timeout: 921 lvb_type: 0 00010000:00010000:2.0:1746129566.502154:0:20578:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009f469400) 00010000:00010000:2.0:1746129566.502159:0:20578:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e0e800/0x40a459093b069036 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129566.502168:0:20578:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e0e800/0x40a459093b069036 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129566.502176:0:20578:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e0e800/0x40a459093b069036 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 2271 initiator: MDT0 00010000:00010000:1.0:1746129566.502276:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1b800/0x40a459093b069044 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129566.502285:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1b800/0x40a459093b069044 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129566.502317:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1b800/0x40a459093b069044 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129566.502329:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1ae00/0x40a459093b06904b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129566.502334:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1ae00/0x40a459093b06904b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129566.502545:0:20578:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129566.502584:0:20578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6fd0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:068dab75-d300-4ead-a742-d14572ad1e50+11:1962:x1830948733981440:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 486us (696us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129566.502590:0:20578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8087 00010000:00010000:1.0:1746129566.502999:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1ae00/0x40a459093b06904b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129566.503094:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1a800/0x40a459093b069059 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129566.503102:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1a800/0x40a459093b069059 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129566.503108:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1a800/0x40a459093b069059 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00200000:1.0:1746129566.503114:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:1.0:1746129566.503157:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1b800/0x40a459093b069044 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129566.503164:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1b800/0x40a459093b069044 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129566.503169:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1b800/0x40a459093b069044 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129566.503179:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ee1b800 already unused, calling callback (ffffffffa136e690) 00010000:00010000:1.0:1746129566.503182:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1b800/0x40a459093b069044 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129566.503189:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1b800/0x40a459093b069044 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129566.503196:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880132ef8f00) 00010000:00010000:1.0:1746129566.503198:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129566.503200:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1b800/0x40a459093b069044 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129566.503203:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1b800/0x40a459093b069044 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129566.503218:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1ae00/0x40a459093b06904b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129566.503221:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1ae00/0x40a459093b06904b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129566.503224:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1ae00/0x40a459093b06904b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129566.503227:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ee1ae00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:1.0:1746129566.503228:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1ae00/0x40a459093b06904b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129566.503230:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1ae00/0x40a459093b06904b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129566.503233:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009cffe100) 00010000:00010000:1.0:1746129566.503234:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129566.503236:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1ae00/0x40a459093b06904b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129566.503239:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1ae00/0x40a459093b06904b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129566.503258:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1b600/0x40a459093b06903d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f207e2 expref: 305 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129566.503263:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1a800/0x40a459093b069059 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f207e2 expref: 304 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129566.503267:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009f469400) 00010000:00010000:1.0:1746129566.503268:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746129566.503269:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ee1a800, rc 0) 00000100:00100000:1.0:1746129566.503308:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013575c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ada2ffba-8920-4ecb-8068-68caa9806978+304:32125:x1830948733981312:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 1419us (1539us total) trans 8589945219 rc 0/0 00000100:00100000:1.0:1746129566.503312:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11142 00000100:00100000:0.0:1746129566.504649:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129566.504704:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733981696 00000100:00100000:1.0:1746129566.504711:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733981696 00000100:00100000:1.0:1746129566.504846:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11143 00000100:00100000:1.0:1746129566.504854:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013575e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:068dab75-d300-4ead-a742-d14572ad1e50+11:32122:x1830948733981696:12345-192.168.202.4@tcp:101:mirror_io.0 00010000:00010000:1.0:1746129566.504870:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129566.504873:0:14549:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1746129566.504889:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e0e800/0x40a459093b069036 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f207db expref: 11 pid: 2271 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129566.504894:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00010000:00010000:1.0:1746129566.504901:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009f469400) 00010000:00010000:1.0:1746129566.504904:0:14549:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129566.504992:0:20578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733981824 00000100:00100000:2.0:1746129566.504995:0:20578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733981824 00000100:00100000:2.0:1746129566.505018:0:20578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 780 00000100:00100000:2.0:1746129566.505022:0:20578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013575f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ada2ffba-8920-4ecb-8068-68caa9806978+304:1963:x1830948733981824:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129566.505033:0:20578:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129566.505042:0:20578:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1a800/0x40a459093b069059 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f207e2 expref: 304 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129566.505051:0:20578:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009f469400) 00010000:00010000:2.0:1746129566.505053:0:20578:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129566.505091:0:20578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013575f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ada2ffba-8920-4ecb-8068-68caa9806978+303:1963:x1830948733981824:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 68us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129566.505097:0:20578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 780 00010000:00010000:1.0:1746129566.505134:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1be00/0x40a459093b069067 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f207e9 expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129566.505249:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1aa00/0x40a459093b06906e lrc: 3/0,1 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129566.505261:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1aa00/0x40a459093b06906e lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129566.505270:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1aa00/0x40a459093b06906e lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129566.505279:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1aa00/0x40a459093b06906e lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129566.505284:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1aa00/0x40a459093b06906e lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129566.505290:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1aa00/0x40a459093b06906e lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129566.505486:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ee1aa00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:1.0:1746129566.505489:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1aa00/0x40a459093b06906e lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129566.505496:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1aa00/0x40a459093b06906e lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129566.505504:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009f469400) 00010000:00010000:1.0:1746129566.505506:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746129566.505509:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1aa00/0x40a459093b06906e lrc: 2/0,0 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129566.505513:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1aa00/0x40a459093b06906e lrc: 0/0,0 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129566.505536:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1be00/0x40a459093b069067 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f207e9 expref: 11 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129566.505543:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1be00/0x40a459093b069067 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f207e9 expref: 11 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129566.505549:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ee1be00, rc 0) 00000100:00100000:1.0:1746129566.506111:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013575e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:068dab75-d300-4ead-a742-d14572ad1e50+10:32122:x1830948733981696:12345-192.168.202.4@tcp:101:mirror_io.0 Request processed in 1257us (1465us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129566.506117:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11143 00000100:00100000:0.0:1746129566.506384:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129566.506554:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733981952 00000100:00100000:2.0:1746129566.506560:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733981952 00000100:00100000:2.0:1746129566.506634:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15826 00000100:00100000:2.0:1746129566.506641:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013575df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ada2ffba-8920-4ecb-8068-68caa9806978+26:32125:x1830948733981952:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:2.0:1746129566.506657:0:7149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129566.506670:0:7149:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a6729600/0x40a459093b069075 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f207f0 expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129566.506694:0:7149:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a9209a00/0x40a459093b068ef4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20725 expref: 16 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129566.506703:0:7149:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b4e0ee00/0x40a459093b069013 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f207c6 expref: 13 pid: 20577 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129566.506710:0:7149:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b4e0e000/0x40a459093b068efb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2072c expref: 27 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129566.506717:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129566.506718:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129566.506722:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6729600/0x40a459093b069075 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [2002944->2097151] (req 2002944->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f207f0 expref: 27 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129566.506753:0:7149:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b4e0e000/0x40a459093b068efb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2072c expref: 27 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129566.506765:0:7149:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b4e0e000/0x40a459093b068efb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2072c expref: 27 pid: 11014 timeout: 921 lvb_type: 1 00000100:00100000:2.0:1746129566.506777:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095626300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7149:1830948737457920:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129566.507534:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00010000:00010000:2.0:1746129566.507601:0:7149:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b4e0ee00/0x40a459093b069013 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f207c6 expref: 13 pid: 20577 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129566.507611:0:7149:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b4e0ee00/0x40a459093b069013 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f207c6 expref: 13 pid: 20577 timeout: 921 lvb_type: 1 00000100:00100000:2.0:1746129566.507619:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095626a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7149:1830948737458048:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129566.507781:0:7149:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a9209a00/0x40a459093b068ef4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20725 expref: 16 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129566.507790:0:7149:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a9209a00/0x40a459093b068ef4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20725 expref: 16 pid: 20577 timeout: 921 lvb_type: 0 00000100:00100000:2.0:1746129566.507838:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095625880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7149:1830948737458176:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129566.507861:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800951de240 going to sleep for 11 seconds 00000100:00100000:2.0:1746129566.508646:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095626300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7149:1830948737457920:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129566.509592:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129566.509694:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129566.509781:0:20578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733982336 00000100:00100000:2.0:1746129566.509786:0:20578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733982336 00010000:00010000:2.0:1746129566.509813:0:20578:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4e0e000/0x40a459093b068efb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2072c expref: 28 pid: 11014 timeout: 921 lvb_type: 1 00000100:00100000:2.0:1746129566.509846:0:20578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733982464 00000100:00100000:2.0:1746129566.509848:0:20578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733982464 00010000:00010000:2.0:1746129566.509857:0:20578:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4e0ee00/0x40a459093b069013 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f207c6 expref: 14 pid: 20577 timeout: 921 lvb_type: 1 00000100:00100000:2.0:1746129566.509881:0:20578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8088 00000100:00100000:2.0:1746129566.509887:0:20578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013575d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ada2ffba-8920-4ecb-8068-68caa9806978+28:1963:x1830948733982336:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129566.509897:0:20578:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129566.509920:0:20578:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b4e0e000/0x40a459093b068efb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2072c expref: 28 pid: 11014 timeout: 921 lvb_type: 1 00010000:00010000:2.0:1746129566.509931:0:20578:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b4e0e000/0x40a459093b068efb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2072c expref: 28 pid: 11014 timeout: 921 lvb_type: 1 00000100:00100000:0.0:1746129566.509948:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8089 00010000:00010000:2.0:1746129566.509954:0:20578:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b4e0e000/0x40a459093b068efb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2072c expref: 28 pid: 11014 timeout: 921 lvb_type: 1 00000100:00100000:0.0:1746129566.509956:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013575d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:068dab75-d300-4ead-a742-d14572ad1e50+14:1962:x1830948733982464:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129566.509964:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129566.509970:0:20578:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746129566.509975:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b4e0ee00/0x40a459093b069013 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f207c6 expref: 14 pid: 20577 timeout: 921 lvb_type: 1 00010000:00010000:0.0:1746129566.509983:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b4e0ee00/0x40a459093b069013 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f207c6 expref: 14 pid: 20577 timeout: 921 lvb_type: 1 00010000:00010000:0.0:1746129566.509994:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129566.510002:0:20578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013575d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ada2ffba-8920-4ecb-8068-68caa9806978+27:1963:x1830948733982336:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 114us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129566.510008:0:20578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8088 00000100:00100000:0.0:1746129566.510009:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013575d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:068dab75-d300-4ead-a742-d14572ad1e50+14:1962:x1830948733982464:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 55us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129566.510015:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8089 00010000:00010000:2.0:1746129566.510461:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b4e0ee00/0x40a459093b069013 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f207c6 expref: 13 pid: 20577 timeout: 921 lvb_type: 1 00000100:00100000:2.0:1746129566.510472:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095626a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7149:1830948737458048:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129566.510485:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095625880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7149:1830948737458176:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129566.510512:0:7149:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a6729600/0x40a459093b069075 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [2002944->2097151] (req 2002944->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f207f0 expref: 26 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129566.510523:0:7149:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6729600, rc 0) 00000100:00100000:2.0:1746129566.510550:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013575df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ada2ffba-8920-4ecb-8068-68caa9806978+26:32125:x1830948733981952:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 3909us (4166us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129566.510557:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15826 00000100:00100000:0.0:1746129566.511728:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129566.514396:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129566.514461:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733982848 00000100:00100000:2.0:1746129566.514468:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733982848 00002000:00100000:2.0:1746129566.514506:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ee:0x0] (2002944->2007039) req@ffff880094efc380 x1830948733982848/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:307/0 lens 488/0 e 0 to 0 dl 1746129577 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129566.514516:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094efc380 with x1830948733982848 ext(2002944->2007039) 00002000:00010000:2.0:1746129566.514521:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094efc380 00000100:00100000:2.0:1746129566.514543:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7604 00000100:00100000:2.0:1746129566.514549:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094efc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+26:1962:x1830948733982848:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:2.0:1746129566.514705:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094efc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+26:1962:x1830948733982848:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 156us (312us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129566.514711:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7604 00002000:00100000:2.0:1746129566.514716:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ee:0x0] (2002944->2007039) req@ffff880094efc380 x1830948733982848/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:307/0 lens 488/4536 e 0 to 0 dl 1746129577 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129566.514723:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094efc380 with x1830948733982848 ext(2002944->2007039) 00002000:00010000:2.0:1746129566.514726:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094efc380 00000100:00100000:0.0:1746129566.517231:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129566.517733:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733982976 00000100:00100000:2.0:1746129566.517744:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733982976 00000100:00100000:2.0:1746129566.518403:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15827 00000100:00100000:2.0:1746129566.518414:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094efce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ada2ffba-8920-4ecb-8068-68caa9806978+26:32125:x1830948733982976:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:2.0:1746129566.518432:0:7149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129566.518449:0:7149:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b4cb5200/0x40a459093b06907c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f207f7 expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129566.518482:0:7149:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880132f98800/0x40a459093b068fe2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f207a3 expref: 15 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129566.518491:0:7149:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b4e0fa00/0x40a459093b069028 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f207cd expref: 12 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129566.518498:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129566.518500:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129566.518503:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4cb5200/0x40a459093b06907c lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [2097152->2105343] (req 2097152->2105343) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f207f7 expref: 27 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129566.518532:0:7149:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b4e0fa00/0x40a459093b069028 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f207cd expref: 12 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129566.518543:0:7149:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b4e0fa00/0x40a459093b069028 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f207cd expref: 12 pid: 7148 timeout: 921 lvb_type: 1 00000100:00100000:2.0:1746129566.518555:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095625880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7149:1830948737458432:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129566.518652:0:7149:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880132f98800/0x40a459093b068fe2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f207a3 expref: 15 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129566.518660:0:7149:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880132f98800/0x40a459093b068fe2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f207a3 expref: 15 pid: 7149 timeout: 921 lvb_type: 0 00000100:00100000:2.0:1746129566.518668:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095626a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7149:1830948737458560:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129566.518684:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800951de240 going to sleep for 11 seconds 00010000:00010000:3.0:1746129566.522102:0:7149:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4cb5200, rc 0) 00000100:00100000:3.0:1746129566.522144:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094efce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ada2ffba-8920-4ecb-8068-68caa9806978+27:32125:x1830948733982976:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 3732us (4922us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129566.522152:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15827 00000100:00100000:0.0:1746129566.523840:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129566.524000:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733983104 00000100:00100000:3.0:1746129566.524009:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733983104 00010000:00010000:3.0:1746129566.524047:0:9823:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4e0fa00/0x40a459093b069028 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f207cd expref: 13 pid: 7148 timeout: 921 lvb_type: 1 00000100:00100000:3.0:1746129566.524089:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8091 00000100:00100000:3.0:1746129566.524096:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094efca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:068dab75-d300-4ead-a742-d14572ad1e50+13:1963:x1830948733983104:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129566.524111:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129566.524133:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b4e0fa00/0x40a459093b069028 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f207cd expref: 13 pid: 7148 timeout: 921 lvb_type: 1 00010000:00010000:3.0:1746129566.524145:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b4e0fa00/0x40a459093b069028 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f207cd expref: 13 pid: 7148 timeout: 921 lvb_type: 1 00010000:00010000:3.0:1746129566.524172:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b4e0fa00/0x40a459093b069028 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f207cd expref: 13 pid: 7148 timeout: 921 lvb_type: 1 00010000:00010000:3.0:1746129566.524185:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129566.524234:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094efca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:068dab75-d300-4ead-a742-d14572ad1e50+12:1963:x1830948733983104:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 138us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129566.524240:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8091 00000100:00100000:0.0:1746129566.524525:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129566.524791:0:15749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733983232 00000100:00100000:1.0:1746129566.524796:0:15749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733983232 00010000:00010000:1.0:1746129566.524812:0:15749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880132f98800/0x40a459093b068fe2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f207a3 expref: 16 pid: 7149 timeout: 921 lvb_type: 0 00000100:00100000:1.0:1746129566.524827:0:15749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8092 00000100:00100000:1.0:1746129566.524832:0:15749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094efdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+16:1962:x1830948733983232:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129566.524839:0:15749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129566.524849:0:15749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880132f98800/0x40a459093b068fe2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f207a3 expref: 16 pid: 7149 timeout: 921 lvb_type: 0 00010000:00010000:1.0:1746129566.524857:0:15749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880132f98800/0x40a459093b068fe2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f207a3 expref: 16 pid: 7149 timeout: 921 lvb_type: 0 00010000:00010000:1.0:1746129566.524869:0:15749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880132f98800/0x40a459093b068fe2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f207a3 expref: 16 pid: 7149 timeout: 921 lvb_type: 0 00010000:00010000:1.0:1746129566.525203:0:15749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129566.525205:0:15749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129566.525213:0:15749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b4cb5200/0x40a459093b06907c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2105343) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f207f7 expref: 26 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129566.525222:0:15749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4cb5200/0x40a459093b06907c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2105343) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f207f7 expref: 26 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129566.525256:0:15749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800b4cb5200/0x40a459093b06907c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2105343) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f207f7 expref: 26 pid: 7149 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129566.525268:0:15749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092fd1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15749:1830948737458688:192.168.202.4@tcp:105: 00000100:00100000:1.0:1746129566.525604:0:15749:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c954d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746129566.527060:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129566.527145:0:15749:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092fd1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15749:1830948737458688:192.168.202.4@tcp:105: 00010000:00010000:1.0:1746129566.527164:0:15749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129566.527198:0:15749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094efdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+15:1962:x1830948733983232:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 2364us (2671us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129566.527209:0:15749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8092 00000100:00100000:2.0:1746129566.527284:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733983488 00000100:00100000:2.0:1746129566.527290:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733983488 00002000:00100000:2.0:1746129566.527378:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ef:0x0] (2101248->2105343) req@ffff880094efd180 x1830948733983488/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:307/0 lens 488/0 e 0 to 0 dl 1746129577 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129566.527388:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094efd180 with x1830948733983488 ext(2101248->2105343) 00002000:00010000:2.0:1746129566.527393:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094efd180 00000100:00100000:2.0:1746129566.527410:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7605 00000100:00100000:2.0:1746129566.527417:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094efd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+27:1963:x1830948733983488:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:2.0:1746129566.527561:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094efd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+27:1963:x1830948733983488:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 145us (505us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129566.527567:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7605 00002000:00100000:2.0:1746129566.527572:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ef:0x0] (2101248->2105343) req@ffff880094efd180 x1830948733983488/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:307/0 lens 488/4536 e 0 to 0 dl 1746129577 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129566.527579:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094efd180 with x1830948733983488 ext(2101248->2105343) 00002000:00010000:2.0:1746129566.527582:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094efd180 00000100:00100000:0.0:1746129566.529244:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129566.529465:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733983744 00000100:00100000:3.0:1746129566.529533:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733983744 00000100:00100000:3.0:1746129566.529649:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4712 00000100:00100000:3.0:1746129566.529656:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094efed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ada2ffba-8920-4ecb-8068-68caa9806978+303:32125:x1830948733983744:12345-192.168.202.4@tcp:35:multiop.0 00000100:00100000:3.0:1746129566.529857:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094efed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ada2ffba-8920-4ecb-8068-68caa9806978+304:32125:x1830948733983744:12345-192.168.202.4@tcp:35:multiop.0 Request processed in 200us (619us total) trans 8589945221 rc 0/0 00000100:00100000:3.0:1746129566.529863:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4712 00000100:00100000:0.0:1746129566.532640:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129566.532832:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733984000 00000100:00100000:1.0:1746129566.532840:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733984000 00000100:00100000:1.0:1746129566.532896:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11144 00000100:00100000:1.0:1746129566.532904:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094efea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+22:32128:x1830948733984000:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:1.0:1746129566.532929:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129566.532948:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1b800/0x40a459093b069083 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f207fe expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129566.533068:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1be00/0x40a459093b06908a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129566.533081:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1be00/0x40a459093b06908a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129566.533092:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1be00/0x40a459093b06908a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129566.533342:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1aa00/0x40a459093b069091 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129566.533404:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1aa00/0x40a459093b069091 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129566.533411:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1aa00/0x40a459093b069091 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129566.533523:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1b600/0x40a459093b069098 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129566.533532:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1b600/0x40a459093b069098 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129566.533538:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1b600/0x40a459093b069098 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00200000:1.0:1746129566.533547:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:1.0:1746129566.533629:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1be00/0x40a459093b06908a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129566.533634:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1be00/0x40a459093b06908a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129566.533641:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1be00/0x40a459093b06908a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129566.533645:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ee1be00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:1.0:1746129566.533647:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1be00/0x40a459093b06908a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129566.533651:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1be00/0x40a459093b06908a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129566.533658:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880132ef8f00) 00010000:00010000:1.0:1746129566.533659:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129566.533662:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1be00/0x40a459093b06908a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129566.533664:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1be00/0x40a459093b06908a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129566.533681:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1aa00/0x40a459093b069091 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129566.533686:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1aa00/0x40a459093b069091 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129566.533690:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1aa00/0x40a459093b069091 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129566.533695:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ee1aa00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:1.0:1746129566.533697:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1aa00/0x40a459093b069091 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129566.533702:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1aa00/0x40a459093b069091 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129566.533711:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009cffec00) 00010000:00010000:1.0:1746129566.533713:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129566.533715:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1aa00/0x40a459093b069091 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129566.533719:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1aa00/0x40a459093b069091 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129566.533750:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1b800/0x40a459093b069083 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f207fe expref: 25 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129566.533759:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1b600/0x40a459093b069098 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f207fe expref: 24 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129566.533765:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009f469400) 00010000:00010000:1.0:1746129566.533767:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746129566.533769:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ee1b600, rc 0) 00000100:00100000:1.0:1746129566.533815:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094efea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+24:32128:x1830948733984000:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 912us (1185us total) trans 8589945222 rc 0/0 00000100:00100000:1.0:1746129566.533822:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11144 00000100:00100000:0.0:1746129566.572539:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129566.572964:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733984256 00000100:00100000:1.0:1746129566.572974:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733984256 00000100:00100000:1.0:1746129566.573644:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11145 00000100:00100000:1.0:1746129566.573654:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094efe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ada2ffba-8920-4ecb-8068-68caa9806978+304:32132:x1830948733984256:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129566.573680:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129566.573699:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1ae00/0x40a459093b0690a6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20805 expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129566.573817:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1b000/0x40a459093b0690ad lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129566.573829:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1b000/0x40a459093b0690ad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129566.573840:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1b000/0x40a459093b0690ad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129566.573854:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1b800/0x40a459093b0690b4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129566.573860:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1b800/0x40a459093b0690b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129566.573865:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1b800/0x40a459093b0690b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129566.573980:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1aa00/0x40a459093b0690bb lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129566.573988:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1aa00/0x40a459093b0690bb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129566.573994:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1aa00/0x40a459093b0690bb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00200000:1.0:1746129566.574004:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:1.0:1746129566.574094:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1b000/0x40a459093b0690ad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129566.574100:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1b000/0x40a459093b0690ad lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129566.574109:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1b000/0x40a459093b0690ad lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129566.574115:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ee1b000 already unused, calling callback (ffffffffa136e690) 00010000:00010000:1.0:1746129566.574118:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1b000/0x40a459093b0690ad lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129566.574125:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1b000/0x40a459093b0690ad lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129566.574136:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880132ef8f00) 00010000:00010000:1.0:1746129566.574138:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129566.574143:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1b000/0x40a459093b0690ad lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129566.574148:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1b000/0x40a459093b0690ad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129566.574175:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1b800/0x40a459093b0690b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129566.574180:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1b800/0x40a459093b0690b4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129566.574185:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1b800/0x40a459093b0690b4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129566.574188:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ee1b800 already unused, calling callback (ffffffffa136e690) 00010000:00010000:1.0:1746129566.574190:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1b800/0x40a459093b0690b4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129566.574194:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1b800/0x40a459093b0690b4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129566.574204:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009cffec00) 00010000:00010000:1.0:1746129566.574206:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129566.574208:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1b800/0x40a459093b0690b4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129566.574212:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1b800/0x40a459093b0690b4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129566.574250:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1ae00/0x40a459093b0690a6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20805 expref: 307 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129566.574261:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1aa00/0x40a459093b0690bb lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20805 expref: 306 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129566.574267:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009f469400) 00010000:00010000:1.0:1746129566.574269:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746129566.574271:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ee1aa00, rc 0) 00000100:00100000:1.0:1746129566.575106:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094efe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ada2ffba-8920-4ecb-8068-68caa9806978+306:32132:x1830948733984256:12345-192.168.202.4@tcp:101:cat.0 Request processed in 1451us (2575us total) trans 8589945223 rc 0/0 00000100:00100000:1.0:1746129566.575114:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11145 00000100:00100000:0.0:1746129566.576802:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129566.576913:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733984512 00000100:00100000:3.0:1746129566.576921:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733984512 00000100:00100000:3.0:1746129566.576969:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4713 00000100:00100000:3.0:1746129566.576977:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ada2ffba-8920-4ecb-8068-68caa9806978+306:32132:x1830948733984512:12345-192.168.202.4@tcp:35:cat.0 00000100:00100000:3.0:1746129566.577195:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ada2ffba-8920-4ecb-8068-68caa9806978+307:32132:x1830948733984512:12345-192.168.202.4@tcp:35:cat.0 Request processed in 219us (399us total) trans 8589945224 rc 0/0 00000100:00100000:3.0:1746129566.577202:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4713 00000100:00100000:0.0:1746129566.579198:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129566.579248:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129566.579432:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733984640 00000100:00100000:3.0:1746129566.579444:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733984640 00000100:00100000:3.0:1746129566.579492:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733984768 00000100:00100000:3.0:1746129566.579495:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733984768 00000100:00100000:2.0:1746129566.579504:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15828 00000100:00100000:2.0:1746129566.579513:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013577c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ada2ffba-8920-4ecb-8068-68caa9806978+27:1963:x1830948733984640:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129566.579530:0:7148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129566.579548:0:7148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f6ca00/0x40a459093b0690c9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2080c expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129566.579574:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129566.579576:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129566.579585:0:7148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f6ca00/0x40a459093b0690c9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2080c expref: 28 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129566.579600:0:7148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095f6ca00/0x40a459093b0690c9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2080c expref: 28 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129566.579611:0:7148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f6ca00, rc 0) 00000100:00100000:3.0:1746129566.579739:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15829 00000100:00100000:3.0:1746129566.579745:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013577c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ada2ffba-8920-4ecb-8068-68caa9806978+27:1963:x1830948733984768:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129566.579753:0:7149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129566.579762:0:7149:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b4e0e600/0x40a459093b0690d0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20813 expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129566.579793:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013577c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ada2ffba-8920-4ecb-8068-68caa9806978+28:1963:x1830948733984640:12345-192.168.202.4@tcp:101:cat.0 Request processed in 281us (602us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129566.579798:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15828 00000100:00100000:3.0:1746129566.579802:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135725500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7149:1830948737458816:192.168.202.4@tcp:106: 00000100:00100000:3.0:1746129566.580395:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a7ba80 going to sleep for 11 seconds 00000100:00100000:3.0:1746129566.580853:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135725500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7149:1830948737458816:192.168.202.4@tcp:106: 00010000:00010000:3.0:1746129566.580877:0:7149:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b4e0e600/0x40a459093b0690d0 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20813 expref: 28 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129566.580888:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b4e0e600/0x40a459093b0690d0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20813 expref: 28 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129566.580897:0:7149:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4e0e600, rc 0) 00000100:00100000:3.0:1746129566.580923:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013577c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ada2ffba-8920-4ecb-8068-68caa9806978+27:1963:x1830948733984768:12345-192.168.202.4@tcp:101:cat.0 Request processed in 1177us (1674us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129566.580929:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15829 00000100:00100000:1.0:1746129566.587014:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129566.587076:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129566.587855:0:31521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733985024 00000100:00100000:2.0:1746129566.587869:0:31521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733985024 00002000:00100000:2.0:1746129566.587928:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3ec:0x0] (0->1048575) req@ffff880092fd1180 x1830948733985024/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:307/0 lens 488/0 e 0 to 0 dl 1746129577 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129566.587938:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092fd1180 with x1830948733985024 ext(0->1048575) 00002000:00010000:2.0:1746129566.587944:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092fd1180 00000100:00100000:2.0:1746129566.587977:0:31521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733985152 00000100:00100000:2.0:1746129566.587980:0:31521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733985152 00002000:00100000:2.0:1746129566.587991:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3ee:0x0] (1048576->2002943) req@ffff880092fd1500 x1830948733985152/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:307/0 lens 488/0 e 0 to 0 dl 1746129577 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129566.587997:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092fd1500 with x1830948733985152 ext(1048576->2002943) 00002000:00010000:2.0:1746129566.588001:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092fd1500 00000100:00100000:0.0:1746129566.588003:0:21463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7606 00000100:00100000:2.0:1746129566.588014:0:31521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7607 00000100:00100000:0.0:1746129566.588014:0:21463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092fd1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ada2ffba-8920-4ecb-8068-68caa9806978+29:1960:x1830948733985024:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:2.0:1746129566.588018:0:31521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092fd1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ada2ffba-8920-4ecb-8068-68caa9806978+29:1961:x1830948733985152:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:2.0:1746129566.604455:0:31521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092fd1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ada2ffba-8920-4ecb-8068-68caa9806978+30:1961:x1830948733985152:12345-192.168.202.4@tcp:3:cat.0 Request processed in 16422us (17369us total) trans 0 rc 954368/954368 00000100:00100000:2.0:1746129566.604470:0:31521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7607 00002000:00100000:2.0:1746129566.604485:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3ee:0x0] (1048576->2002943) req@ffff880092fd1500 x1830948733985152/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:307/0 lens 488/440 e 0 to 0 dl 1746129577 ref 1 fl Complete:/200/0 rc 954368/954368 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129566.604495:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092fd1500 with x1830948733985152 ext(1048576->2002943) 00002000:00010000:2.0:1746129566.604501:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092fd1500 00000100:00100000:1.0:1746129566.606408:0:21463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092fd1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ada2ffba-8920-4ecb-8068-68caa9806978+28:1960:x1830948733985024:12345-192.168.202.4@tcp:3:cat.0 Request processed in 18386us (19394us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129566.606419:0:21463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7606 00002000:00100000:1.0:1746129566.606431:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3ec:0x0] (0->1048575) req@ffff880092fd1180 x1830948733985024/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:307/0 lens 488/440 e 0 to 0 dl 1746129577 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129566.606447:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092fd1180 with x1830948733985024 ext(0->1048575) 00002000:00010000:1.0:1746129566.606452:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092fd1180 00000100:00100000:0.0:1746129566.626212:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129566.627962:0:21463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733985536 00000100:00100000:1.0:1746129566.627977:0:21463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733985536 00002000:00100000:1.0:1746129566.628033:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3ef:0x0] (2105344->3145727) req@ffff88013577dc00 x1830948733985536/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:307/0 lens 488/0 e 0 to 0 dl 1746129577 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129566.628043:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013577dc00 with x1830948733985536 ext(2105344->3145727) 00002000:00010000:1.0:1746129566.628049:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013577dc00 00000100:00100000:1.0:1746129566.628086:0:21463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7608 00000100:00100000:1.0:1746129566.628095:0:21463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013577dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ada2ffba-8920-4ecb-8068-68caa9806978+28:1960:x1830948733985536:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129566.635230:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129566.635748:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733985664 00000100:00100000:3.0:1746129566.635759:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733985664 00000100:00100000:3.0:1746129566.635816:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15830 00000100:00100000:3.0:1746129566.635825:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013577d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+15:32128:x1830948733985664:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:3.0:1746129566.635847:0:7149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129566.635864:0:7149:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b4e0fa00/0x40a459093b0690d7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2081a expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129566.635893:0:7149:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b4cb5200/0x40a459093b06907c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2105343) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f207f7 expref: 29 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129566.635900:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129566.635902:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129566.635905:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4e0fa00/0x40a459093b0690d7 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [3145728->3227647] (req 3145728->3227647) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2081a expref: 16 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129566.635937:0:7149:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b4cb5200/0x40a459093b06907c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2105343) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f207f7 expref: 29 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129566.635954:0:7149:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b4cb5200/0x40a459093b06907c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2105343) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f207f7 expref: 29 pid: 7149 timeout: 921 lvb_type: 0 00000100:00100000:3.0:1746129566.635967:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135725500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7149:1830948737458944:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129566.636078:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a7ba80 going to sleep for 11 seconds 00000100:00100000:1.0:1746129566.640095:0:21463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013577dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ada2ffba-8920-4ecb-8068-68caa9806978+28:1960:x1830948733985536:12345-192.168.202.4@tcp:3:cat.0 Request processed in 11988us (13883us total) trans 0 rc 1040384/1040384 00000100:00100000:1.0:1746129566.640107:0:21463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7608 00002000:00100000:1.0:1746129566.640120:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3ef:0x0] (2105344->3145727) req@ffff88013577dc00 x1830948733985536/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:307/0 lens 488/440 e 0 to 0 dl 1746129577 ref 1 fl Complete:/200/0 rc 1040384/1040384 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129566.640128:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013577dc00 with x1830948733985536 ext(2105344->3145727) 00010000:00010000:1.0:1746129566.640138:0:21463:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800b4cb5200/0x40a459093b06907c lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2105343) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f207f7 expref: 28 pid: 7149 timeout: 921 lvb_type: 0 00010000:00010000:1.0:1746129566.640152:0:21463:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800b4cb5200/0x40a459093b06907c lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2105343) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f207f7 expref: 28 pid: 7149 timeout: 921 lvb_type: 0 00002000:00010000:1.0:1746129566.640159:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88013577dc00 00000100:00100000:0.0:1746129566.640704:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129566.640886:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135725500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7149:1830948737458944:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129566.640916:0:7149:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b4e0fa00/0x40a459093b0690d7 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [3145728->3227647] (req 3145728->3227647) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2081a expref: 16 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129566.640932:0:7149:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4e0fa00, rc 0) 00000100:00100000:3.0:1746129566.640972:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013577d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+16:32128:x1830948733985664:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 5149us (5754us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129566.640980:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15830 00000100:00100000:1.0:1746129566.641577:0:21463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733985792 00000100:00100000:1.0:1746129566.641586:0:21463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733985792 00002000:00100000:1.0:1746129566.641620:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3ef:0x0] (2097152->2105343) req@ffff88013577fb80 x1830948733985792/t0(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:307/0 lens 8680/0 e 0 to 0 dl 1746129577 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129566.641627:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013577fb80 with x1830948733985792 ext(2097152->2105343) 00010000:00010000:1.0:1746129566.641632:0:21463:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800b4cb5200/0x40a459093b06907c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2105343) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f207f7 expref: 28 pid: 7149 timeout: 921 lvb_type: 0 00010000:00010000:1.0:1746129566.641643:0:21463:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800b4cb5200/0x40a459093b06907c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2105343) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f207f7 expref: 28 pid: 7149 timeout: 921 lvb_type: 0 00002000:00010000:1.0:1746129566.641649:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88013577fb80 00000100:00100000:1.0:1746129566.641681:0:21463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2378 00000100:00100000:1.0:1746129566.641688:0:21463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013577fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ada2ffba-8920-4ecb-8068-68caa9806978+28:1963:x1830948733985792:12345-192.168.202.4@tcp:4:cat.0 00000100:00100000:1.0:1746129566.642049:0:21463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013577fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ada2ffba-8920-4ecb-8068-68caa9806978+30:1963:x1830948733985792:12345-192.168.202.4@tcp:4:cat.0 Request processed in 361us (1346us total) trans 21474841287 rc 0/0 00000100:00100000:1.0:1746129566.642056:0:21463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2378 00002000:00100000:1.0:1746129566.642062:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3ef:0x0] (2097152->2105343) req@ffff88013577fb80 x1830948733985792/t21474841287(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:307/0 lens 8680/448 e 0 to 0 dl 1746129577 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129566.642069:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013577fb80 with x1830948733985792 ext(2097152->2105343) 00010000:00010000:1.0:1746129566.642074:0:21463:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800b4cb5200/0x40a459093b06907c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2105343) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f207f7 expref: 30 pid: 7149 timeout: 921 lvb_type: 0 00010000:00010000:1.0:1746129566.642083:0:21463:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800b4cb5200/0x40a459093b06907c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2105343) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f207f7 expref: 30 pid: 7149 timeout: 921 lvb_type: 0 00002000:00010000:1.0:1746129566.642088:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88013577fb80 00000100:00100000:0.0:1746129566.647951:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129566.651471:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733985920 00000100:00100000:3.0:1746129566.651487:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733985920 00000100:00100000:3.0:1746129566.651568:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15831 00000100:00100000:3.0:1746129566.651576:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013577f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ada2ffba-8920-4ecb-8068-68caa9806978+27:32132:x1830948733985920:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129566.651597:0:7149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129566.651617:0:7149:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b4e0ee00/0x40a459093b0690de lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20821 expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129566.651648:0:7149:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f581a00/0x40a459093b068fd4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3969024->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20795 expref: 13 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129566.651661:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129566.651663:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129566.651667:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b4e0ee00/0x40a459093b0690de lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20821 expref: 28 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129566.651700:0:7149:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012f581a00/0x40a459093b068fd4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3969024->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20795 expref: 13 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129566.651711:0:7149:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012f581a00/0x40a459093b068fd4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3969024->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20795 expref: 13 pid: 7149 timeout: 921 lvb_type: 0 00000100:00100000:3.0:1746129566.651723:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135725500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7149:1830948737459072:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129566.651837:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a7ba80 going to sleep for 11 seconds 00000100:00100000:2.0:1746129566.652456:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129566.652568:0:15749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733986048 00000100:00100000:0.0:1746129566.652573:0:15749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733986048 00010000:00010000:0.0:1746129566.652597:0:15749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4cb5200/0x40a459093b06907c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2105343) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f207f7 expref: 30 pid: 7149 timeout: 921 lvb_type: 0 00000100:00100000:0.0:1746129566.652630:0:15749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8093 00000100:00100000:0.0:1746129566.652636:0:15749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6fd0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ada2ffba-8920-4ecb-8068-68caa9806978+30:1963:x1830948733986048:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129566.652645:0:15749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129566.652669:0:15749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b4cb5200/0x40a459093b06907c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2105343) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f207f7 expref: 30 pid: 7149 timeout: 921 lvb_type: 0 00010000:00010000:0.0:1746129566.652680:0:15749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b4cb5200/0x40a459093b06907c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2105343) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f207f7 expref: 30 pid: 7149 timeout: 921 lvb_type: 0 00010000:00010000:0.0:1746129566.652699:0:15749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b4cb5200/0x40a459093b06907c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2105343) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f207f7 expref: 30 pid: 7149 timeout: 921 lvb_type: 0 00010000:00010000:0.0:1746129566.652715:0:15749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129566.652717:0:15749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129566.652723:0:15749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b4e0fa00/0x40a459093b0690d7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3227647) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2081a expref: 15 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129566.652731:0:15749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4e0fa00/0x40a459093b0690d7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3227647) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2081a expref: 15 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129566.652761:0:15749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800b4e0fa00/0x40a459093b0690d7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3227647) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2081a expref: 15 pid: 7149 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129566.652770:0:15749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013577ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15749:1830948737459200:192.168.202.4@tcp:105: 00000100:00100000:0.0:1746129566.652824:0:15749:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a00480 going to sleep for 11 seconds 00000100:00100000:0.0:1746129566.653502:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129566.653788:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733986304 00000100:00100000:1.0:1746129566.653794:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733986304 00000100:00100000:1.0:1746129566.654060:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11146 00000100:00100000:1.0:1746129566.654067:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013577e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ada2ffba-8920-4ecb-8068-68caa9806978+307:32134:x1830948733986304:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:1.0:1746129566.654087:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129566.654101:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1b800/0x40a459093b0690e5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20828 expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129566.654187:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1b000/0x40a459093b0690ec lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129566.654202:0:14549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1b600/0x40a459093b069098 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f207fe expref: 23 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129566.654209:0:14549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1aa00/0x40a459093b0690bb lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20805 expref: 308 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129566.654215:0:14549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1b000/0x40a459093b0690ec lrc: 5/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129566.654237:0:14549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1aa00/0x40a459093b0690bb lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20805 expref: 308 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129566.654245:0:14549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1aa00/0x40a459093b0690bb lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20805 expref: 308 pid: 14549 timeout: 921 lvb_type: 0 00000100:00100000:1.0:1746129566.654254:0:14549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092fd1880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830948737459328:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129566.654364:0:14549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1b600/0x40a459093b069098 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f207fe expref: 23 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129566.654377:0:14549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1b600/0x40a459093b069098 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f207fe expref: 23 pid: 14549 timeout: 921 lvb_type: 0 00000100:00100000:1.0:1746129566.654385:0:14549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092fd1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830948737459456:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129566.654405:0:14549:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c954d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746129566.654799:0:15749:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013577ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15749:1830948737459200:192.168.202.4@tcp:105: 00010000:00010000:0.0:1746129566.654817:0:15749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129566.654837:0:15749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6fd0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ada2ffba-8920-4ecb-8068-68caa9806978+29:1963:x1830948733986048:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 2201us (2383us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129566.654844:0:15749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8093 00000100:00100000:2.0:1746129566.654987:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135725500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7149:1830948737459072:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129566.655006:0:7149:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b4e0ee00/0x40a459093b0690de lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20821 expref: 28 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129566.655023:0:7149:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4e0ee00, rc 0) 00000100:00100000:2.0:1746129566.655057:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013577f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ada2ffba-8920-4ecb-8068-68caa9806978+28:32132:x1830948733985920:12345-192.168.202.4@tcp:101:cat.0 Request processed in 3482us (7124us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129566.655064:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15831 00000100:00100000:2.0:1746129566.656103:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129566.656753:0:14549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092fd1880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830948737459328:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129566.656763:0:14549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092fd1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830948737459456:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129566.656784:0:14549:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1b000/0x40a459093b0690ec lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000100:00100000:3.0:1746129566.656842:0:31521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733986560 00000100:00100000:3.0:1746129566.656850:0:31521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733986560 00002000:00100000:3.0:1746129566.656891:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3ef:0x0] (3223552->3227647) req@ffff880095626300 x1830948733986560/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:307/0 lens 488/0 e 0 to 0 dl 1746129577 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129566.656901:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095626300 with x1830948733986560 ext(3223552->3227647) 00002000:00010000:3.0:1746129566.656906:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095626300 00000100:00100000:3.0:1746129566.656923:0:31521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7609 00000100:00100000:3.0:1746129566.656929:0:31521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095626300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+16:1962:x1830948733986560:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:3.0:1746129566.657425:0:31521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095626300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+16:1962:x1830948733986560:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 495us (1323us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129566.657431:0:31521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7609 00002000:00100000:3.0:1746129566.657438:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3ef:0x0] (3223552->3227647) req@ffff880095626300 x1830948733986560/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:307/0 lens 488/4536 e 0 to 0 dl 1746129577 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129566.657445:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095626300 with x1830948733986560 ext(3223552->3227647) 00002000:00010000:3.0:1746129566.657448:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095626300 00000100:00100000:0.0:1746129566.657592:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129566.657687:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129566.657704:0:15749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733986816 00000100:00100000:0.0:1746129566.657707:0:15749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733986816 00010000:00010000:0.0:1746129566.657725:0:15749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1aa00/0x40a459093b0690bb lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20805 expref: 309 pid: 14549 timeout: 921 lvb_type: 0 00000100:00100000:3.0:1746129566.658058:0:31521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733986688 00000100:00100000:3.0:1746129566.658061:0:31521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733986688 00002000:00100000:3.0:1746129566.658078:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f5:0x0] (2437120->4194303) req@ffff88013577ce00 x1830948733986688/t0(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:307/0 lens 504/0 e 0 to 0 dl 1746129577 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129566.658090:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013577ce00 with x1830948733986688 ext(2437120->4194303) 00010000:00010000:3.0:1746129566.658097:0:31521:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012f581a00/0x40a459093b068fd4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3969024->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20795 expref: 14 pid: 7149 timeout: 921 lvb_type: 0 00010000:00010000:3.0:1746129566.658109:0:31521:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012f581a00/0x40a459093b068fd4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3969024->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20795 expref: 14 pid: 7149 timeout: 921 lvb_type: 0 00002000:00010000:3.0:1746129566.658114:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88013577ce00 00000100:00100000:3.0:1746129566.658780:0:31521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2379 00000100:00100000:3.0:1746129566.658789:0:31521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013577ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+14:1963:x1830948733986688:12345-192.168.202.4@tcp:4:multiop.0 00000100:00100000:2.0:1746129566.659874:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8094 00000100:00100000:2.0:1746129566.659885:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013577d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ada2ffba-8920-4ecb-8068-68caa9806978+309:1962:x1830948733986816:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129566.659896:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129566.659905:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1aa00/0x40a459093b0690bb lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20805 expref: 309 pid: 14549 timeout: 921 lvb_type: 0 00010000:00010000:2.0:1746129566.659918:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1aa00/0x40a459093b0690bb lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20805 expref: 309 pid: 14549 timeout: 921 lvb_type: 0 00010000:00010000:2.0:1746129566.659940:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1aa00/0x40a459093b0690bb lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20805 expref: 309 pid: 14549 timeout: 921 lvb_type: 0 00010000:00010000:2.0:1746129566.659959:0:9823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009f469400) 00010000:00010000:2.0:1746129566.659964:0:9823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1b000/0x40a459093b0690ec lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129566.659971:0:9823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1b000/0x40a459093b0690ec lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129566.659977:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129566.661793:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013577d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ada2ffba-8920-4ecb-8068-68caa9806978+308:1962:x1830948733986816:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 1900us (4094us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129566.661808:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8094 00000100:00100000:2.0:1746129566.662120:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129566.662635:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733986944 00000100:00100000:2.0:1746129566.662644:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733986944 00010000:00010000:2.0:1746129566.662677:0:9823:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1b600/0x40a459093b069098 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f207fe expref: 24 pid: 14549 timeout: 921 lvb_type: 0 00000100:00100000:2.0:1746129566.662900:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8095 00000100:00100000:2.0:1746129566.662908:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095627800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+24:1962:x1830948733986944:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129566.662923:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129566.662929:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1b600/0x40a459093b069098 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f207fe expref: 24 pid: 14549 timeout: 921 lvb_type: 0 00010000:00010000:2.0:1746129566.662941:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1b600/0x40a459093b069098 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f207fe expref: 24 pid: 14549 timeout: 921 lvb_type: 0 00010000:00010000:2.0:1746129566.662962:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1b600/0x40a459093b069098 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f207fe expref: 24 pid: 14549 timeout: 921 lvb_type: 0 00010000:00010000:2.0:1746129566.662976:0:9823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009f469400) 00010000:00010000:2.0:1746129566.662980:0:9823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1b000/0x40a459093b0690ec lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129566.662989:0:9823:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1b000/0x40a459093b0690ec lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129566.662995:0:9823:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1b000/0x40a459093b0690ec lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129566.663030:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129566.663064:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095627800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+23:1962:x1830948733986944:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 158us (946us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129566.663070:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8095 00000100:00100000:3.0:1746129566.663156:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129566.663261:0:14551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733987200 00000100:00100000:1.0:1746129566.663266:0:14551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733987200 00000100:00100000:1.0:1746129566.663307:0:14551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4714 00000100:00100000:1.0:1746129566.663312:0:14551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135725f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+23:32128:x1830948733987200:12345-192.168.202.4@tcp:35:multiop.0 00000100:00100000:1.0:1746129566.663509:0:14551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135725f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+24:32128:x1830948733987200:12345-192.168.202.4@tcp:35:multiop.0 Request processed in 195us (352us total) trans 8589945225 rc 0/0 00000100:00100000:1.0:1746129566.663515:0:14551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4714 00010000:00010000:1.0:1746129566.663533:0:14549:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1b000/0x40a459093b0690ec lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129566.663541:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1b000/0x40a459093b0690ec lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00200000:1.0:1746129566.663556:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:1.0:1746129566.663621:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1b800/0x40a459093b0690e5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20828 expref: 309 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129566.663638:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1b000/0x40a459093b0690ec lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20828 expref: 308 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129566.663644:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009f469400) 00010000:00010000:1.0:1746129566.663647:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746129566.663649:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ee1b000, rc 0) 00000100:00100000:1.0:1746129566.663668:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013577e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ada2ffba-8920-4ecb-8068-68caa9806978+308:32134:x1830948733986304:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 9602us (10168us total) trans 8589945226 rc 0/0 00000100:00100000:1.0:1746129566.663674:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11146 00000100:00100000:3.0:1746129566.676498:0:31521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013577ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+16:1963:x1830948733986688:12345-192.168.202.4@tcp:4:multiop.0 Request processed in 17697us (18892us total) trans 17179874048 rc 0/0 00000100:00100000:3.0:1746129566.676512:0:31521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2379 00002000:00100000:3.0:1746129566.676524:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f5:0x0] (2437120->4194303) req@ffff88013577ce00 x1830948733986688/t17179874048(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:307/0 lens 504/448 e 0 to 0 dl 1746129577 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129566.676534:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013577ce00 with x1830948733986688 ext(2437120->4194303) 00010000:00010000:3.0:1746129566.676546:0:31521:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012f581a00/0x40a459093b068fd4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3969024->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20795 expref: 16 pid: 7149 timeout: 921 lvb_type: 0 00010000:00010000:3.0:1746129566.676561:0:31521:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012f581a00/0x40a459093b068fd4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3969024->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20795 expref: 16 pid: 7149 timeout: 921 lvb_type: 0 00002000:00010000:3.0:1746129566.676568:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88013577ce00 00000100:00100000:0.0:1746129566.683211:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129566.683338:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733987328 00000100:00100000:2.0:1746129566.683347:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733987328 00010000:00010000:2.0:1746129566.683401:0:9823:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012f581a00/0x40a459093b068fd4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3969024->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20795 expref: 16 pid: 7149 timeout: 921 lvb_type: 0 00000100:00100000:2.0:1746129566.683432:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8096 00000100:00100000:2.0:1746129566.683439:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013577f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+16:1962:x1830948733987328:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129566.683455:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129566.683480:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: ffff88012f581a00/0x40a459093b068fd4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3969024->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20795 expref: 16 pid: 7149 timeout: 921 lvb_type: 0 00010000:00010000:2.0:1746129566.683492:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012f581a00/0x40a459093b068fd4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3969024->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20795 expref: 16 pid: 7149 timeout: 921 lvb_type: 0 00010000:00010000:2.0:1746129566.683517:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f581a00/0x40a459093b068fd4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3969024->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20795 expref: 16 pid: 7149 timeout: 921 lvb_type: 0 00010000:00010000:2.0:1746129566.683554:0:9823:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129566.683556:0:9823:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129566.683563:0:9823:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b4e0ee00/0x40a459093b0690de lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20821 expref: 27 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129566.683571:0:9823:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b4e0ee00/0x40a459093b0690de lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20821 expref: 27 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129566.683605:0:9823:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800b4e0ee00/0x40a459093b0690de lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20821 expref: 27 pid: 7149 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129566.683619:0:9823:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095627100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9823:1830948737459584:192.168.202.4@tcp:105: 00000100:00100000:2.0:1746129566.683711:0:9823:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800951de900 going to sleep for 11 seconds 00000100:00100000:2.0:1746129566.692029:0:9823:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095627100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9823:1830948737459584:192.168.202.4@tcp:105: 00010000:00010000:2.0:1746129566.692057:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129566.692115:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013577f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+15:1962:x1830948733987328:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 8674us (8914us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129566.692127:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8096 00000100:00100000:0.0:1746129566.698202:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129566.698389:0:31521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733987584 00000100:00100000:3.0:1746129566.698399:0:31521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733987584 00002000:00100000:3.0:1746129566.698450:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f5:0x0] (2097152->3145727) req@ffff88013577c000 x1830948733987584/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:307/0 lens 488/0 e 0 to 0 dl 1746129577 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129566.698459:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013577c000 with x1830948733987584 ext(2097152->3145727) 00002000:00010000:3.0:1746129566.698465:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013577c000 00000100:00100000:3.0:1746129566.698546:0:31521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7610 00000100:00100000:3.0:1746129566.698556:0:31521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013577c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ada2ffba-8920-4ecb-8068-68caa9806978+28:1963:x1830948733987584:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:3.0:1746129566.714311:0:31521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013577c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ada2ffba-8920-4ecb-8068-68caa9806978+28:1963:x1830948733987584:12345-192.168.202.4@tcp:3:cat.0 Request processed in 15721us (16085us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129566.714328:0:31521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7610 00002000:00100000:3.0:1746129566.714344:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f5:0x0] (2097152->3145727) req@ffff88013577c000 x1830948733987584/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:307/0 lens 488/440 e 0 to 0 dl 1746129577 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129566.714367:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013577c000 with x1830948733987584 ext(2097152->3145727) 00002000:00010000:3.0:1746129566.714374:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013577c000 00000100:00100000:0.0:1746129566.716125:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129566.717809:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733987840 00000100:00100000:1.0:1746129566.717820:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733987840 00000100:00100000:1.0:1746129566.717885:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11147 00000100:00100000:1.0:1746129566.717893:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013577ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+24:32138:x1830948733987840:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129566.717920:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129566.717939:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd7fe00/0x40a459093b0690fa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2082f expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129566.718055:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd7f400/0x40a459093b069101 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129566.718069:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd7f400/0x40a459093b069101 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129566.718082:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd7f400/0x40a459093b069101 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129566.718095:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd7e200/0x40a459093b069108 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129566.718105:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd7e200/0x40a459093b069108 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129566.718110:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd7e200/0x40a459093b069108 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129566.718218:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd7ec00/0x40a459093b06910f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129566.718226:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd7ec00/0x40a459093b06910f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129566.718232:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd7ec00/0x40a459093b06910f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00200000:1.0:1746129566.718240:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:1.0:1746129566.718334:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd7f400/0x40a459093b069101 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129566.718340:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd7f400/0x40a459093b069101 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129566.718345:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd7f400/0x40a459093b069101 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129566.718358:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012cd7f400 already unused, calling callback (ffffffffa136e690) 00010000:00010000:1.0:1746129566.718362:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd7f400/0x40a459093b069101 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129566.718367:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd7f400/0x40a459093b069101 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129566.718377:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880132ef8f00) 00010000:00010000:1.0:1746129566.718380:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129566.718384:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd7f400/0x40a459093b069101 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129566.718388:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd7f400/0x40a459093b069101 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129566.718410:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd7e200/0x40a459093b069108 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129566.718414:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd7e200/0x40a459093b069108 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129566.718418:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd7e200/0x40a459093b069108 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129566.718422:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012cd7e200 already unused, calling callback (ffffffffa136e690) 00010000:00010000:1.0:1746129566.718424:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd7e200/0x40a459093b069108 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129566.718428:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd7e200/0x40a459093b069108 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129566.718432:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009cffec00) 00010000:00010000:1.0:1746129566.718434:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129566.718435:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd7e200/0x40a459093b069108 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129566.718439:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd7e200/0x40a459093b069108 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129566.718470:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd7fe00/0x40a459093b0690fa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2082f expref: 27 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129566.718484:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd7ec00/0x40a459093b06910f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2082f expref: 26 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129566.718489:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009f469400) 00010000:00010000:1.0:1746129566.718491:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746129566.718493:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cd7ec00, rc 0) 00000100:00100000:1.0:1746129566.718542:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013577ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+26:32138:x1830948733987840:12345-192.168.202.4@tcp:101:cat.0 Request processed in 650us (2425us total) trans 8589945227 rc 0/0 00000100:00100000:1.0:1746129566.718548:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11147 00000100:00100000:0.0:1746129566.719224:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129566.720561:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733987968 00000100:00100000:2.0:1746129566.720571:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733987968 00000100:00100000:2.0:1746129566.720615:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15832 00000100:00100000:2.0:1746129566.720621:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013577ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ada2ffba-8920-4ecb-8068-68caa9806978+29:32132:x1830948733987968:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129566.720637:0:7149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129566.720651:0:7149:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e798600/0x40a459093b06911d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20836 expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129566.720683:0:7149:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b4e0fa00/0x40a459093b0690d7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3227647) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2081a expref: 15 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129566.720691:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129566.720693:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129566.720696:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e798600/0x40a459093b06911d lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20836 expref: 30 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129566.720729:0:7149:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b4e0fa00/0x40a459093b0690d7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3227647) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2081a expref: 15 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129566.720741:0:7149:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b4e0fa00/0x40a459093b0690d7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3227647) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2081a expref: 15 pid: 7149 timeout: 922 lvb_type: 0 00000100:00100000:2.0:1746129566.720753:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095627100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7149:1830948737459712:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129566.720845:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800951de900 going to sleep for 11 seconds 00000100:00100000:0.0:1746129566.721816:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129566.721858:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733988096 00000100:00100000:2.0:1746129566.721863:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733988096 00000100:00100000:2.0:1746129566.721910:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 781 00000100:00100000:2.0:1746129566.721916:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013575f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+26:1961:x1830948733988096:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129566.721930:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129566.721953:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd7ec00/0x40a459093b06910f lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2082f expref: 26 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129566.721978:0:9823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009f469400) 00010000:00010000:2.0:1746129566.721982:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129566.722018:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013575f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+25:1961:x1830948733988096:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 101us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129566.722025:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 781 00000100:00100000:2.0:1746129566.722749:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095627100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7149:1830948737459712:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129566.722774:0:7149:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008e798600/0x40a459093b06911d lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20836 expref: 30 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129566.722792:0:7149:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e798600, rc 0) 00000100:00100000:2.0:1746129566.722828:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013577ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ada2ffba-8920-4ecb-8068-68caa9806978+30:32132:x1830948733987968:12345-192.168.202.4@tcp:101:cat.0 Request processed in 2206us (3604us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129566.722834:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15832 00000100:00100000:0.0:1746129566.723051:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129566.723088:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129566.723102:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129566.723118:0:22481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733988352 00000100:00100000:0.0:1746129566.723123:0:22481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733988352 00000100:00100000:0.0:1746129566.723144:0:22481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733988480 00000100:00100000:0.0:1746129566.723146:0:22481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733988480 00000100:00100000:0.0:1746129566.723159:0:22481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15833 00000100:00100000:0.0:1746129566.723164:0:22481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013575d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+17:1962:x1830948733988352:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129566.723176:0:22481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129566.723188:0:22481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f8d4200/0x40a459093b069124 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2083d expref: -99 pid: 22481 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129566.723229:0:22481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094efca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:22481:1830948737459840:192.168.202.4@tcp:106: 00000100:00100000:0.0:1746129566.723277:0:22481:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a00180 going to sleep for 11 seconds 00000100:00100000:0.0:1746129566.723317:0:8412:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15834 00000100:00100000:0.0:1746129566.723323:0:8412:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013575e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+18:1962:x1830948733988480:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129566.723330:0:8412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129566.723336:0:8412:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f8d5400/0x40a459093b06912b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20844 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129566.723368:0:8412:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094efdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8412:1830948737459968:192.168.202.4@tcp:106: 00000100:00100000:0.0:1746129566.723398:0:8412:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a00600 going to sleep for 11 seconds 00000100:00100000:0.0:1746129566.723428:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129566.723532:0:31521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733988224 00000100:00100000:3.0:1746129566.723536:0:31521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733988224 00002000:00100000:3.0:1746129566.723565:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->3227647) req@ffff88013575d880 x1830948733988224/t0(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:307/0 lens 488/0 e 0 to 0 dl 1746129577 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129566.723579:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013575d880 with x1830948733988224 ext(3145728->3227647) 00010000:00010000:3.0:1746129566.723586:0:31521:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800b4e0fa00/0x40a459093b0690d7 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3227647) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2081a expref: 20 pid: 7149 timeout: 922 lvb_type: 0 00010000:00010000:3.0:1746129566.723596:0:31521:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800b4e0fa00/0x40a459093b0690d7 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3227647) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2081a expref: 20 pid: 7149 timeout: 922 lvb_type: 0 00002000:00010000:3.0:1746129566.723602:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88013575d880 00000100:00100000:3.0:1746129566.723618:0:31521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2380 00000100:00100000:3.0:1746129566.723623:0:31521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013575d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:1963:x1830948733988224:12345-192.168.202.4@tcp:4:multiop.0 00000100:00100000:3.0:1746129566.723795:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733988608 00000100:00100000:3.0:1746129566.723798:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733988608 00000100:00100000:3.0:1746129566.723814:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15835 00000100:00100000:3.0:1746129566.723818:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094029f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+15:1962:x1830948733988608:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129566.723825:0:7148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129566.723839:0:7148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800946c6e00/0x40a459093b069132 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2084b expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129566.723850:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129566.723852:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129566.723859:0:7148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800946c6e00/0x40a459093b069132 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2084b expref: 16 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129566.723869:0:7148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800946c6e00/0x40a459093b069132 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2084b expref: 16 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129566.723881:0:7148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800946c6e00, rc 0) 00000100:00100000:3.0:1746129566.725051:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094029f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+16:1962:x1830948733988608:12345-192.168.202.4@tcp:101:cat.0 Request processed in 472us (863us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129566.725058:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15835 00000100:00100000:3.0:1746129566.728614:0:31521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013575d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+22:1963:x1830948733988224:12345-192.168.202.4@tcp:4:multiop.0 Request processed in 4976us (5548us total) trans 21474841288 rc 0/0 00000100:00100000:3.0:1746129566.728629:0:31521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2380 00002000:00100000:3.0:1746129566.728644:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->3227647) req@ffff88013575d880 x1830948733988224/t21474841288(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:307/0 lens 488/448 e 0 to 0 dl 1746129577 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129566.728653:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013575d880 with x1830948733988224 ext(3145728->3227647) 00010000:00010000:3.0:1746129566.728666:0:31521:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800b4e0fa00/0x40a459093b0690d7 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3227647) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2081a expref: 22 pid: 7149 timeout: 922 lvb_type: 0 00010000:00010000:3.0:1746129566.728682:0:31521:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800b4e0fa00/0x40a459093b0690d7 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3227647) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2081a expref: 22 pid: 7149 timeout: 922 lvb_type: 0 00002000:00010000:3.0:1746129566.728690:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88013575d880 00002000:00010000:1.0:1746129566.729176:0:8412:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb atime: 1746129566 -> 1746129567 00000100:00100000:1.0:1746129566.729195:0:8412:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094efdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8412:1830948737459968:192.168.202.4@tcp:106: 00010000:00010000:1.0:1746129566.729228:0:8412:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f8d5400/0x40a459093b06912b lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20844 expref: 21 pid: 8412 timeout: 0 lvb_type: 1 00002000:00010000:2.0:1746129566.729241:0:22481:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb mtime: 1746129566 -> 1746129567 00010000:00010000:1.0:1746129566.729242:0:8412:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f8d5400/0x40a459093b06912b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20844 expref: 21 pid: 8412 timeout: 0 lvb_type: 1 00002000:00010000:2.0:1746129566.729245:0:22481:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb atime: 1746129566 -> 1746129567 00002000:00010000:2.0:1746129566.729247:0:22481:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb ctime: 1746129566 -> 1746129567 00000100:00100000:2.0:1746129566.729262:0:22481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094efca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:22481:1830948737459840:192.168.202.4@tcp:106: 00010000:00010000:1.0:1746129566.729265:0:8412:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f8d5400, rc 0) 00010000:00010000:2.0:1746129566.729284:0:22481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f8d4200/0x40a459093b069124 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2083d expref: 20 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129566.729311:0:22481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f8d4200/0x40a459093b069124 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2083d expref: 20 pid: 22481 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746129566.729313:0:8412:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013575e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:1962:x1830948733988480:12345-192.168.202.4@tcp:101:cat.0 Request processed in 5989us (6209us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129566.729321:0:8412:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15834 00010000:00010000:2.0:1746129566.729323:0:22481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f8d4200, rc 0) 00000100:00100000:2.0:1746129566.729360:0:22481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013575d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+18:1962:x1830948733988352:12345-192.168.202.4@tcp:101:cat.0 Request processed in 6182us (6258us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129566.729368:0:22481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15833 00000100:00100000:0.0:1746129566.731596:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129566.731716:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733988736 00000100:00100000:2.0:1746129566.731727:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733988736 00010000:00010000:2.0:1746129566.731772:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4e0fa00/0x40a459093b0690d7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3227647) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2081a expref: 18 pid: 7149 timeout: 922 lvb_type: 0 00000100:00100000:2.0:1746129566.731828:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8097 00000100:00100000:2.0:1746129566.731840:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094028e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+18:1962:x1830948733988736:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129566.731860:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129566.731886:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b4e0fa00/0x40a459093b0690d7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3227647) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2081a expref: 18 pid: 7149 timeout: 922 lvb_type: 0 00010000:00010000:2.0:1746129566.731900:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b4e0fa00/0x40a459093b0690d7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3227647) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2081a expref: 18 pid: 7149 timeout: 922 lvb_type: 0 00010000:00010000:2.0:1746129566.731927:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b4e0fa00/0x40a459093b0690d7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3227647) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2081a expref: 18 pid: 7149 timeout: 922 lvb_type: 0 00010000:00010000:2.0:1746129566.731945:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129566.731947:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129566.731955:0:7085:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008e798600/0x40a459093b06911d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20836 expref: 29 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129566.731965:0:7085:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e798600/0x40a459093b06911d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20836 expref: 29 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129566.732003:0:7085:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008e798600/0x40a459093b06911d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20836 expref: 29 pid: 7149 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129566.732018:0:7085:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095627100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7085:1830948737460096:192.168.202.4@tcp:105: 00000100:00100000:2.0:1746129566.732145:0:7085:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800951de900 going to sleep for 11 seconds 00000100:00100000:2.0:1746129566.736235:0:7085:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095627100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7085:1830948737460096:192.168.202.4@tcp:105: 00010000:00010000:2.0:1746129566.736260:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129566.736341:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094028e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+17:1962:x1830948733988736:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 4502us (4751us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129566.736361:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8097 00000100:00100000:0.0:1746129566.738983:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129566.740205:0:31521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733989120 00000100:00100000:3.0:1746129566.740220:0:31521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733989120 00002000:00100000:3.0:1746129566.740282:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->4194303) req@ffff880094029880 x1830948733989120/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:307/0 lens 488/0 e 0 to 0 dl 1746129577 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746129566.741047:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00002000:00100000:3.0:1746129566.742533:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094029880 with x1830948733989120 ext(3145728->4194303) 00002000:00010000:3.0:1746129566.742544:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094029880 00000100:00100000:3.0:1746129566.742614:0:21463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733989248 00000100:00100000:3.0:1746129566.742625:0:21463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733989248 00002000:00100000:3.0:1746129566.742676:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3f5:0x0] (3145728->4194303) req@ffff880092fd1c00 x1830948733989248/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:307/0 lens 488/0 e 0 to 0 dl 1746129577 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129566.742686:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092fd1c00 with x1830948733989248 ext(3145728->4194303) 00002000:00010000:3.0:1746129566.742690:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092fd1c00 00000100:00100000:3.0:1746129566.742727:0:21463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7611 00000100:00100000:3.0:1746129566.742736:0:21463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094029880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ada2ffba-8920-4ecb-8068-68caa9806978+30:1960:x1830948733989120:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:1.0:1746129566.742751:0:21725:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7612 00000100:00100000:1.0:1746129566.742757:0:21725:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092fd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ada2ffba-8920-4ecb-8068-68caa9806978+28:1960:x1830948733989248:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129566.746249:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129566.746490:0:22481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733989376 00000100:00100000:2.0:1746129566.746499:0:22481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733989376 00000100:00100000:2.0:1746129566.746554:0:22481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15836 00000100:00100000:2.0:1746129566.746563:0:22481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094028700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+17:32138:x1830948733989376:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129566.746584:0:22481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129566.746605:0:22481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a6729200/0x40a459093b069139 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20852 expref: -99 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129566.746633:0:22481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a6729600/0x40a459093b069075 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2002944->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f207f0 expref: 31 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129566.746641:0:22481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129566.746642:0:22481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129566.746645:0:22481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6729200/0x40a459093b069139 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20852 expref: 18 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129566.746674:0:22481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a6729600/0x40a459093b069075 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2002944->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f207f0 expref: 31 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129566.746685:0:22481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a6729600/0x40a459093b069075 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2002944->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f207f0 expref: 31 pid: 7149 timeout: 922 lvb_type: 0 00000100:00100000:2.0:1746129566.746697:0:22481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095627100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:22481:1830948737460224:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129566.746767:0:22481:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800951de900 going to sleep for 11 seconds 00000100:00100000:2.0:1746129566.748719:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129566.748760:0:31521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733989504 00000100:00100000:2.0:1746129566.748767:0:31521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733989504 00002000:00100000:2.0:1746129566.748808:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3ee:0x0] (2002944->2097151) req@ffff880095625f80 x1830948733989504/t0(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:307/0 lens 488/0 e 0 to 0 dl 1746129577 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129566.748819:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095625f80 with x1830948733989504 ext(2002944->2097151) 00010000:00010000:2.0:1746129566.748828:0:31521:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a6729600/0x40a459093b069075 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2002944->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f207f0 expref: 32 pid: 7149 timeout: 922 lvb_type: 0 00010000:00010000:2.0:1746129566.748842:0:31521:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a6729600/0x40a459093b069075 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2002944->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f207f0 expref: 32 pid: 7149 timeout: 922 lvb_type: 0 00002000:00010000:2.0:1746129566.748850:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095625f80 00000100:00100000:2.0:1746129566.748885:0:31521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2381 00000100:00100000:2.0:1746129566.748892:0:31521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095625f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ada2ffba-8920-4ecb-8068-68caa9806978+32:1963:x1830948733989504:12345-192.168.202.4@tcp:4:cat.0 00000100:00100000:3.0:1746129566.749842:0:22481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095627100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:22481:1830948737460224:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129566.749870:0:22481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a6729200/0x40a459093b069139 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20852 expref: 18 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129566.749885:0:22481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6729200, rc 0) 00000100:00100000:3.0:1746129566.749914:0:22481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094028700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+18:32138:x1830948733989376:12345-192.168.202.4@tcp:101:cat.0 Request processed in 3352us (3676us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129566.749922:0:22481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15836 00000100:00100000:3.0:1746129566.762779:0:31521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095625f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ada2ffba-8920-4ecb-8068-68caa9806978+34:1963:x1830948733989504:12345-192.168.202.4@tcp:4:cat.0 Request processed in 13874us (14055us total) trans 21474841289 rc 0/0 00000100:00100000:3.0:1746129566.762791:0:31521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2381 00002000:00100000:3.0:1746129566.762804:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3ee:0x0] (2002944->2097151) req@ffff880095625f80 x1830948733989504/t21474841289(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:307/0 lens 488/448 e 0 to 0 dl 1746129577 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129566.762814:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095625f80 with x1830948733989504 ext(2002944->2097151) 00010000:00010000:3.0:1746129566.762825:0:31521:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a6729600/0x40a459093b069075 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2002944->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f207f0 expref: 34 pid: 7149 timeout: 922 lvb_type: 0 00010000:00010000:3.0:1746129566.762840:0:31521:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a6729600/0x40a459093b069075 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2002944->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f207f0 expref: 34 pid: 7149 timeout: 922 lvb_type: 0 00002000:00010000:3.0:1746129566.762848:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095625f80 00000100:00100000:1.0:1746129566.763249:0:21725:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092fd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ada2ffba-8920-4ecb-8068-68caa9806978+28:1960:x1830948733989248:12345-192.168.202.4@tcp:3:cat.0 Request processed in 20490us (22204us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129566.763256:0:21725:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7612 00002000:00100000:1.0:1746129566.763262:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f5:0x0] (3145728->4194303) req@ffff880092fd1c00 x1830948733989248/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:307/0 lens 488/440 e 0 to 0 dl 1746129577 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129566.763269:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092fd1c00 with x1830948733989248 ext(3145728->4194303) 00002000:00010000:1.0:1746129566.763273:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092fd1c00 00000100:00100000:1.0:1746129566.768483:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129566.768772:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733989632 00000100:00100000:1.0:1746129566.768783:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733989632 00010000:00010000:1.0:1746129566.768821:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6729600/0x40a459093b069075 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2002944->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f207f0 expref: 33 pid: 7149 timeout: 922 lvb_type: 0 00000100:00100000:1.0:1746129566.768854:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8098 00000100:00100000:1.0:1746129566.768862:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092fd1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ada2ffba-8920-4ecb-8068-68caa9806978+33:1963:x1830948733989632:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129566.768876:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129566.768900:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a6729600/0x40a459093b069075 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2002944->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f207f0 expref: 33 pid: 7149 timeout: 922 lvb_type: 0 00010000:00010000:1.0:1746129566.768913:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a6729600/0x40a459093b069075 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2002944->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f207f0 expref: 33 pid: 7149 timeout: 922 lvb_type: 0 00010000:00010000:1.0:1746129566.768937:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a6729600/0x40a459093b069075 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2002944->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f207f0 expref: 33 pid: 7149 timeout: 922 lvb_type: 0 00010000:00010000:1.0:1746129566.768962:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129566.768964:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129566.768970:0:7085:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a6729200/0x40a459093b069139 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20852 expref: 17 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129566.768978:0:7085:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6729200/0x40a459093b069139 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20852 expref: 17 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129566.769008:0:7085:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a6729200/0x40a459093b069139 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20852 expref: 17 pid: 22481 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129566.769020:0:7085:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092fd1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7085:1830948737460352:192.168.202.4@tcp:105: 00000100:00100000:1.0:1746129566.769085:0:7085:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c954b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746129566.769196:0:21463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094029880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ada2ffba-8920-4ecb-8068-68caa9806978+32:1960:x1830948733989120:12345-192.168.202.4@tcp:3:cat.0 Request processed in 26460us (30226us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129566.769207:0:21463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7611 00002000:00100000:3.0:1746129566.769216:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->4194303) req@ffff880094029880 x1830948733989120/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:307/0 lens 488/440 e 0 to 0 dl 1746129577 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129566.769224:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094029880 with x1830948733989120 ext(3145728->4194303) 00002000:00010000:3.0:1746129566.769229:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094029880 00000100:00100000:0.0:1746129566.774585:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129566.774823:0:22481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733989760 00000100:00100000:3.0:1746129566.774833:0:22481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733989760 00000100:00100000:3.0:1746129566.774879:0:22481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15837 00000100:00100000:3.0:1746129566.774886:0:22481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009402b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ada2ffba-8920-4ecb-8068-68caa9806978+32:1961:x1830948733989760:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129566.774906:0:22481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129566.774923:0:22481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800946c7000/0x40a459093b069140 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20859 expref: -99 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129566.774947:0:22481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129566.774949:0:22481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129566.774957:0:22481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800946c7000/0x40a459093b069140 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20859 expref: 33 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129566.774971:0:22481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800946c7000/0x40a459093b069140 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20859 expref: 33 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129566.774982:0:22481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800946c7000, rc 0) 00000100:00100000:3.0:1746129566.775030:0:22481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009402b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ada2ffba-8920-4ecb-8068-68caa9806978+33:1961:x1830948733989760:12345-192.168.202.4@tcp:101:cat.0 Request processed in 145us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129566.775035:0:22481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15837 00000100:00100000:0.0:1746129566.775200:0:7085:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092fd1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7085:1830948737460352:192.168.202.4@tcp:105: 00010000:00010000:0.0:1746129566.775219:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129566.775241:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092fd1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ada2ffba-8920-4ecb-8068-68caa9806978+32:1963:x1830948733989632:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 6380us (6771us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129566.775248:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8098 00000100:00100000:0.0:1746129566.776173:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129566.779387:0:21463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733990016 00000100:00100000:3.0:1746129566.779399:0:21463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733990016 00002000:00100000:3.0:1746129566.779451:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3ee:0x0] (1048576->2097151) req@ffff88009402aa00 x1830948733990016/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:307/0 lens 488/0 e 0 to 0 dl 1746129577 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129566.779462:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009402aa00 with x1830948733990016 ext(1048576->2097151) 00002000:00010000:3.0:1746129566.779467:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009402aa00 00000100:00100000:3.0:1746129566.779498:0:21463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7613 00000100:00100000:3.0:1746129566.779505:0:21463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009402aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+18:1963:x1830948733990016:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:1.0:1746129566.782005:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129566.782902:0:21725:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733990272 00000100:00100000:2.0:1746129566.782912:0:21725:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733990272 00002000:00100000:2.0:1746129566.782960:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ef:0x0] (4194304->5148671) req@ffff880092fd2300 x1830948733990272/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:307/0 lens 488/0 e 0 to 0 dl 1746129577 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129566.782969:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092fd2300 with x1830948733990272 ext(4194304->5148671) 00002000:00010000:2.0:1746129566.782975:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092fd2300 00000100:00100000:2.0:1746129566.782997:0:21725:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7614 00000100:00100000:2.0:1746129566.783005:0:21725:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092fd2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ada2ffba-8920-4ecb-8068-68caa9806978+32:1960:x1830948733990272:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:3.0:1746129566.794217:0:21463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009402aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+18:1963:x1830948733990016:12345-192.168.202.4@tcp:3:cat.0 Request processed in 14699us (18035us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129566.794231:0:21463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7613 00002000:00100000:3.0:1746129566.794244:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3ee:0x0] (1048576->2097151) req@ffff88009402aa00 x1830948733990016/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:307/0 lens 488/440 e 0 to 0 dl 1746129577 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129566.794253:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009402aa00 with x1830948733990016 ext(1048576->2097151) 00002000:00010000:3.0:1746129566.794261:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009402aa00 00000100:00100000:2.0:1746129566.796327:0:21725:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092fd2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ada2ffba-8920-4ecb-8068-68caa9806978+32:1960:x1830948733990272:12345-192.168.202.4@tcp:3:cat.0 Request processed in 13310us (14318us total) trans 0 rc 954368/954368 00000100:00100000:2.0:1746129566.796341:0:21725:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7614 00002000:00100000:2.0:1746129566.796369:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ef:0x0] (4194304->5148671) req@ffff880092fd2300 x1830948733990272/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:307/0 lens 488/440 e 0 to 0 dl 1746129577 ref 1 fl Complete:/200/0 rc 954368/954368 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129566.796378:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092fd2300 with x1830948733990272 ext(4194304->5148671) 00002000:00010000:2.0:1746129566.796385:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092fd2300 00000100:00100000:0.0:1746129566.803592:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129566.803663:0:8412:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733990400 00000100:00100000:1.0:1746129566.803673:0:8412:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733990400 00000100:00100000:1.0:1746129566.803768:0:8412:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15838 00000100:00100000:1.0:1746129566.803776:0:8412:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094028000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+18:32138:x1830948733990400:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129566.803796:0:8412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129566.803815:0:8412:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012cd7e200/0x40a459093b069147 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20860 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129566.803843:0:8412:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129566.803845:0:8412:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129566.803854:0:8412:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012cd7e200/0x40a459093b069147 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20860 expref: 19 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129566.803874:0:8412:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012cd7e200/0x40a459093b069147 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20860 expref: 19 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129566.803884:0:8412:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cd7e200, rc 0) 00000100:00100000:1.0:1746129566.803941:0:8412:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094028000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+19:32138:x1830948733990400:12345-192.168.202.4@tcp:101:cat.0 Request processed in 166us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129566.803946:0:8412:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15838 00000100:00100000:0.0:1746129566.833657:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129566.834645:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129566.834676:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129566.834706:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129566.834778:0:31521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733990784 00000100:00100000:3.0:1746129566.834788:0:31521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733990784 00002000:00100000:3.0:1746129566.834834:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3ef:0x0] (2097152->3145727) req@ffff8800947bc700 x1830948733990784/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:307/0 lens 488/0 e 0 to 0 dl 1746129577 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129566.834845:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800947bc700 with x1830948733990784 ext(2097152->3145727) 00002000:00010000:3.0:1746129566.834851:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800947bc700 00000100:00100000:3.0:1746129566.834937:0:31521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733990912 00000100:00100000:3.0:1746129566.834940:0:31521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733990912 00000100:00100000:2.0:1746129566.834946:0:21725:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733991040 00002000:00100000:3.0:1746129566.834951:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f5:0x0] (2097152->3145727) req@ffff880092fd2680 x1830948733990912/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:307/0 lens 488/0 e 0 to 0 dl 1746129577 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746129566.834951:0:21725:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733991040 00002000:00100000:3.0:1746129566.834958:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092fd2680 with x1830948733990912 ext(2097152->3145727) 00002000:00010000:3.0:1746129566.834960:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092fd2680 00000100:00100000:3.0:1746129566.834969:0:31521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733991168 00000100:00100000:3.0:1746129566.834971:0:31521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733991168 00002000:00100000:2.0:1746129566.834971:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f5:0x0] (3145728->4194303) req@ffff880092fd2a00 x1830948733991040/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:307/0 lens 488/0 e 0 to 0 dl 1746129577 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129566.834978:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->4194303) req@ffff880092fd2d80 x1830948733991168/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:307/0 lens 488/0 e 0 to 0 dl 1746129577 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129566.834978:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092fd2a00 with x1830948733991040 ext(3145728->4194303) 00002000:00010000:2.0:1746129566.834981:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092fd2a00 00002000:00100000:3.0:1746129566.834984:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092fd2d80 with x1830948733991168 ext(3145728->4194303) 00002000:00010000:3.0:1746129566.834986:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092fd2d80 00000100:00100000:0.0:1746129566.836044:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7615 00000100:00100000:2.0:1746129566.836050:0:21725:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7616 00000100:00100000:2.0:1746129566.836055:0:21725:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092fd2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+17:1961:x1830948733990912:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129566.836056:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:1960:x1830948733990784:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:1.0:1746129566.837625:0:31520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7617 00000100:00100000:1.0:1746129566.837635:0:31520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092fd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+18:1961:x1830948733991040:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:2.0:1746129566.838085:0:31522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7618 00000100:00100000:2.0:1746129566.838093:0:31522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092fd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:1961:x1830948733991168:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:2.0:1746129566.852603:0:21725:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092fd2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+18:1961:x1830948733990912:12345-192.168.202.4@tcp:3:cat.0 Request processed in 16531us (17943us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129566.852620:0:21725:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7616 00002000:00100000:2.0:1746129566.852636:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f5:0x0] (2097152->3145727) req@ffff880092fd2680 x1830948733990912/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:307/0 lens 488/440 e 0 to 0 dl 1746129577 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129566.852646:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092fd2680 with x1830948733990912 ext(2097152->3145727) 00002000:00010000:2.0:1746129566.852652:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092fd2680 00000100:00100000:1.0:1746129566.861101:0:31520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092fd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+16:1961:x1830948733991040:12345-192.168.202.4@tcp:3:cat.0 Request processed in 23454us (26409us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129566.861153:0:31520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7617 00002000:00100000:1.0:1746129566.861168:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3f5:0x0] (3145728->4194303) req@ffff880092fd2a00 x1830948733991040/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:307/0 lens 488/440 e 0 to 0 dl 1746129577 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129566.861179:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092fd2a00 with x1830948733991040 ext(3145728->4194303) 00002000:00010000:1.0:1746129566.861185:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092fd2a00 00000100:00100000:0.0:1746129566.864755:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129566.865082:0:22481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733991552 00000100:00100000:3.0:1746129566.865093:0:22481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733991552 00000100:00100000:3.0:1746129566.865154:0:22481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15839 00000100:00100000:3.0:1746129566.865163:0:22481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ada2ffba-8920-4ecb-8068-68caa9806978+28:32134:x1830948733991552:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:3.0:1746129566.865184:0:22481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129566.865203:0:22481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ee1b600/0x40a459093b06914e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20867 expref: -99 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129566.865236:0:22481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091b4f200/0x40a459093b068eb5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f206f4 expref: 15 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129566.865245:0:22481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095cda800/0x40a459093b069005 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f207b8 expref: 12 pid: 8411 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129566.865252:0:22481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008ebb2800/0x40a459093b068ebc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f206fb expref: 29 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129566.865263:0:22481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129566.865265:0:22481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129566.865269:0:22481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ee1b600/0x40a459093b06914e lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [1728512->2097151] (req 1728512->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20867 expref: 29 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129566.865327:0:22481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008ebb2800/0x40a459093b068ebc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f206fb expref: 29 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129566.865339:0:22481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008ebb2800/0x40a459093b068ebc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f206fb expref: 29 pid: 11014 timeout: 922 lvb_type: 0 00000100:00100000:3.0:1746129566.865360:0:22481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135724a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:22481:1830948737460480:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129566.865466:0:22481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095cda800/0x40a459093b069005 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f207b8 expref: 12 pid: 8411 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129566.865474:0:22481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095cda800/0x40a459093b069005 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f207b8 expref: 12 pid: 8411 timeout: 922 lvb_type: 1 00000100:00100000:3.0:1746129566.865482:0:22481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135725500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:22481:1830948737460608:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129566.865522:0:22481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091b4f200/0x40a459093b068eb5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f206f4 expref: 15 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129566.865530:0:22481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091b4f200/0x40a459093b068eb5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f206f4 expref: 15 pid: 20577 timeout: 922 lvb_type: 0 00000100:00100000:3.0:1746129566.865543:0:22481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135724e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:22481:1830948737460736:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129566.865560:0:22481:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a7b480 going to sleep for 11 seconds 00000100:00100000:3.0:1746129566.867286:0:31522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092fd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:1961:x1830948733991168:12345-192.168.202.4@tcp:3:cat.0 Request processed in 29186us (32571us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129566.867323:0:31522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7618 00002000:00100000:3.0:1746129566.867334:0:31522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->4194303) req@ffff880092fd2d80 x1830948733991168/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:307/0 lens 488/440 e 0 to 0 dl 1746129577 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129566.867343:0:31522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092fd2d80 with x1830948733991168 ext(3145728->4194303) 00002000:00010000:3.0:1746129566.867364:0:31522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092fd2d80 00000100:00100000:1.0:1746129566.868469:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+19:1960:x1830948733990784:12345-192.168.202.4@tcp:3:cat.0 Request processed in 32413us (34820us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129566.868476:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7615 00002000:00100000:1.0:1746129566.868482:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ef:0x0] (2097152->3145727) req@ffff8800947bc700 x1830948733990784/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:307/0 lens 488/440 e 0 to 0 dl 1746129577 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129566.868489:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800947bc700 with x1830948733990784 ext(2097152->3145727) 00002000:00010000:1.0:1746129566.868493:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800947bc700 00000100:00100000:0.0:1746129566.875309:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129566.875442:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129566.875489:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733991680 00000100:00100000:0.0:1746129566.875497:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733991680 00010000:00010000:0.0:1746129566.875535:0:9823:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095cda800/0x40a459093b069005 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f207b8 expref: 13 pid: 8411 timeout: 922 lvb_type: 1 00000100:00100000:0.0:1746129566.875559:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733991808 00000100:00100000:0.0:1746129566.875560:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733991808 00010000:00010000:0.0:1746129566.875568:0:9823:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091b4f200/0x40a459093b068eb5 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f206f4 expref: 16 pid: 20577 timeout: 922 lvb_type: 0 00000100:00100000:3.0:1746129566.875735:0:22481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135724a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:22481:1830948737460480:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129566.875745:0:22481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135725500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:22481:1830948737460608:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129566.875751:0:22481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135724e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:22481:1830948737460736:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129566.875780:0:22481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ee1b600/0x40a459093b06914e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [1728512->2097151] (req 1728512->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20867 expref: 29 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129566.875794:0:22481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ee1b600, rc 0) 00000100:00100000:3.0:1746129566.875838:0:22481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ada2ffba-8920-4ecb-8068-68caa9806978+29:32134:x1830948733991552:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 10677us (11096us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129566.875846:0:22481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15839 00000100:00100000:0.0:1746129566.877046:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8099 00000100:00100000:0.0:1746129566.877060:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6027c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:068dab75-d300-4ead-a742-d14572ad1e50+13:1962:x1830948733991680:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129566.877075:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129566.877102:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095cda800/0x40a459093b069005 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f207b8 expref: 13 pid: 8411 timeout: 922 lvb_type: 1 00010000:00010000:0.0:1746129566.877119:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095cda800/0x40a459093b069005 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f207b8 expref: 13 pid: 8411 timeout: 922 lvb_type: 1 00010000:00010000:0.0:1746129566.877143:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095cda800/0x40a459093b069005 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f207b8 expref: 13 pid: 8411 timeout: 922 lvb_type: 1 00010000:00010000:0.0:1746129566.877163:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129566.877193:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6027c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:068dab75-d300-4ead-a742-d14572ad1e50+12:1962:x1830948733991680:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 140us (1911us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129566.877199:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8099 00000100:00100000:0.0:1746129566.877248:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8100 00000100:00100000:0.0:1746129566.877252:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947bd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+16:1962:x1830948733991808:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129566.877258:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129566.877266:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091b4f200/0x40a459093b068eb5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f206f4 expref: 16 pid: 20577 timeout: 922 lvb_type: 0 00010000:00010000:0.0:1746129566.877272:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091b4f200/0x40a459093b068eb5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f206f4 expref: 16 pid: 20577 timeout: 922 lvb_type: 0 00010000:00010000:0.0:1746129566.877283:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091b4f200/0x40a459093b068eb5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f206f4 expref: 16 pid: 20577 timeout: 922 lvb_type: 0 00010000:00010000:0.0:1746129566.877290:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129566.877320:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947bd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+15:1962:x1830948733991808:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 68us (1879us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129566.877329:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8100 00000100:00100000:0.0:1746129566.878942:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129566.879775:0:20578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733991936 00000100:00100000:2.0:1746129566.879785:0:20578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733991936 00010000:00010000:2.0:1746129566.879822:0:20578:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008ebb2800/0x40a459093b068ebc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f206fb expref: 29 pid: 11014 timeout: 922 lvb_type: 0 00000100:00100000:2.0:1746129566.879862:0:20578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8101 00000100:00100000:2.0:1746129566.879870:0:20578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947be300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ada2ffba-8920-4ecb-8068-68caa9806978+29:1963:x1830948733991936:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129566.879882:0:20578:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129566.879904:0:20578:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008ebb2800/0x40a459093b068ebc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f206fb expref: 29 pid: 11014 timeout: 922 lvb_type: 0 00010000:00010000:2.0:1746129566.879915:0:20578:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008ebb2800/0x40a459093b068ebc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f206fb expref: 29 pid: 11014 timeout: 922 lvb_type: 0 00010000:00010000:2.0:1746129566.879936:0:20578:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008ebb2800/0x40a459093b068ebc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f206fb expref: 29 pid: 11014 timeout: 922 lvb_type: 0 00010000:00010000:2.0:1746129566.880474:0:20578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129566.880477:0:20578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129566.880486:0:20578:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ee1b600/0x40a459093b06914e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1728512->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20867 expref: 28 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129566.880495:0:20578:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ee1b600/0x40a459093b06914e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1728512->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20867 expref: 28 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129566.880530:0:20578:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ee1b600/0x40a459093b06914e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1728512->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20867 expref: 28 pid: 22481 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129566.880542:0:20578:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095627480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:20578:1830948737460864:192.168.202.4@tcp:105: 00000100:00100000:2.0:1746129566.880637:0:20578:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800951de240 going to sleep for 11 seconds 00000100:00100000:3.0:1746129566.886916:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129566.887022:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129566.887208:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733992320 00000100:00100000:1.0:1746129566.887217:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733992320 00002000:00100000:1.0:1746129566.887265:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f3:0x0] (1728512->1732607) req@ffff880135725500 x1830948733992320/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:307/0 lens 488/0 e 0 to 0 dl 1746129577 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129566.887274:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135725500 with x1830948733992320 ext(1728512->1732607) 00002000:00010000:1.0:1746129566.887280:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135725500 00000100:00100000:1.0:1746129566.887320:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7619 00000100:00100000:1.0:1746129566.887327:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135725500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+29:1962:x1830948733992320:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:1.0:1746129566.887518:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135725500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+29:1962:x1830948733992320:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 191us (495us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746129566.887525:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7619 00002000:00100000:1.0:1746129566.887530:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f3:0x0] (1728512->1732607) req@ffff880135725500 x1830948733992320/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:307/0 lens 488/4536 e 0 to 0 dl 1746129577 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129566.887537:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135725500 with x1830948733992320 ext(1728512->1732607) 00002000:00010000:1.0:1746129566.887540:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135725500 00000100:00100000:0.0:1746129566.887722:0:22481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733992064 00000100:00100000:0.0:1746129566.887726:0:22481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733992064 00000100:00100000:0.0:1746129566.887751:0:22481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15840 00000100:00100000:0.0:1746129566.887755:0:22481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135724e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+15:1963:x1830948733992064:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129566.887764:0:22481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129566.887781:0:22481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f8d4c00/0x40a459093b069155 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2086e expref: -99 pid: 22481 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129566.887826:0:22481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:22481:1830948737460992:192.168.202.4@tcp:106: 00000100:00100000:0.0:1746129566.887880:0:22481:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a00780 going to sleep for 11 seconds 00000100:00100000:2.0:1746129566.888155:0:20578:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095627480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:20578:1830948737460864:192.168.202.4@tcp:105: 00010000:00010000:2.0:1746129566.888172:0:20578:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129566.888190:0:20578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947be300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ada2ffba-8920-4ecb-8068-68caa9806978+28:1963:x1830948733991936:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 8322us (9255us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129566.888198:0:20578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8101 00000100:00100000:0.0:1746129566.889404:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129566.889991:0:2271:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733992576 00000100:00100000:3.0:1746129566.889998:0:2271:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733992576 00000100:00100000:3.0:1746129566.890045:0:2271:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11148 00000100:00100000:3.0:1746129566.890052:0:2271:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+25:32143:x1830948733992576:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:3.0:1746129566.890071:0:2271:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129566.890085:0:2271:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135722200/0x40a459093b06915c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20875 expref: -99 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129566.890189:0:2271:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135722600/0x40a459093b069163 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129566.890201:0:2271:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135722600/0x40a459093b069163 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129566.890211:0:2271:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135722600/0x40a459093b069163 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129566.890222:0:2271:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135722800/0x40a459093b06916a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129566.890227:0:2271:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135722800/0x40a459093b06916a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129566.890231:0:2271:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135722800/0x40a459093b06916a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129566.890390:0:2271:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135722a00/0x40a459093b069171 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129566.890400:0:2271:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135722a00/0x40a459093b069171 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129566.890406:0:2271:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135722a00/0x40a459093b069171 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00000004:00200000:3.0:1746129566.890417:0:2271:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:3.0:1746129566.890505:0:2271:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135722600/0x40a459093b069163 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129566.890512:0:2271:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135722600/0x40a459093b069163 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129566.890518:0:2271:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135722600/0x40a459093b069163 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129566.890523:0:2271:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135722600 already unused, calling callback (ffffffffa136e690) 00010000:00010000:3.0:1746129566.890527:0:2271:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135722600/0x40a459093b069163 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129566.890533:0:2271:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135722600/0x40a459093b069163 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129566.890542:0:2271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880132ef8f00) 00010000:00010000:3.0:1746129566.890544:0:2271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129566.890547:0:2271:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135722600/0x40a459093b069163 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129566.890551:0:2271:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135722600/0x40a459093b069163 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129566.890566:0:2271:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135722800/0x40a459093b06916a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129566.890570:0:2271:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135722800/0x40a459093b06916a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129566.890574:0:2271:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135722800/0x40a459093b06916a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129566.890582:0:2271:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135722800 already unused, calling callback (ffffffffa136e690) 00010000:00010000:3.0:1746129566.890584:0:2271:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135722800/0x40a459093b06916a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129566.890588:0:2271:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135722800/0x40a459093b06916a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129566.890592:0:2271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800900d1300) 00010000:00010000:3.0:1746129566.890593:0:2271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129566.890595:0:2271:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135722800/0x40a459093b06916a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129566.890598:0:2271:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135722800/0x40a459093b06916a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129566.890629:0:2271:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135722200/0x40a459093b06915c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20875 expref: 28 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129566.890639:0:2271:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135722a00/0x40a459093b069171 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20875 expref: 27 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129566.890643:0:2271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009f469400) 00010000:00010000:3.0:1746129566.890645:0:2271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746129566.890647:0:2271:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135722a00, rc 0) 00000100:00100000:3.0:1746129566.890685:0:2271:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+27:32143:x1830948733992576:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 633us (1285us total) trans 8589945228 rc 0/0 00000100:00100000:3.0:1746129566.890691:0:2271:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11148 00000100:00100000:0.0:1746129566.891326:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00002000:00010000:0.0:1746129566.891413:0:22481:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb mtime: 1746129565 -> 1746129567 00002000:00010000:0.0:1746129566.891416:0:22481:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb atime: 1746129565 -> 1746129567 00002000:00010000:0.0:1746129566.891418:0:22481:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb ctime: 1746129566 -> 1746129567 00000100:00100000:0.0:1746129566.891434:0:22481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:22481:1830948737460992:192.168.202.4@tcp:106: 00010000:00010000:0.0:1746129566.891456:0:22481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f8d4c00/0x40a459093b069155 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2086e expref: 16 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129566.891467:0:22481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f8d4c00/0x40a459093b069155 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2086e expref: 16 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129566.891478:0:22481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f8d4c00, rc 0) 00000100:00100000:0.0:1746129566.891497:0:22481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135724e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+15:1963:x1830948733992064:12345-192.168.202.4@tcp:101:cat.0 Request processed in 3742us (4595us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129566.891504:0:22481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15840 00000100:00100000:0.0:1746129566.891519:0:22481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733992704 00000100:00100000:0.0:1746129566.891522:0:22481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733992704 00000100:00100000:0.0:1746129566.891547:0:22481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15841 00000100:00100000:0.0:1746129566.891553:0:22481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ada2ffba-8920-4ecb-8068-68caa9806978+28:32134:x1830948733992704:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:0.0:1746129566.891562:0:22481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129566.891572:0:22481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f8d5800/0x40a459093b06917f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2087c expref: -99 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129566.891589:0:22481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c22c000/0x40a459093b068ec3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20702 expref: 14 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129566.891597:0:22481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b4e0ea00/0x40a459093b069021 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f207bf expref: 11 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129566.891604:0:22481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c47d400/0x40a459093b068ee6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20717 expref: 29 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129566.891610:0:22481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129566.891611:0:22481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129566.891614:0:22481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f8d5800/0x40a459093b06917f lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [1048576->1695743] (req 1048576->1695743) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2087c expref: 29 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129566.891637:0:22481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c47d400/0x40a459093b068ee6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20717 expref: 29 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129566.891652:0:22481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c47d400/0x40a459093b068ee6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20717 expref: 29 pid: 11014 timeout: 922 lvb_type: 1 00000100:00100000:0.0:1746129566.891663:0:22481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:22481:1830948737461120:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129566.891713:0:22481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b4e0ea00/0x40a459093b069021 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f207bf expref: 11 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129566.891719:0:22481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b4e0ea00/0x40a459093b069021 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f207bf expref: 11 pid: 7148 timeout: 922 lvb_type: 1 00000100:00100000:0.0:1746129566.891725:0:22481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:22481:1830948737461248:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129566.891743:0:22481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c22c000/0x40a459093b068ec3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20702 expref: 14 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129566.891748:0:22481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c22c000/0x40a459093b068ec3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20702 expref: 14 pid: 11014 timeout: 922 lvb_type: 0 00000100:00100000:0.0:1746129566.891754:0:22481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:22481:1830948737461376:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129566.891765:0:22481:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a00780 going to sleep for 11 seconds 00000100:00100000:2.0:1746129566.897340:0:22481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:22481:1830948737461120:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129566.899395:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129566.899435:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129566.899458:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129566.899471:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129566.899503:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733993088 00000100:00100000:1.0:1746129566.899515:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733993088 00000100:00100000:1.0:1746129566.899573:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733992960 00000100:00100000:1.0:1746129566.899575:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733992960 00000100:00100000:2.0:1746129566.899585:0:22481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:22481:1830948737461248:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129566.899590:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c47d400/0x40a459093b068ee6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20717 expref: 30 pid: 11014 timeout: 922 lvb_type: 1 00000100:00100000:2.0:1746129566.899597:0:22481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:22481:1830948737461376:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129566.899605:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733992832 00000100:00100000:1.0:1746129566.899607:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733992832 00010000:00010000:1.0:1746129566.899617:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b4e0ea00/0x40a459093b069021 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f207bf expref: 12 pid: 7148 timeout: 922 lvb_type: 1 00000100:00100000:1.0:1746129566.899624:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733993216 00010000:00010000:2.0:1746129566.899626:0:22481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f8d5800/0x40a459093b06917f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [1048576->1695743] (req 1048576->1695743) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2087c expref: 30 pid: 22481 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129566.899626:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733993216 00010000:00010000:1.0:1746129566.899633:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c22c000/0x40a459093b068ec3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20702 expref: 15 pid: 11014 timeout: 922 lvb_type: 0 00010000:00010000:2.0:1746129566.899642:0:22481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f8d5800, rc 0) 00000100:00100000:1.0:1746129566.899643:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8102 00000100:00100000:1.0:1746129566.899649:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092fd3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ada2ffba-8920-4ecb-8068-68caa9806978+30:1960:x1830948733992960:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129566.899662:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129566.899683:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c47d400/0x40a459093b068ee6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20717 expref: 30 pid: 11014 timeout: 922 lvb_type: 1 00000100:00100000:2.0:1746129566.899686:0:22481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ada2ffba-8920-4ecb-8068-68caa9806978+30:32134:x1830948733992704:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 8133us (8363us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129566.899692:0:22481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15841 00010000:00010000:1.0:1746129566.899693:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c47d400/0x40a459093b068ee6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20717 expref: 30 pid: 11014 timeout: 922 lvb_type: 1 00010000:00010000:1.0:1746129566.899715:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c47d400/0x40a459093b068ee6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20717 expref: 29 pid: 11014 timeout: 922 lvb_type: 1 00000100:00100000:2.0:1746129566.899719:0:7087:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8103 00000100:00100000:2.0:1746129566.899724:0:7087:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092fd3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:068dab75-d300-4ead-a742-d14572ad1e50+12:1963:x1830948733992832:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129566.899731:0:7087:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129566.899732:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746129566.899740:0:7087:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b4e0ea00/0x40a459093b069021 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f207bf expref: 12 pid: 7148 timeout: 922 lvb_type: 1 00000100:00100000:1.0:1746129566.899746:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092fd3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ada2ffba-8920-4ecb-8068-68caa9806978+28:1960:x1830948733992960:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 98us (311us total) trans 0 rc 0/0 00010000:00010000:2.0:1746129566.899747:0:7087:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b4e0ea00/0x40a459093b069021 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f207bf expref: 12 pid: 7148 timeout: 922 lvb_type: 1 00000100:00100000:1.0:1746129566.899752:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8102 00010000:00010000:2.0:1746129566.899759:0:7087:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b4e0ea00/0x40a459093b069021 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f207bf expref: 12 pid: 7148 timeout: 922 lvb_type: 1 00000100:00100000:1.0:1746129566.899764:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8104 00000100:00100000:1.0:1746129566.899767:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092fd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+15:1963:x1830948733993216:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129566.899771:0:7087:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746129566.899773:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129566.899778:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c22c000/0x40a459093b068ec3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20702 expref: 15 pid: 11014 timeout: 922 lvb_type: 0 00000100:00100000:2.0:1746129566.899783:0:7087:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092fd3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:068dab75-d300-4ead-a742-d14572ad1e50+11:1963:x1830948733992832:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 60us (325us total) trans 0 rc 0/0 00010000:00010000:1.0:1746129566.899786:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c22c000/0x40a459093b068ec3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20702 expref: 15 pid: 11014 timeout: 922 lvb_type: 0 00000100:00100000:2.0:1746129566.899788:0:7087:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8103 00000100:00100000:2.0:1746129566.899797:0:7087:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 782 00010000:00010000:1.0:1746129566.899797:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c22c000/0x40a459093b068ec3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20702 expref: 15 pid: 11014 timeout: 922 lvb_type: 0 00000100:00100000:2.0:1746129566.899801:0:7087:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092fd3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+27:1960:x1830948733993088:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129566.899805:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129566.899806:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129566.899807:0:7087:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129566.899813:0:7085:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f8d5800/0x40a459093b06917f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1695743) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2087c expref: 27 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129566.899819:0:7087:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135722a00/0x40a459093b069171 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20875 expref: 27 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129566.899821:0:7085:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f8d5800/0x40a459093b06917f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1695743) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2087c expref: 27 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129566.899833:0:7087:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009f469400) 00010000:00010000:2.0:1746129566.899836:0:7087:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129566.899846:0:7087:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092fd3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+26:1960:x1830948733993088:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 45us (462us total) trans 0 rc 0/0 00010000:00010000:1.0:1746129566.899850:0:7085:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f8d5800/0x40a459093b06917f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1695743) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2087c expref: 27 pid: 22481 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129566.899851:0:7087:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 782 00000100:00100000:1.0:1746129566.899861:0:7085:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092fd1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7085:1830948737461504:192.168.202.4@tcp:105: 00000100:00100000:0.0:1746129566.900106:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129566.900197:0:7085:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c954cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746129566.900411:0:31522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733993472 00000100:00100000:3.0:1746129566.900415:0:31522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733993472 00002000:00100000:3.0:1746129566.900444:0:31522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3ef:0x0] (4194304->5148671) req@ffff8800947bc380 x1830948733993472/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:307/0 lens 488/0 e 0 to 0 dl 1746129577 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129566.900454:0:31522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800947bc380 with x1830948733993472 ext(4194304->5148671) 00002000:00010000:3.0:1746129566.900458:0:31522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800947bc380 00000100:00100000:3.0:1746129566.900472:0:31522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7620 00000100:00100000:3.0:1746129566.900477:0:31522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+19:1963:x1830948733993472:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:1.0:1746129566.907012:0:7085:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092fd1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7085:1830948737461504:192.168.202.4@tcp:105: 00010000:00010000:1.0:1746129566.907037:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129566.907214:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092fd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+14:1963:x1830948733993216:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 7443us (7739us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129566.907226:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8104 00000100:00100000:0.0:1746129566.909550:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129566.909894:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733993728 00000100:00100000:1.0:1746129566.909905:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733993728 00002000:00100000:1.0:1746129566.909951:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f4:0x0] (1691648->1695743) req@ffff8800947bf800 x1830948733993728/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:307/0 lens 488/0 e 0 to 0 dl 1746129577 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129566.909961:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800947bf800 with x1830948733993728 ext(1691648->1695743) 00002000:00010000:1.0:1746129566.909967:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800947bf800 00000100:00100000:1.0:1746129566.909988:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7621 00000100:00100000:1.0:1746129566.909996:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+28:1962:x1830948733993728:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:1.0:1746129566.910175:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+28:1962:x1830948733993728:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 179us (646us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746129566.910183:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7621 00002000:00100000:1.0:1746129566.910189:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f4:0x0] (1691648->1695743) req@ffff8800947bf800 x1830948733993728/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:307/0 lens 488/4536 e 0 to 0 dl 1746129577 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129566.910196:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800947bf800 with x1830948733993728 ext(1691648->1695743) 00002000:00010000:1.0:1746129566.910198:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800947bf800 00000100:00100000:3.0:1746129566.915483:0:31522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+19:1963:x1830948733993472:12345-192.168.202.4@tcp:3:cat.0 Request processed in 14993us (15365us total) trans 0 rc 954368/954368 00000100:00100000:3.0:1746129566.915494:0:31522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7620 00002000:00100000:3.0:1746129566.915507:0:31522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3ef:0x0] (4194304->5148671) req@ffff8800947bc380 x1830948733993472/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:307/0 lens 488/440 e 0 to 0 dl 1746129577 ref 1 fl Complete:/200/0 rc 954368/954368 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129566.915517:0:31522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800947bc380 with x1830948733993472 ext(4194304->5148671) 00002000:00010000:3.0:1746129566.915523:0:31522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800947bc380 00000100:00100000:0.0:1746129566.924045:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129566.924441:0:22481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733993856 00000100:00100000:2.0:1746129566.924451:0:22481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733993856 00000100:00100000:2.0:1746129566.924502:0:22481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15842 00000100:00100000:2.0:1746129566.924511:0:22481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+14:1962:x1830948733993856:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129566.924531:0:22481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129566.924550:0:22481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d872800/0x40a459093b069186 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20883 expref: -99 pid: 22481 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129566.924608:0:22481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095627480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:22481:1830948737461632:192.168.202.4@tcp:106: 00000100:00100000:2.0:1746129566.924703:0:22481:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800951de240 going to sleep for 11 seconds 00000100:00100000:0.0:1746129566.925417:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129566.925468:0:8412:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733993984 00000100:00100000:1.0:1746129566.925473:0:8412:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733993984 00000100:00100000:1.0:1746129566.925494:0:8412:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15843 00000100:00100000:1.0:1746129566.925499:0:8412:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+16:1962:x1830948733993984:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129566.925506:0:8412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129566.925516:0:8412:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012cd7ee00/0x40a459093b06918d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2088a expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129566.925544:0:8412:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092fd1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8412:1830948737461760:192.168.202.4@tcp:106: 00000100:00100000:1.0:1746129566.925575:0:8412:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c954cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746129566.927223:0:22481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095627480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:22481:1830948737461632:192.168.202.4@tcp:106: 00010000:00010000:2.0:1746129566.927253:0:22481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d872800/0x40a459093b069186 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20883 expref: 17 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129566.927265:0:22481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d872800/0x40a459093b069186 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20883 expref: 17 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129566.927282:0:22481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d872800, rc 0) 00000100:00100000:2.0:1746129566.927341:0:22481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+16:1962:x1830948733993856:12345-192.168.202.4@tcp:101:cat.0 Request processed in 2830us (3310us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129566.927359:0:22481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15842 00002000:00010000:1.0:1746129566.927532:0:8412:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb mtime: 1746129566 -> 1746129567 00002000:00010000:1.0:1746129566.927535:0:8412:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb atime: 1746129566 -> 1746129567 00002000:00010000:1.0:1746129566.927537:0:8412:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb ctime: 1746129566 -> 1746129567 00000100:00100000:1.0:1746129566.927548:0:8412:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092fd1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8412:1830948737461760:192.168.202.4@tcp:106: 00010000:00010000:1.0:1746129566.927564:0:8412:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012cd7ee00/0x40a459093b06918d lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2088a expref: 15 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129566.927573:0:8412:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012cd7ee00/0x40a459093b06918d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2088a expref: 15 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129566.928138:0:8412:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cd7ee00, rc 0) 00000100:00100000:1.0:1746129566.928329:0:8412:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+14:1962:x1830948733993984:12345-192.168.202.4@tcp:101:cat.0 Request processed in 2828us (2911us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129566.928335:0:8412:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15843 00000100:00100000:0.0:1746129566.931052:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129566.931252:0:8412:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733994112 00000100:00100000:1.0:1746129566.931261:0:8412:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733994112 00000100:00100000:1.0:1746129566.931328:0:8412:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15844 00000100:00100000:1.0:1746129566.931337:0:8412:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013577d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+14:1960:x1830948733994112:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129566.931363:0:8412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129566.931386:0:8412:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012cd7fe00/0x40a459093b069194 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20891 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129566.931717:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129566.931776:0:8412:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092fd1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8412:1830948737461888:192.168.202.4@tcp:106: 00000100:00100000:1.0:1746129566.932032:0:8412:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c954cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746129566.932271:0:22481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733994240 00000100:00100000:2.0:1746129566.932276:0:22481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733994240 00000100:00100000:2.0:1746129566.932328:0:22481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15845 00000100:00100000:2.0:1746129566.932334:0:22481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013577f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+16:1960:x1830948733994240:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129566.932341:0:22481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129566.932357:0:22481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d872c00/0x40a459093b06919b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20898 expref: -99 pid: 22481 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129566.932383:0:22481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095627480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:22481:1830948737462016:192.168.202.4@tcp:106: 00000100:00100000:2.0:1746129566.932421:0:22481:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800951de240 going to sleep for 11 seconds 00000100:00100000:1.0:1746129566.933225:0:8412:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092fd1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8412:1830948737461888:192.168.202.4@tcp:106: 00010000:00010000:1.0:1746129566.933247:0:8412:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012cd7fe00/0x40a459093b069194 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20891 expref: 17 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129566.933257:0:8412:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012cd7fe00/0x40a459093b069194 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20891 expref: 17 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129566.933264:0:8412:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cd7fe00, rc 0) 00000100:00100000:1.0:1746129566.933314:0:8412:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013577d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+16:1960:x1830948733994112:12345-192.168.202.4@tcp:101:cat.0 Request processed in 1979us (2271us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129566.933320:0:8412:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15844 00000100:00100000:2.0:1746129566.936476:0:22481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095627480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:22481:1830948737462016:192.168.202.4@tcp:106: 00010000:00010000:2.0:1746129566.936516:0:22481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d872c00/0x40a459093b06919b lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20898 expref: 15 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129566.936538:0:22481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d872c00/0x40a459093b06919b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20898 expref: 15 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129566.936552:0:22481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d872c00, rc 0) 00000100:00100000:2.0:1746129566.936599:0:22481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013577f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+14:1960:x1830948733994240:12345-192.168.202.4@tcp:101:cat.0 Request processed in 4263us (4880us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129566.936608:0:22481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15845 00000100:00100000:0.0:1746129566.945636:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129566.945740:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733994496 00000100:00100000:3.0:1746129566.945750:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733994496 00000100:00100000:3.0:1746129566.945811:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4715 00000100:00100000:3.0:1746129566.945820:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013575f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+26:32138:x1830948733994496:12345-192.168.202.4@tcp:35:cat.0 00000100:00100000:3.0:1746129566.946058:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013575f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+27:32138:x1830948733994496:12345-192.168.202.4@tcp:35:cat.0 Request processed in 238us (431us total) trans 8589945229 rc 0/0 00000100:00100000:3.0:1746129566.946065:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4715 00000100:00100000:0.0:1746129567.023219:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129567.023279:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129567.023593:0:31522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733994752 00000100:00100000:3.0:1746129567.023603:0:31522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733994752 00000100:00100000:2.0:1746129567.023630:0:31520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733994880 00000100:00100000:2.0:1746129567.023636:0:31520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733994880 00002000:00100000:3.0:1746129567.023660:0:31522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->1728511) req@ffff880094028e00 x1830948733994752/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:308/0 lens 488/0 e 0 to 0 dl 1746129578 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129567.023661:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3f4:0x0] (1695744->2097151) req@ffff8800903a0e00 x1830948733994880/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:308/0 lens 488/0 e 0 to 0 dl 1746129578 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129567.023671:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800903a0e00 with x1830948733994880 ext(1695744->2097151) 00002000:00100000:3.0:1746129567.023676:0:31522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094028e00 with x1830948733994752 ext(1048576->1728511) 00002000:00010000:2.0:1746129567.023677:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800903a0e00 00002000:00010000:3.0:1746129567.023680:0:31522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094028e00 00000100:00100000:2.0:1746129567.024445:0:31520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7622 00000100:00100000:2.0:1746129567.024457:0:31520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800903a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ada2ffba-8920-4ecb-8068-68caa9806978+29:1962:x1830948733994880:12345-192.168.202.4@tcp:3:cat.0 00000100:00080000:0.0:1746129567.024481:0:7097:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746129567.024491:0:31522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7623 00000100:00100000:3.0:1746129567.024498:0:31522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094028e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ada2ffba-8920-4ecb-8068-68caa9806978+29:1963:x1830948733994752:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129567.024578:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129567.024626:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733995264 00000100:00100000:1.0:1746129567.024631:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733995264 00002000:00100000:1.0:1746129567.024653:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ee:0x0] (1048576->2097151) req@ffff8800903a2d80 x1830948733995264/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:308/0 lens 488/0 e 0 to 0 dl 1746129578 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129567.024660:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800903a2d80 with x1830948733995264 ext(1048576->2097151) 00002000:00010000:1.0:1746129567.024664:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800903a2d80 00000100:00100000:1.0:1746129567.024679:0:31519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7624 00000100:00100000:1.0:1746129567.024684:0:31519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800903a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ada2ffba-8920-4ecb-8068-68caa9806978+32:1962:x1830948733995264:12345-192.168.202.4@tcp:3:cat.0 00000100:00080000:0.0:1746129567.024781:0:7097:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746129567.035396:0:31520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800903a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ada2ffba-8920-4ecb-8068-68caa9806978+30:1962:x1830948733994880:12345-192.168.202.4@tcp:3:cat.0 Request processed in 10931us (12104us total) trans 0 rc 401408/401408 00000100:00100000:2.0:1746129567.035408:0:31520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7622 00002000:00100000:2.0:1746129567.035420:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3f4:0x0] (1695744->2097151) req@ffff8800903a0e00 x1830948733994880/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:308/0 lens 488/440 e 0 to 0 dl 1746129578 ref 1 fl Complete:/200/0 rc 401408/401408 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129567.035429:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800903a0e00 with x1830948733994880 ext(1695744->2097151) 00002000:00010000:2.0:1746129567.035435:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800903a0e00 00000100:00100000:1.0:1746129567.037974:0:31519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800903a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ada2ffba-8920-4ecb-8068-68caa9806978+32:1962:x1830948733995264:12345-192.168.202.4@tcp:3:cat.0 Request processed in 13279us (13386us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129567.037989:0:31519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7624 00002000:00100000:1.0:1746129567.038001:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3ee:0x0] (1048576->2097151) req@ffff8800903a2d80 x1830948733995264/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:308/0 lens 488/440 e 0 to 0 dl 1746129578 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129567.038011:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800903a2d80 with x1830948733995264 ext(1048576->2097151) 00002000:00010000:1.0:1746129567.038017:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800903a2d80 00000100:00100000:3.0:1746129567.038438:0:31522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094028e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ada2ffba-8920-4ecb-8068-68caa9806978+28:1963:x1830948733994752:12345-192.168.202.4@tcp:3:cat.0 Request processed in 13939us (15229us total) trans 0 rc 679936/679936 00000100:00100000:3.0:1746129567.038444:0:31522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7623 00002000:00100000:3.0:1746129567.038449:0:31522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->1728511) req@ffff880094028e00 x1830948733994752/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:308/0 lens 488/440 e 0 to 0 dl 1746129578 ref 1 fl Complete:/200/0 rc 679936/679936 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129567.038456:0:31522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094028e00 with x1830948733994752 ext(1048576->1728511) 00002000:00010000:3.0:1746129567.038460:0:31522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094028e00 00000100:00100000:0.0:1746129567.050551:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129567.050670:0:31522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733995520 00000100:00100000:3.0:1746129567.050679:0:31522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733995520 00002000:00100000:3.0:1746129567.050731:0:31522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3ef:0x0] (2097152->3145727) req@ffff8800903a0380 x1830948733995520/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:308/0 lens 488/0 e 0 to 0 dl 1746129578 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129567.050740:0:31522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800903a0380 with x1830948733995520 ext(2097152->3145727) 00002000:00010000:3.0:1746129567.050747:0:31522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800903a0380 00000100:00100000:3.0:1746129567.050782:0:31522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7625 00000100:00100000:3.0:1746129567.050789:0:31522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800903a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ada2ffba-8920-4ecb-8068-68caa9806978+32:1963:x1830948733995520:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129567.062404:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129567.062463:0:31522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800903a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ada2ffba-8920-4ecb-8068-68caa9806978+32:1963:x1830948733995520:12345-192.168.202.4@tcp:3:cat.0 Request processed in 11670us (11921us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129567.062475:0:31522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7625 00002000:00100000:3.0:1746129567.062489:0:31522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3ef:0x0] (2097152->3145727) req@ffff8800903a0380 x1830948733995520/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:308/0 lens 488/440 e 0 to 0 dl 1746129578 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129567.062497:0:31522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800903a0380 with x1830948733995520 ext(2097152->3145727) 00002000:00010000:3.0:1746129567.062503:0:31522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800903a0380 00000100:00100000:2.0:1746129567.062607:0:22481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733995648 00000100:00100000:2.0:1746129567.062615:0:22481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733995648 00000100:00100000:2.0:1746129567.063064:0:22481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15846 00000100:00100000:2.0:1746129567.063072:0:22481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800903a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ada2ffba-8920-4ecb-8068-68caa9806978+28:32150:x1830948733995648:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:2.0:1746129567.063087:0:22481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129567.063105:0:22481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d872e00/0x40a459093b0691a2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2089f expref: -99 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129567.063132:0:22481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b4e0ee00/0x40a459093b0690de lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20821 expref: 29 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129567.063140:0:22481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800946c6e00/0x40a459093b069132 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2084b expref: 13 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129567.063146:0:22481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129567.063148:0:22481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129567.063151:0:22481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d872e00/0x40a459093b0691a2 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [4096000->4194303] (req 4096000->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2089f expref: 29 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129567.063178:0:22481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800946c6e00/0x40a459093b069132 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2084b expref: 13 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129567.063188:0:22481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800946c6e00/0x40a459093b069132 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2084b expref: 13 pid: 7148 timeout: 922 lvb_type: 1 00000100:00100000:2.0:1746129567.063198:0:22481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095627480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:22481:1830948737462144:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129567.063437:0:22481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b4e0ee00/0x40a459093b0690de lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20821 expref: 29 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129567.063450:0:22481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b4e0ee00/0x40a459093b0690de lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20821 expref: 29 pid: 7149 timeout: 922 lvb_type: 0 00000100:00100000:2.0:1746129567.063457:0:22481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095627800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:22481:1830948737462272:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129567.063703:0:22481:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800951de240 going to sleep for 11 seconds 00000100:00100000:2.0:1746129567.065117:0:22481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095627480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:22481:1830948737462144:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129567.065128:0:22481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095627800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:22481:1830948737462272:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129567.065155:0:22481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d872e00/0x40a459093b0691a2 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [4096000->4194303] (req 4096000->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2089f expref: 29 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129567.065170:0:22481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d872e00, rc 0) 00000100:00100000:2.0:1746129567.065206:0:22481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800903a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ada2ffba-8920-4ecb-8068-68caa9806978+29:32150:x1830948733995648:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 2135us (2812us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129567.065214:0:22481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15846 00000100:00100000:0.0:1746129567.067511:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129567.067818:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129567.068029:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733995904 00000100:00100000:1.0:1746129567.068040:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733995904 00010000:00010000:1.0:1746129567.068078:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800946c6e00/0x40a459093b069132 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2084b expref: 14 pid: 7148 timeout: 922 lvb_type: 1 00000100:00100000:1.0:1746129567.068123:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8105 00000100:00100000:1.0:1746129567.068132:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6027450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+14:1962:x1830948733995904:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129567.068146:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129567.068169:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800946c6e00/0x40a459093b069132 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2084b expref: 14 pid: 7148 timeout: 922 lvb_type: 1 00010000:00010000:1.0:1746129567.068181:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800946c6e00/0x40a459093b069132 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2084b expref: 14 pid: 7148 timeout: 922 lvb_type: 1 00010000:00010000:1.0:1746129567.068206:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800946c6e00/0x40a459093b069132 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2084b expref: 14 pid: 7148 timeout: 922 lvb_type: 1 00010000:00010000:1.0:1746129567.068225:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129567.068264:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6027450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+13:1962:x1830948733995904:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 134us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129567.068274:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8105 00000100:00100000:2.0:1746129567.068542:0:22481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733995776 00000100:00100000:2.0:1746129567.068547:0:22481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733995776 00000100:00100000:2.0:1746129567.068582:0:22481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15847 00000100:00100000:2.0:1746129567.068588:0:22481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800903a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+19:32143:x1830948733995776:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:2.0:1746129567.068602:0:22481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129567.068616:0:22481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d873600/0x40a459093b0691a9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f208a6 expref: -99 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129567.068636:0:22481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008e798600/0x40a459093b06911d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20836 expref: 31 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129567.068649:0:22481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012cd7e200/0x40a459093b069147 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20860 expref: 20 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129567.068655:0:22481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129567.068656:0:22481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129567.068659:0:22481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d873600/0x40a459093b0691a9 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [3678208->4194303] (req 3678208->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f208a6 expref: 20 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129567.068688:0:22481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012cd7e200/0x40a459093b069147 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20860 expref: 20 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129567.068697:0:22481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012cd7e200/0x40a459093b069147 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20860 expref: 20 pid: 8412 timeout: 922 lvb_type: 0 00000100:00100000:2.0:1746129567.068709:0:22481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095627800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:22481:1830948737462400:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129567.068770:0:22481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008e798600/0x40a459093b06911d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20836 expref: 31 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129567.068778:0:22481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008e798600/0x40a459093b06911d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20836 expref: 31 pid: 7149 timeout: 922 lvb_type: 0 00000100:00100000:2.0:1746129567.068786:0:22481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095627480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:22481:1830948737462528:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129567.068807:0:22481:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800951de240 going to sleep for 11 seconds 00000100:00100000:0.0:1746129567.068842:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00080000:0.0:1746129567.068862:0:7097:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746129567.068957:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129567.069030:0:8412:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733996160 00000100:00100000:3.0:1746129567.069034:0:8412:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733996160 00000100:00100000:3.0:1746129567.069069:0:8412:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15848 00000100:00100000:3.0:1746129567.069074:0:8412:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800903a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ada2ffba-8920-4ecb-8068-68caa9806978+29:32148:x1830948733996160:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129567.069083:0:8412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129567.069091:0:8412:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135723200/0x40a459093b0691b0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f208ad expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129567.069104:0:8412:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129567.069106:0:8412:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129567.069113:0:8412:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135723200/0x40a459093b0691b0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f208ad expref: 30 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129567.069125:0:8412:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135723200/0x40a459093b0691b0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f208ad expref: 30 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129567.069134:0:8412:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135723200, rc 0) 00000100:00100000:3.0:1746129567.069159:0:8412:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800903a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ada2ffba-8920-4ecb-8068-68caa9806978+30:32148:x1830948733996160:12345-192.168.202.4@tcp:101:cat.0 Request processed in 85us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129567.069164:0:8412:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15848 00000100:00100000:1.0:1746129567.069580:0:7086:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733996032 00000100:00100000:1.0:1746129567.069585:0:7086:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733996032 00010000:00010000:1.0:1746129567.069601:0:7086:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b4e0ee00/0x40a459093b0690de lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20821 expref: 30 pid: 7149 timeout: 922 lvb_type: 0 00000100:00100000:2.0:1746129567.070257:0:22481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095627800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:22481:1830948737462400:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129567.070266:0:22481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095627480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:22481:1830948737462528:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129567.070288:0:22481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d873600/0x40a459093b0691a9 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [3678208->4194303] (req 3678208->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f208a6 expref: 20 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129567.070319:0:22481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d873600, rc 0) 00000100:00100000:2.0:1746129567.070404:0:22481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800903a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:32143:x1830948733995776:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 1816us (2902us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129567.070411:0:22481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15847 00000100:00100000:1.0:1746129567.070428:0:7086:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8106 00000100:00100000:1.0:1746129567.070434:0:7086:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800903a3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ada2ffba-8920-4ecb-8068-68caa9806978+30:1962:x1830948733996032:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129567.070445:0:7086:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129567.070467:0:7086:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b4e0ee00/0x40a459093b0690de lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20821 expref: 30 pid: 7149 timeout: 922 lvb_type: 0 00010000:00010000:1.0:1746129567.070477:0:7086:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b4e0ee00/0x40a459093b0690de lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20821 expref: 30 pid: 7149 timeout: 922 lvb_type: 0 00010000:00010000:1.0:1746129567.070492:0:7086:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b4e0ee00/0x40a459093b0690de lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20821 expref: 30 pid: 7149 timeout: 922 lvb_type: 0 00010000:00010000:1.0:1746129567.070754:0:7086:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129567.070756:0:7086:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129567.070762:0:7086:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d872e00/0x40a459093b0691a2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [4096000->18446744073709551615] (req 4096000->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2089f expref: 29 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129567.070771:0:7086:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d872e00/0x40a459093b0691a2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [4096000->18446744073709551615] (req 4096000->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2089f expref: 29 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129567.070796:0:7086:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012d872e00/0x40a459093b0691a2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [4096000->18446744073709551615] (req 4096000->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2089f expref: 29 pid: 22481 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129567.070807:0:7086:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092fd3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7086:1830948737462656:192.168.202.4@tcp:105: 00000100:00100000:1.0:1746129567.072538:0:7086:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c954900 going to sleep for 11 seconds 00000100:00100000:0.0:1746129567.073096:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129567.073159:0:31522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733996416 00000100:00100000:3.0:1746129567.073167:0:31522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733996416 00002000:00100000:3.0:1746129567.073210:0:31522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f5:0x0] (2097152->3145727) req@ffff8800903a3b80 x1830948733996416/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:308/0 lens 488/0 e 0 to 0 dl 1746129578 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129567.073225:0:31522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800903a3b80 with x1830948733996416 ext(2097152->3145727) 00002000:00010000:3.0:1746129567.073230:0:31522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800903a3b80 00000100:00100000:3.0:1746129567.073257:0:31522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7626 00000100:00100000:3.0:1746129567.073264:0:31522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800903a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ada2ffba-8920-4ecb-8068-68caa9806978+30:1962:x1830948733996416:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:0.0:1746129567.073929:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129567.074495:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733996544 00000100:00100000:1.0:1746129567.074501:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733996544 00010000:00010000:1.0:1746129567.074526:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012cd7e200/0x40a459093b069147 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20860 expref: 20 pid: 8412 timeout: 922 lvb_type: 0 00000100:00100000:1.0:1746129567.074552:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8107 00000100:00100000:1.0:1746129567.074558:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800903a1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:1962:x1830948733996544:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129567.074569:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129567.074590:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012cd7e200/0x40a459093b069147 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20860 expref: 20 pid: 8412 timeout: 922 lvb_type: 0 00010000:00010000:1.0:1746129567.074602:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012cd7e200/0x40a459093b069147 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20860 expref: 20 pid: 8412 timeout: 922 lvb_type: 0 00010000:00010000:1.0:1746129567.074624:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012cd7e200/0x40a459093b069147 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20860 expref: 20 pid: 8412 timeout: 922 lvb_type: 0 00010000:00010000:1.0:1746129567.074638:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129567.074698:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800903a1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+19:1962:x1830948733996544:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 139us (770us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129567.074704:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8107 00000100:00100000:1.0:1746129567.075798:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129567.076330:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733996800 00000100:00100000:0.0:1746129567.076399:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733996800 00000100:00100000:1.0:1746129567.076461:0:7086:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092fd3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7086:1830948737462656:192.168.202.4@tcp:105: 00010000:00010000:1.0:1746129567.076481:0:7086:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129567.076732:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11149 00000100:00100000:0.0:1746129567.076740:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092fd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+27:32153:x1830948733996800:12345-192.168.202.4@tcp:101:cat.0 00000100:00100000:1.0:1746129567.076812:0:7086:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800903a3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ada2ffba-8920-4ecb-8068-68caa9806978+31:1962:x1830948733996032:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 6376us (7968us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129567.076819:0:7086:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8106 00010000:00010000:0.0:1746129567.077435:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129567.077456:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea5e000/0x40a459093b0691b7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f208b4 expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129567.077512:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129567.077571:0:7086:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733997056 00000100:00100000:1.0:1746129567.077575:0:7086:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733997056 00010000:00010000:0.0:1746129567.077584:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea5fc00/0x40a459093b0691be lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129567.077593:0:7086:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008e798600/0x40a459093b06911d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20836 expref: 32 pid: 7149 timeout: 922 lvb_type: 0 00010000:00010000:0.0:1746129567.077596:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea5fc00/0x40a459093b0691be lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129567.077610:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea5fc00/0x40a459093b0691be lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000100:00100000:1.0:1746129567.077611:0:7086:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8108 00000100:00100000:1.0:1746129567.077615:0:7086:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095627480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ada2ffba-8920-4ecb-8068-68caa9806978+32:1962:x1830948733997056:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129567.077623:0:7086:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129567.077624:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea5ec00/0x40a459093b0691c5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129567.077629:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea5ec00/0x40a459093b0691c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129567.077635:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea5ec00/0x40a459093b0691c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129567.077640:0:7086:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008e798600/0x40a459093b06911d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20836 expref: 32 pid: 7149 timeout: 922 lvb_type: 0 00010000:00010000:1.0:1746129567.077650:0:7086:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008e798600/0x40a459093b06911d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20836 expref: 32 pid: 7149 timeout: 922 lvb_type: 0 00010000:00010000:1.0:1746129567.077668:0:7086:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e798600/0x40a459093b06911d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20836 expref: 32 pid: 7149 timeout: 922 lvb_type: 0 00010000:00010000:1.0:1746129567.077680:0:7086:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129567.077681:0:7086:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129567.077687:0:7086:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d873600/0x40a459093b0691a9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3678208->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f208a6 expref: 18 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129567.077692:0:7086:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d873600/0x40a459093b0691a9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3678208->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f208a6 expref: 18 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129567.077718:0:7086:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012d873600/0x40a459093b0691a9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3678208->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f208a6 expref: 18 pid: 22481 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129567.077728:0:7086:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092fd3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7086:1830948737462784:192.168.202.4@tcp:105: 00010000:00010000:0.0:1746129567.077750:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800955d3800/0x40a459093b0691cc lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129567.077759:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800955d3800/0x40a459093b0691cc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129567.077765:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800955d3800/0x40a459093b0691cc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00200000:0.0:1746129567.077774:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00000100:00100000:1.0:1746129567.077787:0:7086:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c954900 going to sleep for 11 seconds 00010000:00010000:0.0:1746129567.077859:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea5fc00/0x40a459093b0691be lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129567.077866:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea5fc00/0x40a459093b0691be lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129567.077872:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea5fc00/0x40a459093b0691be lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129567.077878:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ea5fc00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:0.0:1746129567.077882:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea5fc00/0x40a459093b0691be lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129567.077890:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea5fc00/0x40a459093b0691be lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129567.077898:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880132ef8f00) 00010000:00010000:0.0:1746129567.077900:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129567.077903:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea5fc00/0x40a459093b0691be lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129567.077908:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea5fc00/0x40a459093b0691be lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129567.077922:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea5ec00/0x40a459093b0691c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129567.077927:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea5ec00/0x40a459093b0691c5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129567.077932:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea5ec00/0x40a459093b0691c5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129567.077936:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ea5ec00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:0.0:1746129567.077939:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea5ec00/0x40a459093b0691c5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129567.077943:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea5ec00/0x40a459093b0691c5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129567.077949:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880094390e00) 00010000:00010000:0.0:1746129567.077951:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129567.077953:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea5ec00/0x40a459093b0691c5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129567.077958:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea5ec00/0x40a459093b0691c5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129567.077992:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea5e000/0x40a459093b0691b7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f208b4 expref: 30 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129567.078002:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800955d3800/0x40a459093b0691cc lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f208b4 expref: 29 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129567.078009:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009f469400) 00010000:00010000:0.0:1746129567.078011:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746129567.078013:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800955d3800, rc 0) 00000100:00100000:0.0:1746129567.078036:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092fd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+29:32153:x1830948733996800:12345-192.168.202.4@tcp:101:cat.0 Request processed in 1296us (2242us total) trans 8589945230 rc 0/0 00000100:00100000:0.0:1746129567.078043:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11149 00000100:00100000:0.0:1746129567.079571:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129567.079647:0:31519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733997184 00000100:00100000:1.0:1746129567.079654:0:31519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733997184 00002000:00100000:1.0:1746129567.079747:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f5:0x0] (4096000->4100095) req@ffff8800903a3480 x1830948733997184/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:308/0 lens 488/0 e 0 to 0 dl 1746129578 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129567.079757:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800903a3480 with x1830948733997184 ext(4096000->4100095) 00002000:00010000:1.0:1746129567.079762:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800903a3480 00000100:00100000:1.0:1746129567.079790:0:31519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7627 00000100:00100000:1.0:1746129567.079796:0:31519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800903a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ada2ffba-8920-4ecb-8068-68caa9806978+31:1963:x1830948733997184:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:1.0:1746129567.080072:0:31519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800903a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ada2ffba-8920-4ecb-8068-68caa9806978+31:1963:x1830948733997184:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 275us (505us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746129567.080079:0:31519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7627 00002000:00100000:1.0:1746129567.080084:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f5:0x0] (4096000->4100095) req@ffff8800903a3480 x1830948733997184/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:308/0 lens 488/4536 e 0 to 0 dl 1746129578 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129567.080091:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800903a3480 with x1830948733997184 ext(4096000->4100095) 00002000:00010000:1.0:1746129567.080093:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800903a3480 00000100:00100000:0.0:1746129567.080811:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129567.081236:0:31522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800903a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ada2ffba-8920-4ecb-8068-68caa9806978+29:1962:x1830948733996416:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 7971us (8143us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129567.081243:0:31522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7626 00002000:00100000:3.0:1746129567.081249:0:31522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f5:0x0] (2097152->3145727) req@ffff8800903a3b80 x1830948733996416/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:308/0 lens 488/440 e 0 to 0 dl 1746129578 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129567.081255:0:31522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800903a3b80 with x1830948733996416 ext(2097152->3145727) 00000100:00100000:1.0:1746129567.081257:0:7086:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092fd3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7086:1830948737462784:192.168.202.4@tcp:105: 00002000:00010000:3.0:1746129567.081258:0:31522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800903a3b80 00000100:00100000:3.0:1746129567.081269:0:31522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733997440 00000100:00100000:3.0:1746129567.081272:0:31522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733997440 00010000:00010000:1.0:1746129567.081276:0:7086:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:3.0:1746129567.081289:0:31522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3ef:0x0] (3678208->3682303) req@ffff88012e87c380 x1830948733997440/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:308/0 lens 488/0 e 0 to 0 dl 1746129578 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129567.081315:0:31522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e87c380 with x1830948733997440 ext(3678208->3682303) 00002000:00010000:3.0:1746129567.081317:0:31522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e87c380 00000100:00100000:1.0:1746129567.081317:0:7086:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095627480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ada2ffba-8920-4ecb-8068-68caa9806978+31:1962:x1830948733997056:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 3700us (3806us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129567.081325:0:7086:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8108 00000100:00100000:3.0:1746129567.081330:0:31522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7628 00000100:00100000:3.0:1746129567.081334:0:31522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e87c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+19:1963:x1830948733997440:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:3.0:1746129567.081443:0:31522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e87c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+19:1963:x1830948733997440:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 107us (632us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129567.081449:0:31522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7628 00002000:00100000:3.0:1746129567.081454:0:31522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3ef:0x0] (3678208->3682303) req@ffff88012e87c380 x1830948733997440/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:308/0 lens 488/4536 e 0 to 0 dl 1746129578 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129567.081461:0:31522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e87c380 with x1830948733997440 ext(3678208->3682303) 00002000:00010000:3.0:1746129567.081464:0:31522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e87c380 00000100:00100000:0.0:1746129567.081791:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129567.082138:0:7086:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733997568 00000100:00100000:1.0:1746129567.082141:0:7086:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733997568 00000100:00100000:1.0:1746129567.082227:0:7086:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 783 00000100:00100000:1.0:1746129567.082233:0:7086:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e87e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+29:1961:x1830948733997568:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129567.082243:0:7086:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129567.082266:0:7086:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800955d3800/0x40a459093b0691cc lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f208b4 expref: 29 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129567.082281:0:7086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009f469400) 00010000:00010000:1.0:1746129567.082285:0:7086:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129567.082336:0:7086:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e87e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+28:1961:x1830948733997568:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 103us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129567.082341:0:7086:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 783 00000100:00100000:0.0:1746129567.082793:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129567.082816:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129567.082833:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129567.082859:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129567.082902:0:22481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733997696 00000100:00100000:2.0:1746129567.082906:0:22481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733997696 00000100:00100000:2.0:1746129567.082929:0:22481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733997824 00000100:00100000:2.0:1746129567.082930:0:22481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733997824 00000100:00100000:2.0:1746129567.082939:0:22481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733997952 00000100:00100000:2.0:1746129567.082941:0:22481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733997952 00000100:00100000:2.0:1746129567.082948:0:22481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733998080 00000100:00100000:2.0:1746129567.082949:0:22481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733998080 00000100:00100000:2.0:1746129567.082960:0:22481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15849 00000100:00100000:2.0:1746129567.082965:0:22481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e87f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+15:1963:x1830948733997696:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129567.082977:0:22481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129567.082991:0:22481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d873400/0x40a459093b0691da lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f208bb expref: -99 pid: 22481 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129567.083036:0:22481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095627800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:22481:1830948737462912:192.168.202.4@tcp:106: 00000100:00100000:2.0:1746129567.083095:0:22481:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800951de240 going to sleep for 11 seconds 00000100:00100000:2.0:1746129567.083111:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15850 00000100:00100000:2.0:1746129567.083116:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e87ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+16:1963:x1830948733997824:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129567.083122:0:7149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129567.083130:0:7149:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d872c00/0x40a459093b0691e1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f208c2 expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129567.083151:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095627100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7149:1830948737463040:192.168.202.4@tcp:106: 00000100:00100000:2.0:1746129567.083166:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800951de900 going to sleep for 11 seconds 00000100:00100000:1.0:1746129567.083215:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15851 00000100:00100000:1.0:1746129567.083221:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e87dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+17:1963:x1830948733997952:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129567.083226:0:7148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129567.083232:0:7148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f228400/0x40a459093b0691e8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f208c9 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129567.083251:0:7148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092fd3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:7148:1830948737463168:192.168.202.4@tcp:106: 00000100:00100000:1.0:1746129567.083273:0:7148:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c954900 going to sleep for 11 seconds 00000100:00100000:1.0:1746129567.083286:0:20577:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15852 00000100:00100000:1.0:1746129567.083290:0:20577:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ada2ffba-8920-4ecb-8068-68caa9806978+31:32150:x1830948733998080:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:1.0:1746129567.083314:0:20577:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129567.083323:0:20577:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f228c00/0x40a459093b0691ef lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f208d0 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129567.083339:0:20577:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d873600/0x40a459093b0691a9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3678208->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f208a6 expref: 18 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129567.083522:0:20577:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129567.083524:0:20577:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129567.083527:0:20577:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f228c00/0x40a459093b0691ef lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [4194304->4620287] (req 4194304->4620287) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f208d0 expref: 32 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129567.083546:0:20577:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d873600/0x40a459093b0691a9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3678208->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f208a6 expref: 18 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129567.083560:0:20577:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d873600/0x40a459093b0691a9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3678208->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f208a6 expref: 18 pid: 22481 timeout: 922 lvb_type: 0 00000100:00100000:1.0:1746129567.083569:0:20577:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092fd3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20577:1830948737463296:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129567.083605:0:20577:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c954540 going to sleep for 11 seconds 00000100:00100000:0.0:1746129567.087989:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129567.088116:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129567.088141:0:11014:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733998208 00000100:00100000:0.0:1746129567.088150:0:11014:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733998208 00000100:00100000:0.0:1746129567.088194:0:11014:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733998336 00000100:00100000:0.0:1746129567.088196:0:11014:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733998336 00000100:00100000:0.0:1746129567.088212:0:11014:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15853 00000100:00100000:1.0:1746129567.088216:0:20577:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092fd3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20577:1830948737463296:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129567.088219:0:11014:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+19:32143:x1830948733998208:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:0.0:1746129567.088240:0:11014:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129567.088244:0:20577:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f228c00/0x40a459093b0691ef lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [4194304->4620287] (req 4194304->4620287) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f208d0 expref: 33 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129567.088257:0:11014:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800955d3400/0x40a459093b0691f6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f208d7 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129567.088263:0:20577:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f228c00, rc 0) 00010000:00010000:0.0:1746129567.088284:0:11014:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129567.088286:0:11014:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129567.088311:0:11014:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800955d3400/0x40a459093b0691f6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [3145728->4095999] (req 3145728->3624959) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f208d7 expref: 20 pid: 11014 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129567.088318:0:8411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15854 00010000:00010000:0.0:1746129567.088324:0:11014:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800955d3400/0x40a459093b0691f6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [3145728->4095999] (req 3145728->3624959) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f208d7 expref: 20 pid: 11014 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129567.088326:0:8411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ada2ffba-8920-4ecb-8068-68caa9806978+33:32148:x1830948733998336:12345-192.168.202.4@tcp:101:cat.0 00000100:00100000:1.0:1746129567.088331:0:20577:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ada2ffba-8920-4ecb-8068-68caa9806978+33:32150:x1830948733998080:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 5038us (5469us total) trans 0 rc 0/0 00010000:00010000:0.0:1746129567.088332:0:11014:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800955d3400, rc 0) 00010000:00010000:2.0:1746129567.088335:0:8411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746129567.088340:0:20577:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15852 00010000:00010000:2.0:1746129567.088344:0:8411:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d872800/0x40a459093b0691fd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f208de expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129567.088361:0:11014:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:32143:x1830948733998208:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 142us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129567.088366:0:11014:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15853 00010000:00010000:2.0:1746129567.088374:0:8411:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129567.088375:0:8411:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129567.088379:0:8411:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d872800/0x40a459093b0691fd lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f208de expref: 33 pid: 8411 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129567.088388:0:8411:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d872800/0x40a459093b0691fd lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f208de expref: 33 pid: 8411 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129567.088394:0:8411:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d872800, rc 0) 00000100:00100000:1.0:1746129567.088407:0:7148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092fd3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:7148:1830948737463168:192.168.202.4@tcp:106: 00000100:00100000:2.0:1746129567.088412:0:8411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ada2ffba-8920-4ecb-8068-68caa9806978+33:32148:x1830948733998336:12345-192.168.202.4@tcp:101:cat.0 Request processed in 87us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129567.088417:0:8411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15854 00010000:00010000:1.0:1746129567.088424:0:7148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f228400/0x40a459093b0691e8 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f208c9 expref: 19 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129567.088435:0:7148:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f228400/0x40a459093b0691e8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f208c9 expref: 19 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129567.088444:0:7148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f228400, rc 0) 00000100:00100000:1.0:1746129567.088462:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e87dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+18:1963:x1830948733997952:12345-192.168.202.4@tcp:101:cat.0 Request processed in 5241us (5627us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129567.088468:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095627100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7149:1830948737463040:192.168.202.4@tcp:106: 00000100:00100000:1.0:1746129567.088468:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15851 00010000:00010000:2.0:1746129567.088484:0:7149:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d872c00/0x40a459093b0691e1 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f208c2 expref: 17 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129567.088498:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d872c00/0x40a459093b0691e1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f208c2 expref: 17 pid: 7149 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746129567.088509:0:22481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095627800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:22481:1830948737462912:192.168.202.4@tcp:106: 00010000:00010000:2.0:1746129567.088510:0:7149:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d872c00, rc 0) 00010000:00010000:3.0:1746129567.088526:0:22481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d873400/0x40a459093b0691da lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f208bb expref: 16 pid: 22481 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746129567.088528:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e87ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+16:1963:x1830948733997824:12345-192.168.202.4@tcp:101:cat.0 Request processed in 5412us (5711us total) trans 0 rc 301/301 00010000:00010000:3.0:1746129567.088533:0:22481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d873400/0x40a459093b0691da lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f208bb expref: 16 pid: 22481 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746129567.088534:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15850 00010000:00010000:3.0:1746129567.088545:0:22481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d873400, rc 0) 00000100:00100000:3.0:1746129567.088575:0:22481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e87f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+14:1963:x1830948733997696:12345-192.168.202.4@tcp:101:cat.0 Request processed in 5609us (5782us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129567.088580:0:22481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15849 00000100:00100000:0.0:1746129567.089930:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129567.090021:0:31520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733998464 00000100:00100000:2.0:1746129567.090028:0:31520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733998464 00002000:00100000:2.0:1746129567.090065:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3ef:0x0] (3678208->4194303) req@ffff8800900f7b80 x1830948733998464/t0(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:308/0 lens 488/0 e 0 to 0 dl 1746129578 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129567.090074:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800900f7b80 with x1830948733998464 ext(3678208->4194303) 00010000:00010000:2.0:1746129567.090081:0:31520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012d873600/0x40a459093b0691a9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3678208->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f208a6 expref: 19 pid: 22481 timeout: 922 lvb_type: 0 00010000:00010000:2.0:1746129567.090094:0:31520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012d873600/0x40a459093b0691a9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3678208->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f208a6 expref: 19 pid: 22481 timeout: 922 lvb_type: 0 00002000:00010000:2.0:1746129567.090100:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800900f7b80 00000100:00100000:2.0:1746129567.090133:0:31520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2382 00000100:00100000:2.0:1746129567.090139:0:31520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+19:1962:x1830948733998464:12345-192.168.202.4@tcp:4:multiop.0 00000100:00100000:0.0:1746129567.092550:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129567.092644:0:11014:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733998592 00000100:00100000:2.0:1746129567.092653:0:11014:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733998592 00000100:00100000:2.0:1746129567.093151:0:11014:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15855 00000100:00100000:2.0:1746129567.093159:0:11014:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013145e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+14:32153:x1830948733998592:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129567.093181:0:11014:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129567.093198:0:11014:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d872600/0x40a459093b069204 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f208e5 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129567.093227:0:11014:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ee1b600/0x40a459093b06914e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1728512->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20867 expref: 28 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129567.093235:0:11014:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129567.093236:0:11014:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129567.093240:0:11014:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d872600/0x40a459093b069204 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f208e5 expref: 15 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129567.093273:0:11014:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ee1b600/0x40a459093b06914e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1728512->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20867 expref: 28 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129567.093286:0:11014:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ee1b600/0x40a459093b06914e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1728512->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20867 expref: 28 pid: 22481 timeout: 922 lvb_type: 0 00000100:00100000:2.0:1746129567.093332:0:11014:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095627100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11014:1830948737463424:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129567.093447:0:11014:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800951de900 going to sleep for 11 seconds 00000100:00100000:3.0:1746129567.096636:0:11014:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095627100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11014:1830948737463424:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129567.096663:0:11014:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d872600/0x40a459093b069204 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f208e5 expref: 15 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129567.096678:0:11014:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d872600, rc 0) 00000100:00100000:3.0:1746129567.096722:0:11014:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013145e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+15:32153:x1830948733998592:12345-192.168.202.4@tcp:101:cat.0 Request processed in 3563us (4182us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129567.096729:0:11014:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15855 00000100:00100000:0.0:1746129567.097255:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129567.097316:0:31522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733998848 00000100:00100000:3.0:1746129567.097322:0:31522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733998848 00002000:00100000:3.0:1746129567.097373:0:31522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f5:0x0] (3620864->3624959) req@ffff88013145d880 x1830948733998848/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:308/0 lens 488/0 e 0 to 0 dl 1746129578 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129567.097382:0:31522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013145d880 with x1830948733998848 ext(3620864->3624959) 00002000:00010000:3.0:1746129567.097387:0:31522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013145d880 00000100:00100000:0.0:1746129567.097394:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129567.097424:0:31522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733998976 00000100:00100000:3.0:1746129567.097427:0:31522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733998976 00002000:00100000:3.0:1746129567.097439:0:31522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f3:0x0] (1728512->2097151) req@ffff88013145d180 x1830948733998976/t0(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:308/0 lens 488/0 e 0 to 0 dl 1746129578 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129567.097445:0:31522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013145d180 with x1830948733998976 ext(1728512->2097151) 00010000:00010000:3.0:1746129567.097451:0:31522:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ee1b600/0x40a459093b06914e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1728512->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20867 expref: 29 pid: 22481 timeout: 922 lvb_type: 0 00010000:00010000:3.0:1746129567.097460:0:31522:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ee1b600/0x40a459093b06914e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1728512->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20867 expref: 29 pid: 22481 timeout: 922 lvb_type: 0 00002000:00010000:3.0:1746129567.097466:0:31522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88013145d180 00000100:00100000:1.0:1746129567.097605:0:31519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2383 00000100:00100000:1.0:1746129567.097615:0:31519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013145d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ada2ffba-8920-4ecb-8068-68caa9806978+29:1962:x1830948733998976:12345-192.168.202.4@tcp:4:multiop.0 00000100:00100000:3.0:1746129567.098064:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7629 00000100:00100000:3.0:1746129567.098070:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013145d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+15:1963:x1830948733998848:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:3.0:1746129567.098887:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013145d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+15:1963:x1830948733998848:12345-192.168.202.4@tcp:3:cat.0 Request processed in 815us (1631us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129567.098894:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7629 00002000:00100000:3.0:1746129567.098901:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f5:0x0] (3620864->3624959) req@ffff88013145d880 x1830948733998848/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:308/0 lens 488/4536 e 0 to 0 dl 1746129578 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129567.098909:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013145d880 with x1830948733998848 ext(3620864->3624959) 00002000:00010000:3.0:1746129567.098913:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013145d880 00000100:00100000:2.0:1746129567.101434:0:31520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:1962:x1830948733998464:12345-192.168.202.4@tcp:4:multiop.0 Request processed in 11283us (11498us total) trans 21474841290 rc 0/0 00000100:00100000:2.0:1746129567.101446:0:31520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2382 00002000:00100000:2.0:1746129567.101459:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3ef:0x0] (3678208->4194303) req@ffff8800900f7b80 x1830948733998464/t21474841290(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:308/0 lens 488/448 e 0 to 0 dl 1746129578 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129567.101468:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800900f7b80 with x1830948733998464 ext(3678208->4194303) 00010000:00010000:2.0:1746129567.101480:0:31520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012d873600/0x40a459093b0691a9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3678208->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f208a6 expref: 21 pid: 22481 timeout: 922 lvb_type: 0 00010000:00010000:2.0:1746129567.101493:0:31520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012d873600/0x40a459093b0691a9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3678208->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f208a6 expref: 21 pid: 22481 timeout: 922 lvb_type: 0 00002000:00010000:2.0:1746129567.101501:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800900f7b80 00000100:00100000:1.0:1746129567.102736:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129567.102877:0:14551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733999232 00000100:00100000:1.0:1746129567.102887:0:14551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733999232 00000100:00100000:1.0:1746129567.102945:0:14551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4716 00000100:00100000:1.0:1746129567.102953:0:14551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095566850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+28:32143:x1830948733999232:12345-192.168.202.4@tcp:35:multiop.0 00000100:00100000:1.0:1746129567.103160:0:14551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095566850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+29:32143:x1830948733999232:12345-192.168.202.4@tcp:35:multiop.0 Request processed in 208us (432us total) trans 8589945231 rc 0/0 00000100:00100000:1.0:1746129567.103167:0:14551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4716 00000100:00100000:0.0:1746129567.106278:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129567.106409:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733999360 00000100:00100000:2.0:1746129567.106420:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733999360 00010000:00010000:2.0:1746129567.107434:0:9823:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d873600/0x40a459093b0691a9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3678208->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f208a6 expref: 21 pid: 22481 timeout: 922 lvb_type: 0 00000100:00100000:2.0:1746129567.107482:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8109 00000100:00100000:2.0:1746129567.107491:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f37c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:1960:x1830948733999360:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129567.107506:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129567.107532:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d873600/0x40a459093b0691a9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3678208->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f208a6 expref: 21 pid: 22481 timeout: 922 lvb_type: 0 00010000:00010000:2.0:1746129567.107544:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d873600/0x40a459093b0691a9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3678208->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f208a6 expref: 21 pid: 22481 timeout: 922 lvb_type: 0 00010000:00010000:2.0:1746129567.107568:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d873600/0x40a459093b0691a9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3678208->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f208a6 expref: 21 pid: 22481 timeout: 922 lvb_type: 0 00010000:00010000:2.0:1746129567.107598:0:9823:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129567.107600:0:9823:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129567.107608:0:9823:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f228c00/0x40a459093b0691ef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4620287) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f208d0 expref: 32 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129567.107621:0:9823:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f228c00/0x40a459093b0691ef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4620287) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f208d0 expref: 32 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129567.107630:0:9823:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129567.107631:0:9823:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129567.107634:0:9823:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d872800/0x40a459093b0691fd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f208de expref: 32 pid: 8411 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129567.107640:0:9823:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d872800/0x40a459093b0691fd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f208de expref: 32 pid: 8411 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129567.107673:0:9823:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012d872800/0x40a459093b0691fd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f208de expref: 32 pid: 8411 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129567.107687:0:9823:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095626a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9823:1830948737463552:192.168.202.4@tcp:105: 00010000:00010000:2.0:1746129567.107778:0:9823:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f228c00/0x40a459093b0691ef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4620287) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f208d0 expref: 32 pid: 20577 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129567.107786:0:9823:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095625880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9823:1830948737463680:192.168.202.4@tcp:105: 00000100:00100000:2.0:1746129567.107805:0:9823:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800951decc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746129567.108106:0:31519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013145d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ada2ffba-8920-4ecb-8068-68caa9806978+31:1962:x1830948733998976:12345-192.168.202.4@tcp:4:multiop.0 Request processed in 10492us (10811us total) trans 17179874049 rc 0/0 00000100:00100000:1.0:1746129567.108120:0:31519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2383 00002000:00100000:1.0:1746129567.108130:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f3:0x0] (1728512->2097151) req@ffff88013145d180 x1830948733998976/t17179874049(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:308/0 lens 488/448 e 0 to 0 dl 1746129578 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129567.108139:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013145d180 with x1830948733998976 ext(1728512->2097151) 00010000:00010000:1.0:1746129567.108146:0:31519:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ee1b600/0x40a459093b06914e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1728512->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20867 expref: 31 pid: 22481 timeout: 922 lvb_type: 0 00010000:00010000:1.0:1746129567.108160:0:31519:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ee1b600/0x40a459093b06914e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1728512->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20867 expref: 31 pid: 22481 timeout: 922 lvb_type: 0 00002000:00010000:1.0:1746129567.108166:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88013145d180 00000100:00100000:0.0:1746129567.112366:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129567.112488:0:31519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733999616 00000100:00100000:1.0:1746129567.112497:0:31519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733999616 00000100:00100000:2.0:1746129567.112520:0:9823:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095626a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9823:1830948737463552:192.168.202.4@tcp:105: 00000100:00100000:2.0:1746129567.112530:0:9823:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095625880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9823:1830948737463680:192.168.202.4@tcp:105: 00002000:00100000:1.0:1746129567.112548:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3ef:0x0] (4616192->4620287) req@ffff88009f37d180 x1830948733999616/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:308/0 lens 488/0 e 0 to 0 dl 1746129578 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00010000:00010000:2.0:1746129567.112551:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:1.0:1746129567.112558:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f37d180 with x1830948733999616 ext(4616192->4620287) 00002000:00010000:1.0:1746129567.112563:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f37d180 00000100:00100000:1.0:1746129567.112595:0:31519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7630 00000100:00100000:2.0:1746129567.112597:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f37c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:1960:x1830948733999360:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 5108us (6329us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129567.112602:0:31519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f37d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ada2ffba-8920-4ecb-8068-68caa9806978+33:1961:x1830948733999616:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:2.0:1746129567.112607:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8109 00000100:00100000:1.0:1746129567.112771:0:31519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f37d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ada2ffba-8920-4ecb-8068-68caa9806978+33:1961:x1830948733999616:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 169us (424us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746129567.112776:0:31519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7630 00002000:00100000:1.0:1746129567.112781:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3ef:0x0] (4616192->4620287) req@ffff88009f37d180 x1830948733999616/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:308/0 lens 488/4536 e 0 to 0 dl 1746129578 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129567.112794:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f37d180 with x1830948733999616 ext(4616192->4620287) 00002000:00010000:1.0:1746129567.112797:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f37d180 00000100:00100000:0.0:1746129567.117413:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129567.118590:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129567.118719:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734000000 00000100:00100000:2.0:1746129567.118729:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734000000 00010000:00010000:2.0:1746129567.118770:0:9823:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ee1b600/0x40a459093b06914e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1728512->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20867 expref: 31 pid: 22481 timeout: 922 lvb_type: 0 00000100:00100000:2.0:1746129567.118799:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8110 00000100:00100000:2.0:1746129567.118807:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f37c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ada2ffba-8920-4ecb-8068-68caa9806978+31:1963:x1830948734000000:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129567.118821:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129567.118844:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ee1b600/0x40a459093b06914e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1728512->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20867 expref: 31 pid: 22481 timeout: 922 lvb_type: 0 00010000:00010000:2.0:1746129567.118855:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ee1b600/0x40a459093b06914e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1728512->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20867 expref: 31 pid: 22481 timeout: 922 lvb_type: 0 00010000:00010000:2.0:1746129567.118878:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ee1b600/0x40a459093b06914e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1728512->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20867 expref: 31 pid: 22481 timeout: 922 lvb_type: 0 00000100:00100000:3.0:1746129567.122030:0:31520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948733999872 00000100:00100000:3.0:1746129567.122046:0:31520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948733999872 00002000:00100000:3.0:1746129567.122108:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->4194303) req@ffff88009f37f100 x1830948733999872/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:308/0 lens 488/0 e 0 to 0 dl 1746129578 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129567.122119:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f37f100 with x1830948733999872 ext(3145728->4194303) 00002000:00010000:3.0:1746129567.122126:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f37f100 00000100:00100000:3.0:1746129567.122164:0:31520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7631 00000100:00100000:3.0:1746129567.122172:0:31520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f37f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ada2ffba-8920-4ecb-8068-68caa9806978+33:1963:x1830948733999872:12345-192.168.202.4@tcp:3:multiop.0 00010000:00010000:2.0:1746129567.124591:0:9823:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129567.124597:0:9823:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129567.124615:0:9823:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d872600/0x40a459093b069204 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f208e5 expref: 14 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129567.124627:0:9823:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d872600/0x40a459093b069204 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f208e5 expref: 14 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129567.124679:0:9823:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012d872600/0x40a459093b069204 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f208e5 expref: 14 pid: 11014 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129567.124696:0:9823:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095625880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9823:1830948737463808:192.168.202.4@tcp:105: 00000100:00100000:2.0:1746129567.124798:0:9823:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800951decc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746129567.130976:0:31520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f37f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ada2ffba-8920-4ecb-8068-68caa9806978+33:1963:x1830948733999872:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 8791us (13561us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129567.130990:0:31520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7631 00002000:00100000:3.0:1746129567.131003:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->4194303) req@ffff88009f37f100 x1830948733999872/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:308/0 lens 488/440 e 0 to 0 dl 1746129578 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129567.131013:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f37f100 with x1830948733999872 ext(3145728->4194303) 00002000:00010000:3.0:1746129567.131020:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f37f100 00000100:00100000:0.0:1746129567.134336:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129567.134738:0:9823:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095625880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9823:1830948737463808:192.168.202.4@tcp:105: 00010000:00010000:2.0:1746129567.134760:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129567.134788:0:31520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734000256 00000100:00100000:3.0:1746129567.134796:0:31520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734000256 00002000:00100000:3.0:1746129567.134844:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff88009f37df80 x1830948734000256/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:308/0 lens 488/0 e 0 to 0 dl 1746129578 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129567.134855:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f37df80 with x1830948734000256 ext(1048576->2097151) 00002000:00010000:3.0:1746129567.134860:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f37df80 00000100:00100000:2.0:1746129567.135653:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f37c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ada2ffba-8920-4ecb-8068-68caa9806978+30:1963:x1830948734000000:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 16840us (17059us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129567.135664:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8110 00000100:00100000:3.0:1746129567.136150:0:31520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7632 00000100:00100000:3.0:1746129567.136163:0:31520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f37df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+15:1962:x1830948734000256:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129567.138628:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129567.139412:0:11014:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734000384 00000100:00100000:2.0:1746129567.139422:0:11014:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734000384 00000100:00100000:2.0:1746129567.139479:0:11014:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15856 00000100:00100000:2.0:1746129567.139488:0:11014:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f37d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ada2ffba-8920-4ecb-8068-68caa9806978+30:32148:x1830948734000384:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129567.139508:0:11014:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129567.139528:0:11014:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d873400/0x40a459093b06920b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f208ec expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129567.139560:0:11014:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800955d3400/0x40a459093b0691f6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [3145728->4095999] (req 3145728->3624959) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f208d7 expref: 16 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129567.139568:0:11014:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d872e00/0x40a459093b0691a2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [4096000->18446744073709551615] (req 4096000->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2089f expref: 31 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129567.139573:0:11014:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746129567.139575:0:11014:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746129567.139578:0:11014:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d873400/0x40a459093b06920b lrc: 5/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f208ec expref: 31 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129567.139613:0:11014:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d872e00/0x40a459093b0691a2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [4096000->18446744073709551615] (req 4096000->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2089f expref: 31 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129567.139625:0:11014:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d872e00/0x40a459093b0691a2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [4096000->18446744073709551615] (req 4096000->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2089f expref: 31 pid: 22481 timeout: 922 lvb_type: 0 00000100:00100000:2.0:1746129567.139638:0:11014:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095625880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11014:1830948737463936:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129567.139728:0:11014:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800955d3400/0x40a459093b0691f6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [3145728->4095999] (req 3145728->3624959) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f208d7 expref: 16 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129567.139737:0:11014:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800955d3400/0x40a459093b0691f6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [3145728->4095999] (req 3145728->3624959) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f208d7 expref: 16 pid: 11014 timeout: 922 lvb_type: 0 00000100:00100000:2.0:1746129567.139744:0:11014:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095626a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11014:1830948737464064:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129567.139769:0:11014:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800951decc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129567.144252:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129567.144323:0:11014:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095625880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11014:1830948737463936:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129567.144358:0:11014:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095626a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11014:1830948737464064:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129567.144390:0:11014:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d873400/0x40a459093b06920b lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f208ec expref: 31 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129567.144407:0:11014:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d873400, rc 0) 00000100:00100000:2.0:1746129567.144459:0:11014:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f37d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ada2ffba-8920-4ecb-8068-68caa9806978+31:32148:x1830948734000384:12345-192.168.202.4@tcp:101:cat.0 Request processed in 4971us (5841us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129567.144471:0:11014:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15856 00000100:00100000:0.0:1746129567.144582:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129567.144648:0:31522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734000512 00000100:00100000:3.0:1746129567.144657:0:31522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734000512 00000100:00100000:1.0:1746129567.144658:0:31519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734000640 00000100:00100000:1.0:1746129567.144662:0:31519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734000640 00002000:00100000:3.0:1746129567.144693:0:31522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f5:0x0] (4096000->4194303) req@ffff88009f37e680 x1830948734000512/t0(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:308/0 lens 488/0 e 0 to 0 dl 1746129578 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129567.144693:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f5:0x0] (3145728->3624959) req@ffff88008f44bb80 x1830948734000640/t0(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:308/0 lens 488/0 e 0 to 0 dl 1746129578 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129567.144702:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f44bb80 with x1830948734000640 ext(3145728->3624959) 00002000:00100000:3.0:1746129567.144703:0:31522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f37e680 with x1830948734000512 ext(4096000->4194303) 00010000:00010000:3.0:1746129567.144709:0:31522:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012d872e00/0x40a459093b0691a2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [4096000->18446744073709551615] (req 4096000->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2089f expref: 31 pid: 22481 timeout: 922 lvb_type: 0 00010000:00010000:1.0:1746129567.144709:0:31519:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800955d3400/0x40a459093b0691f6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [3145728->4095999] (req 3145728->3624959) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f208d7 expref: 17 pid: 11014 timeout: 922 lvb_type: 0 00010000:00010000:1.0:1746129567.144719:0:31519:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800955d3400/0x40a459093b0691f6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [3145728->4095999] (req 3145728->3624959) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f208d7 expref: 17 pid: 11014 timeout: 922 lvb_type: 0 00010000:00010000:3.0:1746129567.144720:0:31522:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012d872e00/0x40a459093b0691a2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [4096000->18446744073709551615] (req 4096000->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2089f expref: 31 pid: 22481 timeout: 922 lvb_type: 0 00002000:00010000:3.0:1746129567.144726:0:31522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f37e680 00002000:00010000:1.0:1746129567.144726:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008f44bb80 00000100:00100000:1.0:1746129567.144760:0:31519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2384 00000100:00100000:1.0:1746129567.144767:0:31519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f44bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+17:1962:x1830948734000640:12345-192.168.202.4@tcp:4:cat.0 00000100:00100000:3.0:1746129567.144778:0:31522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2385 00000100:00100000:3.0:1746129567.144784:0:31522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f37e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ada2ffba-8920-4ecb-8068-68caa9806978+31:1963:x1830948734000512:12345-192.168.202.4@tcp:4:multiop.0 00000100:00100000:3.0:1746129567.149501:0:31522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f37e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ada2ffba-8920-4ecb-8068-68caa9806978+33:1963:x1830948734000512:12345-192.168.202.4@tcp:4:multiop.0 Request processed in 4700us (5243us total) trans 17179874050 rc 0/0 00000100:00100000:3.0:1746129567.149515:0:31522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2385 00002000:00100000:3.0:1746129567.149530:0:31522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f5:0x0] (4096000->4194303) req@ffff88009f37e680 x1830948734000512/t17179874050(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:308/0 lens 488/448 e 0 to 0 dl 1746129578 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129567.149541:0:31522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f37e680 with x1830948734000512 ext(4096000->4194303) 00010000:00010000:3.0:1746129567.149553:0:31522:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012d872e00/0x40a459093b0691a2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [4096000->18446744073709551615] (req 4096000->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2089f expref: 33 pid: 22481 timeout: 922 lvb_type: 0 00010000:00010000:3.0:1746129567.149567:0:31522:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012d872e00/0x40a459093b0691a2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [4096000->18446744073709551615] (req 4096000->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2089f expref: 33 pid: 22481 timeout: 922 lvb_type: 0 00002000:00010000:3.0:1746129567.149580:0:31522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f37e680 00000100:00100000:3.0:1746129567.151329:0:31520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f37df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+17:1962:x1830948734000256:12345-192.168.202.4@tcp:3:cat.0 Request processed in 15160us (16995us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129567.151342:0:31520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7632 00002000:00100000:3.0:1746129567.151366:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff88009f37df80 x1830948734000256/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:308/0 lens 488/440 e 0 to 0 dl 1746129578 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129567.151376:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f37df80 with x1830948734000256 ext(1048576->2097151) 00002000:00010000:3.0:1746129567.151382:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f37df80 00000100:00100000:0.0:1746129567.152644:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129567.152853:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734000768 00000100:00100000:2.0:1746129567.152863:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734000768 00010000:00010000:2.0:1746129567.152899:0:9823:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d872e00/0x40a459093b0691a2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [4096000->18446744073709551615] (req 4096000->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2089f expref: 33 pid: 22481 timeout: 922 lvb_type: 0 00000100:00100000:2.0:1746129567.152944:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8111 00000100:00100000:2.0:1746129567.152952:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6027850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ada2ffba-8920-4ecb-8068-68caa9806978+33:1961:x1830948734000768:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129567.152969:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129567.152984:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d872e00/0x40a459093b0691a2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [4096000->18446744073709551615] (req 4096000->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2089f expref: 33 pid: 22481 timeout: 922 lvb_type: 0 00010000:00010000:2.0:1746129567.152995:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d872e00/0x40a459093b0691a2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [4096000->18446744073709551615] (req 4096000->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2089f expref: 33 pid: 22481 timeout: 922 lvb_type: 0 00010000:00010000:2.0:1746129567.153024:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d872e00/0x40a459093b0691a2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [4096000->18446744073709551615] (req 4096000->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2089f expref: 33 pid: 22481 timeout: 922 lvb_type: 0 00010000:00010000:2.0:1746129567.153046:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129567.153092:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6027850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ada2ffba-8920-4ecb-8068-68caa9806978+32:1961:x1830948734000768:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 140us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129567.153098:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8111 00000100:00100000:1.0:1746129567.154255:0:31519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f44bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+17:1962:x1830948734000640:12345-192.168.202.4@tcp:4:cat.0 Request processed in 9483us (9668us total) trans 17179874051 rc 0/0 00000100:00100000:1.0:1746129567.154265:0:31519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2384 00002000:00100000:1.0:1746129567.154276:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f5:0x0] (3145728->3624959) req@ffff88008f44bb80 x1830948734000640/t17179874051(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:308/0 lens 488/448 e 0 to 0 dl 1746129578 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129567.154285:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f44bb80 with x1830948734000640 ext(3145728->3624959) 00010000:00010000:1.0:1746129567.154312:0:31519:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800955d3400/0x40a459093b0691f6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [3145728->4095999] (req 3145728->3624959) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f208d7 expref: 17 pid: 11014 timeout: 922 lvb_type: 0 00010000:00010000:1.0:1746129567.154332:0:31519:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800955d3400/0x40a459093b0691f6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [3145728->4095999] (req 3145728->3624959) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f208d7 expref: 17 pid: 11014 timeout: 922 lvb_type: 0 00002000:00010000:1.0:1746129567.154338:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008f44bb80 00000100:00100000:0.0:1746129567.157694:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129567.157757:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129567.157866:0:7086:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734000896 00000100:00100000:2.0:1746129567.157877:0:7086:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734000896 00010000:00010000:2.0:1746129567.157916:0:7086:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800955d3400/0x40a459093b0691f6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [3145728->4095999] (req 3145728->3624959) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f208d7 expref: 17 pid: 11014 timeout: 922 lvb_type: 0 00000100:00100000:2.0:1746129567.157953:0:7086:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8112 00000100:00100000:2.0:1746129567.157961:0:7086:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f44b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+17:1960:x1830948734000896:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129567.157977:0:7086:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129567.158003:0:7086:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800955d3400/0x40a459093b0691f6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [3145728->4095999] (req 3145728->3624959) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f208d7 expref: 17 pid: 11014 timeout: 922 lvb_type: 0 00010000:00010000:2.0:1746129567.158015:0:7086:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800955d3400/0x40a459093b0691f6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [3145728->4095999] (req 3145728->3624959) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f208d7 expref: 17 pid: 11014 timeout: 922 lvb_type: 0 00010000:00010000:2.0:1746129567.158040:0:7086:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800955d3400/0x40a459093b0691f6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [3145728->4095999] (req 3145728->3624959) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f208d7 expref: 17 pid: 11014 timeout: 922 lvb_type: 0 00000100:00100000:3.0:1746129567.158584:0:11014:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734001024 00000100:00100000:3.0:1746129567.158590:0:11014:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734001024 00000100:00100000:3.0:1746129567.158624:0:11014:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15857 00000100:00100000:3.0:1746129567.158630:0:11014:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f448000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+17:32153:x1830948734001024:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129567.158651:0:11014:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129567.158665:0:11014:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ee1b800/0x40a459093b069212 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f208f3 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129567.158688:0:11014:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f8d5800/0x40a459093b06917f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1695743) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2087c expref: 31 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129567.158696:0:11014:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129567.158698:0:11014:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129567.158702:0:11014:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ee1b800/0x40a459093b069212 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f208f3 expref: 18 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129567.158736:0:11014:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f8d5800/0x40a459093b06917f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1695743) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2087c expref: 31 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129567.158749:0:11014:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f8d5800/0x40a459093b06917f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1695743) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2087c expref: 31 pid: 22481 timeout: 922 lvb_type: 0 00000100:00100000:3.0:1746129567.158767:0:11014:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135724a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11014:1830948737464192:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129567.158820:0:7086:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129567.158822:0:7086:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129567.158829:0:7086:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d873400/0x40a459093b06920b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f208ec expref: 31 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129567.158838:0:7086:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d873400/0x40a459093b06920b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f208ec expref: 31 pid: 11014 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129567.158844:0:11014:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a7ba80 going to sleep for 11 seconds 00010000:00010000:2.0:1746129567.158862:0:7086:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012d873400/0x40a459093b06920b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f208ec expref: 31 pid: 11014 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129567.158871:0:7086:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095627480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7086:1830948737464320:192.168.202.4@tcp:105: 00000100:00100000:2.0:1746129567.158898:0:7086:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800951de900 going to sleep for 11 seconds 00000100:00100000:3.0:1746129567.161599:0:11014:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135724a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11014:1830948737464192:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129567.161633:0:11014:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ee1b800/0x40a459093b069212 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f208f3 expref: 18 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129567.161650:0:11014:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ee1b800, rc 0) 00000100:00100000:2.0:1746129567.161662:0:7086:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095627480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7086:1830948737464320:192.168.202.4@tcp:105: 00010000:00010000:2.0:1746129567.161675:0:7086:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129567.161695:0:11014:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f448000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+18:32153:x1830948734001024:12345-192.168.202.4@tcp:101:cat.0 Request processed in 3064us (3936us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129567.161696:0:7086:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f44b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+18:1960:x1830948734000896:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 3736us (4014us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129567.161704:0:11014:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15857 00000100:00100000:2.0:1746129567.161704:0:7086:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8112 00000100:00100000:0.0:1746129567.162195:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129567.162824:0:31519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734001152 00000100:00100000:1.0:1746129567.162832:0:31519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734001152 00002000:00100000:1.0:1746129567.162874:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f4:0x0] (1048576->1695743) req@ffff88008f449180 x1830948734001152/t0(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:308/0 lens 488/0 e 0 to 0 dl 1746129578 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129567.162884:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f449180 with x1830948734001152 ext(1048576->1695743) 00010000:00010000:1.0:1746129567.162892:0:31519:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f8d5800/0x40a459093b06917f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1695743) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2087c expref: 32 pid: 22481 timeout: 922 lvb_type: 0 00010000:00010000:1.0:1746129567.162904:0:31519:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f8d5800/0x40a459093b06917f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1695743) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2087c expref: 32 pid: 22481 timeout: 922 lvb_type: 0 00002000:00010000:1.0:1746129567.162910:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008f449180 00000100:00100000:1.0:1746129567.162941:0:31519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2386 00000100:00100000:1.0:1746129567.162947:0:31519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f449180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ada2ffba-8920-4ecb-8068-68caa9806978+32:1962:x1830948734001152:12345-192.168.202.4@tcp:4:multiop.0 00000100:00100000:0.0:1746129567.164549:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129567.164626:0:31520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734001408 00000100:00100000:3.0:1746129567.164692:0:31520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734001408 00002000:00100000:3.0:1746129567.164726:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3f5:0x0] (3145728->4194303) req@ffff88012e38aa00 x1830948734001408/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:308/0 lens 488/0 e 0 to 0 dl 1746129578 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129567.164735:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e38aa00 with x1830948734001408 ext(3145728->4194303) 00002000:00010000:3.0:1746129567.164740:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e38aa00 00000100:00100000:3.0:1746129567.164792:0:31520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7633 00000100:00100000:3.0:1746129567.164799:0:31520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e38aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ada2ffba-8920-4ecb-8068-68caa9806978+34:1963:x1830948734001408:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:2.0:1746129567.176498:0:31519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f449180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ada2ffba-8920-4ecb-8068-68caa9806978+36:1962:x1830948734001152:12345-192.168.202.4@tcp:4:multiop.0 Request processed in 13537us (14290us total) trans 17179874052 rc 0/0 00000100:00100000:2.0:1746129567.176514:0:31519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2386 00002000:00100000:2.0:1746129567.176678:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f4:0x0] (1048576->1695743) req@ffff88008f449180 x1830948734001152/t17179874052(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:308/0 lens 488/448 e 0 to 0 dl 1746129578 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129567.176746:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f449180 with x1830948734001152 ext(1048576->1695743) 00010000:00010000:2.0:1746129567.176758:0:31519:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f8d5800/0x40a459093b06917f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1695743) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2087c expref: 36 pid: 22481 timeout: 922 lvb_type: 0 00010000:00010000:2.0:1746129567.176773:0:31519:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f8d5800/0x40a459093b06917f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1695743) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2087c expref: 36 pid: 22481 timeout: 922 lvb_type: 0 00002000:00010000:2.0:1746129567.176779:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008f449180 00000100:00100000:3.0:1746129567.177335:0:31520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e38aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ada2ffba-8920-4ecb-8068-68caa9806978+34:1963:x1830948734001408:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 12532us (12788us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129567.177358:0:31520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7633 00002000:00100000:3.0:1746129567.177365:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3f5:0x0] (3145728->4194303) req@ffff88012e38aa00 x1830948734001408/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:308/0 lens 488/440 e 0 to 0 dl 1746129578 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129567.177373:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e38aa00 with x1830948734001408 ext(3145728->4194303) 00002000:00010000:3.0:1746129567.177377:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e38aa00 00000100:00100000:0.0:1746129567.183235:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129567.183282:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129567.183689:0:7086:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734001536 00000100:00100000:2.0:1746129567.183699:0:7086:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734001536 00010000:00010000:2.0:1746129567.183738:0:7086:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f8d5800/0x40a459093b06917f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1695743) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2087c expref: 34 pid: 22481 timeout: 922 lvb_type: 0 00000100:00100000:2.0:1746129567.183769:0:7086:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8113 00000100:00100000:2.0:1746129567.183776:0:7086:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e388a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ada2ffba-8920-4ecb-8068-68caa9806978+34:1963:x1830948734001536:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129567.183792:0:7086:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746129567.183871:0:11014:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734001792 00000100:00100000:3.0:1746129567.183875:0:11014:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734001792 00000100:00100000:3.0:1746129567.183899:0:11014:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15858 00000100:00100000:3.0:1746129567.183903:0:11014:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e389500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ada2ffba-8920-4ecb-8068-68caa9806978+35:1963:x1830948734001792:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129567.183917:0:11014:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129567.183928:0:11014:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ee1a800/0x40a459093b069219 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20901 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129567.183973:0:11014:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135724a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11014:1830948737464448:192.168.202.4@tcp:106: 00000100:00100000:3.0:1746129567.184053:0:11014:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a7ba80 going to sleep for 11 seconds 00010000:00010000:2.0:1746129567.185546:0:7086:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f8d5800/0x40a459093b06917f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1695743) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2087c expref: 36 pid: 22481 timeout: 922 lvb_type: 0 00010000:00010000:2.0:1746129567.185561:0:7086:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f8d5800/0x40a459093b06917f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1695743) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2087c expref: 36 pid: 22481 timeout: 922 lvb_type: 0 00000100:00100000:1.0:1746129567.185979:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129567.186039:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129567.186125:0:22481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734001664 00000100:00100000:3.0:1746129567.186131:0:22481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734001664 00000100:00100000:3.0:1746129567.186170:0:22481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734001920 00000100:00100000:3.0:1746129567.186173:0:22481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734001920 00000100:00100000:1.0:1746129567.186195:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15859 00000100:00100000:1.0:1746129567.186209:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092fd3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ada2ffba-8920-4ecb-8068-68caa9806978+37:1963:x1830948734001664:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129567.186221:0:7148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129567.186234:0:7148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d144800/0x40a459093b069220 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f208fa expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129567.186253:0:22481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15860 00010000:00010000:1.0:1746129567.186255:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129567.186257:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746129567.186259:0:22481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092fd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ada2ffba-8920-4ecb-8068-68caa9806978+33:1963:x1830948734001920:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129567.186268:0:22481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129567.186270:0:7148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d144800/0x40a459093b069220 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f208fa expref: 38 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129567.186277:0:22481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800909ce200/0x40a459093b069227 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20908 expref: -99 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129567.186285:0:7148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009d144800/0x40a459093b069220 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f208fa expref: 38 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129567.186310:0:7148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d144800, rc 0) 00000100:00100000:3.0:1746129567.186327:0:22481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135724000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:22481:1830948737464576:192.168.202.4@tcp:106: 00000100:00100000:1.0:1746129567.186366:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092fd3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ada2ffba-8920-4ecb-8068-68caa9806978+38:1963:x1830948734001664:12345-192.168.202.4@tcp:101:cat.0 Request processed in 163us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129567.186372:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15859 00000100:00100000:3.0:1746129567.186386:0:22481:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a7b000 going to sleep for 11 seconds 00010000:00010000:2.0:1746129567.186513:0:7086:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129567.186514:0:7086:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129567.186519:0:7086:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ee1b800/0x40a459093b069212 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f208f3 expref: 16 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129567.186527:0:7086:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ee1b800/0x40a459093b069212 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f208f3 expref: 16 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129567.186549:0:7086:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ee1b800/0x40a459093b069212 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f208f3 expref: 16 pid: 11014 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129567.186557:0:7086:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095627480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7086:1830948737464704:192.168.202.4@tcp:105: 00000100:00100000:2.0:1746129567.186580:0:7086:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800951de900 going to sleep for 11 seconds 00010000:00010000:3.0:1746129567.187040:0:11014:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.202.4@tcp) returned -22 from glimpse AST (req@ffff880135724a80 x1830948737464448) - normal race ns: filter-lustre-OST0001_UUID lock: ffff88009f8d5800/0x40a459093b06917f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1695743) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2087c expref: 37 pid: 22481 timeout: 922 lvb_type: 0 00010000:00010000:3.0:1746129567.187068:0:11014:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f8d5800/0x40a459093b06917f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1695743) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2087c expref: 37 pid: 22481 timeout: 922 lvb_type: 0 00000100:00100000:3.0:1746129567.187085:0:11014:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135724a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11014:1830948737464448:192.168.202.4@tcp:106: 00010000:00010000:3.0:1746129567.187107:0:11014:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ee1a800/0x40a459093b069219 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20901 expref: 36 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129567.187115:0:11014:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ee1a800/0x40a459093b069219 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20901 expref: 36 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129567.187123:0:11014:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ee1a800, rc 0) 00000100:00100000:3.0:1746129567.187160:0:11014:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e389500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ada2ffba-8920-4ecb-8068-68caa9806978+35:1963:x1830948734001792:12345-192.168.202.4@tcp:101:cat.0 Request processed in 3256us (3877us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129567.187166:0:11014:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15858 00000100:00100000:3.0:1746129567.188809:0:22481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135724000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:22481:1830948737464576:192.168.202.4@tcp:106: 00010000:00010000:3.0:1746129567.188838:0:22481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800909ce200/0x40a459093b069227 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20908 expref: 34 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129567.188851:0:22481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800909ce200/0x40a459093b069227 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20908 expref: 34 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129567.188865:0:22481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800909ce200, rc 0) 00000100:00100000:3.0:1746129567.188916:0:22481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092fd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ada2ffba-8920-4ecb-8068-68caa9806978+33:1963:x1830948734001920:12345-192.168.202.4@tcp:101:cat.0 Request processed in 2654us (2874us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129567.188924:0:22481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15860 00000100:00100000:2.0:1746129567.189015:0:7086:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095627480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7086:1830948737464704:192.168.202.4@tcp:105: 00010000:00010000:2.0:1746129567.189027:0:7086:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129567.189047:0:7086:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e388a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ada2ffba-8920-4ecb-8068-68caa9806978+34:1963:x1830948734001536:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 5271us (5824us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129567.189055:0:7086:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8113 00000100:00100000:0.0:1746129567.191222:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129567.191325:0:31520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734002176 00000100:00100000:3.0:1746129567.191334:0:31520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734002176 00002000:00100000:3.0:1746129567.191392:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3f4:0x0] (1048576->2097151) req@ffff88012e38b100 x1830948734002176/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:308/0 lens 488/0 e 0 to 0 dl 1746129578 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129567.191402:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e38b100 with x1830948734002176 ext(1048576->2097151) 00002000:00010000:3.0:1746129567.191406:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e38b100 00000100:00100000:3.0:1746129567.191436:0:31520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7634 00000100:00100000:3.0:1746129567.191444:0:31520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e38b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+17:1962:x1830948734002176:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:1.0:1746129567.199135:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129567.201181:0:31519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734002432 00000100:00100000:2.0:1746129567.201195:0:31519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734002432 00002000:00100000:2.0:1746129567.201250:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3ef:0x0] (4620288->5148671) req@ffff880092fd3b80 x1830948734002432/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:308/0 lens 488/0 e 0 to 0 dl 1746129578 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129567.201266:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092fd3b80 with x1830948734002432 ext(4620288->5148671) 00002000:00010000:2.0:1746129567.201272:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092fd3b80 00000100:00100000:2.0:1746129567.201314:0:31519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7635 00000100:00100000:2.0:1746129567.201323:0:31519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092fd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ada2ffba-8920-4ecb-8068-68caa9806978+33:1962:x1830948734002432:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:3.0:1746129567.204556:0:31520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e38b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+17:1962:x1830948734002176:12345-192.168.202.4@tcp:3:cat.0 Request processed in 13100us (13331us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129567.204569:0:31520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7634 00002000:00100000:3.0:1746129567.204582:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3f4:0x0] (1048576->2097151) req@ffff88012e38b100 x1830948734002176/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:308/0 lens 488/440 e 0 to 0 dl 1746129578 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129567.204591:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e38b100 with x1830948734002176 ext(1048576->2097151) 00002000:00010000:3.0:1746129567.204597:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e38b100 00000100:00100000:2.0:1746129567.210048:0:31519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092fd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ada2ffba-8920-4ecb-8068-68caa9806978+33:1962:x1830948734002432:12345-192.168.202.4@tcp:3:cat.0 Request processed in 8713us (10910us total) trans 0 rc 528384/528384 00000100:00100000:2.0:1746129567.210061:0:31519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7635 00002000:00100000:2.0:1746129567.210074:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3ef:0x0] (4620288->5148671) req@ffff880092fd3b80 x1830948734002432/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:308/0 lens 488/440 e 0 to 0 dl 1746129578 ref 1 fl Complete:/200/0 rc 528384/528384 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129567.210084:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092fd3b80 with x1830948734002432 ext(4620288->5148671) 00002000:00010000:2.0:1746129567.210091:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092fd3b80 00000100:00100000:0.0:1746129567.215160:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129567.215196:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129567.215221:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129567.215248:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129567.215272:0:11014:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734002560 00000100:00100000:0.0:1746129567.215281:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734002688 00000100:00100000:2.0:1746129567.215282:0:11014:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734002560 00000100:00100000:0.0:1746129567.215284:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734002688 00000100:00100000:2.0:1746129567.215371:0:11014:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734002944 00000100:00100000:2.0:1746129567.215374:0:11014:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734002944 00000100:00100000:1.0:1746129567.215514:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734002816 00000100:00100000:1.0:1746129567.215518:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734002816 00000100:00100000:3.0:1746129567.215587:0:22481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15861 00000100:00100000:3.0:1746129567.215597:0:22481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e388000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:1963:x1830948734002560:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129567.215618:0:22481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129567.215636:0:22481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800909ce000/0x40a459093b06922e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2090f expref: -99 pid: 22481 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129567.215693:0:22481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135724000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:22481:1830948737464832:192.168.202.4@tcp:106: 00000100:00100000:3.0:1746129567.215771:0:22481:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a7b000 going to sleep for 11 seconds 00000100:00100000:0.0:1746129567.216708:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15862 00000100:00100000:2.0:1746129567.216715:0:11014:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15863 00000100:00100000:0.0:1746129567.216716:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e38a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+17:1962:x1830948734002688:12345-192.168.202.4@tcp:101:cat.0 00000100:00100000:2.0:1746129567.216722:0:11014:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e388380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ada2ffba-8920-4ecb-8068-68caa9806978+33:1962:x1830948734002944:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129567.216727:0:7149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129567.216731:0:11014:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129567.216739:0:7149:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800955d3600/0x40a459093b069235 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20916 expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129567.216740:0:11014:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f9c4c00/0x40a459093b06923c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20924 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129567.216755:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129567.216757:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129567.216765:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800955d3600/0x40a459093b069235 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20916 expref: 18 pid: 7149 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746129567.216772:0:11014:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095627480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11014:1830948737464960:192.168.202.4@tcp:106: 00010000:00010000:0.0:1746129567.216780:0:7149:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800955d3600/0x40a459093b069235 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20916 expref: 18 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129567.216795:0:7149:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800955d3600, rc 0) 00000100:00100000:2.0:1746129567.216808:0:11014:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800951de900 going to sleep for 11 seconds 00000100:00100000:0.0:1746129567.216817:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e38a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+18:1962:x1830948734002688:12345-192.168.202.4@tcp:101:cat.0 Request processed in 104us (1621us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129567.216823:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15862 00000100:00100000:2.0:1746129567.216828:0:8411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15864 00000100:00100000:2.0:1746129567.216834:0:8411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e38b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ada2ffba-8920-4ecb-8068-68caa9806978+34:1962:x1830948734002816:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129567.216841:0:8411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129567.216848:0:8411:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f9c5800/0x40a459093b069243 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2091d expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129567.216860:0:8411:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129567.216861:0:8411:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129567.216866:0:8411:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f9c5800/0x40a459093b069243 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2091d expref: 35 pid: 8411 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129567.216875:0:8411:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f9c5800/0x40a459093b069243 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2091d expref: 35 pid: 8411 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129567.216881:0:8411:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f9c5800, rc 0) 00000100:00100000:2.0:1746129567.216895:0:8411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e38b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ada2ffba-8920-4ecb-8068-68caa9806978+35:1962:x1830948734002816:12345-192.168.202.4@tcp:101:cat.0 Request processed in 61us (1646us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129567.216900:0:8411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15864 00000100:00100000:3.0:1746129567.218087:0:22481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135724000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:22481:1830948737464832:192.168.202.4@tcp:106: 00010000:00010000:3.0:1746129567.218111:0:22481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800909ce000/0x40a459093b06922e lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2090f expref: 21 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129567.218121:0:22481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800909ce000/0x40a459093b06922e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2090f expref: 21 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129567.218143:0:22481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800909ce000, rc 0) 00000100:00100000:3.0:1746129567.218172:0:22481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e388000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:1963:x1830948734002560:12345-192.168.202.4@tcp:101:cat.0 Request processed in 2578us (3025us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129567.218178:0:22481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15861 00000100:00100000:2.0:1746129567.221113:0:11014:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095627480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11014:1830948737464960:192.168.202.4@tcp:106: 00010000:00010000:2.0:1746129567.221150:0:11014:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f9c4c00/0x40a459093b06923c lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20924 expref: 34 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129567.221163:0:11014:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f9c4c00/0x40a459093b06923c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20924 expref: 34 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129567.221492:0:11014:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f9c4c00, rc 0) 00000100:00100000:2.0:1746129567.221540:0:11014:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e388380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ada2ffba-8920-4ecb-8068-68caa9806978+33:1962:x1830948734002944:12345-192.168.202.4@tcp:101:cat.0 Request processed in 4817us (6320us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129567.221552:0:11014:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15863 00000100:00100000:0.0:1746129567.222745:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129567.222903:0:11014:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734003072 00000100:00100000:2.0:1746129567.222911:0:11014:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734003072 00000100:00100000:2.0:1746129567.222961:0:11014:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15865 00000100:00100000:2.0:1746129567.222968:0:11014:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e389880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:32153:x1830948734003072:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129567.222984:0:11014:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129567.223001:0:11014:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f9c5c00/0x40a459093b06924a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2092b expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129567.223027:0:11014:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129567.223029:0:11014:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129567.223037:0:11014:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f9c5c00/0x40a459093b06924a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2092b expref: 21 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129567.223051:0:11014:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f9c5c00/0x40a459093b06924a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2092b expref: 21 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129567.223060:0:11014:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f9c5c00, rc 0) 00000100:00100000:2.0:1746129567.223091:0:11014:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e389880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:32153:x1830948734003072:12345-192.168.202.4@tcp:101:cat.0 Request processed in 124us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129567.223096:0:11014:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15865 00000100:00100000:0.0:1746129567.224080:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129567.224458:0:22481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734003200 00000100:00100000:3.0:1746129567.224464:0:22481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734003200 00000100:00100000:3.0:1746129567.224508:0:22481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15866 00000100:00100000:3.0:1746129567.224515:0:22481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e38b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ada2ffba-8920-4ecb-8068-68caa9806978+33:1962:x1830948734003200:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129567.224529:0:22481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129567.224540:0:22481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800909ce600/0x40a459093b069251 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20932 expref: -99 pid: 22481 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129567.224599:0:22481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135724000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:22481:1830948737465088:192.168.202.4@tcp:106: 00000100:00100000:3.0:1746129567.224679:0:22481:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a7b000 going to sleep for 11 seconds 00000100:00100000:3.0:1746129567.226376:0:22481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135724000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:22481:1830948737465088:192.168.202.4@tcp:106: 00010000:00010000:3.0:1746129567.226407:0:22481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800909ce600/0x40a459093b069251 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20932 expref: 34 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129567.226419:0:22481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800909ce600/0x40a459093b069251 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20932 expref: 34 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129567.226650:0:22481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800909ce600, rc 0) 00000100:00100000:3.0:1746129567.226704:0:22481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e38b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ada2ffba-8920-4ecb-8068-68caa9806978+33:1962:x1830948734003200:12345-192.168.202.4@tcp:101:cat.0 Request processed in 2187us (2625us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129567.226712:0:22481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15866 00000100:00100000:0.0:1746129567.231989:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129567.232038:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129567.232066:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129567.232108:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129567.232192:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734003712 00000100:00100000:2.0:1746129567.232202:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734003712 00000100:00100000:1.0:1746129567.232218:0:31522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734003968 00000100:00100000:1.0:1746129567.232223:0:31522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734003968 00002000:00100000:1.0:1746129567.232251:0:31522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3ef:0x0] (2097152->3145727) req@ffff88009c078a80 x1830948734003968/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:308/0 lens 488/0 e 0 to 0 dl 1746129578 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129567.232253:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f5:0x0] (3145728->4194303) req@ffff88012e389180 x1830948734003712/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:308/0 lens 488/0 e 0 to 0 dl 1746129578 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129567.232260:0:31522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c078a80 with x1830948734003968 ext(2097152->3145727) 00002000:00100000:2.0:1746129567.232261:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e389180 with x1830948734003712 ext(3145728->4194303) 00002000:00010000:2.0:1746129567.232265:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e389180 00002000:00010000:1.0:1746129567.232265:0:31522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c078a80 00000100:00100000:2.0:1746129567.232282:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734003584 00000100:00100000:1.0:1746129567.232284:0:31522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734004096 00000100:00100000:2.0:1746129567.232285:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734003584 00000100:00100000:1.0:1746129567.232287:0:31522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734004096 00002000:00100000:2.0:1746129567.232320:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f5:0x0] (2097152->3145727) req@ffff88009c079c00 x1830948734003584/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:308/0 lens 488/0 e 0 to 0 dl 1746129578 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129567.232322:0:31522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->4194303) req@ffff88009c078700 x1830948734004096/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:308/0 lens 488/0 e 0 to 0 dl 1746129578 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129567.232327:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c079c00 with x1830948734003584 ext(2097152->3145727) 00002000:00100000:1.0:1746129567.232328:0:31522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c078700 with x1830948734004096 ext(3145728->4194303) 00002000:00010000:2.0:1746129567.232329:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c079c00 00002000:00010000:1.0:1746129567.232332:0:31522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c078700 00000100:00100000:2.0:1746129567.232342:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7636 00000100:00100000:1.0:1746129567.232527:0:31522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7637 00000100:00100000:1.0:1746129567.232536:0:31522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c078a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+22:1963:x1830948734003968:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:3.0:1746129567.232547:0:21463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7638 00000100:00100000:3.0:1746129567.232556:0:21463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c079c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+19:1962:x1830948734003584:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:2.0:1746129567.233459:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e389180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:1963:x1830948734003712:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129567.233707:0:21725:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7639 00000100:00100000:0.0:1746129567.233718:0:21725:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c078700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+23:1963:x1830948734004096:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129567.252324:0:31522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c078a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+23:1963:x1830948734003968:12345-192.168.202.4@tcp:3:cat.0 Request processed in 19755us (20251us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129567.252340:0:31522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7637 00002000:00100000:0.0:1746129567.252365:0:31522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3ef:0x0] (2097152->3145727) req@ffff88009c078a80 x1830948734003968/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:308/0 lens 488/440 e 0 to 0 dl 1746129578 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129567.252375:0:31522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c078a80 with x1830948734003968 ext(2097152->3145727) 00002000:00010000:0.0:1746129567.252382:0:31522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c078a80 00000100:00100000:3.0:1746129567.253728:0:21463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c079c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:1962:x1830948734003584:12345-192.168.202.4@tcp:3:cat.0 Request processed in 21166us (21653us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129567.253738:0:21463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7638 00002000:00100000:3.0:1746129567.253747:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3f5:0x0] (2097152->3145727) req@ffff88009c079c00 x1830948734003584/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:308/0 lens 488/440 e 0 to 0 dl 1746129578 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129567.253755:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c079c00 with x1830948734003584 ext(2097152->3145727) 00002000:00010000:3.0:1746129567.253760:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c079c00 00000100:00100000:1.0:1746129567.254136:0:21725:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c078700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:1963:x1830948734004096:12345-192.168.202.4@tcp:3:cat.0 Request processed in 20420us (22025us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129567.254143:0:21725:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7639 00002000:00100000:1.0:1746129567.254148:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->4194303) req@ffff88009c078700 x1830948734004096/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:308/0 lens 488/440 e 0 to 0 dl 1746129578 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129567.254156:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c078700 with x1830948734004096 ext(3145728->4194303) 00002000:00010000:1.0:1746129567.254159:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c078700 00000100:00100000:2.0:1746129567.257931:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e389180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+18:1963:x1830948734003712:12345-192.168.202.4@tcp:3:cat.0 Request processed in 25560us (25941us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129567.257945:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7636 00002000:00100000:2.0:1746129567.257957:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f5:0x0] (3145728->4194303) req@ffff88012e389180 x1830948734003712/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:308/0 lens 488/440 e 0 to 0 dl 1746129578 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129567.257968:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e389180 with x1830948734003712 ext(3145728->4194303) 00002000:00010000:2.0:1746129567.257974:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e389180 00000100:00100000:0.0:1746129567.266110:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129567.266197:0:22481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734004352 00000100:00100000:3.0:1746129567.266208:0:22481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734004352 00000100:00100000:3.0:1746129567.266272:0:22481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15867 00000100:00100000:3.0:1746129567.266280:0:22481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c07aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:1960:x1830948734004352:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129567.266335:0:22481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129567.266366:0:22481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800909cec00/0x40a459093b069258 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20939 expref: -99 pid: 22481 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129567.266424:0:22481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135724000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:22481:1830948737465216:192.168.202.4@tcp:106: 00000100:00100000:3.0:1746129567.266524:0:22481:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a7b000 going to sleep for 11 seconds 00000100:00100000:3.0:1746129567.268208:0:22481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135724000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:22481:1830948737465216:192.168.202.4@tcp:106: 00010000:00010000:3.0:1746129567.268241:0:22481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800909cec00/0x40a459093b069258 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20939 expref: 22 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129567.268254:0:22481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800909cec00/0x40a459093b069258 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20939 expref: 22 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129567.268685:0:22481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800909cec00, rc 0) 00000100:00100000:3.0:1746129567.268923:0:22481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c07aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:1960:x1830948734004352:12345-192.168.202.4@tcp:101:cat.0 Request processed in 2641us (2822us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129567.268933:0:22481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15867 00000100:00100000:0.0:1746129567.270659:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129567.270753:0:22481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734004480 00000100:00100000:3.0:1746129567.270763:0:22481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734004480 00000100:00100000:3.0:1746129567.270832:0:22481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15868 00000100:00100000:3.0:1746129567.270840:0:22481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a07ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:32153:x1830948734004480:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129567.270859:0:22481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129567.270878:0:22481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800909cee00/0x40a459093b06925f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20940 expref: -99 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129567.270909:0:22481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f228c00/0x40a459093b0691ef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4620287) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f208d0 expref: 32 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129567.270923:0:22481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129567.270925:0:22481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129567.270928:0:22481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800909cee00/0x40a459093b06925f lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [4194304->5148671] (req 4194304->5148671) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20940 expref: 22 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129567.270961:0:22481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f228c00/0x40a459093b0691ef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4620287) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f208d0 expref: 32 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129567.270974:0:22481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f228c00/0x40a459093b0691ef lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4620287) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f208d0 expref: 32 pid: 20577 timeout: 922 lvb_type: 0 00000100:00100000:3.0:1746129567.270986:0:22481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135724000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:22481:1830948737465344:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129567.271096:0:22481:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a7b000 going to sleep for 11 seconds 00000100:00100000:3.0:1746129567.272204:0:22481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135724000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:22481:1830948737465344:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129567.272232:0:22481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800909cee00/0x40a459093b06925f lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [4194304->5148671] (req 4194304->5148671) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20940 expref: 22 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129567.272249:0:22481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800909cee00, rc 0) 00000100:00100000:3.0:1746129567.272285:0:22481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a07ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+22:32153:x1830948734004480:12345-192.168.202.4@tcp:101:cat.0 Request processed in 1445us (1635us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129567.272321:0:22481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15868 00000100:00100000:0.0:1746129567.274230:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129567.274324:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734004608 00000100:00100000:2.0:1746129567.274333:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734004608 00002000:00100000:2.0:1746129567.274397:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ef:0x0] (4194304->4620287) req@ffff8800a07af100 x1830948734004608/t0(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:308/0 lens 488/0 e 0 to 0 dl 1746129578 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129567.274407:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a07af100 with x1830948734004608 ext(4194304->4620287) 00010000:00010000:2.0:1746129567.274417:0:25745:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f228c00/0x40a459093b0691ef lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4620287) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f208d0 expref: 33 pid: 20577 timeout: 922 lvb_type: 0 00010000:00010000:2.0:1746129567.274432:0:25745:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f228c00/0x40a459093b0691ef lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4620287) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f208d0 expref: 33 pid: 20577 timeout: 922 lvb_type: 0 00002000:00010000:2.0:1746129567.274441:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a07af100 00000100:00100000:2.0:1746129567.274504:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2387 00000100:00100000:2.0:1746129567.274510:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a07af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+33:1963:x1830948734004608:12345-192.168.202.4@tcp:4:cat.0 00000100:00100000:2.0:1746129567.281659:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a07af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+35:1963:x1830948734004608:12345-192.168.202.4@tcp:4:cat.0 Request processed in 7134us (7425us total) trans 21474841291 rc 0/0 00000100:00100000:2.0:1746129567.281673:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2387 00002000:00100000:2.0:1746129567.281688:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ef:0x0] (4194304->4620287) req@ffff8800a07af100 x1830948734004608/t21474841291(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:308/0 lens 488/448 e 0 to 0 dl 1746129578 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129567.281697:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a07af100 with x1830948734004608 ext(4194304->4620287) 00010000:00010000:2.0:1746129567.281709:0:25745:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f228c00/0x40a459093b0691ef lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4620287) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f208d0 expref: 35 pid: 20577 timeout: 922 lvb_type: 0 00010000:00010000:2.0:1746129567.281726:0:25745:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f228c00/0x40a459093b0691ef lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4620287) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f208d0 expref: 35 pid: 20577 timeout: 922 lvb_type: 0 00002000:00010000:2.0:1746129567.281734:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a07af100 00000100:00100000:0.0:1746129567.285455:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129567.285579:0:7086:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734004736 00000100:00100000:2.0:1746129567.285591:0:7086:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734004736 00010000:00010000:2.0:1746129567.285635:0:7086:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f228c00/0x40a459093b0691ef lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4620287) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f208d0 expref: 35 pid: 20577 timeout: 922 lvb_type: 0 00000100:00100000:2.0:1746129567.285679:0:7086:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8114 00000100:00100000:2.0:1746129567.285687:0:7086:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a07ae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ada2ffba-8920-4ecb-8068-68caa9806978+35:1960:x1830948734004736:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129567.285706:0:7086:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129567.285736:0:7086:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f228c00/0x40a459093b0691ef lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->4620287) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f208d0 expref: 35 pid: 20577 timeout: 922 lvb_type: 0 00010000:00010000:2.0:1746129567.285748:0:7086:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f228c00/0x40a459093b0691ef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->4620287) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f208d0 expref: 35 pid: 20577 timeout: 922 lvb_type: 0 00010000:00010000:2.0:1746129567.285773:0:7086:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f228c00/0x40a459093b0691ef lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->4620287) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f208d0 expref: 35 pid: 20577 timeout: 922 lvb_type: 0 00010000:00010000:2.0:1746129567.286074:0:7086:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129567.286077:0:7086:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129567.286085:0:7086:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800909cee00/0x40a459093b06925f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->5148671) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20940 expref: 21 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129567.286095:0:7086:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800909cee00/0x40a459093b06925f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->5148671) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20940 expref: 21 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129567.286145:0:7086:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800909cee00/0x40a459093b06925f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->5148671) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20940 expref: 21 pid: 22481 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129567.286159:0:7086:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095627480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7086:1830948737465472:192.168.202.4@tcp:105: 00000100:00100000:2.0:1746129567.287408:0:7086:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800951de900 going to sleep for 11 seconds 00000100:00100000:2.0:1746129567.290463:0:7086:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095627480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7086:1830948737465472:192.168.202.4@tcp:105: 00010000:00010000:2.0:1746129567.290490:0:7086:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129567.290543:0:7086:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a07ae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ada2ffba-8920-4ecb-8068-68caa9806978+34:1960:x1830948734004736:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 4855us (5098us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129567.290556:0:7086:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8114 00000100:00100000:0.0:1746129567.291598:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129567.292365:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734004992 00000100:00100000:2.0:1746129567.292374:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734004992 00002000:00100000:2.0:1746129567.292422:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ef:0x0] (4194304->5148671) req@ffff8800a07aea00 x1830948734004992/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:308/0 lens 488/0 e 0 to 0 dl 1746129578 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129567.292432:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a07aea00 with x1830948734004992 ext(4194304->5148671) 00002000:00010000:2.0:1746129567.292438:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a07aea00 00000100:00100000:2.0:1746129567.292473:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7640 00000100:00100000:2.0:1746129567.292481:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a07aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+22:1961:x1830948734004992:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:2.0:1746129567.295101:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129567.295500:0:22481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734005120 00000100:00100000:3.0:1746129567.295509:0:22481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734005120 00000100:00100000:3.0:1746129567.295555:0:22481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15869 00000100:00100000:3.0:1746129567.295563:0:22481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095627480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ada2ffba-8920-4ecb-8068-68caa9806978+34:32158:x1830948734005120:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:3.0:1746129567.295588:0:22481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129567.295606:0:22481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800909cf000/0x40a459093b069266 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20947 expref: -99 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129567.295643:0:22481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fb26e00/0x40a459093b068fcd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2078e expref: 23 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129567.295649:0:22481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095f6ca00/0x40a459093b0690c9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2080c expref: 35 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129567.295655:0:22481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ee1a600/0x40a459093b06901a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f207b1 expref: 11 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129567.295661:0:22481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129567.295662:0:22481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129567.295664:0:22481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800909cf000/0x40a459093b069266 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [4096->573439] (req 4096->573439) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20947 expref: 35 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129567.295694:0:22481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ee1a600/0x40a459093b06901a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f207b1 expref: 11 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129567.295706:0:22481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ee1a600/0x40a459093b06901a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f207b1 expref: 11 pid: 11014 timeout: 922 lvb_type: 1 00000100:00100000:3.0:1746129567.295719:0:22481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135724000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:22481:1830948737465600:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129567.295807:0:22481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095f6ca00/0x40a459093b0690c9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2080c expref: 35 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129567.295819:0:22481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095f6ca00/0x40a459093b0690c9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2080c expref: 35 pid: 7148 timeout: 922 lvb_type: 1 00000100:00100000:3.0:1746129567.295827:0:22481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135724a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:22481:1830948737465728:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129567.295855:0:22481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fb26e00/0x40a459093b068fcd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2078e expref: 23 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129567.295863:0:22481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fb26e00/0x40a459093b068fcd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2078e expref: 23 pid: 7149 timeout: 922 lvb_type: 0 00000100:00100000:3.0:1746129567.295870:0:22481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135725f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:22481:1830948737465856:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129567.295886:0:22481:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a7b000 going to sleep for 11 seconds 00000100:00100000:0.0:1746129567.304267:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129567.304291:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129567.304331:0:7086:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734005248 00000100:00100000:2.0:1746129567.304342:0:7086:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734005248 00010000:00010000:2.0:1746129567.304406:0:7086:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ee1a600/0x40a459093b06901a lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f207b1 expref: 12 pid: 11014 timeout: 922 lvb_type: 1 00000100:00100000:2.0:1746129567.304432:0:7086:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734005376 00000100:00100000:2.0:1746129567.304435:0:7086:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734005376 00010000:00010000:2.0:1746129567.304444:0:7086:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb26e00/0x40a459093b068fcd lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2078e expref: 24 pid: 7149 timeout: 922 lvb_type: 0 00000100:00100000:2.0:1746129567.304461:0:7086:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8115 00000100:00100000:2.0:1746129567.304468:0:7086:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a07ace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:068dab75-d300-4ead-a742-d14572ad1e50+12:1962:x1830948734005248:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129567.304482:0:7086:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00080000:1.0:1746129567.304498:0:7097:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1746129567.304505:0:7086:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ee1a600/0x40a459093b06901a lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f207b1 expref: 12 pid: 11014 timeout: 922 lvb_type: 1 00000100:00100000:1.0:1746129567.304516:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8116 00010000:00010000:2.0:1746129567.304521:0:7086:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ee1a600/0x40a459093b06901a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f207b1 expref: 12 pid: 11014 timeout: 922 lvb_type: 1 00000100:00100000:1.0:1746129567.304524:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a07ad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+24:1963:x1830948734005376:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129567.304533:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129567.304545:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fb26e00/0x40a459093b068fcd lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2078e expref: 24 pid: 7149 timeout: 922 lvb_type: 0 00010000:00010000:2.0:1746129567.304548:0:7086:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746129567.304555:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fb26e00/0x40a459093b068fcd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2078e expref: 24 pid: 7149 timeout: 922 lvb_type: 0 00010000:00010000:1.0:1746129567.304567:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129567.304591:0:7086:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a07ace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:068dab75-d300-4ead-a742-d14572ad1e50+12:1962:x1830948734005248:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 123us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129567.304595:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a07ad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+24:1963:x1830948734005376:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 72us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129567.304598:0:7086:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8115 00000100:00100000:1.0:1746129567.304602:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8116 00010000:00010000:3.0:1746129567.304911:0:22481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ee1a600/0x40a459093b06901a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f207b1 expref: 11 pid: 11014 timeout: 922 lvb_type: 1 00000100:00100000:3.0:1746129567.304948:0:22481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135724000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:22481:1830948737465600:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129567.304960:0:22481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135724a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:22481:1830948737465728:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129567.304969:0:22481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fb26e00/0x40a459093b068fcd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2078e expref: 23 pid: 7149 timeout: 922 lvb_type: 0 00000100:00100000:3.0:1746129567.304979:0:22481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135725f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:22481:1830948737465856:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129567.304994:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a07aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:1961:x1830948734004992:12345-192.168.202.4@tcp:3:cat.0 Request processed in 12513us (13400us total) trans 0 rc 954368/954368 00000100:00100000:2.0:1746129567.305001:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7640 00002000:00100000:2.0:1746129567.305009:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ef:0x0] (4194304->5148671) req@ffff8800a07aea00 x1830948734004992/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:308/0 lens 488/440 e 0 to 0 dl 1746129578 ref 1 fl Complete:/200/0 rc 954368/954368 job:'cat.0' uid:0 gid:0 00010000:00010000:3.0:1746129567.305010:0:22481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800909cf000/0x40a459093b069266 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [4096->573439] (req 4096->573439) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20947 expref: 35 pid: 22481 timeout: 0 lvb_type: 0 00002000:00100000:2.0:1746129567.305017:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a07aea00 with x1830948734004992 ext(4194304->5148671) 00002000:00010000:2.0:1746129567.305021:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a07aea00 00010000:00010000:3.0:1746129567.305031:0:22481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800909cf000, rc 0) 00000100:00100000:3.0:1746129567.305064:0:22481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095627480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ada2ffba-8920-4ecb-8068-68caa9806978+35:32158:x1830948734005120:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 9502us (9973us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129567.305071:0:22481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15869 00000100:00100000:0.0:1746129567.305600:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129567.305637:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734005504 00000100:00100000:3.0:1746129567.305641:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734005504 00010000:00010000:3.0:1746129567.305656:0:9823:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095f6ca00/0x40a459093b0690c9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2080c expref: 35 pid: 7148 timeout: 922 lvb_type: 1 00000100:00100000:3.0:1746129567.305680:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8117 00000100:00100000:3.0:1746129567.305685:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a07ac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ada2ffba-8920-4ecb-8068-68caa9806978+35:1960:x1830948734005504:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129567.305695:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129567.305705:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095f6ca00/0x40a459093b0690c9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2080c expref: 35 pid: 7148 timeout: 922 lvb_type: 1 00010000:00010000:3.0:1746129567.305714:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095f6ca00/0x40a459093b0690c9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2080c expref: 35 pid: 7148 timeout: 922 lvb_type: 1 00010000:00010000:3.0:1746129567.305727:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f6ca00/0x40a459093b0690c9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2080c expref: 35 pid: 7148 timeout: 922 lvb_type: 1 00010000:00010000:3.0:1746129567.305735:0:9823:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129567.305737:0:9823:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129567.305743:0:9823:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800909cf000/0x40a459093b069266 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->573439) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20947 expref: 34 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129567.305755:0:9823:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800909cf000/0x40a459093b069266 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->573439) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20947 expref: 34 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129567.305784:0:9823:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800909cf000/0x40a459093b069266 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->573439) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20947 expref: 34 pid: 22481 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129567.305795:0:9823:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135725f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9823:1830948737465984:192.168.202.4@tcp:105: 00000100:00100000:3.0:1746129567.305867:0:9823:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a7b000 going to sleep for 11 seconds 00000100:00100000:3.0:1746129567.313555:0:9823:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135725f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9823:1830948737465984:192.168.202.4@tcp:105: 00010000:00010000:3.0:1746129567.313583:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129567.313642:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a07ac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ada2ffba-8920-4ecb-8068-68caa9806978+34:1960:x1830948734005504:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 7954us (8040us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129567.313653:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8117 00000100:00100000:0.0:1746129567.314357:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129567.314489:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129567.314835:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734005760 00000100:00100000:2.0:1746129567.314843:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734005760 00002000:00100000:2.0:1746129567.314890:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ec:0x0] (4096->8191) req@ffff8800a07af480 x1830948734005760/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:308/0 lens 488/0 e 0 to 0 dl 1746129578 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129567.314899:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a07af480 with x1830948734005760 ext(4096->8191) 00002000:00010000:2.0:1746129567.314903:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a07af480 00000100:00100000:3.0:1746129567.315755:0:22481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734005888 00000100:00100000:3.0:1746129567.315761:0:22481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734005888 00000100:00100000:3.0:1746129567.315812:0:22481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15870 00000100:00100000:3.0:1746129567.315821:0:22481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bf7b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:1960:x1830948734005888:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129567.315837:0:22481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746129567.315851:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7641 00010000:00010000:3.0:1746129567.315856:0:22481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800909cfa00/0x40a459093b06926d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2094e expref: -99 pid: 22481 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129567.315860:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a07af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+34:1962:x1830948734005760:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:3.0:1746129567.315912:0:22481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135725f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:22481:1830948737466112:192.168.202.4@tcp:106: 00000100:00100000:3.0:1746129567.316002:0:22481:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a7b000 going to sleep for 11 seconds 00000100:00100000:2.0:1746129567.316589:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a07af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+34:1962:x1830948734005760:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 729us (2242us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129567.316596:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7641 00002000:00100000:2.0:1746129567.316605:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ec:0x0] (4096->8191) req@ffff8800a07af480 x1830948734005760/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:308/0 lens 488/4536 e 0 to 0 dl 1746129578 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129567.316613:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a07af480 with x1830948734005760 ext(4096->8191) 00002000:00010000:2.0:1746129567.316616:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a07af480 00002000:00010000:3.0:1746129567.323493:0:22481:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3ec:0x0] updating lvb mtime: 1746129566 -> 1746129568 00002000:00010000:3.0:1746129567.323503:0:22481:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3ec:0x0] updating lvb ctime: 1746129566 -> 1746129568 00000100:00100000:3.0:1746129567.323533:0:22481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135725f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:22481:1830948737466112:192.168.202.4@tcp:106: 00010000:00010000:3.0:1746129567.323573:0:22481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800909cfa00/0x40a459093b06926d lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2094e expref: 22 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129567.323588:0:22481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800909cfa00/0x40a459093b06926d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2094e expref: 22 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129567.323612:0:22481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800909cfa00, rc 0) 00000100:00100000:3.0:1746129567.323666:0:22481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bf7b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:1960:x1830948734005888:12345-192.168.202.4@tcp:101:cat.0 Request processed in 7844us (9175us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129567.323675:0:22481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15870 00000100:00100000:0.0:1746129567.326112:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129567.326206:0:22481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734006016 00000100:00100000:3.0:1746129567.326217:0:22481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734006016 00000100:00100000:3.0:1746129567.326278:0:22481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15871 00000100:00100000:3.0:1746129567.326286:0:22481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a07aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:1960:x1830948734006016:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129567.326343:0:22481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129567.326374:0:22481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800909cfc00/0x40a459093b069274 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20955 expref: -99 pid: 22481 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129567.326428:0:22481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135724e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:22481:1830948737466240:192.168.202.4@tcp:106: 00000100:00100000:3.0:1746129567.326578:0:22481:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a7b000 going to sleep for 11 seconds 00000100:00100000:0.0:1746129567.330419:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129567.330583:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734006272 00000100:00100000:2.0:1746129567.330793:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734006272 00002000:00100000:2.0:1746129567.330848:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ec:0x0] (569344->573439) req@ffff8800a07ad880 x1830948734006272/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:308/0 lens 488/0 e 0 to 0 dl 1746129578 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129567.330859:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a07ad880 with x1830948734006272 ext(569344->573439) 00002000:00010000:2.0:1746129567.330865:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a07ad880 00000100:00100000:2.0:1746129567.330902:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7642 00000100:00100000:2.0:1746129567.330910:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a07ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+34:1962:x1830948734006272:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:2.0:1746129567.331112:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a07ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+34:1962:x1830948734006272:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 203us (704us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129567.331119:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7642 00002000:00100000:2.0:1746129567.331125:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ec:0x0] (569344->573439) req@ffff8800a07ad880 x1830948734006272/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:308/0 lens 488/4536 e 0 to 0 dl 1746129578 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129567.331132:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a07ad880 with x1830948734006272 ext(569344->573439) 00002000:00010000:2.0:1746129567.331135:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a07ad880 00000100:00100000:3.0:1746129567.331543:0:22481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135724e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:22481:1830948737466240:192.168.202.4@tcp:106: 00010000:00010000:3.0:1746129567.331578:0:22481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800909cfc00/0x40a459093b069274 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20955 expref: 22 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129567.331597:0:22481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800909cfc00/0x40a459093b069274 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20955 expref: 22 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129567.331606:0:22481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800909cfc00, rc 0) 00000100:00100000:3.0:1746129567.331643:0:22481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a07aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:1960:x1830948734006016:12345-192.168.202.4@tcp:101:cat.0 Request processed in 5358us (5540us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129567.331650:0:22481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15871 00000100:00100000:0.0:1746129567.347175:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129567.347368:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734006528 00000100:00100000:2.0:1746129567.347380:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734006528 00000100:00100000:2.0:1746129567.347446:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4717 00000100:00100000:2.0:1746129567.347454:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f95b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+29:32153:x1830948734006528:12345-192.168.202.4@tcp:35:cat.0 00000100:00100000:2.0:1746129567.347744:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f95b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+30:32153:x1830948734006528:12345-192.168.202.4@tcp:35:cat.0 Request processed in 290us (580us total) trans 8589945232 rc 0/0 00000100:00100000:2.0:1746129567.347751:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4717 00000100:00100000:0.0:1746129567.348129:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129567.348193:0:2271:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734006784 00000100:00100000:3.0:1746129567.348199:0:2271:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734006784 00000100:00100000:3.0:1746129567.348240:0:2271:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11150 00000100:00100000:3.0:1746129567.348246:0:2271:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f958700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+30:32160:x1830948734006784:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:3.0:1746129567.348258:0:2271:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129567.348276:0:2271:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800909cf600/0x40a459093b06927b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2095c expref: -99 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129567.348958:0:2271:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800909cf800/0x40a459093b069282 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129567.348973:0:2271:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800909cf800/0x40a459093b069282 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129567.348984:0:2271:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800909cf800/0x40a459093b069282 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129567.348996:0:2271:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800909cf200/0x40a459093b069289 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129567.349001:0:2271:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800909cf200/0x40a459093b069289 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129567.349007:0:2271:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800909cf200/0x40a459093b069289 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129567.349106:0:2271:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800909cf400/0x40a459093b069290 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129567.349113:0:2271:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800909cf400/0x40a459093b069290 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129567.349118:0:2271:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800909cf400/0x40a459093b069290 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00000004:00200000:3.0:1746129567.349126:0:2271:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:3.0:1746129567.349186:0:2271:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800909cf800/0x40a459093b069282 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129567.349191:0:2271:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800909cf800/0x40a459093b069282 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129567.349197:0:2271:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800909cf800/0x40a459093b069282 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129567.349201:0:2271:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800909cf800 already unused, calling callback (ffffffffa136e690) 00010000:00010000:3.0:1746129567.349204:0:2271:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800909cf800/0x40a459093b069282 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129567.349209:0:2271:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800909cf800/0x40a459093b069282 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129567.349219:0:2271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880132ef8f00) 00010000:00010000:3.0:1746129567.349222:0:2271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129567.349226:0:2271:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800909cf800/0x40a459093b069282 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129567.349233:0:2271:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800909cf800/0x40a459093b069282 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129567.349251:0:2271:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800909cf200/0x40a459093b069289 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129567.349255:0:2271:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800909cf200/0x40a459093b069289 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129567.349258:0:2271:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800909cf200/0x40a459093b069289 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129567.349262:0:2271:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800909cf200 already unused, calling callback (ffffffffa136e690) 00010000:00010000:3.0:1746129567.349264:0:2271:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800909cf200/0x40a459093b069289 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129567.349267:0:2271:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800909cf200/0x40a459093b069289 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129567.349274:0:2271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800900d1900) 00010000:00010000:3.0:1746129567.349276:0:2271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129567.349278:0:2271:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800909cf200/0x40a459093b069289 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129567.349281:0:2271:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800909cf200/0x40a459093b069289 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129567.349410:0:2271:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800909cf600/0x40a459093b06927b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2095c expref: 33 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129567.349422:0:2271:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800909cf400/0x40a459093b069290 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2095c expref: 32 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129567.349432:0:2271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009f469400) 00010000:00010000:3.0:1746129567.349434:0:2271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746129567.349436:0:2271:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800909cf400, rc 0) 00000100:00100000:3.0:1746129567.349896:0:2271:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f958700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+32:32160:x1830948734006784:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 1646us (1763us total) trans 8589945233 rc 0/0 00000100:00100000:3.0:1746129567.349905:0:2271:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11150 00000100:00100000:0.0:1746129567.360973:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129567.361642:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734006912 00000100:00100000:3.0:1746129567.361653:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734006912 00000100:00100000:3.0:1746129567.361721:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 784 00000100:00100000:3.0:1746129567.361730:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6027050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+32:1961:x1830948734006912:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129567.361748:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129567.361782:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800909cf400/0x40a459093b069290 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2095c expref: 32 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129567.361805:0:9823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009f469400) 00010000:00010000:3.0:1746129567.361811:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129567.363750:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6027050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+31:1961:x1830948734006912:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 2012us (2779us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129567.363761:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 784 00000100:00100000:0.0:1746129567.373913:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129567.374179:0:22481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734007040 00000100:00100000:3.0:1746129567.374676:0:22481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734007040 00000100:00100000:3.0:1746129567.374750:0:22481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15872 00000100:00100000:3.0:1746129567.374759:0:22481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f95b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:32160:x1830948734007040:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:3.0:1746129567.374782:0:22481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129567.374801:0:22481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800909cfe00/0x40a459093b06929e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20963 expref: -99 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129567.374834:0:22481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800909cee00/0x40a459093b06925f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->5148671) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20940 expref: 22 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129567.374843:0:22481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f9c5c00/0x40a459093b06924a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2092b expref: 22 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129567.374851:0:22481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d872800/0x40a459093b0691fd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f208de expref: 33 pid: 8411 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129567.374857:0:22481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746129567.374858:0:22481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746129567.374862:0:22481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800909cfe00/0x40a459093b06929e lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [3338240->3653631] (req 3338240->3653631) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20963 expref: 22 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129567.374896:0:22481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d872800/0x40a459093b0691fd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f208de expref: 33 pid: 8411 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129567.374908:0:22481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d872800/0x40a459093b0691fd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f208de expref: 33 pid: 8411 timeout: 922 lvb_type: 0 00000100:00100000:3.0:1746129567.374923:0:22481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135724e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:22481:1830948737466368:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129567.375036:0:22481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f9c5c00/0x40a459093b06924a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2092b expref: 22 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129567.375045:0:22481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f9c5c00/0x40a459093b06924a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2092b expref: 22 pid: 11014 timeout: 922 lvb_type: 0 00000100:00100000:3.0:1746129567.375059:0:22481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135725f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:22481:1830948737466496:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129567.375082:0:22481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800909cee00/0x40a459093b06925f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->5148671) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20940 expref: 22 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129567.375090:0:22481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800909cee00/0x40a459093b06925f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->5148671) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20940 expref: 22 pid: 22481 timeout: 922 lvb_type: 0 00000100:00100000:3.0:1746129567.375097:0:22481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135724a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:22481:1830948737466624:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129567.375112:0:22481:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a7b480 going to sleep for 11 seconds 00000100:00100000:3.0:1746129567.379583:0:22481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135724e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:22481:1830948737466368:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129567.379599:0:22481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135724a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:22481:1830948737466624:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129567.380976:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129567.381724:0:22481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135725f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:22481:1830948737466496:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129567.381767:0:22481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800909cfe00/0x40a459093b06929e lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [3338240->3653631] (req 3338240->3653631) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20963 expref: 22 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129567.381786:0:22481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800909cfe00, rc 0) 00000100:00100000:2.0:1746129567.381901:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734007168 00000100:00100000:2.0:1746129567.381910:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734007168 00010000:00010000:2.0:1746129567.381948:0:9823:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d872800/0x40a459093b0691fd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f208de expref: 34 pid: 8411 timeout: 922 lvb_type: 0 00000100:00100000:3.0:1746129567.382451:0:22481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f95b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+22:32160:x1830948734007040:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 7691us (8547us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129567.382461:0:22481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15872 00000100:00100000:2.0:1746129567.382570:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8118 00000100:00100000:2.0:1746129567.382579:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f95b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ada2ffba-8920-4ecb-8068-68caa9806978+34:1963:x1830948734007168:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129567.382594:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129567.382621:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d872800/0x40a459093b0691fd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f208de expref: 34 pid: 8411 timeout: 922 lvb_type: 0 00010000:00010000:2.0:1746129567.382632:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d872800/0x40a459093b0691fd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f208de expref: 34 pid: 8411 timeout: 922 lvb_type: 0 00010000:00010000:2.0:1746129567.382661:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d872800/0x40a459093b0691fd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f208de expref: 34 pid: 8411 timeout: 922 lvb_type: 0 00010000:00010000:2.0:1746129567.382683:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129567.383178:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f95b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ada2ffba-8920-4ecb-8068-68caa9806978+33:1963:x1830948734007168:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 599us (2208us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129567.383184:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8118 00000100:00100000:0.0:1746129567.383379:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129567.383504:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734007296 00000100:00100000:3.0:1746129567.383510:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734007296 00010000:00010000:3.0:1746129567.383530:0:9823:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800909cee00/0x40a459093b06925f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5148671) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20940 expref: 22 pid: 22481 timeout: 922 lvb_type: 0 00000100:00100000:3.0:1746129567.383550:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8119 00000100:00100000:3.0:1746129567.383555:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f95bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+22:1960:x1830948734007296:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129567.383563:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129567.383575:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800909cee00/0x40a459093b06925f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->5148671) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20940 expref: 22 pid: 22481 timeout: 922 lvb_type: 0 00010000:00010000:3.0:1746129567.383583:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800909cee00/0x40a459093b06925f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->5148671) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20940 expref: 22 pid: 22481 timeout: 922 lvb_type: 0 00010000:00010000:3.0:1746129567.383595:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800909cee00/0x40a459093b06925f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->5148671) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20940 expref: 22 pid: 22481 timeout: 922 lvb_type: 0 00010000:00010000:3.0:1746129567.383618:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129567.383644:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f95bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:1960:x1830948734007296:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 89us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129567.383649:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8119 00000100:00100000:0.0:1746129567.385217:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129567.385544:0:20578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734007424 00000100:00100000:2.0:1746129567.385552:0:20578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734007424 00010000:00010000:2.0:1746129567.385584:0:20578:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f9c5c00/0x40a459093b06924a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2092b expref: 21 pid: 11014 timeout: 922 lvb_type: 0 00000100:00100000:2.0:1746129567.385618:0:20578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8120 00000100:00100000:2.0:1746129567.385624:0:20578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f959500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:1963:x1830948734007424:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129567.385635:0:20578:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129567.385655:0:20578:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f9c5c00/0x40a459093b06924a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2092b expref: 21 pid: 11014 timeout: 922 lvb_type: 0 00010000:00010000:2.0:1746129567.385666:0:20578:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f9c5c00/0x40a459093b06924a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2092b expref: 21 pid: 11014 timeout: 922 lvb_type: 0 00010000:00010000:2.0:1746129567.385685:0:20578:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f9c5c00/0x40a459093b06924a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2092b expref: 21 pid: 11014 timeout: 922 lvb_type: 0 00010000:00010000:2.0:1746129567.385697:0:20578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129567.385699:0:20578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129567.385706:0:20578:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800909cfe00/0x40a459093b06929e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3338240->3653631) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20963 expref: 20 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129567.385713:0:20578:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800909cfe00/0x40a459093b06929e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3338240->3653631) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20963 expref: 20 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129567.385744:0:20578:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800909cfe00/0x40a459093b06929e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3338240->3653631) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20963 expref: 20 pid: 22481 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129567.385756:0:20578:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095626a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:20578:1830948737466752:192.168.202.4@tcp:105: 00000100:00100000:2.0:1746129567.385839:0:20578:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800951de900 going to sleep for 11 seconds 00000100:00100000:2.0:1746129567.387637:0:20578:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095626a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:20578:1830948737466752:192.168.202.4@tcp:105: 00010000:00010000:2.0:1746129567.387658:0:20578:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129567.387696:0:20578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f959500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:1963:x1830948734007424:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 2071us (2485us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129567.387706:0:20578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8120 00000100:00100000:1.0:1746129567.389365:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129567.389438:0:21725:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734007680 00000100:00100000:2.0:1746129567.389448:0:21725:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734007680 00002000:00100000:2.0:1746129567.389497:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ef:0x0] (3338240->3342335) req@ffff880092fd1880 x1830948734007680/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:308/0 lens 488/0 e 0 to 0 dl 1746129578 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129567.389508:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092fd1880 with x1830948734007680 ext(3338240->3342335) 00002000:00010000:2.0:1746129567.389512:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092fd1880 00000100:00100000:2.0:1746129567.389540:0:21725:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7643 00000100:00100000:2.0:1746129567.389546:0:21725:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092fd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:1962:x1830948734007680:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:2.0:1746129567.391949:0:21725:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092fd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:1962:x1830948734007680:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 2384us (2572us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129567.391966:0:21725:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7643 00002000:00100000:2.0:1746129567.391982:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ef:0x0] (3338240->3342335) req@ffff880092fd1880 x1830948734007680/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:308/0 lens 488/4536 e 0 to 0 dl 1746129578 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129567.391994:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092fd1880 with x1830948734007680 ext(3338240->3342335) 00002000:00010000:2.0:1746129567.392000:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092fd1880 00000100:00100000:0.0:1746129567.412077:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129567.412376:0:21725:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734007936 00000100:00100000:2.0:1746129567.412388:0:21725:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734007936 00002000:00100000:2.0:1746129567.412447:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ef:0x0] (3649536->3653631) req@ffff88009f95a300 x1830948734007936/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:308/0 lens 488/0 e 0 to 0 dl 1746129578 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129567.412466:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f95a300 with x1830948734007936 ext(3649536->3653631) 00002000:00010000:2.0:1746129567.412472:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f95a300 00000100:00100000:2.0:1746129567.412496:0:21725:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7644 00000100:00100000:2.0:1746129567.412504:0:21725:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f95a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:1963:x1830948734007936:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:2.0:1746129567.412719:0:21725:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f95a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:1963:x1830948734007936:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 215us (658us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129567.412726:0:21725:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7644 00002000:00100000:2.0:1746129567.412732:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ef:0x0] (3649536->3653631) req@ffff88009f95a300 x1830948734007936/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:308/0 lens 488/4536 e 0 to 0 dl 1746129578 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129567.412739:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f95a300 with x1830948734007936 ext(3649536->3653631) 00002000:00010000:2.0:1746129567.412742:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f95a300 00000100:00100000:0.0:1746129567.419242:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129567.420974:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734008192 00000100:00100000:2.0:1746129567.420988:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734008192 00000100:00100000:2.0:1746129567.421269:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4718 00000100:00100000:2.0:1746129567.421278:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132c25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+31:32160:x1830948734008192:12345-192.168.202.4@tcp:35:multiop.0 00000100:00100000:2.0:1746129567.422477:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132c25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+32:32160:x1830948734008192:12345-192.168.202.4@tcp:35:multiop.0 Request processed in 1198us (3245us total) trans 8589945234 rc 0/0 00000100:00100000:2.0:1746129567.422485:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4718 00000100:00100000:0.0:1746129567.444782:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129567.444896:0:2271:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734008320 00000100:00100000:3.0:1746129567.444907:0:2271:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734008320 00000100:00100000:3.0:1746129567.444962:0:2271:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11151 00000100:00100000:3.0:1746129567.444970:0:2271:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132c27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:068dab75-d300-4ead-a742-d14572ad1e50+11:32164:x1830948734008320:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:3.0:1746129567.444998:0:2271:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129567.445017:0:2271:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800909cf200/0x40a459093b0692a5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2096a expref: -99 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129567.445081:0:2271:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800909cf800/0x40a459093b0692ac lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129567.445096:0:2271:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800909cf800/0x40a459093b0692ac lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129567.445189:0:2271:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800909cf800/0x40a459093b0692ac lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129567.445203:0:2271:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800909cfc00/0x40a459093b0692b3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129567.445209:0:2271:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800909cfc00/0x40a459093b0692b3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129567.445214:0:2271:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800909cfc00/0x40a459093b0692b3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129567.445380:0:2271:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800909cfa00/0x40a459093b0692ba lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129567.445391:0:2271:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1b000/0x40a459093b0690ec lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20828 expref: 307 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129567.445398:0:2271:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800909cfa00/0x40a459093b0692ba lrc: 4/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129567.445429:0:2271:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1b000/0x40a459093b0690ec lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20828 expref: 307 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129567.445441:0:2271:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1b000/0x40a459093b0690ec lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20828 expref: 307 pid: 14549 timeout: 922 lvb_type: 0 00000100:00100000:3.0:1746129567.445454:0:2271:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135725f80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:2271:1830948737466880:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129567.448600:0:2271:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a7b480 going to sleep for 11 seconds 00000100:00100000:0.0:1746129567.451989:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129567.453144:0:14551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734008576 00000100:00100000:1.0:1746129567.453155:0:14551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734008576 00000100:00080000:0.0:1746129567.453213:0:7097:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746129567.453237:0:14551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4719 00000100:00100000:1.0:1746129567.453246:0:14551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132c26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ada2ffba-8920-4ecb-8068-68caa9806978+308:23750:x1830948734008576:12345-192.168.202.4@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746129567.453504:0:14551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132c26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ada2ffba-8920-4ecb-8068-68caa9806978+309:23750:x1830948734008576:12345-192.168.202.4@tcp:35:ldlm_bl.0 Request processed in 260us (1528us total) trans 8589945235 rc 0/0 00000100:00100000:1.0:1746129567.453510:0:14551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4719 00010000:00010000:0.0:1746129567.454467:0:9822:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1746129567.454506:0:2271:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135725f80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:2271:1830948737466880:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129567.454533:0:2271:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800909cfa00/0x40a459093b0692ba lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00000100:00100000:0.0:1746129567.455380:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129567.455432:0:20578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734008704 00000100:00100000:2.0:1746129567.455438:0:20578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734008704 00010000:00010000:2.0:1746129567.455466:0:20578:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1b000/0x40a459093b0690ec lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20828 expref: 309 pid: 14549 timeout: 922 lvb_type: 0 00000100:00100000:2.0:1746129567.455499:0:20578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8121 00000100:00100000:2.0:1746129567.455506:0:20578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132c25180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ada2ffba-8920-4ecb-8068-68caa9806978+309:1960:x1830948734008704:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129567.455518:0:20578:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129567.455523:0:20578:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1b000/0x40a459093b0690ec lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20828 expref: 309 pid: 14549 timeout: 922 lvb_type: 0 00010000:00010000:2.0:1746129567.455534:0:20578:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1b000/0x40a459093b0690ec lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20828 expref: 309 pid: 14549 timeout: 922 lvb_type: 0 00010000:00010000:2.0:1746129567.455552:0:20578:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1b000/0x40a459093b0690ec lrc: 0/0,0 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20828 expref: 309 pid: 14549 timeout: 922 lvb_type: 0 00010000:00010000:2.0:1746129567.455571:0:20578:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009f469400) 00010000:00010000:2.0:1746129567.455576:0:20578:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800909cfa00/0x40a459093b0692ba lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129567.455586:0:20578:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800909cfa00/0x40a459093b0692ba lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129567.455592:0:20578:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800909cfa00/0x40a459093b0692ba lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129567.455609:0:20578:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746129567.455651:0:2271:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800909cfa00/0x40a459093b0692ba lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129567.455657:0:2271:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800909cfa00/0x40a459093b0692ba lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00000004:00200000:3.0:1746129567.455695:0:2271:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00000004:00200000:3.0:1746129567.455698:0:2271:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746129567.455712:0:2271:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800909cfa00/0x40a459093b0692ba lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129567.455721:0:2271:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800909cfa00/0x40a459093b0692ba lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129567.455729:0:2271:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800909cf800/0x40a459093b0692ac lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129567.455735:0:2271:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800909cf800/0x40a459093b0692ac lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129567.455739:0:2271:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800909cf800/0x40a459093b0692ac lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129567.455744:0:2271:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800909cf800 already unused, calling callback (ffffffffa136e690) 00010000:00010000:3.0:1746129567.455747:0:2271:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800909cf800/0x40a459093b0692ac lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129567.455753:0:2271:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800909cf800/0x40a459093b0692ac lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129567.455759:0:2271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880132ef8f00) 00010000:00010000:3.0:1746129567.455762:0:2271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129567.455765:0:2271:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800909cf800/0x40a459093b0692ac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129567.455775:0:2271:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800909cf800/0x40a459093b0692ac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129567.455793:0:2271:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800909cfc00/0x40a459093b0692b3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129567.455797:0:2271:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800909cfc00/0x40a459093b0692b3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129567.455801:0:2271:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800909cfc00/0x40a459093b0692b3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129567.455804:0:2271:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800909cfc00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:3.0:1746129567.455805:0:2271:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800909cfc00/0x40a459093b0692b3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129567.455809:0:2271:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800909cfc00/0x40a459093b0692b3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129567.455813:0:2271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800900d1100) 00010000:00010000:3.0:1746129567.455815:0:2271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129567.455816:0:2271:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800909cfc00/0x40a459093b0692b3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129567.455820:0:2271:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800909cfc00/0x40a459093b0692b3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129567.455847:0:2271:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800909cf200/0x40a459093b0692a5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2096a expref: 13 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129567.455860:0:2271:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800909cfa00/0x40a459093b0692ba lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2096a expref: 12 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129567.455865:0:2271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009f469400) 00010000:00010000:3.0:1746129567.455867:0:2271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746129567.455869:0:2271:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800909cfa00, rc 0) 00000100:00100000:2.0:1746129567.455923:0:20578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132c25180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ada2ffba-8920-4ecb-8068-68caa9806978+308:1960:x1830948734008704:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 416us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129567.455929:0:20578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8121 00000100:00100000:3.0:1746129567.455979:0:2271:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132c27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:068dab75-d300-4ead-a742-d14572ad1e50+12:32164:x1830948734008320:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 11010us (11209us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129567.455984:0:2271:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11151 00000100:00100000:0.0:1746129567.460592:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129567.460643:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129567.460670:0:22481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734008832 00000100:00100000:3.0:1746129567.460681:0:22481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734008832 00000100:00100000:3.0:1746129567.460729:0:22481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15873 00000100:00100000:3.0:1746129567.460736:0:22481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132c24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:068dab75-d300-4ead-a742-d14572ad1e50+11:1963:x1830948734008832:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:3.0:1746129567.460756:0:22481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129567.460775:0:22481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800909cf400/0x40a459093b0692c1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20971 expref: -99 pid: 22481 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129567.460834:0:22481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135725f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:22481:1830948737467008:192.168.202.4@tcp:106: 00000100:00100000:3.0:1746129567.460940:0:22481:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a7b480 going to sleep for 11 seconds 00000100:00100000:0.0:1746129567.461450:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129567.461481:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129567.461494:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129567.461510:0:8412:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734009088 00000100:00100000:0.0:1746129567.461514:0:8412:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734009088 00000100:00100000:0.0:1746129567.461548:0:8412:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734009344 00000100:00100000:0.0:1746129567.461551:0:8412:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734009344 00000100:00100000:0.0:1746129567.461560:0:8412:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734008960 00000100:00100000:0.0:1746129567.461561:0:8412:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734008960 00000100:00100000:0.0:1746129567.461571:0:8412:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734009216 00000100:00100000:0.0:1746129567.461572:0:8412:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734009216 00000100:00100000:1.0:1746129567.461582:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15874 00000100:00100000:1.0:1746129567.461646:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:068dab75-d300-4ead-a742-d14572ad1e50+12:1963:x1830948734009088:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:1.0:1746129567.461656:0:7148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129567.461669:0:7148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800946f0c00/0x40a459093b0692c8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2097f expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129567.461686:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129567.461688:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129567.461699:0:7148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800946f0c00/0x40a459093b0692c8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2097f expref: 13 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129567.461715:0:7148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800946f0c00/0x40a459093b0692c8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2097f expref: 13 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129567.461726:0:7148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800946f0c00, rc 0) 00000100:00100000:1.0:1746129567.461765:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:068dab75-d300-4ead-a742-d14572ad1e50+13:1963:x1830948734009088:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 123us (1121us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129567.462507:0:8412:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15875 00000100:00100000:0.0:1746129567.462516:0:8412:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ced500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:068dab75-d300-4ead-a742-d14572ad1e50+14:1963:x1830948734009344:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:0.0:1746129567.462525:0:8412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129567.462536:0:8412:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800955d3800/0x40a459093b0692cf lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2098d expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129567.462574:0:8412:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ced880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8412:1830948737467136:192.168.202.4@tcp:106: 00000100:00100000:0.0:1746129567.462614:0:8412:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a00300 going to sleep for 11 seconds 00000100:00080000:0.0:1746129567.462631:0:7097:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746129567.462644:0:8410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15876 00000100:00100000:0.0:1746129567.462650:0:8410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:068dab75-d300-4ead-a742-d14572ad1e50+13:1963:x1830948734008960:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:0.0:1746129567.462657:0:8410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129567.462665:0:8410:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800955d3a00/0x40a459093b0692d6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20978 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129567.462676:0:8410:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129567.462677:0:8410:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129567.462683:0:8410:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800955d3a00/0x40a459093b0692d6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20978 expref: 14 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129567.462693:0:8410:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800955d3a00/0x40a459093b0692d6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20978 expref: 14 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129567.462705:0:8410:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800955d3a00, rc 0) 00000100:00100000:0.0:1746129567.462722:0:8410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:068dab75-d300-4ead-a742-d14572ad1e50+14:1963:x1830948734008960:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 72us (1241us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129567.462727:0:8410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15876 00000100:00100000:0.0:1746129567.462746:0:8410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15877 00000100:00100000:0.0:1746129567.462750:0:8410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:068dab75-d300-4ead-a742-d14572ad1e50+15:1963:x1830948734009216:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:0.0:1746129567.462756:0:8410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129567.462762:0:8410:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800955d3000/0x40a459093b0692dd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20986 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129567.462772:0:8410:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129567.462773:0:8410:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129567.462777:0:8410:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800955d3000/0x40a459093b0692dd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20986 expref: 16 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129567.462786:0:8410:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800955d3000/0x40a459093b0692dd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20986 expref: 16 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129567.462792:0:8410:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800955d3000, rc 0) 00000100:00100000:0.0:1746129567.462806:0:8410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:068dab75-d300-4ead-a742-d14572ad1e50+16:1963:x1830948734009216:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 56us (1311us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129567.462811:0:8410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15877 00000100:00100000:1.0:1746129567.463245:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15874 00000100:00100000:0.0:1746129567.463682:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129567.463777:0:11014:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734009472 00000100:00100000:2.0:1746129567.463785:0:11014:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734009472 00000100:00100000:2.0:1746129567.463810:0:11014:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15878 00000100:00100000:2.0:1746129567.463816:0:11014:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:068dab75-d300-4ead-a742-d14572ad1e50+13:1963:x1830948734009472:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:2.0:1746129567.463827:0:11014:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129567.463834:0:11014:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c172c00/0x40a459093b0692e4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20994 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129567.463847:0:11014:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129567.463850:0:11014:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129567.463857:0:11014:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c172c00/0x40a459093b0692e4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20994 expref: 14 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129567.463866:0:11014:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c172c00/0x40a459093b0692e4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20994 expref: 14 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129567.463873:0:11014:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c172c00, rc 0) 00000100:00100000:2.0:1746129567.463895:0:11014:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:068dab75-d300-4ead-a742-d14572ad1e50+14:1963:x1830948734009472:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 80us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129567.463900:0:11014:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15878 00000100:00100000:3.0:1746129567.464062:0:22481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135725f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:22481:1830948737467008:192.168.202.4@tcp:106: 00010000:00010000:3.0:1746129567.464096:0:22481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800909cf400/0x40a459093b0692c1 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20971 expref: 15 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129567.464106:0:22481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800909cf400/0x40a459093b0692c1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20971 expref: 15 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129567.464121:0:22481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800909cf400, rc 0) 00000100:00100000:3.0:1746129567.464145:0:22481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132c24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:068dab75-d300-4ead-a742-d14572ad1e50+14:1963:x1830948734008832:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 3409us (3566us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129567.464152:0:22481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15873 00002000:00010000:2.0:1746129567.465395:0:8412:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb mtime: 1746129567 -> 1746129568 00002000:00010000:2.0:1746129567.465400:0:8412:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb atime: 1746129567 -> 1746129568 00002000:00010000:2.0:1746129567.465402:0:8412:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb ctime: 1746129567 -> 1746129568 00000100:00100000:2.0:1746129567.465415:0:8412:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ced880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8412:1830948737467136:192.168.202.4@tcp:106: 00010000:00010000:2.0:1746129567.465434:0:8412:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800955d3800/0x40a459093b0692cf lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2098d expref: 13 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129567.465443:0:8412:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800955d3800/0x40a459093b0692cf lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2098d expref: 13 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129567.465455:0:8412:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800955d3800, rc 0) 00000100:00100000:2.0:1746129567.465493:0:8412:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ced500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:068dab75-d300-4ead-a742-d14572ad1e50+12:1963:x1830948734009344:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 2979us (4044us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129567.465499:0:8412:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15875 00000100:00100000:0.0:1746129567.472563:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129567.472641:0:2271:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734009728 00000100:00100000:3.0:1746129567.472652:0:2271:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734009728 00000100:00100000:3.0:1746129567.472713:0:2271:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11152 00000100:00100000:3.0:1746129567.472721:0:2271:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:068dab75-d300-4ead-a742-d14572ad1e50+12:32164:x1830948734009728:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:3.0:1746129567.472742:0:2271:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129567.472761:0:2271:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800909cf600/0x40a459093b0692eb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2099b expref: -99 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129567.472863:0:2271:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800909cec00/0x40a459093b0692f2 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129567.472878:0:2271:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800909cfa00/0x40a459093b0692ba lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2096a expref: 13 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129567.472885:0:2271:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800909cec00/0x40a459093b0692f2 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129567.472919:0:2271:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800909cfa00/0x40a459093b0692ba lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2096a expref: 13 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129567.472932:0:2271:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800909cfa00/0x40a459093b0692ba lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2096a expref: 13 pid: 2271 timeout: 922 lvb_type: 0 00000100:00100000:3.0:1746129567.472944:0:2271:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135725f80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:2271:1830948737467264:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129567.474715:0:2271:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a7b480 going to sleep for 11 seconds 00000100:00100000:3.0:1746129567.479191:0:2271:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135725f80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:2271:1830948737467264:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129567.479223:0:2271:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800909cec00/0x40a459093b0692f2 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00000100:00100000:0.0:1746129567.480748:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129567.480941:0:20578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734009856 00000100:00100000:2.0:1746129567.480949:0:20578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734009856 00010000:00010000:2.0:1746129567.480989:0:20578:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800909cfa00/0x40a459093b0692ba lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2096a expref: 14 pid: 2271 timeout: 922 lvb_type: 0 00000100:00100000:2.0:1746129567.481017:0:20578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8122 00000100:00100000:2.0:1746129567.481024:0:20578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ceed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:068dab75-d300-4ead-a742-d14572ad1e50+14:1963:x1830948734009856:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129567.481041:0:20578:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129567.481047:0:20578:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800909cfa00/0x40a459093b0692ba lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2096a expref: 14 pid: 2271 timeout: 922 lvb_type: 0 00010000:00010000:2.0:1746129567.481059:0:20578:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800909cfa00/0x40a459093b0692ba lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2096a expref: 14 pid: 2271 timeout: 922 lvb_type: 0 00010000:00010000:2.0:1746129567.481083:0:20578:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800909cfa00/0x40a459093b0692ba lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2096a expref: 14 pid: 2271 timeout: 922 lvb_type: 0 00010000:00010000:2.0:1746129567.481162:0:20578:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009f469400) 00010000:00010000:2.0:1746129567.481168:0:20578:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800909cec00/0x40a459093b0692f2 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129567.481178:0:20578:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800909cec00/0x40a459093b0692f2 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129567.481185:0:20578:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800909cec00/0x40a459093b0692f2 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129567.482250:0:20578:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129567.482337:0:20578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ceed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:068dab75-d300-4ead-a742-d14572ad1e50+13:1963:x1830948734009856:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 1309us (1591us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129567.482362:0:20578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8122 00010000:00010000:3.0:1746129567.482707:0:2271:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800909cec00/0x40a459093b0692f2 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129567.482715:0:2271:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800909cec00/0x40a459093b0692f2 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00000004:00200000:3.0:1746129567.482737:0:2271:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:3.0:1746129567.482894:0:2271:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800909cf600/0x40a459093b0692eb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2099b expref: 14 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129567.482919:0:2271:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800909cec00/0x40a459093b0692f2 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2099b expref: 13 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129567.482927:0:2271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009f469400) 00010000:00010000:3.0:1746129567.482929:0:2271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746129567.482932:0:2271:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800909cec00, rc 0) 00000100:00100000:3.0:1746129567.482957:0:2271:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:068dab75-d300-4ead-a742-d14572ad1e50+13:32164:x1830948734009728:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 10237us (10407us total) trans 8589945236 rc 0/0 00000100:00100000:3.0:1746129567.482963:0:2271:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11152 00000100:00100000:0.0:1746129567.486020:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129567.486103:0:2271:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734009984 00000100:00100000:3.0:1746129567.486114:0:2271:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734009984 00000100:00100000:3.0:1746129567.486165:0:2271:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11153 00000100:00100000:3.0:1746129567.486172:0:2271:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:068dab75-d300-4ead-a742-d14572ad1e50+13:32164:x1830948734009984:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:3.0:1746129567.486197:0:2271:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129567.486215:0:2271:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800909ce600/0x40a459093b069300 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f209a2 expref: -99 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129567.486337:0:2271:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800909ce000/0x40a459093b069307 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129567.486364:0:2271:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800909cec00/0x40a459093b0692f2 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2099b expref: 14 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129567.486370:0:2271:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800909ce000/0x40a459093b069307 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129567.486402:0:2271:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800909cec00/0x40a459093b0692f2 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2099b expref: 14 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129567.486413:0:2271:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800909cec00/0x40a459093b0692f2 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2099b expref: 14 pid: 2271 timeout: 922 lvb_type: 0 00000100:00100000:3.0:1746129567.486425:0:2271:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135725f80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:2271:1830948737467392:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129567.487911:0:2271:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a7b480 going to sleep for 11 seconds 00000100:00100000:3.0:1746129567.489403:0:2271:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135725f80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:2271:1830948737467392:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129567.489432:0:2271:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800909ce000/0x40a459093b069307 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00000100:00100000:0.0:1746129567.491404:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129567.491515:0:20578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734010112 00000100:00100000:2.0:1746129567.491526:0:20578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734010112 00010000:00010000:2.0:1746129567.491567:0:20578:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800909cec00/0x40a459093b0692f2 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2099b expref: 15 pid: 2271 timeout: 922 lvb_type: 0 00000100:00100000:2.0:1746129567.491596:0:20578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8123 00000100:00100000:2.0:1746129567.491604:0:20578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ced880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:068dab75-d300-4ead-a742-d14572ad1e50+15:1963:x1830948734010112:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129567.491617:0:20578:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129567.491623:0:20578:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800909cec00/0x40a459093b0692f2 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2099b expref: 15 pid: 2271 timeout: 922 lvb_type: 0 00010000:00010000:2.0:1746129567.491633:0:20578:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800909cec00/0x40a459093b0692f2 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2099b expref: 15 pid: 2271 timeout: 922 lvb_type: 0 00010000:00010000:2.0:1746129567.491656:0:20578:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800909cec00/0x40a459093b0692f2 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2099b expref: 15 pid: 2271 timeout: 922 lvb_type: 0 00010000:00010000:2.0:1746129567.491682:0:20578:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009f469400) 00010000:00010000:2.0:1746129567.491687:0:20578:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800909ce000/0x40a459093b069307 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129567.491697:0:20578:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800909ce000/0x40a459093b069307 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129567.491708:0:20578:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800909ce000/0x40a459093b069307 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129567.491748:0:20578:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129567.491790:0:20578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ced880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:068dab75-d300-4ead-a742-d14572ad1e50+14:1963:x1830948734010112:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 187us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129567.491796:0:20578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8123 00010000:00010000:3.0:1746129567.492177:0:2271:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800909ce000/0x40a459093b069307 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129567.492186:0:2271:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800909ce000/0x40a459093b069307 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00000004:00200000:2.0:1746129567.492617:0:2271:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00000004:00200000:2.0:1746129567.492622:0:2271:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746129567.492638:0:2271:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800909ce000/0x40a459093b069307 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129567.492667:0:2271:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800909ce600/0x40a459093b069300 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f209a2 expref: 14 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129567.492680:0:2271:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800909ce000/0x40a459093b069307 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f209a2 expref: 13 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129567.492686:0:2271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009f469400) 00010000:00010000:2.0:1746129567.492688:0:2271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746129567.492690:0:2271:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800909ce000, rc 0) 00000100:00100000:2.0:1746129567.493235:0:2271:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:068dab75-d300-4ead-a742-d14572ad1e50+13:32164:x1830948734009984:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 7061us (7222us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129567.493243:0:2271:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11153 00000100:00100000:0.0:1746129567.495177:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129567.495447:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129567.495597:0:8412:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734010240 00000100:00100000:2.0:1746129567.495611:0:8412:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734010240 00000100:00100000:3.0:1746129567.495620:0:22481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734010368 00000100:00100000:3.0:1746129567.495625:0:22481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734010368 00000100:00100000:2.0:1746129567.495792:0:8412:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15879 00000100:00100000:2.0:1746129567.495801:0:8412:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009507c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:068dab75-d300-4ead-a742-d14572ad1e50+13:1962:x1830948734010240:12345-192.168.202.4@tcp:101:lfs.0 00000100:00100000:3.0:1746129567.495815:0:22481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15880 00000100:00100000:3.0:1746129567.495820:0:22481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009507df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:068dab75-d300-4ead-a742-d14572ad1e50+13:1963:x1830948734010368:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:3.0:1746129567.495840:0:22481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129567.495858:0:22481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800909ce800/0x40a459093b06930e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f209b0 expref: -99 pid: 22481 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129567.495915:0:22481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135725f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:22481:1830948737467520:192.168.202.4@tcp:106: 00010000:00010000:2.0:1746129567.495924:0:8412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129567.495933:0:8412:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c172e00/0x40a459093b069315 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f209a9 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129567.495958:0:8412:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095626a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8412:1830948737467648:192.168.202.4@tcp:106: 00000100:00100000:3.0:1746129567.496007:0:22481:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a7b480 going to sleep for 11 seconds 00000100:00100000:2.0:1746129567.496092:0:8412:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800951de240 going to sleep for 11 seconds 00000100:00100000:2.0:1746129567.499169:0:8412:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095626a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8412:1830948737467648:192.168.202.4@tcp:106: 00010000:00010000:2.0:1746129567.499208:0:8412:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c172e00/0x40a459093b069315 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f209a9 expref: 15 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129567.499222:0:8412:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c172e00/0x40a459093b069315 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f209a9 expref: 15 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129567.499241:0:8412:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c172e00, rc 0) 00000100:00100000:2.0:1746129567.499315:0:8412:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009507c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:068dab75-d300-4ead-a742-d14572ad1e50+14:1962:x1830948734010240:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 3514us (4145us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129567.499325:0:8412:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15879 00000100:00100000:3.0:1746129567.499692:0:22481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135725f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:22481:1830948737467520:192.168.202.4@tcp:106: 00010000:00010000:3.0:1746129567.499715:0:22481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800909ce800/0x40a459093b06930e lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f209b0 expref: 13 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129567.499726:0:22481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800909ce800/0x40a459093b06930e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f209b0 expref: 13 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129567.499747:0:22481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800909ce800, rc 0) 00000100:00100000:3.0:1746129567.499786:0:22481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009507df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:068dab75-d300-4ead-a742-d14572ad1e50+12:1963:x1830948734010368:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 3965us (4339us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129567.499792:0:22481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15880 00000100:00100000:0.0:1746129567.501655:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129567.501734:0:2271:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734010624 00000100:00100000:2.0:1746129567.501744:0:2271:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734010624 00000100:00100000:2.0:1746129567.501803:0:2271:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11154 00000100:00100000:2.0:1746129567.501811:0:2271:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009507ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:068dab75-d300-4ead-a742-d14572ad1e50+13:32164:x1830948734010624:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:2.0:1746129567.501831:0:2271:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129567.501849:0:2271:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c173000/0x40a459093b06931c lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f209b7 expref: -99 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129567.501953:0:2271:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c173200/0x40a459093b069323 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129567.501968:0:2271:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c173200/0x40a459093b069323 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129567.501979:0:2271:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c173200/0x40a459093b069323 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00000004:00200000:2.0:1746129567.501991:0:2271:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:2.0:1746129567.502109:0:2271:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c173000/0x40a459093b06931c lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x1/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f209b7 expref: 16 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129567.502124:0:2271:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c173200/0x40a459093b069323 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f209b7 expref: 15 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129567.502133:0:2271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009f469400) 00010000:00010000:2.0:1746129567.502135:0:2271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746129567.502138:0:2271:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c173200, rc 0) 00000100:00100000:2.0:1746129567.502226:0:2271:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009507ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:068dab75-d300-4ead-a742-d14572ad1e50+15:32164:x1830948734010624:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 415us (577us total) trans 8589945237 rc 0/0 00000100:00100000:2.0:1746129567.502233:0:2271:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11154 00000100:00100000:0.0:1746129567.506545:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129567.506587:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129567.506612:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129567.506638:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129567.506654:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129567.506667:0:8412:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734010880 00000100:00100000:3.0:1746129567.506679:0:22481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734010752 00000100:00100000:2.0:1746129567.506679:0:8412:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734010880 00000100:00100000:0.0:1746129567.506684:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129567.506685:0:22481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734010752 00000100:00100000:1.0:1746129567.506697:0:8411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734011008 00000100:00100000:1.0:1746129567.506702:0:8411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734011008 00000100:00100000:3.0:1746129567.506719:0:22481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734011136 00000100:00100000:3.0:1746129567.506721:0:22481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734011136 00000100:00100000:2.0:1746129567.506723:0:8412:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734011264 00000100:00100000:2.0:1746129567.506725:0:8412:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734011264 00000100:00100000:1.0:1746129567.506726:0:8411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734011392 00000100:00100000:1.0:1746129567.506728:0:8411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734011392 00000100:00100000:0.0:1746129567.506735:0:22480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15881 00000100:00100000:0.0:1746129567.506745:0:22480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009507d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:068dab75-d300-4ead-a742-d14572ad1e50+14:1963:x1830948734010752:12345-192.168.202.4@tcp:1:lfs.0 00000100:00100000:3.0:1746129567.506747:0:31503:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15882 00000100:00100000:3.0:1746129567.506753:0:31503:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009507ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:068dab75-d300-4ead-a742-d14572ad1e50+16:1962:x1830948734010880:12345-192.168.202.4@tcp:1:lfs.0 00000100:00100000:2.0:1746129567.506753:0:8412:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15883 00000100:00100000:1.0:1746129567.506758:0:8411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15884 00000100:00100000:1.0:1746129567.506762:0:8411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009507e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:068dab75-d300-4ead-a742-d14572ad1e50+14:1962:x1830948734011136:12345-192.168.202.4@tcp:1:lfs.0 00000100:00100000:2.0:1746129567.506773:0:8412:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009507d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:068dab75-d300-4ead-a742-d14572ad1e50+16:1963:x1830948734011008:12345-192.168.202.4@tcp:1:lfs.0 00010000:00010000:1.0:1746129567.506789:0:8411:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800946f1a00/0x40a459093b069331 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129567.506789:0:22480:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800955d2400/0x40a459093b069338 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129567.506790:0:31503:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800909cec00/0x40a459093b06933f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129567.506792:0:8412:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012c173600/0x40a459093b069346 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129567.506805:0:31503:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d872600/0x40a459093b069204 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f208e5 expref: 17 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129567.506805:0:8411:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a6729200/0x40a459093b069139 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20852 expref: 19 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129567.506805:0:22480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800909cf000/0x40a459093b069266 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->573439) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20947 expref: 32 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129567.506806:0:8412:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ee1b800/0x40a459093b069212 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f208f3 expref: 17 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129567.506811:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129567.506812:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129567.506813:0:31503:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800955d3a00/0x40a459093b0692d6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20978 expref: 16 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129567.506813:0:8411:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800955d3000/0x40a459093b0692dd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20986 expref: 14 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129567.506814:0:8412:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800946f0c00/0x40a459093b0692c8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2097f expref: 16 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129567.506815:0:22480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800955d2400/0x40a459093b069338 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129567.506820:0:31503:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d144800/0x40a459093b069220 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f208fa expref: 34 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129567.506820:0:8411:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800946c7000/0x40a459093b069140 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20859 expref: 32 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129567.506821:0:8412:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f9c5800/0x40a459093b069243 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2091d expref: 34 pid: 8411 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129567.506825:0:31503:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129567.506825:0:8411:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129567.506826:0:31503:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129567.506826:0:8411:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129567.506827:0:8412:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129567.506828:0:31503:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800909cec00/0x40a459093b06933f lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129567.506828:0:8411:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800946f1a00/0x40a459093b069331 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129567.506829:0:8412:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129567.506831:0:8412:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c173600/0x40a459093b069346 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129567.506843:0:22480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800909cf000/0x40a459093b069266 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->573439) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20947 expref: 32 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129567.506844:0:31503:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009d144800/0x40a459093b069220 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f208fa expref: 34 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129567.506844:0:8411:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800946c7000/0x40a459093b069140 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20859 expref: 32 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129567.506847:0:8412:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f9c5800/0x40a459093b069243 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2091d expref: 34 pid: 8411 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129567.506854:0:8411:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800946c7000/0x40a459093b069140 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20859 expref: 32 pid: 22481 timeout: 922 lvb_type: 1 00010000:00010000:0.0:1746129567.506854:0:22480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800909cf000/0x40a459093b069266 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->573439) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20947 expref: 32 pid: 22481 timeout: 922 lvb_type: 0 00010000:00010000:3.0:1746129567.506855:0:31503:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009d144800/0x40a459093b069220 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f208fa expref: 34 pid: 7148 timeout: 922 lvb_type: 1 00010000:00010000:2.0:1746129567.506856:0:8412:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f9c5800/0x40a459093b069243 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2091d expref: 34 pid: 8411 timeout: 922 lvb_type: 1 00000100:00100000:0.0:1746129567.506866:0:22480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094065180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22480:1830948737467776:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129567.506867:0:31503:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135725f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:31503:1830948737468032:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129567.506867:0:8412:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095626a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8412:1830948737468160:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129567.506867:0:8411:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092fd1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8411:1830948737467904:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129567.506931:0:4699:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15885 00000100:00100000:1.0:1746129567.506935:0:20577:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15886 00000100:00100000:0.0:1746129567.506935:0:22480:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a00780 going to sleep for 11 seconds 00000100:00100000:3.0:1746129567.506936:0:4699:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094064700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:068dab75-d300-4ead-a742-d14572ad1e50+14:1963:x1830948734011264:12345-192.168.202.4@tcp:1:lfs.0 00000100:00100000:1.0:1746129567.506939:0:20577:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094064000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:068dab75-d300-4ead-a742-d14572ad1e50+16:1962:x1830948734011392:12345-192.168.202.4@tcp:1:lfs.0 00010000:00010000:3.0:1746129567.506954:0:4699:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800909cfa00/0x40a459093b069354 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129567.506954:0:20577:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800946f1200/0x40a459093b06934d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129567.506963:0:4699:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800909cfe00/0x40a459093b06929e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3338240->3653631) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20963 expref: 19 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129567.506963:0:20577:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135723200/0x40a459093b0691b0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f208ad expref: 34 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129567.506969:0:4699:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129567.506970:0:4699:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129567.506970:0:20577:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d873400/0x40a459093b06920b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f208ec expref: 34 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129567.506972:0:4699:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800909cfa00/0x40a459093b069354 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129567.506976:0:20577:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c172c00/0x40a459093b0692e4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20994 expref: 16 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129567.506982:0:20577:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800955d3600/0x40a459093b069235 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20916 expref: 17 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129567.506985:0:4699:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800909cfe00/0x40a459093b06929e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3338240->3653631) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20963 expref: 19 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129567.506986:0:20577:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129567.506987:0:20577:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129567.506989:0:20577:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800946f1200/0x40a459093b06934d lrc: 7/0,1 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129567.506992:0:4699:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800909cfe00/0x40a459093b06929e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3338240->3653631) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20963 expref: 19 pid: 22481 timeout: 922 lvb_type: 0 00000100:00100000:3.0:1746129567.507000:0:4699:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135724a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4699:1830948737468288:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129567.507003:0:20577:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800955d3600/0x40a459093b069235 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20916 expref: 17 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129567.507010:0:20577:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800955d3600/0x40a459093b069235 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20916 expref: 17 pid: 7149 timeout: 922 lvb_type: 1 00000100:00100000:3.0:1746129567.507018:0:4699:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a7bf00 going to sleep for 11 seconds 00000100:00100000:1.0:1746129567.507022:0:20577:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092fd0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20577:1830948737468416:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129567.507037:0:31503:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800955d3a00/0x40a459093b0692d6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20978 expref: 16 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129567.507042:0:20577:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c172c00/0x40a459093b0692e4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20994 expref: 16 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129567.507045:0:31503:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800955d3a00/0x40a459093b0692d6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20978 expref: 16 pid: 8410 timeout: 922 lvb_type: 1 00010000:00010000:1.0:1746129567.507049:0:20577:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c172c00/0x40a459093b0692e4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20994 expref: 16 pid: 11014 timeout: 922 lvb_type: 1 00000100:00100000:3.0:1746129567.507053:0:31503:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135724e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:31503:1830948737468544:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129567.507055:0:20577:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092fd0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20577:1830948737468672:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129567.507071:0:31503:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d872600/0x40a459093b069204 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f208e5 expref: 17 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129567.507071:0:20577:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d873400/0x40a459093b06920b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f208ec expref: 34 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129567.507078:0:20577:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d873400/0x40a459093b06920b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f208ec expref: 34 pid: 11014 timeout: 922 lvb_type: 0 00010000:00010000:3.0:1746129567.507079:0:31503:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d872600/0x40a459093b069204 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f208e5 expref: 17 pid: 11014 timeout: 922 lvb_type: 0 00000100:00100000:3.0:1746129567.507085:0:31503:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135724000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:31503:1830948737468800:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129567.507085:0:20577:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092fd3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20577:1830948737468928:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129567.507098:0:31503:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a7b480 going to sleep for 11 seconds 00010000:00010000:1.0:1746129567.507118:0:20577:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135723200/0x40a459093b0691b0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f208ad expref: 34 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129567.507125:0:20577:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135723200/0x40a459093b0691b0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f208ad expref: 34 pid: 8412 timeout: 922 lvb_type: 0 00000100:00100000:1.0:1746129567.507132:0:20577:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092fd3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20577:1830948737469056:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129567.507152:0:20577:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c954300 going to sleep for 11 seconds 00010000:00010000:1.0:1746129567.507186:0:8411:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800955d3000/0x40a459093b0692dd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20986 expref: 14 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129567.507193:0:8411:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800955d3000/0x40a459093b0692dd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20986 expref: 14 pid: 8410 timeout: 922 lvb_type: 1 00000100:00100000:1.0:1746129567.507200:0:8411:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013575ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8411:1830948737469184:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129567.507221:0:8411:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a6729200/0x40a459093b069139 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20852 expref: 19 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129567.507228:0:8411:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a6729200/0x40a459093b069139 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20852 expref: 19 pid: 22481 timeout: 922 lvb_type: 0 00000100:00100000:1.0:1746129567.507234:0:8411:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013575f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8411:1830948737469312:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129567.507257:0:8411:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c954b40 going to sleep for 11 seconds 00010000:00010000:2.0:1746129567.507360:0:8412:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800946f0c00/0x40a459093b0692c8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2097f expref: 16 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129567.507369:0:8412:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800946f0c00/0x40a459093b0692c8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2097f expref: 16 pid: 7148 timeout: 922 lvb_type: 1 00000100:00100000:2.0:1746129567.507377:0:8412:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095625880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8412:1830948737469440:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129567.507410:0:8412:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ee1b800/0x40a459093b069212 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f208f3 expref: 17 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129567.507417:0:8412:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ee1b800/0x40a459093b069212 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f208f3 expref: 17 pid: 11014 timeout: 922 lvb_type: 0 00000100:00100000:2.0:1746129567.507424:0:8412:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095627480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8412:1830948737469568:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129567.507437:0:8412:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b183cc00 going to sleep for 11 seconds 00000100:00100000:0.0:1746129567.514037:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129567.514067:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734011520 00000100:00100000:0.0:1746129567.514075:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734011520 00000100:00100000:2.0:1746129567.514359:0:22480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094065180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22480:1830948737467776:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129567.514385:0:22480:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800955d2400/0x40a459093b069338 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129567.514467:0:8411:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092fd1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8411:1830948737467904:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129567.514541:0:31503:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135725f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:31503:1830948737468032:192.168.202.4@tcp:104: 00002000:00100000:0.0:1746129567.514689:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ec:0x0] (4096->573439) req@ffff880094067100 x1830948734011520/t0(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:308/0 lens 488/0 e 0 to 0 dl 1746129578 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129567.514699:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094067100 with x1830948734011520 ext(4096->573439) 00010000:00010000:0.0:1746129567.514706:0:25745:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800909cf000/0x40a459093b069266 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->573439) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20947 expref: 33 pid: 22481 timeout: 922 lvb_type: 0 00010000:00010000:0.0:1746129567.514717:0:25745:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800909cf000/0x40a459093b069266 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->573439) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20947 expref: 33 pid: 22481 timeout: 922 lvb_type: 0 00002000:00010000:0.0:1746129567.514723:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094067100 00000100:00100000:0.0:1746129567.514750:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2388 00000100:00100000:0.0:1746129567.514757:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094067100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+33:1962:x1830948734011520:12345-192.168.202.4@tcp:4:multiop.0 00000100:00100000:1.0:1746129567.514954:0:20577:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092fd0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20577:1830948737468416:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129567.514983:0:20577:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092fd0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20577:1830948737468672:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129567.515005:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129567.515025:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129567.515043:0:20577:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092fd3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20577:1830948737468928:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129567.515060:0:20577:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092fd3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20577:1830948737469056:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129567.515077:0:20577:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800946f1200/0x40a459093b06934d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129567.515106:0:8411:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013575ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8411:1830948737469184:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129567.515126:0:8411:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013575f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8411:1830948737469312:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129567.515140:0:8411:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800946f1a00/0x40a459093b069331 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129567.515218:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734011776 00000100:00100000:0.0:1746129567.515222:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734011776 00010000:00010000:0.0:1746129567.515242:0:9823:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f9c5800/0x40a459093b069243 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2091d expref: 35 pid: 8411 timeout: 922 lvb_type: 1 00000100:00100000:0.0:1746129567.515260:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8124 00000100:00100000:0.0:1746129567.515264:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6026c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ada2ffba-8920-4ecb-8068-68caa9806978+35:1961:x1830948734011776:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129567.515278:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129567.515318:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f9c5800/0x40a459093b069243 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2091d expref: 35 pid: 8411 timeout: 922 lvb_type: 1 00010000:00010000:0.0:1746129567.515327:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f9c5800/0x40a459093b069243 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2091d expref: 35 pid: 8411 timeout: 922 lvb_type: 1 00010000:00010000:0.0:1746129567.515364:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129567.518219:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6026c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ada2ffba-8920-4ecb-8068-68caa9806978+35:1961:x1830948734011776:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 139us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129567.518241:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8124 00000100:00100000:2.0:1746129567.519256:0:21725:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734011904 00000100:00100000:2.0:1746129567.519267:0:21725:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734011904 00002000:00100000:2.0:1746129567.519331:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ef:0x0] (3338240->3653631) req@ffff88013575df80 x1830948734011904/t0(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:308/0 lens 488/0 e 0 to 0 dl 1746129578 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129567.519341:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013575df80 with x1830948734011904 ext(3338240->3653631) 00010000:00010000:2.0:1746129567.519363:0:21725:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800909cfe00/0x40a459093b06929e lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3338240->3653631) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20963 expref: 20 pid: 22481 timeout: 922 lvb_type: 0 00010000:00010000:2.0:1746129567.519376:0:21725:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800909cfe00/0x40a459093b06929e lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3338240->3653631) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20963 expref: 20 pid: 22481 timeout: 922 lvb_type: 0 00002000:00010000:2.0:1746129567.519384:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88013575df80 00000100:00100000:2.0:1746129567.519407:0:21725:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2389 00000100:00100000:2.0:1746129567.519414:0:21725:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013575df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:1961:x1830948734011904:12345-192.168.202.4@tcp:4:multiop.0 00000100:00100000:3.0:1746129567.519549:0:4699:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135724a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4699:1830948737468288:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129567.519571:0:4699:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800909cfa00/0x40a459093b069354 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129567.519602:0:31503:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135724e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:31503:1830948737468544:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129567.519612:0:31503:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135724000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:31503:1830948737468800:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129567.519628:0:31503:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800909cec00/0x40a459093b06933f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129567.519657:0:8412:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f9c5800/0x40a459093b069243 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2091d expref: 34 pid: 8411 timeout: 922 lvb_type: 1 00000100:00100000:3.0:1746129567.519688:0:8412:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095626a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8412:1830948737468160:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129567.519699:0:8412:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095625880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8412:1830948737469440:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129567.519708:0:8412:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095627480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8412:1830948737469568:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129567.519726:0:8412:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012c173600/0x40a459093b069346 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129567.520125:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129567.520157:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129567.520179:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129567.520196:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734012288 00000100:00100000:0.0:1746129567.520196:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734012032 00000100:00100000:1.0:1746129567.520199:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734012288 00000100:00100000:0.0:1746129567.520200:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734012032 00010000:00010000:1.0:1746129567.520218:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c172c00/0x40a459093b0692e4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20994 expref: 17 pid: 11014 timeout: 922 lvb_type: 1 00010000:00010000:0.0:1746129567.520219:0:9823:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800946c7000/0x40a459093b069140 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20859 expref: 35 pid: 22481 timeout: 922 lvb_type: 1 00000100:00100000:0.0:1746129567.520414:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734012544 00000100:00100000:0.0:1746129567.520417:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734012544 00000100:00100000:1.0:1746129567.520419:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8125 00000100:00100000:1.0:1746129567.520426:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013575ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:068dab75-d300-4ead-a742-d14572ad1e50+17:1963:x1830948734012288:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129567.520427:0:9823:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800955d3000/0x40a459093b0692dd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20986 expref: 15 pid: 8410 timeout: 922 lvb_type: 1 00010000:00010000:1.0:1746129567.520436:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746129567.520448:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8126 00000100:00100000:0.0:1746129567.520452:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013575f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ada2ffba-8920-4ecb-8068-68caa9806978+35:1963:x1830948734012032:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129567.520457:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c172c00/0x40a459093b0692e4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20994 expref: 17 pid: 11014 timeout: 922 lvb_type: 1 00010000:00010000:0.0:1746129567.520461:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129567.520467:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c172c00/0x40a459093b0692e4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20994 expref: 17 pid: 11014 timeout: 922 lvb_type: 1 00010000:00010000:0.0:1746129567.520474:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800946c7000/0x40a459093b069140 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20859 expref: 35 pid: 22481 timeout: 922 lvb_type: 1 00010000:00010000:0.0:1746129567.520487:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800946c7000/0x40a459093b069140 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20859 expref: 35 pid: 22481 timeout: 922 lvb_type: 1 00010000:00010000:1.0:1746129567.520490:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c172c00/0x40a459093b0692e4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20994 expref: 17 pid: 11014 timeout: 922 lvb_type: 1 00010000:00010000:0.0:1746129567.520500:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800946c7000/0x40a459093b069140 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20859 expref: 35 pid: 22481 timeout: 922 lvb_type: 1 00010000:00010000:1.0:1746129567.520510:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746129567.520512:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129567.520534:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013575f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ada2ffba-8920-4ecb-8068-68caa9806978+34:1963:x1830948734012032:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 81us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129567.520539:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8126 00000100:00100000:0.0:1746129567.520553:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8127 00000100:00100000:0.0:1746129567.520557:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013575e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:068dab75-d300-4ead-a742-d14572ad1e50+15:1963:x1830948734012544:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129567.520564:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129567.520570:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800955d3000/0x40a459093b0692dd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20986 expref: 15 pid: 8410 timeout: 922 lvb_type: 1 00010000:00010000:0.0:1746129567.520578:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800955d3000/0x40a459093b0692dd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20986 expref: 15 pid: 8410 timeout: 922 lvb_type: 1 00010000:00010000:0.0:1746129567.520650:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800955d3000/0x40a459093b0692dd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20986 expref: 15 pid: 8410 timeout: 922 lvb_type: 1 00010000:00010000:0.0:1746129567.520658:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129567.520660:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013575ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:068dab75-d300-4ead-a742-d14572ad1e50+16:1963:x1830948734012288:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 234us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129567.520666:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8125 00000100:00100000:0.0:1746129567.520671:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013575e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:068dab75-d300-4ead-a742-d14572ad1e50+14:1963:x1830948734012544:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 114us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129567.520679:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8127 00000100:00100000:1.0:1746129567.520694:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129567.520707:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734011648 00000100:00100000:0.0:1746129567.520710:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734011648 00000100:00100000:1.0:1746129567.520720:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00010000:00010000:0.0:1746129567.520720:0:9823:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009d144800/0x40a459093b069220 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f208fa expref: 34 pid: 7148 timeout: 922 lvb_type: 1 00000100:00100000:1.0:1746129567.520838:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129567.520902:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734012160 00000100:00100000:0.0:1746129567.520905:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734012160 00000100:00100000:2.0:1746129567.520909:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734012416 00000100:00100000:2.0:1746129567.520913:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734012416 00010000:00010000:0.0:1746129567.520915:0:9823:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800955d3a00/0x40a459093b0692d6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20978 expref: 16 pid: 8410 timeout: 922 lvb_type: 1 00010000:00010000:2.0:1746129567.520927:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d872600/0x40a459093b069204 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f208e5 expref: 18 pid: 11014 timeout: 922 lvb_type: 0 00000100:00100000:0.0:1746129567.520929:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8128 00000100:00100000:0.0:1746129567.520934:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013575d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ada2ffba-8920-4ecb-8068-68caa9806978+34:1963:x1830948734011648:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129567.520939:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746129567.520941:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8129 00000100:00100000:2.0:1746129567.520946:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013575fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:068dab75-d300-4ead-a742-d14572ad1e50+16:1963:x1830948734012160:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129567.520949:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009d144800/0x40a459093b069220 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f208fa expref: 34 pid: 7148 timeout: 922 lvb_type: 1 00010000:00010000:0.0:1746129567.520957:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009d144800/0x40a459093b069220 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f208fa expref: 34 pid: 7148 timeout: 922 lvb_type: 1 00010000:00010000:0.0:1746129567.520968:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d144800/0x40a459093b069220 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f208fa expref: 34 pid: 7148 timeout: 922 lvb_type: 1 00010000:00010000:0.0:1746129567.520976:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129567.520989:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013575d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ada2ffba-8920-4ecb-8068-68caa9806978+33:1963:x1830948734011648:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 56us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129567.520994:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8128 00000100:00100000:0.0:1746129567.521005:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8130 00000100:00100000:0.0:1746129567.521009:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013575f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+18:1963:x1830948734012416:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129567.521016:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129567.521022:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d872600/0x40a459093b069204 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f208e5 expref: 18 pid: 11014 timeout: 922 lvb_type: 0 00010000:00010000:0.0:1746129567.521029:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d872600/0x40a459093b069204 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f208e5 expref: 18 pid: 11014 timeout: 922 lvb_type: 0 00010000:00010000:0.0:1746129567.521040:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d872600/0x40a459093b069204 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f208e5 expref: 18 pid: 11014 timeout: 922 lvb_type: 0 00010000:00010000:0.0:1746129567.521048:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129567.521060:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013575f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+17:1963:x1830948734012416:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 52us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129567.521065:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8130 00000100:00100000:1.0:1746129567.521117:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129567.521139:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129567.521154:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129567.521176:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00010000:00010000:2.0:1746129567.521189:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129567.521199:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800955d3a00/0x40a459093b0692d6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20978 expref: 16 pid: 8410 timeout: 922 lvb_type: 1 00010000:00010000:2.0:1746129567.521207:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800955d3a00/0x40a459093b0692d6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20978 expref: 16 pid: 8410 timeout: 922 lvb_type: 1 00010000:00010000:2.0:1746129567.521219:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800955d3a00/0x40a459093b0692d6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20978 expref: 16 pid: 8410 timeout: 922 lvb_type: 1 00010000:00010000:2.0:1746129567.521237:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129567.521239:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129567.521244:0:7085:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800909cec00/0x40a459093b06933f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129567.521253:0:7085:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800909cec00/0x40a459093b06933f lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129567.521272:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129567.521279:0:20578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734012928 00000100:00100000:3.0:1746129567.521283:0:20578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734012928 00000100:00100000:2.0:1746129567.521291:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013575fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:068dab75-d300-4ead-a742-d14572ad1e50+15:1963:x1830948734012160:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 345us (570us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129567.521309:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734012800 00000100:00100000:3.0:1746129567.521311:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734012800 00000100:00100000:2.0:1746129567.521311:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8129 00000100:00100000:2.0:1746129567.521321:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734012672 00000100:00100000:2.0:1746129567.521323:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734012672 00010000:00010000:3.0:1746129567.521325:0:7087:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800946f0c00/0x40a459093b0692c8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2097f expref: 15 pid: 7148 timeout: 922 lvb_type: 1 00010000:00010000:2.0:1746129567.521333:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135723200/0x40a459093b0691b0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f208ad expref: 33 pid: 8412 timeout: 922 lvb_type: 0 00000100:00100000:3.0:1746129567.521337:0:7087:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8131 00000100:00100000:3.0:1746129567.521352:0:7087:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092fd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:068dab75-d300-4ead-a742-d14572ad1e50+15:1960:x1830948734012800:12345-192.168.202.4@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746129567.521356:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8132 00010000:00010000:3.0:1746129567.521360:0:7087:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746129567.521361:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092fd3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ada2ffba-8920-4ecb-8068-68caa9806978+33:1960:x1830948734012672:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129567.521368:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129567.521370:0:7087:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800946f0c00/0x40a459093b0692c8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2097f expref: 15 pid: 7148 timeout: 922 lvb_type: 1 00010000:00010000:2.0:1746129567.521376:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135723200/0x40a459093b0691b0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f208ad expref: 33 pid: 8412 timeout: 922 lvb_type: 0 00010000:00010000:3.0:1746129567.521378:0:7087:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800946f0c00/0x40a459093b0692c8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2097f expref: 15 pid: 7148 timeout: 922 lvb_type: 1 00010000:00010000:2.0:1746129567.521383:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135723200/0x40a459093b0691b0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f208ad expref: 33 pid: 8412 timeout: 922 lvb_type: 0 00010000:00010000:3.0:1746129567.521389:0:7087:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800946f0c00/0x40a459093b0692c8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2097f expref: 15 pid: 7148 timeout: 922 lvb_type: 1 00010000:00010000:2.0:1746129567.521394:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135723200/0x40a459093b0691b0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f208ad expref: 33 pid: 8412 timeout: 922 lvb_type: 0 00010000:00010000:3.0:1746129567.521398:0:7087:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746129567.521403:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129567.521413:0:7087:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092fd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:068dab75-d300-4ead-a742-d14572ad1e50+14:1960:x1830948734012800:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 71us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129567.521417:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092fd3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ada2ffba-8920-4ecb-8068-68caa9806978+32:1960:x1830948734012672:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 56us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129567.521418:0:7087:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8131 00000100:00100000:2.0:1746129567.521422:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8132 00010000:00010000:3.0:1746129567.521438:0:31503:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800909cec00/0x40a459093b06933f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129567.521446:0:31503:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800909cec00/0x40a459093b06933f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129567.521465:0:31503:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800909cec00/0x40a459093b06933f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129567.521473:0:31503:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800909cec00/0x40a459093b06933f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129567.521536:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734013056 00000100:00100000:0.0:1746129567.521539:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734013056 00010000:00010000:0.0:1746129567.521556:0:9823:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ee1b800/0x40a459093b069212 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f208f3 expref: 17 pid: 11014 timeout: 922 lvb_type: 0 00000100:00100000:0.0:1746129567.521570:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8133 00000100:00100000:0.0:1746129567.521573:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092fd3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+17:1960:x1830948734013056:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129567.521579:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129567.521584:0:20578:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6729200/0x40a459093b069139 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20852 expref: 22 pid: 22481 timeout: 922 lvb_type: 0 00010000:00010000:0.0:1746129567.521586:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ee1b800/0x40a459093b069212 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f208f3 expref: 17 pid: 11014 timeout: 922 lvb_type: 0 00010000:00010000:0.0:1746129567.521597:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ee1b800/0x40a459093b069212 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f208f3 expref: 17 pid: 11014 timeout: 922 lvb_type: 0 00000100:00100000:2.0:1746129567.521601:0:7086:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8134 00000100:00100000:2.0:1746129567.521606:0:7086:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6026850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+22:1963:x1830948734012928:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129567.521606:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ee1b800/0x40a459093b069212 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f208f3 expref: 17 pid: 11014 timeout: 922 lvb_type: 0 00010000:00010000:0.0:1746129567.521612:0:9823:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129567.521613:0:7086:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129567.521614:0:9823:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129567.521616:0:9823:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c173600/0x40a459093b069346 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129567.521622:0:9823:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c173600/0x40a459093b069346 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129567.521623:0:7086:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a6729200/0x40a459093b069139 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20852 expref: 22 pid: 22481 timeout: 922 lvb_type: 0 00010000:00010000:2.0:1746129567.521631:0:7086:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a6729200/0x40a459093b069139 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20852 expref: 22 pid: 22481 timeout: 922 lvb_type: 0 00010000:00010000:0.0:1746129567.521634:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746129567.521642:0:7086:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a6729200/0x40a459093b069139 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20852 expref: 22 pid: 22481 timeout: 922 lvb_type: 0 00000100:00100000:0.0:1746129567.521649:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092fd3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+16:1960:x1830948734013056:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 75us (473us total) trans 0 rc 0/0 00010000:00010000:2.0:1746129567.521651:0:7086:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129567.521653:0:7086:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746129567.521654:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8133 00010000:00010000:2.0:1746129567.521655:0:7086:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800946f1a00/0x40a459093b069331 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129567.521662:0:7086:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800946f1a00/0x40a459093b069331 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129567.521757:0:31503:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800909cec00/0x40a459093b06933f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129567.521764:0:31503:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800909cec00 already unused, calling callback (ffffffffa086ed70) 00010000:00010000:3.0:1746129567.521767:0:31503:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800909cec00/0x40a459093b06933f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129567.521775:0:31503:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800909cec00/0x40a459093b06933f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129567.521784:0:31503:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800909cec00/0x40a459093b06933f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129567.521790:0:31503:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800909cec00/0x40a459093b06933f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129567.522061:0:7086:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129567.522271:0:7086:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6026850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:1963:x1830948734012928:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 664us (1153us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129567.522273:0:31503:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009507ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:068dab75-d300-4ead-a742-d14572ad1e50+13:1962:x1830948734010880:12345-192.168.202.4@tcp:1:lfs.0 Request processed in 15519us (15739us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129567.522277:0:7086:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8134 00000100:00100000:3.0:1746129567.522282:0:31503:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15882 00010000:00010000:3.0:1746129567.522321:0:8412:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012c173600/0x40a459093b069346 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129567.522328:0:8412:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c173600/0x40a459093b069346 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129567.522352:0:8412:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012c173600/0x40a459093b069346 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129567.522359:0:8412:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012c173600/0x40a459093b069346 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129567.522365:0:8412:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012c173600/0x40a459093b069346 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129567.522370:0:8412:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c173600 already unused, calling callback (ffffffffa086ed70) 00010000:00010000:3.0:1746129567.522372:0:8412:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012c173600/0x40a459093b069346 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129567.522377:0:8412:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012c173600/0x40a459093b069346 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129567.522386:0:8412:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012c173600/0x40a459093b069346 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129567.522392:0:8412:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c173600/0x40a459093b069346 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129567.522465:0:8411:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800946f1a00/0x40a459093b069331 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129567.522476:0:8411:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800946f1a00/0x40a459093b069331 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129567.522491:0:8411:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800946f1a00/0x40a459093b069331 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129567.522496:0:8411:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800946f1a00/0x40a459093b069331 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129567.522501:0:8411:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800946f1a00/0x40a459093b069331 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129567.522511:0:8411:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800946f1a00 already unused, calling callback (ffffffffa086ed70) 00010000:00010000:1.0:1746129567.522514:0:8411:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800946f1a00/0x40a459093b069331 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129567.522519:0:8411:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800946f1a00/0x40a459093b069331 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129567.522528:0:8411:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800946f1a00/0x40a459093b069331 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129567.522534:0:8411:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800946f1a00/0x40a459093b069331 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129567.523435:0:8412:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009507d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:068dab75-d300-4ead-a742-d14572ad1e50+12:1963:x1830948734011008:12345-192.168.202.4@tcp:1:lfs.0 Request processed in 16670us (16816us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129567.523442:0:8412:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15883 00000100:00100000:1.0:1746129567.523454:0:8411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009507e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:068dab75-d300-4ead-a742-d14572ad1e50+13:1962:x1830948734011136:12345-192.168.202.4@tcp:1:lfs.0 Request processed in 16688us (16812us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129567.523461:0:8411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15884 00000100:00100000:0.0:1746129567.524386:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129567.524459:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129567.525000:0:7086:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734013312 00000100:00100000:2.0:1746129567.525008:0:7086:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734013312 00010000:00010000:2.0:1746129567.525049:0:7086:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d873400/0x40a459093b06920b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f208ec expref: 32 pid: 11014 timeout: 922 lvb_type: 0 00000100:00100000:2.0:1746129567.525077:0:7086:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734013184 00000100:00100000:2.0:1746129567.525080:0:7086:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734013184 00010000:00010000:2.0:1746129567.525091:0:7086:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800955d3600/0x40a459093b069235 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20916 expref: 16 pid: 7149 timeout: 922 lvb_type: 1 00000100:00100000:2.0:1746129567.525106:0:7086:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8135 00000100:00100000:2.0:1746129567.525112:0:7086:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094067480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ada2ffba-8920-4ecb-8068-68caa9806978+32:1963:x1830948734013312:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129567.525131:0:7086:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129567.525153:0:7086:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d873400/0x40a459093b06920b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f208ec expref: 32 pid: 11014 timeout: 922 lvb_type: 0 00010000:00010000:2.0:1746129567.525163:0:7086:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d873400/0x40a459093b06920b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f208ec expref: 32 pid: 11014 timeout: 922 lvb_type: 0 00010000:00010000:2.0:1746129567.525186:0:7086:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d873400/0x40a459093b06920b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f208ec expref: 32 pid: 11014 timeout: 922 lvb_type: 0 00010000:00010000:2.0:1746129567.525202:0:7086:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129567.525250:0:7086:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094067480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ada2ffba-8920-4ecb-8068-68caa9806978+31:1963:x1830948734013312:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 137us (867us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129567.525256:0:7086:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8135 00000100:00100000:2.0:1746129567.525268:0:7086:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8136 00000100:00100000:2.0:1746129567.525272:0:7086:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094065f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+16:1960:x1830948734013184:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129567.525278:0:7086:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129567.525285:0:7086:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800955d3600/0x40a459093b069235 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20916 expref: 16 pid: 7149 timeout: 922 lvb_type: 1 00010000:00010000:2.0:1746129567.525316:0:7086:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800955d3600/0x40a459093b069235 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20916 expref: 16 pid: 7149 timeout: 922 lvb_type: 1 00010000:00010000:2.0:1746129567.525327:0:7086:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800955d3600/0x40a459093b069235 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20916 expref: 16 pid: 7149 timeout: 922 lvb_type: 1 00010000:00010000:2.0:1746129567.525337:0:7086:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129567.525340:0:7086:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129567.525355:0:7086:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800946f1200/0x40a459093b06934d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129567.525364:0:7086:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800946f1200/0x40a459093b06934d lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129567.527235:0:7086:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129567.527290:0:7086:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094065f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+15:1960:x1830948734013184:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 2009us (2823us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129567.527315:0:7086:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8136 00010000:00010000:0.0:1746129567.527892:0:20577:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800946f1200/0x40a459093b06934d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129567.527902:0:20577:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800946f1200/0x40a459093b06934d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129567.527935:0:20577:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800946f1200/0x40a459093b06934d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129567.527943:0:20577:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800946f1200/0x40a459093b06934d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129567.527951:0:20577:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800946f1200/0x40a459093b06934d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129567.527957:0:20577:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800946f1200 already unused, calling callback (ffffffffa086ed70) 00010000:00010000:0.0:1746129567.527961:0:20577:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800946f1200/0x40a459093b06934d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129567.527969:0:20577:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800946f1200/0x40a459093b06934d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129567.527983:0:20577:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800946f1200/0x40a459093b06934d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129567.527990:0:20577:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800946f1200/0x40a459093b06934d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129567.528049:0:20577:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094064000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:068dab75-d300-4ead-a742-d14572ad1e50+11:1962:x1830948734011392:12345-192.168.202.4@tcp:1:lfs.0 Request processed in 21107us (21362us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129567.528058:0:20577:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15886 00000100:00100000:3.0:1746129567.548833:0:21725:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013575df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:1961:x1830948734011904:12345-192.168.202.4@tcp:4:multiop.0 Request processed in 29405us (33793us total) trans 21474841292 rc 0/0 00000100:00100000:3.0:1746129567.548846:0:21725:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2389 00002000:00100000:3.0:1746129567.548858:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ef:0x0] (3338240->3653631) req@ffff88013575df80 x1830948734011904/t21474841292(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:308/0 lens 488/448 e 0 to 0 dl 1746129578 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129567.548868:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013575df80 with x1830948734011904 ext(3338240->3653631) 00010000:00010000:3.0:1746129567.548879:0:21725:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800909cfe00/0x40a459093b06929e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3338240->3653631) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20963 expref: 21 pid: 22481 timeout: 922 lvb_type: 0 00010000:00010000:3.0:1746129567.548892:0:21725:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800909cfe00/0x40a459093b06929e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3338240->3653631) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20963 expref: 21 pid: 22481 timeout: 922 lvb_type: 0 00002000:00010000:3.0:1746129567.548898:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88013575df80 00000100:00100000:1.0:1746129567.548963:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094067100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+34:1962:x1830948734011520:12345-192.168.202.4@tcp:4:multiop.0 Request processed in 34205us (34937us total) trans 21474841293 rc 0/0 00000100:00100000:1.0:1746129567.548970:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2388 00002000:00100000:1.0:1746129567.548974:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ec:0x0] (4096->573439) req@ffff880094067100 x1830948734011520/t21474841293(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:308/0 lens 488/448 e 0 to 0 dl 1746129578 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129567.548981:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094067100 with x1830948734011520 ext(4096->573439) 00010000:00010000:1.0:1746129567.548986:0:25745:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800909cf000/0x40a459093b069266 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->573439) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20947 expref: 34 pid: 22481 timeout: 922 lvb_type: 0 00010000:00010000:1.0:1746129567.548998:0:25745:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800909cf000/0x40a459093b069266 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->573439) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20947 expref: 34 pid: 22481 timeout: 922 lvb_type: 0 00002000:00010000:1.0:1746129567.549004:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094067100 00000100:00100000:2.0:1746129567.554728:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129567.555137:0:7086:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734013440 00000100:00100000:0.0:1746129567.555148:0:7086:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734013440 00010000:00010000:0.0:1746129567.555190:0:7086:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800909cfe00/0x40a459093b06929e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3338240->3653631) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20963 expref: 21 pid: 22481 timeout: 922 lvb_type: 0 00000100:00100000:2.0:1746129567.556269:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129567.557316:0:7086:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734013568 00000100:00100000:0.0:1746129567.557327:0:7086:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734013568 00010000:00010000:0.0:1746129567.557378:0:7086:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800909cf000/0x40a459093b069266 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->573439) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20947 expref: 34 pid: 22481 timeout: 922 lvb_type: 0 00000100:00100000:0.0:1746129567.557406:0:7086:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8137 00000100:00100000:0.0:1746129567.557415:0:7086:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095627100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:1960:x1830948734013440:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129567.557432:0:7086:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129567.557462:0:7086:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800909cfe00/0x40a459093b06929e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3338240->3653631) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20963 expref: 21 pid: 22481 timeout: 922 lvb_type: 0 00010000:00010000:0.0:1746129567.557474:0:7086:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800909cfe00/0x40a459093b06929e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3338240->3653631) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20963 expref: 21 pid: 22481 timeout: 922 lvb_type: 0 00010000:00010000:0.0:1746129567.557498:0:7086:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800909cfe00/0x40a459093b06929e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3338240->3653631) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20963 expref: 21 pid: 22481 timeout: 922 lvb_type: 0 00010000:00010000:0.0:1746129567.557518:0:7086:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129567.557520:0:7086:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129567.557524:0:7086:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800909cfa00/0x40a459093b069354 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129567.557534:0:7086:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800909cfa00/0x40a459093b069354 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129567.557564:0:7086:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129567.557616:0:7086:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095627100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:1960:x1830948734013440:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 202us (2901us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129567.557623:0:7086:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8137 00000100:00100000:0.0:1746129567.557642:0:7086:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8138 00000100:00100000:0.0:1746129567.557646:0:7086:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6026450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ada2ffba-8920-4ecb-8068-68caa9806978+34:1963:x1830948734013568:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129567.557655:0:7086:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129567.557664:0:7086:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800909cf000/0x40a459093b069266 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4096->573439) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20947 expref: 34 pid: 22481 timeout: 922 lvb_type: 0 00010000:00010000:0.0:1746129567.557674:0:7086:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800909cf000/0x40a459093b069266 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4096->573439) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20947 expref: 34 pid: 22481 timeout: 922 lvb_type: 0 00010000:00010000:0.0:1746129567.557685:0:7086:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800909cf000/0x40a459093b069266 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4096->573439) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20947 expref: 34 pid: 22481 timeout: 922 lvb_type: 0 00010000:00010000:0.0:1746129567.557693:0:7086:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129567.557695:0:7086:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129567.557697:0:7086:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800955d2400/0x40a459093b069338 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129567.557703:0:7086:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800955d2400/0x40a459093b069338 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129567.557717:0:7086:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129567.557732:0:7086:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6026450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ada2ffba-8920-4ecb-8068-68caa9806978+33:1963:x1830948734013568:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 85us (1470us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129567.557737:0:7086:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8138 00010000:00010000:0.0:1746129567.557792:0:22480:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800955d2400/0x40a459093b069338 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129567.557801:0:22480:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800955d2400/0x40a459093b069338 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129567.557820:0:22480:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800955d2400/0x40a459093b069338 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129567.557826:0:22480:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800955d2400/0x40a459093b069338 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129567.557832:0:22480:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800955d2400/0x40a459093b069338 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129567.557838:0:22480:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800955d2400 already unused, calling callback (ffffffffa086ed70) 00010000:00010000:0.0:1746129567.557842:0:22480:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800955d2400/0x40a459093b069338 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129567.557849:0:22480:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800955d2400/0x40a459093b069338 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129567.557858:0:22480:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800955d2400/0x40a459093b069338 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129567.557863:0:22480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800955d2400/0x40a459093b069338 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129567.557900:0:22480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009507d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:068dab75-d300-4ead-a742-d14572ad1e50+12:1963:x1830948734010752:12345-192.168.202.4@tcp:1:lfs.0 Request processed in 51158us (51312us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129567.557909:0:22480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15881 00010000:00010000:3.0:1746129567.559270:0:4699:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800909cfa00/0x40a459093b069354 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129567.559281:0:4699:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800909cfa00/0x40a459093b069354 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129567.559323:0:4699:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800909cfa00/0x40a459093b069354 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129567.559334:0:4699:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800909cfa00/0x40a459093b069354 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129567.559340:0:4699:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800909cfa00/0x40a459093b069354 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129567.559355:0:4699:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800909cfa00 already unused, calling callback (ffffffffa086ed70) 00010000:00010000:3.0:1746129567.559359:0:4699:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800909cfa00/0x40a459093b069354 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129567.559366:0:4699:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800909cfa00/0x40a459093b069354 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129567.559377:0:4699:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800909cfa00/0x40a459093b069354 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129567.559383:0:4699:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800909cfa00/0x40a459093b069354 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129567.561380:0:4699:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094064700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:068dab75-d300-4ead-a742-d14572ad1e50+11:1963:x1830948734011264:12345-192.168.202.4@tcp:1:lfs.0 Request processed in 54431us (54712us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129567.561394:0:4699:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15885 00000100:00100000:0.0:1746129567.568072:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129567.568188:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734013824 00000100:00100000:1.0:1746129567.568198:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734013824 00000100:00100000:1.0:1746129567.568265:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11155 00000100:00100000:1.0:1746129567.568273:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094067480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:068dab75-d300-4ead-a742-d14572ad1e50+15:32164:x1830948734013824:12345-192.168.202.4@tcp:36:lfs.0 00010000:00010000:1.0:1746129567.568370:0:14549:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1746129567.568398:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800909ce000/0x40a459093b069307 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f209a2 expref: 15 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129567.568428:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a60b2600/0x40a459093b068c7e lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2053b expref: 14 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129567.568440:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009f469400) 00010000:00010000:1.0:1746129567.568448:0:14549:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746129567.568486:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d863800/0x40a459093b06935b lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129567.568498:0:14549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d106600/0x40a459093b068bc8 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.4@tcp remote: 0xda91008773f204a8 expref: 31 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129567.568505:0:14549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5a87a00/0x40a459093b068bcf lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f204af expref: 307 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129567.568511:0:14549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092f87600/0x40a459093b068c1c lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f204d9 expref: 31 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129567.568518:0:14549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ebb3000/0x40a459093b068e29 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2068b expref: 307 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129567.568524:0:14549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6cf6800/0x40a459093b068f2c lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20748 expref: 307 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129567.568530:0:14549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8d4400/0x40a459093b068f8e lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20772 expref: 31 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129567.568536:0:14549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d863800/0x40a459093b06935b lrc: 9/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129567.568566:0:14549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8d4400/0x40a459093b068f8e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20772 expref: 31 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129567.568577:0:14549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8d4400/0x40a459093b068f8e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20772 expref: 31 pid: 2271 timeout: 922 lvb_type: 0 00000100:00100000:1.0:1746129567.568591:0:14549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092fd0000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830948737469696:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129567.568690:0:14549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6cf6800/0x40a459093b068f2c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20748 expref: 307 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129567.568698:0:14549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6cf6800/0x40a459093b068f2c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20748 expref: 307 pid: 2271 timeout: 922 lvb_type: 0 00000100:00100000:1.0:1746129567.568706:0:14549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092fd0380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830948737469824:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129567.568741:0:14549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008ebb3000/0x40a459093b068e29 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2068b expref: 307 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129567.568748:0:14549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ebb3000/0x40a459093b068e29 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2068b expref: 307 pid: 2271 timeout: 922 lvb_type: 0 00000100:00100000:1.0:1746129567.568755:0:14549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092fd1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830948737469952:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129567.568775:0:14549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880092f87600/0x40a459093b068c1c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f204d9 expref: 31 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129567.568782:0:14549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880092f87600/0x40a459093b068c1c lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f204d9 expref: 31 pid: 2271 timeout: 922 lvb_type: 0 00000100:00100000:1.0:1746129567.568789:0:14549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092fd3100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830948737470080:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129567.568808:0:14549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5a87a00/0x40a459093b068bcf lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f204af expref: 307 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129567.568815:0:14549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5a87a00/0x40a459093b068bcf lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f204af expref: 307 pid: 14549 timeout: 922 lvb_type: 0 00000100:00100000:1.0:1746129567.568822:0:14549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092fd3480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830948737470208:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129567.568840:0:14549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009d106600/0x40a459093b068bc8 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f204a8 expref: 31 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129567.568846:0:14549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d106600/0x40a459093b068bc8 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f204a8 expref: 31 pid: 16908 timeout: 922 lvb_type: 0 00000100:00100000:1.0:1746129567.568853:0:14549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830948737470336:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129567.568868:0:14549:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c954b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746129567.572366:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129567.572389:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129567.572394:0:14549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092fd0000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830948737469696:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129567.572408:0:14549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092fd0380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830948737469824:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129567.572416:0:14549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092fd1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830948737469952:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129567.572423:0:14549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092fd3100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830948737470080:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129567.572472:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129567.572485:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129567.572505:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129567.572526:0:7086:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734013952 00000100:00100000:0.0:1746129567.572532:0:7086:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734013952 00010000:00010000:0.0:1746129567.572568:0:7086:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8d4400/0x40a459093b068f8e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20772 expref: 32 pid: 2271 timeout: 922 lvb_type: 0 00000100:00100000:0.0:1746129567.572590:0:7086:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734014336 00000100:00100000:0.0:1746129567.572592:0:7086:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734014336 00010000:00010000:0.0:1746129567.572600:0:7086:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092f87600/0x40a459093b068c1c lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f204d9 expref: 33 pid: 2271 timeout: 922 lvb_type: 0 00000100:00100000:0.0:1746129567.572654:0:7086:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734014080 00000100:00100000:0.0:1746129567.572657:0:7086:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734014080 00010000:00010000:0.0:1746129567.572666:0:7086:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6cf6800/0x40a459093b068f2c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20748 expref: 308 pid: 2271 timeout: 922 lvb_type: 0 00000100:00100000:2.0:1746129567.572674:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734014464 00000100:00100000:2.0:1746129567.572682:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734014464 00000100:00100000:3.0:1746129567.572692:0:20578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734014592 00000100:00100000:3.0:1746129567.572696:0:20578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734014592 00000100:00100000:3.0:1746129567.572708:0:7087:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8139 00000100:00100000:2.0:1746129567.572708:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4720 00000100:00100000:2.0:1746129567.572714:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094065f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ada2ffba-8920-4ecb-8068-68caa9806978+310:23750:x1830948734014464:12345-192.168.202.4@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1746129567.572715:0:7087:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094067800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+33:1963:x1830948734013952:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129567.572732:0:7087:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129567.572738:0:7087:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8d4400/0x40a459093b068f8e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20772 expref: 33 pid: 2271 timeout: 922 lvb_type: 0 00010000:00010000:3.0:1746129567.572748:0:7087:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8d4400/0x40a459093b068f8e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20772 expref: 33 pid: 2271 timeout: 922 lvb_type: 0 00010000:00010000:3.0:1746129567.572769:0:7087:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8d4400/0x40a459093b068f8e lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20772 expref: 33 pid: 2271 timeout: 922 lvb_type: 0 00010000:00010000:3.0:1746129567.572785:0:7087:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009f469400) 00010000:00010000:3.0:1746129567.572789:0:7087:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d863800/0x40a459093b06935b lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129567.572799:0:7087:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129567.572832:0:7086:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8140 00000100:00100000:1.0:1746129567.572836:0:14549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092fd3480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830948737470208:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129567.572837:0:7086:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094065500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+32:1963:x1830948734014336:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129567.572844:0:7086:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129567.572848:0:7086:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880092f87600/0x40a459093b068c1c lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f204d9 expref: 32 pid: 2271 timeout: 922 lvb_type: 0 00000100:00100000:1.0:1746129567.572860:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8141 00010000:00010000:0.0:1746129567.572860:0:7086:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880092f87600/0x40a459093b068c1c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f204d9 expref: 32 pid: 2271 timeout: 922 lvb_type: 0 00010000:00010000:0.0:1746129567.572870:0:7086:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092f87600/0x40a459093b068c1c lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f204d9 expref: 32 pid: 2271 timeout: 922 lvb_type: 0 00000100:00100000:1.0:1746129567.572871:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094066680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ada2ffba-8920-4ecb-8068-68caa9806978+310:1963:x1830948734014080:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129567.572879:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129567.572884:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6cf6800/0x40a459093b068f2c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20748 expref: 310 pid: 2271 timeout: 922 lvb_type: 0 00010000:00010000:0.0:1746129567.572884:0:7086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009f469400) 00010000:00010000:0.0:1746129567.572887:0:7086:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d863800/0x40a459093b06935b lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129567.572891:0:7086:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746129567.572894:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6cf6800/0x40a459093b068f2c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20748 expref: 310 pid: 2271 timeout: 922 lvb_type: 0 00000100:00100000:3.0:1746129567.572942:0:7087:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094067800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+31:1963:x1830948734013952:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 227us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129567.572948:0:7087:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8139 00010000:00010000:3.0:1746129567.572978:0:20578:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5a87a00/0x40a459093b068bcf lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f204af expref: 311 pid: 14549 timeout: 922 lvb_type: 0 00000100:00100000:3.0:1746129567.572992:0:7087:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8142 00000100:00100000:3.0:1746129567.572996:0:7087:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094065880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ada2ffba-8920-4ecb-8068-68caa9806978+311:1963:x1830948734014592:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129567.573003:0:7087:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129567.573006:0:7087:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5a87a00/0x40a459093b068bcf lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f204af expref: 311 pid: 14549 timeout: 922 lvb_type: 0 00010000:00010000:1.0:1746129567.573032:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6cf6800/0x40a459093b068f2c lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20748 expref: 311 pid: 2271 timeout: 922 lvb_type: 0 00000100:00100000:0.0:1746129567.573037:0:7086:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094065500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+30:1963:x1830948734014336:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 199us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129567.573042:0:7086:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8140 00000100:00100000:0.0:1746129567.573177:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129567.573206:0:7086:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734014720 00000100:00100000:0.0:1746129567.573209:0:7086:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734014720 00010000:00010000:0.0:1746129567.573218:0:7086:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d106600/0x40a459093b068bc8 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f204a8 expref: 30 pid: 16908 timeout: 922 lvb_type: 0 00000100:00100000:0.0:1746129567.573228:0:7086:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8143 00000100:00100000:0.0:1746129567.573233:0:7086:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094066d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+30:1963:x1830948734014720:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129567.573239:0:7086:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129567.573243:0:7086:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009d106600/0x40a459093b068bc8 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f204a8 expref: 30 pid: 16908 timeout: 922 lvb_type: 0 00010000:00010000:3.0:1746129567.573362:0:7087:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5a87a00/0x40a459093b068bcf lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f204af expref: 310 pid: 14549 timeout: 922 lvb_type: 0 00010000:00010000:3.0:1746129567.573375:0:7087:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5a87a00/0x40a459093b068bcf lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f204af expref: 310 pid: 14549 timeout: 922 lvb_type: 0 00010000:00010000:3.0:1746129567.573384:0:7087:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009f469400) 00010000:00010000:3.0:1746129567.573386:0:7087:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d863800/0x40a459093b06935b lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129567.573392:0:7087:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129567.573397:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094065f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ada2ffba-8920-4ecb-8068-68caa9806978+309:23750:x1830948734014464:12345-192.168.202.4@tcp:35:ldlm_bl.0 Request processed in 681us (1054us total) trans 8589945238 rc 0/0 00000100:00100000:2.0:1746129567.573403:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4720 00000100:00100000:3.0:1746129567.573407:0:7087:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094065880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ada2ffba-8920-4ecb-8068-68caa9806978+309:1963:x1830948734014592:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 410us (901us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129567.573413:0:7087:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8142 00010000:00010000:1.0:1746129567.573514:0:9823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009f469400) 00010000:00010000:1.0:1746129567.573519:0:9823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d863800/0x40a459093b06935b lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129567.573524:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746129567.573593:0:7086:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009d106600/0x40a459093b068bc8 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f204a8 expref: 30 pid: 16908 timeout: 922 lvb_type: 0 00010000:00010000:0.0:1746129567.573604:0:7086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009f469400) 00010000:00010000:0.0:1746129567.573607:0:7086:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d863800/0x40a459093b06935b lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129567.573612:0:7086:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129567.573654:0:7086:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094066d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+30:1963:x1830948734014720:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 420us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129567.573655:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094066680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ada2ffba-8920-4ecb-8068-68caa9806978+307:1963:x1830948734014080:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 783us (1167us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129567.573659:0:7086:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8143 00000100:00100000:1.0:1746129567.573665:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8141 00010000:00010000:1.0:1746129567.573689:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d106600/0x40a459093b068bc8 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f204a8 expref: 29 pid: 16908 timeout: 922 lvb_type: 0 00000100:00100000:1.0:1746129567.573699:0:14549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830948737470336:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129567.573727:0:14549:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012d863800/0x40a459093b06935b lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000100:00100000:0.0:1746129567.576534:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129567.576711:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734014848 00000100:00100000:1.0:1746129567.576722:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734014848 00010000:00010000:1.0:1746129567.576761:0:9823:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ebb3000/0x40a459093b068e29 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2068b expref: 307 pid: 2271 timeout: 922 lvb_type: 0 00000100:00100000:1.0:1746129567.576801:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8144 00000100:00100000:1.0:1746129567.576809:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094065180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ada2ffba-8920-4ecb-8068-68caa9806978+307:1960:x1830948734014848:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129567.576824:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129567.576829:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008ebb3000/0x40a459093b068e29 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2068b expref: 307 pid: 2271 timeout: 922 lvb_type: 0 00010000:00010000:1.0:1746129567.576841:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008ebb3000/0x40a459093b068e29 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2068b expref: 307 pid: 2271 timeout: 922 lvb_type: 0 00010000:00010000:1.0:1746129567.576859:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ebb3000/0x40a459093b068e29 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2068b expref: 307 pid: 2271 timeout: 922 lvb_type: 0 00010000:00010000:1.0:1746129567.576874:0:9823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009f469400) 00010000:00010000:1.0:1746129567.576879:0:9823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d863800/0x40a459093b06935b lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129567.576889:0:9823:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d863800/0x40a459093b06935b lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129567.576895:0:9823:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d863800/0x40a459093b06935b lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129567.576929:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129567.576971:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094065180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ada2ffba-8920-4ecb-8068-68caa9806978+306:1960:x1830948734014848:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 164us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129567.576977:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8144 00010000:00010000:2.0:1746129567.577059:0:14549:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012d863800/0x40a459093b06935b lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129567.577068:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d863800/0x40a459093b06935b lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000040:00080000:2.0:1746129567.578156:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3418, 88 off287512 00000004:00080000:2.0:1746129567.578167:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 822894872474ns, next at 776349687452ns, rc = 0 00000040:00080000:2.0:1746129567.578224:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3436, 88 off289008 00000004:00080000:2.0:1746129567.578229:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 822894934852ns, next at 776375382381ns, rc = 0 00000040:00080000:2.0:1746129567.578247:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3437, 88 off289096 00000004:00080000:2.0:1746129567.578250:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 822894955791ns, next at 776375382381ns, rc = 0 00000040:00080000:2.0:1746129567.578256:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3419, 88 off287600 00000004:00080000:2.0:1746129567.578259:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 822894965056ns, next at 776349687452ns, rc = 0 00000040:00080000:2.0:1746129567.578266:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3420, 88 off287688 00000004:00080000:2.0:1746129567.578268:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 822894974406ns, next at 776349687452ns, rc = 0 00000040:00080000:2.0:1746129567.578273:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3438, 88 off289184 00000004:00080000:2.0:1746129567.578276:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 822894982001ns, next at 776375382381ns, rc = 0 00000040:00080000:2.0:1746129567.578281:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3439, 88 off289272 00000004:00080000:2.0:1746129567.578283:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 822894989255ns, next at 776375382381ns, rc = 0 00000040:00080000:2.0:1746129567.578288:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3440, 88 off289360 00000004:00080000:2.0:1746129567.578290:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 822894996652ns, next at 776375382381ns, rc = 0 00000040:00080000:2.0:1746129567.578312:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3421, 88 off287776 00000004:00080000:2.0:1746129567.578314:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 822895020306ns, next at 776349687452ns, rc = 0 00000040:00080000:2.0:1746129567.578338:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3441, 88 off289448 00000004:00080000:2.0:1746129567.578341:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 822895046837ns, next at 776375382381ns, rc = 0 00000040:00080000:2.0:1746129567.578369:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3422, 88 off287864 00000004:00080000:2.0:1746129567.578371:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 822895077585ns, next at 776349687452ns, rc = 0 00000040:00080000:2.0:1746129567.578377:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3442, 88 off289536 00000004:00080000:2.0:1746129567.578382:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 822895088051ns, next at 776375382381ns, rc = 0 00000040:00080000:2.0:1746129567.578389:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3423, 88 off287952 00000004:00080000:2.0:1746129567.578391:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 822895097394ns, next at 776349687452ns, rc = 0 00000040:00080000:2.0:1746129567.578399:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3424, 88 off288040 00000004:00080000:2.0:1746129567.578401:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 822895107292ns, next at 776349687452ns, rc = 0 00000040:00080000:2.0:1746129567.578411:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3425, 88 off288128 00000004:00080000:2.0:1746129567.578414:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 822895120555ns, next at 776349687452ns, rc = 0 00000040:00080000:2.0:1746129567.578421:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3426, 88 off288216 00000004:00080000:2.0:1746129567.578423:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 822895129641ns, next at 776349687452ns, rc = 0 00000040:00080000:2.0:1746129567.578430:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3443, 88 off289624 00000004:00080000:2.0:1746129567.578432:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 822895138324ns, next at 776375382381ns, rc = 0 00000004:00010000:0.0:1746129567.611760:0:14549:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880094067480 reply state ffff88012b874000 transno 8589945239 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d863800/0x40a459093b06935b lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000100:00100000:0.0:1746129567.611780:0:14549:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1746129567.611957:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094067480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:068dab75-d300-4ead-a742-d14572ad1e50+15:32164:x1830948734013824:12345-192.168.202.4@tcp:36:lfs.0 Request processed in 43675us (43888us total) trans 8589945239 rc 0/0 00000100:00100000:0.0:1746129567.611967:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11155 00000001:00080000:0.0:1746129567.612017:0:14619:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945230 is committed 00000001:00080000:0.0:1746129567.612049:0:14619:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945235 is committed 00000001:00080000:0.0:1746129567.612055:0:14619:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945231 is committed 00000001:00080000:0.0:1746129567.612925:0:14619:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945239 is committed 00000004:00080000:0.0:1746129567.612933:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2613 committed 00010000:00010000:3.0:1746129567.612976:0:3287:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d863800/0x40a459093b06935b lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129567.612986:0:3287:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d863800/0x40a459093b06935b lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129567.612995:0:3287:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d863800/0x40a459093b06935b lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129567.613001:0:3287:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d863800 already unused, calling callback (ffffffffa136e690) 00010000:00010000:3.0:1746129567.613006:0:3287:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d863800/0x40a459093b06935b lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129567.613014:0:3287:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d863800/0x40a459093b06935b lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129567.613032:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009f469400) 00010000:00010000:3.0:1746129567.613035:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746129567.613041:0:3287:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d863800/0x40a459093b06935b lrc: 2/0,0 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129567.613047:0:3287:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d863800/0x40a459093b06935b lrc: 0/0,0 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00000004:00080000:0.0:1746129567.613125:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2596 committed 00000004:00080000:0.0:1746129567.613133:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2595 committed 00000004:00080000:0.0:1746129567.613135:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2594 committed 00000004:00080000:0.0:1746129567.613136:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2593 committed 00000004:00080000:0.0:1746129567.613138:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2612 committed 00000004:00080000:0.0:1746129567.613140:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2592 committed 00000004:00080000:0.0:1746129567.613143:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2611 committed 00000004:00080000:0.0:1746129567.613145:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2591 committed 00000004:00080000:0.0:1746129567.613147:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2610 committed 00000004:00080000:0.0:1746129567.613148:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2609 committed 00000004:00080000:0.0:1746129567.613149:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2608 committed 00000004:00080000:0.0:1746129567.613151:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2590 committed 00000004:00080000:0.0:1746129567.613152:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2589 committed 00000004:00080000:0.0:1746129567.613153:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2607 committed 00000004:00080000:0.0:1746129567.613154:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2606 committed 00000004:00080000:0.0:1746129567.613156:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2588 committed 00000001:00080000:0.0:1746129567.613165:0:14619:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945238 is committed 00000001:00080000:0.0:1746129567.613174:0:14619:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945234 is committed 00000100:00100000:1.0:1746129567.613357:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737470464:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129567.613412:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737470848:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129567.613430:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129567.613459:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129567.613490:0:22480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737470464 00000100:00100000:1.0:1746129567.613493:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737470976:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129567.613498:0:22480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737470464 00000100:00100000:1.0:1746129567.613511:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129567.613526:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092fd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737471488:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129567.613538:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129567.613545:0:22480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737470848 00000100:00100000:0.0:1746129567.613547:0:22480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737470848 00000100:00100000:1.0:1746129567.613554:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ceed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737472000:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129567.613562:0:22480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737470976 00000100:00100000:0.0:1746129567.613564:0:22480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737470976 00000100:00100000:1.0:1746129567.613569:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129567.613950:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1830948737470720:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129567.614745:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737470592:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129567.616792:0:22480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737471488 00000100:00100000:2.0:1746129567.616813:0:8412:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737472000 00000100:00100000:0.0:1746129567.616813:0:22480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737471488 00000100:00100000:2.0:1746129567.616819:0:8412:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737472000 00000100:00100000:0.0:1746129567.616862:0:22480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15887 00000100:00100000:0.0:1746129567.616871:0:22480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092fd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+32:3301:x1830948737470464:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129567.616890:0:4699:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15888 00000100:00100000:3.0:1746129567.616899:0:4699:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+32:3300:x1830948737470848:12345-0@lo:2:osp-syn-1-0.0 00000100:00080000:0.0:1746129567.616949:0:7097:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1746129567.616952:0:7097:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746129567.616996:0:8412:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15889 00000100:00100000:2.0:1746129567.617002:0:8412:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092fd0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+32:3301:x1830948737470976:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129567.617189:0:8412:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092fd0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+33:3301:x1830948737470976:12345-0@lo:2:osp-syn-1-0.0 Request processed in 187us (3676us total) trans 17179874053 rc 0/0 00000100:00100000:2.0:1746129567.617196:0:8412:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15889 00000100:00100000:2.0:1746129567.617213:0:8412:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15890 00000100:00100000:2.0:1746129567.617217:0:8412:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092fd0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+32:3301:x1830948737471488:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746129567.617452:0:4699:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746129567.617455:0:4699:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb mtime from disk: 1746129523 -> 1746129523 00002000:00010000:3.0:1746129567.617457:0:4699:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb atime from disk: 1746129523 -> 1746129523 00002000:00010000:3.0:1746129567.617459:0:4699:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb ctime from disk: 1746129524 -> 1746129524 00002000:00010000:3.0:1746129567.617461:0:4699:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1746129567.617483:0:4699:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+34:3300:x1830948737470848:12345-0@lo:2:osp-syn-1-0.0 Request processed in 586us (4024us total) trans 17179874055 rc 0/0 00000100:00100000:3.0:1746129567.617487:0:4699:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15888 00000100:00100000:3.0:1746129567.617496:0:4699:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15891 00000100:00100000:3.0:1746129567.617500:0:4699:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094efce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+32:3301:x1830948737472000:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129567.617591:0:4699:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094efce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+33:3301:x1830948737472000:12345-0@lo:2:osp-syn-0-0.0 Request processed in 91us (4021us total) trans 21474841294 rc 0/0 00000100:00100000:3.0:1746129567.617596:0:4699:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15891 00000100:00100000:3.0:1746129567.617621:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129567.617656:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1830948737471232:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129567.617679:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129567.617687:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f959500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1830948737471744:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129567.617702:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129567.617714:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012baefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1830948737472256:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129567.617725:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129567.617748:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737470720 00000100:00100000:3.0:1746129567.617751:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737470720 00000100:00100000:3.0:1746129567.617762:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737471232 00000100:00100000:3.0:1746129567.617764:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737471232 00000100:00100000:3.0:1746129567.617769:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737471744 00000100:00100000:3.0:1746129567.617770:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737471744 00000100:00100000:3.0:1746129567.617775:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737472256 00000100:00100000:3.0:1746129567.617777:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737472256 00000100:00100000:3.0:1746129567.617784:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15892 00000100:00100000:3.0:1746129567.617787:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135724000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+35:3303:x1830948737470720:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129567.617883:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135724000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+36:3303:x1830948737470720:12345-0@lo:2:osp-syn-1-0.0 Request processed in 95us (262us total) trans 17179874056 rc 0/0 00000100:00100000:3.0:1746129567.617888:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15892 00000100:00100000:3.0:1746129567.617896:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15893 00000100:00100000:3.0:1746129567.617899:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135724e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+35:3303:x1830948737471232:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129567.617959:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135724e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+36:3303:x1830948737471232:12345-0@lo:2:osp-syn-1-0.0 Request processed in 59us (279us total) trans 17179874057 rc 0/0 00000100:00100000:3.0:1746129567.617964:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15893 00000100:00100000:3.0:1746129567.617970:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15894 00000100:00100000:3.0:1746129567.617973:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135725f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+34:3303:x1830948737471744:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129567.618039:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135725f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+35:3303:x1830948737471744:12345-0@lo:2:osp-syn-0-0.0 Request processed in 65us (336us total) trans 21474841295 rc 0/0 00000100:00100000:3.0:1746129567.618044:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15894 00000100:00100000:3.0:1746129567.618050:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15895 00000100:00100000:3.0:1746129567.618053:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135724a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+34:3303:x1830948737472256:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746129567.618105:0:4385:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746129567.618108:0:4385:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1746129567.618109:0:4385:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746129567.618111:0:4385:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1746129567.618113:0:4385:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1746129567.618124:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135724a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+35:3303:x1830948737472256:12345-0@lo:2:osp-syn-0-0.0 Request processed in 71us (398us total) trans 21474841296 rc 0/0 00000100:00100000:3.0:1746129567.618128:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15895 00000004:00080000:3.0:1746129567.618155:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800947bfb80/2, rc 0, transno 17179874056 00000100:00100000:3.0:1746129567.618160:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1830948737470720:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746129567.618165:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800947be300/2, rc 0, transno 17179874057 00000100:00100000:3.0:1746129567.618168:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1830948737471232:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746129567.618174:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f959500/2, rc 0, transno 21474841295 00000100:00100000:3.0:1746129567.618181:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f959500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1830948737471744:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746129567.618186:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012baefb80/2, rc 0, transno 21474841296 00000100:00100000:3.0:1746129567.618188:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012baefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1830948737472256:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129567.618323:0:22480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092fd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+36:3301:x1830948737470464:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1453us (4893us total) trans 17179874058 rc 0/0 00000100:00100000:3.0:1746129567.618328:0:22480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15887 00000100:00100000:2.0:1746129567.618412:0:8412:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092fd0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+35:3301:x1830948737471488:12345-0@lo:2:osp-syn-1-0.0 Request processed in 74us (3751us total) trans 17179874054 rc 0/0 00000100:00100000:2.0:1746129567.618418:0:8412:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15890 00000004:00080000:1.0:1746129567.618538:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093ceed80/2, rc 0, transno 21474841294 00000100:00100000:1.0:1746129567.618542:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ceed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737472000:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746129567.618550:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800947bce00/2, rc 0, transno 17179874058 00000100:00100000:1.0:1746129567.618552:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737470464:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746129567.618558:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800947bd880/2, rc 0, transno 17179874053 00000100:00100000:1.0:1746129567.618561:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737470976:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746129567.618567:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092fd3100/2, rc 0, transno 17179874054 00000100:00100000:1.0:1746129567.618569:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092fd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737471488:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129567.618576:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a07ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737472512:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129567.618595:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129567.618617:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737472512 00000100:00100000:1.0:1746129567.618620:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737472512 00000100:00100000:1.0:1746129567.618642:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15896 00000100:00100000:1.0:1746129567.618647:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094efed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+35:3301:x1830948737472512:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129567.618734:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094efed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+36:3301:x1830948737472512:12345-0@lo:2:osp-syn-0-0.0 Request processed in 86us (137us total) trans 21474841297 rc 0/0 00000100:00100000:1.0:1746129567.618739:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15896 00000004:00080000:1.0:1746129567.618755:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a07ae300/2, rc 0, transno 21474841297 00000100:00100000:1.0:1746129567.618758:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a07ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737472512:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129567.618774:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129567.618790:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f95b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737471104:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129567.618805:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129567.618814:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f95bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737471616:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129567.618826:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129567.618834:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ced880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737472128:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129567.618847:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129567.618864:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737470592 00000100:00100000:1.0:1746129567.618866:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737470592 00000100:00100000:1.0:1746129567.618876:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737471104 00000100:00100000:1.0:1746129567.618878:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737471104 00000100:00100000:1.0:1746129567.618885:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737471616 00000100:00100000:1.0:1746129567.618887:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737471616 00000100:00100000:1.0:1746129567.618895:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737472128 00000100:00100000:1.0:1746129567.618896:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737472128 00000100:00100000:1.0:1746129567.618904:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15897 00000100:00100000:1.0:1746129567.618907:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+35:3302:x1830948737470592:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129567.618993:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+36:3302:x1830948737470592:12345-0@lo:2:osp-syn-1-0.0 Request processed in 84us (218us total) trans 17179874059 rc 0/0 00000100:00100000:1.0:1746129567.618997:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15897 00000100:00100000:1.0:1746129567.619006:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15898 00000100:00100000:1.0:1746129567.619010:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094efca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+38:3302:x1830948737471104:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129567.619089:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094efca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+39:3302:x1830948737471104:12345-0@lo:2:osp-syn-0-0.0 Request processed in 79us (283us total) trans 21474841298 rc 0/0 00000100:00100000:1.0:1746129567.619094:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15898 00000100:00100000:1.0:1746129567.619102:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15899 00000100:00100000:1.0:1746129567.619105:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094efdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+38:3302:x1830948737471616:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129567.619176:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094efdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+39:3302:x1830948737471616:12345-0@lo:2:osp-syn-0-0.0 Request processed in 71us (349us total) trans 21474841299 rc 0/0 00000100:00100000:1.0:1746129567.619181:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15899 00000100:00100000:1.0:1746129567.619188:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15900 00000100:00100000:1.0:1746129567.619192:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b553b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+38:3302:x1830948737472128:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129567.619256:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b553b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+39:3302:x1830948737472128:12345-0@lo:2:osp-syn-0-0.0 Request processed in 63us (407us total) trans 21474841300 rc 0/0 00000100:00100000:1.0:1746129567.619261:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15900 00000004:00080000:1.0:1746129567.619278:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800947bf480/2, rc 0, transno 17179874059 00000100:00100000:1.0:1746129567.619281:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737470592:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746129567.619286:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f95b480/2, rc 0, transno 21474841298 00000100:00100000:1.0:1746129567.619289:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f95b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737471104:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746129567.619319:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f95bb80/2, rc 0, transno 21474841299 00000100:00100000:1.0:1746129567.619322:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f95bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737471616:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746129567.619327:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093ced880/2, rc 0, transno 21474841300 00000100:00100000:1.0:1746129567.619329:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ced880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737472128:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129567.619622:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800947bd180/2, rc 0, transno 17179874055 00000100:00100000:0.0:1746129567.619629:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737470848:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129567.619637:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092fd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737471360:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129567.619669:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129567.619708:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880132c25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737471872:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129567.619727:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129567.619743:0:8412:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737471360 00000100:00100000:0.0:1746129567.619745:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012baec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737472384:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129567.619748:0:8412:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737471360 00000100:00100000:0.0:1746129567.619759:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129567.619769:0:8412:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737471872 00000100:00100000:2.0:1746129567.619770:0:8412:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737471872 00000100:00100000:2.0:1746129567.619778:0:8412:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737472384 00000100:00100000:2.0:1746129567.619779:0:8412:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737472384 00000100:00100000:0.0:1746129567.619786:0:20577:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15901 00000100:00100000:0.0:1746129567.619793:0:20577:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+36:3300:x1830948737471360:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129567.619803:0:8412:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15902 00000100:00100000:2.0:1746129567.619809:0:8412:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+40:3300:x1830948737471872:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129567.619911:0:8412:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+41:3300:x1830948737471872:12345-0@lo:2:osp-syn-0-0.0 Request processed in 102us (182us total) trans 21474841301 rc 0/0 00000100:00100000:0.0:1746129567.619913:0:20577:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+37:3300:x1830948737471360:12345-0@lo:2:osp-syn-1-0.0 Request processed in 120us (243us total) trans 17179874060 rc 0/0 00000100:00100000:2.0:1746129567.619916:0:8412:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15902 00000100:00100000:0.0:1746129567.619919:0:20577:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15901 00000100:00100000:2.0:1746129567.619926:0:8412:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15903 00000100:00100000:2.0:1746129567.619930:0:8412:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+40:3300:x1830948737472384:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129567.619942:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092fd3480/2, rc 0, transno 17179874060 00000100:00100000:0.0:1746129567.619945:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092fd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737471360:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129567.619953:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880132c25180/2, rc 0, transno 21474841301 00000100:00100000:0.0:1746129567.619956:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880132c25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737471872:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129567.620022:0:8412:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+41:3300:x1830948737472384:12345-0@lo:2:osp-syn-0-0.0 Request processed in 91us (261us total) trans 21474841302 rc 0/0 00000100:00100000:2.0:1746129567.620027:0:8412:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15903 00000004:00080000:0.0:1746129567.620045:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012baec700/2, rc 0, transno 21474841302 00000100:00100000:0.0:1746129567.620049:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012baec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737472384:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129567.620288:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129567.620379:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734014976 00000100:00100000:0.0:1746129567.620383:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734014976 00000100:00100000:0.0:1746129567.620421:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11156 00000100:00100000:0.0:1746129567.620427:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b550380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:068dab75-d300-4ead-a742-d14572ad1e50+7:32164:x1830948734014976:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:0.0:1746129567.620446:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129567.620467:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800955d2600/0x40a459093b069362 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f209be expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129567.620526:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800955d2600/0x40a459093b069362 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f209be expref: 8 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129567.620548:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800955d2600/0x40a459093b069362 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f209be expref: 8 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129567.620569:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009f469400) 00010000:00010000:0.0:1746129567.620572:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746129567.620575:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800955d2600, rc 0) 00000100:00100000:0.0:1746129567.620628:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b550380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:068dab75-d300-4ead-a742-d14572ad1e50+8:32164:x1830948734014976:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 200us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129567.620633:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11156 00000100:00100000:0.0:1746129567.623504:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129567.624327:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734015104 00000100:00100000:0.0:1746129567.624337:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734015104 00000100:00100000:0.0:1746129567.624399:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11157 00000100:00100000:0.0:1746129567.624408:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:068dab75-d300-4ead-a742-d14572ad1e50+8:32164:x1830948734015104:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:0.0:1746129567.624427:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129567.624445:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800955d2e00/0x40a459093b069369 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f209c5 expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129567.624526:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800955d2800/0x40a459093b069370 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129567.624539:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800955d2800/0x40a459093b069370 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129567.624550:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800955d2800/0x40a459093b069370 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00200000:0.0:1746129567.624575:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00000004:00200000:0.0:1746129567.624580:0:14549:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746129567.624593:0:14549:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800955d2800/0x40a459093b069370 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129567.624616:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800955d2e00/0x40a459093b069369 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f209c5 expref: 10 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129567.624630:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800955d2800/0x40a459093b069370 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f209c5 expref: 9 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129567.624637:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009f469400) 00010000:00010000:0.0:1746129567.624640:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746129567.624643:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800955d2800, rc 0) 00000100:00100000:0.0:1746129567.624700:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:068dab75-d300-4ead-a742-d14572ad1e50+9:32164:x1830948734015104:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 293us (1206us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129567.624707:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11157 00000100:00100000:0.0:1746129567.630387:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129567.630416:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129567.630434:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129567.630459:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129567.630471:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129567.630545:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129567.630572:0:22481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734015232 00000100:00100000:0.0:1746129567.630581:0:22481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734015232 00000100:00100000:0.0:1746129567.630615:0:22481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734015360 00000100:00100000:0.0:1746129567.630617:0:22481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734015360 00000100:00100000:0.0:1746129567.630625:0:22481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734015488 00000100:00100000:0.0:1746129567.630626:0:22481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734015488 00000100:00100000:0.0:1746129567.630634:0:22481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734015616 00000100:00100000:0.0:1746129567.630635:0:22481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734015616 00000100:00100000:0.0:1746129567.630644:0:22481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734015744 00000100:00100000:0.0:1746129567.630646:0:22481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734015744 00000100:00100000:0.0:1746129567.630654:0:22481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734015872 00000100:00100000:0.0:1746129567.630656:0:22481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734015872 00000100:00100000:0.0:1746129567.630670:0:22481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15904 00000100:00100000:0.0:1746129567.630677:0:22481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baeed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:068dab75-d300-4ead-a742-d14572ad1e50+13:1963:x1830948734015232:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:0.0:1746129567.630698:0:22481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129567.630719:0:22481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009584ee00/0x40a459093b069377 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f209cc expref: -99 pid: 22481 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746129567.630746:0:22481:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3ec:0x0] initial LVB size: 1048576, mtime: 0x6813d2a0, atime: 0x6813d29f, ctime: 0x6813d2a0, blocks: 0x7bd 00010000:00010000:0.0:1746129567.630767:0:22481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129567.630769:0:22481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129567.630778:0:22481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009584ee00/0x40a459093b069377 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f209cc expref: 14 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129567.630793:0:22481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009584ee00/0x40a459093b069377 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f209cc expref: 14 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129567.630804:0:22481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009584ee00, rc 0) 00000100:00100000:0.0:1746129567.630851:0:22481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baeed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:068dab75-d300-4ead-a742-d14572ad1e50+14:1963:x1830948734015232:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 174us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129567.630856:0:22481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15904 00000100:00100000:0.0:1746129567.630875:0:22481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15905 00000100:00100000:0.0:1746129567.630879:0:22481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:068dab75-d300-4ead-a742-d14572ad1e50+13:1963:x1830948734015360:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:0.0:1746129567.630886:0:22481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129567.630897:0:22481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800955d2400/0x40a459093b06937e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f209d3 expref: -99 pid: 22481 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746129567.630916:0:22481:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3f3:0x0] initial LVB size: 2097152, mtime: 0x6813d29f, atime: 0x6813d29f, ctime: 0x6813d29f, blocks: 0x821 00010000:00010000:0.0:1746129567.630924:0:22481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129567.630925:0:22481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129567.630928:0:22481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800955d2400/0x40a459093b06937e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f209d3 expref: 14 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129567.630937:0:22481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800955d2400/0x40a459093b06937e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f209d3 expref: 14 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129567.630943:0:22481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800955d2400, rc 0) 00000100:00100000:0.0:1746129567.630959:0:22481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:068dab75-d300-4ead-a742-d14572ad1e50+14:1963:x1830948734015360:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 79us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129567.630963:0:22481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15905 00000100:00100000:0.0:1746129567.630974:0:22481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15906 00000100:00100000:0.0:1746129567.630978:0:22481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:068dab75-d300-4ead-a742-d14572ad1e50+13:1963:x1830948734015488:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:0.0:1746129567.630982:0:22481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129567.630989:0:22481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800955d3400/0x40a459093b069385 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f209da expref: -99 pid: 22481 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746129567.630998:0:22481:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3f4:0x0] initial LVB size: 2097152, mtime: 0x6813d29f, atime: 0x6813d29f, ctime: 0x6813d29f, blocks: 0x821 00010000:00010000:0.0:1746129567.631004:0:22481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129567.631005:0:22481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129567.631009:0:22481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800955d3400/0x40a459093b069385 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f209da expref: 14 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129567.631021:0:22481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800955d3400/0x40a459093b069385 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f209da expref: 14 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129567.631027:0:22481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800955d3400, rc 0) 00000100:00100000:0.0:1746129567.631043:0:22481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:068dab75-d300-4ead-a742-d14572ad1e50+14:1963:x1830948734015488:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 65us (608us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129567.631048:0:22481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15906 00000100:00100000:0.0:1746129567.631058:0:22481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15907 00000100:00100000:0.0:1746129567.631062:0:22481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:068dab75-d300-4ead-a742-d14572ad1e50+13:1963:x1830948734015616:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:0.0:1746129567.631067:0:22481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129567.631076:0:22481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800955d2a00/0x40a459093b06938c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f209e1 expref: -99 pid: 22481 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746129567.631086:0:22481:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3ee:0x0] initial LVB size: 2097152, mtime: 0x6813d29f, atime: 0x6813d29f, ctime: 0x6813d29f, blocks: 0x81f 00010000:00010000:0.0:1746129567.631093:0:22481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129567.631094:0:22481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129567.631097:0:22481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800955d2a00/0x40a459093b06938c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f209e1 expref: 14 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129567.631105:0:22481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800955d2a00/0x40a459093b06938c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f209e1 expref: 14 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129567.631111:0:22481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800955d2a00, rc 0) 00000100:00100000:0.0:1746129567.631127:0:22481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:068dab75-d300-4ead-a742-d14572ad1e50+14:1963:x1830948734015616:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 65us (667us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129567.631135:0:22481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15907 00000100:00100000:0.0:1746129567.631145:0:22481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15908 00000100:00100000:0.0:1746129567.631150:0:22481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:068dab75-d300-4ead-a742-d14572ad1e50+13:1963:x1830948734015744:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:0.0:1746129567.631155:0:22481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129567.631162:0:22481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5a87a00/0x40a459093b069393 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f209e8 expref: -99 pid: 22481 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746129567.631172:0:22481:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3ef:0x0] initial LVB size: 5146336, mtime: 0x6813d2a0, atime: 0x6813d29f, ctime: 0x6813d2a0, blocks: 0x1791 00010000:00010000:0.0:1746129567.631179:0:22481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129567.631180:0:22481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129567.631183:0:22481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5a87a00/0x40a459093b069393 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f209e8 expref: 14 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129567.631191:0:22481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5a87a00/0x40a459093b069393 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f209e8 expref: 14 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129567.631198:0:22481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5a87a00, rc 0) 00000100:00100000:0.0:1746129567.631215:0:22481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:068dab75-d300-4ead-a742-d14572ad1e50+14:1963:x1830948734015744:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 65us (743us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129567.631221:0:22481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15908 00000100:00100000:0.0:1746129567.631230:0:22481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15909 00000100:00100000:0.0:1746129567.631234:0:22481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bf7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:068dab75-d300-4ead-a742-d14572ad1e50+13:1963:x1830948734015872:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:0.0:1746129567.631239:0:22481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129567.631245:0:22481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5a87600/0x40a459093b06939a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f209ef expref: -99 pid: 22481 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746129567.631262:0:22481:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3f5:0x0] initial LVB size: 4194304, mtime: 0x6813d29f, atime: 0x6813d29f, ctime: 0x6813d29f, blocks: 0x1029 00010000:00010000:0.0:1746129567.631271:0:22481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129567.631272:0:22481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129567.631275:0:22481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5a87600/0x40a459093b06939a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f209ef expref: 14 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129567.631284:0:22481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5a87600/0x40a459093b06939a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f209ef expref: 14 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129567.631291:0:22481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5a87600, rc 0) 00000100:00100000:0.0:1746129567.631328:0:22481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bf7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:068dab75-d300-4ead-a742-d14572ad1e50+14:1963:x1830948734015872:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 94us (783us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129567.631333:0:22481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15909 00000100:00100000:0.0:1746129567.639136:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129567.639202:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734016128 00000100:00100000:1.0:1746129567.639212:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734016128 00000100:00100000:1.0:1746129567.640146:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7645 00000100:00100000:1.0:1746129567.640157:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:068dab75-d300-4ead-a742-d14572ad1e50+14:1961:x1830948734016128:12345-192.168.202.4@tcp:3:lfs.0 00010000:00010000:1.0:1746129567.640196:0:25745:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012c16a000/0x40a459093b0693a1 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25745 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129567.640210:0:25745:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129567.640212:0:25745:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129567.640217:0:25745:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c16a000/0x40a459093b0693a1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25745 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129567.640230:0:25745:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c16a000/0x40a459093b0693a1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25745 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129567.649141:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129567.656281:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129567.656403:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129567.656955:0:31522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734016384 00000100:00100000:0.0:1746129567.656965:0:31522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734016384 00000100:00100000:0.0:1746129567.657556:0:31522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734016640 00000100:00100000:0.0:1746129567.657560:0:31522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734016640 00000100:00100000:3.0:1746129567.657610:0:21725:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734016896 00000100:00100000:3.0:1746129567.657614:0:21725:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734016896 00000100:00100000:3.0:1746129567.657639:0:21725:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7646 00000100:00100000:3.0:1746129567.657646:0:21725:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:068dab75-d300-4ead-a742-d14572ad1e50+15:1960:x1830948734016384:12345-192.168.202.4@tcp:3:lfs.0 00010000:00010000:3.0:1746129567.657684:0:21725:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800909cf400/0x40a459093b0693a8 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21725 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129567.657703:0:21725:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129567.657705:0:21725:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129567.657710:0:21725:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800909cf400/0x40a459093b0693a8 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21725 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129567.657721:0:21725:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800909cf400/0x40a459093b0693a8 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21725 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129567.659055:0:31518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7647 00000100:00100000:3.0:1746129567.659063:0:31518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b553480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:068dab75-d300-4ead-a742-d14572ad1e50+16:1960:x1830948734016640:12345-192.168.202.4@tcp:3:lfs.0 00010000:00010000:3.0:1746129567.659087:0:31518:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800909cf600/0x40a459093b0693af lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129567.659094:0:31518:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129567.659096:0:31518:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129567.659099:0:31518:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800909cf600/0x40a459093b0693af lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129567.659108:0:31518:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800909cf600/0x40a459093b0693af lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31518 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129567.660467:0:21463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7648 00000100:00100000:2.0:1746129567.660482:0:21463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b552680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:068dab75-d300-4ead-a742-d14572ad1e50+16:1961:x1830948734016896:12345-192.168.202.4@tcp:3:lfs.0 00010000:00010000:2.0:1746129567.660516:0:21463:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012c172200/0x40a459093b0693b6 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21463 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129567.660529:0:21463:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129567.660531:0:21463:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129567.660535:0:21463:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c172200/0x40a459093b0693b6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21463 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129567.660548:0:21463:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c172200/0x40a459093b0693b6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21463 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129567.666419:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129567.666458:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129567.666480:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129567.666506:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129567.667258:0:31520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734017152 00000100:00100000:2.0:1746129567.667271:0:31520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734017152 00000100:00100000:2.0:1746129567.667363:0:31520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734017408 00000100:00100000:2.0:1746129567.667366:0:31520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734017408 00000100:00100000:2.0:1746129567.667383:0:31520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734017664 00000100:00100000:2.0:1746129567.667386:0:31520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734017664 00000100:00100000:2.0:1746129567.667397:0:31520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734017920 00000100:00100000:2.0:1746129567.667399:0:31520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734017920 00000100:00100000:2.0:1746129567.667416:0:31520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7649 00000100:00100000:2.0:1746129567.667425:0:31520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:068dab75-d300-4ead-a742-d14572ad1e50+19:1960:x1830948734017152:12345-192.168.202.4@tcp:3:lfs.0 00010000:00010000:2.0:1746129567.667462:0:31520:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012c173c00/0x40a459093b0693bd lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129567.667476:0:31520:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129567.667478:0:31520:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129567.667483:0:31520:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c173c00/0x40a459093b0693bd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129567.667494:0:31520:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c173c00/0x40a459093b0693bd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31520 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129567.667891:0:31521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7650 00000100:00100000:3.0:1746129567.667899:0:31521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:068dab75-d300-4ead-a742-d14572ad1e50+19:1960:x1830948734017408:12345-192.168.202.4@tcp:3:lfs.0 00010000:00010000:3.0:1746129567.667921:0:31521:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800909cfa00/0x40a459093b0693c4 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129567.667929:0:31521:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129567.667931:0:31521:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129567.667934:0:31521:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800909cfa00/0x40a459093b0693c4 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129567.667942:0:31521:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800909cfa00/0x40a459093b0693c4 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31521 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129567.668954:0:8417:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7651 00000100:00100000:2.0:1746129567.668962:0:8417:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f95b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:068dab75-d300-4ead-a742-d14572ad1e50+20:1960:x1830948734017664:12345-192.168.202.4@tcp:3:lfs.0 00010000:00010000:2.0:1746129567.668983:0:8417:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012c173800/0x40a459093b0693cb lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129567.668990:0:8417:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129567.668993:0:8417:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129567.668996:0:8417:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c173800/0x40a459093b0693cb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129567.669005:0:8417:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c173800/0x40a459093b0693cb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129567.669271:0:31519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7652 00000100:00100000:3.0:1746129567.669278:0:31519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132c24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:068dab75-d300-4ead-a742-d14572ad1e50+20:1960:x1830948734017920:12345-192.168.202.4@tcp:3:lfs.0 00010000:00010000:3.0:1746129567.669312:0:31519:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800909cf000/0x40a459093b0693d2 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129567.669320:0:31519:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129567.669321:0:31519:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129567.669324:0:31519:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800909cf000/0x40a459093b0693d2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129567.669332:0:31519:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800909cf000/0x40a459093b0693d2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129567.670604:0:25745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012c16a000/0x40a459093b0693a1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25745 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129567.670614:0:25745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012c16a000/0x40a459093b0693a1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25745 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129567.670622:0:25745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012c16a000/0x40a459093b0693a1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25745 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129567.670628:0:25745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c16a000 already unused, calling callback (ffffffffa086ed70) 00010000:00010000:1.0:1746129567.670631:0:25745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012c16a000/0x40a459093b0693a1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25745 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129567.670639:0:25745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012c16a000/0x40a459093b0693a1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25745 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129567.670656:0:25745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012c16a000/0x40a459093b0693a1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25745 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129567.670662:0:25745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c16a000/0x40a459093b0693a1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25745 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129567.670716:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:068dab75-d300-4ead-a742-d14572ad1e50+20:1961:x1830948734016128:12345-192.168.202.4@tcp:3:lfs.0 Request processed in 30561us (31591us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129567.670723:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7645 00010000:00010000:3.0:1746129567.679844:0:21725:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800909cf400/0x40a459093b0693a8 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21725 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129567.679864:0:21725:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800909cf400/0x40a459093b0693a8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21725 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129567.679871:0:21725:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800909cf400/0x40a459093b0693a8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21725 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129567.679882:0:21725:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800909cf400 already unused, calling callback (ffffffffa086ed70) 00010000:00010000:3.0:1746129567.679886:0:21725:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800909cf400/0x40a459093b0693a8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21725 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129567.679892:0:21725:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800909cf400/0x40a459093b0693a8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21725 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129567.679912:0:21725:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800909cf400/0x40a459093b0693a8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21725 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129567.679918:0:21725:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800909cf400/0x40a459093b0693a8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21725 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129567.681462:0:21725:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:068dab75-d300-4ead-a742-d14572ad1e50+20:1960:x1830948734016384:12345-192.168.202.4@tcp:3:lfs.0 Request processed in 23803us (32319us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129567.681475:0:21725:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7646 00010000:00010000:3.0:1746129567.685405:0:31518:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800909cf600/0x40a459093b0693af lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129567.685424:0:31518:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800909cf600/0x40a459093b0693af lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129567.685433:0:31518:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800909cf600/0x40a459093b0693af lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129567.685439:0:31518:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800909cf600 already unused, calling callback (ffffffffa086ed70) 00010000:00010000:3.0:1746129567.685444:0:31518:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800909cf600/0x40a459093b0693af lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129567.685453:0:31518:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800909cf600/0x40a459093b0693af lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129567.685477:0:31518:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800909cf600/0x40a459093b0693af lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129567.685482:0:31518:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800909cf600/0x40a459093b0693af lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31518 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129567.685562:0:31518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b553480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:068dab75-d300-4ead-a742-d14572ad1e50+18:1960:x1830948734016640:12345-192.168.202.4@tcp:3:lfs.0 Request processed in 26495us (29287us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129567.685571:0:31518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7647 00010000:00010000:2.0:1746129567.692561:0:21463:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012c172200/0x40a459093b0693b6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21463 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129567.692579:0:21463:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012c172200/0x40a459093b0693b6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21463 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129567.692588:0:21463:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012c172200/0x40a459093b0693b6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21463 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129567.692594:0:21463:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c172200 already unused, calling callback (ffffffffa086ed70) 00010000:00010000:2.0:1746129567.692597:0:21463:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012c172200/0x40a459093b0693b6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21463 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129567.692605:0:21463:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012c172200/0x40a459093b0693b6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21463 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129567.692624:0:21463:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012c172200/0x40a459093b0693b6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21463 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129567.692628:0:21463:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c172200/0x40a459093b0693b6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21463 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129567.693498:0:21463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b552680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:068dab75-d300-4ead-a742-d14572ad1e50+18:1961:x1830948734016896:12345-192.168.202.4@tcp:3:lfs.0 Request processed in 33012us (37084us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129567.693510:0:21463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7648 00010000:00010000:3.0:1746129567.700403:0:31521:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800909cfa00/0x40a459093b0693c4 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129567.700423:0:31521:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800909cfa00/0x40a459093b0693c4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129567.700432:0:31521:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800909cfa00/0x40a459093b0693c4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129567.700438:0:31521:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800909cfa00 already unused, calling callback (ffffffffa086ed70) 00010000:00010000:3.0:1746129567.700443:0:31521:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800909cfa00/0x40a459093b0693c4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129567.700451:0:31521:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800909cfa00/0x40a459093b0693c4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129567.700472:0:31521:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800909cfa00/0x40a459093b0693c4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129567.700478:0:31521:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800909cfa00/0x40a459093b0693c4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31521 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129567.700579:0:31521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:068dab75-d300-4ead-a742-d14572ad1e50+16:1960:x1830948734017408:12345-192.168.202.4@tcp:3:lfs.0 Request processed in 32675us (34113us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129567.700589:0:31521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7650 00010000:00010000:2.0:1746129567.701287:0:31520:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012c173c00/0x40a459093b0693bd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129567.701335:0:31520:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012c173c00/0x40a459093b0693bd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129567.701353:0:31520:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012c173c00/0x40a459093b0693bd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129567.701359:0:31520:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c173c00 already unused, calling callback (ffffffffa086ed70) 00010000:00010000:2.0:1746129567.701362:0:31520:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012c173c00/0x40a459093b0693bd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129567.701368:0:31520:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012c173c00/0x40a459093b0693bd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129567.701380:0:31520:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012c173c00/0x40a459093b0693bd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129567.701384:0:31520:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c173c00/0x40a459093b0693bd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31520 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129567.701450:0:31520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:068dab75-d300-4ead-a742-d14572ad1e50+16:1960:x1830948734017152:12345-192.168.202.4@tcp:3:lfs.0 Request processed in 34024us (35041us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129567.701458:0:31520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7649 00010000:00010000:2.0:1746129567.707461:0:8417:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012c173800/0x40a459093b0693cb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129567.707481:0:8417:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012c173800/0x40a459093b0693cb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129567.707493:0:8417:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012c173800/0x40a459093b0693cb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129567.707500:0:8417:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c173800 already unused, calling callback (ffffffffa086ed70) 00010000:00010000:2.0:1746129567.707504:0:8417:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012c173800/0x40a459093b0693cb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129567.707511:0:8417:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012c173800/0x40a459093b0693cb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129567.707528:0:8417:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012c173800/0x40a459093b0693cb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129567.707533:0:8417:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c173800/0x40a459093b0693cb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129567.707626:0:8417:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f95b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:068dab75-d300-4ead-a742-d14572ad1e50+14:1960:x1830948734017664:12345-192.168.202.4@tcp:3:lfs.0 Request processed in 38658us (41138us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129567.707637:0:8417:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7651 00010000:00010000:3.0:1746129567.718947:0:31519:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800909cf000/0x40a459093b0693d2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129567.718967:0:31519:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800909cf000/0x40a459093b0693d2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129567.718976:0:31519:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800909cf000/0x40a459093b0693d2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129567.718983:0:31519:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800909cf000 already unused, calling callback (ffffffffa086ed70) 00010000:00010000:3.0:1746129567.718987:0:31519:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800909cf000/0x40a459093b0693d2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129567.718994:0:31519:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800909cf000/0x40a459093b0693d2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129567.719013:0:31519:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800909cf000/0x40a459093b0693d2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129567.719023:0:31519:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800909cf000/0x40a459093b0693d2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31519 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129567.721304:0:31519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132c24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:068dab75-d300-4ead-a742-d14572ad1e50+14:1960:x1830948734017920:12345-192.168.202.4@tcp:3:lfs.0 Request processed in 52000us (54769us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129567.721319:0:31519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7652 00000100:00100000:0.0:1746129567.731784:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129567.732080:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734018176 00000100:00100000:2.0:1746129567.732092:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734018176 00000100:00100000:2.0:1746129567.732155:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11158 00000100:00100000:2.0:1746129567.732163:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:068dab75-d300-4ead-a742-d14572ad1e50+9:32164:x1830948734018176:12345-192.168.202.4@tcp:36:lfs.0 00010000:00010000:2.0:1746129567.732221:0:14549:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129567.732249:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800955d2800/0x40a459093b069370 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f209c5 expref: 9 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129567.732316:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009f469400) 00010000:00010000:2.0:1746129567.732321:0:14549:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746129567.732388:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6cf6800/0x40a459093b0693d9 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129567.732399:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6cf6800/0x40a459093b0693d9 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129567.732408:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6cf6800/0x40a459093b0693d9 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00010000:2.0:1746129567.732601:0:14549:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880093cec000 reply state ffff880090669000 transno 8589945240 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6cf6800/0x40a459093b0693d9 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000100:00100000:2.0:1746129567.732608:0:14549:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1746129567.732704:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:068dab75-d300-4ead-a742-d14572ad1e50+10:32164:x1830948734018176:12345-192.168.202.4@tcp:36:lfs.0 Request processed in 541us (932us total) trans 8589945240 rc 0/0 00000100:00100000:2.0:1746129567.732710:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11158 00010000:00010000:2.0:1746129567.734457:0:3286:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6cf6800/0x40a459093b0693d9 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129567.734471:0:3286:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6cf6800/0x40a459093b0693d9 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129567.734478:0:3286:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6cf6800/0x40a459093b0693d9 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129567.734484:0:3286:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a6cf6800 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746129567.734489:0:3286:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6cf6800/0x40a459093b0693d9 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129567.734495:0:3286:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6cf6800/0x40a459093b0693d9 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129567.734510:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009f469400) 00010000:00010000:2.0:1746129567.734513:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129567.734516:0:3286:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6cf6800/0x40a459093b0693d9 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129567.734521:0:3286:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6cf6800/0x40a459093b0693d9 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00000100:00100000:0.0:1746129567.735448:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129567.739486:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129567.739659:0:4699:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734018304 00000100:00100000:3.0:1746129567.739670:0:4699:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734018304 00000100:00100000:3.0:1746129567.739721:0:4699:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15910 00000100:00100000:3.0:1746129567.739730:0:4699:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:068dab75-d300-4ead-a742-d14572ad1e50+14:1961:x1830948734018304:12345-192.168.202.4@tcp:2:lfs.0 00002000:00010000:3.0:1746129567.739940:0:4699:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3ec:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:3.0:1746129567.739943:0:4699:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ec:0x0] updating lvb mtime from disk: 1746129568 -> 1746129568 00002000:00010000:3.0:1746129567.739945:0:4699:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3ec:0x0] updating lvb atime from disk: 1746129567 -> 1746129568 00002000:00010000:3.0:1746129567.739947:0:4699:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ec:0x0] updating lvb ctime from disk: 1746129568 -> 1746129568 00002000:00010000:3.0:1746129567.739948:0:4699:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3ec:0x0] updating lvb blocks from disk: 1981 -> 1981 00000100:00100000:3.0:1746129567.740016:0:4699:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:068dab75-d300-4ead-a742-d14572ad1e50+15:1961:x1830948734018304:12345-192.168.202.4@tcp:2:lfs.0 Request processed in 287us (4573us total) trans 21474841303 rc 0/0 00000100:00100000:3.0:1746129567.740023:0:4699:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15910 00000100:00100000:3.0:1746129567.741911:0:4699:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734018432 00000100:00100000:3.0:1746129567.741923:0:4699:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734018432 00000100:00100000:0.0:1746129567.741946:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129567.741973:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129567.741984:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734018688 00000100:00100000:3.0:1746129567.741986:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734018688 00000100:00100000:0.0:1746129567.741991:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129567.742003:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734018944 00000100:00100000:3.0:1746129567.742005:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734018944 00000100:00100000:0.0:1746129567.742020:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129567.742260:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734018560 00000100:00100000:3.0:1746129567.742264:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734018560 00000100:00100000:3.0:1746129567.742285:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734018816 00000100:00100000:3.0:1746129567.742287:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734018816 00000100:00100000:3.0:1746129567.742318:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15911 00000100:00100000:3.0:1746129567.742428:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:068dab75-d300-4ead-a742-d14572ad1e50+16:1960:x1830948734018432:12345-192.168.202.4@tcp:2:lfs.0 00000100:00100000:2.0:1746129567.742503:0:31503:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15912 00000100:00100000:2.0:1746129567.742512:0:31503:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:068dab75-d300-4ead-a742-d14572ad1e50+16:1960:x1830948734018688:12345-192.168.202.4@tcp:2:lfs.0 00000100:00100000:0.0:1746129567.742552:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15913 00000100:00100000:1.0:1746129567.742559:0:8411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15914 00000100:00100000:0.0:1746129567.742559:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ced500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:068dab75-d300-4ead-a742-d14572ad1e50+16:1960:x1830948734018944:12345-192.168.202.4@tcp:2:lfs.0 00000100:00100000:1.0:1746129567.742567:0:8411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009507c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:068dab75-d300-4ead-a742-d14572ad1e50+16:1961:x1830948734018560:12345-192.168.202.4@tcp:2:lfs.0 00000100:00100000:0.0:1746129567.742592:0:8412:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15915 00000100:00100000:0.0:1746129567.742596:0:8412:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009507df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:068dab75-d300-4ead-a742-d14572ad1e50+16:1961:x1830948734018816:12345-192.168.202.4@tcp:2:lfs.0 00002000:00010000:3.0:1746129567.742741:0:4385:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746129567.742741:0:8412:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb size from disk: 5146336 -> 5146336 00002000:00010000:0.0:1746129567.742744:0:8412:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb mtime from disk: 1746129568 -> 1746129568 00002000:00010000:3.0:1746129567.742745:0:4385:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb mtime from disk: 1746129567 -> 1746129568 00002000:00010000:0.0:1746129567.742746:0:8412:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb atime from disk: 1746129567 -> 1746129568 00002000:00010000:3.0:1746129567.742747:0:4385:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb atime from disk: 1746129567 -> 1746129568 00002000:00010000:3.0:1746129567.742748:0:4385:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb ctime from disk: 1746129567 -> 1746129568 00002000:00010000:0.0:1746129567.742748:0:8412:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb ctime from disk: 1746129568 -> 1746129568 00002000:00010000:3.0:1746129567.742750:0:4385:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb blocks from disk: 2081 -> 2081 00002000:00010000:0.0:1746129567.742750:0:8412:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb blocks from disk: 6033 -> 6033 00002000:00010000:2.0:1746129567.742854:0:31503:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746129567.742857:0:31503:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb mtime from disk: 1746129567 -> 1746129568 00002000:00010000:2.0:1746129567.742859:0:31503:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb atime from disk: 1746129567 -> 1746129568 00002000:00010000:2.0:1746129567.742861:0:31503:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb ctime from disk: 1746129567 -> 1746129568 00002000:00010000:2.0:1746129567.742863:0:31503:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:0.0:1746129567.743062:0:8412:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009507df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:068dab75-d300-4ead-a742-d14572ad1e50+18:1961:x1830948734018816:12345-192.168.202.4@tcp:2:lfs.0 Request processed in 463us (1039us total) trans 21474841304 rc 0/0 00000100:00100000:0.0:1746129567.743069:0:8412:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15915 00002000:00010000:1.0:1746129567.743203:0:7148:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3f5:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746129567.743206:0:7148:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f5:0x0] updating lvb mtime from disk: 1746129567 -> 1746129568 00002000:00010000:1.0:1746129567.743208:0:7148:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f5:0x0] updating lvb atime from disk: 1746129567 -> 1746129568 00002000:00010000:1.0:1746129567.743209:0:7148:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f5:0x0] updating lvb ctime from disk: 1746129567 -> 1746129568 00002000:00010000:1.0:1746129567.743211:0:7148:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f5:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:3.0:1746129567.743250:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:068dab75-d300-4ead-a742-d14572ad1e50+18:1960:x1830948734018432:12345-192.168.202.4@tcp:2:lfs.0 Request processed in 924us (3776us total) trans 17179874061 rc 0/0 00000100:00100000:3.0:1746129567.743256:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15911 00000100:00100000:2.0:1746129567.743753:0:31503:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:068dab75-d300-4ead-a742-d14572ad1e50+17:1960:x1830948734018688:12345-192.168.202.4@tcp:2:lfs.0 Request processed in 1241us (1809us total) trans 21474841305 rc 0/0 00000100:00100000:2.0:1746129567.743761:0:31503:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15912 00000100:00100000:1.0:1746129567.743906:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ced500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:068dab75-d300-4ead-a742-d14572ad1e50+17:1960:x1830948734018944:12345-192.168.202.4@tcp:2:lfs.0 Request processed in 1347us (1930us total) trans 17179874062 rc 0/0 00000100:00100000:1.0:1746129567.743912:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15913 00002000:00010000:1.0:1746129567.744036:0:8411:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746129567.744039:0:8411:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb mtime from disk: 1746129567 -> 1746129568 00002000:00010000:1.0:1746129567.744041:0:8411:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb atime from disk: 1746129567 -> 1746129568 00002000:00010000:1.0:1746129567.744043:0:8411:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb ctime from disk: 1746129567 -> 1746129568 00002000:00010000:1.0:1746129567.744044:0:8411:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746129567.744080:0:8411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009507c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:068dab75-d300-4ead-a742-d14572ad1e50+17:1961:x1830948734018560:12345-192.168.202.4@tcp:2:lfs.0 Request processed in 1514us (2087us total) trans 17179874063 rc 0/0 00000100:00100000:1.0:1746129567.744086:0:8411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15914 00000100:00100000:0.0:1746129567.751417:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129567.752204:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734019200 00000100:00100000:2.0:1746129567.752217:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734019200 00000100:00100000:2.0:1746129567.752482:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4721 00000100:00100000:2.0:1746129567.752492:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4e0050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:068dab75-d300-4ead-a742-d14572ad1e50+9:32164:x1830948734019200:12345-192.168.202.4@tcp:35:lfs.0 00000004:00010000:2.0:1746129567.752559:0:14550:0:(mdt_open.c:2471:mdt_close_resync_done()) ### [0x200000403:0x368:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c173200/0x40a459093b069323 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f209b7 expref: 9 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129567.752610:0:14550:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1be00/0x40a459093b0693e0 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746129567.752622:0:14550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800955d2600/0x40a459093b069362 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f209be expref: 9 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129567.752629:0:14550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1be00/0x40a459093b0693e0 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746129567.752658:0:14550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800955d2600/0x40a459093b069362 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f209be expref: 9 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129567.752669:0:14550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800955d2600/0x40a459093b069362 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f209be expref: 9 pid: 14549 timeout: 923 lvb_type: 0 00000100:00100000:2.0:1746129567.752682:0:14550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095627800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:14550:1830948737472640:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129567.752779:0:14550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0ac3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129567.758473:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129567.758598:0:14550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095627800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:14550:1830948737472640:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129567.758625:0:14550:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1be00/0x40a459093b0693e0 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00000100:00100000:1.0:1746129567.758830:0:7086:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734019328 00000100:00100000:1.0:1746129567.758837:0:7086:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734019328 00010000:00010000:1.0:1746129567.758873:0:7086:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800955d2600/0x40a459093b069362 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f209be expref: 10 pid: 14549 timeout: 923 lvb_type: 0 00000100:00100000:1.0:1746129567.758899:0:7086:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8145 00000100:00100000:1.0:1746129567.758906:0:7086:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6026050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:068dab75-d300-4ead-a742-d14572ad1e50+10:1962:x1830948734019328:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129567.758919:0:7086:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129567.758924:0:7086:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800955d2600/0x40a459093b069362 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f209be expref: 10 pid: 14549 timeout: 923 lvb_type: 0 00010000:00010000:1.0:1746129567.758935:0:7086:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800955d2600/0x40a459093b069362 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f209be expref: 10 pid: 14549 timeout: 923 lvb_type: 0 00010000:00010000:1.0:1746129567.758958:0:7086:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800955d2600/0x40a459093b069362 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f209be expref: 10 pid: 14549 timeout: 923 lvb_type: 0 00010000:00010000:1.0:1746129567.758981:0:7086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009f469400) 00010000:00010000:1.0:1746129567.758985:0:7086:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1be00/0x40a459093b0693e0 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746129567.758994:0:7086:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1be00/0x40a459093b0693e0 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746129567.759001:0:7086:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1be00/0x40a459093b0693e0 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746129567.759192:0:7086:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746129567.759281:0:14550:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1be00/0x40a459093b0693e0 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746129567.759287:0:14550:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1be00/0x40a459093b0693e0 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00000040:00080000:3.0:1746129567.759909:0:14550:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3427, 88 off288304 00000004:00080000:3.0:1746129567.759914:0:14550:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 823076619947ns, next at 776349687452ns, rc = 0 00000040:00080000:3.0:1746129567.759953:0:14550:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3444, 88 off289712 00000004:00080000:3.0:1746129567.759956:0:14550:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 823076662123ns, next at 776375382381ns, rc = 0 00000040:00080000:3.0:1746129567.759968:0:14550:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3445, 88 off289800 00000004:00080000:3.0:1746129567.759971:0:14550:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 823076677175ns, next at 776375382381ns, rc = 0 00000040:00080000:3.0:1746129567.759977:0:14550:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3428, 88 off288392 00000004:00080000:3.0:1746129567.759979:0:14550:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 823076685322ns, next at 776349687452ns, rc = 0 00000040:00080000:3.0:1746129567.759984:0:14550:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3429, 88 off288480 00000004:00080000:3.0:1746129567.759987:0:14550:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 823076692828ns, next at 776349687452ns, rc = 0 00000040:00080000:3.0:1746129567.759994:0:14550:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3446, 88 off289888 00000004:00080000:3.0:1746129567.759996:0:14550:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 823076702367ns, next at 776375382381ns, rc = 0 00000040:00080000:3.0:1746129567.760002:0:14550:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3447, 88 off289976 00000004:00080000:3.0:1746129567.760005:0:14550:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 823076711120ns, next at 776375382381ns, rc = 0 00000040:00080000:3.0:1746129567.760011:0:14550:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3448, 88 off290064 00000004:00080000:3.0:1746129567.760013:0:14550:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 823076719480ns, next at 776375382381ns, rc = 0 00000040:00080000:3.0:1746129567.760019:0:14550:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3430, 88 off288568 00000004:00080000:3.0:1746129567.760021:0:14550:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 823076727090ns, next at 776349687452ns, rc = 0 00000040:00080000:3.0:1746129567.760026:0:14550:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3449, 88 off290152 00000004:00080000:3.0:1746129567.760028:0:14550:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 823076734300ns, next at 776375382381ns, rc = 0 00000040:00080000:3.0:1746129567.760033:0:14550:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3431, 88 off288656 00000004:00080000:3.0:1746129567.760035:0:14550:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 823076741205ns, next at 776349687452ns, rc = 0 00000040:00080000:3.0:1746129567.760040:0:14550:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3450, 88 off290240 00000004:00080000:3.0:1746129567.760042:0:14550:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 823076747887ns, next at 776375382381ns, rc = 0 00000040:00080000:3.0:1746129567.760047:0:14550:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3432, 88 off288744 00000004:00080000:3.0:1746129567.760048:0:14550:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 823076754695ns, next at 776349687452ns, rc = 0 00000040:00080000:3.0:1746129567.760053:0:14550:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3433, 88 off288832 00000004:00080000:3.0:1746129567.760055:0:14550:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 823076761185ns, next at 776349687452ns, rc = 0 00000040:00080000:3.0:1746129567.760060:0:14550:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3434, 88 off288920 00000004:00080000:3.0:1746129567.760061:0:14550:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 823076767695ns, next at 776349687452ns, rc = 0 00000040:00080000:3.0:1746129567.760066:0:14550:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3435, 88 off289008 00000004:00080000:3.0:1746129567.760068:0:14550:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 823076774178ns, next at 776349687452ns, rc = 0 00000040:00080000:3.0:1746129567.760073:0:14550:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3451, 88 off290328 00000004:00080000:3.0:1746129567.760074:0:14550:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 823076780788ns, next at 776375382381ns, rc = 0 00000100:00100000:1.0:1746129567.760479:0:7086:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6026050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:068dab75-d300-4ead-a742-d14572ad1e50+10:1962:x1830948734019328:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 1566us (2012us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129567.760489:0:7086:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8145 00000001:00080000:0.0:1746129567.800634:0:14619:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945240 is committed 00000001:00080000:0.0:1746129567.800656:0:14619:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945241 is committed 00000004:00080000:0.0:1746129567.800660:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2621 committed 00000004:00080000:0.0:1746129567.800668:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2605 committed 00000004:00080000:0.0:1746129567.800676:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2604 committed 00000004:00080000:0.0:1746129567.800679:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2603 committed 00000004:00080000:0.0:1746129567.800680:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2602 committed 00000004:00080000:0.0:1746129567.800682:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2620 committed 00000004:00080000:0.0:1746129567.800683:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2601 committed 00000004:00080000:0.0:1746129567.800685:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2619 committed 00000004:00080000:0.0:1746129567.800686:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2600 committed 00000004:00080000:0.0:1746129567.800688:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2618 committed 00000004:00080000:0.0:1746129567.800689:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2617 committed 00000004:00080000:0.0:1746129567.800691:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2616 committed 00000004:00080000:0.0:1746129567.800693:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2599 committed 00000004:00080000:0.0:1746129567.800694:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2598 committed 00000004:00080000:0.0:1746129567.800696:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2615 committed 00000004:00080000:0.0:1746129567.800697:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2614 committed 00000004:00080000:0.0:1746129567.800699:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2597 committed 00000004:00010000:3.0:1746129567.800821:0:14550:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88012b4e0050 reply state ffff880095565c00 transno 8589945241 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1be00/0x40a459093b0693e0 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00000100:00100000:3.0:1746129567.800839:0:14550:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1746129567.800849:0:14550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009f469400) 00010000:00010000:3.0:1746129567.800852:0:14550:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746129567.800862:0:14550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c173200/0x40a459093b069323 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f209b7 expref: 7 pid: 2271 timeout: 0 lvb_type: 0 00010000:00080000:3.0:1746129567.800974:0:14550:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1746129567.800987:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4e0050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:068dab75-d300-4ead-a742-d14572ad1e50+7:32164:x1830948734019200:12345-192.168.202.4@tcp:35:lfs.0 Request processed in 48495us (49580us total) trans 8589945241 rc 0/0 00000100:00100000:3.0:1746129567.800996:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4721 00010000:00010000:3.0:1746129567.801063:0:3287:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1be00/0x40a459093b0693e0 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746129567.801070:0:3287:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1be00/0x40a459093b0693e0 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746129567.801077:0:3287:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1be00/0x40a459093b0693e0 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746129567.801083:0:3287:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ee1be00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:3.0:1746129567.801087:0:3287:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1be00/0x40a459093b0693e0 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746129567.801094:0:3287:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1be00/0x40a459093b0693e0 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746129567.801108:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009f469400) 00010000:00010000:3.0:1746129567.801110:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746129567.801113:0:3287:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1be00/0x40a459093b0693e0 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746129567.801120:0:3287:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1be00/0x40a459093b0693e0 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14550 initiator: MDT0 00000100:00100000:0.0:1746129567.801367:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009507e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737473024:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129567.801414:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129567.801458:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094065500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737473536:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129567.801473:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129567.801490:0:3300:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1746129567.801495:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009507d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737473152:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129567.801509:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129567.801519:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094065880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737473664:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129567.801533:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129567.801566:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737473024 00000100:00100000:0.0:1746129567.801573:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737473024 00000100:00100000:0.0:1746129567.801601:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737473536 00000100:00100000:0.0:1746129567.801603:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737473536 00000100:00100000:0.0:1746129567.801611:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737473152 00000100:00100000:0.0:1746129567.801613:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737473152 00000100:00100000:0.0:1746129567.801620:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737473664 00000100:00100000:0.0:1746129567.801621:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737473664 00000100:00100000:0.0:1746129567.801632:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15916 00000100:00100000:0.0:1746129567.801638:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094066d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+44:3300:x1830948737473024:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746129567.801839:0:7148:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb size from disk: 5146336 -> 5146336 00002000:00010000:0.0:1746129567.801842:0:7148:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb mtime from disk: 1746129568 -> 1746129568 00002000:00010000:0.0:1746129567.801844:0:7148:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb atime from disk: 1746129568 -> 1746129568 00002000:00010000:0.0:1746129567.801846:0:7148:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb ctime from disk: 1746129568 -> 1746129568 00002000:00010000:0.0:1746129567.801848:0:7148:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb blocks from disk: 6033 -> 6033 00000100:00100000:0.0:1746129567.801872:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094066d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+45:3300:x1830948737473024:12345-0@lo:2:osp-syn-0-0.0 Request processed in 235us (457us total) trans 21474841306 rc 0/0 00000100:00100000:0.0:1746129567.801877:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15916 00000100:00100000:0.0:1746129567.801890:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15917 00000100:00100000:0.0:1746129567.801895:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094066680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+44:3300:x1830948737473536:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746129567.801957:0:7148:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746129567.801960:0:7148:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1746129567.801961:0:7148:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746129567.801963:0:7148:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746129567.801964:0:7148:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1746129567.801982:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094066680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+45:3300:x1830948737473536:12345-0@lo:2:osp-syn-0-0.0 Request processed in 87us (508us total) trans 21474841307 rc 0/0 00000100:00100000:0.0:1746129567.801987:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15917 00000100:00100000:0.0:1746129567.801996:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15918 00000100:00100000:0.0:1746129567.802000:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094065180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+44:3300:x1830948737473152:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129567.802074:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094065180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+45:3300:x1830948737473152:12345-0@lo:2:osp-syn-0-0.0 Request processed in 73us (563us total) trans 21474841308 rc 0/0 00000100:00100000:0.0:1746129567.802082:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15918 00000100:00100000:0.0:1746129567.802091:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15919 00000100:00100000:0.0:1746129567.802095:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094064000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+44:3300:x1830948737473664:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129567.802166:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094064000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+45:3300:x1830948737473664:12345-0@lo:2:osp-syn-0-0.0 Request processed in 71us (632us total) trans 21474841309 rc 0/0 00000100:00100000:0.0:1746129567.802171:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15919 00000004:00080000:0.0:1746129567.802209:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009507d180/2, rc 0, transno 21474841308 00000100:00100000:0.0:1746129567.802217:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009507d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737473152:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129567.802224:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094065880/2, rc 0, transno 21474841309 00000100:00100000:0.0:1746129567.802226:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094065880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737473664:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129567.802231:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009507e300/2, rc 0, transno 21474841306 00000100:00100000:0.0:1746129567.802234:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009507e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737473024:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129567.802239:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094065500/2, rc 0, transno 21474841307 00000100:00100000:0.0:1746129567.802242:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094065500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737473536:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129567.802727:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009507ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737472768:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129567.802755:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129567.802792:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094065f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737473280:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129567.802808:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129567.802818:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094064700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737473792:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129567.802830:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129567.802838:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b552d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737474304:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129567.802852:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129567.802862:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b551880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737474816:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129567.802874:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129567.802886:0:3302:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:1.0:1746129567.802890:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009507d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737472896:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129567.802902:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129567.802912:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094067800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737473408:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129567.802924:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129567.802932:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b550a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737473920:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129567.802945:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129567.802950:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b550e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737474432:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129567.802961:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129567.802973:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b552300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737474176:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129567.802988:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129567.802994:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b552a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737474688:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129567.803006:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129567.803013:0:3301:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1746129567.803016:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b553100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737474048:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129567.803028:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129567.803034:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b550000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737474560:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129567.803047:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129567.803062:0:8411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737472768 00000100:00100000:1.0:1746129567.803066:0:8411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737472768 00000100:00100000:1.0:1746129567.803083:0:8411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737473280 00000100:00100000:1.0:1746129567.803085:0:8411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737473280 00000100:00100000:1.0:1746129567.803090:0:8411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737473792 00000100:00100000:1.0:1746129567.803092:0:8411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737473792 00000100:00100000:1.0:1746129567.803097:0:8411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737474304 00000100:00100000:1.0:1746129567.803099:0:8411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737474304 00000100:00100000:1.0:1746129567.803106:0:8411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737474816 00000100:00100000:1.0:1746129567.803108:0:8411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737474816 00000100:00100000:1.0:1746129567.803113:0:8411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737472896 00000100:00100000:1.0:1746129567.803115:0:8411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737472896 00000100:00100000:1.0:1746129567.803121:0:8411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737473408 00000100:00100000:1.0:1746129567.803122:0:8411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737473408 00000100:00100000:1.0:1746129567.803128:0:8411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737473920 00000100:00100000:1.0:1746129567.803130:0:8411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737473920 00000100:00100000:1.0:1746129567.803137:0:8411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737474432 00000100:00100000:1.0:1746129567.803138:0:8411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737474432 00000100:00100000:1.0:1746129567.803146:0:8411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737474176 00000100:00100000:1.0:1746129567.803147:0:8411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737474176 00000100:00100000:1.0:1746129567.803152:0:8411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737474688 00000100:00100000:1.0:1746129567.803154:0:8411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737474688 00000100:00100000:1.0:1746129567.803159:0:8411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737474048 00000100:00100000:1.0:1746129567.803160:0:8411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737474048 00000100:00100000:1.0:1746129567.803165:0:8411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737474560 00000100:00100000:1.0:1746129567.803166:0:8411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737474560 00000100:00100000:1.0:1746129567.803173:0:8411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15920 00000100:00100000:1.0:1746129567.803178:0:8411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b553b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+49:3302:x1830948737472768:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746129567.803278:0:8411:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3ec:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:1.0:1746129567.803281:0:8411:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ec:0x0] updating lvb mtime from disk: 1746129568 -> 1746129568 00002000:00010000:1.0:1746129567.803283:0:8411:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3ec:0x0] updating lvb atime from disk: 1746129568 -> 1746129568 00002000:00010000:1.0:1746129567.803285:0:8411:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ec:0x0] updating lvb ctime from disk: 1746129568 -> 1746129568 00002000:00010000:1.0:1746129567.803286:0:8411:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3ec:0x0] updating lvb blocks from disk: 1981 -> 1981 00000100:00100000:1.0:1746129567.803338:0:8411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b553b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+50:3302:x1830948737472768:12345-0@lo:2:osp-syn-0-0.0 Request processed in 158us (581us total) trans 21474841310 rc 0/0 00000100:00100000:1.0:1746129567.803355:0:8411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15920 00000100:00100000:1.0:1746129567.803367:0:8411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15921 00000100:00100000:1.0:1746129567.803371:0:8411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+49:3302:x1830948737473280:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129567.803446:0:8411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+50:3302:x1830948737473280:12345-0@lo:2:osp-syn-0-0.0 Request processed in 74us (636us total) trans 21474841311 rc 0/0 00000100:00100000:1.0:1746129567.803454:0:8411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15921 00000100:00100000:1.0:1746129567.803463:0:8411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15922 00000100:00100000:1.0:1746129567.803467:0:8411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+49:3302:x1830948737473792:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129567.803539:0:8411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+50:3302:x1830948737473792:12345-0@lo:2:osp-syn-0-0.0 Request processed in 72us (707us total) trans 21474841312 rc 0/0 00000100:00100000:1.0:1746129567.803545:0:8411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15922 00000100:00100000:1.0:1746129567.803553:0:8411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15923 00000100:00100000:1.0:1746129567.803557:0:8411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+44:3302:x1830948737474304:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746129567.803644:0:8411:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746129567.803646:0:8411:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb mtime from disk: 1746129523 -> 1746129523 00002000:00010000:1.0:1746129567.803648:0:8411:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb atime from disk: 1746129523 -> 1746129523 00002000:00010000:1.0:1746129567.803650:0:8411:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb ctime from disk: 1746129524 -> 1746129524 00002000:00010000:1.0:1746129567.803652:0:8411:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1746129567.803669:0:8411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+45:3302:x1830948737474304:12345-0@lo:2:osp-syn-1-0.0 Request processed in 112us (816us total) trans 17179874064 rc 0/0 00000100:00100000:1.0:1746129567.803673:0:8411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15923 00000100:00100000:1.0:1746129567.803682:0:8411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15924 00000100:00100000:1.0:1746129567.803686:0:8411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+44:3302:x1830948737474816:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129567.803757:0:8411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+45:3302:x1830948737474816:12345-0@lo:2:osp-syn-1-0.0 Request processed in 71us (882us total) trans 17179874065 rc 0/0 00000100:00100000:1.0:1746129567.803762:0:8411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15924 00000100:00100000:1.0:1746129567.803771:0:8411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15925 00000100:00100000:1.0:1746129567.803775:0:8411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+49:3302:x1830948737472896:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746129567.803844:0:8411:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746129567.803847:0:8411:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb mtime from disk: 1746129568 -> 1746129568 00002000:00010000:1.0:1746129567.803849:0:8411:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb atime from disk: 1746129568 -> 1746129568 00002000:00010000:1.0:1746129567.803851:0:8411:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb ctime from disk: 1746129568 -> 1746129568 00002000:00010000:1.0:1746129567.803852:0:8411:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:1.0:1746129567.803870:0:8411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+50:3302:x1830948737472896:12345-0@lo:2:osp-syn-0-0.0 Request processed in 94us (966us total) trans 21474841313 rc 0/0 00000100:00100000:1.0:1746129567.803874:0:8411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15925 00000100:00100000:1.0:1746129567.803883:0:8411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15926 00000100:00100000:1.0:1746129567.803887:0:8411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+49:3302:x1830948737473408:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129567.803958:0:8411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+50:3302:x1830948737473408:12345-0@lo:2:osp-syn-0-0.0 Request processed in 70us (1033us total) trans 21474841314 rc 0/0 00000100:00100000:1.0:1746129567.803963:0:8411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15926 00000100:00100000:1.0:1746129567.803973:0:8411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15927 00000100:00100000:1.0:1746129567.803976:0:8411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+44:3302:x1830948737473920:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746129567.804046:0:8411:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746129567.804048:0:8411:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb mtime from disk: 1746129568 -> 1746129568 00002000:00010000:1.0:1746129567.804050:0:8411:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb atime from disk: 1746129568 -> 1746129568 00002000:00010000:1.0:1746129567.804052:0:8411:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb ctime from disk: 1746129568 -> 1746129568 00002000:00010000:1.0:1746129567.804053:0:8411:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746129567.804070:0:8411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+45:3302:x1830948737473920:12345-0@lo:2:osp-syn-1-0.0 Request processed in 94us (1125us total) trans 17179874066 rc 0/0 00000100:00100000:1.0:1746129567.804075:0:8411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15927 00000100:00100000:1.0:1746129567.804084:0:8411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15928 00000100:00100000:1.0:1746129567.804087:0:8411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+44:3302:x1830948737474432:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129567.804154:0:8411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+45:3302:x1830948737474432:12345-0@lo:2:osp-syn-1-0.0 Request processed in 65us (1191us total) trans 17179874067 rc 0/0 00000100:00100000:1.0:1746129567.804159:0:8411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15928 00000100:00100000:1.0:1746129567.804168:0:8411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15929 00000100:00100000:1.0:1746129567.804171:0:8411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+44:3301:x1830948737474176:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746129567.804233:0:8411:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3f5:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746129567.804235:0:8411:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f5:0x0] updating lvb mtime from disk: 1746129568 -> 1746129568 00002000:00010000:1.0:1746129567.804237:0:8411:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f5:0x0] updating lvb atime from disk: 1746129568 -> 1746129568 00002000:00010000:1.0:1746129567.804238:0:8411:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f5:0x0] updating lvb ctime from disk: 1746129568 -> 1746129568 00002000:00010000:1.0:1746129567.804240:0:8411:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f5:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:1.0:1746129567.804261:0:8411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+45:3301:x1830948737474176:12345-0@lo:2:osp-syn-1-0.0 Request processed in 90us (1273us total) trans 17179874068 rc 0/0 00000100:00100000:1.0:1746129567.804266:0:8411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15929 00000100:00100000:1.0:1746129567.804274:0:8411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15930 00000100:00100000:1.0:1746129567.804279:0:8411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+44:3301:x1830948737474688:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129567.804380:0:8411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+45:3301:x1830948737474688:12345-0@lo:2:osp-syn-1-0.0 Request processed in 101us (1373us total) trans 17179874069 rc 0/0 00000100:00100000:1.0:1746129567.804385:0:8411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15930 00000100:00100000:1.0:1746129567.804393:0:8411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15931 00000100:00100000:1.0:1746129567.804397:0:8411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+44:3301:x1830948737474048:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746129567.804460:0:8411:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746129567.804462:0:8411:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb mtime from disk: 1746129568 -> 1746129568 00002000:00010000:1.0:1746129567.804463:0:8411:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb atime from disk: 1746129568 -> 1746129568 00002000:00010000:1.0:1746129567.804465:0:8411:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb ctime from disk: 1746129568 -> 1746129568 00002000:00010000:1.0:1746129567.804467:0:8411:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746129567.804482:0:8411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+45:3301:x1830948737474048:12345-0@lo:2:osp-syn-1-0.0 Request processed in 85us (1452us total) trans 17179874070 rc 0/0 00000100:00100000:1.0:1746129567.804487:0:8411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15931 00000100:00100000:1.0:1746129567.804494:0:8411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15932 00000100:00100000:1.0:1746129567.804498:0:8411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+44:3301:x1830948737474560:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129567.804555:0:8411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+45:3301:x1830948737474560:12345-0@lo:2:osp-syn-1-0.0 Request processed in 56us (1507us total) trans 17179874071 rc 0/0 00000100:00100000:1.0:1746129567.804559:0:8411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15932 00000004:00080000:1.0:1746129567.804675:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b553100/2, rc 0, transno 17179874070 00000100:00100000:1.0:1746129567.804679:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b553100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737474048:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746129567.804686:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b550000/2, rc 0, transno 17179874071 00000100:00100000:1.0:1746129567.804689:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b550000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737474560:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746129567.804694:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b552300/2, rc 0, transno 17179874068 00000100:00100000:1.0:1746129567.804696:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b552300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737474176:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746129567.804701:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b552a00/2, rc 0, transno 17179874069 00000100:00100000:1.0:1746129567.804703:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b552a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737474688:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746129567.804719:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009507d880/2, rc 0, transno 21474841313 00000100:00100000:1.0:1746129567.804722:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009507d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737472896:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746129567.804727:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094067800/2, rc 0, transno 21474841314 00000100:00100000:1.0:1746129567.804729:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094067800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737473408:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746129567.804734:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b550a80/2, rc 0, transno 17179874066 00000100:00100000:1.0:1746129567.804736:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b550a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737473920:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746129567.804740:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b550e00/2, rc 0, transno 17179874067 00000100:00100000:1.0:1746129567.804742:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b550e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737474432:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746129567.804749:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009507ce00/2, rc 0, transno 21474841310 00000100:00100000:1.0:1746129567.804752:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009507ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737472768:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746129567.804758:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094065f80/2, rc 0, transno 21474841311 00000100:00100000:1.0:1746129567.804760:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094065f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737473280:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746129567.804764:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094064700/2, rc 0, transno 21474841312 00000100:00100000:1.0:1746129567.804766:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094064700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737473792:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746129567.804770:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b552d80/2, rc 0, transno 17179874064 00000100:00100000:1.0:1746129567.804772:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b552d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737474304:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746129567.804777:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b551880/2, rc 0, transno 17179874065 00000100:00100000:1.0:1746129567.804779:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b551880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737474816:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129567.805842:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129567.805900:0:2271:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734019456 00000100:00100000:3.0:1746129567.805908:0:2271:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734019456 00000100:00100000:3.0:1746129567.805945:0:2271:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11159 00000100:00100000:3.0:1746129567.805951:0:2271:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095627800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:068dab75-d300-4ead-a742-d14572ad1e50+6:32164:x1830948734019456:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:3.0:1746129567.805968:0:2271:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129567.805986:0:2271:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009efe9600/0x40a459093b0693e7 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f209f6 expref: -99 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129567.806040:0:2271:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009efe9600/0x40a459093b0693e7 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f209f6 expref: 7 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129567.806053:0:2271:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009efe9600/0x40a459093b0693e7 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f209f6 expref: 7 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129567.806070:0:2271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:3.0:1746129567.806073:0:2271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746129567.806076:0:2271:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009efe9600, rc 0) 00000100:00100000:3.0:1746129567.806113:0:2271:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095627800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:068dab75-d300-4ead-a742-d14572ad1e50+7:32164:x1830948734019456:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 162us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129567.806118:0:2271:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11159 00000100:00100000:0.0:1746129567.811890:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129567.811970:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734019712 00000100:00100000:3.0:1746129567.811979:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734019712 00000100:00100000:3.0:1746129567.812025:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4722 00000100:00100000:3.0:1746129567.812032:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135724000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:068dab75-d300-4ead-a742-d14572ad1e50+7:32164:x1830948734019712:12345-192.168.202.4@tcp:35:lfs.0 00000100:00100000:3.0:1746129567.813633:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135724000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:068dab75-d300-4ead-a742-d14572ad1e50+8:32164:x1830948734019712:12345-192.168.202.4@tcp:35:lfs.0 Request processed in 1592us (1745us total) trans 8589945242 rc 0/0 00000100:00100000:3.0:1746129567.813645:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4722 00000100:00100000:0.0:1746129567.859682:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129567.862829:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129567.863047:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734019968 00000100:00100000:2.0:1746129567.863059:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734019968 00000100:00100000:2.0:1746129567.863105:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734020224 00000100:00100000:2.0:1746129567.863108:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734020224 00000100:00100000:2.0:1746129567.863127:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11160 00000100:00100000:2.0:1746129567.863135:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135724e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+6:32172:x1830948734019968:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:2.0:1746129567.863165:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129567.863184:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1a600/0x40a459093b0693ee lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f209fd expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129567.863319:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1b000/0x40a459093b0693f5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129567.863332:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1b000/0x40a459093b0693f5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129567.863355:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1b000/0x40a459093b0693f5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129567.863367:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1b800/0x40a459093b0693fc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129567.863372:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1b800/0x40a459093b0693fc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129567.863378:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1b800/0x40a459093b0693fc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129567.863485:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1b600/0x40a459093b069403 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129567.863491:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1b600/0x40a459093b069403 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129567.863496:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1b600/0x40a459093b069403 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00200000:2.0:1746129567.863504:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:2.0:1746129567.863586:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1b000/0x40a459093b0693f5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129567.863593:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1b000/0x40a459093b0693f5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129567.863602:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1b000/0x40a459093b0693f5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129567.863608:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ee1b000 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746129567.863611:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1b000/0x40a459093b0693f5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129567.863617:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1b000/0x40a459093b0693f5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129567.863627:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880132ef8f00) 00010000:00010000:2.0:1746129567.863629:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129567.863633:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1b000/0x40a459093b0693f5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129567.863638:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1b000/0x40a459093b0693f5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129567.863655:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1b800/0x40a459093b0693fc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129567.863661:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1b800/0x40a459093b0693fc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129567.863666:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1b800/0x40a459093b0693fc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129567.863670:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ee1b800 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746129567.863672:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1b800/0x40a459093b0693fc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129567.863676:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1b800/0x40a459093b0693fc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129567.863685:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f0e7400) 00010000:00010000:2.0:1746129567.863686:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129567.863689:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1b800/0x40a459093b0693fc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129567.863693:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1b800/0x40a459093b0693fc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129567.863729:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1a600/0x40a459093b0693ee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f209fd expref: 9 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129567.863740:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1b600/0x40a459093b069403 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f209fd expref: 8 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129567.863745:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:2.0:1746129567.863747:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746129567.863749:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ee1b600, rc 0) 00000100:00100000:3.0:1746129567.863889:0:2271:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11161 00000100:00100000:3.0:1746129567.863898:0:2271:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135725f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ada2ffba-8920-4ecb-8068-68caa9806978+288:32171:x1830948734020224:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:3.0:1746129567.863911:0:2271:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129567.863919:0:2271:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009efe9800/0x40a459093b069411 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20a04 expref: -99 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129567.863963:0:2271:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009efe8600/0x40a459093b069418 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129567.863970:0:2271:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009efe8600/0x40a459093b069418 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129567.863976:0:2271:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009efe8600/0x40a459093b069418 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129567.863986:0:2271:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009efe8400/0x40a459093b06941f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129567.863991:0:2271:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009efe8400/0x40a459093b06941f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129567.863997:0:2271:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009efe8400/0x40a459093b06941f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129567.864052:0:2271:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009efe8200/0x40a459093b069426 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129567.864058:0:2271:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009efe8200/0x40a459093b069426 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129567.864063:0:2271:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009efe8200/0x40a459093b069426 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00000004:00200000:3.0:1746129567.864068:0:2271:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:3.0:1746129567.864111:0:2271:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009efe8600/0x40a459093b069418 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129567.864115:0:2271:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009efe8600/0x40a459093b069418 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129567.864120:0:2271:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009efe8600/0x40a459093b069418 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129567.864123:0:2271:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009efe8600 already unused, calling callback (ffffffffa136e690) 00010000:00010000:3.0:1746129567.864126:0:2271:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009efe8600/0x40a459093b069418 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129567.864130:0:2271:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009efe8600/0x40a459093b069418 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129567.864136:0:2271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880132ef8f00) 00010000:00010000:3.0:1746129567.864139:0:2271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129567.864140:0:2271:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009efe8600/0x40a459093b069418 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129567.864144:0:2271:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009efe8600/0x40a459093b069418 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129567.864158:0:2271:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009efe8400/0x40a459093b06941f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129567.864163:0:2271:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009efe8400/0x40a459093b06941f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129567.864171:0:2271:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009efe8400/0x40a459093b06941f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129567.864175:0:2271:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009efe8400 already unused, calling callback (ffffffffa136e690) 00010000:00010000:3.0:1746129567.864177:0:2271:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009efe8400/0x40a459093b06941f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129567.864180:0:2271:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009efe8400/0x40a459093b06941f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129567.864185:0:2271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800900d1900) 00010000:00010000:3.0:1746129567.864187:0:2271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129567.864189:0:2271:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009efe8400/0x40a459093b06941f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129567.864193:0:2271:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009efe8400/0x40a459093b06941f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129567.864217:0:2271:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009efe9800/0x40a459093b069411 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20a04 expref: 291 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129567.864227:0:2271:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009efe8200/0x40a459093b069426 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20a04 expref: 290 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129567.864233:0:2271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:3.0:1746129567.864234:0:2271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746129567.864236:0:2271:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009efe8200, rc 0) 00000100:00100000:2.0:1746129567.866508:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135724e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+8:32172:x1830948734019968:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 3360us (6824us total) trans 8589945243 rc 0/0 00000100:00100000:2.0:1746129567.866524:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11160 00000100:00100000:3.0:1746129567.866806:0:2271:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135725f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ada2ffba-8920-4ecb-8068-68caa9806978+290:32171:x1830948734020224:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 2907us (3984us total) trans 8589945244 rc 0/0 00000100:00100000:3.0:1746129567.866814:0:2271:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11161 00000100:00100000:0.0:1746129567.871809:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129567.872232:0:2271:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734020480 00000100:00100000:3.0:1746129567.872242:0:2271:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734020480 00000100:00100000:3.0:1746129567.873252:0:2271:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11162 00000100:00100000:3.0:1746129567.873266:0:2271:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135724a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ada2ffba-8920-4ecb-8068-68caa9806978+290:32176:x1830948734020480:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129567.873307:0:2271:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129567.873330:0:2271:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009efe9800/0x40a459093b069434 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20a0b expref: -99 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129567.873445:0:2271:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009efe8400/0x40a459093b06943b lrc: 3/1,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129567.873459:0:2271:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009efe8400/0x40a459093b06943b lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129567.873470:0:2271:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009efe8400/0x40a459093b06943b lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00000004:00200000:3.0:1746129567.873480:0:2271:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:3.0:1746129567.873602:0:2271:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009efe9800/0x40a459093b069434 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20a0b expref: 293 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129567.873626:0:2271:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009efe8400/0x40a459093b06943b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20a0b expref: 292 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129567.873634:0:2271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:3.0:1746129567.873637:0:2271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1746129567.873640:0:2271:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009efe8400, rc 0) 00000100:00100000:3.0:1746129567.875614:0:2271:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135724a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ada2ffba-8920-4ecb-8068-68caa9806978+292:32176:x1830948734020480:12345-192.168.202.4@tcp:101:cat.0 Request processed in 2341us (3804us total) trans 8589945245 rc 0/0 00000100:00100000:3.0:1746129567.875626:0:2271:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11162 00000100:00100000:2.0:1746129567.875873:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129567.876180:0:2271:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734020736 00000100:00100000:3.0:1746129567.876189:0:2271:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734020736 00000100:00100000:3.0:1746129567.876225:0:2271:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11163 00000100:00100000:3.0:1746129567.876232:0:2271:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095627100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+8:32175:x1830948734020736:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129567.876259:0:2271:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129567.876276:0:2271:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009efe8600/0x40a459093b069449 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20a12 expref: -99 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129567.876426:0:2271:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d106600/0x40a459093b069450 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129567.876438:0:2271:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d106600/0x40a459093b069450 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129567.876449:0:2271:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d106600/0x40a459093b069450 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00000004:00200000:3.0:1746129567.876459:0:2271:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:3.0:1746129567.876574:0:2271:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009efe8600/0x40a459093b069449 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20a12 expref: 11 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129567.876591:0:2271:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d106600/0x40a459093b069450 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20a12 expref: 10 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129567.876598:0:2271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:3.0:1746129567.876601:0:2271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1746129567.876603:0:2271:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d106600, rc 0) 00000100:00100000:3.0:1746129567.876661:0:2271:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095627100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+10:32175:x1830948734020736:12345-192.168.202.4@tcp:101:cat.0 Request processed in 429us (788us total) trans 8589945246 rc 0/0 00000100:00100000:3.0:1746129567.876667:0:2271:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11163 00000100:00100000:0.0:1746129567.879937:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129567.880647:0:8410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734020864 00000100:00100000:3.0:1746129567.880657:0:8410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734020864 00000100:00100000:3.0:1746129567.880704:0:8410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15933 00000100:00100000:3.0:1746129567.880712:0:8410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092fd0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:32175:x1830948734020864:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129567.880731:0:8410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129567.880750:0:8410:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800909ce400/0x40a459093b06945e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20a19 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129567.880778:0:8410:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129567.880780:0:8410:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129567.880789:0:8410:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800909ce400/0x40a459093b06945e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20a19 expref: 21 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129567.880803:0:8410:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800909ce400/0x40a459093b06945e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20a19 expref: 21 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129567.880813:0:8410:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800909ce400, rc 0) 00000100:00100000:3.0:1746129567.880873:0:8410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092fd0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:32175:x1830948734020864:12345-192.168.202.4@tcp:101:cat.0 Request processed in 162us (949us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129567.880879:0:8410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15933 00000100:00100000:0.0:1746129567.882066:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129567.882193:0:4699:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734020992 00000100:00100000:2.0:1746129567.882199:0:4699:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734020992 00000100:00100000:2.0:1746129567.882235:0:4699:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15934 00000100:00100000:2.0:1746129567.882241:0:4699:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092fd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ada2ffba-8920-4ecb-8068-68caa9806978+33:32176:x1830948734020992:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129567.882252:0:4699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129567.882266:0:4699:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ee1b800/0x40a459093b069465 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20a20 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129567.882288:0:4699:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129567.882290:0:4699:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129567.882326:0:4699:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ee1b800/0x40a459093b069465 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20a20 expref: 34 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129567.882351:0:4699:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ee1b800/0x40a459093b069465 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20a20 expref: 34 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129567.882360:0:4699:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ee1b800, rc 0) 00000100:00100000:2.0:1746129567.882394:0:4699:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092fd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ada2ffba-8920-4ecb-8068-68caa9806978+34:32176:x1830948734020992:12345-192.168.202.4@tcp:101:cat.0 Request processed in 153us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129567.882399:0:4699:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15934 00000100:00100000:0.0:1746129567.884235:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129567.884622:0:31519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734021248 00000100:00100000:3.0:1746129567.884632:0:31519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734021248 00002000:00100000:3.0:1746129567.884687:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3ec:0x0] (0->1048575) req@ffff880092fd0000 x1830948734021248/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:308/0 lens 488/0 e 0 to 0 dl 1746129578 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129567.884697:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092fd0000 with x1830948734021248 ext(0->1048575) 00002000:00010000:3.0:1746129567.884703:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092fd0000 00000100:00100000:3.0:1746129567.884737:0:31519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7653 00000100:00100000:3.0:1746129567.884745:0:31519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092fd0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:1960:x1830948734021248:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129567.887382:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129567.892912:0:8417:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734021504 00000100:00100000:2.0:1746129567.892929:0:8417:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734021504 00002000:00100000:2.0:1746129567.892986:0:8417:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3ec:0x0] (0->1048575) req@ffff880094efce00 x1830948734021504/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:308/0 lens 488/0 e 0 to 0 dl 1746129578 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129567.892996:0:8417:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094efce00 with x1830948734021504 ext(0->1048575) 00002000:00010000:2.0:1746129567.893001:0:8417:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094efce00 00000100:00100000:2.0:1746129567.893032:0:8417:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7654 00000100:00100000:2.0:1746129567.893040:0:8417:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094efce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ada2ffba-8920-4ecb-8068-68caa9806978+34:1960:x1830948734021504:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129567.894965:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129567.895260:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734021760 00000100:00100000:2.0:1746129567.895267:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734021760 00000100:00100000:2.0:1746129567.895335:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11164 00000100:00100000:2.0:1746129567.895351:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094efed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ada2ffba-8920-4ecb-8068-68caa9806978+292:32171:x1830948734021760:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:2.0:1746129567.895377:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129567.895381:0:14549:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:2.0:1746129567.895409:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009efe8400/0x40a459093b06943b lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20a0b expref: 292 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129567.895458:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009efe8200/0x40a459093b069426 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20a04 expref: 291 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129567.895473:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:2.0:1746129567.895478:0:14549:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746129567.895490:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1aa00/0x40a459093b06946c lrc: 2/0,0 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20a27 expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129567.895548:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1ae00/0x40a459093b069473 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129567.895561:0:14549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009efe9600/0x40a459093b0693e7 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f209f6 expref: 7 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129567.895568:0:14549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d106600/0x40a459093b069450 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20a12 expref: 9 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129567.895575:0:14549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1b600/0x40a459093b069403 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f209fd expref: 9 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129567.895581:0:14549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1ae00/0x40a459093b069473 lrc: 6/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129567.895615:0:14549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1b600/0x40a459093b069403 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f209fd expref: 9 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129567.895628:0:14549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1b600/0x40a459093b069403 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f209fd expref: 9 pid: 14549 timeout: 923 lvb_type: 0 00000100:00100000:2.0:1746129567.895642:0:14549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095627480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830948737474944:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129567.895745:0:14549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009d106600/0x40a459093b069450 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20a12 expref: 9 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129567.895754:0:14549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d106600/0x40a459093b069450 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20a12 expref: 9 pid: 2271 timeout: 923 lvb_type: 0 00000100:00100000:2.0:1746129567.895762:0:14549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095625880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830948737475072:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129567.895798:0:14549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009efe9600/0x40a459093b0693e7 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f209f6 expref: 7 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129567.895806:0:14549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009efe9600/0x40a459093b0693e7 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f209f6 expref: 7 pid: 2271 timeout: 923 lvb_type: 0 00000100:00100000:2.0:1746129567.895814:0:14549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095626a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830948737475200:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129567.895837:0:14549:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0ac600 going to sleep for 11 seconds 00000100:00100000:2.0:1746129567.897806:0:31519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092fd0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:1960:x1830948734021248:12345-192.168.202.4@tcp:3:cat.0 Request processed in 13053us (13570us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129567.897818:0:31519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7653 00002000:00100000:2.0:1746129567.897830:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3ec:0x0] (0->1048575) req@ffff880092fd0000 x1830948734021248/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:308/0 lens 488/440 e 0 to 0 dl 1746129578 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129567.897839:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092fd0000 with x1830948734021248 ext(0->1048575) 00002000:00010000:2.0:1746129567.897844:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092fd0000 00000100:00100000:2.0:1746129567.907809:0:8417:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094efce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ada2ffba-8920-4ecb-8068-68caa9806978+34:1960:x1830948734021504:12345-192.168.202.4@tcp:3:cat.0 Request processed in 14757us (20423us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129567.907822:0:8417:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7654 00002000:00100000:2.0:1746129567.907834:0:8417:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3ec:0x0] (0->1048575) req@ffff880094efce00 x1830948734021504/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:308/0 lens 488/440 e 0 to 0 dl 1746129578 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129567.907845:0:8417:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094efce00 with x1830948734021504 ext(0->1048575) 00002000:00010000:2.0:1746129567.907851:0:8417:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094efce00 00000100:00100000:3.0:1746129567.908402:0:14549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095627480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830948737474944:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129567.909448:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129567.909467:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129567.909493:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129567.909526:0:20578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734021888 00000100:00100000:0.0:1746129567.909533:0:20578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734021888 00010000:00010000:0.0:1746129567.909566:0:20578:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1b600/0x40a459093b069403 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f209fd expref: 10 pid: 14549 timeout: 923 lvb_type: 0 00000100:00100000:0.0:1746129567.909588:0:20578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734022144 00000100:00100000:0.0:1746129567.909589:0:20578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734022144 00010000:00010000:0.0:1746129567.909598:0:20578:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009efe9600/0x40a459093b0693e7 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f209f6 expref: 8 pid: 2271 timeout: 923 lvb_type: 0 00000100:00100000:0.0:1746129567.909609:0:20578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734022016 00000100:00100000:0.0:1746129567.909610:0:20578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734022016 00010000:00010000:0.0:1746129567.909617:0:20578:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d106600/0x40a459093b069450 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20a12 expref: 11 pid: 2271 timeout: 923 lvb_type: 0 00000100:00100000:0.0:1746129567.909629:0:20578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8146 00000100:00100000:0.0:1746129567.909635:0:20578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+11:1963:x1830948734021888:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129567.909648:0:20578:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129567.909654:0:20578:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1b600/0x40a459093b069403 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f209fd expref: 11 pid: 14549 timeout: 923 lvb_type: 0 00010000:00010000:0.0:1746129567.909665:0:20578:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1b600/0x40a459093b069403 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f209fd expref: 11 pid: 14549 timeout: 923 lvb_type: 0 00010000:00010000:0.0:1746129567.909687:0:20578:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1b600/0x40a459093b069403 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f209fd expref: 11 pid: 14549 timeout: 923 lvb_type: 0 00010000:00010000:0.0:1746129567.909705:0:20578:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:0.0:1746129567.909711:0:20578:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1ae00/0x40a459093b069473 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129567.909718:0:20578:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1ae00/0x40a459093b069473 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129567.909723:0:20578:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129567.909752:0:20578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+10:1963:x1830948734021888:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 117us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129567.909757:0:20578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8146 00000100:00100000:0.0:1746129567.909768:0:20578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8147 00000100:00100000:0.0:1746129567.909772:0:20578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094efca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:068dab75-d300-4ead-a742-d14572ad1e50+8:1963:x1830948734022144:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129567.909778:0:20578:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129567.909781:0:20578:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009efe9600/0x40a459093b0693e7 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f209f6 expref: 8 pid: 2271 timeout: 923 lvb_type: 0 00010000:00010000:0.0:1746129567.909788:0:20578:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009efe9600/0x40a459093b0693e7 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f209f6 expref: 8 pid: 2271 timeout: 923 lvb_type: 0 00010000:00010000:0.0:1746129567.909796:0:20578:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:0.0:1746129567.909799:0:20578:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1ae00/0x40a459093b069473 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129567.909803:0:20578:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1ae00/0x40a459093b069473 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129567.909807:0:20578:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129567.909816:0:20578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094efca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:068dab75-d300-4ead-a742-d14572ad1e50+8:1963:x1830948734022144:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 43us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129567.909820:0:20578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8147 00000100:00100000:0.0:1746129567.909827:0:20578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8148 00000100:00100000:0.0:1746129567.909831:0:20578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094efdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+9:1963:x1830948734022016:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129567.909835:0:20578:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129567.909838:0:20578:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009d106600/0x40a459093b069450 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20a12 expref: 9 pid: 2271 timeout: 923 lvb_type: 0 00010000:00010000:0.0:1746129567.909845:0:20578:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009d106600/0x40a459093b069450 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20a12 expref: 9 pid: 2271 timeout: 923 lvb_type: 0 00010000:00010000:0.0:1746129567.909853:0:20578:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:0.0:1746129567.909855:0:20578:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1ae00/0x40a459093b069473 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129567.909861:0:20578:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1ae00/0x40a459093b069473 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129567.909867:0:20578:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1ae00/0x40a459093b069473 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129567.909880:0:20578:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129567.909889:0:20578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094efdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+9:1963:x1830948734022016:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 58us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129567.909894:0:20578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8148 00000100:00100000:0.0:1746129567.913963:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129567.914017:0:8410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734022272 00000100:00100000:2.0:1746129567.914026:0:8410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734022272 00000100:00100000:0.0:1746129567.914047:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129567.914073:0:8410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15935 00000100:00100000:2.0:1746129567.914081:0:8410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+15:32175:x1830948734022272:12345-192.168.202.4@tcp:101:cat.0 00000100:00100000:0.0:1746129567.914093:0:2271:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734022400 00000100:00100000:0.0:1746129567.914097:0:2271:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734022400 00010000:00010000:2.0:1746129567.914099:0:8410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129567.914117:0:8410:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c16a600/0x40a459093b06947a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20a2e expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129567.914122:0:2271:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11165 00000100:00100000:0.0:1746129567.914127:0:2271:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+9:32172:x1830948734022400:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:2.0:1746129567.914143:0:8410:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129567.914145:0:8410:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129567.914145:0:2271:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129567.914154:0:8410:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c16a600/0x40a459093b06947a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20a2e expref: 16 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129567.914157:0:2271:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d863a00/0x40a459093b069481 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20a35 expref: -99 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129567.914169:0:8410:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c16a600/0x40a459093b06947a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20a2e expref: 16 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129567.914181:0:8410:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c16a600, rc 0) 00010000:00010000:0.0:1746129567.914209:0:2271:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1ae00/0x40a459093b069473 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129567.914216:0:2271:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d863a00/0x40a459093b069481 lrc: 4/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20a35 expref: 10 pid: 2271 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129567.914231:0:8410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+16:32175:x1830948734022272:12345-192.168.202.4@tcp:101:cat.0 Request processed in 150us (279us total) trans 0 rc 0/0 00010000:00010000:0.0:1746129567.914231:0:2271:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1ae00/0x40a459093b069473 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 14549 initiator: MDT0 00000100:00100000:2.0:1746129567.914237:0:8410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15935 00010000:00010000:0.0:1746129567.914241:0:2271:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d863a00/0x40a459093b069481 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20a35 expref: 10 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129567.914251:0:2271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:0.0:1746129567.914254:0:2271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746129567.914256:0:2271:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d863a00/0x40a459093b069481 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20a35 expref: 10 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129567.914262:0:2271:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d863a00, rc 0) 00000100:00100000:0.0:1746129567.914277:0:2271:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+10:32172:x1830948734022400:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 150us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129567.914281:0:2271:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11165 00010000:00010000:3.0:1746129567.914520:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d106600/0x40a459093b069450 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20a12 expref: 9 pid: 2271 timeout: 923 lvb_type: 0 00000100:00100000:3.0:1746129567.914548:0:14549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095625880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830948737475072:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129567.914562:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009efe9600/0x40a459093b0693e7 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f209f6 expref: 7 pid: 2271 timeout: 923 lvb_type: 0 00000100:00100000:3.0:1746129567.914570:0:14549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095626a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830948737475200:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129567.914594:0:14549:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1ae00/0x40a459093b069473 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129567.914600:0:14549:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1ae00/0x40a459093b069473 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129567.914604:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1ae00/0x40a459093b069473 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14549 initiator: MDT0 00000040:00080000:3.0:1746129567.915151:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3436, 88 off289096 00000004:00080000:3.0:1746129567.915157:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 823231862429ns, next at 776349687452ns, rc = 0 00000040:00080000:3.0:1746129567.915202:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3452, 88 off290416 00000004:00080000:3.0:1746129567.915205:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 823231910978ns, next at 776375382381ns, rc = 0 00000040:00080000:3.0:1746129567.915214:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3453, 88 off290504 00000004:00080000:3.0:1746129567.915216:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 823231922339ns, next at 776375382381ns, rc = 0 00000040:00080000:3.0:1746129567.915222:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3437, 88 off289184 00000004:00080000:3.0:1746129567.915225:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 823231930935ns, next at 776349687452ns, rc = 0 00000040:00080000:3.0:1746129567.915230:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3438, 88 off289272 00000004:00080000:3.0:1746129567.915233:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 823231939168ns, next at 776349687452ns, rc = 0 00000040:00080000:3.0:1746129567.915239:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3454, 88 off290592 00000004:00080000:3.0:1746129567.915241:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 823231946993ns, next at 776375382381ns, rc = 0 00000040:00080000:3.0:1746129567.915246:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3455, 88 off290680 00000004:00080000:3.0:1746129567.915249:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 823231955049ns, next at 776375382381ns, rc = 0 00000040:00080000:3.0:1746129567.915255:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3456, 88 off290768 00000004:00080000:3.0:1746129567.915257:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 823231963499ns, next at 776375382381ns, rc = 0 00000040:00080000:3.0:1746129567.915263:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3439, 88 off289360 00000004:00080000:3.0:1746129567.915265:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 823231971754ns, next at 776349687452ns, rc = 0 00000040:00080000:3.0:1746129567.915271:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3457, 88 off290856 00000004:00080000:3.0:1746129567.915274:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 823231979892ns, next at 776375382381ns, rc = 0 00000040:00080000:3.0:1746129567.915279:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3440, 88 off289448 00000004:00080000:3.0:1746129567.915281:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 823231987472ns, next at 776349687452ns, rc = 0 00000040:00080000:3.0:1746129567.915287:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3458, 88 off290944 00000004:00080000:3.0:1746129567.915289:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 823231995188ns, next at 776375382381ns, rc = 0 00000040:00080000:3.0:1746129567.915316:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3441, 88 off289536 00000004:00080000:3.0:1746129567.915319:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 823232025554ns, next at 776349687452ns, rc = 0 00000040:00080000:3.0:1746129567.915327:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3442, 88 off289624 00000004:00080000:3.0:1746129567.915329:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 823232035369ns, next at 776349687452ns, rc = 0 00000040:00080000:3.0:1746129567.915335:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3443, 88 off289712 00000004:00080000:3.0:1746129567.915337:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 823232043238ns, next at 776349687452ns, rc = 0 00000040:00080000:3.0:1746129567.915352:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3444, 88 off289800 00000004:00080000:3.0:1746129567.915355:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 823232061035ns, next at 776349687452ns, rc = 0 00000040:00080000:3.0:1746129567.915362:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3459, 88 off291032 00000004:00080000:3.0:1746129567.915365:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 823232070808ns, next at 776375382381ns, rc = 0 00000100:00100000:0.0:1746129567.918626:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129567.918745:0:8410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734022528 00000100:00100000:2.0:1746129567.918755:0:8410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734022528 00000100:00100000:2.0:1746129567.918802:0:8410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15936 00000100:00100000:2.0:1746129567.918811:0:8410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ada2ffba-8920-4ecb-8068-68caa9806978+31:32176:x1830948734022528:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129567.918832:0:8410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129567.918852:0:8410:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ee1a800/0x40a459093b069488 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20a3c expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129567.918883:0:8410:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129567.918884:0:8410:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129567.918893:0:8410:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ee1a800/0x40a459093b069488 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20a3c expref: 32 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129567.918907:0:8410:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ee1a800/0x40a459093b069488 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20a3c expref: 32 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129567.918917:0:8410:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ee1a800, rc 0) 00000100:00100000:2.0:1746129567.918986:0:8410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ada2ffba-8920-4ecb-8068-68caa9806978+32:32176:x1830948734022528:12345-192.168.202.4@tcp:101:cat.0 Request processed in 177us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129567.918992:0:8410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15936 00000100:00100000:0.0:1746129567.920802:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129567.921528:0:14547:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734022656 00000100:00100000:2.0:1746129567.921537:0:14547:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734022656 00000100:00100000:2.0:1746129567.921576:0:14547:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11166 00000100:00100000:2.0:1746129567.921584:0:14547:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ada2ffba-8920-4ecb-8068-68caa9806978+293:32176:x1830948734022656:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129567.921602:0:14547:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129567.921618:0:14547:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1a600/0x40a459093b06948f lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20a43 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129567.921676:0:14547:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1a600/0x40a459093b06948f lrc: 3/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20a43 expref: 294 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129567.921687:0:14547:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1a600/0x40a459093b06948f lrc: 3/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20a43 expref: 294 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129567.921699:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:2.0:1746129567.921702:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746129567.921705:0:14547:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d863a00/0x40a459093b069481 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20a35 expref: 8 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129567.921711:0:14547:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ee1a600, rc 0) 00000100:00100000:2.0:1746129567.921753:0:14547:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ada2ffba-8920-4ecb-8068-68caa9806978+294:32176:x1830948734022656:12345-192.168.202.4@tcp:101:cat.0 Request processed in 170us (956us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129567.921759:0:14547:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11166 00010000:00010000:0.0:1746129567.935363:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1ae00/0x40a459093b069473 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20a27 expref: 294 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129567.935385:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:0.0:1746129567.935388:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1746129567.935393:0:14549:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d863a00/0x40a459093b069481 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20a35 expref: 8 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129567.935405:0:14549:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d863a00/0x40a459093b069481 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20a35 expref: 8 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129567.935412:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d863a00/0x40a459093b069481 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20a35 expref: 8 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129567.935419:0:14549:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1a600/0x40a459093b06948f lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20a43 expref: 294 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129567.935424:0:14549:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1a600/0x40a459093b06948f lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20a43 expref: 294 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129567.935430:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1a600/0x40a459093b06948f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20a43 expref: 294 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129567.935474:0:14549:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1a600/0x40a459093b06948f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20a43 expref: 294 pid: 14547 timeout: 0 lvb_type: 0 00000001:00080000:1.0:1746129567.935489:0:14619:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945243 is committed 00000100:00100000:0.0:1746129567.935490:0:14549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012baeed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830948737475328:192.168.202.4@tcp:105: 00000001:00080000:1.0:1746129567.935502:0:14619:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945247 is committed 00000004:00080000:1.0:1746129567.935506:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2629 committed 00000004:00080000:1.0:1746129567.935515:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2614 committed 00000004:00080000:1.0:1746129567.935522:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2613 committed 00000004:00080000:1.0:1746129567.935523:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2612 committed 00000004:00080000:1.0:1746129567.935525:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2611 committed 00000004:00080000:1.0:1746129567.935526:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2628 committed 00000004:00080000:1.0:1746129567.935528:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2610 committed 00000004:00080000:1.0:1746129567.935529:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2627 committed 00000004:00080000:1.0:1746129567.935530:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2609 committed 00000004:00080000:1.0:1746129567.935532:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2626 committed 00000004:00080000:1.0:1746129567.935533:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2625 committed 00000004:00080000:1.0:1746129567.935534:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2624 committed 00000004:00080000:1.0:1746129567.935535:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2608 committed 00000004:00080000:1.0:1746129567.935537:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2607 committed 00000004:00080000:1.0:1746129567.935539:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2623 committed 00000004:00080000:1.0:1746129567.935541:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2622 committed 00000004:00080000:1.0:1746129567.935542:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2606 committed 00000001:00080000:1.0:1746129567.935547:0:14619:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945246 is committed 00000001:00080000:1.0:1746129567.935559:0:14619:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945242 is committed 00010000:00010000:0.0:1746129567.935595:0:14549:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012d863a00/0x40a459093b069481 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20a35 expref: 6 pid: 2271 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129567.935606:0:14549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012baed180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830948737475584:192.168.202.4@tcp:105: 00000100:00100000:0.0:1746129567.935625:0:14549:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a000c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746129567.935776:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fbaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737475968:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129567.935814:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129567.935833:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cda5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737476480:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129567.935838:0:4699:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737475968 00000100:00100000:0.0:1746129567.935845:0:4699:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737475968 00000100:00100000:1.0:1746129567.935846:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129567.935855:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ea91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737476992:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129567.935868:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129567.935879:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093edd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737477504:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129567.935880:0:4699:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737476480 00000100:00100000:0.0:1746129567.935883:0:4699:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737476480 00000100:00100000:1.0:1746129567.935890:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129567.935895:0:4699:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737476992 00000100:00100000:0.0:1746129567.935897:0:4699:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737476992 00000100:00100000:1.0:1746129567.935903:0:3302:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:1.0:1746129567.935907:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737475456:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129567.935910:0:4699:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737477504 00000100:00100000:0.0:1746129567.935911:0:4699:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737477504 00000100:00100000:1.0:1746129567.935918:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129567.935922:0:4699:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737475456 00000100:00100000:0.0:1746129567.935924:0:4699:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737475456 00000100:00100000:1.0:1746129567.935927:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fbac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737476096:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129567.935937:0:4699:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15937 00000100:00100000:1.0:1746129567.935938:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129567.935943:0:4699:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cda4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+47:3302:x1830948737475968:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129567.935947:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012baef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737476608:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129567.935960:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129567.935968:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093edc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737477120:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129567.935980:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129567.935991:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737475712:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129567.936006:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129567.936013:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fbae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737476224:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129567.936025:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129567.936031:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ea93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737476736:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129567.936041:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129567.936047:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093edd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737477248:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129567.936057:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129567.936064:0:3300:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:1.0:1746129567.936067:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fbaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737475840:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129567.936079:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129567.936084:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009feed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737476352:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129567.936095:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129567.936101:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ea91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737476864:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129567.936113:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129567.936119:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093edfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737477376:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129567.936129:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:0.0:1746129567.936130:0:4699:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746129567.936133:0:4699:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb mtime from disk: 1746129523 -> 1746129523 00002000:00010000:0.0:1746129567.936135:0:4699:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb atime from disk: 1746129523 -> 1746129523 00002000:00010000:0.0:1746129567.936137:0:4699:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb ctime from disk: 1746129524 -> 1746129524 00002000:00010000:0.0:1746129567.936139:0:4699:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1746129567.936146:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737476096 00000100:00100000:1.0:1746129567.936149:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737476096 00000100:00100000:1.0:1746129567.936161:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737476608 00000100:00100000:1.0:1746129567.936162:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737476608 00000100:00100000:1.0:1746129567.936168:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737477120 00000100:00100000:0.0:1746129567.936168:0:4699:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cda4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+49:3302:x1830948737475968:12345-0@lo:2:osp-syn-1-0.0 Request processed in 225us (354us total) trans 17179874072 rc 0/0 00000100:00100000:1.0:1746129567.936170:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737477120 00000100:00100000:0.0:1746129567.936175:0:4699:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15937 00000100:00100000:1.0:1746129567.936184:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737475712 00000100:00100000:1.0:1746129567.936185:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737475712 00000100:00100000:0.0:1746129567.936188:0:4699:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737476224 00000100:00100000:0.0:1746129567.936190:0:4699:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737476224 00000100:00100000:1.0:1746129567.936191:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737476736 00000100:00100000:1.0:1746129567.936193:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737476736 00000100:00100000:0.0:1746129567.936196:0:4699:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737477248 00000100:00100000:0.0:1746129567.936197:0:4699:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737477248 00000100:00100000:1.0:1746129567.936198:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737475840 00000100:00100000:1.0:1746129567.936200:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737475840 00000100:00100000:1.0:1746129567.936204:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737476864 00000100:00100000:0.0:1746129567.936204:0:4699:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737476352 00000100:00100000:0.0:1746129567.936205:0:4699:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737476352 00000100:00100000:1.0:1746129567.936206:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737476864 00000100:00100000:0.0:1746129567.936211:0:4699:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737477376 00000100:00100000:0.0:1746129567.936212:0:4699:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737477376 00000100:00100000:1.0:1746129567.936214:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15938 00000100:00100000:1.0:1746129567.936217:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cda5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+52:3302:x1830948737476480:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129567.936220:0:4699:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15939 00000100:00100000:0.0:1746129567.936223:0:4699:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cda4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+57:3302:x1830948737476992:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129567.936329:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cda5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+53:3302:x1830948737476480:12345-0@lo:2:osp-syn-1-0.0 Request processed in 110us (480us total) trans 17179874073 rc 0/0 00000100:00100000:1.0:1746129567.936334:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15938 00000100:00100000:0.0:1746129567.936334:0:4699:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cda4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+58:3302:x1830948737476992:12345-0@lo:2:osp-syn-0-0.0 Request processed in 110us (464us total) trans 21474841315 rc 0/0 00000100:00100000:0.0:1746129567.936350:0:4699:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15939 00000100:00100000:1.0:1746129567.936354:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15940 00000100:00100000:0.0:1746129567.936358:0:4699:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15941 00000100:00100000:1.0:1746129567.936359:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cda5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+57:3302:x1830948737477504:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129567.936362:0:4699:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cda6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+52:3302:x1830948737475456:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746129567.936428:0:4699:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746129567.936431:0:4699:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb mtime from disk: 1746129568 -> 1746129568 00000100:00100000:1.0:1746129567.936432:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cda5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+58:3302:x1830948737477504:12345-0@lo:2:osp-syn-0-0.0 Request processed in 73us (540us total) trans 21474841316 rc 0/0 00002000:00010000:0.0:1746129567.936432:0:4699:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb atime from disk: 1746129568 -> 1746129568 00002000:00010000:0.0:1746129567.936434:0:4699:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb ctime from disk: 1746129568 -> 1746129568 00002000:00010000:0.0:1746129567.936436:0:4699:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746129567.936437:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15940 00000100:00100000:1.0:1746129567.936446:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15942 00000100:00100000:1.0:1746129567.936450:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cda7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+53:3302:x1830948737476096:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129567.936451:0:4699:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cda6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+53:3302:x1830948737475456:12345-0@lo:2:osp-syn-1-0.0 Request processed in 89us (531us total) trans 17179874074 rc 0/0 00000100:00100000:0.0:1746129567.936455:0:4699:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15941 00000100:00100000:0.0:1746129567.936463:0:4699:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15943 00000100:00100000:0.0:1746129567.936467:0:4699:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009016a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+57:3302:x1830948737476608:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129567.936518:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cda7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+53:3302:x1830948737476096:12345-0@lo:2:osp-syn-1-0.0 Request processed in 67us (579us total) trans 17179874075 rc 0/0 00000100:00100000:1.0:1746129567.936523:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15942 00002000:00010000:0.0:1746129567.936528:0:4699:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3ec:0x0] updating lvb size from disk: 1048576 -> 1048576 00000100:00100000:1.0:1746129567.936531:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15944 00002000:00010000:0.0:1746129567.936531:0:4699:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ec:0x0] updating lvb mtime from disk: 1746129568 -> 1746129568 00002000:00010000:0.0:1746129567.936532:0:4699:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3ec:0x0] updating lvb atime from disk: 1746129568 -> 1746129568 00002000:00010000:0.0:1746129567.936534:0:4699:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ec:0x0] updating lvb ctime from disk: 1746129568 -> 1746129568 00000100:00100000:1.0:1746129567.936535:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090168a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+58:3302:x1830948737477120:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746129567.936536:0:4699:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3ec:0x0] updating lvb blocks from disk: 1981 -> 1981 00000100:00100000:0.0:1746129567.936552:0:4699:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009016a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+58:3302:x1830948737476608:12345-0@lo:2:osp-syn-0-0.0 Request processed in 86us (592us total) trans 21474841317 rc 0/0 00000100:00100000:0.0:1746129567.936560:0:4699:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15943 00000100:00100000:0.0:1746129567.936568:0:4699:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15945 00000100:00100000:0.0:1746129567.936572:0:4699:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bf7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+52:3300:x1830948737475712:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129567.936602:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090168a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+58:3302:x1830948737477120:12345-0@lo:2:osp-syn-0-0.0 Request processed in 66us (620us total) trans 21474841318 rc 0/0 00000100:00100000:1.0:1746129567.936606:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15944 00000100:00100000:1.0:1746129567.936615:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15946 00000100:00100000:1.0:1746129567.936618:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090169f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+52:3300:x1830948737476224:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129567.936632:0:22481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15947 00000100:00100000:1.0:1746129567.936635:0:22481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090169880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+57:3300:x1830948737476736:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746129567.936639:0:4699:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746129567.936641:0:4699:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb mtime from disk: 1746129568 -> 1746129568 00002000:00010000:0.0:1746129567.936643:0:4699:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb atime from disk: 1746129568 -> 1746129568 00002000:00010000:0.0:1746129567.936645:0:4699:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb ctime from disk: 1746129568 -> 1746129568 00002000:00010000:0.0:1746129567.936646:0:4699:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746129567.936666:0:4699:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bf7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+53:3300:x1830948737475712:12345-0@lo:2:osp-syn-1-0.0 Request processed in 93us (659us total) trans 17179874076 rc 0/0 00000100:00100000:0.0:1746129567.936671:0:4699:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15945 00002000:00010000:1.0:1746129567.936708:0:22481:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746129567.936711:0:22481:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb mtime from disk: 1746129568 -> 1746129568 00002000:00010000:1.0:1746129567.936712:0:22481:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb atime from disk: 1746129568 -> 1746129568 00002000:00010000:1.0:1746129567.936714:0:22481:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb ctime from disk: 1746129568 -> 1746129568 00002000:00010000:1.0:1746129567.936715:0:22481:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:1.0:1746129567.936731:0:22481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090169880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+58:3300:x1830948737476736:12345-0@lo:2:osp-syn-0-0.0 Request processed in 95us (688us total) trans 21474841319 rc 0/0 00000100:00100000:1.0:1746129567.936735:0:22481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15947 00000100:00100000:1.0:1746129567.936743:0:22481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15948 00000100:00100000:1.0:1746129567.936746:0:22481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009016b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+57:3300:x1830948737477248:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129567.936787:0:4699:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15949 00000100:00100000:0.0:1746129567.936791:0:4699:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009016a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+52:3300:x1830948737475840:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129567.936810:0:22481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009016b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+58:3300:x1830948737477248:12345-0@lo:2:osp-syn-0-0.0 Request processed in 63us (752us total) trans 21474841320 rc 0/0 00000100:00100000:1.0:1746129567.936815:0:22481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15948 00000100:00100000:1.0:1746129567.936823:0:22481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15950 00000100:00100000:1.0:1746129567.936827:0:22481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090169180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+52:3300:x1830948737476352:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746129567.936855:0:4699:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3f5:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746129567.936858:0:4699:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f5:0x0] updating lvb mtime from disk: 1746129568 -> 1746129568 00002000:00010000:0.0:1746129567.936860:0:4699:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f5:0x0] updating lvb atime from disk: 1746129568 -> 1746129568 00002000:00010000:0.0:1746129567.936861:0:4699:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f5:0x0] updating lvb ctime from disk: 1746129568 -> 1746129568 00002000:00010000:0.0:1746129567.936863:0:4699:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f5:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:0.0:1746129567.936880:0:4699:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009016a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+54:3300:x1830948737475840:12345-0@lo:2:osp-syn-1-0.0 Request processed in 89us (800us total) trans 17179874077 rc 0/0 00000100:00100000:0.0:1746129567.936885:0:4699:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15949 00000100:00100000:1.0:1746129567.936887:0:22481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090169180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+54:3300:x1830948737476352:12345-0@lo:2:osp-syn-1-0.0 Request processed in 60us (791us total) trans 17179874078 rc 0/0 00000100:00100000:1.0:1746129567.936892:0:22481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15950 00000100:00100000:0.0:1746129567.936894:0:4699:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15951 00000100:00100000:0.0:1746129567.936898:0:4699:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800912ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+57:3300:x1830948737476864:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129567.936899:0:22481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15952 00000100:00100000:1.0:1746129567.936902:0:22481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800912af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+57:3300:x1830948737477376:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746129567.936943:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fbaed80/2, rc 0, transno 17179874077 00000100:00100000:1.0:1746129567.936948:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fbaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737475840:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746129567.936954:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009feed180/2, rc 0, transno 17179874078 00000100:00100000:1.0:1746129567.936957:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009feed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737476352:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746129567.936963:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c7db480/2, rc 0, transno 17179874076 00002000:00010000:0.0:1746129567.936965:0:4699:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb size from disk: 5146336 -> 5146336 00000100:00100000:1.0:1746129567.936966:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737475712:0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746129567.936968:0:4699:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb mtime from disk: 1746129568 -> 1746129568 00002000:00010000:0.0:1746129567.936970:0:4699:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb atime from disk: 1746129568 -> 1746129568 00000004:00080000:1.0:1746129567.936972:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ea93800/2, rc 0, transno 21474841319 00002000:00010000:0.0:1746129567.936972:0:4699:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb ctime from disk: 1746129568 -> 1746129568 00002000:00010000:0.0:1746129567.936974:0:4699:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb blocks from disk: 6033 -> 6033 00000100:00100000:1.0:1746129567.936979:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ea93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737476736:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746129567.936984:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093edd880/2, rc 0, transno 21474841320 00000100:00100000:1.0:1746129567.936987:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093edd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737477248:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129567.936991:0:4699:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800912ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+58:3300:x1830948737476864:12345-0@lo:2:osp-syn-0-0.0 Request processed in 93us (877us total) trans 21474841321 rc 0/0 00000004:00080000:1.0:1746129567.936994:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ea91f80/2, rc 0, transno 21474841321 00000100:00100000:1.0:1746129567.936996:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ea91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737476864:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129567.936996:0:4699:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15951 00000004:00080000:1.0:1746129567.937031:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c7dbb80/2, rc 0, transno 17179874074 00000100:00100000:1.0:1746129567.937034:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737475456:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746129567.937039:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fbac700/2, rc 0, transno 17179874075 00000100:00100000:1.0:1746129567.937041:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fbac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737476096:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746129567.937047:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012baef100/2, rc 0, transno 21474841317 00000100:00100000:1.0:1746129567.937049:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012baef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737476608:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746129567.937053:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093edc380/2, rc 0, transno 21474841318 00000100:00100000:1.0:1746129567.937056:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093edc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737477120:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746129567.937061:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fbaf100/2, rc 0, transno 17179874072 00000100:00100000:1.0:1746129567.937062:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fbaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737475968:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746129567.937067:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012cda5c00/2, rc 0, transno 17179874073 00000100:00100000:1.0:1746129567.937069:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cda5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737476480:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746129567.937073:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ea91500/2, rc 0, transno 21474841315 00000100:00100000:1.0:1746129567.937075:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ea91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737476992:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746129567.937080:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093edd500/2, rc 0, transno 21474841316 00000100:00100000:1.0:1746129567.937083:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093edd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737477504:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129567.937088:0:3302:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1746129567.937092:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737477632:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129567.937108:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129567.937124:0:20577:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737477632 00000100:00100000:0.0:1746129567.937127:0:20577:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737477632 00000100:00100000:0.0:1746129567.937143:0:20577:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15953 00000100:00100000:0.0:1746129567.937147:0:20577:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+58:3302:x1830948737477632:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746129567.937167:0:22481:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746129567.937169:0:22481:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1746129567.937171:0:22481:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746129567.937172:0:22481:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1746129567.937174:0:22481:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1746129567.937194:0:22481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800912af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+60:3300:x1830948737477376:12345-0@lo:2:osp-syn-0-0.0 Request processed in 291us (1063us total) trans 21474841322 rc 0/0 00000100:00100000:1.0:1746129567.937199:0:22481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15952 00000004:00080000:1.0:1746129567.937215:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093edfb80/2, rc 0, transno 21474841322 00000100:00100000:1.0:1746129567.937218:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093edfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737477376:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129567.937221:0:20577:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+59:3302:x1830948737477632:12345-0@lo:2:osp-syn-0-0.0 Request processed in 73us (112us total) trans 21474841323 rc 0/0 00000100:00100000:0.0:1746129567.937226:0:20577:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15953 00000004:00080000:1.0:1746129567.937227:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880090e6c380/2, rc 0, transno 21474841323 00000100:00100000:1.0:1746129567.937229:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737477632:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129567.937324:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090169f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+53:3300:x1830948737476224:12345-0@lo:2:osp-syn-1-0.0 Request processed in 704us (1297us total) trans 17179874079 rc 0/0 00000100:00100000:1.0:1746129567.937329:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15946 00000004:00080000:0.0:1746129567.937362:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fbae300/2, rc 0, transno 17179874079 00000100:00100000:0.0:1746129567.937365:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fbae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737476224:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129567.939055:0:14549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012baeed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830948737475328:192.168.202.4@tcp:105: 00000100:00100000:2.0:1746129567.939068:0:14549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012baed180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830948737475584:192.168.202.4@tcp:105: 00010000:00010000:2.0:1746129567.939115:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1aa00/0x40a459093b06946c lrc: 0/0,0 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20a27 expref: 291 pid: 14549 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1746129567.939134:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1ae00/0x40a459093b069473 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20a27 expref: 290 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129567.939169:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ee1ae00, rc 0) 00000100:00100000:2.0:1746129567.939217:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094efed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ada2ffba-8920-4ecb-8068-68caa9806978+290:32171:x1830948734021760:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 43866us (44262us total) trans 8589945247 rc 0/0 00000100:00100000:2.0:1746129567.939225:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11164 00000100:00100000:0.0:1746129567.939630:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129567.939704:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129567.939860:0:14551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734022784 00000100:00100000:3.0:1746129567.939866:0:14551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734022784 00000100:00100000:3.0:1746129567.939905:0:14551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734022912 00000100:00100000:3.0:1746129567.939906:0:14551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734022912 00000100:00100000:3.0:1746129567.939920:0:14551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4723 00000100:00100000:3.0:1746129567.939926:0:14551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093eddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ada2ffba-8920-4ecb-8068-68caa9806978+290:32176:x1830948734022784:12345-192.168.202.4@tcp:49:cat.0 00000100:00100000:3.0:1746129567.940010:0:14551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093eddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ada2ffba-8920-4ecb-8068-68caa9806978+290:32176:x1830948734022784:12345-192.168.202.4@tcp:49:cat.0 Request processed in 83us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129567.940016:0:14551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4723 00000100:00100000:3.0:1746129567.940028:0:14551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4724 00000100:00100000:3.0:1746129567.940033:0:14551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093edca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+7:32172:x1830948734022912:12345-192.168.202.4@tcp:49:multiop.0 00000100:00100000:3.0:1746129567.940066:0:14551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093edca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+7:32172:x1830948734022912:12345-192.168.202.4@tcp:49:multiop.0 Request processed in 33us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129567.940072:0:14551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4724 00000100:00100000:0.0:1746129567.940694:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129567.941365:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734023040 00000100:00100000:2.0:1746129567.941372:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734023040 00000100:00100000:2.0:1746129567.941837:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11167 00000100:00100000:2.0:1746129567.941846:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093edc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+7:32175:x1830948734023040:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129567.941861:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129567.941879:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6dd3a00/0x40a459093b069496 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20a4a expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129567.941935:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6dd3a00/0x40a459093b069496 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20a4a expref: 8 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129567.941949:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6dd3a00/0x40a459093b069496 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20a4a expref: 8 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129567.941964:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:2.0:1746129567.941967:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746129567.941971:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6dd3a00, rc 0) 00000100:00100000:2.0:1746129567.942022:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093edc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+8:32175:x1830948734023040:12345-192.168.202.4@tcp:101:cat.0 Request processed in 177us (1329us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129567.942027:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11167 00000100:00100000:0.0:1746129567.943528:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129567.943639:0:16680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734023168 00000100:00100000:1.0:1746129567.943650:0:16680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734023168 00000100:00100000:1.0:1746129567.943769:0:16680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4725 00000100:00100000:1.0:1746129567.943777:0:16680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093edf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ada2ffba-8920-4ecb-8068-68caa9806978+290:32171:x1830948734023168:12345-192.168.202.4@tcp:49:multiop.0 00000100:00100000:1.0:1746129567.944033:0:16680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093edf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ada2ffba-8920-4ecb-8068-68caa9806978+290:32171:x1830948734023168:12345-192.168.202.4@tcp:49:multiop.0 Request processed in 256us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129567.944040:0:16680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4725 00000100:00100000:0.0:1746129567.944500:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129567.944869:0:11014:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734023296 00000100:00100000:3.0:1746129567.944875:0:11014:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734023296 00000100:00100000:3.0:1746129567.944915:0:11014:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15954 00000100:00100000:3.0:1746129567.944921:0:11014:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ede680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:32172:x1830948734023296:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:3.0:1746129567.944933:0:11014:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129567.944951:0:11014:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095cda000/0x40a459093b06949d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20a51 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129567.944977:0:11014:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5a87a00/0x40a459093b069393 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f209e8 expref: 16 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129567.944985:0:11014:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129567.944988:0:11014:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129567.944991:0:11014:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095cda000/0x40a459093b06949d lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [3878912->4194303] (req 3878912->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20a51 expref: 22 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129567.945026:0:11014:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5a87a00/0x40a459093b069393 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f209e8 expref: 16 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129567.945039:0:11014:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5a87a00/0x40a459093b069393 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f209e8 expref: 16 pid: 22481 timeout: 923 lvb_type: 1 00000100:00100000:3.0:1746129567.945052:0:11014:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a07ace00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11014:1830948737477760:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129567.945130:0:11014:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e29fd80 going to sleep for 11 seconds 00000100:00100000:1.0:1746129567.945336:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129567.945511:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734023424 00000100:00100000:0.0:1746129567.945515:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734023424 00000100:00100000:0.0:1746129567.945534:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15955 00000100:00100000:0.0:1746129567.945539:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f325c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ada2ffba-8920-4ecb-8068-68caa9806978+32:32171:x1830948734023424:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:0.0:1746129567.945547:0:7149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129567.945557:0:7149:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f850800/0x40a459093b0694a4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20a58 expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129567.945571:0:7149:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5a87600/0x40a459093b06939a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f209ef expref: 16 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129567.945576:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129567.945577:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129567.945579:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f850800/0x40a459093b0694a4 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [3293184->3772415] (req 3293184->3772415) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20a58 expref: 33 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129567.945595:0:7149:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5a87600/0x40a459093b06939a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f209ef expref: 16 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129567.945601:0:7149:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5a87600/0x40a459093b06939a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f209ef expref: 16 pid: 22481 timeout: 923 lvb_type: 1 00000100:00100000:0.0:1746129567.945608:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093cefb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7149:1830948737477888:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129567.945635:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5de8900 going to sleep for 11 seconds 00000100:00100000:0.0:1746129567.946986:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129567.947070:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734023552 00000100:00100000:2.0:1746129567.947078:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734023552 00000100:00100000:2.0:1746129567.947286:0:7087:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 785 00000100:00100000:2.0:1746129567.947311:0:7087:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cedc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+8:1962:x1830948734023552:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129567.947325:0:7087:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129567.947356:0:7087:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6dd3a00/0x40a459093b069496 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20a4a expref: 8 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129567.947372:0:7087:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:2.0:1746129567.947377:0:7087:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129567.947935:0:7087:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cedc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+7:1962:x1830948734023552:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 638us (952us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129567.947943:0:7087:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 785 00000100:00100000:0.0:1746129567.948372:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129567.948544:0:8417:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734023808 00000100:00100000:2.0:1746129567.948549:0:8417:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734023808 00002000:00100000:2.0:1746129567.948580:0:8417:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff880093cec700 x1830948734023808/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:308/0 lens 488/0 e 0 to 0 dl 1746129578 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129567.948590:0:8417:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093cec700 with x1830948734023808 ext(1048576->2097151) 00002000:00010000:2.0:1746129567.948594:0:8417:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093cec700 00000100:00100000:2.0:1746129567.948619:0:8417:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7655 00000100:00100000:2.0:1746129567.948625:0:8417:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ada2ffba-8920-4ecb-8068-68caa9806978+34:1963:x1830948734023808:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:0.0:1746129567.949641:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129567.950014:0:31519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734024064 00000100:00100000:3.0:1746129567.950019:0:31519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734024064 00002000:00100000:3.0:1746129567.950043:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff880093ced500 x1830948734024064/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:308/0 lens 488/0 e 0 to 0 dl 1746129578 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129567.950051:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ced500 with x1830948734024064 ext(1048576->2097151) 00002000:00010000:3.0:1746129567.950054:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093ced500 00000100:00100000:3.0:1746129567.950070:0:31519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7656 00000100:00100000:3.0:1746129567.950074:0:31519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ced500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+16:1962:x1830948734024064:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:1.0:1746129567.950935:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093cefb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7149:1830948737477888:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129567.950966:0:7149:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f850800/0x40a459093b0694a4 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [3293184->3772415] (req 3293184->3772415) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20a58 expref: 35 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129567.950981:0:7149:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f850800, rc 0) 00000100:00100000:1.0:1746129567.951007:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f325c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ada2ffba-8920-4ecb-8068-68caa9806978+35:32171:x1830948734023424:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 5467us (5671us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129567.951014:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15955 00000100:00100000:3.0:1746129567.953113:0:11014:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a07ace00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11014:1830948737477760:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129567.953150:0:11014:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095cda000/0x40a459093b06949d lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [3878912->4194303] (req 3878912->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20a51 expref: 22 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129567.953167:0:11014:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095cda000, rc 0) 00000100:00100000:3.0:1746129567.953219:0:11014:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ede680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+22:32172:x1830948734023296:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 8297us (8718us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129567.953233:0:11014:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15954 00000100:00100000:1.0:1746129567.953696:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129567.953808:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129567.953877:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734024192 00000100:00100000:3.0:1746129567.953886:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734024192 00010000:00010000:3.0:1746129567.953918:0:7087:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5a87a00/0x40a459093b069393 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f209e8 expref: 17 pid: 22481 timeout: 923 lvb_type: 1 00000100:00100000:3.0:1746129567.953952:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734024320 00000100:00100000:3.0:1746129567.953954:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734024320 00000100:00100000:2.0:1746129567.953963:0:15749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8149 00010000:00010000:3.0:1746129567.953967:0:7087:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5a87600/0x40a459093b06939a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f209ef expref: 17 pid: 22481 timeout: 923 lvb_type: 1 00000100:00100000:2.0:1746129567.953972:0:15749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f325880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:068dab75-d300-4ead-a742-d14572ad1e50+17:1961:x1830948734024192:12345-192.168.202.4@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746129567.953983:0:7087:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8150 00010000:00010000:2.0:1746129567.953987:0:15749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746129567.953988:0:7087:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f325180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:068dab75-d300-4ead-a742-d14572ad1e50+17:1961:x1830948734024320:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129567.953998:0:7087:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129567.954015:0:7087:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5a87600/0x40a459093b06939a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f209ef expref: 17 pid: 22481 timeout: 923 lvb_type: 1 00010000:00010000:2.0:1746129567.954015:0:15749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5a87a00/0x40a459093b069393 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f209e8 expref: 17 pid: 22481 timeout: 923 lvb_type: 1 00010000:00010000:2.0:1746129567.954025:0:15749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5a87a00/0x40a459093b069393 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f209e8 expref: 17 pid: 22481 timeout: 923 lvb_type: 1 00010000:00010000:3.0:1746129567.954026:0:7087:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5a87600/0x40a459093b06939a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f209ef expref: 17 pid: 22481 timeout: 923 lvb_type: 1 00010000:00010000:3.0:1746129567.954049:0:7087:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5a87600/0x40a459093b06939a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f209ef expref: 17 pid: 22481 timeout: 923 lvb_type: 1 00010000:00010000:2.0:1746129567.954049:0:15749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5a87a00/0x40a459093b069393 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f209e8 expref: 17 pid: 22481 timeout: 923 lvb_type: 1 00010000:00010000:3.0:1746129567.954062:0:7087:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129567.954062:0:15749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129567.954064:0:7087:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129567.954065:0:15749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129567.954073:0:7087:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f850800/0x40a459093b0694a4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3293184->3772415) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20a58 expref: 34 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129567.954073:0:15749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880095cda000/0x40a459093b06949d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3878912->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20a51 expref: 21 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129567.954081:0:15749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095cda000/0x40a459093b06949d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3878912->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20a51 expref: 21 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129567.954086:0:7087:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f850800/0x40a459093b0694a4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3293184->3772415) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20a58 expref: 34 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129567.954109:0:7087:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f850800/0x40a459093b0694a4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3293184->3772415) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20a58 expref: 34 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129567.954109:0:15749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880095cda000/0x40a459093b06949d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3878912->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20a51 expref: 21 pid: 11014 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129567.954121:0:7087:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a07ace00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7087:1830948737478016:192.168.202.4@tcp:105: 00000100:00100000:2.0:1746129567.954121:0:15749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095626a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15749:1830948737478144:192.168.202.4@tcp:105: 00000100:00100000:3.0:1746129567.954451:0:7087:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e29fd80 going to sleep for 11 seconds 00000100:00100000:2.0:1746129567.955827:0:15749:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0ac3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746129567.959900:0:15749:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095626a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15749:1830948737478144:192.168.202.4@tcp:105: 00010000:00010000:2.0:1746129567.959926:0:15749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129567.959977:0:15749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f325880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:068dab75-d300-4ead-a742-d14572ad1e50+16:1961:x1830948734024192:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 6004us (6281us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129567.959988:0:15749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8149 00000100:00100000:3.0:1746129567.960095:0:7087:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a07ace00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7087:1830948737478016:192.168.202.4@tcp:105: 00010000:00010000:3.0:1746129567.960108:0:7087:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129567.960127:0:7087:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f325180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:068dab75-d300-4ead-a742-d14572ad1e50+16:1961:x1830948734024320:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 6139us (6320us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129567.960134:0:7087:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8150 00000100:00100000:0.0:1746129567.960572:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129567.960757:0:31520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734024576 00000100:00100000:3.0:1746129567.960765:0:31520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734024576 00002000:00100000:3.0:1746129567.960804:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3f5:0x0] (3293184->3297279) req@ffff880093cefb80 x1830948734024576/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:308/0 lens 488/0 e 0 to 0 dl 1746129578 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129567.960814:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093cefb80 with x1830948734024576 ext(3293184->3297279) 00002000:00010000:3.0:1746129567.960819:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093cefb80 00000100:00100000:3.0:1746129567.960845:0:31520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7657 00000100:00100000:3.0:1746129567.960852:0:31520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ada2ffba-8920-4ecb-8068-68caa9806978+35:1962:x1830948734024576:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:3.0:1746129567.961544:0:31520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ada2ffba-8920-4ecb-8068-68caa9806978+35:1962:x1830948734024576:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 691us (972us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129567.961554:0:31520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7657 00002000:00100000:3.0:1746129567.961559:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3f5:0x0] (3293184->3297279) req@ffff880093cefb80 x1830948734024576/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:308/0 lens 488/4536 e 0 to 0 dl 1746129578 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129567.961566:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093cefb80 with x1830948734024576 ext(3293184->3297279) 00002000:00010000:3.0:1746129567.961568:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093cefb80 00000100:00100000:0.0:1746129567.961695:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129567.961740:0:31521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734024832 00000100:00100000:2.0:1746129567.961745:0:31521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734024832 00002000:00100000:2.0:1746129567.961764:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3ef:0x0] (3878912->3883007) req@ffff88009507df80 x1830948734024832/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:308/0 lens 488/0 e 0 to 0 dl 1746129578 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129567.961771:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009507df80 with x1830948734024832 ext(3878912->3883007) 00002000:00010000:2.0:1746129567.961774:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009507df80 00000100:00100000:2.0:1746129567.961797:0:31521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7658 00000100:00100000:2.0:1746129567.961802:0:31521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009507df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+22:1962:x1830948734024832:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:2.0:1746129567.961894:0:31521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009507df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+22:1962:x1830948734024832:12345-192.168.202.4@tcp:3:cat.0 Request processed in 91us (199us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129567.961901:0:31521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7658 00002000:00100000:2.0:1746129567.961906:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3ef:0x0] (3878912->3883007) req@ffff88009507df80 x1830948734024832/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:308/0 lens 488/4536 e 0 to 0 dl 1746129578 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129567.961912:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009507df80 with x1830948734024832 ext(3878912->3883007) 00002000:00010000:2.0:1746129567.961915:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009507df80 00000100:00100000:2.0:1746129567.963865:0:8417:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ada2ffba-8920-4ecb-8068-68caa9806978+33:1963:x1830948734023808:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 15228us (15666us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129567.963875:0:8417:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7655 00002000:00100000:2.0:1746129567.963885:0:8417:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff880093cec700 x1830948734023808/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:308/0 lens 488/440 e 0 to 0 dl 1746129578 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129567.963893:0:8417:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093cec700 with x1830948734023808 ext(1048576->2097151) 00002000:00010000:2.0:1746129567.963898:0:8417:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093cec700 00000100:00100000:3.0:1746129567.966196:0:31519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ced500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+16:1962:x1830948734024064:12345-192.168.202.4@tcp:3:cat.0 Request processed in 16109us (16546us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129567.966207:0:31519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7656 00002000:00100000:3.0:1746129567.966221:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff880093ced500 x1830948734024064/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:308/0 lens 488/440 e 0 to 0 dl 1746129578 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129567.966231:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ced500 with x1830948734024064 ext(1048576->2097151) 00002000:00010000:3.0:1746129567.966238:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093ced500 00000100:00100000:0.0:1746129567.967497:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129567.968064:0:11014:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734024960 00000100:00100000:3.0:1746129567.968074:0:11014:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734024960 00000100:00100000:1.0:1746129567.969322:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15956 00000100:00100000:1.0:1746129567.969347:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009507c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ada2ffba-8920-4ecb-8068-68caa9806978+33:32176:x1830948734024960:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129567.969370:0:7149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129567.969392:0:7149:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ee1aa00/0x40a459093b0694ab lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20a5f expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129567.969425:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129567.969428:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129567.969437:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ee1aa00/0x40a459093b0694ab lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20a5f expref: 34 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129567.969455:0:7149:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ee1aa00/0x40a459093b0694ab lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20a5f expref: 34 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129567.969473:0:7149:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ee1aa00, rc 0) 00000100:00100000:1.0:1746129567.969546:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009507c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ada2ffba-8920-4ecb-8068-68caa9806978+34:32176:x1830948734024960:12345-192.168.202.4@tcp:101:cat.0 Request processed in 213us (2054us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129567.969552:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15956 00000100:00100000:0.0:1746129567.973650:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129567.973693:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129567.973716:0:31519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734025216 00000100:00100000:3.0:1746129567.973727:0:31519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734025216 00000100:00100000:0.0:1746129567.973729:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00002000:00100000:3.0:1746129567.973775:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f5:0x0] (3768320->3772415) req@ffff880094066d80 x1830948734025216/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:308/0 lens 488/0 e 0 to 0 dl 1746129578 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129567.973785:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094066d80 with x1830948734025216 ext(3768320->3772415) 00002000:00010000:3.0:1746129567.973790:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094066d80 00000100:00100000:1.0:1746129567.973807:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734025344 00000100:00100000:3.0:1746129567.973810:0:31519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7659 00000100:00100000:1.0:1746129567.973811:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734025344 00000100:00100000:3.0:1746129567.973817:0:31519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094066d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ada2ffba-8920-4ecb-8068-68caa9806978+34:1962:x1830948734025216:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:1.0:1746129567.973832:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734025472 00000100:00100000:1.0:1746129567.973834:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734025472 00000100:00100000:1.0:1746129567.973847:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15957 00000100:00100000:1.0:1746129567.973851:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094066680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+17:32175:x1830948734025344:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129567.973860:0:7149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129567.973879:0:7149:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5a87a00/0x40a459093b0694b2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20a66 expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129567.973899:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129567.973901:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129567.973908:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5a87a00/0x40a459093b0694b2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20a66 expref: 18 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129567.973921:0:7149:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5a87a00/0x40a459093b0694b2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20a66 expref: 18 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129567.973930:0:7149:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5a87a00, rc 0) 00000100:00100000:1.0:1746129567.973981:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094066680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+18:32175:x1830948734025344:12345-192.168.202.4@tcp:101:cat.0 Request processed in 128us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129567.973987:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15957 00000100:00100000:1.0:1746129567.974003:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15958 00000100:00100000:1.0:1746129567.974007:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094065180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+17:32172:x1830948734025472:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:1.0:1746129567.974013:0:7149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129567.974021:0:7149:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ee1b000/0x40a459093b0694b9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20a6d expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129567.974036:0:7149:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f850800/0x40a459093b0694a4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3293184->3772415) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20a58 expref: 34 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129567.974042:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129567.974044:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129567.974046:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ee1b000/0x40a459093b0694b9 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [3145728->3379199] (req 3145728->3379199) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20a6d expref: 18 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129567.974075:0:7149:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f850800/0x40a459093b0694a4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3293184->3772415) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20a58 expref: 34 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129567.974087:0:7149:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f850800/0x40a459093b0694a4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3293184->3772415) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20a58 expref: 34 pid: 7149 timeout: 923 lvb_type: 0 00000100:00100000:1.0:1746129567.974098:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fa24e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7149:1830948737478272:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129567.974417:0:31519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094066d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ada2ffba-8920-4ecb-8068-68caa9806978+34:1962:x1830948734025216:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 599us (778us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129567.974427:0:31519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7659 00002000:00100000:3.0:1746129567.974432:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f5:0x0] (3768320->3772415) req@ffff880094066d80 x1830948734025216/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:308/0 lens 488/4536 e 0 to 0 dl 1746129578 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129567.974440:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094066d80 with x1830948734025216 ext(3768320->3772415) 00010000:00010000:3.0:1746129567.974444:0:31519:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f850800/0x40a459093b0694a4 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3293184->3772415) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20a58 expref: 34 pid: 7149 timeout: 923 lvb_type: 0 00010000:00010000:3.0:1746129567.974454:0:31519:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f850800/0x40a459093b0694a4 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3293184->3772415) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20a58 expref: 34 pid: 7149 timeout: 923 lvb_type: 0 00002000:00010000:3.0:1746129567.974460:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094066d80 00000100:00100000:1.0:1746129567.974525:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a6dc86c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129567.975061:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129567.975101:0:31519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734025728 00000100:00100000:3.0:1746129567.975105:0:31519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734025728 00002000:00100000:3.0:1746129567.975123:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f4:0x0] (1048576->2097151) req@ffff880094064000 x1830948734025728/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:308/0 lens 488/0 e 0 to 0 dl 1746129578 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129567.975130:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094064000 with x1830948734025728 ext(1048576->2097151) 00002000:00010000:3.0:1746129567.975133:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094064000 00000100:00100000:3.0:1746129567.975156:0:31519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7660 00000100:00100000:3.0:1746129567.975161:0:31519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094064000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ada2ffba-8920-4ecb-8068-68caa9806978+34:1962:x1830948734025728:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:1.0:1746129567.978507:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fa24e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7149:1830948737478272:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129567.978541:0:7149:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ee1b000/0x40a459093b0694b9 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [3145728->3379199] (req 3145728->3379199) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20a6d expref: 18 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129567.978559:0:7149:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ee1b000, rc 0) 00000100:00100000:1.0:1746129567.978613:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094065180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+18:32172:x1830948734025472:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 4601us (4880us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129567.978622:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15958 00000100:00100000:0.0:1746129567.984956:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129567.985290:0:8417:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734025984 00000100:00100000:0.0:1746129567.985323:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129567.985358:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129567.985366:0:16680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734026496 00000100:00100000:1.0:1746129567.985377:0:16680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734026496 00000100:00100000:1.0:1746129567.985424:0:16680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4726 00000100:00100000:1.0:1746129567.985431:0:16680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4e1050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ada2ffba-8920-4ecb-8068-68caa9806978+290:32171:x1830948734026496:12345-192.168.202.4@tcp:35:multiop.0 00000100:00100000:3.0:1746129567.985490:0:31520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734026240 00000100:00100000:3.0:1746129567.985494:0:31520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734026240 00002000:00100000:3.0:1746129567.985521:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3f5:0x0] (3293184->3772415) req@ffff880091b06a00 x1830948734026240/t0(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:308/0 lens 488/0 e 0 to 0 dl 1746129578 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129567.985531:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091b06a00 with x1830948734026240 ext(3293184->3772415) 00010000:00010000:3.0:1746129567.985542:0:31520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f850800/0x40a459093b0694a4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3293184->3772415) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20a58 expref: 36 pid: 7149 timeout: 923 lvb_type: 0 00010000:00010000:3.0:1746129567.985554:0:31520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f850800/0x40a459093b0694a4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3293184->3772415) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20a58 expref: 36 pid: 7149 timeout: 923 lvb_type: 0 00002000:00010000:3.0:1746129567.985561:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880091b06a00 00000100:00100000:3.0:1746129567.985574:0:31520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2390 00000100:00100000:3.0:1746129567.985578:0:31520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ada2ffba-8920-4ecb-8068-68caa9806978+36:1960:x1830948734026240:12345-192.168.202.4@tcp:4:multiop.0 00000100:00100000:1.0:1746129567.985718:0:16680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4e1050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ada2ffba-8920-4ecb-8068-68caa9806978+291:32171:x1830948734026496:12345-192.168.202.4@tcp:35:multiop.0 Request processed in 287us (424us total) trans 8589945248 rc 0/0 00000100:00100000:1.0:1746129567.985725:0:16680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4726 00000100:00100000:3.0:1746129567.986401:0:31519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094064000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ada2ffba-8920-4ecb-8068-68caa9806978+36:1962:x1830948734025728:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 11238us (11341us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129567.986408:0:31519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7660 00002000:00100000:3.0:1746129567.986413:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f4:0x0] (1048576->2097151) req@ffff880094064000 x1830948734025728/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:308/0 lens 488/440 e 0 to 0 dl 1746129578 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129567.986426:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094064000 with x1830948734025728 ext(1048576->2097151) 00002000:00010000:3.0:1746129567.986431:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094064000 00000100:00100000:2.0:1746129567.986578:0:8417:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734025984 00002000:00100000:2.0:1746129567.986615:0:8417:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3f4:0x0] (1048576->2097151) req@ffff88012b553b80 x1830948734025984/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:308/0 lens 488/0 e 0 to 0 dl 1746129578 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129567.986622:0:8417:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b553b80 with x1830948734025984 ext(1048576->2097151) 00002000:00010000:2.0:1746129567.986626:0:8417:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b553b80 00000100:00100000:2.0:1746129567.986639:0:8417:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7661 00000100:00100000:2.0:1746129567.986644:0:8417:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b553b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+18:1963:x1830948734025984:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129567.999329:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129567.999589:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734026624 00000100:00100000:2.0:1746129567.999599:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734026624 00000100:00100000:2.0:1746129567.999662:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15959 00000100:00100000:2.0:1746129567.999671:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ada2ffba-8920-4ecb-8068-68caa9806978+34:32176:x1830948734026624:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129567.999695:0:7149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129567.999714:0:7149:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095cdac00/0x40a459093b0694c0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20a74 expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129567.999742:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129567.999743:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129567.999751:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095cdac00/0x40a459093b0694c0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20a74 expref: 35 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129567.999767:0:7149:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095cdac00/0x40a459093b0694c0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20a74 expref: 35 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129567.999779:0:7149:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095cdac00, rc 0) 00000100:00100000:2.0:1746129567.999826:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ada2ffba-8920-4ecb-8068-68caa9806978+35:32176:x1830948734026624:12345-192.168.202.4@tcp:101:cat.0 Request processed in 156us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129567.999832:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15959 00000100:00100000:3.0:1746129568.003437:0:8417:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b553b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+18:1963:x1830948734025984:12345-192.168.202.4@tcp:3:cat.0 Request processed in 16779us (18480us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129568.003447:0:8417:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7661 00002000:00100000:3.0:1746129568.003459:0:8417:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3f4:0x0] (1048576->2097151) req@ffff88012b553b80 x1830948734025984/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:308/0 lens 488/440 e 0 to 0 dl 1746129578 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129568.003469:0:8417:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b553b80 with x1830948734025984 ext(1048576->2097151) 00002000:00010000:3.0:1746129568.003475:0:8417:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b553b80 00000100:00100000:0.0:1746129568.005771:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129568.005979:0:31521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734026880 00000100:00100000:2.0:1746129568.005990:0:31521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734026880 00002000:00100000:2.0:1746129568.006034:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3ee:0x0] (1048576->2097151) req@ffff880091b06300 x1830948734026880/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:309/0 lens 488/0 e 0 to 0 dl 1746129579 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129568.006044:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091b06300 with x1830948734026880 ext(1048576->2097151) 00002000:00010000:2.0:1746129568.006048:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091b06300 00000100:00100000:2.0:1746129568.006068:0:31521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7662 00000100:00100000:2.0:1746129568.006075:0:31521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ada2ffba-8920-4ecb-8068-68caa9806978+35:1962:x1830948734026880:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:3.0:1746129568.013075:0:31520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ada2ffba-8920-4ecb-8068-68caa9806978+36:1960:x1830948734026240:12345-192.168.202.4@tcp:4:multiop.0 Request processed in 27481us (27702us total) trans 17179874080 rc 0/0 00000100:00100000:3.0:1746129568.013090:0:31520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2390 00002000:00100000:3.0:1746129568.013104:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3f5:0x0] (3293184->3772415) req@ffff880091b06a00 x1830948734026240/t17179874080(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:308/0 lens 488/448 e 0 to 0 dl 1746129578 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129568.013113:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091b06a00 with x1830948734026240 ext(3293184->3772415) 00010000:00010000:3.0:1746129568.013125:0:31520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f850800/0x40a459093b0694a4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3293184->3772415) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20a58 expref: 36 pid: 7149 timeout: 923 lvb_type: 0 00010000:00010000:3.0:1746129568.013144:0:31520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f850800/0x40a459093b0694a4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3293184->3772415) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20a58 expref: 36 pid: 7149 timeout: 923 lvb_type: 0 00002000:00010000:3.0:1746129568.013151:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880091b06a00 00000100:00100000:1.0:1746129568.015279:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129568.015664:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734027008 00000100:00100000:2.0:1746129568.015675:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734027008 00000100:00100000:1.0:1746129568.015763:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129568.016059:0:31521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ada2ffba-8920-4ecb-8068-68caa9806978+35:1962:x1830948734026880:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 9982us (10297us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129568.016070:0:31521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7662 00002000:00100000:3.0:1746129568.016082:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3ee:0x0] (1048576->2097151) req@ffff880091b06300 x1830948734026880/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:309/0 lens 488/440 e 0 to 0 dl 1746129579 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129568.016091:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091b06300 with x1830948734026880 ext(1048576->2097151) 00002000:00010000:3.0:1746129568.016095:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091b06300 00000100:00100000:3.0:1746129568.016122:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734027136 00000100:00100000:3.0:1746129568.016125:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734027136 00010000:00010000:3.0:1746129568.016150:0:7087:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f850800/0x40a459093b0694a4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3293184->3772415) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20a58 expref: 36 pid: 7149 timeout: 923 lvb_type: 0 00000100:00100000:3.0:1746129568.016176:0:7087:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8151 00000100:00100000:3.0:1746129568.016182:0:7087:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6025c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ada2ffba-8920-4ecb-8068-68caa9806978+36:1962:x1830948734027136:12345-192.168.202.4@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746129568.016193:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15960 00010000:00010000:3.0:1746129568.016196:0:7087:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746129568.016198:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+22:32175:x1830948734027008:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129568.016211:0:7149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129568.016214:0:7087:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f850800/0x40a459093b0694a4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3293184->3772415) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20a58 expref: 36 pid: 7149 timeout: 923 lvb_type: 0 00010000:00010000:3.0:1746129568.016224:0:7087:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f850800/0x40a459093b0694a4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3293184->3772415) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20a58 expref: 36 pid: 7149 timeout: 923 lvb_type: 0 00010000:00010000:2.0:1746129568.016225:0:7149:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095cda200/0x40a459093b0694c7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20a7b expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129568.016241:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129568.016243:0:7087:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f850800/0x40a459093b0694a4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3293184->3772415) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20a58 expref: 36 pid: 7149 timeout: 923 lvb_type: 0 00010000:00010000:2.0:1746129568.016243:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129568.016249:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095cda200/0x40a459093b0694c7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20a7b expref: 23 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129568.016257:0:7087:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129568.016259:0:7087:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129568.016259:0:7149:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095cda200/0x40a459093b0694c7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20a7b expref: 23 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129568.016263:0:7087:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ee1b000/0x40a459093b0694b9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3379199) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20a6d expref: 17 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129568.016268:0:7149:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095cda200, rc 0) 00010000:00010000:3.0:1746129568.016269:0:7087:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ee1b000/0x40a459093b0694b9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3379199) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20a6d expref: 17 pid: 7149 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129568.016284:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+23:32175:x1830948734027008:12345-192.168.202.4@tcp:101:cat.0 Request processed in 86us (1017us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129568.016288:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15960 00010000:00010000:3.0:1746129568.016314:0:7087:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ee1b000/0x40a459093b0694b9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3379199) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20a6d expref: 17 pid: 7149 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129568.016327:0:7087:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a07ace00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7087:1830948737478400:192.168.202.4@tcp:105: 00000100:00100000:3.0:1746129568.016389:0:7087:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e29f780 going to sleep for 11 seconds 00000100:00100000:3.0:1746129568.022238:0:7087:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a07ace00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7087:1830948737478400:192.168.202.4@tcp:105: 00010000:00010000:3.0:1746129568.022264:0:7087:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129568.023334:0:7087:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6025c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ada2ffba-8920-4ecb-8068-68caa9806978+35:1962:x1830948734027136:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 7147us (7566us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129568.023356:0:7087:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8151 00000100:00100000:0.0:1746129568.024584:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129568.024632:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129568.024721:0:8417:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734027392 00000100:00100000:2.0:1746129568.024730:0:8417:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734027392 00000100:00100000:3.0:1746129568.024744:0:31521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734027648 00000100:00100000:3.0:1746129568.024747:0:31521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734027648 00002000:00100000:3.0:1746129568.024777:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f5:0x0] (3375104->3379199) req@ffff880091b05f80 x1830948734027648/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:309/0 lens 488/0 e 0 to 0 dl 1746129579 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129568.024777:0:8417:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3ee:0x0] (1048576->2097151) req@ffff880091b06d80 x1830948734027392/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:309/0 lens 488/0 e 0 to 0 dl 1746129579 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129568.024786:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091b05f80 with x1830948734027648 ext(3375104->3379199) 00002000:00100000:2.0:1746129568.024786:0:8417:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091b06d80 with x1830948734027392 ext(1048576->2097151) 00002000:00010000:3.0:1746129568.024791:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091b05f80 00002000:00010000:2.0:1746129568.024791:0:8417:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091b06d80 00000100:00100000:3.0:1746129568.024812:0:31521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7663 00000100:00100000:3.0:1746129568.024818:0:31521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+18:1961:x1830948734027648:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:3.0:1746129568.025010:0:31521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+18:1961:x1830948734027648:12345-192.168.202.4@tcp:3:cat.0 Request processed in 191us (377us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129568.025016:0:31521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7663 00002000:00100000:3.0:1746129568.025021:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f5:0x0] (3375104->3379199) req@ffff880091b05f80 x1830948734027648/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:309/0 lens 488/4536 e 0 to 0 dl 1746129579 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129568.025028:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091b05f80 with x1830948734027648 ext(3375104->3379199) 00002000:00010000:3.0:1746129568.025031:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091b05f80 00000100:00100000:3.0:1746129568.025041:0:31521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7664 00000100:00100000:3.0:1746129568.025046:0:31521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+23:1963:x1830948734027392:12345-192.168.202.4@tcp:3:cat.0 00000100:00080000:0.0:1746129568.026568:0:7097:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746129568.032241:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129568.032289:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129568.032379:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129568.032467:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734027776 00000100:00100000:3.0:1746129568.032477:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734027776 00000100:00100000:3.0:1746129568.032528:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734028160 00000100:00100000:3.0:1746129568.032531:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734028160 00000100:00100000:3.0:1746129568.032549:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15961 00000100:00100000:3.0:1746129568.032557:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095625880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ada2ffba-8920-4ecb-8068-68caa9806978+35:1962:x1830948734027776:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129568.032580:0:7149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129568.032601:0:7149:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009efe8000/0x40a459093b0694ce lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20a82 expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129568.032669:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a07ace00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7149:1830948737478528:192.168.202.4@tcp:106: 00000100:00100000:3.0:1746129568.032754:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e29fd80 going to sleep for 11 seconds 00000100:00100000:3.0:1746129568.032831:0:11014:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15962 00000100:00100000:3.0:1746129568.032837:0:11014:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095627480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ada2ffba-8920-4ecb-8068-68caa9806978+35:1963:x1830948734028160:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129568.032846:0:11014:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129568.032858:0:11014:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009efe8800/0x40a459093b0694d5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20a89 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129568.032888:0:11014:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a07ad500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11014:1830948737478656:192.168.202.4@tcp:106: 00000100:00100000:3.0:1746129568.032913:0:11014:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e29f240 going to sleep for 11 seconds 00000100:00100000:0.0:1746129568.032974:0:16680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734028032 00000100:00100000:0.0:1746129568.032979:0:16680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734028032 00000100:00100000:0.0:1746129568.033025:0:16680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4727 00000100:00100000:0.0:1746129568.033031:0:16680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095626a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+7:32172:x1830948734028032:12345-192.168.202.4@tcp:35:multiop.0 00000100:00100000:0.0:1746129568.034278:0:16680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095626a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+8:32172:x1830948734028032:12345-192.168.202.4@tcp:35:multiop.0 Request processed in 1240us (2045us total) trans 8589945249 rc 0/0 00000100:00100000:0.0:1746129568.034287:0:16680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4727 00000100:00080000:1.0:1746129568.034799:0:7097:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746129568.037881:0:11014:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a07ad500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11014:1830948737478656:192.168.202.4@tcp:106: 00010000:00010000:3.0:1746129568.037920:0:11014:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009efe8800/0x40a459093b0694d5 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20a89 expref: 36 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129568.037933:0:11014:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009efe8800/0x40a459093b0694d5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20a89 expref: 36 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129568.037948:0:11014:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009efe8800, rc 0) 00000100:00100000:3.0:1746129568.037993:0:11014:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095627480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ada2ffba-8920-4ecb-8068-68caa9806978+35:1963:x1830948734028160:12345-192.168.202.4@tcp:101:cat.0 Request processed in 5154us (5612us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129568.038001:0:11014:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15962 00000100:00100000:3.0:1746129568.038332:0:31521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+23:1963:x1830948734027392:12345-192.168.202.4@tcp:3:cat.0 Request processed in 13285us (13751us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129568.038350:0:31521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7664 00002000:00100000:3.0:1746129568.038359:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3ee:0x0] (1048576->2097151) req@ffff880091b06d80 x1830948734027392/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:309/0 lens 488/440 e 0 to 0 dl 1746129579 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129568.038368:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091b06d80 with x1830948734027392 ext(1048576->2097151) 00002000:00010000:3.0:1746129568.038373:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091b06d80 00000100:00100000:2.0:1746129568.038598:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a07ace00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7149:1830948737478528:192.168.202.4@tcp:106: 00010000:00010000:2.0:1746129568.038617:0:7149:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009efe8000/0x40a459093b0694ce lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20a82 expref: 36 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129568.038626:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009efe8000/0x40a459093b0694ce lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20a82 expref: 36 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129568.038653:0:7149:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009efe8000, rc 0) 00000100:00100000:2.0:1746129568.038686:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095625880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ada2ffba-8920-4ecb-8068-68caa9806978+35:1962:x1830948734027776:12345-192.168.202.4@tcp:101:cat.0 Request processed in 6130us (6395us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129568.038692:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15961 00000100:00100000:0.0:1746129568.044098:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129568.044183:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734028288 00000100:00100000:2.0:1746129568.044193:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734028288 00000100:00100000:2.0:1746129568.044869:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15963 00000100:00100000:2.0:1746129568.044879:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ada2ffba-8920-4ecb-8068-68caa9806978+35:32176:x1830948734028288:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129568.044900:0:7149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129568.044919:0:7149:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009faa2400/0x40a459093b0694dc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20a90 expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129568.045073:0:7149:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095cda000/0x40a459093b06949d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3878912->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20a51 expref: 22 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129568.045080:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129568.045082:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129568.045085:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009faa2400/0x40a459093b0694dc lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20a90 expref: 36 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129568.045124:0:7149:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095cda000/0x40a459093b06949d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3878912->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20a51 expref: 22 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129568.045137:0:7149:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095cda000/0x40a459093b06949d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3878912->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20a51 expref: 22 pid: 11014 timeout: 923 lvb_type: 0 00000100:00100000:2.0:1746129568.045149:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013575f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7149:1830948737478784:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129568.045930:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0aca80 going to sleep for 11 seconds 00000100:00100000:0.0:1746129568.052572:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129568.052621:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129568.052649:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129568.052676:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129568.052685:0:31520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734028544 00000100:00100000:2.0:1746129568.052695:0:31520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734028544 00002000:00100000:2.0:1746129568.052749:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3ef:0x0] (2097152->3145727) req@ffff880094f47b80 x1830948734028544/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:309/0 lens 488/0 e 0 to 0 dl 1746129579 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129568.052759:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094f47b80 with x1830948734028544 ext(2097152->3145727) 00010000:00010000:2.0:1746129568.052769:0:31520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880095cda000/0x40a459093b06949d lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3878912->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20a51 expref: 23 pid: 11014 timeout: 923 lvb_type: 0 00010000:00010000:2.0:1746129568.052782:0:31520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880095cda000/0x40a459093b06949d lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3878912->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20a51 expref: 23 pid: 11014 timeout: 923 lvb_type: 0 00002000:00010000:2.0:1746129568.052790:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094f47b80 00000100:00100000:2.0:1746129568.052807:0:31520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734028800 00000100:00100000:2.0:1746129568.052810:0:31520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734028800 00002000:00100000:2.0:1746129568.052823:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->3878911) req@ffff880094f45180 x1830948734028800/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:309/0 lens 488/0 e 0 to 0 dl 1746129579 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129568.052829:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094f45180 with x1830948734028800 ext(3145728->3878911) 00010000:00010000:2.0:1746129568.052834:0:31520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880095cda000/0x40a459093b06949d lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3878912->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20a51 expref: 24 pid: 11014 timeout: 923 lvb_type: 0 00010000:00010000:2.0:1746129568.052842:0:31520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880095cda000/0x40a459093b06949d lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3878912->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20a51 expref: 24 pid: 11014 timeout: 923 lvb_type: 0 00002000:00010000:2.0:1746129568.052852:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094f45180 00000100:00100000:2.0:1746129568.052861:0:31520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734029056 00000100:00100000:2.0:1746129568.052863:0:31520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734029056 00002000:00100000:2.0:1746129568.052877:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3f5:0x0] (2097152->3145727) req@ffff880094f45500 x1830948734029056/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:309/0 lens 488/0 e 0 to 0 dl 1746129579 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746129568.052881:0:31521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734029312 00002000:00100000:2.0:1746129568.052883:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094f45500 with x1830948734029056 ext(2097152->3145727) 00000100:00100000:3.0:1746129568.052885:0:31521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734029312 00002000:00010000:2.0:1746129568.052887:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094f45500 00000100:00100000:2.0:1746129568.052898:0:31520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2391 00002000:00100000:3.0:1746129568.052899:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f5:0x0] (3379200->4194303) req@ffff880094f44e00 x1830948734029312/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:309/0 lens 488/0 e 0 to 0 dl 1746129579 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129568.052905:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094f44e00 with x1830948734029312 ext(3379200->4194303) 00000100:00100000:2.0:1746129568.052905:0:31520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+24:1962:x1830948734028544:12345-192.168.202.4@tcp:3:cat.0 00002000:00010000:3.0:1746129568.052907:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094f44e00 00000100:00100000:3.0:1746129568.052917:0:31521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2392 00000100:00100000:3.0:1746129568.052921:0:31521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+24:1963:x1830948734028800:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:2.0:1746129568.052997:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013575f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7149:1830948737478784:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129568.053020:0:7149:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009faa2400/0x40a459093b0694dc lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20a90 expref: 36 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129568.053035:0:7149:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009faa2400, rc 0) 00000100:00100000:2.0:1746129568.053074:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ada2ffba-8920-4ecb-8068-68caa9806978+36:32176:x1830948734028288:12345-192.168.202.4@tcp:101:cat.0 Request processed in 8198us (8988us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129568.053080:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15963 00000100:00100000:3.0:1746129568.053883:0:31518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7665 00000100:00100000:3.0:1746129568.053891:0:31518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+19:1962:x1830948734029056:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:1.0:1746129568.054724:0:31519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7666 00000100:00100000:1.0:1746129568.054734:0:31519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:1962:x1830948734029312:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129568.059974:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129568.060078:0:8416:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734029440 00000100:00100000:2.0:1746129568.060088:0:8416:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734029440 00002000:00100000:2.0:1746129568.060139:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3ef:0x0] (3878912->4194303) req@ffff880094f44000 x1830948734029440/t0(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:309/0 lens 488/0 e 0 to 0 dl 1746129579 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129568.060151:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094f44000 with x1830948734029440 ext(3878912->4194303) 00010000:00010000:2.0:1746129568.060160:0:8416:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880095cda000/0x40a459093b06949d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3878912->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20a51 expref: 27 pid: 11014 timeout: 923 lvb_type: 0 00010000:00010000:2.0:1746129568.060173:0:8416:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880095cda000/0x40a459093b06949d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3878912->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20a51 expref: 27 pid: 11014 timeout: 923 lvb_type: 0 00002000:00010000:2.0:1746129568.060180:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094f44000 00000100:00100000:2.0:1746129568.060199:0:8416:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2393 00000100:00100000:2.0:1746129568.060206:0:8416:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+27:1963:x1830948734029440:12345-192.168.202.4@tcp:4:cat.0 00000100:00100000:3.0:1746129568.064746:0:31521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+27:1963:x1830948734028800:12345-192.168.202.4@tcp:3:cat.0 Request processed in 11811us (12112us total) trans 0 rc 733184/733184 00000100:00100000:3.0:1746129568.064759:0:31521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2392 00002000:00100000:3.0:1746129568.064771:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->3878911) req@ffff880094f45180 x1830948734028800/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:309/0 lens 488/440 e 0 to 0 dl 1746129579 ref 1 fl Complete:H/200/0 rc 733184/733184 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129568.064780:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094f45180 with x1830948734028800 ext(3145728->3878911) 00010000:00010000:3.0:1746129568.064791:0:31521:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880095cda000/0x40a459093b06949d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3878912->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20a51 expref: 27 pid: 11014 timeout: 923 lvb_type: 0 00010000:00010000:3.0:1746129568.064806:0:31521:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880095cda000/0x40a459093b06949d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3878912->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20a51 expref: 27 pid: 11014 timeout: 923 lvb_type: 0 00002000:00010000:3.0:1746129568.064813:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094f45180 00000100:00100000:3.0:1746129568.069367:0:31518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:1962:x1830948734029056:12345-192.168.202.4@tcp:3:cat.0 Request processed in 15465us (16704us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129568.069381:0:31518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7665 00002000:00100000:3.0:1746129568.069394:0:31518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3f5:0x0] (2097152->3145727) req@ffff880094f45500 x1830948734029056/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:309/0 lens 488/440 e 0 to 0 dl 1746129579 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129568.069404:0:31518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094f45500 with x1830948734029056 ext(2097152->3145727) 00002000:00010000:3.0:1746129568.069411:0:31518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094f45500 00000100:00100000:2.0:1746129568.072591:0:8416:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+27:1963:x1830948734029440:12345-192.168.202.4@tcp:4:cat.0 Request processed in 12375us (12618us total) trans 21474841324 rc 0/0 00000100:00100000:2.0:1746129568.072604:0:8416:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2393 00002000:00100000:2.0:1746129568.072617:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3ef:0x0] (3878912->4194303) req@ffff880094f44000 x1830948734029440/t21474841324(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:309/0 lens 488/448 e 0 to 0 dl 1746129579 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129568.072627:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094f44000 with x1830948734029440 ext(3878912->4194303) 00010000:00010000:2.0:1746129568.072637:0:8416:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880095cda000/0x40a459093b06949d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3878912->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20a51 expref: 27 pid: 11014 timeout: 923 lvb_type: 0 00010000:00010000:2.0:1746129568.072652:0:8416:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880095cda000/0x40a459093b06949d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3878912->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20a51 expref: 27 pid: 11014 timeout: 923 lvb_type: 0 00002000:00010000:2.0:1746129568.072659:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094f44000 00000100:00100000:1.0:1746129568.073806:0:31519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+18:1962:x1830948734029312:12345-192.168.202.4@tcp:3:cat.0 Request processed in 19070us (21124us total) trans 0 rc 815104/815104 00000100:00100000:1.0:1746129568.073815:0:31519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7666 00002000:00100000:1.0:1746129568.073821:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f5:0x0] (3379200->4194303) req@ffff880094f44e00 x1830948734029312/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:309/0 lens 488/440 e 0 to 0 dl 1746129579 ref 1 fl Complete:/200/0 rc 815104/815104 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129568.073829:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094f44e00 with x1830948734029312 ext(3379200->4194303) 00002000:00010000:1.0:1746129568.073832:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094f44e00 00000100:00100000:0.0:1746129568.076822:0:31520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+25:1962:x1830948734028544:12345-192.168.202.4@tcp:3:cat.0 Request processed in 23904us (24248us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129568.076834:0:31520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2391 00002000:00100000:0.0:1746129568.076844:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3ef:0x0] (2097152->3145727) req@ffff880094f47b80 x1830948734028544/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:309/0 lens 488/440 e 0 to 0 dl 1746129579 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129568.076860:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094f47b80 with x1830948734028544 ext(2097152->3145727) 00010000:00010000:0.0:1746129568.076870:0:31520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880095cda000/0x40a459093b06949d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3878912->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20a51 expref: 25 pid: 11014 timeout: 923 lvb_type: 0 00010000:00010000:0.0:1746129568.076884:0:31520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880095cda000/0x40a459093b06949d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3878912->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20a51 expref: 25 pid: 11014 timeout: 923 lvb_type: 0 00002000:00010000:0.0:1746129568.076891:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094f47b80 00000100:00100000:0.0:1746129568.080559:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129568.080634:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734029568 00000100:00100000:2.0:1746129568.080646:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734029568 00000100:00100000:0.0:1746129568.080665:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129568.080986:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15964 00000100:00100000:2.0:1746129568.080996:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+25:32175:x1830948734029568:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129568.081022:0:7149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129568.081042:0:7149:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009faa2800/0x40a459093b0694e3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20a97 expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129568.081075:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129568.081077:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129568.081082:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009faa2800/0x40a459093b0694e3 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20a97 expref: 26 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129568.081093:0:7149:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009faa2800/0x40a459093b0694e3 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20a97 expref: 26 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129568.081104:0:7149:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009faa2800, rc 0) 00000100:00100000:2.0:1746129568.081153:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+26:32175:x1830948734029568:12345-192.168.202.4@tcp:101:cat.0 Request processed in 159us (652us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129568.081160:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15964 00000100:00100000:3.0:1746129568.081247:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734029696 00000100:00100000:3.0:1746129568.081251:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734029696 00010000:00010000:3.0:1746129568.081271:0:7087:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095cda000/0x40a459093b06949d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3878912->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20a51 expref: 26 pid: 11014 timeout: 923 lvb_type: 0 00000100:00100000:3.0:1746129568.081348:0:7087:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8152 00000100:00100000:3.0:1746129568.081354:0:7087:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092fd0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+26:1962:x1830948734029696:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129568.081363:0:7087:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129568.081387:0:7087:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095cda000/0x40a459093b06949d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3878912->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20a51 expref: 26 pid: 11014 timeout: 923 lvb_type: 0 00010000:00010000:3.0:1746129568.081397:0:7087:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095cda000/0x40a459093b06949d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3878912->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20a51 expref: 26 pid: 11014 timeout: 923 lvb_type: 0 00010000:00010000:3.0:1746129568.081421:0:7087:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095cda000/0x40a459093b06949d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3878912->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20a51 expref: 26 pid: 11014 timeout: 923 lvb_type: 0 00010000:00010000:3.0:1746129568.081444:0:7087:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129568.081445:0:7087:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129568.081451:0:7087:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009faa2400/0x40a459093b0694dc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20a90 expref: 35 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129568.081459:0:7087:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009faa2400/0x40a459093b0694dc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20a90 expref: 35 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129568.081465:0:7087:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129568.081466:0:7087:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129568.081468:0:7087:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009faa2800/0x40a459093b0694e3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20a97 expref: 25 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129568.081474:0:7087:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009faa2800/0x40a459093b0694e3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20a97 expref: 25 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129568.081500:0:7087:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009faa2800/0x40a459093b0694e3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20a97 expref: 25 pid: 7149 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129568.081512:0:7087:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a07ad500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7087:1830948737478912:192.168.202.4@tcp:105: 00010000:00010000:3.0:1746129568.086021:0:7087:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009faa2400/0x40a459093b0694dc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20a90 expref: 35 pid: 7149 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129568.086048:0:7087:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a07ac000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7087:1830948737479040:192.168.202.4@tcp:105: 00000100:00100000:3.0:1746129568.086149:0:7087:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e29f240 going to sleep for 11 seconds 00000100:00100000:0.0:1746129568.091321:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129568.092480:0:7087:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a07ad500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7087:1830948737478912:192.168.202.4@tcp:105: 00000100:00100000:1.0:1746129568.093724:0:31520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734029952 00000100:00100000:1.0:1746129568.093735:0:31520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734029952 00002000:00100000:1.0:1746129568.093784:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->4194303) req@ffff880092fd1f80 x1830948734029952/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:309/0 lens 488/0 e 0 to 0 dl 1746129579 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129568.093795:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092fd1f80 with x1830948734029952 ext(3145728->4194303) 00002000:00010000:1.0:1746129568.093800:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092fd1f80 00000100:00100000:1.0:1746129568.093828:0:31520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7667 00000100:00100000:1.0:1746129568.093835:0:31520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092fd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+26:1963:x1830948734029952:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129568.095187:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129568.095273:0:7087:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a07ac000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7087:1830948737479040:192.168.202.4@tcp:105: 00010000:00010000:3.0:1746129568.095310:0:7087:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129568.095351:0:7087:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092fd0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+27:1962:x1830948734029696:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 13996us (14685us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129568.095362:0:7087:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8152 00000100:00100000:2.0:1746129568.095514:0:31519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734030208 00000100:00100000:2.0:1746129568.095520:0:31519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734030208 00002000:00100000:2.0:1746129568.095551:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3ef:0x0] (2097152->3145727) req@ffff88012baed180 x1830948734030208/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:309/0 lens 488/0 e 0 to 0 dl 1746129579 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129568.095559:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012baed180 with x1830948734030208 ext(2097152->3145727) 00002000:00010000:2.0:1746129568.095563:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012baed180 00000100:00100000:2.0:1746129568.095578:0:31519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7668 00000100:00100000:2.0:1746129568.095585:0:31519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ada2ffba-8920-4ecb-8068-68caa9806978+36:1963:x1830948734030208:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:1.0:1746129568.102857:0:31520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092fd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+25:1963:x1830948734029952:12345-192.168.202.4@tcp:3:cat.0 Request processed in 9008us (11533us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129568.102871:0:31520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7667 00002000:00100000:1.0:1746129568.102885:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->4194303) req@ffff880092fd1f80 x1830948734029952/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:309/0 lens 488/440 e 0 to 0 dl 1746129579 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129568.102895:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092fd1f80 with x1830948734029952 ext(3145728->4194303) 00002000:00010000:1.0:1746129568.102901:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092fd1f80 00000100:00100000:2.0:1746129568.108012:0:31519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ada2ffba-8920-4ecb-8068-68caa9806978+36:1963:x1830948734030208:12345-192.168.202.4@tcp:3:cat.0 Request processed in 12414us (12818us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129568.108025:0:31519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7668 00002000:00100000:2.0:1746129568.108039:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3ef:0x0] (2097152->3145727) req@ffff88012baed180 x1830948734030208/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:309/0 lens 488/440 e 0 to 0 dl 1746129579 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129568.108050:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012baed180 with x1830948734030208 ext(2097152->3145727) 00002000:00010000:2.0:1746129568.108057:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012baed180 00000100:00100000:0.0:1746129568.113500:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129568.113583:0:31519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734030464 00000100:00100000:2.0:1746129568.113593:0:31519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734030464 00002000:00100000:2.0:1746129568.113646:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3ef:0x0] (4194304->5148671) req@ffff88012baeed80 x1830948734030464/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:309/0 lens 488/0 e 0 to 0 dl 1746129579 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129568.113657:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012baeed80 with x1830948734030464 ext(4194304->5148671) 00002000:00010000:2.0:1746129568.113663:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012baeed80 00000100:00100000:2.0:1746129568.113702:0:31519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7669 00000100:00100000:2.0:1746129568.113710:0:31519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baeed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+25:1962:x1830948734030464:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129568.115449:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129568.116503:0:11014:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734030592 00000100:00100000:3.0:1746129568.116514:0:11014:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734030592 00000100:00100000:3.0:1746129568.117272:0:11014:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15965 00000100:00100000:3.0:1746129568.117282:0:11014:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ada2ffba-8920-4ecb-8068-68caa9806978+35:32176:x1830948734030592:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129568.117326:0:11014:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129568.117354:0:11014:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a051cc00/0x40a459093b0694ea lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20a9e expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129568.117386:0:11014:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ee1b000/0x40a459093b0694b9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3379199) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20a6d expref: 17 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129568.117393:0:11014:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129568.117395:0:11014:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129568.117398:0:11014:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a051cc00/0x40a459093b0694ea lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20a9e expref: 36 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129568.117431:0:11014:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ee1b000/0x40a459093b0694b9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3379199) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20a6d expref: 17 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129568.117444:0:11014:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ee1b000/0x40a459093b0694b9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3379199) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20a6d expref: 17 pid: 7149 timeout: 923 lvb_type: 0 00000100:00100000:3.0:1746129568.117456:0:11014:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a07ac000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11014:1830948737479168:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129568.117562:0:11014:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e29f240 going to sleep for 11 seconds 00000100:00100000:0.0:1746129568.121416:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129568.121880:0:11014:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a07ac000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11014:1830948737479168:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129568.121911:0:11014:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a051cc00/0x40a459093b0694ea lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20a9e expref: 36 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129568.121929:0:11014:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a051cc00, rc 0) 00000100:00100000:3.0:1746129568.121979:0:11014:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ada2ffba-8920-4ecb-8068-68caa9806978+36:32176:x1830948734030592:12345-192.168.202.4@tcp:101:cat.0 Request processed in 4699us (6536us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129568.121988:0:11014:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15965 00000100:00100000:1.0:1746129568.122822:0:31520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734030720 00000100:00100000:1.0:1746129568.122831:0:31520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734030720 00002000:00100000:1.0:1746129568.122866:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3f5:0x0] (3145728->3379199) req@ffff88012baee680 x1830948734030720/t0(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:309/0 lens 488/0 e 0 to 0 dl 1746129579 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129568.122875:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012baee680 with x1830948734030720 ext(3145728->3379199) 00010000:00010000:1.0:1746129568.122881:0:31520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ee1b000/0x40a459093b0694b9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3379199) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20a6d expref: 18 pid: 7149 timeout: 923 lvb_type: 0 00010000:00010000:1.0:1746129568.122893:0:31520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ee1b000/0x40a459093b0694b9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3379199) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20a6d expref: 18 pid: 7149 timeout: 923 lvb_type: 0 00002000:00010000:1.0:1746129568.122899:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012baee680 00000100:00100000:1.0:1746129568.122928:0:31520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2394 00000100:00100000:1.0:1746129568.122935:0:31520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+18:1962:x1830948734030720:12345-192.168.202.4@tcp:4:cat.0 00000100:00100000:2.0:1746129568.123210:0:31519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baeed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+25:1962:x1830948734030464:12345-192.168.202.4@tcp:3:cat.0 Request processed in 9499us (9720us total) trans 0 rc 954368/954368 00000100:00100000:2.0:1746129568.123218:0:31519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7669 00002000:00100000:2.0:1746129568.123224:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3ef:0x0] (4194304->5148671) req@ffff88012baeed80 x1830948734030464/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:309/0 lens 488/440 e 0 to 0 dl 1746129579 ref 1 fl Complete:/200/0 rc 954368/954368 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129568.123231:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012baeed80 with x1830948734030464 ext(4194304->5148671) 00002000:00010000:2.0:1746129568.123235:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012baeed80 00000100:00100000:0.0:1746129568.126589:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129568.127859:0:11014:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734030848 00000100:00100000:3.0:1746129568.127871:0:11014:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734030848 00000100:00100000:3.0:1746129568.128082:0:11014:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15966 00000100:00100000:3.0:1746129568.128092:0:11014:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cda4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:1962:x1830948734030848:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129568.128113:0:11014:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129568.128133:0:11014:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a051ce00/0x40a459093b0694f1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20aa5 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129568.128192:0:11014:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a07ac000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11014:1830948737479296:192.168.202.4@tcp:106: 00000100:00100000:3.0:1746129568.128835:0:11014:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e29f240 going to sleep for 11 seconds 00000100:00100000:0.0:1746129568.130551:0:31520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+22:1962:x1830948734030720:12345-192.168.202.4@tcp:4:cat.0 Request processed in 7606us (9136us total) trans 17179874081 rc 0/0 00000100:00100000:0.0:1746129568.130563:0:31520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2394 00002000:00100000:0.0:1746129568.130574:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3f5:0x0] (3145728->3379199) req@ffff88012baee680 x1830948734030720/t17179874081(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:309/0 lens 488/448 e 0 to 0 dl 1746129579 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129568.130583:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012baee680 with x1830948734030720 ext(3145728->3379199) 00010000:00010000:0.0:1746129568.130596:0:31520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ee1b000/0x40a459093b0694b9 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3379199) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20a6d expref: 22 pid: 7149 timeout: 923 lvb_type: 0 00010000:00010000:0.0:1746129568.130615:0:31520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ee1b000/0x40a459093b0694b9 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3379199) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20a6d expref: 22 pid: 7149 timeout: 923 lvb_type: 0 00002000:00010000:0.0:1746129568.130621:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012baee680 00000100:00100000:3.0:1746129568.130931:0:11014:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a07ac000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11014:1830948737479296:192.168.202.4@tcp:106: 00010000:00010000:3.0:1746129568.130961:0:11014:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a051ce00/0x40a459093b0694f1 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20aa5 expref: 21 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129568.130972:0:11014:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a051ce00/0x40a459093b0694f1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20aa5 expref: 21 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129568.130997:0:11014:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a051ce00, rc 0) 00000100:00100000:3.0:1746129568.131032:0:11014:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cda4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:1962:x1830948734030848:12345-192.168.202.4@tcp:101:cat.0 Request processed in 2942us (4450us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129568.131038:0:11014:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15966 00000100:00100000:1.0:1746129568.134807:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129568.134898:0:11014:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734030976 00000100:00100000:3.0:1746129568.134908:0:11014:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734030976 00000100:00100000:3.0:1746129568.134966:0:11014:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15967 00000100:00100000:3.0:1746129568.134974:0:11014:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:1961:x1830948734030976:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129568.134993:0:11014:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129568.135010:0:11014:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a051c800/0x40a459093b0694f8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20aac expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129568.135066:0:11014:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a07ac000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11014:1830948737479424:192.168.202.4@tcp:106: 00000100:00100000:3.0:1746129568.135159:0:11014:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e29f240 going to sleep for 11 seconds 00000100:00100000:0.0:1746129568.135604:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129568.135654:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734031104 00000100:00100000:2.0:1746129568.135659:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734031104 00010000:00010000:2.0:1746129568.135679:0:7087:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ee1b000/0x40a459093b0694b9 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3379199) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20a6d expref: 22 pid: 7149 timeout: 923 lvb_type: 0 00000100:00100000:2.0:1746129568.135706:0:15749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8153 00000100:00100000:2.0:1746129568.135712:0:15749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cda5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+22:1962:x1830948734031104:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129568.135721:0:15749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129568.135745:0:15749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ee1b000/0x40a459093b0694b9 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3379199) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20a6d expref: 22 pid: 7149 timeout: 923 lvb_type: 0 00010000:00010000:2.0:1746129568.135757:0:15749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ee1b000/0x40a459093b0694b9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3379199) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20a6d expref: 22 pid: 7149 timeout: 923 lvb_type: 0 00010000:00010000:2.0:1746129568.135778:0:15749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129568.135780:0:15749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129568.135788:0:15749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a051cc00/0x40a459093b0694ea lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20a9e expref: 35 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129568.135795:0:15749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a051cc00/0x40a459093b0694ea lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20a9e expref: 35 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129568.135820:0:15749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a051cc00/0x40a459093b0694ea lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20a9e expref: 35 pid: 11014 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129568.135828:0:15749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013575f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15749:1830948737479552:192.168.202.4@tcp:105: 00000100:00100000:2.0:1746129568.135871:0:15749:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0aca80 going to sleep for 11 seconds 00010000:00010000:3.0:1746129568.137826:0:11014:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.202.4@tcp) returned -22 from glimpse AST (req@ffff8800a07ac000 x1830948737479424) - normal race ns: filter-lustre-OST0001_UUID lock: ffff88009ee1b000/0x40a459093b0694b9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3379199) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20a6d expref: 22 pid: 7149 timeout: 923 lvb_type: 0 00010000:00010000:3.0:1746129568.137860:0:11014:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ee1b000/0x40a459093b0694b9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3379199) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20a6d expref: 22 pid: 7149 timeout: 923 lvb_type: 0 00000100:00100000:3.0:1746129568.137892:0:11014:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a07ac000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11014:1830948737479424:192.168.202.4@tcp:106: 00010000:00010000:3.0:1746129568.137921:0:11014:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a051c800/0x40a459093b0694f8 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20aac expref: 21 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129568.137932:0:11014:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a051c800/0x40a459093b0694f8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20aac expref: 21 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129568.137940:0:11014:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a051c800, rc 0) 00000100:00100000:3.0:1746129568.137998:0:11014:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:1961:x1830948734030976:12345-192.168.202.4@tcp:101:cat.0 Request processed in 3024us (3201us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129568.138005:0:11014:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15967 00000100:00100000:2.0:1746129568.139712:0:15749:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013575f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15749:1830948737479552:192.168.202.4@tcp:105: 00010000:00010000:2.0:1746129568.139734:0:15749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129568.139777:0:15749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cda5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+19:1962:x1830948734031104:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 4063us (4171us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129568.139786:0:15749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8153 00000100:00100000:0.0:1746129568.144076:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129568.144130:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129568.144164:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129568.144210:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129568.144231:0:8416:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734031488 00000100:00100000:3.0:1746129568.144241:0:8416:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734031488 00002000:00100000:3.0:1746129568.144319:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3f5:0x0] (2097152->3145727) req@ffff88012cda5f80 x1830948734031488/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:309/0 lens 488/0 e 0 to 0 dl 1746129579 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129568.144330:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cda5f80 with x1830948734031488 ext(2097152->3145727) 00002000:00010000:3.0:1746129568.144335:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012cda5f80 00000100:00100000:3.0:1746129568.144365:0:8416:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734031872 00000100:00100000:3.0:1746129568.144367:0:8416:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734031872 00002000:00100000:3.0:1746129568.144379:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3f5:0x0] (3145728->4194303) req@ffff88012cda6d80 x1830948734031872/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:309/0 lens 488/0 e 0 to 0 dl 1746129579 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129568.144386:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cda6d80 with x1830948734031872 ext(3145728->4194303) 00000100:00100000:2.0:1746129568.144387:0:20861:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734031616 00002000:00010000:3.0:1746129568.144388:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012cda6d80 00000100:00100000:2.0:1746129568.144391:0:20861:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734031616 00000100:00100000:3.0:1746129568.144401:0:31521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734032128 00000100:00100000:3.0:1746129568.144404:0:31521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734032128 00002000:00100000:3.0:1746129568.144417:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->4194303) req@ffff88012cda7480 x1830948734032128/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:309/0 lens 488/0 e 0 to 0 dl 1746129579 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746129568.144418:0:20861:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4728 00002000:00100000:3.0:1746129568.144423:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cda7480 with x1830948734032128 ext(3145728->4194303) 00000100:00100000:2.0:1746129568.144425:0:20861:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cda4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+8:32175:x1830948734031616:12345-192.168.202.4@tcp:35:cat.0 00002000:00010000:3.0:1746129568.144426:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012cda7480 00000100:00100000:3.0:1746129568.144434:0:31521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7670 00000100:00100000:3.0:1746129568.144438:0:31521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cda5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ada2ffba-8920-4ecb-8068-68caa9806978+37:1963:x1830948734031488:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:2.0:1746129568.144617:0:20861:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cda4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+9:32175:x1830948734031616:12345-192.168.202.4@tcp:35:cat.0 Request processed in 191us (553us total) trans 8589945250 rc 0/0 00000100:00100000:2.0:1746129568.144622:0:20861:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4728 00000100:00100000:2.0:1746129568.144644:0:31519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7671 00000100:00100000:2.0:1746129568.144648:0:31519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cda6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ada2ffba-8920-4ecb-8068-68caa9806978+37:1963:x1830948734031872:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:3.0:1746129568.145725:0:31518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7672 00000100:00100000:3.0:1746129568.145734:0:31518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cda7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ada2ffba-8920-4ecb-8068-68caa9806978+36:1963:x1830948734032128:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:3.0:1746129568.161906:0:31521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cda5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ada2ffba-8920-4ecb-8068-68caa9806978+38:1963:x1830948734031488:12345-192.168.202.4@tcp:3:cat.0 Request processed in 17452us (17761us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129568.161920:0:31521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7670 00002000:00100000:3.0:1746129568.161936:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f5:0x0] (2097152->3145727) req@ffff88012cda5f80 x1830948734031488/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:309/0 lens 488/440 e 0 to 0 dl 1746129579 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129568.161945:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cda5f80 with x1830948734031488 ext(2097152->3145727) 00002000:00010000:3.0:1746129568.161952:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012cda5f80 00000100:00100000:2.0:1746129568.165489:0:31519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cda6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ada2ffba-8920-4ecb-8068-68caa9806978+36:1963:x1830948734031872:12345-192.168.202.4@tcp:3:cat.0 Request processed in 20825us (21309us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129568.165503:0:31519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7671 00002000:00100000:2.0:1746129568.165516:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f5:0x0] (3145728->4194303) req@ffff88012cda6d80 x1830948734031872/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:309/0 lens 488/440 e 0 to 0 dl 1746129579 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129568.165526:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cda6d80 with x1830948734031872 ext(3145728->4194303) 00002000:00010000:2.0:1746129568.165532:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012cda6d80 00000100:00100000:3.0:1746129568.169171:0:31518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cda7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ada2ffba-8920-4ecb-8068-68caa9806978+36:1963:x1830948734032128:12345-192.168.202.4@tcp:3:cat.0 Request processed in 23427us (24949us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129568.169182:0:31518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7672 00002000:00100000:3.0:1746129568.169195:0:31518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->4194303) req@ffff88012cda7480 x1830948734032128/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:309/0 lens 488/440 e 0 to 0 dl 1746129579 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129568.169204:0:31518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cda7480 with x1830948734032128 ext(3145728->4194303) 00002000:00010000:3.0:1746129568.169210:0:31518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012cda7480 00000100:00100000:0.0:1746129568.178473:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129568.178615:0:31518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734032384 00000100:00100000:3.0:1746129568.178625:0:31518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734032384 00002000:00100000:3.0:1746129568.178679:0:31518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3ef:0x0] (4194304->5148671) req@ffff88009016a300 x1830948734032384/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:309/0 lens 488/0 e 0 to 0 dl 1746129579 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129568.178689:0:31518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009016a300 with x1830948734032384 ext(4194304->5148671) 00002000:00010000:3.0:1746129568.178695:0:31518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009016a300 00000100:00100000:3.0:1746129568.178724:0:31518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7673 00000100:00100000:3.0:1746129568.178730:0:31518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009016a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ada2ffba-8920-4ecb-8068-68caa9806978+36:1962:x1830948734032384:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:3.0:1746129568.186811:0:31518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009016a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ada2ffba-8920-4ecb-8068-68caa9806978+36:1962:x1830948734032384:12345-192.168.202.4@tcp:3:cat.0 Request processed in 8066us (8335us total) trans 0 rc 954368/954368 00000100:00100000:3.0:1746129568.186825:0:31518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7673 00002000:00100000:3.0:1746129568.186838:0:31518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3ef:0x0] (4194304->5148671) req@ffff88009016a300 x1830948734032384/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:309/0 lens 488/440 e 0 to 0 dl 1746129579 ref 1 fl Complete:/200/0 rc 954368/954368 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129568.186848:0:31518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009016a300 with x1830948734032384 ext(4194304->5148671) 00002000:00010000:3.0:1746129568.186855:0:31518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009016a300 00000100:00100000:0.0:1746129568.195833:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129568.195970:0:16680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734032640 00000100:00100000:2.0:1746129568.195980:0:16680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734032640 00000100:00100000:2.0:1746129568.196037:0:16680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4729 00000100:00100000:2.0:1746129568.196046:0:16680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090168a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ada2ffba-8920-4ecb-8068-68caa9806978+291:32176:x1830948734032640:12345-192.168.202.4@tcp:35:cat.0 00000100:00100000:2.0:1746129568.196288:0:16680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090168a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ada2ffba-8920-4ecb-8068-68caa9806978+292:32176:x1830948734032640:12345-192.168.202.4@tcp:35:cat.0 Request processed in 242us (466us total) trans 8589945251 rc 0/0 00000100:00100000:2.0:1746129568.196351:0:16680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4729 00000100:00100000:0.0:1746129568.209696:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129568.209979:0:2271:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734032896 00000100:00100000:2.0:1746129568.209989:0:2271:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734032896 00000100:00100000:2.0:1746129568.210039:0:2271:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11168 00000100:00100000:2.0:1746129568.210047:0:2271:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ada2ffba-8920-4ecb-8068-68caa9806978+292:32183:x1830948734032896:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:2.0:1746129568.210075:0:2271:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129568.210095:0:2271:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa3600/0x40a459093b0694ff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20ab3 expref: -99 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129568.210209:0:2271:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa3800/0x40a459093b069506 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129568.210222:0:2271:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa3800/0x40a459093b069506 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129568.210233:0:2271:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa3800/0x40a459093b069506 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129568.210245:0:2271:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa3a00/0x40a459093b06950d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129568.210250:0:2271:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa3a00/0x40a459093b06950d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129568.210255:0:2271:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa3a00/0x40a459093b06950d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129568.210426:0:2271:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa3c00/0x40a459093b069514 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129568.210438:0:2271:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa3c00/0x40a459093b069514 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129568.210444:0:2271:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa3c00/0x40a459093b069514 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00000004:00200000:2.0:1746129568.210453:0:2271:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:2.0:1746129568.210539:0:2271:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa3800/0x40a459093b069506 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129568.210546:0:2271:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa3800/0x40a459093b069506 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129568.210551:0:2271:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa3800/0x40a459093b069506 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129568.210558:0:2271:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009faa3800 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746129568.210562:0:2271:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa3800/0x40a459093b069506 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129568.210569:0:2271:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa3800/0x40a459093b069506 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129568.210580:0:2271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880132ef8f00) 00010000:00010000:2.0:1746129568.210583:0:2271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129568.210587:0:2271:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa3800/0x40a459093b069506 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129568.210592:0:2271:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa3800/0x40a459093b069506 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129568.210811:0:2271:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa3a00/0x40a459093b06950d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129568.210820:0:2271:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa3a00/0x40a459093b06950d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129568.210825:0:2271:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa3a00/0x40a459093b06950d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129568.210829:0:2271:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009faa3a00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746129568.210831:0:2271:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa3a00/0x40a459093b06950d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129568.210836:0:2271:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa3a00/0x40a459093b06950d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129568.210842:0:2271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f0e7400) 00010000:00010000:2.0:1746129568.210845:0:2271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129568.210847:0:2271:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa3a00/0x40a459093b06950d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129568.210851:0:2271:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa3a00/0x40a459093b06950d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129568.210889:0:2271:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa3600/0x40a459093b0694ff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20ab3 expref: 295 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129568.210900:0:2271:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa3c00/0x40a459093b069514 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20ab3 expref: 294 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129568.210906:0:2271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:2.0:1746129568.210908:0:2271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746129568.210910:0:2271:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009faa3c00, rc 0) 00000100:00100000:2.0:1746129568.210970:0:2271:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ada2ffba-8920-4ecb-8068-68caa9806978+294:32183:x1830948734032896:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 923us (1286us total) trans 8589945252 rc 0/0 00000100:00100000:2.0:1746129568.210978:0:2271:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11168 00000100:00100000:0.0:1746129568.259469:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129568.259857:0:2271:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734033152 00000100:00100000:2.0:1746129568.259867:0:2271:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734033152 00000100:00100000:2.0:1746129568.259917:0:2271:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11169 00000100:00100000:2.0:1746129568.259924:0:2271:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+9:32185:x1830948734033152:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:2.0:1746129568.259950:0:2271:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129568.259970:0:2271:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa3e00/0x40a459093b069522 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20aba expref: -99 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129568.260095:0:2271:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa3200/0x40a459093b069529 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129568.260111:0:2271:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa3200/0x40a459093b069529 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129568.260123:0:2271:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa3200/0x40a459093b069529 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129568.260139:0:2271:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa3600/0x40a459093b069530 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129568.260145:0:2271:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa3600/0x40a459093b069530 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129568.260151:0:2271:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa3600/0x40a459093b069530 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129568.260283:0:2271:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa3a00/0x40a459093b069537 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129568.260314:0:2271:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa3a00/0x40a459093b069537 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129568.260323:0:2271:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa3a00/0x40a459093b069537 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00000004:00200000:2.0:1746129568.260345:0:2271:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:2.0:1746129568.260444:0:2271:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa3200/0x40a459093b069529 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129568.260450:0:2271:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa3200/0x40a459093b069529 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129568.260456:0:2271:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa3200/0x40a459093b069529 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129568.260462:0:2271:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009faa3200 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746129568.260466:0:2271:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa3200/0x40a459093b069529 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129568.260472:0:2271:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa3200/0x40a459093b069529 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129568.260483:0:2271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880132ef8f00) 00010000:00010000:2.0:1746129568.260486:0:2271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129568.260490:0:2271:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa3200/0x40a459093b069529 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129568.260495:0:2271:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa3200/0x40a459093b069529 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129568.261575:0:2271:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa3600/0x40a459093b069530 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129568.261589:0:2271:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa3600/0x40a459093b069530 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129568.261598:0:2271:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa3600/0x40a459093b069530 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129568.261602:0:2271:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009faa3600 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746129568.261604:0:2271:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa3600/0x40a459093b069530 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129568.261609:0:2271:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa3600/0x40a459093b069530 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129568.261616:0:2271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f0e7100) 00010000:00010000:2.0:1746129568.261618:0:2271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129568.261620:0:2271:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa3600/0x40a459093b069530 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129568.261623:0:2271:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa3600/0x40a459093b069530 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129568.261677:0:2271:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa3e00/0x40a459093b069522 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20aba expref: 12 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129568.261689:0:2271:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa3a00/0x40a459093b069537 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20aba expref: 11 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129568.261696:0:2271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:2.0:1746129568.261697:0:2271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746129568.261700:0:2271:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009faa3a00, rc 0) 00000100:00100000:2.0:1746129568.261845:0:2271:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+11:32185:x1830948734033152:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 1920us (2467us total) trans 8589945253 rc 0/0 00000100:00100000:2.0:1746129568.261853:0:2271:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11169 00000100:00100000:0.0:1746129568.285640:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129568.285795:0:11014:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734033280 00000100:00100000:3.0:1746129568.285808:0:11014:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734033280 00000100:00100000:3.0:1746129568.285888:0:11014:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15968 00000100:00100000:3.0:1746129568.285898:0:11014:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ada2ffba-8920-4ecb-8068-68caa9806978+36:32183:x1830948734033280:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:3.0:1746129568.285918:0:11014:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129568.285937:0:11014:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a051c600/0x40a459093b069545 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20ac1 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129568.286091:0:11014:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009584ee00/0x40a459093b069377 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f209cc expref: 15 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129568.286105:0:11014:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ee1b800/0x40a459093b069465 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20a20 expref: 37 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129568.286112:0:11014:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800909ce400/0x40a459093b06945e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20a19 expref: 24 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129568.286120:0:11014:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129568.286122:0:11014:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129568.286126:0:11014:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a051c600/0x40a459093b069545 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [368640->991231] (req 368640->991231) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20ac1 expref: 37 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129568.286164:0:11014:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800909ce400/0x40a459093b06945e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20a19 expref: 24 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129568.286178:0:11014:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800909ce400/0x40a459093b06945e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20a19 expref: 24 pid: 8410 timeout: 923 lvb_type: 0 00000100:00100000:3.0:1746129568.286192:0:11014:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a07ac000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11014:1830948737479680:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129568.286513:0:11014:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ee1b800/0x40a459093b069465 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20a20 expref: 37 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129568.286522:0:11014:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ee1b800/0x40a459093b069465 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20a20 expref: 37 pid: 4699 timeout: 923 lvb_type: 0 00000100:00100000:3.0:1746129568.286530:0:11014:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a07ad500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11014:1830948737479808:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129568.286725:0:11014:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009584ee00/0x40a459093b069377 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f209cc expref: 15 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129568.286735:0:11014:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009584ee00/0x40a459093b069377 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f209cc expref: 15 pid: 22481 timeout: 923 lvb_type: 1 00000100:00100000:3.0:1746129568.286755:0:11014:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a07ace00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11014:1830948737479936:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129568.286789:0:11014:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e29f240 going to sleep for 11 seconds 00000100:00100000:0.0:1746129568.288419:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129568.288523:0:11014:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a07ac000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11014:1830948737479680:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129568.288533:0:11014:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a07ad500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11014:1830948737479808:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129568.288546:0:11014:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a07ace00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11014:1830948737479936:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129568.288574:0:11014:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a051c600/0x40a459093b069545 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [368640->991231] (req 368640->991231) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20ac1 expref: 37 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129568.288590:0:11014:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a051c600, rc 0) 00000100:00100000:3.0:1746129568.288628:0:11014:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ada2ffba-8920-4ecb-8068-68caa9806978+37:32183:x1830948734033280:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 2731us (3102us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129568.288637:0:11014:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15968 00000100:00100000:2.0:1746129568.288774:0:15749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734033408 00000100:00100000:2.0:1746129568.288782:0:15749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734033408 00010000:00010000:2.0:1746129568.288811:0:15749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800909ce400/0x40a459093b06945e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20a19 expref: 25 pid: 8410 timeout: 923 lvb_type: 0 00000100:00100000:2.0:1746129568.288835:0:15749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8154 00000100:00100000:2.0:1746129568.288842:0:15749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+25:1960:x1830948734033408:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129568.288854:0:15749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129568.288877:0:15749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800909ce400/0x40a459093b06945e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20a19 expref: 25 pid: 8410 timeout: 923 lvb_type: 0 00010000:00010000:2.0:1746129568.288886:0:15749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800909ce400/0x40a459093b06945e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20a19 expref: 25 pid: 8410 timeout: 923 lvb_type: 0 00010000:00010000:2.0:1746129568.288907:0:15749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800909ce400/0x40a459093b06945e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20a19 expref: 25 pid: 8410 timeout: 923 lvb_type: 0 00010000:00010000:2.0:1746129568.288922:0:15749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129568.288941:0:15749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+24:1960:x1830948734033408:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 100us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129568.288946:0:15749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8154 00000100:00100000:0.0:1746129568.289150:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129568.289378:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734033536 00000100:00100000:3.0:1746129568.289384:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734033536 00010000:00010000:3.0:1746129568.289404:0:7087:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ee1b800/0x40a459093b069465 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20a20 expref: 37 pid: 4699 timeout: 923 lvb_type: 0 00000100:00100000:3.0:1746129568.289425:0:7087:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8155 00000100:00100000:3.0:1746129568.289432:0:7087:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ada2ffba-8920-4ecb-8068-68caa9806978+37:1963:x1830948734033536:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129568.289441:0:7087:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129568.289453:0:7087:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ee1b800/0x40a459093b069465 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20a20 expref: 37 pid: 4699 timeout: 923 lvb_type: 0 00010000:00010000:3.0:1746129568.289463:0:7087:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ee1b800/0x40a459093b069465 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20a20 expref: 37 pid: 4699 timeout: 923 lvb_type: 0 00010000:00010000:3.0:1746129568.289477:0:7087:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ee1b800/0x40a459093b069465 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20a20 expref: 37 pid: 4699 timeout: 923 lvb_type: 0 00010000:00010000:3.0:1746129568.289777:0:7087:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129568.289818:0:7087:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ada2ffba-8920-4ecb-8068-68caa9806978+36:1963:x1830948734033536:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 375us (656us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129568.289826:0:7087:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8155 00000100:00100000:1.0:1746129568.290127:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129568.290199:0:15749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734033664 00000100:00100000:3.0:1746129568.290203:0:15749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734033664 00010000:00010000:3.0:1746129568.290217:0:15749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009584ee00/0x40a459093b069377 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f209cc expref: 16 pid: 22481 timeout: 923 lvb_type: 1 00000100:00100000:3.0:1746129568.290499:0:15749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8156 00000100:00100000:3.0:1746129568.290506:0:15749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa24a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:068dab75-d300-4ead-a742-d14572ad1e50+16:1963:x1830948734033664:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129568.290517:0:15749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129568.290526:0:15749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009584ee00/0x40a459093b069377 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f209cc expref: 16 pid: 22481 timeout: 923 lvb_type: 1 00010000:00010000:3.0:1746129568.290535:0:15749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009584ee00/0x40a459093b069377 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f209cc expref: 16 pid: 22481 timeout: 923 lvb_type: 1 00010000:00010000:3.0:1746129568.290548:0:15749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009584ee00/0x40a459093b069377 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f209cc expref: 16 pid: 22481 timeout: 923 lvb_type: 1 00010000:00010000:3.0:1746129568.290556:0:15749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129568.290558:0:15749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129568.290565:0:15749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a051c600/0x40a459093b069545 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 368640->991231) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20ac1 expref: 35 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129568.290573:0:15749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a051c600/0x40a459093b069545 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 368640->991231) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20ac1 expref: 35 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129568.290607:0:15749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a051c600/0x40a459093b069545 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 368640->991231) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20ac1 expref: 35 pid: 11014 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129568.290618:0:15749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a07ace00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15749:1830948737480064:192.168.202.4@tcp:105: 00000100:00100000:3.0:1746129568.290934:0:15749:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e29f240 going to sleep for 11 seconds 00000100:00100000:3.0:1746129568.294029:0:15749:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a07ace00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15749:1830948737480064:192.168.202.4@tcp:105: 00010000:00010000:3.0:1746129568.294053:0:15749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129568.294196:0:15749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa24a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:068dab75-d300-4ead-a742-d14572ad1e50+15:1963:x1830948734033664:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 3688us (4067us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129568.294208:0:15749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8156 00000100:00100000:0.0:1746129568.294661:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129568.294764:0:31518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734033920 00000100:00100000:3.0:1746129568.294771:0:31518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734033920 00002000:00100000:3.0:1746129568.294809:0:31518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3ec:0x0] (368640->372735) req@ffff8800959d5180 x1830948734033920/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:309/0 lens 488/0 e 0 to 0 dl 1746129579 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129568.294823:0:31518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800959d5180 with x1830948734033920 ext(368640->372735) 00002000:00010000:3.0:1746129568.294829:0:31518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800959d5180 00000100:00100000:3.0:1746129568.294858:0:31518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7674 00000100:00100000:3.0:1746129568.294865:0:31518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ada2ffba-8920-4ecb-8068-68caa9806978+36:1962:x1830948734033920:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:3.0:1746129568.295029:0:31518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ada2ffba-8920-4ecb-8068-68caa9806978+36:1962:x1830948734033920:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 164us (369us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129568.295035:0:31518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7674 00002000:00100000:3.0:1746129568.295040:0:31518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3ec:0x0] (368640->372735) req@ffff8800959d5180 x1830948734033920/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:309/0 lens 488/4536 e 0 to 0 dl 1746129579 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129568.295047:0:31518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800959d5180 with x1830948734033920 ext(368640->372735) 00002000:00010000:3.0:1746129568.295050:0:31518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800959d5180 00000100:00100000:1.0:1746129568.296905:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129568.297024:0:2271:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734034176 00000100:00100000:3.0:1746129568.297032:0:2271:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734034176 00000100:00100000:3.0:1746129568.297072:0:2271:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11170 00000100:00100000:3.0:1746129568.297079:0:2271:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135724000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+11:32188:x1830948734034176:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129568.297098:0:2271:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129568.297116:0:2271:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a051dc00/0x40a459093b06954c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20ac8 expref: -99 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129568.297237:0:2271:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a051d600/0x40a459093b069553 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129568.297253:0:2271:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a051d600/0x40a459093b069553 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129568.297263:0:2271:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a051d600/0x40a459093b069553 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00000004:00200000:3.0:1746129568.297275:0:2271:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:3.0:1746129568.297430:0:2271:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a051dc00/0x40a459093b06954c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20ac8 expref: 14 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129568.297445:0:2271:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a051d600/0x40a459093b069553 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20ac8 expref: 13 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129568.297454:0:2271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:3.0:1746129568.297457:0:2271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1746129568.297459:0:2271:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a051d600, rc 0) 00000100:00100000:3.0:1746129568.297509:0:2271:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135724000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+13:32188:x1830948734034176:12345-192.168.202.4@tcp:101:cat.0 Request processed in 430us (612us total) trans 8589945254 rc 0/0 00000100:00100000:3.0:1746129568.297515:0:2271:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11170 00000100:00100000:0.0:1746129568.302652:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129568.302817:0:31519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734034432 00000100:00100000:2.0:1746129568.302827:0:31519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734034432 00002000:00100000:2.0:1746129568.302876:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3ec:0x0] (987136->991231) req@ffff8800959d5500 x1830948734034432/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:309/0 lens 488/0 e 0 to 0 dl 1746129579 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129568.302886:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800959d5500 with x1830948734034432 ext(987136->991231) 00002000:00010000:2.0:1746129568.302891:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800959d5500 00000100:00100000:2.0:1746129568.303011:0:31519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7675 00000100:00100000:2.0:1746129568.303024:0:31519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ada2ffba-8920-4ecb-8068-68caa9806978+36:1961:x1830948734034432:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:2.0:1746129568.303357:0:31519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ada2ffba-8920-4ecb-8068-68caa9806978+36:1961:x1830948734034432:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 333us (718us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129568.303364:0:31519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7675 00002000:00100000:2.0:1746129568.303369:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3ec:0x0] (987136->991231) req@ffff8800959d5500 x1830948734034432/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:309/0 lens 488/4536 e 0 to 0 dl 1746129579 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129568.303377:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800959d5500 with x1830948734034432 ext(987136->991231) 00002000:00010000:2.0:1746129568.303379:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800959d5500 00000100:00100000:0.0:1746129568.305104:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129568.305184:0:11014:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734034560 00000100:00100000:3.0:1746129568.305194:0:11014:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734034560 00000100:00100000:0.0:1746129568.305232:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129568.305387:0:11014:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734034688 00000100:00100000:3.0:1746129568.305390:0:11014:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734034688 00000100:00100000:3.0:1746129568.305419:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15969 00000100:00100000:3.0:1746129568.305427:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+24:1963:x1830948734034560:12345-192.168.202.4@tcp:101:cat.0 00000100:00100000:1.0:1746129568.305427:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15970 00000100:00100000:0.0:1746129568.305427:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129568.305434:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+19:1962:x1830948734034688:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129568.305445:0:4385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129568.305445:0:7148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129568.305461:0:4385:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a051d200/0x40a459093b069561 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20acf expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129568.305461:0:7148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d144800/0x40a459093b069568 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20ad6 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129568.305461:0:16680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734034944 00000100:00100000:0.0:1746129568.305464:0:16680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734034944 00010000:00010000:1.0:1746129568.305482:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129568.305484:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746129568.305490:0:16680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4730 00010000:00010000:1.0:1746129568.305493:0:7148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d144800/0x40a459093b069568 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20ad6 expref: 20 pid: 7148 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746129568.305495:0:16680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ada2ffba-8920-4ecb-8068-68caa9806978+294:32183:x1830948734034944:12345-192.168.202.4@tcp:35:multiop.0 00010000:00010000:1.0:1746129568.305508:0:7148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009d144800/0x40a459093b069568 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20ad6 expref: 20 pid: 7148 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746129568.305518:0:4385:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a07ace00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:4385:1830948737480192:192.168.202.4@tcp:106: 00010000:00010000:1.0:1746129568.305518:0:7148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d144800, rc 0) 00000100:00100000:1.0:1746129568.305560:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:1962:x1830948734034688:12345-192.168.202.4@tcp:101:cat.0 Request processed in 126us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129568.305566:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15970 00000100:00100000:3.0:1746129568.305575:0:4385:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e29f000 going to sleep for 11 seconds 00000100:00100000:2.0:1746129568.306060:0:16680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ada2ffba-8920-4ecb-8068-68caa9806978+295:32183:x1830948734034944:12345-192.168.202.4@tcp:35:multiop.0 Request processed in 563us (631us total) trans 8589945255 rc 0/0 00000100:00100000:2.0:1746129568.306067:0:16680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4730 00002000:00010000:3.0:1746129568.308195:0:4385:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3ec:0x0] updating lvb mtime: 1746129568 -> 1746129569 00002000:00010000:3.0:1746129568.308204:0:4385:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3ec:0x0] updating lvb ctime: 1746129568 -> 1746129569 00000100:00100000:3.0:1746129568.308231:0:4385:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a07ace00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:4385:1830948737480192:192.168.202.4@tcp:106: 00010000:00010000:3.0:1746129568.308266:0:4385:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a051d200/0x40a459093b069561 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20acf expref: 25 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129568.308280:0:4385:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a051d200/0x40a459093b069561 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20acf expref: 25 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129568.309095:0:4385:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a051d200, rc 0) 00000100:00100000:3.0:1746129568.309155:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+24:1963:x1830948734034560:12345-192.168.202.4@tcp:101:cat.0 Request processed in 3726us (4057us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129568.309164:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15969 00000100:00100000:0.0:1746129568.311563:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129568.311708:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734035072 00000100:00100000:3.0:1746129568.311718:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734035072 00000100:00100000:3.0:1746129568.311779:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15971 00000100:00100000:3.0:1746129568.311787:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+24:32188:x1830948734035072:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129568.311807:0:4385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129568.311827:0:4385:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a051d400/0x40a459093b06956f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20add expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129568.311856:0:4385:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a051c600/0x40a459093b069545 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 368640->991231) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20ac1 expref: 35 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129568.311864:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129568.311866:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129568.311870:0:4385:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a051d400/0x40a459093b06956f lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20add expref: 25 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129568.311907:0:4385:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a051c600/0x40a459093b069545 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 368640->991231) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20ac1 expref: 35 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129568.311923:0:4385:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a051c600/0x40a459093b069545 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 368640->991231) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20ac1 expref: 35 pid: 11014 timeout: 923 lvb_type: 0 00000100:00100000:3.0:1746129568.311936:0:4385:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a07ace00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:4385:1830948737480320:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129568.312020:0:4385:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e29f000 going to sleep for 11 seconds 00000100:00100000:2.0:1746129568.313054:0:4385:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a07ace00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:4385:1830948737480320:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129568.313076:0:4385:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a051d400/0x40a459093b06956f lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20add expref: 25 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129568.313088:0:4385:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a051d400, rc 0) 00000100:00100000:2.0:1746129568.313118:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+25:32188:x1830948734035072:12345-192.168.202.4@tcp:101:cat.0 Request processed in 1332us (1566us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129568.313126:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15971 00000100:00100000:0.0:1746129568.314068:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129568.314112:0:31519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734035200 00000100:00100000:3.0:1746129568.314119:0:31519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734035200 00002000:00100000:3.0:1746129568.314151:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3ec:0x0] (368640->991231) req@ffff8800959d6680 x1830948734035200/t0(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:309/0 lens 488/0 e 0 to 0 dl 1746129579 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129568.314161:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800959d6680 with x1830948734035200 ext(368640->991231) 00010000:00010000:3.0:1746129568.314168:0:31519:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a051c600/0x40a459093b069545 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 368640->991231) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20ac1 expref: 36 pid: 11014 timeout: 923 lvb_type: 0 00010000:00010000:3.0:1746129568.314181:0:31519:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a051c600/0x40a459093b069545 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 368640->991231) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20ac1 expref: 36 pid: 11014 timeout: 923 lvb_type: 0 00002000:00010000:3.0:1746129568.314188:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800959d6680 00000100:00100000:3.0:1746129568.314211:0:31519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2395 00000100:00100000:3.0:1746129568.314217:0:31519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ada2ffba-8920-4ecb-8068-68caa9806978+36:1961:x1830948734035200:12345-192.168.202.4@tcp:4:multiop.0 00000100:00100000:3.0:1746129568.331859:0:31519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ada2ffba-8920-4ecb-8068-68caa9806978+38:1961:x1830948734035200:12345-192.168.202.4@tcp:4:multiop.0 Request processed in 17630us (17782us total) trans 21474841325 rc 0/0 00000100:00100000:3.0:1746129568.331873:0:31519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2395 00002000:00100000:3.0:1746129568.331886:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3ec:0x0] (368640->991231) req@ffff8800959d6680 x1830948734035200/t21474841325(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:309/0 lens 488/448 e 0 to 0 dl 1746129579 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129568.331900:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800959d6680 with x1830948734035200 ext(368640->991231) 00010000:00010000:3.0:1746129568.331910:0:31519:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a051c600/0x40a459093b069545 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 368640->991231) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20ac1 expref: 38 pid: 11014 timeout: 923 lvb_type: 0 00010000:00010000:3.0:1746129568.331924:0:31519:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a051c600/0x40a459093b069545 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 368640->991231) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20ac1 expref: 38 pid: 11014 timeout: 923 lvb_type: 0 00002000:00010000:3.0:1746129568.331931:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800959d6680 00000100:00100000:0.0:1746129568.336496:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129568.336630:0:15749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734035328 00000100:00100000:3.0:1746129568.336639:0:15749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734035328 00010000:00010000:3.0:1746129568.336682:0:15749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a051c600/0x40a459093b069545 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 368640->991231) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20ac1 expref: 38 pid: 11014 timeout: 923 lvb_type: 0 00000100:00100000:3.0:1746129568.336720:0:15749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8157 00000100:00100000:3.0:1746129568.336727:0:15749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ada2ffba-8920-4ecb-8068-68caa9806978+38:1960:x1830948734035328:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129568.336741:0:15749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129568.336766:0:15749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a051c600/0x40a459093b069545 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 368640->991231) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20ac1 expref: 38 pid: 11014 timeout: 923 lvb_type: 0 00010000:00010000:3.0:1746129568.336778:0:15749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a051c600/0x40a459093b069545 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 368640->991231) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20ac1 expref: 38 pid: 11014 timeout: 923 lvb_type: 0 00010000:00010000:3.0:1746129568.336800:0:15749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a051c600/0x40a459093b069545 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 368640->991231) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20ac1 expref: 38 pid: 11014 timeout: 923 lvb_type: 0 00010000:00010000:3.0:1746129568.336830:0:15749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129568.336832:0:15749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129568.336839:0:15749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a051d400/0x40a459093b06956f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20add expref: 24 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129568.336847:0:15749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a051d400/0x40a459093b06956f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20add expref: 24 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129568.336880:0:15749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a051d400/0x40a459093b06956f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20add expref: 24 pid: 4385 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129568.336891:0:15749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a07ad500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15749:1830948737480448:192.168.202.4@tcp:105: 00000100:00100000:3.0:1746129568.337012:0:15749:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e29f000 going to sleep for 11 seconds 00000100:00100000:3.0:1746129568.340406:0:15749:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a07ad500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15749:1830948737480448:192.168.202.4@tcp:105: 00010000:00010000:3.0:1746129568.340427:0:15749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129568.340472:0:15749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ada2ffba-8920-4ecb-8068-68caa9806978+37:1960:x1830948734035328:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 3745us (3986us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129568.340483:0:15749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8157 00000100:00100000:0.0:1746129568.340661:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129568.340741:0:31519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734035584 00000100:00100000:3.0:1746129568.340747:0:31519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734035584 00002000:00100000:3.0:1746129568.340786:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3ec:0x0] (0->1048575) req@ffff8800959d6d80 x1830948734035584/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:309/0 lens 488/0 e 0 to 0 dl 1746129579 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129568.340795:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800959d6d80 with x1830948734035584 ext(0->1048575) 00002000:00010000:3.0:1746129568.340799:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800959d6d80 00000100:00100000:3.0:1746129568.340817:0:31519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7676 00000100:00100000:3.0:1746129568.340823:0:31519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+25:1962:x1830948734035584:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:3.0:1746129568.349996:0:31519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+25:1962:x1830948734035584:12345-192.168.202.4@tcp:3:cat.0 Request processed in 9160us (9322us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129568.350009:0:31519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7676 00002000:00100000:3.0:1746129568.350024:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3ec:0x0] (0->1048575) req@ffff8800959d6d80 x1830948734035584/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:309/0 lens 488/440 e 0 to 0 dl 1746129579 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129568.350034:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800959d6d80 with x1830948734035584 ext(0->1048575) 00002000:00010000:3.0:1746129568.350041:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800959d6d80 00000100:00100000:0.0:1746129568.368284:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129568.368401:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129568.368483:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129568.369287:0:31519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734035968 00000100:00100000:3.0:1746129568.369320:0:31519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734035968 00002000:00100000:3.0:1746129568.369380:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3ef:0x0] (2097152->3145727) req@ffff8800959d7100 x1830948734035968/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:309/0 lens 488/0 e 0 to 0 dl 1746129579 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746129568.369381:0:31521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734036224 00000100:00100000:2.0:1746129568.369385:0:31521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734036224 00002000:00100000:3.0:1746129568.369390:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800959d7100 with x1830948734035968 ext(2097152->3145727) 00002000:00010000:3.0:1746129568.369396:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800959d7100 00002000:00100000:2.0:1746129568.369403:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f5:0x0] (3145728->4194303) req@ffff88009bc6f850 x1830948734036224/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:309/0 lens 488/0 e 0 to 0 dl 1746129579 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129568.369409:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bc6f850 with x1830948734036224 ext(3145728->4194303) 00002000:00010000:2.0:1746129568.369413:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bc6f850 00000100:00100000:2.0:1746129568.369418:0:31521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734036096 00000100:00100000:2.0:1746129568.369421:0:31521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734036096 00000100:00100000:3.0:1746129568.369423:0:8416:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7677 00002000:00100000:2.0:1746129568.369429:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f5:0x0] (2097152->3145727) req@ffff8800959d7480 x1830948734036096/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:309/0 lens 488/0 e 0 to 0 dl 1746129579 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746129568.369430:0:8416:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+25:1961:x1830948734035968:12345-192.168.202.4@tcp:3:cat.0 00002000:00100000:2.0:1746129568.369435:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800959d7480 with x1830948734036096 ext(2097152->3145727) 00002000:00010000:2.0:1746129568.369437:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800959d7480 00000100:00100000:2.0:1746129568.369445:0:31521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7678 00000100:00100000:2.0:1746129568.369449:0:31521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bc6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:1961:x1830948734036224:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:1.0:1746129568.369651:0:31518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7679 00000100:00100000:1.0:1746129568.369659:0:31518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:1961:x1830948734036096:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:1.0:1746129568.390211:0:31518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+22:1961:x1830948734036096:12345-192.168.202.4@tcp:3:cat.0 Request processed in 20537us (21712us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129568.390231:0:31518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7679 00002000:00100000:1.0:1746129568.390246:0:31518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3f5:0x0] (2097152->3145727) req@ffff8800959d7480 x1830948734036096/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:309/0 lens 488/440 e 0 to 0 dl 1746129579 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129568.390257:0:31518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800959d7480 with x1830948734036096 ext(2097152->3145727) 00002000:00010000:1.0:1746129568.390264:0:31518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800959d7480 00000100:00100000:3.0:1746129568.397738:0:8416:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+25:1961:x1830948734035968:12345-192.168.202.4@tcp:3:cat.0 Request processed in 28296us (29457us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129568.397750:0:8416:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7677 00002000:00100000:3.0:1746129568.397762:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3ef:0x0] (2097152->3145727) req@ffff8800959d7100 x1830948734035968/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:309/0 lens 488/440 e 0 to 0 dl 1746129579 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129568.397772:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800959d7100 with x1830948734035968 ext(2097152->3145727) 00002000:00010000:3.0:1746129568.397779:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800959d7100 00000100:00100000:2.0:1746129568.403553:0:31521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bc6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:1961:x1830948734036224:12345-192.168.202.4@tcp:3:cat.0 Request processed in 34088us (35137us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129568.403564:0:31521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7678 00002000:00100000:2.0:1746129568.403578:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f5:0x0] (3145728->4194303) req@ffff88009bc6f850 x1830948734036224/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:309/0 lens 488/440 e 0 to 0 dl 1746129579 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129568.403588:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bc6f850 with x1830948734036224 ext(3145728->4194303) 00002000:00010000:2.0:1746129568.403594:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bc6f850 00000100:00100000:0.0:1746129568.423889:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129568.423969:0:2271:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734036608 00000100:00100000:3.0:1746129568.423981:0:2271:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734036608 00000100:00100000:3.0:1746129568.424051:0:2271:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11171 00000100:00100000:3.0:1746129568.424060:0:2271:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ada2ffba-8920-4ecb-8068-68caa9806978+295:32193:x1830948734036608:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129568.424088:0:2271:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129568.424106:0:2271:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800909cf000/0x40a459093b069576 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20ae4 expref: -99 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129568.424209:0:2271:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6cf6800/0x40a459093b06957d lrc: 3/1,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129568.424223:0:2271:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6cf6800/0x40a459093b06957d lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129568.424234:0:2271:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6cf6800/0x40a459093b06957d lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00000004:00200000:3.0:1746129568.424245:0:2271:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:3.0:1746129568.424422:0:2271:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800909cf000/0x40a459093b069576 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20ae4 expref: 298 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129568.424455:0:2271:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6cf6800/0x40a459093b06957d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20ae4 expref: 297 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129568.424463:0:2271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:3.0:1746129568.424466:0:2271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1746129568.424470:0:2271:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6cf6800, rc 0) 00000100:00100000:3.0:1746129568.424525:0:2271:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ada2ffba-8920-4ecb-8068-68caa9806978+297:32193:x1830948734036608:12345-192.168.202.4@tcp:101:cat.0 Request processed in 467us (648us total) trans 8589945256 rc 0/0 00000100:00100000:3.0:1746129568.424532:0:2271:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11171 00000100:00100000:0.0:1746129568.430086:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129568.430214:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734036736 00000100:00100000:2.0:1746129568.430224:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734036736 00000100:00100000:2.0:1746129568.430272:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15972 00000100:00100000:2.0:1746129568.430279:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ada2ffba-8920-4ecb-8068-68caa9806978+37:1960:x1830948734036736:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129568.430323:0:4385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129568.430351:0:4385:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009faa2c00/0x40a459093b06958b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20aeb expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129568.430378:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129568.430381:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129568.430389:0:4385:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009faa2c00/0x40a459093b06958b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20aeb expref: 38 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129568.430405:0:4385:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009faa2c00/0x40a459093b06958b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20aeb expref: 38 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129568.430417:0:4385:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009faa2c00, rc 0) 00000100:00100000:2.0:1746129568.430481:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ada2ffba-8920-4ecb-8068-68caa9806978+38:1960:x1830948734036736:12345-192.168.202.4@tcp:101:cat.0 Request processed in 202us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129568.430488:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15972 00000100:00100000:0.0:1746129568.438772:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129568.438837:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129568.440428:0:31521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734036992 00000100:00100000:2.0:1746129568.440440:0:31521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734036992 00002000:00100000:2.0:1746129568.440491:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3ec:0x0] (0->1048575) req@ffff8800959d5180 x1830948734036992/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:309/0 lens 488/0 e 0 to 0 dl 1746129579 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129568.440502:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800959d5180 with x1830948734036992 ext(0->1048575) 00002000:00010000:2.0:1746129568.440508:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800959d5180 00000100:00100000:2.0:1746129568.440540:0:31521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7680 00000100:00100000:2.0:1746129568.440547:0:31521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ada2ffba-8920-4ecb-8068-68caa9806978+38:1962:x1830948734036992:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:1.0:1746129568.440663:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734037120 00000100:00100000:1.0:1746129568.440668:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734037120 00000100:00100000:1.0:1746129568.440701:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15973 00000100:00100000:1.0:1746129568.440706:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:32185:x1830948734037120:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:1.0:1746129568.440718:0:7149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129568.440735:0:7149:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d94fe00/0x40a459093b069592 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20af2 expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129568.440762:0:7149:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800955d3400/0x40a459093b069385 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f209da expref: 15 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129568.440771:0:7149:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5a87a00/0x40a459093b0694b2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20a66 expref: 21 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129568.440778:0:7149:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ee1aa00/0x40a459093b0694ab lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20a5f expref: 35 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129568.440785:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129568.440786:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129568.440790:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d94fe00/0x40a459093b069592 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [1236992->2097151] (req 1236992->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20af2 expref: 21 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129568.440828:0:7149:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ee1aa00/0x40a459093b0694ab lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20a5f expref: 35 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129568.440840:0:7149:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ee1aa00/0x40a459093b0694ab lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20a5f expref: 35 pid: 7149 timeout: 923 lvb_type: 0 00000100:00100000:1.0:1746129568.440852:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135727800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7149:1830948737480576:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129568.440943:0:7149:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5a87a00/0x40a459093b0694b2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20a66 expref: 21 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129568.440950:0:7149:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5a87a00/0x40a459093b0694b2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20a66 expref: 21 pid: 7149 timeout: 923 lvb_type: 0 00000100:00100000:1.0:1746129568.440958:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135725880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7149:1830948737480704:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129568.440978:0:7149:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800955d3400/0x40a459093b069385 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f209da expref: 15 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129568.440985:0:7149:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800955d3400/0x40a459093b069385 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f209da expref: 15 pid: 22481 timeout: 923 lvb_type: 1 00000100:00100000:1.0:1746129568.440992:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135727b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7149:1830948737480832:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129568.442412:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a6dc80c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746129568.444723:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135727800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7149:1830948737480576:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129568.444741:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135725880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7149:1830948737480704:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129568.444749:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135727b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7149:1830948737480832:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129568.444784:0:7149:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d94fe00/0x40a459093b069592 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [1236992->2097151] (req 1236992->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20af2 expref: 21 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129568.444804:0:7149:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d94fe00, rc 0) 00000100:00100000:1.0:1746129568.444850:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:32185:x1830948734037120:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 4142us (6011us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129568.444860:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15973 00000100:00100000:0.0:1746129568.445969:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129568.446017:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129568.446051:0:15749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734037376 00000100:00100000:3.0:1746129568.446059:0:15749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734037376 00010000:00010000:3.0:1746129568.446094:0:15749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800955d3400/0x40a459093b069385 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f209da expref: 16 pid: 22481 timeout: 923 lvb_type: 1 00000100:00100000:1.0:1746129568.446098:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734037248 00000100:00100000:1.0:1746129568.446102:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734037248 00010000:00010000:1.0:1746129568.446117:0:9823:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ee1aa00/0x40a459093b0694ab lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20a5f expref: 36 pid: 7149 timeout: 923 lvb_type: 0 00000100:00100000:1.0:1746129568.446143:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8158 00000100:00100000:1.0:1746129568.446150:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959d6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ada2ffba-8920-4ecb-8068-68caa9806978+36:1962:x1830948734037248:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129568.446163:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129568.446186:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ee1aa00/0x40a459093b0694ab lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20a5f expref: 36 pid: 7149 timeout: 923 lvb_type: 0 00010000:00010000:1.0:1746129568.446201:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ee1aa00/0x40a459093b0694ab lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20a5f expref: 36 pid: 7149 timeout: 923 lvb_type: 0 00000100:00100000:0.0:1746129568.446520:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129568.446538:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734037504 00000100:00100000:0.0:1746129568.446541:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734037504 00010000:00010000:0.0:1746129568.446555:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5a87a00/0x40a459093b0694b2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20a66 expref: 21 pid: 7149 timeout: 923 lvb_type: 0 00000100:00100000:0.0:1746129568.446573:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8159 00000100:00100000:0.0:1746129568.446579:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:1962:x1830948734037504:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129568.446585:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746129568.446642:0:15749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8160 00000100:00100000:3.0:1746129568.446649:0:15749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6025850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:068dab75-d300-4ead-a742-d14572ad1e50+16:1962:x1830948734037376:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129568.446657:0:15749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129568.446995:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ee1aa00/0x40a459093b0694ab lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20a5f expref: 36 pid: 7149 timeout: 923 lvb_type: 0 00010000:00010000:1.0:1746129568.447074:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746129568.447076:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5a87a00/0x40a459093b0694b2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20a66 expref: 21 pid: 7149 timeout: 923 lvb_type: 0 00010000:00010000:3.0:1746129568.447078:0:15749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800955d3400/0x40a459093b069385 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f209da expref: 16 pid: 22481 timeout: 923 lvb_type: 1 00010000:00010000:0.0:1746129568.447086:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5a87a00/0x40a459093b0694b2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20a66 expref: 21 pid: 7149 timeout: 923 lvb_type: 0 00010000:00010000:3.0:1746129568.447096:0:15749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800955d3400/0x40a459093b069385 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f209da expref: 16 pid: 22481 timeout: 923 lvb_type: 1 00000100:00100000:1.0:1746129568.447103:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959d6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ada2ffba-8920-4ecb-8068-68caa9806978+35:1962:x1830948734037248:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 953us (1084us total) trans 0 rc 0/0 00010000:00010000:0.0:1746129568.447109:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5a87a00/0x40a459093b0694b2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20a66 expref: 21 pid: 7149 timeout: 923 lvb_type: 0 00000100:00100000:1.0:1746129568.447110:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8158 00010000:00010000:3.0:1746129568.447114:0:15749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800955d3400/0x40a459093b069385 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f209da expref: 16 pid: 22481 timeout: 923 lvb_type: 1 00010000:00010000:0.0:1746129568.447124:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129568.447126:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129568.447133:0:7085:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d94fe00/0x40a459093b069592 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1236992->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20af2 expref: 20 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129568.447141:0:7085:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d94fe00/0x40a459093b069592 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1236992->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20af2 expref: 20 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129568.447150:0:15749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129568.447168:0:15749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6025850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:068dab75-d300-4ead-a742-d14572ad1e50+15:1962:x1830948734037376:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 521us (1203us total) trans 0 rc 0/0 00010000:00010000:0.0:1746129568.447172:0:7085:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012d94fe00/0x40a459093b069592 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1236992->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20af2 expref: 20 pid: 7149 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129568.447174:0:15749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8160 00000100:00100000:0.0:1746129568.447185:0:7085:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800959d7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7085:1830948737480960:192.168.202.4@tcp:105: 00000100:00100000:0.0:1746129568.447239:0:7085:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5de8cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746129568.452319:0:7085:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800959d7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7085:1830948737480960:192.168.202.4@tcp:105: 00010000:00010000:1.0:1746129568.452352:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129568.452419:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:1962:x1830948734037504:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 5838us (5897us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129568.452431:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8159 00000100:00100000:0.0:1746129568.452703:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129568.452795:0:8416:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734037760 00000100:00100000:2.0:1746129568.452803:0:8416:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734037760 00002000:00100000:2.0:1746129568.452842:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3f4:0x0] (1236992->1241087) req@ffff8800959d7100 x1830948734037760/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:309/0 lens 488/0 e 0 to 0 dl 1746129579 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129568.452852:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800959d7100 with x1830948734037760 ext(1236992->1241087) 00002000:00010000:2.0:1746129568.452857:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800959d7100 00000100:00100000:2.0:1746129568.452875:0:8416:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7681 00000100:00100000:2.0:1746129568.452883:0:8416:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:1963:x1830948734037760:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:2.0:1746129568.453028:0:8416:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:1963:x1830948734037760:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 146us (325us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129568.453033:0:8416:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7681 00002000:00100000:2.0:1746129568.453038:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3f4:0x0] (1236992->1241087) req@ffff8800959d7100 x1830948734037760/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:309/0 lens 488/4536 e 0 to 0 dl 1746129579 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129568.453044:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800959d7100 with x1830948734037760 ext(1236992->1241087) 00002000:00010000:2.0:1746129568.453047:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800959d7100 00000100:00100000:2.0:1746129568.454379:0:31521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ada2ffba-8920-4ecb-8068-68caa9806978+38:1962:x1830948734036992:12345-192.168.202.4@tcp:3:cat.0 Request processed in 13827us (15613us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129568.454388:0:31521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7680 00002000:00100000:2.0:1746129568.454396:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3ec:0x0] (0->1048575) req@ffff8800959d5180 x1830948734036992/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:309/0 lens 488/440 e 0 to 0 dl 1746129579 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129568.454403:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800959d5180 with x1830948734036992 ext(0->1048575) 00002000:00010000:2.0:1746129568.454406:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800959d5180 00010000:00010000:3.0:1746129568.457181:0:7088:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746129568.460543:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129568.460612:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734037888 00000100:00100000:1.0:1746129568.460621:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734037888 00000100:00100000:0.0:1746129568.461753:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129568.461821:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734038016 00000100:00100000:1.0:1746129568.461826:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734038016 00000100:00100000:1.0:1746129568.461860:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15974 00000100:00100000:1.0:1746129568.461868:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+25:32185:x1830948734037888:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:1.0:1746129568.461888:0:7149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129568.461906:0:7149:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d94f400/0x40a459093b069599 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20af9 expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129568.461938:0:7149:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800955d2a00/0x40a459093b06938c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f209e1 expref: 14 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129568.461947:0:7149:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095cda200/0x40a459093b0694c7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20a7b expref: 26 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129568.461958:0:7149:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095cdac00/0x40a459093b0694c0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20a74 expref: 37 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129568.461964:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129568.461966:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129568.461969:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d94f400/0x40a459093b069599 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [1048576->1171455] (req 1048576->1171455) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20af9 expref: 26 pid: 7149 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129568.462001:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15975 00010000:00010000:1.0:1746129568.462002:0:7149:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095cdac00/0x40a459093b0694c0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20a74 expref: 37 pid: 7149 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129568.462009:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ada2ffba-8920-4ecb-8068-68caa9806978+35:32193:x1830948734038016:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129568.462014:0:7149:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095cdac00/0x40a459093b0694c0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20a74 expref: 37 pid: 7149 timeout: 923 lvb_type: 0 00010000:00010000:0.0:1746129568.462019:0:7148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746129568.462026:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135727b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7149:1830948737481088:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129568.462029:0:7148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f358800/0x40a459093b0695a0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20b00 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129568.462045:0:7148:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d94fe00/0x40a459093b069592 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1236992->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20af2 expref: 19 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129568.462056:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129568.462058:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129568.462061:0:7148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f358800/0x40a459093b0695a0 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20b00 expref: 36 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129568.462077:0:7148:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d94fe00/0x40a459093b069592 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1236992->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20af2 expref: 19 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129568.462085:0:7148:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d94fe00/0x40a459093b069592 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1236992->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20af2 expref: 19 pid: 7149 timeout: 923 lvb_type: 0 00000100:00100000:0.0:1746129568.462095:0:7148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800959d6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:7148:1830948737481216:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129568.462109:0:7149:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095cda200/0x40a459093b0694c7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20a7b expref: 26 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129568.462117:0:7149:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095cda200/0x40a459093b0694c7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20a7b expref: 26 pid: 7149 timeout: 923 lvb_type: 0 00000100:00100000:0.0:1746129568.462119:0:7148:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5de8900 going to sleep for 11 seconds 00000100:00100000:1.0:1746129568.462126:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135725880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7149:1830948737481344:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129568.462150:0:7149:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800955d2a00/0x40a459093b06938c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f209e1 expref: 14 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129568.462162:0:7149:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800955d2a00/0x40a459093b06938c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f209e1 expref: 14 pid: 22481 timeout: 923 lvb_type: 1 00000100:00100000:1.0:1746129568.462169:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135727800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7149:1830948737481472:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129568.462184:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a6dc80c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129568.464600:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129568.464619:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129568.464671:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129568.464703:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734038272 00000100:00100000:0.0:1746129568.464709:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734038272 00010000:00010000:0.0:1746129568.464740:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095cda200/0x40a459093b0694c7 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20a7b expref: 27 pid: 7149 timeout: 923 lvb_type: 0 00000100:00100000:0.0:1746129568.464761:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734038400 00000100:00100000:0.0:1746129568.464764:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734038400 00010000:00010000:0.0:1746129568.464772:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095cdac00/0x40a459093b0694c0 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20a74 expref: 38 pid: 7149 timeout: 923 lvb_type: 0 00000100:00100000:0.0:1746129568.464785:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8161 00000100:00100000:0.0:1746129568.464792:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009507ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+27:1960:x1830948734038272:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129568.464803:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129568.464827:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095cda200/0x40a459093b0694c7 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20a7b expref: 27 pid: 7149 timeout: 923 lvb_type: 0 00010000:00010000:0.0:1746129568.464837:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095cda200/0x40a459093b0694c7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20a7b expref: 27 pid: 7149 timeout: 923 lvb_type: 0 00010000:00010000:0.0:1746129568.464860:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129568.464891:0:7087:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8162 00000100:00100000:0.0:1746129568.464899:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009507ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+27:1960:x1830948734038272:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 106us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129568.464900:0:7087:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009507f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ada2ffba-8920-4ecb-8068-68caa9806978+38:1963:x1830948734038400:12345-192.168.202.4@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746129568.464906:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8161 00010000:00010000:3.0:1746129568.464907:0:7087:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129568.464917:0:7087:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095cdac00/0x40a459093b0694c0 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20a74 expref: 38 pid: 7149 timeout: 923 lvb_type: 0 00010000:00010000:3.0:1746129568.464927:0:7087:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095cdac00/0x40a459093b0694c0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20a74 expref: 38 pid: 7149 timeout: 923 lvb_type: 0 00010000:00010000:3.0:1746129568.464939:0:7087:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129568.464971:0:7087:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009507f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ada2ffba-8920-4ecb-8068-68caa9806978+38:1963:x1830948734038400:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 74us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129568.464977:0:7087:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8162 00000100:00100000:3.0:1746129568.465004:0:31521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734038144 00000100:00100000:3.0:1746129568.465008:0:31521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734038144 00010000:00010000:1.0:1746129568.465014:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095cdac00/0x40a459093b0694c0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20a74 expref: 37 pid: 7149 timeout: 923 lvb_type: 0 00000100:00100000:1.0:1746129568.465034:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135727b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7149:1830948737481088:192.168.202.4@tcp:104: 00002000:00100000:3.0:1746129568.465035:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f4:0x0] (1236992->2097151) req@ffff88009507d500 x1830948734038144/t0(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:309/0 lens 488/0 e 0 to 0 dl 1746129579 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00010000:00010000:1.0:1746129568.465043:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095cda200/0x40a459093b0694c7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20a7b expref: 26 pid: 7149 timeout: 923 lvb_type: 0 00002000:00100000:3.0:1746129568.465044:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009507d500 with x1830948734038144 ext(1236992->2097151) 00010000:00010000:3.0:1746129568.465051:0:31521:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012d94fe00/0x40a459093b069592 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1236992->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20af2 expref: 20 pid: 7149 timeout: 923 lvb_type: 0 00000100:00100000:1.0:1746129568.465052:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135725880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7149:1830948737481344:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129568.465060:0:31521:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012d94fe00/0x40a459093b069592 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1236992->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20af2 expref: 20 pid: 7149 timeout: 923 lvb_type: 0 00000100:00100000:1.0:1746129568.465060:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135727800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7149:1830948737481472:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129568.465062:0:7148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800959d6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:7148:1830948737481216:192.168.202.4@tcp:104: 00002000:00010000:3.0:1746129568.465065:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009507d500 00000100:00100000:3.0:1746129568.465076:0:31521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2396 00000100:00100000:3.0:1746129568.465081:0:31521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009507d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:1963:x1830948734038144:12345-192.168.202.4@tcp:4:multiop.0 00010000:00010000:2.0:1746129568.465081:0:7148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f358800/0x40a459093b0695a0 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20b00 expref: 36 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129568.465081:0:7149:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d94f400/0x40a459093b069599 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->1171455] (req 1048576->1171455) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20af9 expref: 25 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129568.465090:0:7148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f358800, rc 0) 00010000:00010000:1.0:1746129568.465090:0:7149:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d94f400, rc 0) 00000100:00100000:1.0:1746129568.465113:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+25:32185:x1830948734037888:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 3246us (4579us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129568.465119:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15974 00000100:00100000:2.0:1746129568.465124:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ada2ffba-8920-4ecb-8068-68caa9806978+36:32193:x1830948734038016:12345-192.168.202.4@tcp:101:cat.0 Request processed in 3116us (3373us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129568.465131:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15975 00000100:00100000:0.0:1746129568.466481:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129568.466555:0:15749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734038528 00000100:00100000:2.0:1746129568.466561:0:15749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734038528 00010000:00010000:2.0:1746129568.466580:0:15749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800955d2a00/0x40a459093b06938c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f209e1 expref: 15 pid: 22481 timeout: 923 lvb_type: 1 00000100:00100000:2.0:1746129568.466611:0:15749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8163 00000100:00100000:2.0:1746129568.466622:0:15749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009507dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:068dab75-d300-4ead-a742-d14572ad1e50+15:1963:x1830948734038528:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129568.466631:0:15749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129568.466642:0:15749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800955d2a00/0x40a459093b06938c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f209e1 expref: 15 pid: 22481 timeout: 923 lvb_type: 1 00010000:00010000:2.0:1746129568.466652:0:15749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800955d2a00/0x40a459093b06938c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f209e1 expref: 15 pid: 22481 timeout: 923 lvb_type: 1 00010000:00010000:2.0:1746129568.466665:0:15749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800955d2a00/0x40a459093b06938c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f209e1 expref: 15 pid: 22481 timeout: 923 lvb_type: 1 00010000:00010000:2.0:1746129568.466693:0:15749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129568.466695:0:15749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129568.466703:0:15749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d94f400/0x40a459093b069599 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1171455) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20af9 expref: 24 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129568.466711:0:15749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d94f400/0x40a459093b069599 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1171455) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20af9 expref: 24 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129568.467030:0:15749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012d94f400/0x40a459093b069599 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1171455) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20af9 expref: 24 pid: 7149 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129568.467043:0:15749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013575d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15749:1830948737481600:192.168.202.4@tcp:105: 00000100:00100000:2.0:1746129568.467106:0:15749:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0ac9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129568.472569:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129568.472626:0:15749:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013575d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15749:1830948737481600:192.168.202.4@tcp:105: 00010000:00010000:3.0:1746129568.472651:0:15749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129568.472679:0:31518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734038784 00000100:00100000:1.0:1746129568.472687:0:31518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734038784 00000100:00100000:3.0:1746129568.472697:0:15749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009507dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:068dab75-d300-4ead-a742-d14572ad1e50+14:1963:x1830948734038528:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 6075us (6220us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129568.472708:0:15749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8163 00002000:00100000:1.0:1746129568.472735:0:31518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3ee:0x0] (1167360->1171455) req@ffff88009507f480 x1830948734038784/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:309/0 lens 488/0 e 0 to 0 dl 1746129579 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129568.472744:0:31518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009507f480 with x1830948734038784 ext(1167360->1171455) 00002000:00010000:1.0:1746129568.472749:0:31518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009507f480 00000100:00100000:1.0:1746129568.472767:0:31518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7682 00000100:00100000:1.0:1746129568.472774:0:31518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009507f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+25:1962:x1830948734038784:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:1.0:1746129568.472915:0:31518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009507f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+25:1962:x1830948734038784:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 141us (358us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746129568.472921:0:31518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7682 00002000:00100000:1.0:1746129568.472926:0:31518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3ee:0x0] (1167360->1171455) req@ffff88009507f480 x1830948734038784/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:309/0 lens 488/4536 e 0 to 0 dl 1746129579 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129568.472932:0:31518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009507f480 with x1830948734038784 ext(1167360->1171455) 00002000:00010000:1.0:1746129568.472935:0:31518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009507f480 00000100:00100000:0.0:1746129568.476167:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129568.476559:0:16680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734039040 00000100:00100000:3.0:1746129568.476570:0:16680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734039040 00000100:00100000:3.0:1746129568.476945:0:16680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4731 00000100:00100000:3.0:1746129568.476953:0:16680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009507f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+13:32185:x1830948734039040:12345-192.168.202.4@tcp:35:multiop.0 00000100:00100000:3.0:1746129568.477966:0:16680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009507f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+14:32185:x1830948734039040:12345-192.168.202.4@tcp:35:multiop.0 Request processed in 1008us (1805us total) trans 8589945257 rc 0/0 00000100:00100000:3.0:1746129568.477975:0:16680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4731 00000100:00100000:2.0:1746129568.478097:0:31521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009507d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+22:1963:x1830948734038144:12345-192.168.202.4@tcp:4:multiop.0 Request processed in 13015us (13424us total) trans 17179874082 rc 0/0 00000100:00100000:2.0:1746129568.478106:0:31521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2396 00002000:00100000:2.0:1746129568.478115:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f4:0x0] (1236992->2097151) req@ffff88009507d500 x1830948734038144/t17179874082(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:309/0 lens 488/448 e 0 to 0 dl 1746129579 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129568.478125:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009507d500 with x1830948734038144 ext(1236992->2097151) 00010000:00010000:2.0:1746129568.478134:0:31521:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012d94fe00/0x40a459093b069592 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1236992->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20af2 expref: 22 pid: 7149 timeout: 923 lvb_type: 0 00010000:00010000:2.0:1746129568.478149:0:31521:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012d94fe00/0x40a459093b069592 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1236992->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20af2 expref: 22 pid: 7149 timeout: 923 lvb_type: 0 00002000:00010000:2.0:1746129568.478156:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009507d500 00000100:00100000:0.0:1746129568.481114:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129568.481188:0:15749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734039168 00000100:00100000:3.0:1746129568.481197:0:15749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734039168 00010000:00010000:3.0:1746129568.481236:0:15749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d94fe00/0x40a459093b069592 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1236992->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20af2 expref: 22 pid: 7149 timeout: 923 lvb_type: 0 00000100:00100000:3.0:1746129568.481278:0:15749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8164 00000100:00100000:3.0:1746129568.481285:0:15749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009507df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+22:1962:x1830948734039168:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129568.481324:0:15749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746129568.481355:0:15749:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb mtime from disk: 1746129568 -> 1746129569 00002000:00010000:3.0:1746129568.481357:0:15749:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb ctime from disk: 1746129568 -> 1746129569 00010000:00010000:3.0:1746129568.481364:0:15749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d94fe00/0x40a459093b069592 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1236992->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20af2 expref: 22 pid: 7149 timeout: 923 lvb_type: 0 00010000:00010000:3.0:1746129568.481376:0:15749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d94fe00/0x40a459093b069592 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1236992->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20af2 expref: 22 pid: 7149 timeout: 923 lvb_type: 0 00010000:00010000:3.0:1746129568.481398:0:15749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d94fe00/0x40a459093b069592 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1236992->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20af2 expref: 22 pid: 7149 timeout: 923 lvb_type: 0 00010000:00010000:3.0:1746129568.481428:0:15749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129568.481431:0:15749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129568.481438:0:15749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f358800/0x40a459093b0695a0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20b00 expref: 35 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129568.481446:0:15749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f358800/0x40a459093b0695a0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20b00 expref: 35 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129568.481480:0:15749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012f358800/0x40a459093b0695a0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20b00 expref: 35 pid: 7148 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129568.481492:0:15749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a07ad500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15749:1830948737481728:192.168.202.4@tcp:105: 00000100:00100000:3.0:1746129568.481584:0:15749:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e29ff00 going to sleep for 11 seconds 00000100:00100000:3.0:1746129568.485591:0:15749:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a07ad500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15749:1830948737481728:192.168.202.4@tcp:105: 00010000:00010000:3.0:1746129568.485619:0:15749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129568.485859:0:15749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009507df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:1962:x1830948734039168:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 4572us (4752us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129568.485872:0:15749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8164 00000100:00100000:0.0:1746129568.487811:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129568.487904:0:31521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734039424 00000100:00100000:2.0:1746129568.487913:0:31521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734039424 00002000:00100000:2.0:1746129568.487961:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f4:0x0] (1048576->2097151) req@ffff880094064a80 x1830948734039424/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:309/0 lens 488/0 e 0 to 0 dl 1746129579 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129568.487972:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094064a80 with x1830948734039424 ext(1048576->2097151) 00002000:00010000:2.0:1746129568.487977:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094064a80 00000100:00100000:2.0:1746129568.488048:0:31521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7683 00000100:00100000:2.0:1746129568.488056:0:31521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094064a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ada2ffba-8920-4ecb-8068-68caa9806978+36:1963:x1830948734039424:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:2.0:1746129568.500789:0:31521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094064a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ada2ffba-8920-4ecb-8068-68caa9806978+36:1963:x1830948734039424:12345-192.168.202.4@tcp:3:cat.0 Request processed in 12723us (12975us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129568.500801:0:31521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7683 00002000:00100000:2.0:1746129568.500813:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f4:0x0] (1048576->2097151) req@ffff880094064a80 x1830948734039424/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:309/0 lens 488/440 e 0 to 0 dl 1746129579 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129568.500822:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094064a80 with x1830948734039424 ext(1048576->2097151) 00002000:00010000:2.0:1746129568.500828:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094064a80 00000100:00100000:0.0:1746129568.505541:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129568.505651:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734039552 00000100:00100000:2.0:1746129568.505660:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734039552 00000100:00100000:2.0:1746129568.505941:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15976 00000100:00100000:2.0:1746129568.505949:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094064380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ada2ffba-8920-4ecb-8068-68caa9806978+37:32193:x1830948734039552:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129568.505971:0:7148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129568.505990:0:7148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a06b4c00/0x40a459093b0695a7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20b07 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129568.506173:0:7148:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d94f400/0x40a459093b069599 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1171455) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20af9 expref: 24 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129568.506182:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129568.506184:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129568.506187:0:7148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a06b4c00/0x40a459093b0695a7 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20b07 expref: 38 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129568.506220:0:7148:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d94f400/0x40a459093b069599 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1171455) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20af9 expref: 24 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129568.506232:0:7148:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d94f400/0x40a459093b069599 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1171455) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20af9 expref: 24 pid: 7149 timeout: 923 lvb_type: 0 00000100:00100000:2.0:1746129568.506243:0:7148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013575ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7148:1830948737481856:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129568.506385:0:7148:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0ac300 going to sleep for 11 seconds 00000100:00100000:2.0:1746129568.507776:0:7148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013575ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7148:1830948737481856:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129568.507801:0:7148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a06b4c00/0x40a459093b0695a7 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20b07 expref: 38 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129568.507815:0:7148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a06b4c00, rc 0) 00000100:00100000:2.0:1746129568.507863:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094064380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ada2ffba-8920-4ecb-8068-68caa9806978+38:32193:x1830948734039552:12345-192.168.202.4@tcp:101:cat.0 Request processed in 1913us (2332us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129568.507871:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15976 00000100:00100000:0.0:1746129568.508806:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129568.508906:0:31521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734039680 00000100:00100000:2.0:1746129568.508912:0:31521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734039680 00002000:00100000:2.0:1746129568.508947:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3ee:0x0] (1048576->1171455) req@ffff880094064e00 x1830948734039680/t0(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:309/0 lens 488/0 e 0 to 0 dl 1746129579 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129568.508956:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094064e00 with x1830948734039680 ext(1048576->1171455) 00010000:00010000:2.0:1746129568.508963:0:31521:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012d94f400/0x40a459093b069599 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1171455) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20af9 expref: 25 pid: 7149 timeout: 923 lvb_type: 0 00010000:00010000:2.0:1746129568.508974:0:31521:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012d94f400/0x40a459093b069599 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1171455) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20af9 expref: 25 pid: 7149 timeout: 923 lvb_type: 0 00002000:00010000:2.0:1746129568.508980:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094064e00 00000100:00100000:1.0:1746129568.509498:0:31518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2397 00000100:00100000:1.0:1746129568.509511:0:31518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094064e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+25:1963:x1830948734039680:12345-192.168.202.4@tcp:4:multiop.0 00000100:00100000:2.0:1746129568.517692:0:31518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094064e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+27:1963:x1830948734039680:12345-192.168.202.4@tcp:4:multiop.0 Request processed in 8172us (8873us total) trans 21474841326 rc 0/0 00000100:00100000:2.0:1746129568.517705:0:31518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2397 00002000:00100000:2.0:1746129568.517719:0:31518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3ee:0x0] (1048576->1171455) req@ffff880094064e00 x1830948734039680/t21474841326(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:309/0 lens 488/448 e 0 to 0 dl 1746129579 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129568.517735:0:31518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094064e00 with x1830948734039680 ext(1048576->1171455) 00010000:00010000:2.0:1746129568.517746:0:31518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012d94f400/0x40a459093b069599 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1171455) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20af9 expref: 27 pid: 7149 timeout: 923 lvb_type: 0 00010000:00010000:2.0:1746129568.517762:0:31518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012d94f400/0x40a459093b069599 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1171455) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20af9 expref: 27 pid: 7149 timeout: 923 lvb_type: 0 00002000:00010000:2.0:1746129568.517769:0:31518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094064e00 00000100:00100000:0.0:1746129568.524342:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129568.524451:0:15749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734039808 00000100:00100000:3.0:1746129568.524461:0:15749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734039808 00010000:00010000:3.0:1746129568.524503:0:15749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d94f400/0x40a459093b069599 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1171455) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20af9 expref: 27 pid: 7149 timeout: 923 lvb_type: 0 00000100:00100000:3.0:1746129568.524546:0:15749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8165 00000100:00100000:3.0:1746129568.524554:0:15749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6025450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+27:1961:x1830948734039808:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129568.524569:0:15749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746129568.524590:0:15749:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb mtime from disk: 1746129568 -> 1746129569 00002000:00010000:3.0:1746129568.524593:0:15749:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb ctime from disk: 1746129568 -> 1746129569 00010000:00010000:3.0:1746129568.524599:0:15749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d94f400/0x40a459093b069599 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1171455) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20af9 expref: 27 pid: 7149 timeout: 923 lvb_type: 0 00010000:00010000:3.0:1746129568.524610:0:15749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d94f400/0x40a459093b069599 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1171455) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20af9 expref: 27 pid: 7149 timeout: 923 lvb_type: 0 00010000:00010000:3.0:1746129568.524634:0:15749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d94f400/0x40a459093b069599 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1171455) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20af9 expref: 27 pid: 7149 timeout: 923 lvb_type: 0 00010000:00010000:3.0:1746129568.524668:0:15749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129568.524670:0:15749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129568.524678:0:15749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a06b4c00/0x40a459093b0695a7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20b07 expref: 37 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129568.524685:0:15749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a06b4c00/0x40a459093b0695a7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20b07 expref: 37 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129568.524723:0:15749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a06b4c00/0x40a459093b0695a7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20b07 expref: 37 pid: 7148 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129568.524736:0:15749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a07ad500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15749:1830948737481984:192.168.202.4@tcp:105: 00000100:00100000:3.0:1746129568.524816:0:15749:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e29ff00 going to sleep for 11 seconds 00000100:00100000:3.0:1746129568.530937:0:15749:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a07ad500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15749:1830948737481984:192.168.202.4@tcp:105: 00010000:00010000:3.0:1746129568.530967:0:15749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129568.531016:0:15749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6025450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+26:1961:x1830948734039808:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 6462us (6735us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129568.531029:0:15749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8165 00000100:00100000:0.0:1746129568.533714:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129568.533942:0:31518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734040064 00000100:00100000:2.0:1746129568.533951:0:31518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734040064 00002000:00100000:2.0:1746129568.534003:0:31518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3ee:0x0] (1048576->2097151) req@ffff880094066a00 x1830948734040064/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:309/0 lens 488/0 e 0 to 0 dl 1746129579 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129568.534012:0:31518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094066a00 with x1830948734040064 ext(1048576->2097151) 00002000:00010000:2.0:1746129568.534018:0:31518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094066a00 00000100:00100000:2.0:1746129568.534043:0:31518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7684 00000100:00100000:2.0:1746129568.534052:0:31518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094066a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ada2ffba-8920-4ecb-8068-68caa9806978+38:1962:x1830948734040064:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129568.546754:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129568.546931:0:2271:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734040320 00000100:00100000:2.0:1746129568.546941:0:2271:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734040320 00000100:00100000:2.0:1746129568.546993:0:2271:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11172 00000100:00100000:2.0:1746129568.547001:0:2271:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094066300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ada2ffba-8920-4ecb-8068-68caa9806978+297:32196:x1830948734040320:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:2.0:1746129568.547027:0:2271:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129568.547052:0:2271:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06b5000/0x40a459093b0695ae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20b0e expref: -99 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129568.547152:0:2271:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06b5200/0x40a459093b0695b5 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129568.547167:0:2271:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa3c00/0x40a459093b069514 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20ab3 expref: 298 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129568.547174:0:2271:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa3a00/0x40a459093b069537 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20aba expref: 13 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129568.547180:0:2271:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06b5200/0x40a459093b0695b5 lrc: 5/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129568.547211:0:2271:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa3a00/0x40a459093b069537 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20aba expref: 13 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129568.547222:0:2271:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa3a00/0x40a459093b069537 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20aba expref: 13 pid: 2271 timeout: 923 lvb_type: 0 00000100:00100000:2.0:1746129568.547234:0:2271:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013575ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:2271:1830948737482112:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129568.548447:0:31518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094066a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ada2ffba-8920-4ecb-8068-68caa9806978+38:1962:x1830948734040064:12345-192.168.202.4@tcp:3:cat.0 Request processed in 14389us (14737us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129568.548460:0:31518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7684 00002000:00100000:3.0:1746129568.548472:0:31518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3ee:0x0] (1048576->2097151) req@ffff880094066a00 x1830948734040064/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:309/0 lens 488/440 e 0 to 0 dl 1746129579 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129568.548480:0:31518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094066a00 with x1830948734040064 ext(1048576->2097151) 00002000:00010000:3.0:1746129568.548485:0:31518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094066a00 00010000:00010000:2.0:1746129568.549869:0:2271:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa3c00/0x40a459093b069514 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20ab3 expref: 298 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129568.549885:0:2271:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa3c00/0x40a459093b069514 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20ab3 expref: 298 pid: 2271 timeout: 923 lvb_type: 0 00000100:00100000:2.0:1746129568.549899:0:2271:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013575ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:2271:1830948737482240:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129568.549957:0:2271:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0ac6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129568.555055:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129568.555268:0:15749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734040448 00000100:00100000:3.0:1746129568.555278:0:15749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734040448 00010000:00010000:3.0:1746129568.555368:0:15749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa3c00/0x40a459093b069514 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20ab3 expref: 299 pid: 2271 timeout: 923 lvb_type: 0 00000100:00100000:0.0:1746129568.555526:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129568.555742:0:15749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734040576 00000100:00100000:3.0:1746129568.555746:0:15749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734040576 00010000:00010000:3.0:1746129568.555759:0:15749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa3a00/0x40a459093b069537 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20aba expref: 14 pid: 2271 timeout: 923 lvb_type: 0 00000100:00100000:3.0:1746129568.555783:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8166 00000100:00100000:3.0:1746129568.555790:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094065c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ada2ffba-8920-4ecb-8068-68caa9806978+299:1962:x1830948734040448:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129568.555803:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129568.555808:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa3c00/0x40a459093b069514 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20ab3 expref: 299 pid: 2271 timeout: 923 lvb_type: 0 00010000:00010000:3.0:1746129568.555820:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa3c00/0x40a459093b069514 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20ab3 expref: 299 pid: 2271 timeout: 923 lvb_type: 0 00010000:00010000:3.0:1746129568.555845:0:7085:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:3.0:1746129568.555850:0:7085:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06b5200/0x40a459093b0695b5 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129568.555858:0:7085:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06b5200/0x40a459093b0695b5 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129568.555862:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129568.555910:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094065c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ada2ffba-8920-4ecb-8068-68caa9806978+299:1962:x1830948734040448:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 121us (869us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129568.555916:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8166 00000100:00100000:3.0:1746129568.555932:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8167 00000100:00100000:3.0:1746129568.555937:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094067100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+14:1963:x1830948734040576:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129568.555944:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129568.555948:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa3a00/0x40a459093b069537 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20aba expref: 14 pid: 2271 timeout: 923 lvb_type: 0 00010000:00010000:3.0:1746129568.555957:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa3a00/0x40a459093b069537 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20aba expref: 14 pid: 2271 timeout: 923 lvb_type: 0 00010000:00010000:3.0:1746129568.555968:0:7085:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:3.0:1746129568.555971:0:7085:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06b5200/0x40a459093b0695b5 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129568.555977:0:7085:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06b5200/0x40a459093b0695b5 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129568.555983:0:7085:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06b5200/0x40a459093b0695b5 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129568.556000:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129568.556016:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094067100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+14:1963:x1830948734040576:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 79us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129568.556024:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8167 00010000:00010000:2.0:1746129568.556136:0:2271:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa3a00/0x40a459093b069537 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20aba expref: 13 pid: 2271 timeout: 923 lvb_type: 0 00000100:00100000:2.0:1746129568.556157:0:2271:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013575ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:2271:1830948737482112:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129568.556170:0:2271:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa3c00/0x40a459093b069514 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20ab3 expref: 298 pid: 2271 timeout: 923 lvb_type: 0 00000100:00100000:2.0:1746129568.556177:0:2271:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013575ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:2271:1830948737482240:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129568.556199:0:2271:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06b5200/0x40a459093b0695b5 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129568.556206:0:2271:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06b5200/0x40a459093b0695b5 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129568.556211:0:2271:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06b5200/0x40a459093b0695b5 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00000004:00200000:2.0:1746129568.556231:0:2271:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:2.0:1746129568.556413:0:2271:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06b5000/0x40a459093b0695ae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20b0e expref: 299 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129568.556425:0:2271:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06b5200/0x40a459093b0695b5 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20b0e expref: 298 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129568.556430:0:2271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:2.0:1746129568.556432:0:2271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746129568.556434:0:2271:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a06b5200, rc 0) 00000100:00100000:2.0:1746129568.556460:0:2271:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094066300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ada2ffba-8920-4ecb-8068-68caa9806978+298:32196:x1830948734040320:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 9461us (9718us total) trans 8589945258 rc 0/0 00000100:00100000:2.0:1746129568.556465:0:2271:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11172 00000100:00100000:0.0:1746129568.563473:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129568.563629:0:2271:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734040704 00000100:00100000:2.0:1746129568.563639:0:2271:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734040704 00000100:00080000:1.0:1746129568.564435:0:7097:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746129568.564608:0:2271:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11173 00000100:00100000:3.0:1746129568.564618:0:2271:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094066d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:068dab75-d300-4ead-a742-d14572ad1e50+6:32197:x1830948734040704:12345-192.168.202.4@tcp:101:mirror_io.0 00010000:00010000:3.0:1746129568.564645:0:2271:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129568.564665:0:2271:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800955d3400/0x40a459093b0695c3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20b15 expref: -99 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129568.564728:0:2271:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa3c00/0x40a459093b0695ca lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129568.564742:0:2271:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa3c00/0x40a459093b0695ca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129568.564753:0:2271:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa3c00/0x40a459093b0695ca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129568.564766:0:2271:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa3a00/0x40a459093b0695d1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129568.564771:0:2271:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa3a00/0x40a459093b0695d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129568.564776:0:2271:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa3a00/0x40a459093b0695d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129568.564888:0:2271:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba2de00/0x40a459093b0695d8 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129568.564897:0:2271:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06b5200/0x40a459093b0695b5 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20b0e expref: 297 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129568.564909:0:2271:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba2de00/0x40a459093b0695d8 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129568.564939:0:2271:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06b5200/0x40a459093b0695b5 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20b0e expref: 297 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129568.564949:0:2271:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06b5200/0x40a459093b0695b5 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20b0e expref: 297 pid: 2271 timeout: 923 lvb_type: 0 00000100:00100000:3.0:1746129568.564961:0:2271:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a07ad500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:2271:1830948737482368:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129568.565050:0:2271:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e29fd80 going to sleep for 11 seconds 00000100:00100000:0.0:1746129568.568754:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129568.568879:0:2271:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a07ad500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:2271:1830948737482368:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129568.568905:0:2271:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba2de00/0x40a459093b0695d8 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00000100:00100000:1.0:1746129568.569048:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734040832 00000100:00100000:1.0:1746129568.569059:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734040832 00010000:00010000:1.0:1746129568.569092:0:7087:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06b5200/0x40a459093b0695b5 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20b0e expref: 298 pid: 2271 timeout: 923 lvb_type: 0 00000100:00100000:1.0:1746129568.569117:0:7087:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8168 00000100:00100000:1.0:1746129568.569124:0:7087:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094064000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ada2ffba-8920-4ecb-8068-68caa9806978+298:1963:x1830948734040832:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129568.569138:0:7087:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129568.569144:0:7087:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06b5200/0x40a459093b0695b5 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20b0e expref: 298 pid: 2271 timeout: 923 lvb_type: 0 00010000:00010000:1.0:1746129568.569154:0:7087:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06b5200/0x40a459093b0695b5 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20b0e expref: 298 pid: 2271 timeout: 923 lvb_type: 0 00010000:00010000:1.0:1746129568.569175:0:7087:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06b5200/0x40a459093b0695b5 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20b0e expref: 298 pid: 2271 timeout: 923 lvb_type: 0 00010000:00010000:1.0:1746129568.569554:0:7087:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:1.0:1746129568.569560:0:7087:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba2de00/0x40a459093b0695d8 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00010000:00010000:1.0:1746129568.569570:0:7087:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba2de00/0x40a459093b0695d8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 2271 initiator: MDT0 00010000:00010000:1.0:1746129568.569576:0:7087:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba2de00/0x40a459093b0695d8 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 2271 initiator: MDT0 00010000:00010000:1.0:1746129568.569601:0:7087:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129568.569642:0:7087:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094064000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ada2ffba-8920-4ecb-8068-68caa9806978+297:1963:x1830948734040832:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 519us (900us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129568.569652:0:7087:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8168 00010000:00010000:3.0:1746129568.569809:0:2271:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba2de00/0x40a459093b0695d8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129568.569815:0:2271:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba2de00/0x40a459093b0695d8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00000004:00200000:3.0:1746129568.569861:0:2271:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00000004:00200000:3.0:1746129568.569864:0:2271:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746129568.569879:0:2271:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba2de00/0x40a459093b0695d8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129568.569888:0:2271:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba2de00/0x40a459093b0695d8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129568.569897:0:2271:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa3c00/0x40a459093b0695ca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129568.569903:0:2271:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa3c00/0x40a459093b0695ca lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129568.569909:0:2271:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa3c00/0x40a459093b0695ca lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129568.569913:0:2271:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009faa3c00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:3.0:1746129568.569916:0:2271:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa3c00/0x40a459093b0695ca lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129568.569922:0:2271:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa3c00/0x40a459093b0695ca lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129568.569929:0:2271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880132ef8f00) 00010000:00010000:3.0:1746129568.569931:0:2271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129568.569933:0:2271:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa3c00/0x40a459093b0695ca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129568.569937:0:2271:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa3c00/0x40a459093b0695ca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129568.569949:0:2271:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa3a00/0x40a459093b0695d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129568.569953:0:2271:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa3a00/0x40a459093b0695d1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129568.569957:0:2271:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa3a00/0x40a459093b0695d1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129568.569961:0:2271:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009faa3a00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:3.0:1746129568.569963:0:2271:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa3a00/0x40a459093b0695d1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129568.569972:0:2271:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa3a00/0x40a459093b0695d1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129568.569978:0:2271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012db42100) 00010000:00010000:3.0:1746129568.569980:0:2271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129568.569982:0:2271:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa3a00/0x40a459093b0695d1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129568.569986:0:2271:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa3a00/0x40a459093b0695d1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129568.570018:0:2271:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800955d3400/0x40a459093b0695c3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20b15 expref: 8 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129568.570030:0:2271:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba2de00/0x40a459093b0695d8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20b15 expref: 7 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129568.570035:0:2271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:3.0:1746129568.570037:0:2271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746129568.570038:0:2271:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ba2de00, rc 0) 00000100:00100000:3.0:1746129568.570066:0:2271:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094066d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:068dab75-d300-4ead-a742-d14572ad1e50+7:32197:x1830948734040704:12345-192.168.202.4@tcp:101:mirror_io.0 Request processed in 5451us (6605us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129568.570072:0:2271:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11173 00000100:00100000:0.0:1746129568.575202:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129568.575234:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129568.575257:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129568.575280:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129568.575327:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129568.575363:0:8410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734040960 00000100:00100000:0.0:1746129568.575372:0:8410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734040960 00000100:00100000:0.0:1746129568.575410:0:8410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734041088 00000100:00100000:0.0:1746129568.575412:0:8410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734041088 00000100:00100000:0.0:1746129568.575422:0:8410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734041344 00000100:00100000:0.0:1746129568.575424:0:8410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734041344 00000100:00100000:0.0:1746129568.575431:0:8410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734041216 00000100:00100000:0.0:1746129568.575433:0:8410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734041216 00000100:00100000:0.0:1746129568.575441:0:8410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734041472 00000100:00100000:0.0:1746129568.575442:0:8410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734041472 00000100:00100000:0.0:1746129568.575455:0:8410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15977 00000100:00100000:0.0:1746129568.575462:0:8410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b550700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:068dab75-d300-4ead-a742-d14572ad1e50+16:1961:x1830948734040960:12345-192.168.202.4@tcp:101:mirror_io.0 00010000:00010000:0.0:1746129568.575481:0:8410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129568.575498:0:8410:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f359a00/0x40a459093b0695df lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20b1c expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129568.575523:0:8410:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129568.575524:0:8410:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129568.575533:0:8410:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f359a00/0x40a459093b0695df lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20b1c expref: 17 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129568.575549:0:8410:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f359a00/0x40a459093b0695df lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20b1c expref: 17 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129568.575559:0:8410:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f359a00, rc 0) 00000100:00100000:0.0:1746129568.575601:0:8410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b550700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:068dab75-d300-4ead-a742-d14572ad1e50+17:1961:x1830948734040960:12345-192.168.202.4@tcp:101:mirror_io.0 Request processed in 141us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129568.575608:0:8410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15977 00000100:00100000:0.0:1746129568.575623:0:8410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15978 00000100:00100000:0.0:1746129568.575627:0:8410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b551500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:068dab75-d300-4ead-a742-d14572ad1e50+16:1961:x1830948734041088:12345-192.168.202.4@tcp:101:mirror_io.0 00010000:00010000:0.0:1746129568.575633:0:8410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129568.575643:0:8410:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f359600/0x40a459093b0695e6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20b23 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129568.575653:0:8410:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129568.575654:0:8410:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129568.575658:0:8410:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f359600/0x40a459093b0695e6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20b23 expref: 17 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129568.575666:0:8410:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f359600/0x40a459093b0695e6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20b23 expref: 17 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129568.575673:0:8410:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f359600, rc 0) 00000100:00100000:0.0:1746129568.575692:0:8410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b551500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:068dab75-d300-4ead-a742-d14572ad1e50+17:1961:x1830948734041088:12345-192.168.202.4@tcp:101:mirror_io.0 Request processed in 65us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129568.575697:0:8410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15978 00000100:00100000:0.0:1746129568.575705:0:8410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15979 00000100:00100000:0.0:1746129568.575709:0:8410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b551180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:068dab75-d300-4ead-a742-d14572ad1e50+16:1961:x1830948734041344:12345-192.168.202.4@tcp:101:mirror_io.0 00010000:00010000:0.0:1746129568.575713:0:8410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129568.575719:0:8410:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f359400/0x40a459093b0695ed lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20b31 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129568.575726:0:8410:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129568.575728:0:8410:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129568.575732:0:8410:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f359400/0x40a459093b0695ed lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20b31 expref: 17 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129568.575739:0:8410:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f359400/0x40a459093b0695ed lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20b31 expref: 17 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129568.575744:0:8410:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f359400, rc 0) 00000100:00100000:0.0:1746129568.575755:0:8410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b551180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:068dab75-d300-4ead-a742-d14572ad1e50+17:1961:x1830948734041344:12345-192.168.202.4@tcp:101:mirror_io.0 Request processed in 46us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129568.575759:0:8410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15979 00000100:00100000:0.0:1746129568.575765:0:8410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15980 00000100:00100000:0.0:1746129568.575768:0:8410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b551f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:068dab75-d300-4ead-a742-d14572ad1e50+16:1961:x1830948734041216:12345-192.168.202.4@tcp:101:mirror_io.0 00010000:00010000:0.0:1746129568.575772:0:8410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129568.575777:0:8410:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f359200/0x40a459093b0695f4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20b2a expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129568.575784:0:8410:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129568.575785:0:8410:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129568.575788:0:8410:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f359200/0x40a459093b0695f4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20b2a expref: 17 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129568.575795:0:8410:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f359200/0x40a459093b0695f4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20b2a expref: 17 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129568.575800:0:8410:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f359200, rc 0) 00000100:00100000:0.0:1746129568.575808:0:8410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b551f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:068dab75-d300-4ead-a742-d14572ad1e50+17:1961:x1830948734041216:12345-192.168.202.4@tcp:101:mirror_io.0 Request processed in 39us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129568.575815:0:8410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15980 00000100:00100000:0.0:1746129568.575821:0:8410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15981 00000100:00100000:0.0:1746129568.575824:0:8410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b551c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:068dab75-d300-4ead-a742-d14572ad1e50+16:1961:x1830948734041472:12345-192.168.202.4@tcp:101:mirror_io.0 00010000:00010000:0.0:1746129568.575829:0:8410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129568.575834:0:8410:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f359000/0x40a459093b0695fb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20b38 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129568.575913:0:8410:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129568.575914:0:8410:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129568.575919:0:8410:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f359000/0x40a459093b0695fb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20b38 expref: 17 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129568.575931:0:8410:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f359000/0x40a459093b0695fb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20b38 expref: 17 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129568.575938:0:8410:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f359000, rc 0) 00000100:00100000:0.0:1746129568.575987:0:8410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b551c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:068dab75-d300-4ead-a742-d14572ad1e50+17:1961:x1830948734041472:12345-192.168.202.4@tcp:101:mirror_io.0 Request processed in 158us (656us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129568.575992:0:8410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15981 00000100:00100000:0.0:1746129568.579235:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129568.579378:0:2271:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734041728 00000100:00100000:3.0:1746129568.579388:0:2271:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734041728 00000100:00100000:3.0:1746129568.579435:0:2271:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11174 00000100:00100000:3.0:1746129568.579442:0:2271:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b553480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:068dab75-d300-4ead-a742-d14572ad1e50+7:32197:x1830948734041728:12345-192.168.202.4@tcp:101:mirror_io.0 00010000:00010000:3.0:1746129568.579462:0:2271:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129568.579481:0:2271:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5a87600/0x40a459093b069602 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20b3f expref: -99 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129568.580128:0:2271:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800955d3400/0x40a459093b069609 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129568.580144:0:2271:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba2de00/0x40a459093b0695d8 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20b15 expref: 8 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129568.580151:0:2271:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800955d3400/0x40a459093b069609 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129568.580186:0:2271:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba2de00/0x40a459093b0695d8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20b15 expref: 8 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129568.580199:0:2271:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba2de00/0x40a459093b0695d8 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20b15 expref: 8 pid: 2271 timeout: 923 lvb_type: 0 00000100:00100000:3.0:1746129568.580212:0:2271:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a07ad500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:2271:1830948737482496:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129568.580705:0:2271:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e29fd80 going to sleep for 11 seconds 00000100:00100000:0.0:1746129568.583289:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129568.583538:0:2271:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a07ad500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:2271:1830948737482496:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129568.583566:0:2271:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800955d3400/0x40a459093b069609 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00000100:00100000:1.0:1746129568.583647:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734041856 00000100:00100000:1.0:1746129568.583655:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734041856 00010000:00010000:1.0:1746129568.583695:0:7087:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba2de00/0x40a459093b0695d8 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20b15 expref: 9 pid: 2271 timeout: 923 lvb_type: 0 00000100:00100000:1.0:1746129568.583724:0:7087:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8169 00000100:00100000:1.0:1746129568.583731:0:7087:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b552680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:068dab75-d300-4ead-a742-d14572ad1e50+9:1960:x1830948734041856:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129568.583751:0:7087:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129568.583757:0:7087:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba2de00/0x40a459093b0695d8 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20b15 expref: 9 pid: 2271 timeout: 923 lvb_type: 0 00010000:00010000:1.0:1746129568.583768:0:7087:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba2de00/0x40a459093b0695d8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20b15 expref: 9 pid: 2271 timeout: 923 lvb_type: 0 00010000:00010000:1.0:1746129568.583795:0:7087:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba2de00/0x40a459093b0695d8 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20b15 expref: 9 pid: 2271 timeout: 923 lvb_type: 0 00010000:00010000:1.0:1746129568.583821:0:7087:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:1.0:1746129568.583827:0:7087:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800955d3400/0x40a459093b069609 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00010000:00010000:1.0:1746129568.583835:0:7087:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800955d3400/0x40a459093b069609 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 2271 initiator: MDT0 00010000:00010000:1.0:1746129568.583842:0:7087:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800955d3400/0x40a459093b069609 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 2271 initiator: MDT0 00010000:00010000:1.0:1746129568.583871:0:7087:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746129568.583892:0:2271:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800955d3400/0x40a459093b069609 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129568.583899:0:2271:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800955d3400/0x40a459093b069609 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00000100:00100000:1.0:1746129568.583914:0:7087:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b552680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:068dab75-d300-4ead-a742-d14572ad1e50+8:1960:x1830948734041856:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 183us (636us total) trans 0 rc 0/0 00000004:00200000:2.0:1746129568.583919:0:2271:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00000100:00100000:1.0:1746129568.583920:0:7087:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8169 00010000:00010000:2.0:1746129568.584074:0:2271:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5a87600/0x40a459093b069602 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20b3f expref: 9 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129568.584091:0:2271:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800955d3400/0x40a459093b069609 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20b3f expref: 8 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129568.584096:0:2271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:2.0:1746129568.584099:0:2271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746129568.584101:0:2271:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800955d3400, rc 0) 00000100:00100000:2.0:1746129568.584127:0:2271:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b553480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:068dab75-d300-4ead-a742-d14572ad1e50+8:32197:x1830948734041728:12345-192.168.202.4@tcp:101:mirror_io.0 Request processed in 4686us (4902us total) trans 8589945259 rc 0/0 00000100:00100000:2.0:1746129568.584132:0:2271:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11174 00000100:00100000:0.0:1746129568.592120:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129568.592444:0:2271:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734042112 00000100:00100000:2.0:1746129568.592455:0:2271:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734042112 00000100:00100000:2.0:1746129568.592516:0:2271:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11175 00000100:00100000:2.0:1746129568.592525:0:2271:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b553b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:068dab75-d300-4ead-a742-d14572ad1e50+8:32197:x1830948734042112:12345-192.168.202.4@tcp:101:mirror_io.0 00010000:00010000:2.0:1746129568.592552:0:2271:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129568.592555:0:2271:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746129568.592585:0:2271:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800955d3400/0x40a459093b069609 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20b3f expref: 8 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129568.592622:0:2271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:2.0:1746129568.592627:0:2271:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746129568.592639:0:2271:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06b5400/0x40a459093b069617 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20b46 expref: -99 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129568.592737:0:2271:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06b5600/0x40a459093b06961e lrc: 3/0,1 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129568.592749:0:2271:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06b5600/0x40a459093b06961e lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129568.592759:0:2271:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06b5600/0x40a459093b06961e lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129568.592770:0:2271:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06b5600/0x40a459093b06961e lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129568.592776:0:2271:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06b5600/0x40a459093b06961e lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129568.592781:0:2271:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06b5600/0x40a459093b06961e lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129568.592787:0:2271:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a06b5600 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746129568.592790:0:2271:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06b5600/0x40a459093b06961e lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129568.592817:0:2271:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06b5600/0x40a459093b06961e lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129568.592825:0:2271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:2.0:1746129568.592828:0:2271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746129568.592831:0:2271:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06b5600/0x40a459093b06961e lrc: 2/0,0 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129568.592835:0:2271:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06b5600/0x40a459093b06961e lrc: 0/0,0 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129568.592862:0:2271:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06b5400/0x40a459093b069617 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20b46 expref: 8 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129568.592873:0:2271:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06b5400/0x40a459093b069617 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20b46 expref: 8 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129568.592881:0:2271:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a06b5400, rc 0) 00000100:00100000:2.0:1746129568.592944:0:2271:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b553b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:068dab75-d300-4ead-a742-d14572ad1e50+7:32197:x1830948734042112:12345-192.168.202.4@tcp:101:mirror_io.0 Request processed in 419us (835us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129568.592950:0:2271:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11175 00000100:00100000:1.0:1746129568.596066:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129568.596416:0:16680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734042368 00000100:00100000:3.0:1746129568.596425:0:16680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734042368 00000100:00100000:3.0:1746129568.596479:0:16680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4732 00000100:00100000:3.0:1746129568.596487:0:16680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4e3c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:068dab75-d300-4ead-a742-d14572ad1e50+7:32197:x1830948734042368:12345-192.168.202.4@tcp:35:mirror_io.0 00000100:00100000:3.0:1746129568.596726:0:16680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4e3c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:068dab75-d300-4ead-a742-d14572ad1e50+8:32197:x1830948734042368:12345-192.168.202.4@tcp:35:mirror_io.0 Request processed in 239us (672us total) trans 8589945260 rc 0/0 00000100:00100000:3.0:1746129568.596733:0:16680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4732 00000100:00100000:1.0:1746129568.636319:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129568.636444:0:2271:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734042624 00000100:00100000:2.0:1746129568.636455:0:2271:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734042624 00000100:00100000:2.0:1746129568.636521:0:2271:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11176 00000100:00100000:2.0:1746129568.636528:0:2271:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135727800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+13:32202:x1830948734042624:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129568.636549:0:2271:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129568.636564:0:2271:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06b5c00/0x40a459093b069625 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20b4d expref: -99 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129568.636663:0:2271:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06b5e00/0x40a459093b06962c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129568.636674:0:2271:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06b5e00/0x40a459093b06962c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129568.636683:0:2271:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06b5e00/0x40a459093b06962c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129568.636695:0:2271:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06b5400/0x40a459093b069633 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129568.636704:0:2271:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06b5400/0x40a459093b069633 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129568.636709:0:2271:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06b5400/0x40a459093b069633 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129568.636796:0:2271:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06b5600/0x40a459093b06963a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129568.636804:0:2271:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06b5600/0x40a459093b06963a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129568.636810:0:2271:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06b5600/0x40a459093b06963a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00000004:00200000:2.0:1746129568.636818:0:2271:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:2.0:1746129568.636886:0:2271:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06b5e00/0x40a459093b06962c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129568.636893:0:2271:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06b5e00/0x40a459093b06962c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129568.636898:0:2271:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06b5e00/0x40a459093b06962c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129568.636903:0:2271:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a06b5e00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746129568.636906:0:2271:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06b5e00/0x40a459093b06962c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129568.636912:0:2271:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06b5e00/0x40a459093b06962c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129568.636921:0:2271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880132ef8f00) 00010000:00010000:2.0:1746129568.636924:0:2271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129568.636927:0:2271:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06b5e00/0x40a459093b06962c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129568.636932:0:2271:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06b5e00/0x40a459093b06962c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129568.636955:0:2271:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06b5400/0x40a459093b069633 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129568.636960:0:2271:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06b5400/0x40a459093b069633 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129568.636964:0:2271:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06b5400/0x40a459093b069633 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129568.636968:0:2271:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a06b5400 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746129568.636971:0:2271:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06b5400/0x40a459093b069633 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129568.636975:0:2271:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06b5400/0x40a459093b069633 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129568.636981:0:2271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f0e7e00) 00010000:00010000:2.0:1746129568.636983:0:2271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129568.636985:0:2271:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06b5400/0x40a459093b069633 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129568.636990:0:2271:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06b5400/0x40a459093b069633 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129568.637018:0:2271:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06b5c00/0x40a459093b069625 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20b4d expref: 16 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129568.637032:0:2271:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06b5600/0x40a459093b06963a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20b4d expref: 15 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129568.637037:0:2271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:2.0:1746129568.637039:0:2271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746129568.637042:0:2271:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a06b5600, rc 0) 00000100:00100000:2.0:1746129568.637103:0:2271:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135727800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+15:32202:x1830948734042624:12345-192.168.202.4@tcp:101:cat.0 Request processed in 575us (817us total) trans 8589945261 rc 0/0 00000100:00100000:2.0:1746129568.637110:0:2271:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11176 00000100:00100000:0.0:1746129568.640689:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129568.641087:0:16680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734042880 00000100:00100000:3.0:1746129568.641097:0:16680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734042880 00000100:00100000:3.0:1746129568.641148:0:16680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4733 00000100:00100000:3.0:1746129568.641155:0:16680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+15:32202:x1830948734042880:12345-192.168.202.4@tcp:35:cat.0 00000100:00100000:3.0:1746129568.641712:0:16680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+16:32202:x1830948734042880:12345-192.168.202.4@tcp:35:cat.0 Request processed in 555us (1033us total) trans 8589945262 rc 0/0 00000100:00100000:3.0:1746129568.641719:0:16680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4733 00000100:00100000:0.0:1746129568.643864:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129568.643915:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129568.644031:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734043008 00000100:00100000:2.0:1746129568.644039:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734043008 00000100:00100000:2.0:1746129568.644076:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734043136 00000100:00100000:2.0:1746129568.644078:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734043136 00000100:00100000:2.0:1746129568.644091:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15982 00000100:00100000:2.0:1746129568.644097:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:1962:x1830948734043008:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129568.644113:0:4385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129568.644130:0:4385:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a06b4e00/0x40a459093b069648 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20b54 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129568.644154:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129568.644156:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129568.644165:0:4385:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a06b4e00/0x40a459093b069648 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20b54 expref: 22 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129568.644179:0:4385:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a06b4e00/0x40a459093b069648 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20b54 expref: 22 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129568.644195:0:4385:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a06b4e00, rc 0) 00000100:00100000:1.0:1746129568.644317:0:22481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15983 00000100:00100000:1.0:1746129568.644324:0:22481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+26:1963:x1830948734043136:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129568.644331:0:22481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129568.644350:0:22481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d94e400/0x40a459093b06964f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20b5b expref: -99 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129568.644362:0:22481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129568.644363:0:22481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129568.644367:0:22481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d94e400/0x40a459093b06964f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20b5b expref: 27 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129568.644376:0:22481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d94e400/0x40a459093b06964f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20b5b expref: 27 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129568.644383:0:22481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d94e400, rc 0) 00000100:00100000:2.0:1746129568.644753:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+22:1962:x1830948734043008:12345-192.168.202.4@tcp:101:cat.0 Request processed in 654us (897us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129568.644759:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15982 00000100:00100000:1.0:1746129568.644823:0:22481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+27:1963:x1830948734043136:12345-192.168.202.4@tcp:101:cat.0 Request processed in 500us (906us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129568.644828:0:22481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15983 00000100:00100000:0.0:1746129568.663060:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129568.663181:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129568.663273:0:31518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734043392 00000100:00100000:3.0:1746129568.663283:0:31518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734043392 00000100:00100000:1.0:1746129568.663579:0:31521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734043648 00000100:00100000:1.0:1746129568.663583:0:31521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734043648 00002000:00100000:1.0:1746129568.663609:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3ee:0x0] (1048576->2097151) req@ffff880091b04a80 x1830948734043648/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:309/0 lens 488/0 e 0 to 0 dl 1746129579 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129568.663620:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091b04a80 with x1830948734043648 ext(1048576->2097151) 00002000:00010000:1.0:1746129568.663625:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091b04a80 00000100:00100000:1.0:1746129568.664099:0:31521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7685 00000100:00100000:1.0:1746129568.664108:0:31521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+27:1961:x1830948734043648:12345-192.168.202.4@tcp:3:cat.0 00002000:00100000:3.0:1746129568.665572:0:31518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3f4:0x0] (1048576->2097151) req@ffff880091b05500 x1830948734043392/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:309/0 lens 488/0 e 0 to 0 dl 1746129579 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129568.665583:0:31518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091b05500 with x1830948734043392 ext(1048576->2097151) 00002000:00010000:3.0:1746129568.665589:0:31518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091b05500 00000100:00100000:3.0:1746129568.665629:0:31518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7686 00000100:00100000:3.0:1746129568.665639:0:31518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+22:1961:x1830948734043392:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:1.0:1746129568.673907:0:31521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+27:1961:x1830948734043648:12345-192.168.202.4@tcp:3:cat.0 Request processed in 9787us (10712us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129568.673919:0:31521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7685 00002000:00100000:1.0:1746129568.673931:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3ee:0x0] (1048576->2097151) req@ffff880091b04a80 x1830948734043648/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:309/0 lens 488/440 e 0 to 0 dl 1746129579 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129568.673941:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091b04a80 with x1830948734043648 ext(1048576->2097151) 00002000:00010000:1.0:1746129568.673949:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091b04a80 00000100:00100000:0.0:1746129568.681723:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129568.681883:0:2271:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734043904 00000100:00100000:0.0:1746129568.681893:0:2271:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734043904 00000100:00100000:0.0:1746129568.681953:0:2271:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11177 00000100:00100000:0.0:1746129568.681961:0:2271:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ada2ffba-8920-4ecb-8068-68caa9806978+297:32205:x1830948734043904:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129568.681986:0:2271:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746129568.682063:0:31518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+22:1961:x1830948734043392:12345-192.168.202.4@tcp:3:cat.0 Request processed in 16425us (19011us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129568.682073:0:31518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7686 00002000:00100000:3.0:1746129568.682082:0:31518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3f4:0x0] (1048576->2097151) req@ffff880091b05500 x1830948734043392/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:309/0 lens 488/440 e 0 to 0 dl 1746129579 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129568.682092:0:31518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091b05500 with x1830948734043392 ext(1048576->2097151) 00002000:00010000:3.0:1746129568.682097:0:31518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091b05500 00010000:00010000:0.0:1746129568.682228:0:2271:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f358a00/0x40a459093b069656 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20b62 expref: -99 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129568.682652:0:2271:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800955d3400/0x40a459093b06965d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129568.682668:0:2271:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800955d3400/0x40a459093b06965d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129568.683790:0:2271:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800955d3400/0x40a459093b06965d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129568.683809:0:2271:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800955d2a00/0x40a459093b069664 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129568.683816:0:2271:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800955d2a00/0x40a459093b069664 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129568.683822:0:2271:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800955d2a00/0x40a459093b069664 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129568.683951:0:2271:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c47d400/0x40a459093b06966b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129568.683960:0:2271:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c47d400/0x40a459093b06966b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129568.683965:0:2271:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c47d400/0x40a459093b06966b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00000004:00200000:3.0:1746129568.683974:0:2271:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:3.0:1746129568.684058:0:2271:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800955d3400/0x40a459093b06965d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129568.684064:0:2271:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800955d3400/0x40a459093b06965d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129568.684071:0:2271:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800955d3400/0x40a459093b06965d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129568.684080:0:2271:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800955d3400 already unused, calling callback (ffffffffa136e690) 00010000:00010000:3.0:1746129568.684084:0:2271:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800955d3400/0x40a459093b06965d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129568.684090:0:2271:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800955d3400/0x40a459093b06965d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129568.684100:0:2271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880132ef8f00) 00010000:00010000:3.0:1746129568.684103:0:2271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129568.684107:0:2271:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800955d3400/0x40a459093b06965d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129568.684112:0:2271:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800955d3400/0x40a459093b06965d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129568.684143:0:2271:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800955d2a00/0x40a459093b069664 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129568.684148:0:2271:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800955d2a00/0x40a459093b069664 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129568.684152:0:2271:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800955d2a00/0x40a459093b069664 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129568.684156:0:2271:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800955d2a00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:3.0:1746129568.684158:0:2271:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800955d2a00/0x40a459093b069664 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129568.684162:0:2271:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800955d2a00/0x40a459093b069664 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129568.684167:0:2271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012db42d00) 00010000:00010000:3.0:1746129568.684169:0:2271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129568.684172:0:2271:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800955d2a00/0x40a459093b069664 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129568.684176:0:2271:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800955d2a00/0x40a459093b069664 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129568.684221:0:2271:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f358a00/0x40a459093b069656 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20b62 expref: 300 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129568.684234:0:2271:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c47d400/0x40a459093b06966b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20b62 expref: 299 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129568.684240:0:2271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:3.0:1746129568.684242:0:2271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746129568.684244:0:2271:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c47d400, rc 0) 00000100:00100000:3.0:1746129568.684755:0:2271:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ada2ffba-8920-4ecb-8068-68caa9806978+299:32205:x1830948734043904:12345-192.168.202.4@tcp:101:cat.0 Request processed in 2793us (3043us total) trans 8589945263 rc 0/0 00000100:00100000:3.0:1746129568.684764:0:2271:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11177 00000100:00100000:0.0:1746129568.692902:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129568.693011:0:16680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734044160 00000100:00100000:3.0:1746129568.693021:0:16680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734044160 00000100:00100000:3.0:1746129568.693079:0:16680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4734 00000100:00100000:3.0:1746129568.693086:0:16680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ada2ffba-8920-4ecb-8068-68caa9806978+299:32205:x1830948734044160:12345-192.168.202.4@tcp:35:cat.0 00000100:00100000:3.0:1746129568.695938:0:16680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ada2ffba-8920-4ecb-8068-68caa9806978+300:32205:x1830948734044160:12345-192.168.202.4@tcp:35:cat.0 Request processed in 2839us (3037us total) trans 8589945264 rc 0/0 00000100:00100000:3.0:1746129568.695951:0:16680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4734 00000100:00100000:0.0:1746129568.709123:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129568.709286:0:22481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734044288 00000100:00100000:1.0:1746129568.709330:0:22481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734044288 00000100:00100000:1.0:1746129568.709408:0:22481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15984 00000100:00100000:1.0:1746129568.709417:0:22481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ada2ffba-8920-4ecb-8068-68caa9806978+36:32196:x1830948734044288:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:1.0:1746129568.709441:0:22481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129568.709461:0:22481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d94f200/0x40a459093b069679 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20b69 expref: -99 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129568.709498:0:22481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800955d2400/0x40a459093b06937e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f209d3 expref: 16 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129568.709507:0:22481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ee1a800/0x40a459093b069488 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20a3c expref: 37 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129568.709514:0:22481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c16a600/0x40a459093b06947a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20a2e expref: 21 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129568.709521:0:22481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129568.709522:0:22481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129568.709526:0:22481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d94f200/0x40a459093b069679 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [1822720->2097151] (req 1822720->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20b69 expref: 37 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129568.709559:0:22481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c16a600/0x40a459093b06947a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20a2e expref: 21 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129568.709577:0:22481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c16a600/0x40a459093b06947a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20a2e expref: 21 pid: 8410 timeout: 924 lvb_type: 0 00000100:00100000:1.0:1746129568.709590:0:22481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135725880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:22481:1830948737482624:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129568.709705:0:22481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ee1a800/0x40a459093b069488 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20a3c expref: 37 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129568.709713:0:22481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ee1a800/0x40a459093b069488 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20a3c expref: 37 pid: 8410 timeout: 924 lvb_type: 0 00000100:00100000:1.0:1746129568.709721:0:22481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135727b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:22481:1830948737482752:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129568.709746:0:22481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800955d2400/0x40a459093b06937e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f209d3 expref: 16 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129568.709754:0:22481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800955d2400/0x40a459093b06937e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f209d3 expref: 16 pid: 22481 timeout: 924 lvb_type: 1 00000100:00100000:1.0:1746129568.709762:0:22481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135725c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:22481:1830948737482880:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129568.709776:0:22481:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a6dc8300 going to sleep for 11 seconds 00000100:00100000:0.0:1746129568.712753:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129568.712817:0:2271:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734044544 00000100:00100000:3.0:1746129568.712828:0:2271:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734044544 00000100:00100000:3.0:1746129568.712890:0:2271:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11178 00000100:00100000:3.0:1746129568.712899:0:2271:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+16:32207:x1830948734044544:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:3.0:1746129568.712929:0:2271:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129568.712949:0:2271:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800915dc200/0x40a459093b069680 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20b70 expref: -99 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129568.713056:0:2271:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800915dc400/0x40a459093b069687 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129568.713071:0:2271:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06b5600/0x40a459093b06963a lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20b4d expref: 17 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129568.713078:0:2271:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c47d400/0x40a459093b06966b lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20b62 expref: 299 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129568.713084:0:2271:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800915dc400/0x40a459093b069687 lrc: 5/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129568.713116:0:2271:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009c47d400/0x40a459093b06966b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20b62 expref: 299 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129568.713127:0:2271:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c47d400/0x40a459093b06966b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20b62 expref: 299 pid: 2271 timeout: 924 lvb_type: 0 00000100:00100000:3.0:1746129568.713140:0:2271:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a07ad500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:2271:1830948737483008:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129568.713288:0:2271:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06b5600/0x40a459093b06963a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20b4d expref: 17 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129568.713325:0:2271:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06b5600/0x40a459093b06963a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20b4d expref: 17 pid: 2271 timeout: 924 lvb_type: 0 00000100:00100000:3.0:1746129568.713491:0:2271:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a07ac000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:2271:1830948737483136:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129568.714357:0:2271:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e29fcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746129568.714582:0:22481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135725880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:22481:1830948737482624:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129568.714592:0:22481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135727b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:22481:1830948737482752:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129568.714597:0:22481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135725c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:22481:1830948737482880:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129568.714624:0:22481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d94f200/0x40a459093b069679 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [1822720->2097151] (req 1822720->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20b69 expref: 37 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129568.714638:0:22481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d94f200, rc 0) 00000100:00100000:1.0:1746129568.714675:0:22481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ada2ffba-8920-4ecb-8068-68caa9806978+37:32196:x1830948734044288:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 5260us (5564us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129568.714682:0:22481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15984 00000100:00100000:0.0:1746129568.716886:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129568.717003:0:2271:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a07ad500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:2271:1830948737483008:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129568.717014:0:2271:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a07ac000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:2271:1830948737483136:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129568.717036:0:2271:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800915dc400/0x40a459093b069687 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00000100:00100000:0.0:1746129568.717172:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129568.717175:0:20578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734044928 00000100:00100000:1.0:1746129568.717183:0:20578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734044928 00000100:00100000:0.0:1746129568.717206:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00010000:00010000:1.0:1746129568.717215:0:20578:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c47d400/0x40a459093b06966b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20b62 expref: 300 pid: 2271 timeout: 924 lvb_type: 0 00000100:00100000:0.0:1746129568.717224:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129568.717238:0:20578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734044672 00000100:00100000:1.0:1746129568.717240:0:20578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734044672 00000100:00100000:0.0:1746129568.717251:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00010000:00010000:1.0:1746129568.717253:0:20578:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ee1a800/0x40a459093b069488 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20a3c expref: 37 pid: 8410 timeout: 924 lvb_type: 0 00000100:00100000:1.0:1746129568.717262:0:20578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734045056 00000100:00100000:1.0:1746129568.717264:0:20578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734045056 00010000:00010000:1.0:1746129568.717272:0:20578:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c16a600/0x40a459093b06947a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20a2e expref: 22 pid: 8410 timeout: 924 lvb_type: 0 00000100:00100000:1.0:1746129568.717280:0:20578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734044800 00000100:00100000:1.0:1746129568.717282:0:20578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734044800 00010000:00010000:1.0:1746129568.717290:0:20578:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800955d2400/0x40a459093b06937e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f209d3 expref: 17 pid: 22481 timeout: 924 lvb_type: 1 00000100:00100000:1.0:1746129568.717327:0:20578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734045184 00000100:00100000:1.0:1746129568.717329:0:20578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734045184 00010000:00010000:1.0:1746129568.717350:0:20578:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06b5600/0x40a459093b06963a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20b4d expref: 18 pid: 2271 timeout: 924 lvb_type: 0 00000100:00100000:3.0:1746129568.717358:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8170 00000100:00100000:1.0:1746129568.717364:0:20578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8171 00000100:00100000:3.0:1746129568.717366:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b07800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ada2ffba-8920-4ecb-8068-68caa9806978+300:1963:x1830948734044928:12345-192.168.202.4@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746129568.717368:0:20578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b05880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ada2ffba-8920-4ecb-8068-68caa9806978+37:1963:x1830948734044672:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129568.717379:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129568.717379:0:20578:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129568.717385:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009c47d400/0x40a459093b06966b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20b62 expref: 300 pid: 2271 timeout: 924 lvb_type: 0 00010000:00010000:3.0:1746129568.717392:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009c47d400/0x40a459093b06966b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20b62 expref: 300 pid: 2271 timeout: 924 lvb_type: 0 00010000:00010000:1.0:1746129568.717402:0:20578:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ee1a800/0x40a459093b069488 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20a3c expref: 37 pid: 8410 timeout: 924 lvb_type: 0 00010000:00010000:1.0:1746129568.717408:0:20578:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ee1a800/0x40a459093b069488 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20a3c expref: 37 pid: 8410 timeout: 924 lvb_type: 0 00010000:00010000:3.0:1746129568.717413:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c47d400/0x40a459093b06966b lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20b62 expref: 300 pid: 2271 timeout: 924 lvb_type: 0 00010000:00010000:1.0:1746129568.717422:0:20578:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ee1a800/0x40a459093b069488 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20a3c expref: 37 pid: 8410 timeout: 924 lvb_type: 0 00010000:00010000:3.0:1746129568.717432:0:7085:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:3.0:1746129568.717436:0:7085:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800915dc400/0x40a459093b069687 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129568.717445:0:7085:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800915dc400/0x40a459093b069687 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00000100:00100000:2.0:1746129568.717452:0:7087:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8172 00010000:00010000:3.0:1746129568.717454:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129568.717461:0:7087:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6025050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+22:1963:x1830948734045056:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129568.717471:0:7087:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129568.717475:0:20578:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746129568.717480:0:7087:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c16a600/0x40a459093b06947a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20a2e expref: 22 pid: 8410 timeout: 924 lvb_type: 0 00010000:00010000:2.0:1746129568.717488:0:7087:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c16a600/0x40a459093b06947a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20a2e expref: 22 pid: 8410 timeout: 924 lvb_type: 0 00010000:00010000:2.0:1746129568.717499:0:7087:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c16a600/0x40a459093b06947a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20a2e expref: 22 pid: 8410 timeout: 924 lvb_type: 0 00000100:00100000:3.0:1746129568.717508:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b07800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ada2ffba-8920-4ecb-8068-68caa9806978+299:1963:x1830948734044928:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 143us (631us total) trans 0 rc 0/0 00010000:00010000:2.0:1746129568.717512:0:7087:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129568.717518:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8170 00000100:00100000:3.0:1746129568.717534:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8173 00000100:00100000:3.0:1746129568.717539:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b06a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:068dab75-d300-4ead-a742-d14572ad1e50+17:1960:x1830948734044800:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129568.717545:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746129568.717546:0:20578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b05880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ada2ffba-8920-4ecb-8068-68caa9806978+36:1963:x1830948734044672:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 176us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129568.717547:0:7087:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6025050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:1963:x1830948734045056:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 87us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129568.717551:0:20578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8171 00010000:00010000:3.0:1746129568.717553:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800955d2400/0x40a459093b06937e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f209d3 expref: 17 pid: 22481 timeout: 924 lvb_type: 1 00000100:00100000:2.0:1746129568.717555:0:7087:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8172 00010000:00010000:3.0:1746129568.717561:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800955d2400/0x40a459093b06937e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f209d3 expref: 17 pid: 22481 timeout: 924 lvb_type: 1 00000100:00100000:1.0:1746129568.717561:0:20578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8174 00000100:00100000:1.0:1746129568.717565:0:20578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b06300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+18:1960:x1830948734045184:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129568.717570:0:20578:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129568.717572:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800955d2400/0x40a459093b06937e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f209d3 expref: 17 pid: 22481 timeout: 924 lvb_type: 1 00010000:00010000:1.0:1746129568.717573:0:20578:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06b5600/0x40a459093b06963a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20b4d expref: 18 pid: 2271 timeout: 924 lvb_type: 0 00010000:00010000:3.0:1746129568.717581:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129568.717582:0:20578:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06b5600/0x40a459093b06963a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20b4d expref: 18 pid: 2271 timeout: 924 lvb_type: 0 00010000:00010000:3.0:1746129568.717583:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129568.717589:0:7085:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d94f200/0x40a459093b069679 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1822720->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20b69 expref: 35 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129568.717596:0:7085:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d94f200/0x40a459093b069679 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1822720->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20b69 expref: 35 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129568.717596:0:20578:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06b5600/0x40a459093b06963a lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20b4d expref: 18 pid: 2271 timeout: 924 lvb_type: 0 00010000:00010000:1.0:1746129568.717604:0:20578:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:1.0:1746129568.717606:0:20578:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800915dc400/0x40a459093b069687 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00010000:00010000:1.0:1746129568.717612:0:20578:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800915dc400/0x40a459093b069687 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 2271 initiator: MDT0 00010000:00010000:1.0:1746129568.717616:0:20578:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800915dc400/0x40a459093b069687 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129568.717624:0:7085:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012d94f200/0x40a459093b069679 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1822720->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20b69 expref: 35 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129568.717628:0:20578:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746129568.717633:0:2271:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800915dc400/0x40a459093b069687 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00000100:00100000:3.0:1746129568.717636:0:7085:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a07ac000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7085:1830948737483264:192.168.202.4@tcp:105: 00010000:00010000:2.0:1746129568.717640:0:2271:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800915dc400/0x40a459093b069687 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00000100:00100000:1.0:1746129568.717641:0:20578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b06300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+17:1960:x1830948734045184:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 76us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129568.717645:0:20578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8174 00000004:00200000:2.0:1746129568.717663:0:2271:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00000100:00100000:3.0:1746129568.717673:0:7085:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e29fcc0 going to sleep for 11 seconds 00010000:00010000:2.0:1746129568.719376:0:2271:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800915dc200/0x40a459093b069680 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20b70 expref: 18 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129568.719394:0:2271:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800915dc400/0x40a459093b069687 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20b70 expref: 17 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129568.719401:0:2271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:2.0:1746129568.719404:0:2271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746129568.719406:0:2271:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800915dc400, rc 0) 00000100:00100000:2.0:1746129568.719460:0:2271:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+17:32207:x1830948734044544:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 6562us (6719us total) trans 8589945265 rc 0/0 00000100:00100000:2.0:1746129568.719467:0:2271:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11178 00000100:00100000:3.0:1746129568.727574:0:7085:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a07ac000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7085:1830948737483264:192.168.202.4@tcp:105: 00010000:00010000:3.0:1746129568.727600:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129568.727648:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b06a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:068dab75-d300-4ead-a742-d14572ad1e50+16:1960:x1830948734044800:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 10107us (10420us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129568.727658:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8173 00000100:00100000:0.0:1746129568.728620:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129568.728786:0:31518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734045440 00000100:00100000:3.0:1746129568.728794:0:31518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734045440 00002000:00100000:3.0:1746129568.728840:0:31518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3f3:0x0] (1822720->1826815) req@ffff880091b05f80 x1830948734045440/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:309/0 lens 488/0 e 0 to 0 dl 1746129579 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129568.728849:0:31518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091b05f80 with x1830948734045440 ext(1822720->1826815) 00002000:00010000:3.0:1746129568.728853:0:31518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091b05f80 00000100:00100000:3.0:1746129568.729233:0:31518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7687 00000100:00100000:3.0:1746129568.729241:0:31518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ada2ffba-8920-4ecb-8068-68caa9806978+36:1963:x1830948734045440:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:3.0:1746129568.729585:0:31518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ada2ffba-8920-4ecb-8068-68caa9806978+36:1963:x1830948734045440:12345-192.168.202.4@tcp:3:cat.0 Request processed in 344us (967us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129568.729592:0:31518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7687 00002000:00100000:3.0:1746129568.729598:0:31518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3f3:0x0] (1822720->1826815) req@ffff880091b05f80 x1830948734045440/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:309/0 lens 488/4536 e 0 to 0 dl 1746129579 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129568.729605:0:31518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091b05f80 with x1830948734045440 ext(1822720->1826815) 00002000:00010000:3.0:1746129568.729609:0:31518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091b05f80 00000100:00100000:0.0:1746129568.736323:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129568.736426:0:22481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734045568 00000100:00100000:1.0:1746129568.736437:0:22481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734045568 00000100:00100000:1.0:1746129568.736496:0:22481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15985 00000100:00100000:1.0:1746129568.736505:0:22481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ada2ffba-8920-4ecb-8068-68caa9806978+36:32196:x1830948734045568:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:1.0:1746129568.736524:0:22481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129568.736543:0:22481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d94f600/0x40a459093b069695 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20b77 expref: -99 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129568.736578:0:22481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f358800/0x40a459093b0695a0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20b00 expref: 37 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129568.736592:0:22481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a06b4e00/0x40a459093b069648 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20b54 expref: 20 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129568.736600:0:22481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f359600/0x40a459093b0695e6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20b23 expref: 15 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129568.736606:0:22481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129568.736608:0:22481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129568.736612:0:22481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d94f600/0x40a459093b069695 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [1048576->1724415] (req 1048576->1724415) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20b77 expref: 37 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129568.736646:0:22481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012f359600/0x40a459093b0695e6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20b23 expref: 15 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129568.736658:0:22481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012f359600/0x40a459093b0695e6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20b23 expref: 15 pid: 8410 timeout: 924 lvb_type: 1 00000100:00100000:1.0:1746129568.736670:0:22481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135725c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:22481:1830948737483392:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129568.738432:0:22481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a06b4e00/0x40a459093b069648 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20b54 expref: 20 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129568.738446:0:22481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a06b4e00/0x40a459093b069648 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20b54 expref: 20 pid: 4385 timeout: 924 lvb_type: 1 00000100:00100000:1.0:1746129568.738458:0:22481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135727b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:22481:1830948737483520:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129568.738847:0:22481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012f358800/0x40a459093b0695a0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20b00 expref: 37 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129568.738856:0:22481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012f358800/0x40a459093b0695a0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20b00 expref: 37 pid: 7148 timeout: 924 lvb_type: 0 00000100:00100000:1.0:1746129568.738865:0:22481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135725880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:22481:1830948737483648:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129568.738889:0:22481:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a6dc8300 going to sleep for 11 seconds 00000100:00100000:1.0:1746129568.740906:0:22481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135725c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:22481:1830948737483392:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129568.740918:0:22481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135727b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:22481:1830948737483520:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129568.743042:0:22481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135725880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:22481:1830948737483648:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129568.743080:0:22481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d94f600/0x40a459093b069695 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [1048576->1724415] (req 1048576->1724415) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20b77 expref: 37 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129568.743098:0:22481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d94f600, rc 0) 00000100:00100000:1.0:1746129568.743156:0:22481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ada2ffba-8920-4ecb-8068-68caa9806978+37:32196:x1830948734045568:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 6652us (6875us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129568.743165:0:22481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15985 00000100:00100000:0.0:1746129568.743459:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129568.745543:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734045696 00000100:00100000:3.0:1746129568.745557:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734045696 00010000:00010000:3.0:1746129568.745603:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012f359600/0x40a459093b0695e6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20b23 expref: 16 pid: 8410 timeout: 924 lvb_type: 1 00000100:00100000:3.0:1746129568.745642:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8175 00000100:00100000:3.0:1746129568.745651:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b07800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:068dab75-d300-4ead-a742-d14572ad1e50+16:1963:x1830948734045696:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129568.745665:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129568.745687:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012f359600/0x40a459093b0695e6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20b23 expref: 16 pid: 8410 timeout: 924 lvb_type: 1 00010000:00010000:3.0:1746129568.745700:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012f359600/0x40a459093b0695e6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20b23 expref: 16 pid: 8410 timeout: 924 lvb_type: 1 00010000:00010000:3.0:1746129568.745724:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f359600/0x40a459093b0695e6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20b23 expref: 16 pid: 8410 timeout: 924 lvb_type: 1 00010000:00010000:3.0:1746129568.745746:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129568.745791:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b07800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:068dab75-d300-4ead-a742-d14572ad1e50+15:1963:x1830948734045696:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 142us (2333us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129568.745798:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8175 00000100:00100000:0.0:1746129568.746222:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129568.746273:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129568.746342:0:20578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734045824 00000100:00100000:1.0:1746129568.746347:0:20578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734045824 00010000:00010000:1.0:1746129568.746365:0:20578:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a06b4e00/0x40a459093b069648 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20b54 expref: 21 pid: 4385 timeout: 924 lvb_type: 1 00000100:00100000:1.0:1746129568.746384:0:20578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734045952 00000100:00100000:1.0:1746129568.746387:0:20578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734045952 00010000:00010000:1.0:1746129568.746397:0:20578:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012f358800/0x40a459093b0695a0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20b00 expref: 37 pid: 7148 timeout: 924 lvb_type: 0 00000100:00100000:1.0:1746129568.746410:0:20578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8176 00000100:00100000:1.0:1746129568.746415:0:20578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b05880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:1962:x1830948734045824:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129568.746422:0:20578:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129568.746432:0:20578:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a06b4e00/0x40a459093b069648 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20b54 expref: 21 pid: 4385 timeout: 924 lvb_type: 1 00010000:00010000:1.0:1746129568.746439:0:20578:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a06b4e00/0x40a459093b069648 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20b54 expref: 21 pid: 4385 timeout: 924 lvb_type: 1 00010000:00010000:1.0:1746129568.746450:0:20578:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a06b4e00/0x40a459093b069648 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20b54 expref: 21 pid: 4385 timeout: 924 lvb_type: 1 00010000:00010000:1.0:1746129568.746463:0:20578:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129568.746486:0:20578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b05880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:1962:x1830948734045824:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 71us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129568.746491:0:20578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8176 00000100:00100000:1.0:1746129568.746502:0:20578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8177 00000100:00100000:1.0:1746129568.746506:0:20578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f46a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ada2ffba-8920-4ecb-8068-68caa9806978+37:1963:x1830948734045952:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129568.746513:0:20578:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129568.746520:0:20578:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012f358800/0x40a459093b0695a0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20b00 expref: 37 pid: 7148 timeout: 924 lvb_type: 0 00010000:00010000:1.0:1746129568.746527:0:20578:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012f358800/0x40a459093b0695a0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20b00 expref: 37 pid: 7148 timeout: 924 lvb_type: 0 00010000:00010000:1.0:1746129568.746539:0:20578:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f358800/0x40a459093b0695a0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20b00 expref: 37 pid: 7148 timeout: 924 lvb_type: 0 00010000:00010000:1.0:1746129568.746547:0:20578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129568.746549:0:20578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129568.746556:0:20578:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d94f600/0x40a459093b069695 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1724415) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20b77 expref: 36 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129568.746563:0:20578:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d94f600/0x40a459093b069695 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1724415) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20b77 expref: 36 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129568.746595:0:20578:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012d94f600/0x40a459093b069695 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1724415) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20b77 expref: 36 pid: 22481 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129568.746607:0:20578:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135725880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:20578:1830948737483776:192.168.202.4@tcp:105: 00000100:00100000:1.0:1746129568.746655:0:20578:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a6dc8300 going to sleep for 11 seconds 00000100:00100000:1.0:1746129568.750100:0:20578:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135725880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:20578:1830948737483776:192.168.202.4@tcp:105: 00010000:00010000:1.0:1746129568.750125:0:20578:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129568.750179:0:20578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f46a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ada2ffba-8920-4ecb-8068-68caa9806978+36:1963:x1830948734045952:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 3671us (3904us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129568.750190:0:20578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8177 00000100:00100000:0.0:1746129568.757867:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129568.758247:0:31518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734046208 00000100:00100000:3.0:1746129568.758256:0:31518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734046208 00002000:00100000:3.0:1746129568.758356:0:31518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3f4:0x0] (1720320->1724415) req@ffff880094f45880 x1830948734046208/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:309/0 lens 488/0 e 0 to 0 dl 1746129579 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129568.758366:0:31518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094f45880 with x1830948734046208 ext(1720320->1724415) 00002000:00010000:3.0:1746129568.758372:0:31518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094f45880 00000100:00100000:3.0:1746129568.758405:0:31518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7688 00000100:00100000:3.0:1746129568.758414:0:31518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ada2ffba-8920-4ecb-8068-68caa9806978+36:1963:x1830948734046208:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:3.0:1746129568.758603:0:31518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ada2ffba-8920-4ecb-8068-68caa9806978+36:1963:x1830948734046208:12345-192.168.202.4@tcp:3:cat.0 Request processed in 190us (748us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129568.758612:0:31518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7688 00002000:00100000:3.0:1746129568.758618:0:31518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3f4:0x0] (1720320->1724415) req@ffff880094f45880 x1830948734046208/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:309/0 lens 488/4536 e 0 to 0 dl 1746129579 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129568.758628:0:31518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094f45880 with x1830948734046208 ext(1720320->1724415) 00002000:00010000:3.0:1746129568.758631:0:31518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094f45880 00000100:00100000:0.0:1746129568.760996:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129568.761204:0:16680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734046464 00000100:00100000:3.0:1746129568.761214:0:16680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734046464 00000100:00100000:3.0:1746129568.761253:0:16680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4735 00000100:00100000:3.0:1746129568.761260:0:16680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ada2ffba-8920-4ecb-8068-68caa9806978+299:32196:x1830948734046464:12345-192.168.202.4@tcp:35:multiop.0 00000100:00100000:3.0:1746129568.761541:0:16680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ada2ffba-8920-4ecb-8068-68caa9806978+300:32196:x1830948734046464:12345-192.168.202.4@tcp:35:multiop.0 Request processed in 280us (553us total) trans 8589945266 rc 0/0 00000100:00100000:3.0:1746129568.761547:0:16680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4735 00000100:00100000:0.0:1746129568.809717:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129568.809926:0:22481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734046592 00000100:00100000:1.0:1746129568.809936:0:22481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734046592 00000100:00100000:1.0:1746129568.810227:0:22481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15986 00000100:00100000:1.0:1746129568.810240:0:22481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+27:32207:x1830948734046592:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:1.0:1746129568.810264:0:22481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129568.810284:0:22481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d94fa00/0x40a459093b06969c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20b7e expref: -99 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129568.810370:0:22481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a06b4c00/0x40a459093b0695a7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20b07 expref: 37 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129568.810378:0:22481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d94e400/0x40a459093b06964f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20b5b expref: 28 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129568.810384:0:22481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f359200/0x40a459093b0695f4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20b2a expref: 16 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129568.810389:0:22481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129568.810391:0:22481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129568.810394:0:22481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d94fa00/0x40a459093b06969c lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [1716224->2097151] (req 1716224->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20b7e expref: 28 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129568.810426:0:22481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f359200/0x40a459093b0695f4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20b2a expref: 16 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129568.810439:0:22481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f359200/0x40a459093b0695f4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20b2a expref: 16 pid: 8410 timeout: 924 lvb_type: 1 00000100:00100000:1.0:1746129568.810454:0:22481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135725880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:22481:1830948737483904:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129568.810596:0:22481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d94e400/0x40a459093b06964f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20b5b expref: 28 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129568.810610:0:22481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d94e400/0x40a459093b06964f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20b5b expref: 28 pid: 22481 timeout: 924 lvb_type: 1 00000100:00100000:1.0:1746129568.810621:0:22481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135727b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:22481:1830948737484032:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129568.810657:0:22481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a06b4c00/0x40a459093b0695a7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20b07 expref: 37 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129568.810666:0:22481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a06b4c00/0x40a459093b0695a7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20b07 expref: 37 pid: 7148 timeout: 924 lvb_type: 0 00000100:00100000:1.0:1746129568.810674:0:22481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135725c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:22481:1830948737484160:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129568.810694:0:22481:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a6dc8300 going to sleep for 11 seconds 00000100:00100000:1.0:1746129568.813047:0:22481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135725880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:22481:1830948737483904:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129568.814252:0:22481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135727b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:22481:1830948737484032:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129568.814264:0:22481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135725c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:22481:1830948737484160:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129568.814320:0:22481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d94fa00/0x40a459093b06969c lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [1716224->2097151] (req 1716224->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20b7e expref: 28 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129568.814350:0:22481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d94fa00, rc 0) 00000100:00100000:1.0:1746129568.814397:0:22481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+28:32207:x1830948734046592:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 4159us (4691us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129568.814406:0:22481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15986 00000100:00100000:0.0:1746129568.816364:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129568.816401:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129568.816695:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129568.817163:0:20578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734046720 00000100:00100000:1.0:1746129568.817173:0:20578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734046720 00010000:00010000:1.0:1746129568.817212:0:20578:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f359200/0x40a459093b0695f4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20b2a expref: 17 pid: 8410 timeout: 924 lvb_type: 1 00000100:00100000:1.0:1746129568.817466:0:20578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734046848 00000100:00100000:1.0:1746129568.817469:0:20578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734046848 00010000:00010000:1.0:1746129568.817480:0:20578:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d94e400/0x40a459093b06964f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20b5b expref: 28 pid: 22481 timeout: 924 lvb_type: 1 00000100:00100000:3.0:1746129568.817730:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734046976 00000100:00100000:3.0:1746129568.817735:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734046976 00010000:00010000:3.0:1746129568.817752:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a06b4c00/0x40a459093b0695a7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20b07 expref: 38 pid: 7148 timeout: 924 lvb_type: 0 00000100:00100000:3.0:1746129568.817771:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8178 00000100:00100000:3.0:1746129568.817778:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f45f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:068dab75-d300-4ead-a742-d14572ad1e50+17:1962:x1830948734046720:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129568.817792:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129568.817813:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f359200/0x40a459093b0695f4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20b2a expref: 17 pid: 8410 timeout: 924 lvb_type: 1 00010000:00010000:3.0:1746129568.817824:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f359200/0x40a459093b0695f4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20b2a expref: 17 pid: 8410 timeout: 924 lvb_type: 1 00010000:00010000:3.0:1746129568.817848:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f359200/0x40a459093b0695f4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20b2a expref: 17 pid: 8410 timeout: 924 lvb_type: 1 00010000:00010000:3.0:1746129568.817879:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129568.817925:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f45f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:068dab75-d300-4ead-a742-d14572ad1e50+16:1962:x1830948734046720:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 148us (1570us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129568.817931:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8178 00000100:00100000:3.0:1746129568.817946:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8179 00000100:00100000:3.0:1746129568.817951:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bbcc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+28:1963:x1830948734046848:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129568.817960:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129568.817967:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d94e400/0x40a459093b06964f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20b5b expref: 28 pid: 22481 timeout: 924 lvb_type: 1 00010000:00010000:3.0:1746129568.817974:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d94e400/0x40a459093b06964f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20b5b expref: 28 pid: 22481 timeout: 924 lvb_type: 1 00010000:00010000:3.0:1746129568.817985:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d94e400/0x40a459093b06964f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20b5b expref: 28 pid: 22481 timeout: 924 lvb_type: 1 00010000:00010000:3.0:1746129568.817993:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129568.818008:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bbcc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+27:1963:x1830948734046848:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 57us (1607us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129568.818013:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8179 00000100:00100000:3.0:1746129568.818065:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8180 00000100:00100000:3.0:1746129568.818070:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f47800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ada2ffba-8920-4ecb-8068-68caa9806978+38:1962:x1830948734046976:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129568.818077:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129568.818084:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a06b4c00/0x40a459093b0695a7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20b07 expref: 38 pid: 7148 timeout: 924 lvb_type: 0 00010000:00010000:3.0:1746129568.818092:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a06b4c00/0x40a459093b0695a7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20b07 expref: 38 pid: 7148 timeout: 924 lvb_type: 0 00010000:00010000:3.0:1746129568.818104:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a06b4c00/0x40a459093b0695a7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20b07 expref: 38 pid: 7148 timeout: 924 lvb_type: 0 00010000:00010000:3.0:1746129568.818112:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129568.818114:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129568.818120:0:7085:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d94fa00/0x40a459093b06969c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1716224->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20b7e expref: 26 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129568.818127:0:7085:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d94fa00/0x40a459093b06969c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1716224->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20b7e expref: 26 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129568.818160:0:7085:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012d94fa00/0x40a459093b06969c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1716224->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20b7e expref: 26 pid: 22481 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129568.818173:0:7085:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a07ac000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7085:1830948737484288:192.168.202.4@tcp:105: 00000100:00100000:3.0:1746129568.818224:0:7085:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c4e96c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129568.821769:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129568.822289:0:7085:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a07ac000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7085:1830948737484288:192.168.202.4@tcp:105: 00010000:00010000:3.0:1746129568.822341:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129568.822393:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f47800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ada2ffba-8920-4ecb-8068-68caa9806978+37:1962:x1830948734046976:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 4320us (5697us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129568.822405:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8180 00000100:00100000:1.0:1746129568.822835:0:31521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734047232 00000100:00100000:1.0:1746129568.822843:0:31521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734047232 00002000:00100000:1.0:1746129568.822888:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3ee:0x0] (1716224->1720319) req@ffff880094f45c00 x1830948734047232/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:309/0 lens 488/0 e 0 to 0 dl 1746129579 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129568.822898:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094f45c00 with x1830948734047232 ext(1716224->1720319) 00002000:00010000:1.0:1746129568.822902:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094f45c00 00000100:00100000:1.0:1746129568.822928:0:31521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7689 00000100:00100000:1.0:1746129568.822934:0:31521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+27:1962:x1830948734047232:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:1.0:1746129568.823115:0:31521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+27:1962:x1830948734047232:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 180us (1357us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746129568.823121:0:31521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7689 00002000:00100000:1.0:1746129568.823127:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3ee:0x0] (1716224->1720319) req@ffff880094f45c00 x1830948734047232/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:309/0 lens 488/4536 e 0 to 0 dl 1746129579 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129568.823133:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094f45c00 with x1830948734047232 ext(1716224->1720319) 00002000:00010000:1.0:1746129568.823136:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094f45c00 00000100:00100000:0.0:1746129568.830187:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129568.830346:0:22481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734047360 00000100:00100000:1.0:1746129568.830356:0:22481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734047360 00000100:00100000:1.0:1746129568.831386:0:22481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15987 00000100:00100000:1.0:1746129568.831399:0:22481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+27:32207:x1830948734047360:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:1.0:1746129568.831420:0:22481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129568.831440:0:22481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d94f400/0x40a459093b0696a3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20b85 expref: -99 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129568.831475:0:22481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009faa2400/0x40a459093b0694dc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20a90 expref: 36 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129568.831483:0:22481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f359400/0x40a459093b0695ed lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20b31 expref: 15 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129568.831488:0:22481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009faa2800/0x40a459093b0694e3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20a97 expref: 28 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129568.831495:0:22481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129568.831497:0:22481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129568.831501:0:22481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d94f400/0x40a459093b0696a3 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [2097152->2445311] (req 2097152->2445311) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20b85 expref: 28 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129568.832861:0:22481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009faa2800/0x40a459093b0694e3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20a97 expref: 28 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129568.832875:0:22481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009faa2800/0x40a459093b0694e3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20a97 expref: 28 pid: 7149 timeout: 924 lvb_type: 0 00000100:00100000:1.0:1746129568.832889:0:22481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135725c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:22481:1830948737484416:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129568.833010:0:22481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f359400/0x40a459093b0695ed lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20b31 expref: 15 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129568.833019:0:22481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f359400/0x40a459093b0695ed lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20b31 expref: 15 pid: 8410 timeout: 924 lvb_type: 1 00000100:00100000:1.0:1746129568.833323:0:22481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135727b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:22481:1830948737484544:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129568.833384:0:22481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009faa2400/0x40a459093b0694dc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20a90 expref: 36 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129568.833393:0:22481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009faa2400/0x40a459093b0694dc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20a90 expref: 36 pid: 7149 timeout: 924 lvb_type: 0 00000100:00100000:1.0:1746129568.833401:0:22481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135725880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:22481:1830948737484672:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129568.833416:0:22481:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a6dc80c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746129568.837277:0:22481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135725c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:22481:1830948737484416:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129568.837326:0:22481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135727b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:22481:1830948737484544:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129568.837345:0:22481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135725880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:22481:1830948737484672:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129568.837380:0:22481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d94f400/0x40a459093b0696a3 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [2097152->2445311] (req 2097152->2445311) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20b85 expref: 28 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129568.837400:0:22481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d94f400, rc 0) 00000100:00100000:1.0:1746129568.837457:0:22481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+28:32207:x1830948734047360:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 6060us (7282us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129568.837471:0:22481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15987 00000100:00100000:0.0:1746129568.840396:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129568.840452:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129568.840587:0:7086:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734047616 00000100:00100000:2.0:1746129568.840597:0:7086:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734047616 00000100:00100000:3.0:1746129568.840611:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734047488 00000100:00100000:3.0:1746129568.840615:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734047488 00010000:00010000:3.0:1746129568.840637:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f359400/0x40a459093b0695ed lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20b31 expref: 16 pid: 8410 timeout: 924 lvb_type: 1 00010000:00010000:2.0:1746129568.840637:0:7086:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009faa2400/0x40a459093b0694dc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20a90 expref: 37 pid: 7149 timeout: 924 lvb_type: 0 00000100:00100000:2.0:1746129568.840743:0:7086:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8181 00000100:00100000:3.0:1746129568.840805:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8182 00000100:00100000:2.0:1746129568.840809:0:7086:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f44380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ada2ffba-8920-4ecb-8068-68caa9806978+37:1962:x1830948734047616:12345-192.168.202.4@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746129568.840811:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f46d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:068dab75-d300-4ead-a742-d14572ad1e50+16:1962:x1830948734047488:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129568.840825:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129568.840825:0:7086:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129568.840847:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f359400/0x40a459093b0695ed lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20b31 expref: 16 pid: 8410 timeout: 924 lvb_type: 1 00010000:00010000:2.0:1746129568.840848:0:7086:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009faa2400/0x40a459093b0694dc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20a90 expref: 37 pid: 7149 timeout: 924 lvb_type: 0 00010000:00010000:2.0:1746129568.840859:0:7086:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009faa2400/0x40a459093b0694dc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20a90 expref: 37 pid: 7149 timeout: 924 lvb_type: 0 00010000:00010000:3.0:1746129568.840871:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f359400/0x40a459093b0695ed lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20b31 expref: 16 pid: 8410 timeout: 924 lvb_type: 1 00010000:00010000:2.0:1746129568.841008:0:7086:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009faa2400/0x40a459093b0694dc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20a90 expref: 37 pid: 7149 timeout: 924 lvb_type: 0 00010000:00010000:3.0:1746129568.841014:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f359400/0x40a459093b0695ed lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20b31 expref: 16 pid: 8410 timeout: 924 lvb_type: 1 00010000:00010000:2.0:1746129568.841041:0:7086:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129568.841139:0:7086:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f44380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ada2ffba-8920-4ecb-8068-68caa9806978+36:1962:x1830948734047616:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 288us (712us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129568.841147:0:7086:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8181 00010000:00010000:3.0:1746129568.841537:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129568.841772:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f46d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:068dab75-d300-4ead-a742-d14572ad1e50+15:1962:x1830948734047488:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 959us (1316us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129568.842141:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8182 00000100:00100000:0.0:1746129568.844414:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129568.845008:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734047744 00000100:00100000:3.0:1746129568.845018:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734047744 00010000:00010000:3.0:1746129568.845055:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009faa2800/0x40a459093b0694e3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20a97 expref: 28 pid: 7149 timeout: 924 lvb_type: 0 00000100:00100000:3.0:1746129568.845088:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8183 00000100:00100000:3.0:1746129568.845096:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f46300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+28:1962:x1830948734047744:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129568.845112:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129568.845137:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009faa2800/0x40a459093b0694e3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20a97 expref: 28 pid: 7149 timeout: 924 lvb_type: 0 00010000:00010000:3.0:1746129568.845149:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009faa2800/0x40a459093b0694e3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20a97 expref: 28 pid: 7149 timeout: 924 lvb_type: 0 00010000:00010000:3.0:1746129568.845171:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009faa2800/0x40a459093b0694e3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20a97 expref: 28 pid: 7149 timeout: 924 lvb_type: 0 00010000:00010000:3.0:1746129568.845187:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129568.845189:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129568.845195:0:7085:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d94f400/0x40a459093b0696a3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2445311) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20b85 expref: 27 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129568.845203:0:7085:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d94f400/0x40a459093b0696a3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2445311) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20b85 expref: 27 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129568.845238:0:7085:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012d94f400/0x40a459093b0696a3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2445311) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20b85 expref: 27 pid: 22481 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129568.845251:0:7085:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a07ac000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7085:1830948737484800:192.168.202.4@tcp:105: 00000100:00100000:3.0:1746129568.845370:0:7085:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c4e96c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129568.850414:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129568.850493:0:2271:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734048000 00000100:00100000:2.0:1746129568.850501:0:2271:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734048000 00000100:00100000:2.0:1746129568.850557:0:2271:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11179 00000100:00100000:2.0:1746129568.850564:0:2271:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ada2ffba-8920-4ecb-8068-68caa9806978+300:32213:x1830948734048000:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129568.850589:0:2271:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129568.850607:0:2271:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06b4a00/0x40a459093b0696aa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20b8c expref: -99 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129568.850721:0:2271:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06b4e00/0x40a459093b0696b1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129568.850735:0:2271:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06b4e00/0x40a459093b0696b1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129568.850746:0:2271:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06b4e00/0x40a459093b0696b1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129568.850758:0:2271:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06b4c00/0x40a459093b0696b8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129568.850763:0:2271:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06b4c00/0x40a459093b0696b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129568.850771:0:2271:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06b4c00/0x40a459093b0696b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129568.850877:0:2271:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06b5000/0x40a459093b0696bf lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129568.850885:0:2271:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06b5000/0x40a459093b0696bf lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129568.850890:0:2271:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06b5000/0x40a459093b0696bf lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00000004:00200000:2.0:1746129568.850899:0:2271:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:2.0:1746129568.850991:0:2271:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06b4e00/0x40a459093b0696b1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129568.850998:0:2271:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06b4e00/0x40a459093b0696b1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129568.851003:0:2271:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06b4e00/0x40a459093b0696b1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129568.851008:0:2271:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a06b4e00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746129568.851011:0:2271:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06b4e00/0x40a459093b0696b1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129568.851018:0:2271:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06b4e00/0x40a459093b0696b1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129568.851029:0:2271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880132ef8f00) 00010000:00010000:2.0:1746129568.851031:0:2271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129568.851036:0:2271:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06b4e00/0x40a459093b0696b1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129568.851044:0:2271:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06b4e00/0x40a459093b0696b1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 2271 initiator: MDT0 00000100:00100000:3.0:1746129568.851152:0:7085:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a07ac000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7085:1830948737484800:192.168.202.4@tcp:105: 00010000:00010000:3.0:1746129568.851170:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129568.851215:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f46300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+27:1962:x1830948734047744:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 6119us (6809us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129568.851224:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8183 00010000:00010000:2.0:1746129568.852745:0:2271:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06b4c00/0x40a459093b0696b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129568.852756:0:2271:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06b4c00/0x40a459093b0696b8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129568.852760:0:2271:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06b4c00/0x40a459093b0696b8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129568.852765:0:2271:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a06b4c00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746129568.852767:0:2271:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06b4c00/0x40a459093b0696b8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129568.852772:0:2271:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06b4c00/0x40a459093b0696b8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129568.852780:0:2271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f0e7e00) 00010000:00010000:2.0:1746129568.852782:0:2271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129568.852784:0:2271:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06b4c00/0x40a459093b0696b8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129568.852788:0:2271:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06b4c00/0x40a459093b0696b8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129568.852841:0:2271:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06b4a00/0x40a459093b0696aa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20b8c expref: 303 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129568.852852:0:2271:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06b5000/0x40a459093b0696bf lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20b8c expref: 302 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129568.852862:0:2271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:2.0:1746129568.852864:0:2271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746129568.852866:0:2271:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a06b5000, rc 0) 00000100:00100000:2.0:1746129568.853604:0:2271:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ada2ffba-8920-4ecb-8068-68caa9806978+302:32213:x1830948734048000:12345-192.168.202.4@tcp:101:cat.0 Request processed in 3035us (3195us total) trans 8589945267 rc 0/0 00000100:00100000:2.0:1746129568.853612:0:2271:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11179 00000100:00100000:0.0:1746129568.855938:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129568.856054:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129568.856143:0:20861:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734048256 00000100:00100000:2.0:1746129568.856153:0:20861:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734048256 00000100:00100000:2.0:1746129568.856200:0:20861:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4736 00000100:00100000:2.0:1746129568.856207:0:20861:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:ada2ffba-8920-4ecb-8068-68caa9806978+302:32213:x1830948734048256:12345-192.168.202.4@tcp:35:cat.0 00000100:00100000:3.0:1746129568.856472:0:31518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734048512 00000100:00100000:3.0:1746129568.856476:0:31518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734048512 00002000:00100000:3.0:1746129568.856506:0:31518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3ef:0x0] (2441216->2445311) req@ffff880094f45500 x1830948734048512/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:309/0 lens 488/0 e 0 to 0 dl 1746129579 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129568.856516:0:31518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094f45500 with x1830948734048512 ext(2441216->2445311) 00002000:00010000:3.0:1746129568.856522:0:31518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094f45500 00000100:00100000:3.0:1746129568.856537:0:31518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7690 00000100:00100000:3.0:1746129568.856542:0:31518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+27:1963:x1830948734048512:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:2.0:1746129568.857268:0:20861:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:ada2ffba-8920-4ecb-8068-68caa9806978+303:32213:x1830948734048256:12345-192.168.202.4@tcp:35:cat.0 Request processed in 1060us (1339us total) trans 8589945268 rc 0/0 00000100:00100000:2.0:1746129568.857276:0:20861:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4736 00000100:00100000:3.0:1746129568.857643:0:31518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+27:1963:x1830948734048512:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 1100us (1588us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129568.857650:0:31518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7690 00002000:00100000:3.0:1746129568.857655:0:31518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3ef:0x0] (2441216->2445311) req@ffff880094f45500 x1830948734048512/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:309/0 lens 488/4536 e 0 to 0 dl 1746129579 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129568.857664:0:31518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094f45500 with x1830948734048512 ext(2441216->2445311) 00002000:00010000:3.0:1746129568.857668:0:31518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094f45500 00000100:00100000:0.0:1746129568.861993:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129568.863235:0:14545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734048640 00000100:00100000:1.0:1746129568.863247:0:14545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734048640 00000100:00100000:1.0:1746129568.863378:0:14545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 217 00000100:00100000:1.0:1746129568.863388:0:14545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012db1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8b5f81a-2f18-4d7f-accf-308742f5a04f+15:1963:x1830948734048640:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:1.0:1746129568.863460:0:14545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012db1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8b5f81a-2f18-4d7f-accf-308742f5a04f+15:1963:x1830948734048640:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 74us (1478us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129568.863943:0:14545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 217 00000100:00100000:2.0:1746129568.864025:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129568.864089:0:22481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734048768 00000100:00100000:0.0:1746129568.864093:0:22481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734048768 00000100:00100000:0.0:1746129568.864690:0:22481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15988 00000100:00100000:0.0:1746129568.864699:0:22481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013575ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ada2ffba-8920-4ecb-8068-68caa9806978+36:1963:x1830948734048768:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129568.864979:0:22481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129568.865000:0:22481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d94ee00/0x40a459093b0696cd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20b93 expref: -99 pid: 22481 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129568.865582:0:22481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135725880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:22481:1830948737484928:192.168.202.4@tcp:106: 00000100:00100000:0.0:1746129568.866257:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129568.866455:0:22481:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a6dc8a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746129568.867003:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734048896 00000100:00100000:3.0:1746129568.867012:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734048896 00000100:00100000:3.0:1746129568.867139:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15989 00000100:00100000:3.0:1746129568.867200:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ada2ffba-8920-4ecb-8068-68caa9806978+38:1962:x1830948734048896:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129568.867421:0:4385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129568.867438:0:4385:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800915dd000/0x40a459093b0696d4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20b9a expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129568.867484:0:4385:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a07ac000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:4385:1830948737485056:192.168.202.4@tcp:106: 00000100:00100000:3.0:1746129568.868286:0:4385:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c4e9480 going to sleep for 11 seconds 00002000:00010000:1.0:1746129568.872175:0:22481:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb atime: 1746129568 -> 1746129569 00000100:00100000:1.0:1746129568.872209:0:22481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135725880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:22481:1830948737484928:192.168.202.4@tcp:106: 00010000:00010000:1.0:1746129568.872246:0:22481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d94ee00/0x40a459093b0696cd lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20b93 expref: 39 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129568.872263:0:22481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d94ee00/0x40a459093b0696cd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20b93 expref: 39 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129568.872291:0:22481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d94ee00, rc 0) 00000100:00100000:1.0:1746129568.873610:0:22481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013575ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ada2ffba-8920-4ecb-8068-68caa9806978+38:1963:x1830948734048768:12345-192.168.202.4@tcp:101:cat.0 Request processed in 8909us (9580us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129568.873625:0:22481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15988 00002000:00010000:3.0:1746129568.879794:0:4385:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb mtime: 1746129568 -> 1746129569 00002000:00010000:3.0:1746129568.879804:0:4385:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb atime: 1746129568 -> 1746129569 00002000:00010000:3.0:1746129568.879806:0:4385:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb ctime: 1746129568 -> 1746129569 00000100:00100000:3.0:1746129568.879836:0:4385:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a07ac000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:4385:1830948737485056:192.168.202.4@tcp:106: 00010000:00010000:3.0:1746129568.879873:0:4385:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800915dd000/0x40a459093b0696d4 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20b9a expref: 37 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129568.879888:0:4385:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800915dd000/0x40a459093b0696d4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20b9a expref: 37 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129568.879915:0:4385:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800915dd000, rc 0) 00000100:00100000:3.0:1746129568.879974:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ada2ffba-8920-4ecb-8068-68caa9806978+36:1962:x1830948734048896:12345-192.168.202.4@tcp:101:cat.0 Request processed in 12777us (13719us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129568.879984:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15989 00000100:00100000:0.0:1746129568.892402:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129568.892514:0:2271:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734049280 00000100:00100000:2.0:1746129568.892524:0:2271:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734049280 00000100:00100000:2.0:1746129568.892578:0:2271:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11180 00000100:00100000:2.0:1746129568.892584:0:2271:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ada2ffba-8920-4ecb-8068-68caa9806978+303:32216:x1830948734049280:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:2.0:1746129568.892610:0:2271:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129568.892627:0:2271:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06b5200/0x40a459093b0696db lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20ba1 expref: -99 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129568.892738:0:2271:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06b5c00/0x40a459093b0696e2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129568.892750:0:2271:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06b5c00/0x40a459093b0696e2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129568.892762:0:2271:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06b5c00/0x40a459093b0696e2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129568.892774:0:2271:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06b5400/0x40a459093b0696e9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129568.892778:0:2271:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06b5400/0x40a459093b0696e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129568.892782:0:2271:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06b5400/0x40a459093b0696e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129568.892877:0:2271:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06b5e00/0x40a459093b0696f0 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129568.892885:0:2271:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06b5e00/0x40a459093b0696f0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129568.892890:0:2271:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06b5e00/0x40a459093b0696f0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00000004:00200000:2.0:1746129568.892897:0:2271:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:2.0:1746129568.892972:0:2271:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06b5c00/0x40a459093b0696e2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129568.892978:0:2271:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06b5c00/0x40a459093b0696e2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129568.892982:0:2271:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06b5c00/0x40a459093b0696e2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129568.892987:0:2271:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a06b5c00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746129568.892991:0:2271:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06b5c00/0x40a459093b0696e2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129568.892999:0:2271:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06b5c00/0x40a459093b0696e2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129568.893009:0:2271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880132ef8f00) 00010000:00010000:2.0:1746129568.893012:0:2271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129568.893016:0:2271:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06b5c00/0x40a459093b0696e2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129568.893020:0:2271:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06b5c00/0x40a459093b0696e2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129568.893035:0:2271:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06b5400/0x40a459093b0696e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129568.893039:0:2271:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06b5400/0x40a459093b0696e9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129568.893044:0:2271:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06b5400/0x40a459093b0696e9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129568.893048:0:2271:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a06b5400 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746129568.893050:0:2271:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06b5400/0x40a459093b0696e9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129568.893055:0:2271:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06b5400/0x40a459093b0696e9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129568.893061:0:2271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f0e7100) 00010000:00010000:2.0:1746129568.893063:0:2271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129568.893064:0:2271:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06b5400/0x40a459093b0696e9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129568.893068:0:2271:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06b5400/0x40a459093b0696e9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129568.893103:0:2271:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06b5200/0x40a459093b0696db lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20ba1 expref: 306 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129568.893114:0:2271:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06b5e00/0x40a459093b0696f0 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20ba1 expref: 305 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129568.893119:0:2271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:2.0:1746129568.893121:0:2271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746129568.893123:0:2271:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a06b5e00, rc 0) 00000100:00100000:2.0:1746129568.893175:0:2271:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ada2ffba-8920-4ecb-8068-68caa9806978+305:32216:x1830948734049280:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 591us (785us total) trans 8589945269 rc 0/0 00000100:00100000:2.0:1746129568.893182:0:2271:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11180 00000100:00100000:0.0:1746129568.897064:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129568.897112:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129568.897392:0:31521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734049408 00000100:00100000:1.0:1746129568.897402:0:31521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734049408 00002000:00100000:1.0:1746129568.897454:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->1822719) req@ffff880094f47b80 x1830948734049408/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:309/0 lens 488/0 e 0 to 0 dl 1746129579 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129568.897465:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094f47b80 with x1830948734049408 ext(1048576->1822719) 00002000:00010000:1.0:1746129568.897472:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094f47b80 00000100:00100000:1.0:1746129568.897493:0:31521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734049536 00000100:00100000:1.0:1746129568.897496:0:31521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734049536 00002000:00100000:1.0:1746129568.897507:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f4:0x0] (1724416->2097151) req@ffff880094f46a00 x1830948734049536/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:309/0 lens 488/0 e 0 to 0 dl 1746129579 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129568.897513:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094f46a00 with x1830948734049536 ext(1724416->2097151) 00002000:00010000:1.0:1746129568.897516:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094f46a00 00000100:00100000:1.0:1746129568.897547:0:31521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7691 00000100:00100000:1.0:1746129568.897554:0:31521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ada2ffba-8920-4ecb-8068-68caa9806978+37:1961:x1830948734049408:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:2.0:1746129568.897591:0:8416:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7692 00000100:00100000:2.0:1746129568.897600:0:8416:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ada2ffba-8920-4ecb-8068-68caa9806978+37:1961:x1830948734049536:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129568.899278:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129568.899343:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734049792 00000100:00100000:3.0:1746129568.899350:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734049792 00000100:00100000:3.0:1746129568.899392:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 786 00000100:00100000:3.0:1746129568.899399:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f45f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ada2ffba-8920-4ecb-8068-68caa9806978+305:1961:x1830948734049792:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129568.899411:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129568.899435:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06b5e00/0x40a459093b0696f0 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20ba1 expref: 305 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129568.899475:0:7085:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:3.0:1746129568.899480:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129568.899593:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f45f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ada2ffba-8920-4ecb-8068-68caa9806978+304:1961:x1830948734049792:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 193us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129568.899599:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 786 00000100:00100000:1.0:1746129568.910422:0:31521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ada2ffba-8920-4ecb-8068-68caa9806978+38:1961:x1830948734049408:12345-192.168.202.4@tcp:3:cat.0 Request processed in 12853us (13355us total) trans 0 rc 774144/774144 00000100:00100000:1.0:1746129568.910434:0:31521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7691 00002000:00100000:1.0:1746129568.910448:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->1822719) req@ffff880094f47b80 x1830948734049408/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:309/0 lens 488/440 e 0 to 0 dl 1746129579 ref 1 fl Complete:/200/0 rc 774144/774144 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129568.910458:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094f47b80 with x1830948734049408 ext(1048576->1822719) 00002000:00010000:1.0:1746129568.910464:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094f47b80 00000100:00100000:0.0:1746129568.916446:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129568.916564:0:20861:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734050048 00000100:00100000:3.0:1746129568.916575:0:20861:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734050048 00000100:00100000:3.0:1746129568.916635:0:20861:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4737 00000100:00100000:3.0:1746129568.916644:0:20861:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092fd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:ada2ffba-8920-4ecb-8068-68caa9806978+304:32216:x1830948734050048:12345-192.168.202.4@tcp:35:multiop.0 00000100:00100000:2.0:1746129568.916751:0:8416:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ada2ffba-8920-4ecb-8068-68caa9806978+36:1961:x1830948734049536:12345-192.168.202.4@tcp:3:cat.0 Request processed in 19151us (19637us total) trans 0 rc 372736/372736 00000100:00100000:2.0:1746129568.916760:0:8416:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7692 00002000:00100000:2.0:1746129568.916769:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3f4:0x0] (1724416->2097151) req@ffff880094f46a00 x1830948734049536/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:309/0 lens 488/440 e 0 to 0 dl 1746129579 ref 1 fl Complete:/200/0 rc 372736/372736 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129568.916778:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094f46a00 with x1830948734049536 ext(1724416->2097151) 00002000:00010000:2.0:1746129568.916783:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094f46a00 00000100:00100000:3.0:1746129568.919559:0:20861:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092fd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:ada2ffba-8920-4ecb-8068-68caa9806978+305:32216:x1830948734050048:12345-192.168.202.4@tcp:35:multiop.0 Request processed in 2901us (3110us total) trans 8589945270 rc 0/0 00000100:00100000:3.0:1746129568.919572:0:20861:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4737 00000100:00100000:0.0:1746129568.926702:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129568.929087:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734050176 00000100:00100000:3.0:1746129568.929140:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734050176 00000100:00100000:3.0:1746129568.929213:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15990 00000100:00100000:3.0:1746129568.929222:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bf7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ada2ffba-8920-4ecb-8068-68caa9806978+36:32213:x1830948734050176:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129568.929243:0:4385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129568.929261:0:4385:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800915dc600/0x40a459093b0696fe lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20ba8 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129568.929291:0:4385:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d94fa00/0x40a459093b06969c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1716224->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20b7e expref: 26 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129568.929312:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129568.929314:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129568.929319:0:4385:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800915dc600/0x40a459093b0696fe lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20ba8 expref: 37 pid: 4385 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129568.929534:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00010000:00010000:3.0:1746129568.929608:0:4385:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d94fa00/0x40a459093b06969c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1716224->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20b7e expref: 26 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129568.929621:0:4385:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d94fa00/0x40a459093b06969c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1716224->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20b7e expref: 26 pid: 22481 timeout: 924 lvb_type: 0 00000100:00100000:3.0:1746129568.929633:0:4385:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a07ac000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:4385:1830948737485184:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129568.929723:0:4385:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c4e9480 going to sleep for 11 seconds 00000100:00100000:1.0:1746129568.929927:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734050432 00000100:00100000:1.0:1746129568.929932:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734050432 00000100:00100000:1.0:1746129568.929964:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11181 00000100:00100000:1.0:1746129568.929970:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092fd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+17:32220:x1830948734050432:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129568.929984:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129568.929996:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94e200/0x40a459093b069705 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20baf expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129568.930105:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94fe00/0x40a459093b06970c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129568.930116:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94fe00/0x40a459093b06970c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129568.930128:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94fe00/0x40a459093b06970c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129568.930140:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94e400/0x40a459093b069713 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129568.930145:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94e400/0x40a459093b069713 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129568.930150:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94e400/0x40a459093b069713 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129568.930255:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94ec00/0x40a459093b06971a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129568.930263:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94ec00/0x40a459093b06971a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129568.930268:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94ec00/0x40a459093b06971a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00200000:1.0:1746129568.930277:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:1.0:1746129568.930442:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94fe00/0x40a459093b06970c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129568.930450:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94fe00/0x40a459093b06970c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129568.930455:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94fe00/0x40a459093b06970c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129568.930460:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d94fe00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:1.0:1746129568.930464:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94fe00/0x40a459093b06970c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129568.930469:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94fe00/0x40a459093b06970c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129568.930479:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880132ef8f00) 00010000:00010000:1.0:1746129568.930481:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129568.930484:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94fe00/0x40a459093b06970c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129568.930489:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94fe00/0x40a459093b06970c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129568.930681:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94e400/0x40a459093b069713 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129568.930687:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94e400/0x40a459093b069713 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129568.930691:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94e400/0x40a459093b069713 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129568.930695:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d94e400 already unused, calling callback (ffffffffa136e690) 00010000:00010000:1.0:1746129568.930697:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94e400/0x40a459093b069713 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129568.930703:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94e400/0x40a459093b069713 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129568.930710:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009cffee00) 00010000:00010000:1.0:1746129568.930712:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129568.930714:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94e400/0x40a459093b069713 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129568.930719:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94e400/0x40a459093b069713 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129568.930754:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94e200/0x40a459093b069705 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20baf expref: 20 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129568.930763:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94ec00/0x40a459093b06971a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20baf expref: 19 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129568.930770:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:1.0:1746129568.930772:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746129568.930774:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d94ec00, rc 0) 00000100:00100000:1.0:1746129568.931042:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092fd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+19:32220:x1830948734050432:12345-192.168.202.4@tcp:101:cat.0 Request processed in 1071us (1508us total) trans 8589945271 rc 0/0 00000100:00100000:1.0:1746129568.931049:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11181 00000100:00100000:0.0:1746129568.933062:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129568.933160:0:20861:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734050688 00000100:00100000:2.0:1746129568.933169:0:20861:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734050688 00000100:00100000:3.0:1746129568.933184:0:4385:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a07ac000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:4385:1830948737485184:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129568.933216:0:4385:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800915dc600/0x40a459093b0696fe lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20ba8 expref: 37 pid: 4385 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129568.933231:0:20861:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4738 00010000:00010000:3.0:1746129568.933235:0:4385:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800915dc600, rc 0) 00000100:00100000:2.0:1746129568.933238:0:20861:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095f15050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+19:32220:x1830948734050688:12345-192.168.202.4@tcp:35:cat.0 00000100:00100000:3.0:1746129568.933284:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bf7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ada2ffba-8920-4ecb-8068-68caa9806978+37:32213:x1830948734050176:12345-192.168.202.4@tcp:101:cat.0 Request processed in 4063us (6593us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129568.933291:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15990 00000100:00100000:2.0:1746129568.933460:0:20861:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095f15050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:32220:x1830948734050688:12345-192.168.202.4@tcp:35:cat.0 Request processed in 222us (409us total) trans 8589945272 rc 0/0 00000100:00100000:2.0:1746129568.933465:0:20861:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4738 00000100:00100000:0.0:1746129568.934110:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129568.934530:0:8416:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734050816 00000100:00100000:2.0:1746129568.934535:0:8416:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734050816 00002000:00100000:2.0:1746129568.934570:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3ee:0x0] (1716224->2097151) req@ffff880092fd0a80 x1830948734050816/t0(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:309/0 lens 488/0 e 0 to 0 dl 1746129579 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129568.934580:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092fd0a80 with x1830948734050816 ext(1716224->2097151) 00010000:00010000:2.0:1746129568.934588:0:8416:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012d94fa00/0x40a459093b06969c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1716224->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20b7e expref: 27 pid: 22481 timeout: 924 lvb_type: 0 00010000:00010000:2.0:1746129568.934601:0:8416:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012d94fa00/0x40a459093b06969c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1716224->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20b7e expref: 27 pid: 22481 timeout: 924 lvb_type: 0 00002000:00010000:2.0:1746129568.934608:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092fd0a80 00000100:00100000:2.0:1746129568.934923:0:8416:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2398 00000100:00100000:2.0:1746129568.934930:0:8416:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092fd0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+27:1962:x1830948734050816:12345-192.168.202.4@tcp:4:multiop.0 00000100:00100000:0.0:1746129568.936201:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129568.936270:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129568.937015:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129568.937112:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734050944 00000100:00100000:3.0:1746129568.937121:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734050944 00000100:00100000:3.0:1746129568.937177:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734051072 00000100:00100000:3.0:1746129568.937179:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734051072 00000100:00100000:3.0:1746129568.937192:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734051200 00000100:00100000:3.0:1746129568.937194:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734051200 00000100:00100000:2.0:1746129568.937201:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15991 00000100:00100000:2.0:1746129568.937210:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092fd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:1960:x1830948734050944:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129568.937229:0:7149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129568.937249:0:7149:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a06b5600/0x40a459093b069728 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20bb6 expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129568.937315:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013575ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7149:1830948737485312:192.168.202.4@tcp:106: 00000100:00100000:3.0:1746129568.937401:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15992 00000100:00100000:3.0:1746129568.937408:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092fd1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+22:1960:x1830948734051072:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129568.937417:0:4385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129568.937425:0:4385:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800915dd400/0x40a459093b06972f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20bbd expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129568.937448:0:4385:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a07ac000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:4385:1830948737485440:192.168.202.4@tcp:106: 00000100:00100000:3.0:1746129568.937502:0:4385:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c4e9480 going to sleep for 11 seconds 00000100:00100000:3.0:1746129568.937520:0:22480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15993 00000100:00100000:3.0:1746129568.937525:0:22480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092fd1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+29:1960:x1830948734051200:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129568.937531:0:22480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129568.937541:0:22480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800915dda00/0x40a459093b069736 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20bc4 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129568.937561:0:22480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a07ad500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22480:1830948737485568:192.168.202.4@tcp:106: 00000100:00100000:3.0:1746129568.937577:0:22480:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c4e9b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746129568.937635:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0ac600 going to sleep for 11 seconds 00002000:00010000:2.0:1746129568.940887:0:4385:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb atime: 1746129568 -> 1746129569 00000100:00100000:2.0:1746129568.940921:0:4385:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a07ac000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:4385:1830948737485440:192.168.202.4@tcp:106: 00010000:00010000:2.0:1746129568.940956:0:4385:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800915dd400/0x40a459093b06972f lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20bbd expref: 23 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129568.940971:0:4385:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800915dd400/0x40a459093b06972f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20bbd expref: 23 pid: 4385 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746129568.940982:0:22480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a07ad500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22480:1830948737485568:192.168.202.4@tcp:106: 00010000:00010000:2.0:1746129568.940996:0:4385:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800915dd400, rc 0) 00010000:00010000:3.0:1746129568.941001:0:22480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800915dda00/0x40a459093b069736 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20bc4 expref: 30 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129568.941011:0:22480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800915dda00/0x40a459093b069736 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20bc4 expref: 30 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129568.941023:0:22480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800915dda00, rc 0) 00000100:00100000:2.0:1746129568.941502:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092fd1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+22:1960:x1830948734051072:12345-192.168.202.4@tcp:101:cat.0 Request processed in 4093us (5229us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129568.941513:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15992 00000100:00100000:3.0:1746129568.941549:0:22480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092fd1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+29:1960:x1830948734051200:12345-192.168.202.4@tcp:101:cat.0 Request processed in 4022us (4533us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129568.941555:0:22480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15993 00002000:00010000:2.0:1746129568.941562:0:7149:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb mtime: 1746129568 -> 1746129569 00002000:00010000:2.0:1746129568.941564:0:7149:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb atime: 1746129568 -> 1746129569 00002000:00010000:2.0:1746129568.941566:0:7149:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb ctime: 1746129568 -> 1746129569 00000100:00100000:2.0:1746129568.941576:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013575ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7149:1830948737485312:192.168.202.4@tcp:106: 00010000:00010000:2.0:1746129568.941593:0:7149:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a06b5600/0x40a459093b069728 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20bb6 expref: 21 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129568.941603:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a06b5600/0x40a459093b069728 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20bb6 expref: 21 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129568.941611:0:7149:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a06b5600, rc 0) 00000100:00100000:2.0:1746129568.941627:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092fd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:1960:x1830948734050944:12345-192.168.202.4@tcp:101:cat.0 Request processed in 4419us (5431us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129568.941633:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15991 00000100:00100000:3.0:1746129568.942870:0:8416:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092fd0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+29:1962:x1830948734050816:12345-192.168.202.4@tcp:4:multiop.0 Request processed in 7933us (8754us total) trans 21474841327 rc 0/0 00000100:00100000:3.0:1746129568.942879:0:8416:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2398 00002000:00100000:3.0:1746129568.942889:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3ee:0x0] (1716224->2097151) req@ffff880092fd0a80 x1830948734050816/t21474841327(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:309/0 lens 488/448 e 0 to 0 dl 1746129579 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129568.942897:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092fd0a80 with x1830948734050816 ext(1716224->2097151) 00010000:00010000:3.0:1746129568.942905:0:8416:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012d94fa00/0x40a459093b06969c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1716224->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20b7e expref: 29 pid: 22481 timeout: 924 lvb_type: 0 00010000:00010000:3.0:1746129568.942918:0:8416:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012d94fa00/0x40a459093b06969c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1716224->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20b7e expref: 29 pid: 22481 timeout: 924 lvb_type: 0 00002000:00010000:3.0:1746129568.942923:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092fd0a80 00000100:00100000:0.0:1746129568.945277:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129568.946246:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734051328 00000100:00100000:3.0:1746129568.946257:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734051328 00010000:00010000:3.0:1746129568.946316:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d94fa00/0x40a459093b06969c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1716224->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20b7e expref: 29 pid: 22481 timeout: 924 lvb_type: 0 00000100:00100000:3.0:1746129568.946368:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8184 00000100:00100000:3.0:1746129568.946376:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092fd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+29:1963:x1830948734051328:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129568.946391:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129568.946417:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d94fa00/0x40a459093b06969c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1716224->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20b7e expref: 29 pid: 22481 timeout: 924 lvb_type: 0 00010000:00010000:3.0:1746129568.946430:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d94fa00/0x40a459093b06969c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1716224->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20b7e expref: 29 pid: 22481 timeout: 924 lvb_type: 0 00010000:00010000:3.0:1746129568.946460:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d94fa00/0x40a459093b06969c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1716224->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20b7e expref: 29 pid: 22481 timeout: 924 lvb_type: 0 00010000:00010000:3.0:1746129568.946476:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129568.946478:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129568.946485:0:7085:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800915dc600/0x40a459093b0696fe lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20ba8 expref: 36 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129568.946493:0:7085:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800915dc600/0x40a459093b0696fe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20ba8 expref: 36 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129568.946528:0:7085:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800915dc600/0x40a459093b0696fe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20ba8 expref: 36 pid: 4385 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129568.946540:0:7085:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a07ad500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7085:1830948737485696:192.168.202.4@tcp:105: 00000100:00100000:3.0:1746129568.947243:0:7085:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c4e9b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746129568.948880:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129568.950451:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734051456 00000100:00100000:2.0:1746129568.950463:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734051456 00000100:00100000:2.0:1746129568.950566:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15994 00000100:00100000:2.0:1746129568.950576:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092fd2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:32220:x1830948734051456:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129568.950598:0:7149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129568.950617:0:7149:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a06b5c00/0x40a459093b06973d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20bcb expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129568.950652:0:7149:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d94f200/0x40a459093b069679 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1822720->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20b69 expref: 35 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129568.950660:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129568.950662:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129568.950666:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a06b5c00/0x40a459093b06973d lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20bcb expref: 21 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129568.950699:0:7149:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d94f200/0x40a459093b069679 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1822720->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20b69 expref: 35 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129568.950712:0:7149:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d94f200/0x40a459093b069679 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1822720->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20b69 expref: 35 pid: 22481 timeout: 924 lvb_type: 0 00000100:00100000:2.0:1746129568.950723:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013575ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7149:1830948737485824:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129568.950793:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0ac600 going to sleep for 11 seconds 00000100:00100000:3.0:1746129568.952456:0:7085:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a07ad500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7085:1830948737485696:192.168.202.4@tcp:105: 00010000:00010000:3.0:1746129568.952474:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129568.952522:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092fd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+28:1963:x1830948734051328:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 6147us (7254us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129568.952532:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8184 00000100:00100000:1.0:1746129568.952906:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129568.953675:0:8416:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734051712 00000100:00100000:3.0:1746129568.953684:0:8416:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734051712 00002000:00100000:3.0:1746129568.953726:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3ee:0x0] (1048576->2097151) req@ffff880135725880 x1830948734051712/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:309/0 lens 488/0 e 0 to 0 dl 1746129579 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129568.953742:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135725880 with x1830948734051712 ext(1048576->2097151) 00002000:00010000:3.0:1746129568.953747:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135725880 00000100:00100000:3.0:1746129568.954482:0:8416:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7693 00000100:00100000:3.0:1746129568.954492:0:8416:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135725880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ada2ffba-8920-4ecb-8068-68caa9806978+37:1963:x1830948734051712:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:0.0:1746129568.956681:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129568.956833:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013575ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7149:1830948737485824:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129568.956867:0:7149:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a06b5c00/0x40a459093b06973d lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20bcb expref: 21 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129568.956889:0:7149:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a06b5c00, rc 0) 00000100:00100000:1.0:1746129568.957255:0:31521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734051840 00000100:00100000:1.0:1746129568.957264:0:31521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734051840 00000100:00100000:2.0:1746129568.957318:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092fd2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:32220:x1830948734051456:12345-192.168.202.4@tcp:101:cat.0 Request processed in 6743us (8447us total) trans 0 rc 0/0 00002000:00100000:1.0:1746129568.957322:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f3:0x0] (1822720->2097151) req@ffff880092fd2680 x1830948734051840/t0(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:309/0 lens 488/0 e 0 to 0 dl 1746129579 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:2.0:1746129568.957327:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15994 00002000:00100000:1.0:1746129568.957339:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092fd2680 with x1830948734051840 ext(1822720->2097151) 00010000:00010000:1.0:1746129568.957348:0:31521:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012d94f200/0x40a459093b069679 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1822720->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20b69 expref: 36 pid: 22481 timeout: 924 lvb_type: 0 00010000:00010000:1.0:1746129568.957360:0:31521:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012d94f200/0x40a459093b069679 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1822720->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20b69 expref: 36 pid: 22481 timeout: 924 lvb_type: 0 00002000:00010000:1.0:1746129568.957367:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092fd2680 00000100:00100000:1.0:1746129568.957383:0:31521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2399 00000100:00100000:1.0:1746129568.957390:0:31521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092fd2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ada2ffba-8920-4ecb-8068-68caa9806978+36:1962:x1830948734051840:12345-192.168.202.4@tcp:4:multiop.0 00000100:00100000:1.0:1746129568.969552:0:31521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092fd2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ada2ffba-8920-4ecb-8068-68caa9806978+38:1962:x1830948734051840:12345-192.168.202.4@tcp:4:multiop.0 Request processed in 12147us (12862us total) trans 17179874083 rc 0/0 00000100:00100000:1.0:1746129568.969565:0:31521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2399 00002000:00100000:1.0:1746129568.969577:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f3:0x0] (1822720->2097151) req@ffff880092fd2680 x1830948734051840/t17179874083(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:309/0 lens 488/448 e 0 to 0 dl 1746129579 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129568.969587:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092fd2680 with x1830948734051840 ext(1822720->2097151) 00010000:00010000:1.0:1746129568.969598:0:31521:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012d94f200/0x40a459093b069679 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1822720->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20b69 expref: 38 pid: 22481 timeout: 924 lvb_type: 0 00010000:00010000:1.0:1746129568.969615:0:31521:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012d94f200/0x40a459093b069679 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1822720->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20b69 expref: 38 pid: 22481 timeout: 924 lvb_type: 0 00002000:00010000:1.0:1746129568.969622:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092fd2680 00000100:00100000:3.0:1746129568.970656:0:8416:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135725880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ada2ffba-8920-4ecb-8068-68caa9806978+37:1963:x1830948734051712:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 16162us (17747us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129568.970665:0:8416:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7693 00002000:00100000:3.0:1746129568.970672:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3ee:0x0] (1048576->2097151) req@ffff880135725880 x1830948734051712/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:309/0 lens 488/440 e 0 to 0 dl 1746129579 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129568.970681:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135725880 with x1830948734051712 ext(1048576->2097151) 00002000:00010000:3.0:1746129568.970686:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135725880 00000100:00100000:0.0:1746129568.976365:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129568.977349:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734051968 00000100:00100000:3.0:1746129568.977361:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734051968 00010000:00010000:3.0:1746129568.977406:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d94f200/0x40a459093b069679 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1822720->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20b69 expref: 38 pid: 22481 timeout: 924 lvb_type: 0 00000100:00100000:3.0:1746129568.977440:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8185 00000100:00100000:3.0:1746129568.977446:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bbc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ada2ffba-8920-4ecb-8068-68caa9806978+38:1962:x1830948734051968:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129568.977462:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129568.977484:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d94f200/0x40a459093b069679 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1822720->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20b69 expref: 38 pid: 22481 timeout: 924 lvb_type: 0 00010000:00010000:3.0:1746129568.977496:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d94f200/0x40a459093b069679 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1822720->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20b69 expref: 38 pid: 22481 timeout: 924 lvb_type: 0 00010000:00010000:3.0:1746129568.977521:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d94f200/0x40a459093b069679 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1822720->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20b69 expref: 38 pid: 22481 timeout: 924 lvb_type: 0 00010000:00010000:3.0:1746129568.977556:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129568.977558:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129568.977566:0:7085:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a06b5c00/0x40a459093b06973d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20bcb expref: 20 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129568.977574:0:7085:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a06b5c00/0x40a459093b06973d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20bcb expref: 20 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129568.977609:0:7085:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a06b5c00/0x40a459093b06973d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20bcb expref: 20 pid: 7149 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129568.978108:0:7085:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a07ad500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7085:1830948737485952:192.168.202.4@tcp:105: 00000100:00100000:3.0:1746129568.978199:0:7085:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c4e9b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746129568.980964:0:7085:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a07ad500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7085:1830948737485952:192.168.202.4@tcp:105: 00010000:00010000:3.0:1746129568.980991:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129568.981109:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bbc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ada2ffba-8920-4ecb-8068-68caa9806978+37:1962:x1830948734051968:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 3660us (4828us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129568.981121:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8185 00000100:00100000:0.0:1746129568.995530:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129568.995888:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129568.996222:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734052096 00000100:00100000:3.0:1746129568.996234:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734052096 00000100:00100000:3.0:1746129568.996284:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15995 00000100:00100000:3.0:1746129568.996323:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092fd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ada2ffba-8920-4ecb-8068-68caa9806978+37:32213:x1830948734052096:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129568.996356:0:7149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129568.996374:0:7149:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800915ddc00/0x40a459093b069744 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20bd2 expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129568.996406:0:7149:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d94f400/0x40a459093b0696a3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2445311) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20b85 expref: 27 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129568.996414:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129568.996416:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129568.996419:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800915ddc00/0x40a459093b069744 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20bd2 expref: 38 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129568.996452:0:7149:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d94f400/0x40a459093b0696a3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2445311) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20b85 expref: 27 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129568.996464:0:7149:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d94f400/0x40a459093b0696a3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2445311) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20b85 expref: 27 pid: 22481 timeout: 924 lvb_type: 0 00000100:00100000:3.0:1746129568.996477:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a07ad500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7149:1830948737486080:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129568.996556:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734052352 00000100:00100000:3.0:1746129568.996559:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c4e9840 going to sleep for 11 seconds 00000100:00100000:1.0:1746129568.996561:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734052352 00000100:00100000:1.0:1746129568.996591:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11182 00000100:00100000:1.0:1746129568.996597:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013575ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:32222:x1830948734052352:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:1.0:1746129568.996613:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129568.996625:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94f200/0x40a459093b06974b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20bd9 expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129568.996647:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00010000:00010000:1.0:1746129568.996728:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94fa00/0x40a459093b069752 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129568.996740:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94fa00/0x40a459093b069752 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129568.996751:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94fa00/0x40a459093b069752 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129568.996762:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94f000/0x40a459093b069759 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129568.996767:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94f000/0x40a459093b069759 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129568.996773:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94f000/0x40a459093b069759 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129568.996868:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94e800/0x40a459093b069760 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129568.996876:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94e800/0x40a459093b069760 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129568.996881:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94e800/0x40a459093b069760 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00200000:1.0:1746129568.996890:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:1.0:1746129568.996963:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94fa00/0x40a459093b069752 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129568.996974:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94fa00/0x40a459093b069752 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129568.996979:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94fa00/0x40a459093b069752 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129568.996984:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d94fa00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:1.0:1746129568.996988:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94fa00/0x40a459093b069752 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00000100:00100000:3.0:1746129568.996990:0:8416:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734052608 00010000:00010000:1.0:1746129568.996993:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94fa00/0x40a459093b069752 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00000100:00100000:3.0:1746129568.996994:0:8416:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734052608 00010000:00010000:1.0:1746129568.997002:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880132ef8f00) 00010000:00010000:1.0:1746129568.997005:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129568.997008:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94fa00/0x40a459093b069752 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129568.997012:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94fa00/0x40a459093b069752 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00002000:00100000:3.0:1746129568.997020:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff880092fd2d80 x1830948734052608/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:309/0 lens 488/0 e 0 to 0 dl 1746129579 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129568.997029:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092fd2d80 with x1830948734052608 ext(1048576->2097151) 00002000:00010000:3.0:1746129568.997033:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092fd2d80 00010000:00010000:1.0:1746129568.997039:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94f000/0x40a459093b069759 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129568.997044:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94f000/0x40a459093b069759 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00000100:00100000:3.0:1746129568.997047:0:8416:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7694 00010000:00010000:1.0:1746129568.997048:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94f000/0x40a459093b069759 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129568.997052:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d94f000 already unused, calling callback (ffffffffa136e690) 00000100:00100000:3.0:1746129568.997053:0:8416:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092fd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:1960:x1830948734052608:12345-192.168.202.4@tcp:3:cat.0 00010000:00010000:1.0:1746129568.997053:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94f000/0x40a459093b069759 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129568.997061:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94f000/0x40a459093b069759 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129568.997068:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009cffeb00) 00010000:00010000:1.0:1746129568.997070:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129568.997072:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94f000/0x40a459093b069759 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129568.997077:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94f000/0x40a459093b069759 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129568.997110:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94f200/0x40a459093b06974b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20bd9 expref: 23 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129568.997119:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94e800/0x40a459093b069760 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20bd9 expref: 22 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129568.997126:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:1.0:1746129568.997127:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746129568.997130:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d94e800, rc 0) 00000100:00100000:1.0:1746129568.997157:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013575ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+22:32222:x1830948734052352:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 560us (1270us total) trans 8589945273 rc 0/0 00000100:00100000:1.0:1746129568.997163:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11182 00000100:00100000:2.0:1746129569.000533:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a07ad500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7149:1830948737486080:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129569.000565:0:7149:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800915ddc00/0x40a459093b069744 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20bd2 expref: 38 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129569.000583:0:7149:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800915ddc00, rc 0) 00000100:00100000:2.0:1746129569.000640:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092fd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ada2ffba-8920-4ecb-8068-68caa9806978+38:32213:x1830948734052096:12345-192.168.202.4@tcp:101:cat.0 Request processed in 4348us (5120us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129569.000648:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15995 00000100:00100000:0.0:1746129569.003114:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129569.003275:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734052864 00000100:00100000:3.0:1746129569.003287:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734052864 00000100:00100000:3.0:1746129569.003930:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 787 00000100:00100000:3.0:1746129569.003940:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092fd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+22:1963:x1830948734052864:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129569.003957:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129569.003984:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94e800/0x40a459093b069760 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20bd9 expref: 22 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129569.004943:0:7085:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:3.0:1746129569.004950:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129569.005019:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092fd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:1963:x1830948734052864:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 1079us (1916us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129569.005028:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 787 00000100:00100000:3.0:1746129569.006035:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129569.006075:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129569.006802:0:31521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734052736 00000100:00100000:0.0:1746129569.006814:0:31521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734052736 00002000:00100000:0.0:1746129569.006870:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3ef:0x0] (2097152->2445311) req@ffff8800a07aca80 x1830948734052736/t0(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:310/0 lens 488/0 e 0 to 0 dl 1746129580 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129569.006881:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a07aca80 with x1830948734052736 ext(2097152->2445311) 00010000:00010000:0.0:1746129569.006890:0:31521:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012d94f400/0x40a459093b0696a3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2445311) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20b85 expref: 28 pid: 22481 timeout: 924 lvb_type: 0 00010000:00010000:0.0:1746129569.006904:0:31521:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012d94f400/0x40a459093b0696a3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2445311) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20b85 expref: 28 pid: 22481 timeout: 924 lvb_type: 0 00002000:00010000:0.0:1746129569.006911:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a07aca80 00000100:00100000:0.0:1746129569.006934:0:31519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2400 00000100:00100000:0.0:1746129569.006941:0:31519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a07aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+28:1962:x1830948734052736:12345-192.168.202.4@tcp:4:cat.0 00000100:00100000:1.0:1746129569.007327:0:16680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734053120 00000100:00100000:1.0:1746129569.007340:0:16680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734053120 00000100:00100000:1.0:1746129569.007383:0:16680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4739 00000100:00100000:1.0:1746129569.007389:0:16680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a07ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:32222:x1830948734053120:12345-192.168.202.4@tcp:35:multiop.0 00000100:00100000:1.0:1746129569.007601:0:16680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a07ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+22:32222:x1830948734053120:12345-192.168.202.4@tcp:35:multiop.0 Request processed in 210us (1523us total) trans 8589945274 rc 0/0 00000100:00100000:1.0:1746129569.007608:0:16680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4739 00000100:00080000:1.0:1746129569.007627:0:7097:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1746129569.008640:0:8416:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092fd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:1960:x1830948734052608:12345-192.168.202.4@tcp:3:cat.0 Request processed in 11583us (11990us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129569.008648:0:8416:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7694 00002000:00100000:3.0:1746129569.008656:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff880092fd2d80 x1830948734052608/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:309/0 lens 488/440 e 0 to 0 dl 1746129579 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129569.008664:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092fd2d80 with x1830948734052608 ext(1048576->2097151) 00002000:00010000:3.0:1746129569.008668:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092fd2d80 00000100:00100000:0.0:1746129569.016991:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129569.017066:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734053248 00000100:00100000:3.0:1746129569.017076:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734053248 00000100:00100000:3.0:1746129569.017121:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15996 00000100:00100000:3.0:1746129569.017129:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092fd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:32220:x1830948734053248:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129569.017161:0:7149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129569.017179:0:7149:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800915dc800/0x40a459093b06976e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20be0 expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129569.017212:0:7149:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d94f600/0x40a459093b069695 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1724415) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20b77 expref: 36 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129569.017220:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129569.017222:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129569.017226:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800915dc800/0x40a459093b06976e lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20be0 expref: 22 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129569.017266:0:7149:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d94f600/0x40a459093b069695 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1724415) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20b77 expref: 36 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129569.017276:0:7149:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d94f600/0x40a459093b069695 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1724415) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20b77 expref: 36 pid: 22481 timeout: 924 lvb_type: 0 00000100:00100000:3.0:1746129569.017289:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a07ac000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7149:1830948737486208:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129569.020567:0:31519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a07aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+30:1962:x1830948734052736:12345-192.168.202.4@tcp:4:cat.0 Request processed in 13613us (14520us total) trans 21474841328 rc 0/0 00000100:00100000:0.0:1746129569.020581:0:31519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2400 00002000:00100000:0.0:1746129569.020593:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3ef:0x0] (2097152->2445311) req@ffff8800a07aca80 x1830948734052736/t21474841328(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:310/0 lens 488/448 e 0 to 0 dl 1746129580 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129569.020607:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a07aca80 with x1830948734052736 ext(2097152->2445311) 00010000:00010000:0.0:1746129569.020618:0:31519:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012d94f400/0x40a459093b0696a3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2445311) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20b85 expref: 30 pid: 22481 timeout: 924 lvb_type: 0 00010000:00010000:0.0:1746129569.020633:0:31519:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012d94f400/0x40a459093b0696a3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2445311) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20b85 expref: 30 pid: 22481 timeout: 924 lvb_type: 0 00002000:00010000:0.0:1746129569.020641:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a07aca80 00000100:00100000:3.0:1746129569.020788:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c4e9480 going to sleep for 11 seconds 00000100:00100000:1.0:1746129569.025577:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129569.025605:0:22480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734053376 00000100:00100000:0.0:1746129569.025615:0:22480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734053376 00000100:00100000:3.0:1746129569.025746:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a07ac000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7149:1830948737486208:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129569.025778:0:7149:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800915dc800/0x40a459093b06976e lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20be0 expref: 23 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129569.025798:0:7149:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800915dc800, rc 0) 00000100:00100000:3.0:1746129569.025853:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092fd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+23:32220:x1830948734053248:12345-192.168.202.4@tcp:101:cat.0 Request processed in 8724us (8873us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129569.026127:0:22480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15997 00000100:00100000:0.0:1746129569.026136:0:22480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135727b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+23:32222:x1830948734053376:12345-192.168.202.4@tcp:101:multiop.0 00000100:00100000:1.0:1746129569.026137:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00010000:00010000:0.0:1746129569.026154:0:22480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129569.026169:0:22480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f2fe600/0x40a459093b069775 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20be7 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129569.026193:0:22480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a06b5c00/0x40a459093b06973d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20bcb expref: 24 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129569.026200:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746129569.026240:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129569.026259:0:31519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734053632 00000100:00100000:1.0:1746129569.026263:0:31519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734053632 00002000:00100000:1.0:1746129569.026322:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f4:0x0] (1048576->1724415) req@ffff880135726680 x1830948734053632/t0(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:310/0 lens 488/0 e 0 to 0 dl 1746129580 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129569.026340:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135726680 with x1830948734053632 ext(1048576->1724415) 00010000:00010000:1.0:1746129569.026347:0:31519:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012d94f600/0x40a459093b069695 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1724415) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20b77 expref: 37 pid: 22481 timeout: 924 lvb_type: 0 00010000:00010000:1.0:1746129569.026357:0:31519:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012d94f600/0x40a459093b069695 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1724415) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20b77 expref: 37 pid: 22481 timeout: 924 lvb_type: 0 00002000:00010000:1.0:1746129569.026363:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880135726680 00000100:00100000:1.0:1746129569.026380:0:31519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2401 00000100:00100000:1.0:1746129569.026386:0:31519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135726680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ada2ffba-8920-4ecb-8068-68caa9806978+37:1963:x1830948734053632:12345-192.168.202.4@tcp:4:cat.0 00010000:00010000:0.0:1746129569.026805:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129569.026811:0:22480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f2fe600/0x40a459093b069775 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1159168->1388543] (req 1159168->1388543) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20be7 expref: 24 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129569.026845:0:22480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a06b5c00/0x40a459093b06973d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20bcb expref: 24 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129569.026861:0:22480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a06b5c00/0x40a459093b06973d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20bcb expref: 24 pid: 7149 timeout: 924 lvb_type: 0 00000100:00100000:0.0:1746129569.026873:0:22480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092fd0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22480:1830948737486336:192.168.202.4@tcp:104: 00000100:00080000:1.0:1746129569.026946:0:7097:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746129569.026994:0:22480:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5de8900 going to sleep for 11 seconds 00000100:00100000:0.0:1746129569.027013:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734053504 00000100:00100000:0.0:1746129569.027016:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734053504 00010000:00010000:0.0:1746129569.027033:0:9823:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d94f400/0x40a459093b0696a3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2445311) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20b85 expref: 30 pid: 22481 timeout: 924 lvb_type: 0 00000100:00100000:0.0:1746129569.027052:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8186 00000100:00100000:0.0:1746129569.027056:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135725c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+30:1961:x1830948734053504:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129569.027064:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129569.027085:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d94f400/0x40a459093b0696a3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2445311) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20b85 expref: 30 pid: 22481 timeout: 924 lvb_type: 0 00010000:00010000:0.0:1746129569.027094:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d94f400/0x40a459093b0696a3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2445311) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20b85 expref: 30 pid: 22481 timeout: 924 lvb_type: 0 00000100:00100000:3.0:1746129569.027112:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15996 00010000:00010000:0.0:1746129569.027112:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d94f400/0x40a459093b0696a3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2445311) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20b85 expref: 30 pid: 22481 timeout: 924 lvb_type: 0 00010000:00010000:0.0:1746129569.027137:0:9823:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129569.027139:0:9823:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129569.027145:0:9823:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800915ddc00/0x40a459093b069744 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20bd2 expref: 37 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129569.027153:0:9823:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800915ddc00/0x40a459093b069744 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20bd2 expref: 37 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129569.027173:0:9823:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800915ddc00/0x40a459093b069744 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20bd2 expref: 37 pid: 7149 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129569.027182:0:9823:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092fd1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9823:1830948737486464:192.168.202.4@tcp:105: 00000100:00100000:0.0:1746129569.027204:0:9823:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5de8cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129569.035363:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129569.035436:0:22480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092fd0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22480:1830948737486336:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129569.035436:0:9823:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092fd1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9823:1830948737486464:192.168.202.4@tcp:105: 00010000:00010000:0.0:1746129569.035455:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746129569.035463:0:22480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f2fe600/0x40a459093b069775 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1159168->1388543] (req 1159168->1388543) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20be7 expref: 23 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129569.035481:0:22480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f2fe600, rc 0) 00000100:00100000:0.0:1746129569.035494:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135725c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+29:1961:x1830948734053504:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 8437us (9357us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129569.035499:0:22480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135727b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+23:32222:x1830948734053376:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 9366us (9934us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129569.035505:0:22480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15997 00000100:00100000:0.0:1746129569.035505:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8186 00000100:00100000:0.0:1746129569.035532:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734053760 00000100:00100000:0.0:1746129569.035538:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734053760 00010000:00010000:0.0:1746129569.035559:0:9823:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a06b5c00/0x40a459093b06973d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20bcb expref: 23 pid: 7149 timeout: 924 lvb_type: 0 00000100:00100000:0.0:1746129569.035588:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8187 00000100:00100000:0.0:1746129569.035595:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092fd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+23:1963:x1830948734053760:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129569.035607:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129569.035628:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a06b5c00/0x40a459093b06973d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20bcb expref: 23 pid: 7149 timeout: 924 lvb_type: 0 00010000:00010000:0.0:1746129569.035642:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a06b5c00/0x40a459093b06973d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20bcb expref: 23 pid: 7149 timeout: 924 lvb_type: 0 00010000:00010000:0.0:1746129569.035664:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a06b5c00/0x40a459093b06973d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20bcb expref: 23 pid: 7149 timeout: 924 lvb_type: 0 00010000:00010000:0.0:1746129569.035690:0:9823:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129569.035693:0:9823:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129569.035700:0:9823:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f2fe600/0x40a459093b069775 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1159168->1388543) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20be7 expref: 22 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129569.035708:0:9823:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f2fe600/0x40a459093b069775 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1159168->1388543) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20be7 expref: 22 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129569.035735:0:9823:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f2fe600/0x40a459093b069775 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1159168->1388543) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20be7 expref: 22 pid: 22480 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129569.035746:0:9823:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092fd1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9823:1830948737486592:192.168.202.4@tcp:105: 00000100:00100000:3.0:1746129569.037580:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129569.037608:0:8416:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734054016 00000100:00100000:3.0:1746129569.037617:0:8416:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734054016 00002000:00100000:3.0:1746129569.037670:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3ef:0x0] (2097152->3145727) req@ffff8800a07ac000 x1830948734054016/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:310/0 lens 488/0 e 0 to 0 dl 1746129580 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129569.037680:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a07ac000 with x1830948734054016 ext(2097152->3145727) 00002000:00010000:3.0:1746129569.037685:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a07ac000 00000100:00100000:3.0:1746129569.037705:0:8416:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7695 00000100:00100000:3.0:1746129569.037713:0:8416:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a07ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ada2ffba-8920-4ecb-8068-68caa9806978+38:1962:x1830948734054016:12345-192.168.202.4@tcp:3:cat.0 00000100:00080000:1.0:1746129569.037808:0:7097:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746129569.040021:0:9823:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5de8cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746129569.041110:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129569.041177:0:31521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734054144 00000100:00100000:1.0:1746129569.041188:0:31521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734054144 00002000:00100000:1.0:1746129569.041235:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->4194303) req@ffff8800a07af800 x1830948734054144/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:310/0 lens 488/0 e 0 to 0 dl 1746129580 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129569.041244:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a07af800 with x1830948734054144 ext(3145728->4194303) 00002000:00010000:1.0:1746129569.041249:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a07af800 00000100:00100000:1.0:1746129569.041273:0:31521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7696 00000100:00100000:1.0:1746129569.041281:0:31521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a07af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ada2ffba-8920-4ecb-8068-68caa9806978+40:1962:x1830948734054144:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:3.0:1746129569.042852:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129569.043151:0:31518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734054528 00000100:00100000:3.0:1746129569.043159:0:31518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734054528 00002000:00100000:3.0:1746129569.043197:0:31518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3f3:0x0] (1159168->1163263) req@ffff8800a07adc00 x1830948734054528/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:310/0 lens 488/0 e 0 to 0 dl 1746129580 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129569.043207:0:31518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a07adc00 with x1830948734054528 ext(1159168->1163263) 00002000:00010000:3.0:1746129569.043212:0:31518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a07adc00 00000100:00100000:3.0:1746129569.043243:0:31518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7697 00000100:00100000:3.0:1746129569.043251:0:31518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a07adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+23:1963:x1830948734054528:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:0.0:1746129569.043270:0:9823:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092fd1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9823:1830948737486592:192.168.202.4@tcp:105: 00010000:00010000:0.0:1746129569.043303:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129569.043357:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092fd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+23:1963:x1830948734053760:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 7761us (8004us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129569.043367:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8187 00000100:00100000:3.0:1746129569.043408:0:31518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a07adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+22:1963:x1830948734054528:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 157us (565us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129569.043413:0:31518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7697 00002000:00100000:3.0:1746129569.043418:0:31518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3f3:0x0] (1159168->1163263) req@ffff8800a07adc00 x1830948734054528/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:310/0 lens 488/4536 e 0 to 0 dl 1746129580 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129569.043431:0:31518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a07adc00 with x1830948734054528 ext(1159168->1163263) 00002000:00010000:3.0:1746129569.043434:0:31518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a07adc00 00000100:00100000:3.0:1746129569.052178:0:8416:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a07ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ada2ffba-8920-4ecb-8068-68caa9806978+40:1962:x1830948734054016:12345-192.168.202.4@tcp:3:cat.0 Request processed in 14453us (14596us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129569.052189:0:8416:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7695 00002000:00100000:3.0:1746129569.052201:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3ef:0x0] (2097152->3145727) req@ffff8800a07ac000 x1830948734054016/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:310/0 lens 488/440 e 0 to 0 dl 1746129580 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129569.052211:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a07ac000 with x1830948734054016 ext(2097152->3145727) 00002000:00010000:3.0:1746129569.052217:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a07ac000 00000100:00100000:1.0:1746129569.056984:0:31519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135726680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ada2ffba-8920-4ecb-8068-68caa9806978+39:1963:x1830948734053632:12345-192.168.202.4@tcp:4:cat.0 Request processed in 30584us (30730us total) trans 17179874084 rc 0/0 00000100:00100000:1.0:1746129569.056998:0:31519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2401 00002000:00100000:1.0:1746129569.057012:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f4:0x0] (1048576->1724415) req@ffff880135726680 x1830948734053632/t17179874084(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:310/0 lens 488/448 e 0 to 0 dl 1746129580 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129569.057023:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135726680 with x1830948734053632 ext(1048576->1724415) 00010000:00010000:1.0:1746129569.057036:0:31519:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012d94f600/0x40a459093b069695 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1724415) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20b77 expref: 39 pid: 22481 timeout: 924 lvb_type: 0 00010000:00010000:1.0:1746129569.057055:0:31519:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012d94f600/0x40a459093b069695 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1724415) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20b77 expref: 39 pid: 22481 timeout: 924 lvb_type: 0 00002000:00010000:1.0:1746129569.057062:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880135726680 00000100:00100000:0.0:1746129569.057736:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129569.057860:0:31519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734054784 00000100:00100000:0.0:1746129569.057868:0:31519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734054784 00002000:00100000:0.0:1746129569.057900:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f3:0x0] (1384448->1388543) req@ffff880092fd1f80 x1830948734054784/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:310/0 lens 488/0 e 0 to 0 dl 1746129580 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129569.057909:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092fd1f80 with x1830948734054784 ext(1384448->1388543) 00002000:00010000:0.0:1746129569.057912:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092fd1f80 00000100:00100000:0.0:1746129569.057944:0:31519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7698 00000100:00100000:0.0:1746129569.057952:0:31519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092fd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+22:1962:x1830948734054784:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:0.0:1746129569.058120:0:31519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092fd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+22:1962:x1830948734054784:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 168us (385us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746129569.058126:0:31519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7698 00002000:00100000:0.0:1746129569.058131:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f3:0x0] (1384448->1388543) req@ffff880092fd1f80 x1830948734054784/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:310/0 lens 488/4536 e 0 to 0 dl 1746129580 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129569.058138:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092fd1f80 with x1830948734054784 ext(1384448->1388543) 00002000:00010000:0.0:1746129569.058140:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092fd1f80 00000100:00100000:1.0:1746129569.059231:0:31521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a07af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ada2ffba-8920-4ecb-8068-68caa9806978+38:1962:x1830948734054144:12345-192.168.202.4@tcp:3:cat.0 Request processed in 17944us (18122us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129569.059240:0:31521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7696 00002000:00100000:1.0:1746129569.059247:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->4194303) req@ffff8800a07af800 x1830948734054144/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:310/0 lens 488/440 e 0 to 0 dl 1746129580 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129569.059256:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a07af800 with x1830948734054144 ext(3145728->4194303) 00002000:00010000:1.0:1746129569.059261:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a07af800 00000100:00100000:0.0:1746129569.060239:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129569.060635:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734054912 00000100:00100000:2.0:1746129569.060643:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734054912 00010000:00010000:2.0:1746129569.060678:0:9823:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d94f600/0x40a459093b069695 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1724415) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20b77 expref: 39 pid: 22481 timeout: 924 lvb_type: 0 00000100:00100000:2.0:1746129569.060703:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8188 00000100:00100000:2.0:1746129569.060709:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092fd0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ada2ffba-8920-4ecb-8068-68caa9806978+39:1963:x1830948734054912:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129569.060722:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129569.060742:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d94f600/0x40a459093b069695 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1724415) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20b77 expref: 39 pid: 22481 timeout: 924 lvb_type: 0 00010000:00010000:2.0:1746129569.060758:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d94f600/0x40a459093b069695 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1724415) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20b77 expref: 39 pid: 22481 timeout: 924 lvb_type: 0 00010000:00010000:2.0:1746129569.060779:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d94f600/0x40a459093b069695 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1724415) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20b77 expref: 39 pid: 22481 timeout: 924 lvb_type: 0 00010000:00010000:2.0:1746129569.061157:0:9823:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129569.061159:0:9823:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129569.061168:0:9823:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800915dc800/0x40a459093b06976e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20be0 expref: 21 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129569.061176:0:9823:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800915dc800/0x40a459093b06976e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20be0 expref: 21 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129569.061216:0:9823:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800915dc800/0x40a459093b06976e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20be0 expref: 21 pid: 7149 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129569.061228:0:9823:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013575c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9823:1830948737486720:192.168.202.4@tcp:105: 00000100:00100000:2.0:1746129569.062064:0:9823:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0ac600 going to sleep for 11 seconds 00000100:00100000:0.0:1746129569.069461:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129569.069488:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129569.069537:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129569.069584:0:31521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734055424 00000100:00100000:0.0:1746129569.069594:0:31521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734055424 00002000:00100000:0.0:1746129569.069643:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f4:0x0] (1048576->2097151) req@ffff88012baeea00 x1830948734055424/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:310/0 lens 488/0 e 0 to 0 dl 1746129580 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129569.069653:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012baeea00 with x1830948734055424 ext(1048576->2097151) 00002000:00010000:0.0:1746129569.069659:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012baeea00 00000100:00100000:0.0:1746129569.069684:0:31519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7699 00000100:00100000:0.0:1746129569.069691:0:31519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baeea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+22:1961:x1830948734055424:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:1.0:1746129569.071276:0:22480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734055040 00000100:00100000:1.0:1746129569.071283:0:22480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734055040 00000100:00100000:1.0:1746129569.071339:0:22480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734055168 00000100:00100000:1.0:1746129569.071342:0:22480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734055168 00000100:00100000:1.0:1746129569.071357:0:22480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15998 00000100:00100000:1.0:1746129569.071362:0:22480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092fd0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ada2ffba-8920-4ecb-8068-68caa9806978+40:1961:x1830948734055040:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129569.071375:0:22480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129569.071392:0:22480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d94e000/0x40a459093b06977c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20bee expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129569.071442:0:22480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135726a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22480:1830948737486848:192.168.202.4@tcp:106: 00000100:00100000:1.0:1746129569.071502:0:22480:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b52c80c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746129569.071518:0:22481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15999 00000100:00100000:1.0:1746129569.071523:0:22481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ada2ffba-8920-4ecb-8068-68caa9806978+41:1961:x1830948734055168:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129569.071528:0:22481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129569.071533:0:22481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d94ea00/0x40a459093b069783 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20bf5 expref: -99 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129569.071543:0:22481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129569.071545:0:22481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129569.071553:0:22481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d94ea00/0x40a459093b069783 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20bf5 expref: 42 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129569.071566:0:22481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d94ea00/0x40a459093b069783 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20bf5 expref: 42 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129569.071573:0:22481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d94ea00, rc 0) 00000100:00100000:1.0:1746129569.071595:0:22481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ada2ffba-8920-4ecb-8068-68caa9806978+42:1961:x1830948734055168:12345-192.168.202.4@tcp:101:cat.0 Request processed in 71us (2106us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129569.071600:0:22481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15999 00000100:00100000:2.0:1746129569.071707:0:9823:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013575c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9823:1830948737486720:192.168.202.4@tcp:105: 00010000:00010000:2.0:1746129569.071723:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129569.071744:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092fd0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ada2ffba-8920-4ecb-8068-68caa9806978+41:1963:x1830948734054912:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 11036us (11511us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129569.071751:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8188 00000100:00100000:1.0:1746129569.079269:0:22480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135726a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22480:1830948737486848:192.168.202.4@tcp:106: 00010000:00010000:1.0:1746129569.079340:0:22480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d94e000/0x40a459093b06977c lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20bee expref: 40 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129569.079356:0:22480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d94e000/0x40a459093b06977c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20bee expref: 40 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129569.080266:0:22480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d94e000, rc 0) 00000100:00100000:1.0:1746129569.080700:0:22480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092fd0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ada2ffba-8920-4ecb-8068-68caa9806978+39:1961:x1830948734055040:12345-192.168.202.4@tcp:101:cat.0 Request processed in 9332us (11246us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129569.080710:0:22480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15998 00000100:00100000:1.0:1746129569.082368:0:31519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baeea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+22:1961:x1830948734055424:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 12671us (12824us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129569.082379:0:31519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7699 00002000:00100000:1.0:1746129569.082390:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f4:0x0] (1048576->2097151) req@ffff88012baeea00 x1830948734055424/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:310/0 lens 488/440 e 0 to 0 dl 1746129580 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129569.082404:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012baeea00 with x1830948734055424 ext(1048576->2097151) 00002000:00010000:1.0:1746129569.082411:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012baeea00 00000100:00100000:0.0:1746129569.088147:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129569.088343:0:22480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734055552 00000100:00100000:1.0:1746129569.088353:0:22480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734055552 00000100:00100000:1.0:1746129569.088432:0:22480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16000 00000100:00100000:1.0:1746129569.088440:0:22480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+29:32220:x1830948734055552:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129569.088458:0:22480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129569.088474:0:22480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d94e600/0x40a459093b06978a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20bfc expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129569.088500:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129569.088501:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129569.088508:0:22480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d94e600/0x40a459093b06978a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20bfc expref: 30 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129569.088522:0:22480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d94e600/0x40a459093b06978a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20bfc expref: 30 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129569.088532:0:22480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d94e600, rc 0) 00000100:00100000:1.0:1746129569.088576:0:22480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+30:32220:x1830948734055552:12345-192.168.202.4@tcp:101:cat.0 Request processed in 137us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129569.088581:0:22480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16000 00000100:00100000:0.0:1746129569.088963:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129569.089010:0:31519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734055808 00000100:00100000:1.0:1746129569.089014:0:31519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734055808 00002000:00100000:1.0:1746129569.089041:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3ef:0x0] (4194304->5148671) req@ffff88012baeca80 x1830948734055808/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:310/0 lens 488/0 e 0 to 0 dl 1746129580 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129569.089055:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012baeca80 with x1830948734055808 ext(4194304->5148671) 00002000:00010000:1.0:1746129569.089060:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012baeca80 00000100:00100000:1.0:1746129569.089072:0:31519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7700 00000100:00100000:1.0:1746129569.089077:0:31519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baeca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ada2ffba-8920-4ecb-8068-68caa9806978+38:1962:x1830948734055808:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129569.091565:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129569.091692:0:31521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734056064 00000100:00100000:2.0:1746129569.091700:0:31521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734056064 00002000:00100000:2.0:1746129569.091744:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3ee:0x0] (1048576->2097151) req@ffff88012baef480 x1830948734056064/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:310/0 lens 488/0 e 0 to 0 dl 1746129580 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129569.091755:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012baef480 with x1830948734056064 ext(1048576->2097151) 00002000:00010000:2.0:1746129569.091760:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012baef480 00000100:00100000:2.0:1746129569.091792:0:31521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7701 00000100:00100000:2.0:1746129569.091799:0:31521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+30:1960:x1830948734056064:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:1.0:1746129569.099681:0:31519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baeca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ada2ffba-8920-4ecb-8068-68caa9806978+38:1962:x1830948734055808:12345-192.168.202.4@tcp:3:cat.0 Request processed in 10591us (10706us total) trans 0 rc 954368/954368 00000100:00100000:1.0:1746129569.099695:0:31519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7700 00002000:00100000:1.0:1746129569.099708:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3ef:0x0] (4194304->5148671) req@ffff88012baeca80 x1830948734055808/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:310/0 lens 488/440 e 0 to 0 dl 1746129580 ref 1 fl Complete:/200/0 rc 954368/954368 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129569.099718:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012baeca80 with x1830948734055808 ext(4194304->5148671) 00002000:00010000:1.0:1746129569.099724:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012baeca80 00000100:00100000:3.0:1746129569.101234:0:31521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+30:1960:x1830948734056064:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 9427us (9672us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129569.101244:0:31521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7701 00002000:00100000:3.0:1746129569.101252:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3ee:0x0] (1048576->2097151) req@ffff88012baef480 x1830948734056064/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:310/0 lens 488/440 e 0 to 0 dl 1746129580 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129569.101260:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012baef480 with x1830948734056064 ext(1048576->2097151) 00002000:00010000:3.0:1746129569.101266:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012baef480 00000100:00100000:2.0:1746129569.107734:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129569.108936:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129569.108993:0:22480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734056192 00000100:00100000:1.0:1746129569.109004:0:22480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734056192 00000100:00100000:1.0:1746129569.109502:0:22480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734056320 00000100:00100000:1.0:1746129569.109505:0:22480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734056320 00000100:00100000:3.0:1746129569.109512:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16001 00000100:00100000:3.0:1746129569.109522:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013575c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ada2ffba-8920-4ecb-8068-68caa9806978+39:1962:x1830948734056192:12345-192.168.202.4@tcp:101:cat.0 00000100:00100000:1.0:1746129569.109533:0:22480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16002 00000100:00100000:1.0:1746129569.109538:0:22480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+30:32220:x1830948734056320:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129569.109541:0:7149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129569.109547:0:22480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129569.109559:0:7149:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f891400/0x40a459093b069791 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20c03 expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129569.109559:0:22480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d94e200/0x40a459093b069798 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20c0a expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129569.109582:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129569.109584:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129569.109592:0:22480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d94e200/0x40a459093b069798 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20c0a expref: 31 pid: 22480 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129569.109610:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a07adf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7149:1830948737486976:192.168.202.4@tcp:106: 00010000:00010000:1.0:1746129569.109611:0:22480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d94e200/0x40a459093b069798 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20c0a expref: 31 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129569.109620:0:22480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d94e200, rc 0) 00000100:00100000:1.0:1746129569.109667:0:22480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+31:32220:x1830948734056320:12345-192.168.202.4@tcp:101:cat.0 Request processed in 128us (735us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129569.109673:0:22480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16002 00000100:00100000:3.0:1746129569.109685:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c4e9480 going to sleep for 11 seconds 00000100:00100000:3.0:1746129569.114768:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a07adf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7149:1830948737486976:192.168.202.4@tcp:106: 00010000:00010000:3.0:1746129569.114814:0:7149:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f891400/0x40a459093b069791 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20c03 expref: 40 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129569.114830:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f891400/0x40a459093b069791 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20c03 expref: 40 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129569.114870:0:7149:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f891400, rc 0) 00000100:00100000:3.0:1746129569.114946:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013575c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ada2ffba-8920-4ecb-8068-68caa9806978+39:1962:x1830948734056192:12345-192.168.202.4@tcp:101:cat.0 Request processed in 5424us (7221us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129569.114954:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16001 00000100:00100000:0.0:1746129569.118014:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129569.118099:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734056448 00000100:00100000:1.0:1746129569.118109:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734056448 00000100:00100000:1.0:1746129569.118172:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11183 00000100:00100000:1.0:1746129569.118180:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:068dab75-d300-4ead-a742-d14572ad1e50+8:32224:x1830948734056448:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:1.0:1746129569.118206:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129569.118227:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94fe00/0x40a459093b06979f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20c11 expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129569.118350:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94e000/0x40a459093b0697a6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129569.118365:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94e000/0x40a459093b0697a6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129569.118380:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94e000/0x40a459093b0697a6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129569.118394:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94f600/0x40a459093b0697ad lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129569.118399:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94f600/0x40a459093b0697ad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129569.118406:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94f600/0x40a459093b0697ad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129569.118526:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94e400/0x40a459093b0697b4 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129569.118537:0:14549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800915dc400/0x40a459093b069687 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20b70 expref: 21 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129569.118544:0:14549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94e400/0x40a459093b0697b4 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129569.118576:0:14549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800915dc400/0x40a459093b069687 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20b70 expref: 21 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129569.118588:0:14549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800915dc400/0x40a459093b069687 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20b70 expref: 21 pid: 2271 timeout: 924 lvb_type: 0 00000100:00100000:1.0:1746129569.118601:0:14549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135726a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830948737487104:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129569.118693:0:14549:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b52c80c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129569.118919:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129569.118987:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129569.119145:0:31521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734056704 00000100:00100000:3.0:1746129569.119150:0:31521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734056704 00002000:00100000:3.0:1746129569.119181:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3ef:0x0] (2097152->3145727) req@ffff88012baee300 x1830948734056704/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:310/0 lens 488/0 e 0 to 0 dl 1746129580 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129569.119190:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012baee300 with x1830948734056704 ext(2097152->3145727) 00002000:00010000:3.0:1746129569.119195:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012baee300 00000100:00100000:3.0:1746129569.119215:0:31521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734056832 00000100:00100000:3.0:1746129569.119217:0:31521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734056832 00002000:00100000:3.0:1746129569.119227:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->4194303) req@ffff88012baed180 x1830948734056832/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:310/0 lens 488/0 e 0 to 0 dl 1746129580 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129569.119233:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012baed180 with x1830948734056832 ext(3145728->4194303) 00002000:00010000:3.0:1746129569.119236:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012baed180 00000100:00100000:2.0:1746129569.119240:0:8416:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7702 00000100:00100000:2.0:1746129569.119249:0:8416:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+32:1960:x1830948734056704:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:3.0:1746129569.119542:0:31520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7703 00000100:00100000:3.0:1746129569.119549:0:31520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+32:1961:x1830948734056832:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:1.0:1746129569.121458:0:14549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135726a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830948737487104:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129569.121489:0:14549:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94e400/0x40a459093b0697b4 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000100:00100000:1.0:1746129569.121528:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129569.121556:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734057088 00000100:00100000:1.0:1746129569.121561:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734057088 00000100:00100000:1.0:1746129569.121605:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16003 00000100:00100000:1.0:1746129569.121611:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135726a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ada2ffba-8920-4ecb-8068-68caa9806978+39:1963:x1830948734057088:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129569.121627:0:7149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129569.121644:0:7149:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d94f400/0x40a459093b0697bb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20c18 expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129569.121692:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135724700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7149:1830948737487232:192.168.202.4@tcp:106: 00000100:00100000:1.0:1746129569.121751:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b52c80c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746129569.121782:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129569.126780:0:20861:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734057344 00000100:00100000:3.0:1746129569.126794:0:20861:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734057344 00000100:00100000:3.0:1746129569.126878:0:20861:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4740 00000100:00100000:3.0:1746129569.126886:0:20861:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135725180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+22:7701:x1830948734057344:12345-192.168.202.4@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1746129569.127158:0:20861:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135725180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+23:7701:x1830948734057344:12345-192.168.202.4@tcp:35:ldlm_bl.0 Request processed in 272us (5374us total) trans 8589945275 rc 0/0 00000100:00100000:3.0:1746129569.127164:0:20861:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4740 00000100:00100000:1.0:1746129569.128528:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135724700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7149:1830948737487232:192.168.202.4@tcp:106: 00010000:00010000:1.0:1746129569.128569:0:7149:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d94f400/0x40a459093b0697bb lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20c18 expref: 40 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129569.128585:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d94f400/0x40a459093b0697bb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20c18 expref: 40 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129569.128614:0:7149:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d94f400, rc 0) 00000100:00100000:1.0:1746129569.129201:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135726a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ada2ffba-8920-4ecb-8068-68caa9806978+39:1963:x1830948734057088:12345-192.168.202.4@tcp:101:cat.0 Request processed in 7587us (7671us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129569.129211:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16003 00000100:00100000:2.0:1746129569.135288:0:8416:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+33:1960:x1830948734056704:12345-192.168.202.4@tcp:3:cat.0 Request processed in 16027us (16356us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129569.135327:0:8416:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7702 00002000:00100000:2.0:1746129569.135350:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3ef:0x0] (2097152->3145727) req@ffff88012baee300 x1830948734056704/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:310/0 lens 488/440 e 0 to 0 dl 1746129580 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129569.135360:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012baee300 with x1830948734056704 ext(2097152->3145727) 00002000:00010000:2.0:1746129569.135367:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012baee300 00000100:00100000:3.0:1746129569.138196:0:31520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+31:1961:x1830948734056832:12345-192.168.202.4@tcp:3:cat.0 Request processed in 18633us (19194us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129569.138209:0:31520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7703 00002000:00100000:3.0:1746129569.138222:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->4194303) req@ffff88012baed180 x1830948734056832/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:310/0 lens 488/440 e 0 to 0 dl 1746129580 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129569.138231:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012baed180 with x1830948734056832 ext(3145728->4194303) 00002000:00010000:3.0:1746129569.138236:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012baed180 00000100:00100000:0.0:1746129569.140835:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129569.140941:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734057472 00000100:00100000:2.0:1746129569.140950:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734057472 00010000:00010000:2.0:1746129569.140990:0:9823:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800915dc400/0x40a459093b069687 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20b70 expref: 23 pid: 2271 timeout: 924 lvb_type: 0 00000100:00100000:2.0:1746129569.141029:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8189 00000100:00100000:2.0:1746129569.141036:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baeed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+23:1963:x1830948734057472:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129569.141054:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129569.141060:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800915dc400/0x40a459093b069687 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20b70 expref: 23 pid: 2271 timeout: 924 lvb_type: 0 00010000:00010000:2.0:1746129569.141071:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800915dc400/0x40a459093b069687 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20b70 expref: 23 pid: 2271 timeout: 924 lvb_type: 0 00010000:00010000:2.0:1746129569.141093:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800915dc400/0x40a459093b069687 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20b70 expref: 23 pid: 2271 timeout: 924 lvb_type: 0 00010000:00010000:2.0:1746129569.141838:0:9823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:2.0:1746129569.141846:0:9823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94e400/0x40a459093b0697b4 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129569.141858:0:9823:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94e400/0x40a459093b0697b4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129569.141865:0:9823:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94e400/0x40a459093b0697b4 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129569.142514:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129569.142592:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baeed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+22:1963:x1830948734057472:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 1551us (1763us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129569.142601:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8189 00010000:00010000:1.0:1746129569.142830:0:14549:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94e400/0x40a459093b0697b4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129569.142838:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94e400/0x40a459093b0697b4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00200000:1.0:1746129569.142892:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00000004:00200000:1.0:1746129569.142898:0:14549:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746129569.142917:0:14549:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94e400/0x40a459093b0697b4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129569.142930:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94e400/0x40a459093b0697b4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129569.142940:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94e000/0x40a459093b0697a6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129569.142947:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94e000/0x40a459093b0697a6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129569.142953:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94e000/0x40a459093b0697a6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129569.142958:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d94e000 already unused, calling callback (ffffffffa136e690) 00010000:00010000:1.0:1746129569.142962:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94e000/0x40a459093b0697a6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129569.142968:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94e000/0x40a459093b0697a6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129569.142978:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880132ef8f00) 00010000:00010000:1.0:1746129569.142980:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129569.142983:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94e000/0x40a459093b0697a6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129569.142988:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94e000/0x40a459093b0697a6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129569.143004:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94f600/0x40a459093b0697ad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129569.143009:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94f600/0x40a459093b0697ad lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129569.143014:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94f600/0x40a459093b0697ad lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129569.143018:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d94f600 already unused, calling callback (ffffffffa136e690) 00010000:00010000:1.0:1746129569.143021:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94f600/0x40a459093b0697ad lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129569.143025:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94f600/0x40a459093b0697ad lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129569.143031:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009cffea00) 00010000:00010000:1.0:1746129569.143032:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129569.143034:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94f600/0x40a459093b0697ad lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129569.143038:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94f600/0x40a459093b0697ad lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129569.143073:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94fe00/0x40a459093b06979f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20c11 expref: 10 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129569.143084:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94e400/0x40a459093b0697b4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20c11 expref: 9 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129569.143089:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:1.0:1746129569.143091:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746129569.143093:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d94e400, rc 0) 00000100:00100000:1.0:1746129569.143122:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:068dab75-d300-4ead-a742-d14572ad1e50+9:32224:x1830948734056448:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 24943us (25118us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129569.143128:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11183 00000100:00100000:0.0:1746129569.149558:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129569.149588:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734057600 00000100:00100000:0.0:1746129569.149597:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734057600 00000100:00080000:0.0:1746129569.149621:0:7097:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746129569.151431:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16004 00000100:00100000:0.0:1746129569.151449:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:068dab75-d300-4ead-a742-d14572ad1e50+15:1963:x1830948734057600:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:0.0:1746129569.151469:0:7149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129569.151492:0:7149:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800915dd800/0x40a459093b0697c2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20c1f expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129569.154522:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cda4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7149:1830948737487360:192.168.202.4@tcp:106: 00000100:00100000:0.0:1746129569.159896:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5de8cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129569.160071:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129569.160100:0:22481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734057856 00000100:00100000:0.0:1746129569.160109:0:22481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734057856 00000100:00100000:0.0:1746129569.160162:0:22481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16005 00000100:00100000:0.0:1746129569.160169:0:22481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cda4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:068dab75-d300-4ead-a742-d14572ad1e50+15:1963:x1830948734057856:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:0.0:1746129569.160189:0:22481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129569.160207:0:22481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800915dd200/0x40a459093b0697c9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20c2d expref: -99 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129569.160230:0:22481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129569.160231:0:22481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129569.160239:0:22481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800915dd200/0x40a459093b0697c9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20c2d expref: 16 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129569.160255:0:22481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800915dd200/0x40a459093b0697c9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20c2d expref: 16 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129569.160267:0:22481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800915dd200, rc 0) 00000100:00100000:0.0:1746129569.160311:0:22481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cda4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:068dab75-d300-4ead-a742-d14572ad1e50+16:1963:x1830948734057856:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 142us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129569.160316:0:22481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16005 00000100:00080000:0.0:1746129569.160347:0:7097:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746129569.160391:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129569.160400:0:22481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734057728 00000100:00100000:0.0:1746129569.160403:0:22481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734057728 00000100:00100000:0.0:1746129569.160424:0:22481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16006 00000100:00100000:0.0:1746129569.160429:0:22481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cda5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:068dab75-d300-4ead-a742-d14572ad1e50+17:1963:x1830948734057728:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:0.0:1746129569.160436:0:22481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129569.160447:0:22481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800915dc200/0x40a459093b0697d0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20c26 expref: -99 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129569.160457:0:22481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129569.160459:0:22481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129569.160463:0:22481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800915dc200/0x40a459093b0697d0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20c26 expref: 18 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129569.160472:0:22481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800915dc200/0x40a459093b0697d0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20c26 expref: 18 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129569.160479:0:22481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800915dc200, rc 0) 00000100:00100000:0.0:1746129569.160493:0:22481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cda5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:068dab75-d300-4ead-a742-d14572ad1e50+18:1963:x1830948734057728:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 64us (102us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129569.160497:0:22481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16006 00000100:00100000:0.0:1746129569.160524:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129569.160532:0:22481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734057984 00000100:00100000:0.0:1746129569.160534:0:22481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734057984 00000100:00100000:0.0:1746129569.160552:0:22481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16007 00000100:00100000:0.0:1746129569.160557:0:22481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cda6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:068dab75-d300-4ead-a742-d14572ad1e50+16:1963:x1830948734057984:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:0.0:1746129569.160562:0:22481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129569.160569:0:22481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800915dde00/0x40a459093b0697d7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20c34 expref: -99 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129569.160578:0:22481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129569.160580:0:22481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129569.160583:0:22481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800915dde00/0x40a459093b0697d7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20c34 expref: 17 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129569.160591:0:22481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800915dde00/0x40a459093b0697d7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20c34 expref: 17 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129569.160602:0:22481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800915dde00, rc 0) 00000100:00100000:0.0:1746129569.160615:0:22481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cda6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:068dab75-d300-4ead-a742-d14572ad1e50+17:1963:x1830948734057984:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 59us (92us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129569.160620:0:22481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16007 00000100:00100000:0.0:1746129569.160858:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129569.161044:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129569.161104:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734058496 00000100:00100000:1.0:1746129569.161109:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734058496 00000100:00100000:1.0:1746129569.161142:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11184 00000100:00100000:1.0:1746129569.161146:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cda4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ada2ffba-8920-4ecb-8068-68caa9806978+305:32226:x1830948734058496:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:1.0:1746129569.161158:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129569.161169:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94f600/0x40a459093b0697de lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20c3b expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129569.161262:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94e000/0x40a459093b0697e5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129569.161273:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94e000/0x40a459093b0697e5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129569.161281:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94e000/0x40a459093b0697e5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129569.161308:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94f000/0x40a459093b0697ec lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129569.161314:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94f000/0x40a459093b0697ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129569.161320:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94f000/0x40a459093b0697ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129569.161436:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94f200/0x40a459093b0697f3 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129569.161444:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94f200/0x40a459093b0697f3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129569.161449:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94f200/0x40a459093b0697f3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00200000:1.0:1746129569.161457:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:1.0:1746129569.161539:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94e000/0x40a459093b0697e5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129569.161545:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94e000/0x40a459093b0697e5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129569.161551:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94e000/0x40a459093b0697e5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129569.161556:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d94e000 already unused, calling callback (ffffffffa136e690) 00010000:00010000:1.0:1746129569.161560:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94e000/0x40a459093b0697e5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129569.161567:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94e000/0x40a459093b0697e5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129569.161575:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880132ef8f00) 00010000:00010000:1.0:1746129569.161578:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129569.161582:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94e000/0x40a459093b0697e5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129569.161586:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94e000/0x40a459093b0697e5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129569.161596:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94f000/0x40a459093b0697ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129569.161601:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94f000/0x40a459093b0697ec lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129569.161605:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94f000/0x40a459093b0697ec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129569.161608:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d94f000 already unused, calling callback (ffffffffa136e690) 00010000:00010000:1.0:1746129569.161610:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94f000/0x40a459093b0697ec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129569.161615:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94f000/0x40a459093b0697ec lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129569.161620:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009cffec00) 00010000:00010000:1.0:1746129569.161621:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129569.161623:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94f000/0x40a459093b0697ec lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129569.161628:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94f000/0x40a459093b0697ec lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129569.161658:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94f600/0x40a459093b0697de lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20c3b expref: 308 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129569.161665:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94f200/0x40a459093b0697f3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20c3b expref: 307 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129569.161671:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:1.0:1746129569.161672:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746129569.161674:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d94f200, rc 0) 00000100:00100000:1.0:1746129569.161702:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cda4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ada2ffba-8920-4ecb-8068-68caa9806978+307:32226:x1830948734058496:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 555us (658us total) trans 8589945276 rc 0/0 00000100:00100000:1.0:1746129569.161708:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11184 00000100:00080000:1.0:1746129569.161723:0:7097:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746129569.162096:0:31520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734058240 00000100:00100000:3.0:1746129569.162103:0:31520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734058240 00002000:00100000:3.0:1746129569.162134:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3ef:0x0] (4194304->5148671) req@ffff88012cda4a80 x1830948734058240/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:310/0 lens 488/0 e 0 to 0 dl 1746129580 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129569.162143:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cda4a80 with x1830948734058240 ext(4194304->5148671) 00002000:00010000:3.0:1746129569.162148:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012cda4a80 00000100:00100000:3.0:1746129569.162164:0:31520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7704 00000100:00100000:3.0:1746129569.162169:0:31520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cda4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+31:1961:x1830948734058240:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129569.168178:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cda4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7149:1830948737487360:192.168.202.4@tcp:106: 00010000:00010000:0.0:1746129569.168214:0:7149:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800915dd800/0x40a459093b0697c2 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20c1f expref: 17 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129569.168231:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800915dd800/0x40a459093b0697c2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20c1f expref: 17 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129569.168246:0:7149:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800915dd800, rc 0) 00000100:00100000:0.0:1746129569.168326:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:068dab75-d300-4ead-a742-d14572ad1e50+16:1963:x1830948734057600:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 16882us (18777us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129569.168344:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16004 00000100:00100000:0.0:1746129569.177729:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129569.177760:0:2271:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734058752 00000100:00100000:0.0:1746129569.177770:0:2271:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734058752 00000100:00100000:0.0:1746129569.177817:0:2271:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11185 00000100:00100000:0.0:1746129569.177825:0:2271:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cda4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:068dab75-d300-4ead-a742-d14572ad1e50+9:32224:x1830948734058752:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:0.0:1746129569.177848:0:2271:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129569.177866:0:2271:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800915dce00/0x40a459093b069801 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20c42 expref: -99 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129569.177966:0:2271:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800915dd400/0x40a459093b069808 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129569.177982:0:2271:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94e400/0x40a459093b0697b4 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20c11 expref: 10 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129569.177990:0:2271:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94f200/0x40a459093b0697f3 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20c3b expref: 306 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129569.177996:0:2271:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800915dd400/0x40a459093b069808 lrc: 5/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129569.178028:0:2271:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94f200/0x40a459093b0697f3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20c3b expref: 306 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129569.178040:0:2271:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94f200/0x40a459093b0697f3 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20c3b expref: 306 pid: 14549 timeout: 924 lvb_type: 0 00000100:00100000:0.0:1746129569.178052:0:2271:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cda5880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:2271:1830948737487488:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129569.178130:0:2271:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94e400/0x40a459093b0697b4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20c11 expref: 10 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129569.178136:0:2271:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94e400/0x40a459093b0697b4 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20c11 expref: 10 pid: 14549 timeout: 924 lvb_type: 0 00000100:00100000:0.0:1746129569.178143:0:2271:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cda4000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:2271:1830948737487616:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129569.178164:0:2271:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5de8cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746129569.179943:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129569.179971:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734058880 00000100:00100000:1.0:1746129569.179977:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734058880 00000100:00100000:1.0:1746129569.180017:0:22481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16008 00000100:00100000:1.0:1746129569.180023:0:22481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135724700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ada2ffba-8920-4ecb-8068-68caa9806978+39:32226:x1830948734058880:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:1.0:1746129569.180039:0:22481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129569.180053:0:22481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ee7fa00/0x40a459093b06980f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20c49 expref: -99 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129569.180078:0:22481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800915dc800/0x40a459093b06976e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20be0 expref: 21 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129569.180086:0:22481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800915dc200/0x40a459093b0697d0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20c26 expref: 15 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129569.180093:0:22481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d94ea00/0x40a459093b069783 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20bf5 expref: 40 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129569.180099:0:22481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129569.180101:0:22481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129569.180104:0:22481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ee7fa00/0x40a459093b06980f lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [1961984->2097151] (req 1961984->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20c49 expref: 40 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129569.181246:0:22481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d94ea00/0x40a459093b069783 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20bf5 expref: 40 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129569.181261:0:22481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d94ea00/0x40a459093b069783 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20bf5 expref: 40 pid: 22481 timeout: 924 lvb_type: 1 00000100:00100000:1.0:1746129569.181273:0:22481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135725500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:22481:1830948737487744:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129569.181508:0:22481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800915dc200/0x40a459093b0697d0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20c26 expref: 15 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129569.181521:0:22481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800915dc200/0x40a459093b0697d0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20c26 expref: 15 pid: 22481 timeout: 924 lvb_type: 1 00000100:00100000:1.0:1746129569.181528:0:22481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ede680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:22481:1830948737487872:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129569.181547:0:22481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800915dc800/0x40a459093b06976e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20be0 expref: 21 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129569.181554:0:22481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800915dc800/0x40a459093b06976e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20be0 expref: 21 pid: 7149 timeout: 924 lvb_type: 0 00000100:00100000:1.0:1746129569.181561:0:22481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093edd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:22481:1830948737488000:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129569.181573:0:22481:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a6dc8300 going to sleep for 11 seconds 00000100:00100000:1.0:1746129569.182593:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129569.182674:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129569.182696:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734059008 00000100:00100000:1.0:1746129569.182703:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734059008 00010000:00010000:1.0:1746129569.182736:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94f200/0x40a459093b0697f3 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20c3b expref: 307 pid: 14549 timeout: 924 lvb_type: 0 00000100:00100000:1.0:1746129569.182760:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734059136 00000100:00100000:1.0:1746129569.182762:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734059136 00010000:00010000:1.0:1746129569.182771:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94e400/0x40a459093b0697b4 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20c11 expref: 11 pid: 14549 timeout: 924 lvb_type: 0 00000100:00100000:1.0:1746129569.182785:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8190 00000100:00100000:1.0:1746129569.182790:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093eded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ada2ffba-8920-4ecb-8068-68caa9806978+307:1963:x1830948734059008:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129569.182802:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129569.182807:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94f200/0x40a459093b0697f3 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20c3b expref: 307 pid: 14549 timeout: 924 lvb_type: 0 00010000:00010000:1.0:1746129569.182816:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94f200/0x40a459093b0697f3 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20c3b expref: 307 pid: 14549 timeout: 924 lvb_type: 0 00010000:00010000:1.0:1746129569.182836:0:7085:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:1.0:1746129569.182841:0:7085:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800915dd400/0x40a459093b069808 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:1.0:1746129569.182849:0:7085:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800915dd400/0x40a459093b069808 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:1.0:1746129569.182853:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129569.182880:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093eded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ada2ffba-8920-4ecb-8068-68caa9806978+307:1963:x1830948734059008:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 89us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129569.182886:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8190 00000100:00100000:1.0:1746129569.182901:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8191 00000100:00100000:1.0:1746129569.182905:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bbc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:068dab75-d300-4ead-a742-d14572ad1e50+11:1963:x1830948734059136:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129569.182911:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129569.182914:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94e400/0x40a459093b0697b4 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20c11 expref: 11 pid: 14549 timeout: 924 lvb_type: 0 00010000:00010000:1.0:1746129569.182921:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94e400/0x40a459093b0697b4 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20c11 expref: 11 pid: 14549 timeout: 924 lvb_type: 0 00010000:00010000:1.0:1746129569.182930:0:7085:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:1.0:1746129569.182934:0:7085:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800915dd400/0x40a459093b069808 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:1.0:1746129569.182942:0:7085:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800915dd400/0x40a459093b069808 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50290000000000 pid: 2271 initiator: MDT0 00010000:00010000:1.0:1746129569.182948:0:7085:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800915dd400/0x40a459093b069808 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50290000000000 pid: 2271 initiator: MDT0 00010000:00010000:1.0:1746129569.182964:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129569.182977:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bbc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:068dab75-d300-4ead-a742-d14572ad1e50+11:1963:x1830948734059136:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 71us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129569.182982:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8191 00010000:00010000:2.0:1746129569.183187:0:2271:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94f200/0x40a459093b0697f3 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20c3b expref: 306 pid: 14549 timeout: 924 lvb_type: 0 00000100:00100000:2.0:1746129569.183206:0:2271:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cda5880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:2271:1830948737487488:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129569.183217:0:2271:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94e400/0x40a459093b0697b4 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20c11 expref: 10 pid: 14549 timeout: 924 lvb_type: 0 00000100:00100000:2.0:1746129569.183225:0:2271:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cda4000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:2271:1830948737487616:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129569.183243:0:2271:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800915dd400/0x40a459093b069808 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129569.183251:0:2271:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800915dd400/0x40a459093b069808 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129569.183256:0:2271:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800915dd400/0x40a459093b069808 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00000004:00200000:2.0:1746129569.183275:0:2271:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:2.0:1746129569.183463:0:2271:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800915dce00/0x40a459093b069801 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20c42 expref: 11 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129569.183477:0:2271:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800915dd400/0x40a459093b069808 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20c42 expref: 10 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129569.183483:0:2271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:2.0:1746129569.183564:0:2271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746129569.183567:0:2271:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800915dd400, rc 0) 00000100:00100000:2.0:1746129569.183595:0:2271:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cda4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:068dab75-d300-4ead-a742-d14572ad1e50+10:32224:x1830948734058752:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 5770us (5879us total) trans 8589945277 rc 0/0 00000100:00100000:2.0:1746129569.183601:0:2271:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11185 00000100:00100000:3.0:1746129569.184345:0:31520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cda4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+31:1961:x1830948734058240:12345-192.168.202.4@tcp:3:cat.0 Request processed in 22173us (23484us total) trans 0 rc 954368/954368 00000100:00100000:3.0:1746129569.184357:0:31520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7704 00002000:00100000:3.0:1746129569.184366:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3ef:0x0] (4194304->5148671) req@ffff88012cda4a80 x1830948734058240/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:310/0 lens 488/440 e 0 to 0 dl 1746129580 ref 1 fl Complete:/200/0 rc 954368/954368 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129569.184374:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cda4a80 with x1830948734058240 ext(4194304->5148671) 00002000:00010000:3.0:1746129569.184379:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012cda4a80 00000100:00100000:0.0:1746129569.187437:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129569.187473:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129569.187495:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734059264 00000100:00100000:0.0:1746129569.187504:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734059264 00010000:00010000:0.0:1746129569.187540:0:9823:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800915dc200/0x40a459093b0697d0 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20c26 expref: 16 pid: 22481 timeout: 924 lvb_type: 1 00000100:00100000:0.0:1746129569.187567:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734059392 00000100:00100000:0.0:1746129569.187570:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734059392 00010000:00010000:0.0:1746129569.187580:0:9823:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d94ea00/0x40a459093b069783 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20bf5 expref: 41 pid: 22481 timeout: 924 lvb_type: 1 00000100:00100000:0.0:1746129569.187596:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8192 00000100:00100000:0.0:1746129569.187603:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cda6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:068dab75-d300-4ead-a742-d14572ad1e50+16:1962:x1830948734059264:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129569.187616:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129569.187639:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800915dc200/0x40a459093b0697d0 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20c26 expref: 16 pid: 22481 timeout: 924 lvb_type: 1 00010000:00010000:0.0:1746129569.187649:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800915dc200/0x40a459093b0697d0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20c26 expref: 16 pid: 22481 timeout: 924 lvb_type: 1 00010000:00010000:0.0:1746129569.187673:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129569.187712:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cda6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:068dab75-d300-4ead-a742-d14572ad1e50+16:1962:x1830948734059264:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 110us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129569.187719:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8192 00000100:00100000:0.0:1746129569.187734:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8193 00000100:00100000:0.0:1746129569.187738:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cda7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ada2ffba-8920-4ecb-8068-68caa9806978+41:1960:x1830948734059392:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129569.187744:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129569.187751:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d94ea00/0x40a459093b069783 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20bf5 expref: 41 pid: 22481 timeout: 924 lvb_type: 1 00010000:00010000:0.0:1746129569.187758:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d94ea00/0x40a459093b069783 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20bf5 expref: 41 pid: 22481 timeout: 924 lvb_type: 1 00010000:00010000:0.0:1746129569.187768:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129569.187780:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cda7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ada2ffba-8920-4ecb-8068-68caa9806978+41:1960:x1830948734059392:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 41us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129569.187784:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8193 00000100:00100000:0.0:1746129569.187813:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129569.187826:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734059520 00000100:00100000:0.0:1746129569.187828:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734059520 00010000:00010000:0.0:1746129569.187838:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800915dc800/0x40a459093b06976e lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20be0 expref: 22 pid: 7149 timeout: 924 lvb_type: 0 00000100:00100000:0.0:1746129569.187850:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8194 00000100:00100000:0.0:1746129569.187853:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cda7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+22:1962:x1830948734059520:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129569.187859:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129569.187866:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800915dc800/0x40a459093b06976e lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20be0 expref: 22 pid: 7149 timeout: 924 lvb_type: 0 00010000:00010000:0.0:1746129569.187874:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800915dc800/0x40a459093b06976e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20be0 expref: 22 pid: 7149 timeout: 924 lvb_type: 0 00010000:00010000:0.0:1746129569.187885:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129569.187887:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129569.187894:0:7085:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ee7fa00/0x40a459093b06980f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1961984->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20c49 expref: 40 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129569.187902:0:7085:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ee7fa00/0x40a459093b06980f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1961984->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20c49 expref: 40 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129569.187931:0:7085:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ee7fa00/0x40a459093b06980f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1961984->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20c49 expref: 40 pid: 22481 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129569.187942:0:7085:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cda5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7085:1830948737488128:192.168.202.4@tcp:105: 00000100:00100000:0.0:1746129569.187995:0:7085:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5de8900 going to sleep for 11 seconds 00000100:00100000:0.0:1746129569.188042:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129569.189233:0:2271:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734059648 00000100:00100000:2.0:1746129569.189242:0:2271:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734059648 00000100:00100000:2.0:1746129569.189280:0:2271:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11186 00000100:00100000:2.0:1746129569.189286:0:2271:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cda6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:068dab75-d300-4ead-a742-d14572ad1e50+10:32224:x1830948734059648:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:2.0:1746129569.189338:0:2271:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129569.189355:0:2271:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa3e00/0x40a459093b06981d lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20c50 expref: -99 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129569.189436:0:2271:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa3800/0x40a459093b069824 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129569.189451:0:2271:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800915dd400/0x40a459093b069808 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20c42 expref: 11 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129569.189457:0:2271:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa3800/0x40a459093b069824 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129569.189484:0:2271:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800915dd400/0x40a459093b069808 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20c42 expref: 11 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129569.189494:0:2271:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800915dd400/0x40a459093b069808 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20c42 expref: 11 pid: 2271 timeout: 924 lvb_type: 0 00000100:00100000:2.0:1746129569.189503:0:2271:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013575c000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:2271:1830948737488256:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129569.189558:0:2271:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0ac300 going to sleep for 11 seconds 00000100:00100000:0.0:1746129569.190366:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00010000:00010000:1.0:1746129569.190389:0:22481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d94ea00/0x40a459093b069783 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20bf5 expref: 40 pid: 22481 timeout: 924 lvb_type: 1 00000100:00100000:1.0:1746129569.190407:0:22481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135725500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:22481:1830948737487744:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129569.190637:0:7085:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cda5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7085:1830948737488128:192.168.202.4@tcp:105: 00010000:00010000:0.0:1746129569.190653:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746129569.190727:0:22481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800915dc200/0x40a459093b0697d0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20c26 expref: 15 pid: 22481 timeout: 924 lvb_type: 1 00000100:00100000:1.0:1746129569.190806:0:22481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ede680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:22481:1830948737487872:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129569.190825:0:22481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800915dc800/0x40a459093b06976e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20be0 expref: 22 pid: 7149 timeout: 924 lvb_type: 0 00000100:00100000:1.0:1746129569.190834:0:22481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093edd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:22481:1830948737488000:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129569.190857:0:22481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ee7fa00/0x40a459093b06980f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1961984->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20c49 expref: 39 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129569.190872:0:22481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ee7fa00, rc 0) 00000100:00100000:1.0:1746129569.190892:0:22481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135724700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ada2ffba-8920-4ecb-8068-68caa9806978+39:32226:x1830948734058880:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 10870us (10957us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129569.190901:0:22481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16008 00000100:00100000:1.0:1746129569.190922:0:22481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734059776 00000100:00100000:1.0:1746129569.190927:0:22481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734059776 00000100:00100000:1.0:1746129569.190950:0:22481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16009 00000100:00100000:1.0:1746129569.190955:0:22481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cda7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+22:1961:x1830948734059776:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129569.190965:0:22481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129569.190973:0:22481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f119400/0x40a459093b06982b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20c57 expref: -99 pid: 22481 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129569.191010:0:22481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093edd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:22481:1830948737488384:192.168.202.4@tcp:106: 00000100:00100000:1.0:1746129569.191040:0:22481:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4123e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746129569.191138:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cda7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+22:1962:x1830948734059520:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 2827us (2868us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129569.191148:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8194 00000100:00100000:0.0:1746129569.191441:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129569.191453:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734059904 00000100:00100000:0.0:1746129569.191456:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734059904 00010000:00010000:0.0:1746129569.191470:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800915dd400/0x40a459093b069808 lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20c42 expref: 12 pid: 2271 timeout: 924 lvb_type: 0 00000100:00100000:0.0:1746129569.191488:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8195 00000100:00100000:0.0:1746129569.191603:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cda5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:068dab75-d300-4ead-a742-d14572ad1e50+12:1963:x1830948734059904:12345-192.168.202.4@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746129569.191635:0:2271:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013575c000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:2271:1830948737488256:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129569.191650:0:2271:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa3800/0x40a459093b069824 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129569.191654:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129569.191660:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800915dd400/0x40a459093b069808 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20c42 expref: 12 pid: 2271 timeout: 924 lvb_type: 0 00010000:00010000:0.0:1746129569.191669:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800915dd400/0x40a459093b069808 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20c42 expref: 12 pid: 2271 timeout: 924 lvb_type: 0 00010000:00010000:0.0:1746129569.191686:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800915dd400/0x40a459093b069808 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20c42 expref: 12 pid: 2271 timeout: 924 lvb_type: 0 00010000:00010000:0.0:1746129569.191695:0:7085:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:0.0:1746129569.191700:0:7085:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa3800/0x40a459093b069824 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129569.191709:0:7085:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa3800/0x40a459093b069824 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129569.191714:0:7085:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa3800/0x40a459093b069824 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129569.191883:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129569.191962:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cda5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:068dab75-d300-4ead-a742-d14572ad1e50+11:1963:x1830948734059904:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 468us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129569.191968:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8195 00010000:00010000:2.0:1746129569.191972:0:2271:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa3800/0x40a459093b069824 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129569.191978:0:2271:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa3800/0x40a459093b069824 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00000004:00200000:2.0:1746129569.192025:0:2271:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00000004:00200000:2.0:1746129569.192067:0:2271:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746129569.192084:0:2271:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa3800/0x40a459093b069824 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129569.192114:0:2271:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa3e00/0x40a459093b06981d lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20c50 expref: 11 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129569.192127:0:2271:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa3800/0x40a459093b069824 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20c50 expref: 10 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129569.192133:0:2271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:2.0:1746129569.192135:0:2271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746129569.192137:0:2271:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009faa3800, rc 0) 00000100:00100000:2.0:1746129569.192160:0:2271:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cda6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:068dab75-d300-4ead-a742-d14572ad1e50+10:32224:x1830948734059648:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 2874us (4117us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129569.192166:0:2271:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11186 00000100:00100000:1.0:1746129569.196938:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129569.197036:0:22481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093edd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:22481:1830948737488384:192.168.202.4@tcp:106: 00010000:00010000:1.0:1746129569.197070:0:22481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f119400/0x40a459093b06982b lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20c57 expref: 22 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129569.197086:0:22481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f119400/0x40a459093b06982b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20c57 expref: 22 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129569.197095:0:22481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f119400, rc 0) 00000100:00100000:1.0:1746129569.197145:0:22481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cda7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:1961:x1830948734059776:12345-192.168.202.4@tcp:101:cat.0 Request processed in 6189us (6779us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129569.197156:0:22481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16009 00000100:00100000:1.0:1746129569.197183:0:22481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734060160 00000100:00100000:1.0:1746129569.197188:0:22481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734060160 00000100:00100000:1.0:1746129569.197213:0:22481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16010 00000100:00100000:1.0:1746129569.197219:0:22481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ede680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:068dab75-d300-4ead-a742-d14572ad1e50+15:1963:x1830948734060160:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:1.0:1746129569.197233:0:22481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129569.197247:0:22481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f118e00/0x40a459093b069832 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20c65 expref: -99 pid: 22481 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129569.197290:0:22481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093edd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:22481:1830948737488512:192.168.202.4@tcp:106: 00000100:00100000:1.0:1746129569.197367:0:22481:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4123e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746129569.197392:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129569.197407:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734060032 00000100:00100000:1.0:1746129569.197410:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734060032 00000100:00100000:1.0:1746129569.197425:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16011 00000100:00100000:1.0:1746129569.197430:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093eded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:068dab75-d300-4ead-a742-d14572ad1e50+17:1962:x1830948734060032:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:1.0:1746129569.197436:0:7149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129569.197443:0:7149:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f118600/0x40a459093b069839 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20c5e expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129569.197465:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093edc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7149:1830948737488640:192.168.202.4@tcp:106: 00000100:00100000:1.0:1746129569.197483:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4123d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746129569.197602:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129569.199320:0:31520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734060416 00000100:00100000:3.0:1746129569.199340:0:31520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734060416 00000100:00100000:2.0:1746129569.201422:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129569.201512:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734060544 00000100:00100000:2.0:1746129569.201519:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734060544 00000100:00100000:2.0:1746129569.201553:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16012 00000100:00100000:2.0:1746129569.201560:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013575c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:1963:x1830948734060544:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129569.201577:0:4385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129569.201594:0:4385:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009faa3000/0x40a459093b069840 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20c6c expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129569.201645:0:4385:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013575ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:4385:1830948737488768:192.168.202.4@tcp:106: 00000100:00100000:2.0:1746129569.201710:0:4385:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0ac300 going to sleep for 11 seconds 00000100:00100000:2.0:1746129569.201840:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093edc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7149:1830948737488640:192.168.202.4@tcp:106: 00010000:00010000:2.0:1746129569.201865:0:7149:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f118600/0x40a459093b069839 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20c5e expref: 18 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129569.201874:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f118600/0x40a459093b069839 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20c5e expref: 18 pid: 7149 timeout: 0 lvb_type: 1 00002000:00100000:3.0:1746129569.201877:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3f4:0x0] (1961984->1966079) req@ffff880093edf800 x1830948734060416/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:310/0 lens 488/0 e 0 to 0 dl 1746129580 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00010000:00010000:2.0:1746129569.201882:0:7149:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f118600, rc 0) 00002000:00100000:3.0:1746129569.201887:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093edf800 with x1830948734060416 ext(1961984->1966079) 00002000:00010000:3.0:1746129569.201891:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093edf800 00000100:00100000:2.0:1746129569.201907:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093eded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:068dab75-d300-4ead-a742-d14572ad1e50+17:1962:x1830948734060032:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 4475us (4512us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129569.201912:0:8416:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7705 00000100:00100000:2.0:1746129569.201913:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16011 00000100:00100000:3.0:1746129569.201917:0:8416:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093edf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ada2ffba-8920-4ecb-8068-68caa9806978+39:1962:x1830948734060416:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:3.0:1746129569.202117:0:8416:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093edf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ada2ffba-8920-4ecb-8068-68caa9806978+39:1962:x1830948734060416:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 198us (4514us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129569.202122:0:8416:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7705 00002000:00100000:3.0:1746129569.202127:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3f4:0x0] (1961984->1966079) req@ffff880093edf800 x1830948734060416/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:310/0 lens 488/4536 e 0 to 0 dl 1746129580 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129569.202133:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093edf800 with x1830948734060416 ext(1961984->1966079) 00002000:00010000:3.0:1746129569.202136:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093edf800 00000100:00100000:1.0:1746129569.202180:0:22481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093edd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:22481:1830948737488512:192.168.202.4@tcp:106: 00010000:00010000:1.0:1746129569.202196:0:22481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f118e00/0x40a459093b069832 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20c65 expref: 16 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129569.202207:0:22481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f118e00/0x40a459093b069832 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20c65 expref: 16 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129569.202215:0:22481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f118e00, rc 0) 00000100:00100000:1.0:1746129569.202430:0:22481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ede680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:068dab75-d300-4ead-a742-d14572ad1e50+15:1963:x1830948734060160:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 5209us (5500us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129569.202437:0:22481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16010 00000100:00100000:2.0:1746129569.206757:0:4385:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013575ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:4385:1830948737488768:192.168.202.4@tcp:106: 00010000:00010000:2.0:1746129569.206798:0:4385:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009faa3000/0x40a459093b069840 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20c6c expref: 22 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129569.206815:0:4385:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009faa3000/0x40a459093b069840 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20c6c expref: 22 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129569.206985:0:4385:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009faa3000, rc 0) 00000100:00100000:2.0:1746129569.207041:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013575c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:1963:x1830948734060544:12345-192.168.202.4@tcp:101:cat.0 Request processed in 5479us (5627us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129569.207051:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16012 00000100:00100000:0.0:1746129569.207899:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129569.207947:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129569.207966:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734060928 00000100:00100000:2.0:1746129569.207973:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734060928 00000100:00100000:2.0:1746129569.208012:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16013 00000100:00100000:2.0:1746129569.208018:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013575ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ada2ffba-8920-4ecb-8068-68caa9806978+38:32226:x1830948734060928:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:2.0:1746129569.208034:0:4385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129569.208048:0:4385:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009faa2000/0x40a459093b069847 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20c7a expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129569.208178:0:4385:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800915dc600/0x40a459093b0696fe lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20ba8 expref: 39 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129569.208187:0:4385:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800915dd200/0x40a459093b0697c9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20c2d expref: 16 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129569.208194:0:4385:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d94e600/0x40a459093b06978a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20bfc expref: 30 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129569.208200:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129569.208203:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129569.208207:0:4385:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009faa2000/0x40a459093b069847 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [1048576->1257471] (req 1048576->1257471) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20c7a expref: 39 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129569.208239:0:4385:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d94e600/0x40a459093b06978a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20bfc expref: 30 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129569.208251:0:4385:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d94e600/0x40a459093b06978a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20bfc expref: 30 pid: 22480 timeout: 924 lvb_type: 0 00000100:00100000:2.0:1746129569.208264:0:4385:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013575f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:4385:1830948737488896:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129569.208431:0:4385:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800915dd200/0x40a459093b0697c9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20c2d expref: 16 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129569.208440:0:4385:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800915dd200/0x40a459093b0697c9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20c2d expref: 16 pid: 22481 timeout: 924 lvb_type: 1 00000100:00100000:2.0:1746129569.208448:0:4385:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013575d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:4385:1830948737489024:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129569.208472:0:4385:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800915dc600/0x40a459093b0696fe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20ba8 expref: 39 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129569.208479:0:4385:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800915dc600/0x40a459093b0696fe lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20ba8 expref: 39 pid: 4385 timeout: 924 lvb_type: 0 00000100:00100000:2.0:1746129569.208485:0:4385:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013575df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:4385:1830948737489152:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129569.208500:0:4385:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0ac300 going to sleep for 11 seconds 00000100:00100000:2.0:1746129569.208516:0:2271:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734060800 00000100:00100000:2.0:1746129569.208519:0:2271:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734060800 00000100:00100000:2.0:1746129569.208543:0:2271:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11187 00000100:00100000:2.0:1746129569.208547:0:2271:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cda4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:068dab75-d300-4ead-a742-d14572ad1e50+10:32224:x1830948734060800:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:2.0:1746129569.208555:0:2271:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129569.208567:0:2271:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cfd7800/0x40a459093b06984e lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20c73 expref: -99 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129569.208652:0:2271:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cfd6600/0x40a459093b069855 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129569.208665:0:2271:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cfd6600/0x40a459093b069855 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129569.208676:0:2271:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cfd6600/0x40a459093b069855 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129569.208686:0:2271:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cfd6600/0x40a459093b069855 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129569.208691:0:2271:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cfd6600/0x40a459093b069855 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129569.208696:0:2271:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009cfd6600/0x40a459093b069855 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129569.208701:0:2271:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009cfd6600 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746129569.208704:0:2271:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cfd6600/0x40a459093b069855 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129569.208710:0:2271:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cfd6600/0x40a459093b069855 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40218400000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129569.208720:0:2271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:2.0:1746129569.208724:0:2271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746129569.208728:0:2271:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009cfd6600/0x40a459093b069855 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129569.208733:0:2271:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cfd6600/0x40a459093b069855 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129569.208754:0:2271:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cfd7800/0x40a459093b06984e lrc: 1/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20c73 expref: 11 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129569.208760:0:2271:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cfd7800/0x40a459093b06984e lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20c73 expref: 11 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129569.208770:0:2271:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cfd7800, rc 0) 00000100:00100000:2.0:1746129569.208790:0:2271:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cda4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:068dab75-d300-4ead-a742-d14572ad1e50+10:32224:x1830948734060800:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 242us (894us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129569.208796:0:2271:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11187 00000100:00100000:1.0:1746129569.217487:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129569.217505:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129569.217521:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129569.217545:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129569.217570:0:16680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734061568 00000100:00100000:1.0:1746129569.217578:0:16680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734061568 00000100:00100000:1.0:1746129569.217618:0:16680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4741 00000100:00100000:1.0:1746129569.217627:0:16680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093eddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:068dab75-d300-4ead-a742-d14572ad1e50+10:32224:x1830948734061568:12345-192.168.202.4@tcp:35:lfs.0 00000100:00100000:1.0:1746129569.217817:0:16680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093eddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:068dab75-d300-4ead-a742-d14572ad1e50+11:32224:x1830948734061568:12345-192.168.202.4@tcp:35:lfs.0 Request processed in 190us (269us total) trans 8589945278 rc 0/0 00000100:00100000:1.0:1746129569.217823:0:16680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4741 00000100:00100000:1.0:1746129569.217846:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734061184 00000100:00100000:1.0:1746129569.217848:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734061184 00010000:00010000:1.0:1746129569.217864:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800915dd200/0x40a459093b0697c9 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20c2d expref: 17 pid: 22481 timeout: 924 lvb_type: 1 00000100:00100000:1.0:1746129569.217883:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734061056 00000100:00100000:1.0:1746129569.217885:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734061056 00010000:00010000:1.0:1746129569.217893:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d94e600/0x40a459093b06978a lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20bfc expref: 31 pid: 22480 timeout: 924 lvb_type: 0 00000100:00100000:1.0:1746129569.217903:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734061312 00000100:00100000:1.0:1746129569.217904:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734061312 00010000:00010000:1.0:1746129569.217912:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800915dc600/0x40a459093b0696fe lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20ba8 expref: 40 pid: 4385 timeout: 924 lvb_type: 0 00000100:00100000:1.0:1746129569.217923:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8196 00000100:00100000:1.0:1746129569.217927:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093edd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:068dab75-d300-4ead-a742-d14572ad1e50+17:1962:x1830948734061184:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129569.217935:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129569.217953:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800915dd200/0x40a459093b0697c9 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20c2d expref: 17 pid: 22481 timeout: 924 lvb_type: 1 00000100:00100000:3.0:1746129569.217961:0:7086:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8197 00010000:00010000:1.0:1746129569.217963:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800915dd200/0x40a459093b0697c9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20c2d expref: 17 pid: 22481 timeout: 924 lvb_type: 1 00000100:00100000:3.0:1746129569.217968:0:7086:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093edce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+31:1962:x1830948734061056:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129569.217978:0:7086:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129569.217986:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746129569.217988:0:7086:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d94e600/0x40a459093b06978a lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20bfc expref: 31 pid: 22480 timeout: 924 lvb_type: 0 00010000:00010000:3.0:1746129569.217998:0:7086:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d94e600/0x40a459093b06978a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20bfc expref: 31 pid: 22480 timeout: 924 lvb_type: 0 00000100:00100000:1.0:1746129569.217998:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093edd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:068dab75-d300-4ead-a742-d14572ad1e50+17:1962:x1830948734061184:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 71us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129569.218003:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8196 00010000:00010000:3.0:1746129569.218009:0:7086:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129569.218012:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8198 00000100:00100000:1.0:1746129569.218015:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bbc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ada2ffba-8920-4ecb-8068-68caa9806978+40:1962:x1830948734061312:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129569.218020:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746129569.218025:0:7086:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093edce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+31:1962:x1830948734061056:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 59us (519us total) trans 0 rc 0/0 00010000:00010000:1.0:1746129569.218025:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800915dc600/0x40a459093b0696fe lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20ba8 expref: 40 pid: 4385 timeout: 924 lvb_type: 0 00000100:00100000:3.0:1746129569.218030:0:7086:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8197 00010000:00010000:1.0:1746129569.218038:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800915dc600/0x40a459093b0696fe lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20ba8 expref: 40 pid: 4385 timeout: 924 lvb_type: 0 00010000:00010000:1.0:1746129569.218048:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129569.218049:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129569.218056:0:7085:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009faa2000/0x40a459093b069847 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->1257471) gid 0 flags: 0x50080000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20c7a expref: 40 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129569.218063:0:7085:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009faa2000/0x40a459093b069847 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->1257471) gid 0 flags: 0x50080000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20c7a expref: 40 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129569.218091:0:7085:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009faa2000/0x40a459093b069847 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->1257471) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20c7a expref: 40 pid: 4385 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129569.218103:0:7085:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ede300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7085:1830948737489280:192.168.202.4@tcp:105: 00010000:00010000:2.0:1746129569.218119:0:4385:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d94e600/0x40a459093b06978a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20bfc expref: 30 pid: 22480 timeout: 924 lvb_type: 0 00000100:00100000:2.0:1746129569.218129:0:4385:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013575f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:4385:1830948737488896:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129569.218138:0:4385:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800915dd200/0x40a459093b0697c9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20c2d expref: 16 pid: 22481 timeout: 924 lvb_type: 1 00000100:00100000:1.0:1746129569.218143:0:7085:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4123e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746129569.218144:0:4385:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013575d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:4385:1830948737489024:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129569.218151:0:4385:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800915dc600/0x40a459093b0696fe lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20ba8 expref: 40 pid: 4385 timeout: 924 lvb_type: 0 00000100:00100000:2.0:1746129569.218157:0:4385:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013575df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:4385:1830948737489152:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129569.218182:0:4385:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009faa2000/0x40a459093b069847 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1257471) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20c7a expref: 39 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129569.218189:0:4385:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009faa2000, rc 0) 00000100:00100000:2.0:1746129569.218206:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013575ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ada2ffba-8920-4ecb-8068-68caa9806978+39:32226:x1830948734060928:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 10189us (10260us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129569.218212:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16013 00000100:00100000:1.0:1746129569.223744:0:7085:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ede300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7085:1830948737489280:192.168.202.4@tcp:105: 00010000:00010000:1.0:1746129569.223767:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129569.223812:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bbc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ada2ffba-8920-4ecb-8068-68caa9806978+38:1962:x1830948734061312:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 5794us (6288us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129569.223823:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8198 00000100:00100000:1.0:1746129569.227360:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129569.227843:0:31520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734061824 00000100:00100000:3.0:1746129569.227853:0:31520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734061824 00002000:00100000:3.0:1746129569.227896:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3ee:0x0] (1253376->1257471) req@ffff880093edd180 x1830948734061824/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:310/0 lens 488/0 e 0 to 0 dl 1746129580 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129569.227905:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093edd180 with x1830948734061824 ext(1253376->1257471) 00002000:00010000:3.0:1746129569.227910:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093edd180 00000100:00100000:3.0:1746129569.227929:0:31520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7706 00000100:00100000:3.0:1746129569.227936:0:31520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093edd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ada2ffba-8920-4ecb-8068-68caa9806978+38:1963:x1830948734061824:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:3.0:1746129569.228094:0:31520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093edd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ada2ffba-8920-4ecb-8068-68caa9806978+38:1963:x1830948734061824:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 157us (742us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129569.228101:0:31520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7706 00002000:00100000:3.0:1746129569.228107:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3ee:0x0] (1253376->1257471) req@ffff880093edd180 x1830948734061824/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:310/0 lens 488/4536 e 0 to 0 dl 1746129580 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129569.228115:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093edd180 with x1830948734061824 ext(1253376->1257471) 00002000:00010000:3.0:1746129569.228159:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093edd180 00000100:00100000:1.0:1746129569.230694:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129569.230771:0:20861:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734062080 00000100:00100000:0.0:1746129569.230780:0:20861:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734062080 00000100:00100000:0.0:1746129569.230822:0:20861:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4742 00000100:00100000:0.0:1746129569.230830:0:20861:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093edce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:ada2ffba-8920-4ecb-8068-68caa9806978+306:32226:x1830948734062080:12345-192.168.202.4@tcp:35:multiop.0 00000100:00100000:0.0:1746129569.231168:0:20861:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093edce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:ada2ffba-8920-4ecb-8068-68caa9806978+307:32226:x1830948734062080:12345-192.168.202.4@tcp:35:multiop.0 Request processed in 338us (483us total) trans 8589945279 rc 0/0 00000100:00100000:0.0:1746129569.231178:0:20861:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4742 00000001:00080000:0.0:1746129569.249266:0:2276:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874081 is committed 00000001:00080000:0.0:1746129569.249289:0:2276:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874077 is committed 00000001:00080000:0.0:1746129569.249417:0:2276:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874084 is committed 00000001:00080000:0.0:1746129569.249430:0:2276:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874079 is committed 00000001:00080000:0.0:1746129569.249456:0:2276:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874063 is committed 00000001:00080000:0.0:1746129569.249527:0:2276:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874082 is committed 00000100:00100000:0.0:1746129569.290593:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129569.292044:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734062336 00000100:00100000:2.0:1746129569.292060:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734062336 00000100:00100000:2.0:1746129569.292140:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11188 00000100:00100000:2.0:1746129569.292149:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cda5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+22:32232:x1830948734062336:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:2.0:1746129569.292178:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129569.292198:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094274e00/0x40a459093b06985c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20c81 expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129569.292372:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094274600/0x40a459093b069863 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129569.292386:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094274600/0x40a459093b069863 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129569.292397:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094274600/0x40a459093b069863 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129569.292409:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094275600/0x40a459093b06986a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129569.292414:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094275600/0x40a459093b06986a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129569.292418:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094275600/0x40a459093b06986a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129569.292529:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094275200/0x40a459093b069871 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129569.292537:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094275200/0x40a459093b069871 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129569.292542:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094275200/0x40a459093b069871 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00200000:2.0:1746129569.292552:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:2.0:1746129569.292946:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094274600/0x40a459093b069863 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129569.292954:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094274600/0x40a459093b069863 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129569.292959:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094274600/0x40a459093b069863 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129569.292965:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094274600 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746129569.292969:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094274600/0x40a459093b069863 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129569.292975:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094274600/0x40a459093b069863 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129569.292984:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880132ef8f00) 00010000:00010000:2.0:1746129569.292987:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129569.292990:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094274600/0x40a459093b069863 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129569.292995:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094274600/0x40a459093b069863 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129569.293032:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094275600/0x40a459093b06986a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129569.293037:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094275600/0x40a459093b06986a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129569.293041:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094275600/0x40a459093b06986a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129569.293048:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094275600 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746129569.293050:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094275600/0x40a459093b06986a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129569.293054:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094275600/0x40a459093b06986a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129569.293089:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f0e7100) 00010000:00010000:2.0:1746129569.293092:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129569.293094:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094275600/0x40a459093b06986a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129569.293099:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094275600/0x40a459093b06986a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129569.293137:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094274e00/0x40a459093b06985c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20c81 expref: 25 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129569.293149:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094275200/0x40a459093b069871 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20c81 expref: 24 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129569.293155:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:2.0:1746129569.293157:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746129569.293159:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094275200, rc 0) 00000100:00100000:2.0:1746129569.293224:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cda5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+24:32232:x1830948734062336:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 1076us (2643us total) trans 8589945280 rc 0/0 00000100:00100000:2.0:1746129569.293232:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11188 00000100:00100000:0.0:1746129569.379400:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129569.382711:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734062464 00000100:00100000:2.0:1746129569.382725:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734062464 00000100:00100000:2.0:1746129569.382796:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16014 00000100:00100000:2.0:1746129569.382806:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cda6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ada2ffba-8920-4ecb-8068-68caa9806978+21:1962:x1830948734062464:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129569.382826:0:4385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129569.382845:0:4385:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094275800/0x40a459093b06987f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20c88 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129569.382912:0:4385:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013575df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:4385:1830948737489408:192.168.202.4@tcp:106: 00000100:00100000:2.0:1746129569.383033:0:4385:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0ac300 going to sleep for 11 seconds 00000100:00100000:2.0:1746129569.394364:0:4385:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013575df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:4385:1830948737489408:192.168.202.4@tcp:106: 00010000:00010000:2.0:1746129569.394416:0:4385:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094275800/0x40a459093b06987f lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20c88 expref: 22 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129569.394434:0:4385:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094275800/0x40a459093b06987f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20c88 expref: 22 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129569.394464:0:4385:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094275800, rc 0) 00000100:00100000:2.0:1746129569.394525:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cda6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ada2ffba-8920-4ecb-8068-68caa9806978+21:1962:x1830948734062464:12345-192.168.202.4@tcp:101:cat.0 Request processed in 11720us (15136us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129569.394534:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16014 00000100:00100000:0.0:1746129569.414286:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129569.416649:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734062592 00000100:00100000:2.0:1746129569.416663:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734062592 00000100:00100000:2.0:1746129569.417181:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16015 00000100:00100000:2.0:1746129569.417193:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cda7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ada2ffba-8920-4ecb-8068-68caa9806978+21:32236:x1830948734062592:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129569.417218:0:4385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129569.417242:0:4385:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094275000/0x40a459093b069886 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20c8f expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129569.417284:0:4385:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f2fe600/0x40a459093b069775 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1159168->1388543) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20be7 expref: 6 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129569.417322:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129569.417333:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129569.417338:0:4385:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094275000/0x40a459093b069886 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20c8f expref: 22 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129569.420424:0:4385:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f2fe600/0x40a459093b069775 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1159168->1388543) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20be7 expref: 6 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129569.420445:0:4385:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f2fe600/0x40a459093b069775 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1159168->1388543) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20be7 expref: 6 pid: 22480 timeout: 924 lvb_type: 0 00000100:00100000:3.0:1746129569.420460:0:4385:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013575df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:4385:1830948737489536:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129569.424694:0:4385:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0ac300 going to sleep for 11 seconds 00000100:00100000:0.0:1746129569.430947:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129569.431027:0:8416:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734062720 00000100:00100000:2.0:1746129569.431037:0:8416:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734062720 00002000:00100000:2.0:1746129569.431089:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3f3:0x0] (1159168->1388543) req@ffff88012cda7100 x1830948734062720/t0(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:310/0 lens 488/0 e 0 to 0 dl 1746129580 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129569.431101:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cda7100 with x1830948734062720 ext(1159168->1388543) 00010000:00010000:2.0:1746129569.431111:0:8416:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f2fe600/0x40a459093b069775 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1159168->1388543) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20be7 expref: 7 pid: 22480 timeout: 924 lvb_type: 0 00010000:00010000:2.0:1746129569.431126:0:8416:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f2fe600/0x40a459093b069775 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1159168->1388543) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20be7 expref: 7 pid: 22480 timeout: 924 lvb_type: 0 00002000:00010000:2.0:1746129569.431133:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012cda7100 00000100:00100000:2.0:1746129569.431170:0:8416:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2402 00000100:00100000:2.0:1746129569.431178:0:8416:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cda7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+7:1963:x1830948734062720:12345-192.168.202.4@tcp:4:cat.0 00000100:00100000:3.0:1746129569.431580:0:4385:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013575df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:4385:1830948737489536:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129569.431609:0:4385:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094275000/0x40a459093b069886 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20c8f expref: 22 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129569.431624:0:4385:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094275000, rc 0) 00000100:00100000:3.0:1746129569.431654:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cda7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ada2ffba-8920-4ecb-8068-68caa9806978+22:32236:x1830948734062592:12345-192.168.202.4@tcp:101:cat.0 Request processed in 14465us (17385us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129569.431661:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16015 00000100:00100000:2.0:1746129569.439516:0:8416:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cda7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+9:1963:x1830948734062720:12345-192.168.202.4@tcp:4:cat.0 Request processed in 8326us (8569us total) trans 17179874085 rc 0/0 00000100:00100000:2.0:1746129569.439529:0:8416:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2402 00002000:00100000:2.0:1746129569.439543:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3f3:0x0] (1159168->1388543) req@ffff88012cda7100 x1830948734062720/t17179874085(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:310/0 lens 488/448 e 0 to 0 dl 1746129580 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129569.439551:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cda7100 with x1830948734062720 ext(1159168->1388543) 00010000:00010000:2.0:1746129569.439561:0:8416:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f2fe600/0x40a459093b069775 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1159168->1388543) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20be7 expref: 9 pid: 22480 timeout: 924 lvb_type: 0 00010000:00010000:2.0:1746129569.439576:0:8416:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f2fe600/0x40a459093b069775 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1159168->1388543) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20be7 expref: 9 pid: 22480 timeout: 924 lvb_type: 0 00002000:00010000:2.0:1746129569.439582:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012cda7100 00000100:00100000:0.0:1746129569.445837:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129569.445959:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734062848 00000100:00100000:2.0:1746129569.445970:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734062848 00000100:00100000:2.0:1746129569.446030:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11189 00000100:00100000:2.0:1746129569.446039:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cda5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:068dab75-d300-4ead-a742-d14572ad1e50+11:32239:x1830948734062848:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:2.0:1746129569.446065:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129569.446084:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8d4200/0x40a459093b06988d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20c96 expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129569.446146:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8d4a00/0x40a459093b069894 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129569.446159:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8d4a00/0x40a459093b069894 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129569.446170:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8d4a00/0x40a459093b069894 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129569.446182:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8d4800/0x40a459093b06989b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129569.446192:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8d4800/0x40a459093b06989b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129569.446197:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8d4800/0x40a459093b06989b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129569.446367:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8d5000/0x40a459093b0698a2 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129569.446377:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8d5000/0x40a459093b0698a2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129569.446384:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8d5000/0x40a459093b0698a2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00200000:2.0:1746129569.446418:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00000004:00200000:2.0:1746129569.446422:0:14549:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746129569.446438:0:14549:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8d5000/0x40a459093b0698a2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129569.446446:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8d5000/0x40a459093b0698a2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129569.446452:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8d4a00/0x40a459093b069894 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129569.446457:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8d4a00/0x40a459093b069894 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129569.446461:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8d4a00/0x40a459093b069894 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129569.446466:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f8d4a00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746129569.446470:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8d4a00/0x40a459093b069894 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129569.446476:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8d4a00/0x40a459093b069894 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129569.446487:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880132ef8f00) 00010000:00010000:2.0:1746129569.446489:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129569.446493:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8d4a00/0x40a459093b069894 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129569.446497:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8d4a00/0x40a459093b069894 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129569.446524:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8d4800/0x40a459093b06989b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129569.446529:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8d4800/0x40a459093b06989b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129569.446533:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8d4800/0x40a459093b06989b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129569.446537:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f8d4800 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746129569.446538:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8d4800/0x40a459093b06989b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129569.446542:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8d4800/0x40a459093b06989b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129569.446547:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f0e7e00) 00010000:00010000:2.0:1746129569.446549:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129569.446551:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8d4800/0x40a459093b06989b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129569.446555:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8d4800/0x40a459093b06989b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129569.446582:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8d4200/0x40a459093b06988d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20c96 expref: 13 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129569.446592:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8d5000/0x40a459093b0698a2 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20c96 expref: 12 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129569.446598:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:2.0:1746129569.446600:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746129569.447278:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f8d5000, rc 0) 00000100:00100000:2.0:1746129569.449211:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cda5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:068dab75-d300-4ead-a742-d14572ad1e50+12:32239:x1830948734062848:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 3162us (3375us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129569.449222:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11189 00000100:00100000:0.0:1746129569.449952:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129569.449984:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129569.450005:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734062976 00000100:00100000:0.0:1746129569.450006:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129569.450014:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734062976 00000100:00100000:3.0:1746129569.450048:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734063104 00000100:00100000:3.0:1746129569.450050:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734063104 00000100:00100000:0.0:1746129569.450050:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129569.450070:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734063232 00000100:00100000:3.0:1746129569.450072:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734063232 00000100:00100000:3.0:1746129569.450094:0:20577:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16016 00000100:00100000:2.0:1746129569.450100:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16017 00000100:00100000:3.0:1746129569.450101:0:20577:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090169880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+10:1963:x1830948734062976:12345-192.168.202.4@tcp:101:cat.0 00000100:00100000:2.0:1746129569.450105:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009016b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+10:1963:x1830948734063104:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129569.450117:0:20577:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129569.450117:0:7149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129569.450133:0:20577:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f891400/0x40a459093b0698b0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20c9d expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129569.450133:0:7149:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f8d5a00/0x40a459093b0698a9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20ca4 expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129569.450184:0:20577:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a07adf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20577:1830948737489792:192.168.202.4@tcp:106: 00000100:00100000:2.0:1746129569.450184:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013575d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7149:1830948737489664:192.168.202.4@tcp:106: 00000100:00100000:1.0:1746129569.450234:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734063360 00000100:00100000:1.0:1746129569.450238:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734063360 00000100:00100000:0.0:1746129569.450247:0:4699:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16018 00000100:00100000:0.0:1746129569.450253:0:4699:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009016a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+30:1963:x1830948734063232:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129569.450255:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f2fe600/0x40a459093b069775 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1159168->1388543) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20be7 expref: 13 pid: 22480 timeout: 924 lvb_type: 0 00010000:00010000:0.0:1746129569.450260:0:4699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129569.450270:0:4699:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800915dcc00/0x40a459093b0698b7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20cab expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129569.450274:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8199 00000100:00100000:1.0:1746129569.450278:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090169180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+13:1961:x1830948734063360:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129569.450286:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746129569.450312:0:4699:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090169f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4699:1830948737489920:192.168.202.4@tcp:106: 00010000:00010000:1.0:1746129569.450322:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f2fe600/0x40a459093b069775 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1159168->1388543) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20be7 expref: 13 pid: 22480 timeout: 924 lvb_type: 0 00010000:00010000:1.0:1746129569.450344:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f2fe600/0x40a459093b069775 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1159168->1388543) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20be7 expref: 13 pid: 22480 timeout: 924 lvb_type: 0 00010000:00010000:1.0:1746129569.450364:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129569.450366:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129569.450373:0:7085:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094275000/0x40a459093b069886 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20c8f expref: 21 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129569.450381:0:7085:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094275000/0x40a459093b069886 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20c8f expref: 21 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129569.450401:0:7085:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880094275000/0x40a459093b069886 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20c8f expref: 21 pid: 4385 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129569.450408:0:7085:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ede300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7085:1830948737490048:192.168.202.4@tcp:105: 00000100:00100000:1.0:1746129569.450519:0:7085:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ac5a49c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129569.450531:0:4699:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a586e780 going to sleep for 11 seconds 00000100:00100000:3.0:1746129569.450533:0:20577:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a6ce8240 going to sleep for 11 seconds 00000100:00100000:2.0:1746129569.450775:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0ac9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746129569.453166:0:7085:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ede300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7085:1830948737490048:192.168.202.4@tcp:105: 00010000:00010000:1.0:1746129569.453188:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129569.453235:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090169180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+13:1961:x1830948734063360:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 2955us (3183us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129569.453244:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8199 00002000:00010000:2.0:1746129569.453819:0:4699:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb atime: 1746129569 -> 1746129570 00000100:00100000:2.0:1746129569.453846:0:4699:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090169f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4699:1830948737489920:192.168.202.4@tcp:106: 00010000:00010000:2.0:1746129569.453877:0:4699:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800915dcc00/0x40a459093b0698b7 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20cab expref: 31 pid: 4699 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129569.453898:0:4699:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800915dcc00/0x40a459093b0698b7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20cab expref: 31 pid: 4699 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129569.453911:0:4699:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800915dcc00, rc 0) 00000100:00100000:2.0:1746129569.453943:0:4699:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009016a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+30:1963:x1830948734063232:12345-192.168.202.4@tcp:101:cat.0 Request processed in 3689us (3935us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129569.453951:0:4699:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16018 00010000:00010000:3.0:1746129569.454384:0:20577:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.202.4@tcp) returned -22 from glimpse AST (req@ffff8800a07adf80 x1830948737489792) - normal race ns: filter-lustre-OST0001_UUID lock: ffff88009f2fe600/0x40a459093b069775 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1159168->1388543) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20be7 expref: 12 pid: 22480 timeout: 924 lvb_type: 0 00010000:00010000:3.0:1746129569.454410:0:20577:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f2fe600/0x40a459093b069775 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1159168->1388543) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20be7 expref: 12 pid: 22480 timeout: 924 lvb_type: 0 00000100:00100000:3.0:1746129569.454436:0:20577:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a07adf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20577:1830948737489792:192.168.202.4@tcp:106: 00010000:00010000:3.0:1746129569.454455:0:20577:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f891400/0x40a459093b0698b0 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20c9d expref: 11 pid: 20577 timeout: 0 lvb_type: 1 00002000:00010000:0.0:1746129569.454455:0:7149:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb atime: 1746129569 -> 1746129570 00010000:00010000:3.0:1746129569.454463:0:20577:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f891400/0x40a459093b0698b0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20c9d expref: 11 pid: 20577 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746129569.454465:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013575d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7149:1830948737489664:192.168.202.4@tcp:106: 00010000:00010000:3.0:1746129569.454469:0:20577:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f891400, rc 0) 00010000:00010000:0.0:1746129569.454482:0:7149:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f8d5a00/0x40a459093b0698a9 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20ca4 expref: 10 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129569.454490:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f8d5a00/0x40a459093b0698a9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20ca4 expref: 10 pid: 7149 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746129569.454491:0:20577:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090169880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+10:1963:x1830948734062976:12345-192.168.202.4@tcp:101:cat.0 Request processed in 4391us (4541us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129569.454496:0:20577:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16016 00010000:00010000:0.0:1746129569.454510:0:7149:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f8d5a00, rc 0) 00000100:00100000:0.0:1746129569.454527:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009016b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+8:1963:x1830948734063104:12345-192.168.202.4@tcp:101:cat.0 Request processed in 4421us (4541us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129569.454535:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16017 00010000:00010000:3.0:1746129569.458650:0:7089:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746129569.463595:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129569.463669:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734063616 00000100:00100000:2.0:1746129569.463679:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734063616 00000100:00100000:2.0:1746129569.463909:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16019 00000100:00100000:2.0:1746129569.463920:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090168a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:068dab75-d300-4ead-a742-d14572ad1e50+6:1962:x1830948734063616:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:2.0:1746129569.463939:0:7149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129569.463960:0:7149:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008e798600/0x40a459093b0698be lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20cb2 expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129569.463984:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129569.463986:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129569.463995:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e798600/0x40a459093b0698be lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20cb2 expref: 7 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129569.464011:0:7149:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008e798600/0x40a459093b0698be lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20cb2 expref: 7 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129569.464021:0:7149:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e798600, rc 0) 00000100:00100000:2.0:1746129569.464086:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090168a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:068dab75-d300-4ead-a742-d14572ad1e50+7:1962:x1830948734063616:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 169us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129569.464095:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16019 00000100:00100000:0.0:1746129569.465740:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129569.467378:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129569.467404:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129569.467481:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734063488 00000100:00100000:2.0:1746129569.467492:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734063488 00000100:00100000:2.0:1746129569.467550:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 788 00000100:00100000:2.0:1746129569.467558:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ede300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:068dab75-d300-4ead-a742-d14572ad1e50+12:1962:x1830948734063488:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129569.467575:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129569.467603:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8d5000/0x40a459093b0698a2 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20c96 expref: 12 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129569.467624:0:7085:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:2.0:1746129569.467629:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129569.467679:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ede300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:068dab75-d300-4ead-a742-d14572ad1e50+11:1962:x1830948734063488:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 121us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129569.467685:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 788 00000100:00100000:3.0:1746129569.468023:0:20577:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734063872 00000100:00100000:3.0:1746129569.468028:0:20577:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734063872 00000100:00100000:3.0:1746129569.468056:0:20577:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16020 00000100:00100000:3.0:1746129569.468061:0:20577:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009016ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:068dab75-d300-4ead-a742-d14572ad1e50+16:1962:x1830948734063872:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:3.0:1746129569.468075:0:20577:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129569.468090:0:20577:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f891000/0x40a459093b0698c5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20cc0 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129569.468141:0:20577:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a07adf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20577:1830948737490176:192.168.202.4@tcp:106: 00000100:00100000:3.0:1746129569.468195:0:20577:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a6ce8240 going to sleep for 11 seconds 00000100:00100000:0.0:1746129569.468340:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129569.468395:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129569.468403:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734064128 00000100:00100000:0.0:1746129569.468407:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734064128 00000100:00100000:1.0:1746129569.468410:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129569.468436:0:31520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734064512 00000100:00100000:0.0:1746129569.468438:0:31520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734064512 00000100:00100000:1.0:1746129569.468441:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00002000:00100000:0.0:1746129569.468464:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff880093edca80 x1830948734064512/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:310/0 lens 488/0 e 0 to 0 dl 1746129580 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129569.468474:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093edca80 with x1830948734064512 ext(1048576->2097151) 00002000:00010000:0.0:1746129569.468478:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093edca80 00000100:00100000:0.0:1746129569.468498:0:31520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734064640 00000100:00100000:0.0:1746129569.468500:0:31520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734064640 00002000:00100000:0.0:1746129569.468512:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3f4:0x0] (1048576->1961983) req@ffff880093edf100 x1830948734064640/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:310/0 lens 488/0 e 0 to 0 dl 1746129580 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129569.468519:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093edf100 with x1830948734064640 ext(1048576->1961983) 00002000:00010000:0.0:1746129569.468522:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093edf100 00000100:00100000:0.0:1746129569.468531:0:31520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734064896 00000100:00100000:0.0:1746129569.468533:0:31520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734064896 00002000:00100000:0.0:1746129569.468543:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3ee:0x0] (1257472->2097151) req@ffff880093edc700 x1830948734064896/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:310/0 lens 488/0 e 0 to 0 dl 1746129580 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129569.468549:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093edc700 with x1830948734064896 ext(1257472->2097151) 00002000:00010000:0.0:1746129569.468552:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093edc700 00000100:00100000:0.0:1746129569.468562:0:31520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7707 00000100:00100000:0.0:1746129569.468567:0:31520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093edca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ada2ffba-8920-4ecb-8068-68caa9806978+23:1960:x1830948734064512:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:1.0:1746129569.468711:0:31519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7708 00000100:00100000:1.0:1746129569.468718:0:31519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093edf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ada2ffba-8920-4ecb-8068-68caa9806978+23:1960:x1830948734064640:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129569.468887:0:21463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7709 00000100:00100000:0.0:1746129569.468892:0:21463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093edc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ada2ffba-8920-4ecb-8068-68caa9806978+38:1960:x1830948734064896:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129569.470593:0:2271:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11190 00000100:00100000:0.0:1746129569.470604:0:2271:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009016bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ada2ffba-8920-4ecb-8068-68caa9806978+307:32242:x1830948734064128:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:0.0:1746129569.470624:0:2271:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129569.470639:0:2271:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800915dc800/0x40a459093b0698cc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20cc7 expref: -99 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129569.470731:0:2271:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800915dc200/0x40a459093b0698d3 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129569.470748:0:2271:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa3800/0x40a459093b069824 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20c50 expref: 10 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129569.470755:0:2271:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094275200/0x40a459093b069871 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20c81 expref: 23 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129569.470761:0:2271:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800915dc200/0x40a459093b0698d3 lrc: 5/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129569.470793:0:2271:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094275200/0x40a459093b069871 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20c81 expref: 23 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129569.470804:0:2271:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094275200/0x40a459093b069871 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20c81 expref: 23 pid: 14549 timeout: 924 lvb_type: 0 00000100:00100000:0.0:1746129569.470816:0:2271:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090168000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:2271:1830948737490304:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129569.470888:0:2271:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa3800/0x40a459093b069824 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20c50 expref: 10 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129569.470896:0:2271:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa3800/0x40a459093b069824 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20c50 expref: 10 pid: 2271 timeout: 924 lvb_type: 0 00000100:00100000:0.0:1746129569.470904:0:2271:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009016b800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:2271:1830948737490432:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129569.470923:0:2271:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a586e9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746129569.474543:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734063744 00000100:00100000:3.0:1746129569.474560:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734063744 00000100:00100000:3.0:1746129569.474613:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16021 00000100:00100000:3.0:1746129569.474621:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093eddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:068dab75-d300-4ead-a742-d14572ad1e50+7:1962:x1830948734063744:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:3.0:1746129569.474645:0:7149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129569.474668:0:7149:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f891600/0x40a459093b0698da lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20cb9 expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129569.474723:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a07ad180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7149:1830948737490560:192.168.202.4@tcp:106: 00000100:00100000:3.0:1746129569.474819:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a6ce8e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746129569.481526:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129569.481608:0:4699:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734065024 00000100:00100000:0.0:1746129569.481619:0:4699:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734065024 00000100:00100000:0.0:1746129569.481678:0:4699:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16022 00000100:00100000:0.0:1746129569.481686:0:4699:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013575f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+8:32240:x1830948734065024:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129569.481706:0:4699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129569.481726:0:4699:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f599800/0x40a459093b0698e1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20cce expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129569.481756:0:4699:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129569.481758:0:4699:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129569.481765:0:4699:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f599800/0x40a459093b0698e1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20cce expref: 9 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129569.481785:0:4699:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f599800/0x40a459093b0698e1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20cce expref: 9 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129569.481794:0:4699:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f599800, rc 0) 00000100:00100000:0.0:1746129569.482265:0:4699:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013575f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+9:32240:x1830948734065024:12345-192.168.202.4@tcp:101:cat.0 Request processed in 577us (749us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129569.482271:0:4699:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16022 00000100:00100000:3.0:1746129569.494057:0:20577:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a07adf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20577:1830948737490176:192.168.202.4@tcp:106: 00010000:00010000:3.0:1746129569.494102:0:20577:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f891000/0x40a459093b0698c5 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20cc0 expref: 17 pid: 20577 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129569.494117:0:20577:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f891000/0x40a459093b0698c5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20cc0 expref: 17 pid: 20577 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129569.494145:0:20577:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f891000, rc 0) 00000100:00100000:3.0:1746129569.494212:0:20577:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009016ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:068dab75-d300-4ead-a742-d14572ad1e50+16:1962:x1830948734063872:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 26148us (28477us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129569.494225:0:20577:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16020 00000100:00100000:0.0:1746129569.494518:0:2271:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090168000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:2271:1830948737490304:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129569.494558:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129569.495090:0:31519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093edf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ada2ffba-8920-4ecb-8068-68caa9806978+24:1960:x1830948734064640:12345-192.168.202.4@tcp:3:cat.0 Request processed in 26372us (26677us total) trans 0 rc 913408/913408 00000100:00100000:1.0:1746129569.495099:0:31519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7708 00002000:00100000:1.0:1746129569.495108:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f4:0x0] (1048576->1961983) req@ffff880093edf100 x1830948734064640/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:310/0 lens 488/440 e 0 to 0 dl 1746129580 ref 1 fl Complete:/200/0 rc 913408/913408 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129569.495116:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093edf100 with x1830948734064640 ext(1048576->1961983) 00002000:00010000:1.0:1746129569.495121:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093edf100 00000100:00100000:0.0:1746129569.495976:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129569.496199:0:21463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093edc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ada2ffba-8920-4ecb-8068-68caa9806978+38:1960:x1830948734064896:12345-192.168.202.4@tcp:3:cat.0 Request processed in 27307us (27757us total) trans 0 rc 839680/839680 00000100:00100000:0.0:1746129569.496206:0:21463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7709 00002000:00100000:0.0:1746129569.496212:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3ee:0x0] (1257472->2097151) req@ffff880093edc700 x1830948734064896/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:310/0 lens 488/440 e 0 to 0 dl 1746129580 ref 1 fl Complete:/200/0 rc 839680/839680 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129569.496219:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093edc700 with x1830948734064896 ext(1257472->2097151) 00002000:00010000:0.0:1746129569.496223:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093edc700 00000100:00100000:1.0:1746129569.496631:0:2271:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009016b800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:2271:1830948737490432:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129569.496655:0:2271:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800915dc200/0x40a459093b0698d3 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00000100:00100000:3.0:1746129569.496740:0:20578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734065152 00000100:00100000:3.0:1746129569.496748:0:20578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734065152 00010000:00010000:3.0:1746129569.496776:0:20578:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094275200/0x40a459093b069871 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20c81 expref: 24 pid: 14549 timeout: 924 lvb_type: 0 00000100:00100000:3.0:1746129569.496794:0:20578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734065280 00000100:00100000:3.0:1746129569.496796:0:20578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734065280 00010000:00010000:3.0:1746129569.496804:0:20578:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa3800/0x40a459093b069824 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20c50 expref: 11 pid: 2271 timeout: 924 lvb_type: 0 00000100:00100000:3.0:1746129569.496816:0:20578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8200 00000100:00100000:3.0:1746129569.496821:0:20578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090169500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+24:1961:x1830948734065152:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129569.496833:0:20578:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129569.496839:0:20578:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094275200/0x40a459093b069871 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20c81 expref: 24 pid: 14549 timeout: 924 lvb_type: 0 00010000:00010000:3.0:1746129569.496849:0:20578:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094275200/0x40a459093b069871 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20c81 expref: 24 pid: 14549 timeout: 924 lvb_type: 0 00010000:00010000:3.0:1746129569.496870:0:20578:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094275200/0x40a459093b069871 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20c81 expref: 24 pid: 14549 timeout: 924 lvb_type: 0 00010000:00010000:3.0:1746129569.496885:0:20578:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:3.0:1746129569.496890:0:20578:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800915dc200/0x40a459093b0698d3 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129569.496899:0:20578:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800915dc200/0x40a459093b0698d3 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129569.496906:0:20578:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129569.496926:0:20578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090169500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+23:1961:x1830948734065152:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 105us (2369us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129569.496931:0:20578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8200 00000100:00100000:3.0:1746129569.496940:0:20578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8201 00000100:00100000:3.0:1746129569.496944:0:20578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090169c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:068dab75-d300-4ead-a742-d14572ad1e50+11:1962:x1830948734065280:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129569.496949:0:20578:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129569.496952:0:20578:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa3800/0x40a459093b069824 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20c50 expref: 11 pid: 2271 timeout: 924 lvb_type: 0 00010000:00010000:3.0:1746129569.496961:0:20578:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa3800/0x40a459093b069824 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20c50 expref: 11 pid: 2271 timeout: 924 lvb_type: 0 00010000:00010000:3.0:1746129569.496970:0:20578:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa3800/0x40a459093b069824 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20c50 expref: 11 pid: 2271 timeout: 924 lvb_type: 0 00010000:00010000:3.0:1746129569.496977:0:20578:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:3.0:1746129569.496980:0:20578:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800915dc200/0x40a459093b0698d3 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129569.496985:0:20578:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800915dc200/0x40a459093b0698d3 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129569.496991:0:20578:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800915dc200/0x40a459093b0698d3 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129569.497006:0:20578:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129569.497016:0:20578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090169c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:068dab75-d300-4ead-a742-d14572ad1e50+10:1962:x1830948734065280:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 72us (1042us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129569.497022:0:20578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8201 00010000:00010000:3.0:1746129569.497032:0:2271:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800915dc200/0x40a459093b0698d3 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129569.497038:0:2271:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800915dc200/0x40a459093b0698d3 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00000004:00200000:3.0:1746129569.497054:0:2271:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:3.0:1746129569.497191:0:2271:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800915dc800/0x40a459093b0698cc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20cc7 expref: 310 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129569.497203:0:2271:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800915dc200/0x40a459093b0698d3 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20cc7 expref: 309 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129569.497209:0:2271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:3.0:1746129569.497212:0:2271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746129569.497214:0:2271:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800915dc200, rc 0) 00000100:00100000:3.0:1746129569.497233:0:2271:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009016bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ada2ffba-8920-4ecb-8068-68caa9806978+309:32242:x1830948734064128:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 26632us (28893us total) trans 8589945281 rc 0/0 00000100:00100000:3.0:1746129569.497238:0:2271:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11190 00000100:00100000:0.0:1746129569.498118:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129569.498174:0:21463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734065536 00000100:00100000:1.0:1746129569.498180:0:21463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734065536 00002000:00100000:1.0:1746129569.498210:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff88009016b100 x1830948734065536/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:310/0 lens 488/0 e 0 to 0 dl 1746129580 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129569.498219:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009016b100 with x1830948734065536 ext(1048576->2097151) 00002000:00010000:1.0:1746129569.498225:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009016b100 00000100:00100000:1.0:1746129569.498240:0:21463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7710 00000100:00100000:1.0:1746129569.498246:0:21463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009016b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+9:1962:x1830948734065536:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:3.0:1746129569.500048:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a07ad180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7149:1830948737490560:192.168.202.4@tcp:106: 00010000:00010000:3.0:1746129569.500082:0:7149:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f891600/0x40a459093b0698da lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20cb9 expref: 8 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129569.500096:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f891600/0x40a459093b0698da lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20cb9 expref: 8 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129569.500112:0:7149:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f891600, rc 0) 00000100:00100000:3.0:1746129569.500139:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093eddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:068dab75-d300-4ead-a742-d14572ad1e50+7:1962:x1830948734063744:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 25519us (32733us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129569.500149:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16021 00000100:00100000:0.0:1746129569.502029:0:31520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093edca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ada2ffba-8920-4ecb-8068-68caa9806978+22:1960:x1830948734064512:12345-192.168.202.4@tcp:3:cat.0 Request processed in 33451us (33624us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129569.502040:0:31520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7707 00002000:00100000:0.0:1746129569.502052:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff880093edca80 x1830948734064512/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:310/0 lens 488/440 e 0 to 0 dl 1746129580 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129569.502068:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093edca80 with x1830948734064512 ext(1048576->2097151) 00002000:00010000:0.0:1746129569.502074:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093edca80 00000100:00100000:1.0:1746129569.513985:0:21463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009016b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+9:1962:x1830948734065536:12345-192.168.202.4@tcp:3:cat.0 Request processed in 15723us (15854us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129569.513998:0:21463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7710 00002000:00100000:1.0:1746129569.514013:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff88009016b100 x1830948734065536/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:310/0 lens 488/440 e 0 to 0 dl 1746129580 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129569.514022:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009016b100 with x1830948734065536 ext(1048576->2097151) 00002000:00010000:1.0:1746129569.514029:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009016b100 00000100:00100000:0.0:1746129569.515348:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129569.516028:0:2271:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734065664 00000100:00100000:3.0:1746129569.516038:0:2271:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734065664 00000100:00100000:3.0:1746129569.516085:0:2271:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11191 00000100:00100000:3.0:1746129569.516093:0:2271:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090168e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:068dab75-d300-4ead-a742-d14572ad1e50+10:32239:x1830948734065664:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:3.0:1746129569.516114:0:2271:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129569.516133:0:2271:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009efe8c00/0x40a459093b0698ef lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20cd5 expref: -99 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129569.516196:0:2271:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009efe8c00/0x40a459093b0698ef lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20cd5 expref: 11 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129569.516210:0:2271:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009efe8c00/0x40a459093b0698ef lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20cd5 expref: 11 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129569.516227:0:2271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:3.0:1746129569.516230:0:2271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746129569.516233:0:2271:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009efe8c00, rc 0) 00000100:00100000:3.0:1746129569.516289:0:2271:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090168e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:068dab75-d300-4ead-a742-d14572ad1e50+11:32239:x1830948734065664:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 196us (947us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129569.516314:0:2271:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11191 00000100:00100000:0.0:1746129569.517659:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129569.517737:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129569.518017:0:20577:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734065792 00000100:00100000:2.0:1746129569.518025:0:20577:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734065792 00000100:00100000:2.0:1746129569.518068:0:20577:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734065920 00000100:00100000:2.0:1746129569.518070:0:20577:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734065920 00000100:00100000:2.0:1746129569.518088:0:20577:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16023 00000100:00100000:2.0:1746129569.518094:0:20577:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009016aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ada2ffba-8920-4ecb-8068-68caa9806978+38:32242:x1830948734065792:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:2.0:1746129569.518110:0:20577:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129569.518124:0:20577:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a6de8e00/0x40a459093b0698f6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20cdc expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129569.518151:0:20577:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800915ddc00/0x40a459093b069744 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20bd2 expref: 39 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129569.518160:0:20577:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800915dde00/0x40a459093b0697d7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20c34 expref: 15 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129569.518167:0:20577:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d94e200/0x40a459093b069798 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20c0a expref: 29 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129569.518174:0:20577:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129569.518176:0:20577:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129569.518179:0:20577:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6de8e00/0x40a459093b0698f6 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [2605056->2785279] (req 2605056->2785279) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20cdc expref: 39 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129569.518211:0:20577:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d94e200/0x40a459093b069798 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20c0a expref: 29 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129569.518222:0:20577:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d94e200/0x40a459093b069798 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20c0a expref: 29 pid: 22480 timeout: 924 lvb_type: 0 00000100:00100000:2.0:1746129569.518235:0:20577:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013575f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20577:1830948737490688:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129569.518365:0:20577:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800915dde00/0x40a459093b0697d7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20c34 expref: 15 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129569.518374:0:20577:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800915dde00/0x40a459093b0697d7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20c34 expref: 15 pid: 22481 timeout: 924 lvb_type: 1 00000100:00100000:2.0:1746129569.518381:0:20577:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013575ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20577:1830948737490816:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129569.518404:0:20577:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800915ddc00/0x40a459093b069744 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20bd2 expref: 39 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129569.518410:0:20577:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800915ddc00/0x40a459093b069744 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20bd2 expref: 39 pid: 7149 timeout: 924 lvb_type: 0 00000100:00100000:2.0:1746129569.518416:0:20577:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013575e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20577:1830948737490944:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129569.518428:0:20577:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0aca80 going to sleep for 11 seconds 00000100:00100000:3.0:1746129569.518586:0:22481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16024 00000100:00100000:3.0:1746129569.518594:0:22481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009016a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+9:32240:x1830948734065920:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129569.518604:0:22481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129569.518613:0:22481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009efe8e00/0x40a459093b0698fd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20ce3 expref: -99 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129569.518629:0:22481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ee7fa00/0x40a459093b06980f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1961984->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20c49 expref: 21 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129569.518634:0:22481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129569.518636:0:22481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129569.518638:0:22481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009efe8e00/0x40a459093b0698fd lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20ce3 expref: 10 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129569.518653:0:22481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ee7fa00/0x40a459093b06980f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1961984->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20c49 expref: 21 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129569.518660:0:22481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ee7fa00/0x40a459093b06980f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1961984->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20c49 expref: 21 pid: 22481 timeout: 924 lvb_type: 0 00000100:00100000:3.0:1746129569.518668:0:22481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a07ad180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:22481:1830948737491072:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129569.518688:0:22481:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a6ce8e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746129569.519062:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129569.519246:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734066176 00000100:00100000:0.0:1746129569.519251:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734066176 00000100:00100000:0.0:1746129569.519288:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11192 00000100:00100000:0.0:1746129569.519310:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013575d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:068dab75-d300-4ead-a742-d14572ad1e50+11:32239:x1830948734066176:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:0.0:1746129569.519320:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129569.519343:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f599200/0x40a459093b069904 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20cea expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129569.519447:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f599000/0x40a459093b06990b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129569.519459:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f599000/0x40a459093b06990b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129569.519469:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f599000/0x40a459093b06990b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129569.519480:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f598e00/0x40a459093b069912 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129569.519486:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f598e00/0x40a459093b069912 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129569.519491:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f598e00/0x40a459093b069912 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129569.519606:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f598c00/0x40a459093b069919 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129569.519615:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f598c00/0x40a459093b069919 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129569.519620:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f598c00/0x40a459093b069919 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00200000:0.0:1746129569.519629:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:0.0:1746129569.519710:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f599000/0x40a459093b06990b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129569.519717:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f599000/0x40a459093b06990b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129569.519723:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f599000/0x40a459093b06990b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129569.519729:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f599000 already unused, calling callback (ffffffffa136e690) 00010000:00010000:0.0:1746129569.519732:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f599000/0x40a459093b06990b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129569.519738:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f599000/0x40a459093b06990b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129569.519751:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880132ef8f00) 00010000:00010000:0.0:1746129569.519754:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129569.519757:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f599000/0x40a459093b06990b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129569.519762:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f599000/0x40a459093b06990b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129569.519790:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f598e00/0x40a459093b069912 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129569.519795:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f598e00/0x40a459093b069912 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129569.519800:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f598e00/0x40a459093b069912 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129569.519803:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f598e00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:0.0:1746129569.519805:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f598e00/0x40a459093b069912 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129569.519809:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f598e00/0x40a459093b069912 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129569.519814:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f469200) 00010000:00010000:0.0:1746129569.519816:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129569.519818:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f598e00/0x40a459093b069912 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129569.519822:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f598e00/0x40a459093b069912 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129569.519855:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f599200/0x40a459093b069904 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20cea expref: 14 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129569.519864:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f598c00/0x40a459093b069919 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20cea expref: 13 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129569.519870:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:0.0:1746129569.519872:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746129569.519874:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f598c00, rc 0) 00000100:00100000:0.0:1746129569.519910:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013575d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:068dab75-d300-4ead-a742-d14572ad1e50+13:32239:x1830948734066176:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 616us (848us total) trans 8589945282 rc 0/0 00000100:00100000:0.0:1746129569.519916:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11192 00000100:00100000:3.0:1746129569.523850:0:22481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a07ad180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:22481:1830948737491072:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129569.523892:0:22481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009efe8e00/0x40a459093b0698fd lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20ce3 expref: 10 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129569.523915:0:22481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009efe8e00, rc 0) 00000100:00100000:3.0:1746129569.523993:0:22481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009016a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+10:32240:x1830948734065920:12345-192.168.202.4@tcp:101:cat.0 Request processed in 5398us (6254us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129569.524003:0:22481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16024 00000100:00100000:3.0:1746129569.524061:0:20577:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013575f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20577:1830948737490688:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129569.524069:0:20577:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013575ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20577:1830948737490816:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129569.524077:0:20577:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013575e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20577:1830948737490944:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129569.524095:0:20577:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a6de8e00/0x40a459093b0698f6 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [2605056->2785279] (req 2605056->2785279) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20cdc expref: 39 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129569.524105:0:20577:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6de8e00, rc 0) 00000100:00100000:3.0:1746129569.524125:0:20577:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009016aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ada2ffba-8920-4ecb-8068-68caa9806978+39:32242:x1830948734065792:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 6031us (6473us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129569.524130:0:20577:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16023 00000100:00100000:0.0:1746129569.525229:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129569.525283:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734066304 00000100:00100000:0.0:1746129569.525343:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129569.525365:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129569.525398:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129569.525417:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129569.525431:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129569.525452:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129569.525467:0:4699:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734066944 00000100:00100000:1.0:1746129569.525475:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734066304 00000100:00100000:0.0:1746129569.525475:0:4699:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734066944 00010000:00010000:1.0:1746129569.525505:0:7087:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800915dde00/0x40a459093b0697d7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20c34 expref: 17 pid: 22481 timeout: 924 lvb_type: 1 00000100:00100000:0.0:1746129569.525505:0:4699:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734066816 00000100:00100000:0.0:1746129569.525506:0:4699:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734066816 00000100:00100000:0.0:1746129569.525518:0:4699:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734067072 00000100:00100000:0.0:1746129569.525519:0:4699:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734067072 00000100:00100000:1.0:1746129569.525522:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734066560 00000100:00100000:1.0:1746129569.525524:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734066560 00000100:00100000:0.0:1746129569.525530:0:4699:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16025 00010000:00010000:1.0:1746129569.525532:0:7087:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800915ddc00/0x40a459093b069744 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20bd2 expref: 39 pid: 7149 timeout: 924 lvb_type: 0 00000100:00100000:0.0:1746129569.525536:0:4699:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800903a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:068dab75-d300-4ead-a742-d14572ad1e50+18:1960:x1830948734066944:12345-192.168.202.4@tcp:101:lfs.0 00000100:00100000:1.0:1746129569.525542:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734066432 00000100:00100000:1.0:1746129569.525544:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734066432 00010000:00010000:0.0:1746129569.525550:0:4699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129569.525551:0:7087:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d94e200/0x40a459093b069798 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20c0a expref: 30 pid: 22480 timeout: 924 lvb_type: 0 00000100:00100000:1.0:1746129569.525562:0:7087:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8202 00000100:00100000:1.0:1746129569.525565:0:7087:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009016b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:068dab75-d300-4ead-a742-d14572ad1e50+18:1962:x1830948734066304:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129569.525565:0:4699:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f598200/0x40a459093b069927 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20cf8 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129569.525577:0:7087:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129569.525597:0:7087:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800915dde00/0x40a459093b0697d7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20c34 expref: 19 pid: 22481 timeout: 924 lvb_type: 1 00000100:00100000:0.0:1746129569.525604:0:4699:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800903a0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4699:1830948737491200:192.168.202.4@tcp:106: 00010000:00010000:1.0:1746129569.525605:0:7087:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800915dde00/0x40a459093b0697d7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20c34 expref: 19 pid: 22481 timeout: 924 lvb_type: 1 00010000:00010000:1.0:1746129569.525622:0:7087:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800915dde00/0x40a459093b0697d7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20c34 expref: 19 pid: 22481 timeout: 924 lvb_type: 1 00010000:00010000:1.0:1746129569.525637:0:7087:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129569.525650:0:7087:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009016b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:068dab75-d300-4ead-a742-d14572ad1e50+18:1962:x1830948734066304:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 85us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129569.525656:0:7087:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8202 00000100:00100000:0.0:1746129569.525662:0:4699:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a586ec00 going to sleep for 11 seconds 00000100:00100000:1.0:1746129569.525667:0:7087:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8203 00000100:00100000:1.0:1746129569.525671:0:7087:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090168000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ada2ffba-8920-4ecb-8068-68caa9806978+39:1962:x1830948734066560:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129569.525678:0:7087:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746129569.525678:0:22480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16026 00000100:00100000:0.0:1746129569.525683:0:22480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800903a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:068dab75-d300-4ead-a742-d14572ad1e50+7:1960:x1830948734066816:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:1.0:1746129569.525684:0:7087:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800915ddc00/0x40a459093b069744 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20bd2 expref: 39 pid: 7149 timeout: 924 lvb_type: 0 00010000:00010000:0.0:1746129569.525690:0:22480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129569.525692:0:7087:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800915ddc00/0x40a459093b069744 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20bd2 expref: 39 pid: 7149 timeout: 924 lvb_type: 0 00010000:00010000:0.0:1746129569.525699:0:22480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f599a00/0x40a459093b06992e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20cf1 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129569.525702:0:7087:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800915ddc00/0x40a459093b069744 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20bd2 expref: 39 pid: 7149 timeout: 924 lvb_type: 0 00010000:00010000:1.0:1746129569.525714:0:7087:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129569.525722:0:22480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800903a0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22480:1830948737491328:192.168.202.4@tcp:106: 00000100:00100000:1.0:1746129569.525726:0:7087:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090168000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ada2ffba-8920-4ecb-8068-68caa9806978+38:1962:x1830948734066560:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 54us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129569.525730:0:7087:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8203 00000100:00100000:0.0:1746129569.525738:0:22480:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a586e9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746129569.525739:0:7087:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8204 00000100:00100000:1.0:1746129569.525743:0:7087:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6ce3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+30:1962:x1830948734066432:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129569.525748:0:7087:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129569.525754:0:7087:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d94e200/0x40a459093b069798 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20c0a expref: 30 pid: 22480 timeout: 924 lvb_type: 0 00010000:00010000:1.0:1746129569.525761:0:7087:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d94e200/0x40a459093b069798 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20c0a expref: 30 pid: 22480 timeout: 924 lvb_type: 0 00010000:00010000:1.0:1746129569.525772:0:7087:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d94e200/0x40a459093b069798 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20c0a expref: 30 pid: 22480 timeout: 924 lvb_type: 0 00010000:00010000:1.0:1746129569.525780:0:7087:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129569.525782:0:7087:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129569.525789:0:7087:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a6de8e00/0x40a459093b0698f6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2605056->2785279) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20cdc expref: 37 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129569.525796:0:7087:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6de8e00/0x40a459093b0698f6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2605056->2785279) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20cdc expref: 37 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129569.525818:0:7087:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a6de8e00/0x40a459093b0698f6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2605056->2785279) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20cdc expref: 37 pid: 20577 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129569.525826:0:7087:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135725500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7087:1830948737491456:192.168.202.4@tcp:105: 00000100:00100000:1.0:1746129569.525846:0:7087:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ac5a49c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746129569.525870:0:21463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734066688 00000100:00100000:1.0:1746129569.525873:0:21463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734066688 00002000:00100000:1.0:1746129569.525899:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3f4:0x0] (1961984->2097151) req@ffff880090169f80 x1830948734066688/t0(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:310/0 lens 488/0 e 0 to 0 dl 1746129580 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129569.525908:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090169f80 with x1830948734066688 ext(1961984->2097151) 00010000:00010000:1.0:1746129569.525913:0:21463:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ee7fa00/0x40a459093b06980f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1961984->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20c49 expref: 22 pid: 22481 timeout: 924 lvb_type: 0 00010000:00010000:1.0:1746129569.525922:0:21463:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ee7fa00/0x40a459093b06980f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1961984->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20c49 expref: 22 pid: 22481 timeout: 924 lvb_type: 0 00002000:00010000:1.0:1746129569.525927:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880090169f80 00000100:00100000:1.0:1746129569.525940:0:21463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2403 00000100:00100000:1.0:1746129569.525945:0:21463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090169f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ada2ffba-8920-4ecb-8068-68caa9806978+22:1962:x1830948734066688:12345-192.168.202.4@tcp:4:multiop.0 00000100:00100000:3.0:1746129569.525992:0:22481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16027 00000100:00100000:3.0:1746129569.525998:0:22481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800903a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:068dab75-d300-4ead-a742-d14572ad1e50+17:1960:x1830948734067072:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:3.0:1746129569.526004:0:22481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129569.526010:0:22481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009efe9000/0x40a459093b069935 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20cff expref: -99 pid: 22481 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129569.526033:0:22481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a07ad180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:22481:1830948737491584:192.168.202.4@tcp:106: 00000100:00100000:3.0:1746129569.526770:0:22481:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a6ce8e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746129569.531116:0:4699:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800903a0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4699:1830948737491200:192.168.202.4@tcp:106: 00010000:00010000:0.0:1746129569.531154:0:4699:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f598200/0x40a459093b069927 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20cf8 expref: 18 pid: 4699 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129569.531170:0:4699:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f598200/0x40a459093b069927 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20cf8 expref: 18 pid: 4699 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129569.531198:0:4699:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f598200, rc 0) 00000100:00100000:0.0:1746129569.531254:0:4699:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800903a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:068dab75-d300-4ead-a742-d14572ad1e50+17:1960:x1830948734066944:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 5716us (5834us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129569.531262:0:4699:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16025 00000100:00100000:0.0:1746129569.531381:0:22480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800903a0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22480:1830948737491328:192.168.202.4@tcp:106: 00010000:00010000:0.0:1746129569.531397:0:22480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f599a00/0x40a459093b06992e lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20cf1 expref: 8 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129569.531406:0:22480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f599a00/0x40a459093b06992e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20cf1 expref: 8 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129569.531415:0:22480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f599a00, rc 0) 00000100:00100000:0.0:1746129569.531431:0:22480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800903a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:068dab75-d300-4ead-a742-d14572ad1e50+7:1960:x1830948734066816:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 5748us (5999us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129569.531436:0:22480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16026 00000100:00100000:0.0:1746129569.531547:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129569.531562:0:31520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734067328 00000100:00100000:0.0:1746129569.531568:0:31520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734067328 00002000:00100000:0.0:1746129569.531593:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3ef:0x0] (2605056->2609151) req@ffff8800903a0e00 x1830948734067328/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:310/0 lens 488/0 e 0 to 0 dl 1746129580 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129569.531601:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800903a0e00 with x1830948734067328 ext(2605056->2609151) 00002000:00010000:0.0:1746129569.531606:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800903a0e00 00000100:00100000:0.0:1746129569.531624:0:31519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7711 00000100:00100000:0.0:1746129569.531630:0:31519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800903a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ada2ffba-8920-4ecb-8068-68caa9806978+38:1963:x1830948734067328:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:0.0:1746129569.531742:0:31519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800903a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ada2ffba-8920-4ecb-8068-68caa9806978+38:1963:x1830948734067328:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 113us (196us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746129569.531748:0:31519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7711 00002000:00100000:0.0:1746129569.531752:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3ef:0x0] (2605056->2609151) req@ffff8800903a0e00 x1830948734067328/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:310/0 lens 488/4536 e 0 to 0 dl 1746129580 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129569.531759:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800903a0e00 with x1830948734067328 ext(2605056->2609151) 00002000:00010000:0.0:1746129569.531761:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800903a0e00 00002000:00010000:3.0:1746129569.532039:0:22481:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb atime: 1746129569 -> 1746129570 00000100:00100000:3.0:1746129569.532059:0:22481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a07ad180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:22481:1830948737491584:192.168.202.4@tcp:106: 00010000:00010000:3.0:1746129569.532086:0:22481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009efe9000/0x40a459093b069935 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20cff expref: 16 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129569.532103:0:22481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009efe9000/0x40a459093b069935 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20cff expref: 16 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129569.532120:0:22481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009efe9000, rc 0) 00000100:00100000:3.0:1746129569.532179:0:22481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800903a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:068dab75-d300-4ead-a742-d14572ad1e50+15:1960:x1830948734067072:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 6179us (6724us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129569.532186:0:22481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16027 00000100:00100000:1.0:1746129569.532284:0:7087:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135725500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7087:1830948737491456:192.168.202.4@tcp:105: 00010000:00010000:1.0:1746129569.532321:0:7087:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129569.532356:0:7087:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6ce3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+29:1962:x1830948734066432:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 6611us (6989us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129569.532364:0:7087:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8204 00000100:00100000:2.0:1746129569.536240:0:21463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090169f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ada2ffba-8920-4ecb-8068-68caa9806978+24:1962:x1830948734066688:12345-192.168.202.4@tcp:4:multiop.0 Request processed in 10278us (10824us total) trans 17179874086 rc 0/0 00000100:00100000:2.0:1746129569.536255:0:21463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2403 00002000:00100000:2.0:1746129569.536269:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3f4:0x0] (1961984->2097151) req@ffff880090169f80 x1830948734066688/t17179874086(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:310/0 lens 488/448 e 0 to 0 dl 1746129580 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129569.536279:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090169f80 with x1830948734066688 ext(1961984->2097151) 00010000:00010000:2.0:1746129569.536535:0:21463:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ee7fa00/0x40a459093b06980f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1961984->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20c49 expref: 24 pid: 22481 timeout: 924 lvb_type: 0 00010000:00010000:2.0:1746129569.536553:0:21463:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ee7fa00/0x40a459093b06980f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1961984->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20c49 expref: 24 pid: 22481 timeout: 924 lvb_type: 0 00002000:00010000:2.0:1746129569.536561:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880090169f80 00000100:00100000:0.0:1746129569.536975:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129569.537025:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129569.537095:0:22481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734067456 00000100:00100000:3.0:1746129569.537126:0:22481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734067456 00000100:00100000:3.0:1746129569.537569:0:22481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16028 00000100:00100000:3.0:1746129569.537577:0:22481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800903a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+10:32232:x1830948734067456:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:3.0:1746129569.537595:0:22481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129569.537612:0:22481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009efe9400/0x40a459093b06993c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20d06 expref: -99 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129569.537638:0:22481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129569.537643:0:22481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009efe8e00/0x40a459093b0698fd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20ce3 expref: 11 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129569.537649:0:22481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746129569.537653:0:22481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009efe9400/0x40a459093b06993c lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [1884160->2097151] (req 1884160->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20d06 expref: 11 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129569.537690:0:22481:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009efe8e00/0x40a459093b0698fd lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20ce3 expref: 11 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129569.537707:0:22481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009efe9400/0x40a459093b06993c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [1884160->2097151] (req 1884160->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20d06 expref: 11 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129569.537717:0:22481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009efe9400, rc 0) 00000100:00100000:2.0:1746129569.537834:0:21463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734067712 00000100:00100000:2.0:1746129569.537838:0:21463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734067712 00002000:00100000:2.0:1746129569.537867:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3ef:0x0] (2781184->2785279) req@ffff8800903a2d80 x1830948734067712/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:310/0 lens 488/0 e 0 to 0 dl 1746129580 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129569.537882:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800903a2d80 with x1830948734067712 ext(2781184->2785279) 00002000:00010000:2.0:1746129569.537885:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800903a2d80 00000100:00100000:2.0:1746129569.538070:0:21463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7712 00000100:00100000:2.0:1746129569.538076:0:21463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800903a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ada2ffba-8920-4ecb-8068-68caa9806978+38:1962:x1830948734067712:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:2.0:1746129569.538602:0:21463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800903a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ada2ffba-8920-4ecb-8068-68caa9806978+38:1962:x1830948734067712:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 524us (1575us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129569.538609:0:21463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7712 00002000:00100000:2.0:1746129569.538615:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3ef:0x0] (2781184->2785279) req@ffff8800903a2d80 x1830948734067712/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:310/0 lens 488/4536 e 0 to 0 dl 1746129580 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129569.538623:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800903a2d80 with x1830948734067712 ext(2781184->2785279) 00002000:00010000:2.0:1746129569.538626:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800903a2d80 00000100:00100000:0.0:1746129569.538796:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129569.539080:0:22481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800903a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+11:32232:x1830948734067456:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 1503us (2106us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129569.539087:0:22481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16028 00000100:00100000:3.0:1746129569.539109:0:2271:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734067968 00000100:00100000:3.0:1746129569.539113:0:2271:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734067968 00000100:00100000:3.0:1746129569.539248:0:2271:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11193 00000100:00100000:3.0:1746129569.539254:0:2271:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800903a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:068dab75-d300-4ead-a742-d14572ad1e50+13:32239:x1830948734067968:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:3.0:1746129569.539270:0:2271:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129569.539285:0:2271:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009efe8200/0x40a459093b069943 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20d0d expref: -99 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129569.539398:0:2271:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009efe9a00/0x40a459093b06994a lrc: 3/0,1 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129569.539413:0:2271:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800915dc200/0x40a459093b0698d3 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20cc7 expref: 308 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129569.539419:0:2271:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009efe9a00/0x40a459093b06994a lrc: 4/0,1 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129569.539443:0:2271:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800915dc200/0x40a459093b0698d3 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20cc7 expref: 308 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129569.539458:0:2271:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800915dc200/0x40a459093b0698d3 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20cc7 expref: 308 pid: 2271 timeout: 924 lvb_type: 0 00000100:00100000:3.0:1746129569.539470:0:2271:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a07ad180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:2271:1830948737491840:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129569.539532:0:2271:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a6ce8e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746129569.540269:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129569.540734:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734068096 00000100:00100000:1.0:1746129569.540740:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734068096 00010000:00010000:1.0:1746129569.540767:0:7087:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ee7fa00/0x40a459093b06980f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1961984->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20c49 expref: 24 pid: 22481 timeout: 924 lvb_type: 0 00000100:00100000:1.0:1746129569.540804:0:7087:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8205 00000100:00100000:1.0:1746129569.540811:0:7087:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800903a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ada2ffba-8920-4ecb-8068-68caa9806978+24:1963:x1830948734068096:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129569.540822:0:7087:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129569.540841:0:7087:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ee7fa00/0x40a459093b06980f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1961984->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20c49 expref: 24 pid: 22481 timeout: 924 lvb_type: 0 00010000:00010000:1.0:1746129569.540850:0:7087:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ee7fa00/0x40a459093b06980f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1961984->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20c49 expref: 24 pid: 22481 timeout: 924 lvb_type: 0 00010000:00010000:1.0:1746129569.540869:0:7087:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ee7fa00/0x40a459093b06980f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1961984->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20c49 expref: 24 pid: 22481 timeout: 924 lvb_type: 0 00010000:00010000:1.0:1746129569.540899:0:7087:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129569.540902:0:7087:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129569.540909:0:7087:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009efe8e00/0x40a459093b0698fd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60080000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20ce3 expref: 10 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129569.540915:0:7087:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009efe8e00/0x40a459093b0698fd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60080000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20ce3 expref: 10 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129569.540938:0:7087:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009efe8e00/0x40a459093b0698fd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20ce3 expref: 10 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129569.540948:0:7087:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009efe8e00/0x40a459093b0698fd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20ce3 expref: 10 pid: 22481 timeout: 924 lvb_type: 0 00000100:00100000:1.0:1746129569.540962:0:7087:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135725500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7087:1830948737491968:192.168.202.4@tcp:105: 00000100:00100000:1.0:1746129569.541023:0:7087:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ac5a4c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746129569.543655:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129569.543810:0:21463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734068352 00000100:00100000:2.0:1746129569.543821:0:21463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734068352 00002000:00100000:2.0:1746129569.543869:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3ef:0x0] (2097152->2605055) req@ffff8800903a3b80 x1830948734068352/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:310/0 lens 488/0 e 0 to 0 dl 1746129580 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129569.543881:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800903a3b80 with x1830948734068352 ext(2097152->2605055) 00002000:00010000:2.0:1746129569.543886:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800903a3b80 00000100:00100000:2.0:1746129569.544246:0:21463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7713 00000100:00100000:2.0:1746129569.544254:0:21463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800903a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ada2ffba-8920-4ecb-8068-68caa9806978+38:1962:x1830948734068352:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:3.0:1746129569.545249:0:2271:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a07ad180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:2271:1830948737491840:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129569.545274:0:2271:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009efe9a00/0x40a459093b06994a lrc: 3/0,1 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00000100:00100000:0.0:1746129569.546072:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129569.546156:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129569.546176:0:20861:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734068736 00000100:00100000:0.0:1746129569.546183:0:20861:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734068736 00000100:00100000:0.0:1746129569.546221:0:20861:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4743 00000100:00100000:0.0:1746129569.546228:0:20861:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800903a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:ada2ffba-8920-4ecb-8068-68caa9806978+309:32242:x1830948734068736:12345-192.168.202.4@tcp:35:multiop.0 00000100:00100000:0.0:1746129569.546497:0:20861:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800903a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:ada2ffba-8920-4ecb-8068-68caa9806978+310:32242:x1830948734068736:12345-192.168.202.4@tcp:35:multiop.0 Request processed in 268us (339us total) trans 8589945283 rc 0/0 00000100:00100000:0.0:1746129569.546503:0:20861:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4743 00000100:00100000:1.0:1746129569.547127:0:7087:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135725500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7087:1830948737491968:192.168.202.4@tcp:105: 00010000:00010000:1.0:1746129569.547148:0:7087:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129569.547175:0:7087:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800903a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ada2ffba-8920-4ecb-8068-68caa9806978+23:1963:x1830948734068096:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 6364us (6907us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129569.547183:0:7087:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8205 00000100:00100000:1.0:1746129569.547201:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734068480 00000100:00100000:1.0:1746129569.547204:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734068480 00010000:00010000:1.0:1746129569.547219:0:7087:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800915dc200/0x40a459093b0698d3 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20cc7 expref: 310 pid: 2271 timeout: 924 lvb_type: 0 00000100:00100000:1.0:1746129569.547238:0:7087:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8206 00000100:00100000:1.0:1746129569.547243:0:7087:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800903a0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ada2ffba-8920-4ecb-8068-68caa9806978+310:1962:x1830948734068480:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129569.547251:0:7087:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129569.547256:0:7087:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800915dc200/0x40a459093b0698d3 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20cc7 expref: 310 pid: 2271 timeout: 924 lvb_type: 0 00010000:00010000:1.0:1746129569.547265:0:7087:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800915dc200/0x40a459093b0698d3 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20cc7 expref: 310 pid: 2271 timeout: 924 lvb_type: 0 00010000:00010000:1.0:1746129569.547286:0:7087:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800915dc200/0x40a459093b0698d3 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20cc7 expref: 310 pid: 2271 timeout: 924 lvb_type: 0 00010000:00010000:1.0:1746129569.547322:0:7087:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:1.0:1746129569.547338:0:7087:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009efe9a00/0x40a459093b06994a lrc: 3/0,1 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00010000:00010000:1.0:1746129569.547348:0:7087:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009efe9a00/0x40a459093b06994a lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 2271 initiator: MDT0 00010000:00010000:1.0:1746129569.547353:0:7087:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009efe9a00/0x40a459093b06994a lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 2271 initiator: MDT0 00010000:00010000:1.0:1746129569.547373:0:7087:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129569.547388:0:7087:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800903a0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ada2ffba-8920-4ecb-8068-68caa9806978+309:1962:x1830948734068480:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 145us (1320us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129569.547394:0:7087:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8206 00010000:00010000:3.0:1746129569.547919:0:2271:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009efe9a00/0x40a459093b06994a lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129569.547928:0:2271:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009efe9a00/0x40a459093b06994a lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129569.547945:0:2271:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009efe9a00/0x40a459093b06994a lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129569.547950:0:2271:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009efe9a00/0x40a459093b06994a lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210400000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129569.547955:0:2271:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009efe9a00/0x40a459093b06994a lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129569.547960:0:2271:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009efe9a00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:3.0:1746129569.547964:0:2271:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009efe9a00/0x40a459093b06994a lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129569.547969:0:2271:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009efe9a00/0x40a459093b06994a lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40218400000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129569.547981:0:2271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:3.0:1746129569.547983:0:2271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746129569.547986:0:2271:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009efe9a00/0x40a459093b06994a lrc: 2/0,0 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129569.547990:0:2271:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009efe9a00/0x40a459093b06994a lrc: 0/0,0 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129569.548030:0:2271:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009efe8200/0x40a459093b069943 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x1/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20d0d expref: 14 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129569.548037:0:2271:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009efe8200/0x40a459093b069943 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x1/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20d0d expref: 14 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129569.548046:0:2271:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009efe8200, rc 0) 00000100:00100000:3.0:1746129569.548069:0:2271:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800903a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:068dab75-d300-4ead-a742-d14572ad1e50+13:32239:x1830948734067968:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 8815us (9273us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129569.548076:0:2271:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11193 00000100:00100000:2.0:1746129569.551229:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129569.552109:0:31520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734068992 00000100:00100000:1.0:1746129569.552121:0:31520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734068992 00002000:00100000:1.0:1746129569.552169:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3f4:0x0] (1048576->2097151) req@ffff88013575f480 x1830948734068992/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:310/0 lens 488/0 e 0 to 0 dl 1746129580 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129569.552180:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013575f480 with x1830948734068992 ext(1048576->2097151) 00010000:00010000:1.0:1746129569.552189:0:31520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009efe8e00/0x40a459093b0698fd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20ce3 expref: 11 pid: 22481 timeout: 924 lvb_type: 0 00010000:00010000:1.0:1746129569.552203:0:31520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009efe8e00/0x40a459093b0698fd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20ce3 expref: 11 pid: 22481 timeout: 924 lvb_type: 0 00002000:00010000:1.0:1746129569.552210:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88013575f480 00000100:00100000:1.0:1746129569.552667:0:31520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2404 00000100:00100000:1.0:1746129569.552675:0:31520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013575f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+11:1963:x1830948734068992:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:3.0:1746129569.554350:0:21463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800903a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ada2ffba-8920-4ecb-8068-68caa9806978+38:1962:x1830948734068352:12345-192.168.202.4@tcp:3:cat.0 Request processed in 10087us (10696us total) trans 0 rc 507904/507904 00000100:00100000:3.0:1746129569.554363:0:21463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7713 00002000:00100000:3.0:1746129569.554375:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3ef:0x0] (2097152->2605055) req@ffff8800903a3b80 x1830948734068352/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:310/0 lens 488/440 e 0 to 0 dl 1746129580 ref 1 fl Complete:/200/0 rc 507904/507904 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129569.554384:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800903a3b80 with x1830948734068352 ext(2097152->2605055) 00002000:00010000:3.0:1746129569.554390:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800903a3b80 00000100:00100000:0.0:1746129569.558236:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129569.559217:0:16680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734069248 00000100:00100000:1.0:1746129569.559228:0:16680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734069248 00000100:00100000:1.0:1746129569.559273:0:16680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4744 00000100:00100000:1.0:1746129569.559281:0:16680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095f14850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:068dab75-d300-4ead-a742-d14572ad1e50+13:32239:x1830948734069248:12345-192.168.202.4@tcp:35:lfs.0 00000100:00100000:1.0:1746129569.559533:0:16680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095f14850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:068dab75-d300-4ead-a742-d14572ad1e50+14:32239:x1830948734069248:12345-192.168.202.4@tcp:35:lfs.0 Request processed in 252us (1307us total) trans 8589945284 rc 0/0 00000100:00100000:1.0:1746129569.559540:0:16680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4744 00000100:00100000:3.0:1746129569.570937:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129569.571788:0:21463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734069504 00000100:00100000:2.0:1746129569.571801:0:21463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734069504 00002000:00100000:2.0:1746129569.571854:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3ef:0x0] (2785280->3145727) req@ffff8800a07ad180 x1830948734069504/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:310/0 lens 488/0 e 0 to 0 dl 1746129580 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129569.571866:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a07ad180 with x1830948734069504 ext(2785280->3145727) 00002000:00010000:2.0:1746129569.571873:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a07ad180 00000100:00100000:2.0:1746129569.571898:0:21463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7714 00000100:00100000:2.0:1746129569.571907:0:21463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a07ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ada2ffba-8920-4ecb-8068-68caa9806978+38:1960:x1830948734069504:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:3.0:1746129569.573811:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129569.574471:0:31520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013575f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+11:1963:x1830948734068992:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 21793us (24044us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129569.574482:0:31520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2404 00002000:00100000:1.0:1746129569.574492:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3f4:0x0] (1048576->2097151) req@ffff88013575f480 x1830948734068992/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:310/0 lens 488/440 e 0 to 0 dl 1746129580 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129569.574501:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013575f480 with x1830948734068992 ext(1048576->2097151) 00010000:00010000:1.0:1746129569.574512:0:31520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009efe8e00/0x40a459093b0698fd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20ce3 expref: 11 pid: 22481 timeout: 924 lvb_type: 0 00010000:00010000:1.0:1746129569.574525:0:31520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009efe8e00/0x40a459093b0698fd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20ce3 expref: 11 pid: 22481 timeout: 924 lvb_type: 0 00002000:00010000:1.0:1746129569.574532:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88013575f480 00000100:00100000:1.0:1746129569.574554:0:31520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734069760 00000100:00100000:1.0:1746129569.574559:0:31520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734069760 00002000:00100000:1.0:1746129569.574584:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->4194303) req@ffff8800a07adf80 x1830948734069760/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:310/0 lens 488/0 e 0 to 0 dl 1746129580 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129569.574591:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a07adf80 with x1830948734069760 ext(3145728->4194303) 00002000:00010000:1.0:1746129569.574594:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a07adf80 00000100:00100000:1.0:1746129569.574610:0:31520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7715 00000100:00100000:1.0:1746129569.574616:0:31520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a07adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ada2ffba-8920-4ecb-8068-68caa9806978+40:1960:x1830948734069760:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:3.0:1746129569.585657:0:21463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a07ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ada2ffba-8920-4ecb-8068-68caa9806978+40:1960:x1830948734069504:12345-192.168.202.4@tcp:3:cat.0 Request processed in 13740us (14719us total) trans 0 rc 360448/360448 00000100:00100000:3.0:1746129569.585669:0:21463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7714 00002000:00100000:3.0:1746129569.585681:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3ef:0x0] (2785280->3145727) req@ffff8800a07ad180 x1830948734069504/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:310/0 lens 488/440 e 0 to 0 dl 1746129580 ref 1 fl Complete:/200/0 rc 360448/360448 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129569.585690:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a07ad180 with x1830948734069504 ext(2785280->3145727) 00002000:00010000:3.0:1746129569.585696:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a07ad180 00000100:00100000:0.0:1746129569.588397:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129569.588438:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129569.588650:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734070016 00000100:00100000:2.0:1746129569.588659:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734070016 00010000:00010000:2.0:1746129569.588697:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009efe8e00/0x40a459093b0698fd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20ce3 expref: 11 pid: 22481 timeout: 924 lvb_type: 0 00000100:00100000:2.0:1746129569.588848:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8207 00000100:00100000:2.0:1746129569.588858:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800903a1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+11:1960:x1830948734070016:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129569.588874:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129569.588897:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009efe8e00/0x40a459093b0698fd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20ce3 expref: 11 pid: 22481 timeout: 924 lvb_type: 0 00010000:00010000:2.0:1746129569.588909:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009efe8e00/0x40a459093b0698fd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20ce3 expref: 11 pid: 22481 timeout: 924 lvb_type: 0 00010000:00010000:2.0:1746129569.588932:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009efe8e00/0x40a459093b0698fd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20ce3 expref: 11 pid: 22481 timeout: 924 lvb_type: 0 00010000:00010000:2.0:1746129569.588953:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129569.588955:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129569.588962:0:7085:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009efe9400/0x40a459093b06993c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1884160->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20d06 expref: 10 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129569.588976:0:7085:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009efe9400/0x40a459093b06993c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1884160->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20d06 expref: 10 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129569.589015:0:7085:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009efe9400/0x40a459093b06993c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1884160->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20d06 expref: 10 pid: 22481 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129569.589026:0:7085:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013575fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7085:1830948737492096:192.168.202.4@tcp:105: 00000100:00100000:2.0:1746129569.589115:0:7085:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0ac9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746129569.590085:0:31520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a07adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ada2ffba-8920-4ecb-8068-68caa9806978+38:1960:x1830948734069760:12345-192.168.202.4@tcp:3:cat.0 Request processed in 15464us (16277us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129569.590095:0:31520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7715 00002000:00100000:1.0:1746129569.590105:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->4194303) req@ffff8800a07adf80 x1830948734069760/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:310/0 lens 488/440 e 0 to 0 dl 1746129580 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129569.590112:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a07adf80 with x1830948734069760 ext(3145728->4194303) 00002000:00010000:1.0:1746129569.590117:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a07adf80 00000100:00100000:3.0:1746129569.590871:0:22481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734069888 00000100:00100000:3.0:1746129569.590878:0:22481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734069888 00000100:00100000:3.0:1746129569.591005:0:22481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16029 00000100:00100000:3.0:1746129569.591013:0:22481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800903a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+29:32240:x1830948734069888:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129569.591027:0:22481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129569.591564:0:22481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f568a00/0x40a459093b069951 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20d14 expref: -99 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129569.591597:0:22481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009faa2000/0x40a459093b069847 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1257471) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20c7a expref: 37 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129569.591604:0:22481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129569.591606:0:22481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129569.591609:0:22481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f568a00/0x40a459093b069951 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20d14 expref: 30 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129569.591640:0:22481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009faa2000/0x40a459093b069847 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1257471) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20c7a expref: 37 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129569.591652:0:22481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009faa2000/0x40a459093b069847 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1257471) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20c7a expref: 37 pid: 4385 timeout: 924 lvb_type: 0 00000100:00100000:3.0:1746129569.591663:0:22481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a07ac700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:22481:1830948737492224:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129569.592222:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129569.592379:0:31520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734070272 00000100:00100000:0.0:1746129569.592385:0:31520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734070272 00000100:00100000:3.0:1746129569.592569:0:22481:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a6ce8e40 going to sleep for 11 seconds 00002000:00100000:0.0:1746129569.592697:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3f4:0x0] (1884160->1888255) req@ffff880135725180 x1830948734070272/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:310/0 lens 488/0 e 0 to 0 dl 1746129580 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129569.592708:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135725180 with x1830948734070272 ext(1884160->1888255) 00002000:00010000:0.0:1746129569.592714:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135725180 00000100:00100000:0.0:1746129569.592736:0:31520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7716 00000100:00100000:0.0:1746129569.592746:0:31520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135725180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+11:1963:x1830948734070272:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:0.0:1746129569.592975:0:31520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135725180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+11:1963:x1830948734070272:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 229us (752us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746129569.592982:0:31520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7716 00002000:00100000:0.0:1746129569.592990:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3f4:0x0] (1884160->1888255) req@ffff880135725180 x1830948734070272/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:310/0 lens 488/4536 e 0 to 0 dl 1746129580 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129569.592998:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135725180 with x1830948734070272 ext(1884160->1888255) 00002000:00010000:0.0:1746129569.593003:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135725180 00000100:00100000:3.0:1746129569.593250:0:7085:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013575fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7085:1830948737492096:192.168.202.4@tcp:105: 00010000:00010000:3.0:1746129569.593267:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129569.593288:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800903a1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+10:1960:x1830948734070016:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 4433us (4850us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129569.593322:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8207 00000100:00100000:3.0:1746129569.594260:0:22481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a07ac700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:22481:1830948737492224:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129569.594284:0:22481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f568a00/0x40a459093b069951 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20d14 expref: 30 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129569.594322:0:22481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f568a00, rc 0) 00000100:00100000:3.0:1746129569.594383:0:22481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800903a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+30:32240:x1830948734069888:12345-192.168.202.4@tcp:101:cat.0 Request processed in 3370us (5998us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129569.594390:0:22481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16029 00000100:00100000:0.0:1746129569.594648:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129569.595442:0:21463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734070400 00000100:00100000:2.0:1746129569.595451:0:21463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734070400 00002000:00100000:2.0:1746129569.595490:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3ee:0x0] (1048576->1257471) req@ffff8800903a3100 x1830948734070400/t0(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:310/0 lens 488/0 e 0 to 0 dl 1746129580 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129569.595500:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800903a3100 with x1830948734070400 ext(1048576->1257471) 00010000:00010000:2.0:1746129569.595508:0:21463:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009faa2000/0x40a459093b069847 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1257471) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20c7a expref: 38 pid: 4385 timeout: 924 lvb_type: 0 00010000:00010000:2.0:1746129569.595521:0:21463:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009faa2000/0x40a459093b069847 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1257471) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20c7a expref: 38 pid: 4385 timeout: 924 lvb_type: 0 00002000:00010000:2.0:1746129569.595528:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800903a3100 00000100:00100000:2.0:1746129569.595581:0:21463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2405 00000100:00100000:2.0:1746129569.595589:0:21463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800903a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ada2ffba-8920-4ecb-8068-68caa9806978+38:1963:x1830948734070400:12345-192.168.202.4@tcp:4:cat.0 00000100:00100000:0.0:1746129569.597744:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129569.597825:0:22481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734070528 00000100:00100000:3.0:1746129569.597832:0:22481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734070528 00000100:00100000:3.0:1746129569.597865:0:22481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16030 00000100:00100000:3.0:1746129569.597871:0:22481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800903a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+30:32232:x1830948734070528:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:3.0:1746129569.597886:0:22481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129569.597902:0:22481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f568200/0x40a459093b069958 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20d1b expref: -99 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129569.597926:0:22481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129569.597931:0:22481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f568a00/0x40a459093b069951 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20d14 expref: 31 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129569.597936:0:22481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746129569.597939:0:22481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f568200/0x40a459093b069958 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [1048576->1884159] (req 1048576->1884159) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20d1b expref: 31 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129569.597971:0:22481:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f568a00/0x40a459093b069951 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20d14 expref: 31 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129569.597981:0:22481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f568200/0x40a459093b069958 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [1048576->1884159] (req 1048576->1884159) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20d1b expref: 31 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129569.597989:0:22481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f568200, rc 0) 00000100:00100000:3.0:1746129569.598022:0:22481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800903a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+31:32232:x1830948734070528:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 151us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129569.598027:0:22481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16030 00000100:00100000:2.0:1746129569.599147:0:21463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800903a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ada2ffba-8920-4ecb-8068-68caa9806978+40:1963:x1830948734070400:12345-192.168.202.4@tcp:4:cat.0 Request processed in 3554us (4494us total) trans 21474841329 rc 0/0 00000100:00100000:2.0:1746129569.599161:0:21463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2405 00002000:00100000:2.0:1746129569.599170:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3ee:0x0] (1048576->1257471) req@ffff8800903a3100 x1830948734070400/t21474841329(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:310/0 lens 488/448 e 0 to 0 dl 1746129580 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129569.599178:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800903a3100 with x1830948734070400 ext(1048576->1257471) 00010000:00010000:2.0:1746129569.599185:0:21463:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009faa2000/0x40a459093b069847 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1257471) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20c7a expref: 40 pid: 4385 timeout: 924 lvb_type: 0 00010000:00010000:2.0:1746129569.599199:0:21463:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009faa2000/0x40a459093b069847 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1257471) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20c7a expref: 40 pid: 4385 timeout: 924 lvb_type: 0 00002000:00010000:2.0:1746129569.599205:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800903a3100 00000100:00100000:1.0:1746129569.599825:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129569.599850:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129569.599921:0:22481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734070784 00000100:00100000:3.0:1746129569.599928:0:22481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734070784 00000100:00100000:3.0:1746129569.599954:0:22481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734070656 00000100:00100000:3.0:1746129569.599956:0:22481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734070656 00000100:00100000:3.0:1746129569.599971:0:22481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16031 00000100:00100000:3.0:1746129569.599977:0:22481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135725500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ada2ffba-8920-4ecb-8068-68caa9806978+40:1962:x1830948734070784:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129569.599988:0:22481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129569.600001:0:22481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f568600/0x40a459093b06995f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20d29 expref: -99 pid: 22481 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129569.600040:0:22481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a07ac700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:22481:1830948737492480:192.168.202.4@tcp:106: 00000100:00100000:3.0:1746129569.600090:0:22481:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a6ce8e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746129569.600143:0:4699:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16032 00000100:00100000:1.0:1746129569.600149:0:4699:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135725c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ada2ffba-8920-4ecb-8068-68caa9806978+23:1962:x1830948734070656:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129569.600157:0:4699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129569.600167:0:4699:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f118a00/0x40a459093b069966 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20d22 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129569.600192:0:4699:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093eddf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4699:1830948737492608:192.168.202.4@tcp:106: 00000100:00100000:1.0:1746129569.600210:0:4699:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5de8cc0 going to sleep for 11 seconds 00002000:00010000:1.0:1746129569.603644:0:4699:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb mtime: 1746129569 -> 1746129570 00002000:00010000:1.0:1746129569.603653:0:4699:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb ctime: 1746129569 -> 1746129570 00000100:00100000:1.0:1746129569.603679:0:4699:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093eddf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4699:1830948737492608:192.168.202.4@tcp:106: 00010000:00010000:1.0:1746129569.603712:0:4699:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f118a00/0x40a459093b069966 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20d22 expref: 24 pid: 4699 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129569.603728:0:4699:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f118a00/0x40a459093b069966 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20d22 expref: 24 pid: 4699 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129569.603756:0:4699:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f118a00, rc 0) 00000100:00100000:1.0:1746129569.603809:0:4699:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135725c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ada2ffba-8920-4ecb-8068-68caa9806978+23:1962:x1830948734070656:12345-192.168.202.4@tcp:101:cat.0 Request processed in 3659us (3956us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129569.603817:0:4699:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16032 00002000:00010000:3.0:1746129569.604087:0:22481:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb mtime: 1746129569 -> 1746129570 00002000:00010000:3.0:1746129569.604090:0:22481:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb ctime: 1746129569 -> 1746129570 00000100:00100000:3.0:1746129569.604104:0:22481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a07ac700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:22481:1830948737492480:192.168.202.4@tcp:106: 00010000:00010000:3.0:1746129569.604122:0:22481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f568600/0x40a459093b06995f lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20d29 expref: 41 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129569.604130:0:22481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f568600/0x40a459093b06995f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20d29 expref: 41 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129569.604433:0:22481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f568600, rc 0) 00000100:00100000:3.0:1746129569.604686:0:22481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135725500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ada2ffba-8920-4ecb-8068-68caa9806978+40:1962:x1830948734070784:12345-192.168.202.4@tcp:101:cat.0 Request processed in 4708us (4861us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129569.604692:0:22481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16031 00000100:00100000:2.0:1746129569.604840:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129569.604936:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734070912 00000100:00100000:3.0:1746129569.604943:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734070912 00010000:00010000:3.0:1746129569.604969:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009faa2000/0x40a459093b069847 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1257471) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20c7a expref: 40 pid: 4385 timeout: 924 lvb_type: 0 00000100:00100000:3.0:1746129569.605001:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8208 00000100:00100000:3.0:1746129569.605008:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013575fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ada2ffba-8920-4ecb-8068-68caa9806978+40:1962:x1830948734070912:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129569.605020:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129569.605031:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009faa2000/0x40a459093b069847 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1257471) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20c7a expref: 40 pid: 4385 timeout: 924 lvb_type: 0 00010000:00010000:3.0:1746129569.605041:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009faa2000/0x40a459093b069847 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1257471) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20c7a expref: 40 pid: 4385 timeout: 924 lvb_type: 0 00010000:00010000:3.0:1746129569.605060:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009faa2000/0x40a459093b069847 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1257471) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20c7a expref: 40 pid: 4385 timeout: 924 lvb_type: 0 00010000:00010000:3.0:1746129569.605071:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129569.605073:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129569.605080:0:7085:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f568a00/0x40a459093b069951 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60080000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20d14 expref: 30 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129569.605087:0:7085:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f568a00/0x40a459093b069951 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60080000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20d14 expref: 30 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129569.605116:0:7085:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f568a00/0x40a459093b069951 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20d14 expref: 30 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129569.605127:0:7085:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f568a00/0x40a459093b069951 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20d14 expref: 30 pid: 22481 timeout: 924 lvb_type: 0 00000100:00100000:3.0:1746129569.605138:0:7085:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a07ac700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7085:1830948737492736:192.168.202.4@tcp:105: 00000100:00100000:3.0:1746129569.605194:0:7085:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a6ce8e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746129569.607370:0:7085:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a07ac700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7085:1830948737492736:192.168.202.4@tcp:105: 00010000:00010000:3.0:1746129569.607395:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129569.607449:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013575fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ada2ffba-8920-4ecb-8068-68caa9806978+39:1962:x1830948734070912:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 2440us (2609us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129569.607460:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8208 00000100:00100000:0.0:1746129569.611581:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129569.612661:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129569.612918:0:31520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734071168 00000100:00100000:1.0:1746129569.612928:0:31520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734071168 00002000:00100000:1.0:1746129569.612972:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3ee:0x0] (1048576->2097151) req@ffff88009f37d500 x1830948734071168/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:310/0 lens 488/0 e 0 to 0 dl 1746129580 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129569.612981:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f37d500 with x1830948734071168 ext(1048576->2097151) 00010000:00010000:1.0:1746129569.612990:0:31520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f568a00/0x40a459093b069951 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20d14 expref: 31 pid: 22481 timeout: 924 lvb_type: 0 00010000:00010000:1.0:1746129569.613003:0:31520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f568a00/0x40a459093b069951 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20d14 expref: 31 pid: 22481 timeout: 924 lvb_type: 0 00002000:00010000:1.0:1746129569.613010:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f37d500 00000100:00100000:1.0:1746129569.613339:0:31520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734071424 00000100:00100000:1.0:1746129569.613342:0:31520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734071424 00002000:00100000:1.0:1746129569.613355:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3ef:0x0] (4194304->5148671) req@ffff88009f37e300 x1830948734071424/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:310/0 lens 488/0 e 0 to 0 dl 1746129580 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129569.613362:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f37e300 with x1830948734071424 ext(4194304->5148671) 00002000:00010000:1.0:1746129569.613365:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f37e300 00000100:00100000:1.0:1746129569.613377:0:31520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2406 00000100:00100000:1.0:1746129569.613383:0:31520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f37d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+31:1963:x1830948734071168:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:2.0:1746129569.614666:0:21463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7717 00000100:00100000:2.0:1746129569.615505:0:21463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f37e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ada2ffba-8920-4ecb-8068-68caa9806978+39:1961:x1830948734071424:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:1.0:1746129569.630468:0:31520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f37d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+31:1963:x1830948734071168:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 17071us (18885us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129569.630480:0:31520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2406 00002000:00100000:1.0:1746129569.630492:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3ee:0x0] (1048576->2097151) req@ffff88009f37d500 x1830948734071168/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:310/0 lens 488/440 e 0 to 0 dl 1746129580 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129569.630501:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f37d500 with x1830948734071168 ext(1048576->2097151) 00010000:00010000:1.0:1746129569.630512:0:31520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f568a00/0x40a459093b069951 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20d14 expref: 31 pid: 22481 timeout: 924 lvb_type: 0 00010000:00010000:1.0:1746129569.630526:0:31520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f568a00/0x40a459093b069951 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20d14 expref: 31 pid: 22481 timeout: 924 lvb_type: 0 00002000:00010000:1.0:1746129569.630533:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f37d500 00000100:00100000:3.0:1746129569.632874:0:21463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f37e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ada2ffba-8920-4ecb-8068-68caa9806978+39:1961:x1830948734071424:12345-192.168.202.4@tcp:3:cat.0 Request processed in 18186us (20202us total) trans 0 rc 954368/954368 00000100:00100000:3.0:1746129569.632887:0:21463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7717 00002000:00100000:3.0:1746129569.632898:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3ef:0x0] (4194304->5148671) req@ffff88009f37e300 x1830948734071424/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:310/0 lens 488/440 e 0 to 0 dl 1746129580 ref 1 fl Complete:/200/0 rc 954368/954368 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129569.632907:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f37e300 with x1830948734071424 ext(4194304->5148671) 00002000:00010000:3.0:1746129569.632913:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f37e300 00000100:00100000:0.0:1746129569.644371:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129569.644406:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129569.644421:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129569.644444:0:22481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734071552 00000100:00100000:0.0:1746129569.644451:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129569.644452:0:22481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734071552 00000100:00100000:2.0:1746129569.644486:0:22481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734071808 00000100:00100000:2.0:1746129569.644487:0:22481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734071808 00000100:00100000:2.0:1746129569.644713:0:20577:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734071936 00000100:00100000:2.0:1746129569.644716:0:20577:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734071936 00000100:00100000:1.0:1746129569.644723:0:4699:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16033 00000100:00100000:1.0:1746129569.644736:0:4699:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f37fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+31:32240:x1830948734071552:12345-192.168.202.4@tcp:101:cat.0 00000100:00100000:2.0:1746129569.644747:0:20577:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16034 00000100:00100000:2.0:1746129569.644754:0:20577:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f37f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ada2ffba-8920-4ecb-8068-68caa9806978+23:1963:x1830948734071808:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129569.644755:0:4699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129569.644768:0:20577:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129569.644774:0:4699:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f118c00/0x40a459093b06996d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20d30 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129569.644782:0:20577:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800946c6800/0x40a459093b069974 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20d37 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129569.644804:0:4699:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a6de8e00/0x40a459093b0698f6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2605056->2785279) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20cdc expref: 39 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129569.644811:0:4699:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129569.644814:0:4699:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129569.644817:0:4699:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f118c00/0x40a459093b06996d lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20d30 expref: 32 pid: 4699 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129569.644831:0:20577:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013575e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20577:1830948737492864:192.168.202.4@tcp:106: 00010000:00010000:1.0:1746129569.644842:0:4699:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a6de8e00/0x40a459093b0698f6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2605056->2785279) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20cdc expref: 39 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129569.644852:0:4699:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a6de8e00/0x40a459093b0698f6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2605056->2785279) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20cdc expref: 39 pid: 20577 timeout: 924 lvb_type: 0 00000100:00100000:1.0:1746129569.644863:0:4699:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093eddf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4699:1830948737492992:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129569.644899:0:22481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16035 00000100:00100000:2.0:1746129569.644904:0:22481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f37e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ada2ffba-8920-4ecb-8068-68caa9806978+39:1963:x1830948734071936:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129569.644910:0:22481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129569.644918:0:22481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800946c7a00/0x40a459093b06997b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20d3e expref: -99 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129569.644927:0:22481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129569.644934:0:22481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800946c7a00/0x40a459093b06997b lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20d3e expref: 40 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129569.644942:0:22481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800946c7a00/0x40a459093b06997b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20d3e expref: 40 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129569.644953:0:22481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800946c7a00, rc 0) 00000100:00100000:0.0:1746129569.644957:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734071680 00000100:00100000:0.0:1746129569.644962:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734071680 00000100:00100000:2.0:1746129569.644973:0:22481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f37e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ada2ffba-8920-4ecb-8068-68caa9806978+39:1963:x1830948734071936:12345-192.168.202.4@tcp:101:cat.0 Request processed in 69us (521us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129569.644978:0:22481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16035 00010000:00010000:0.0:1746129569.644982:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f568a00/0x40a459093b069951 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20d14 expref: 33 pid: 22481 timeout: 924 lvb_type: 0 00000100:00100000:0.0:1746129569.645001:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8209 00000100:00100000:0.0:1746129569.645006:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f37d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+33:1963:x1830948734071680:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129569.645014:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129569.645035:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f568a00/0x40a459093b069951 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20d14 expref: 33 pid: 22481 timeout: 924 lvb_type: 0 00010000:00010000:0.0:1746129569.645045:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f568a00/0x40a459093b069951 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20d14 expref: 33 pid: 22481 timeout: 924 lvb_type: 0 00010000:00010000:0.0:1746129569.645065:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f568a00/0x40a459093b069951 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20d14 expref: 33 pid: 22481 timeout: 924 lvb_type: 0 00010000:00010000:0.0:1746129569.645085:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129569.645087:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129569.645093:0:7085:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f568200/0x40a459093b069958 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1884159) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20d1b expref: 32 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129569.645100:0:7085:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f568200/0x40a459093b069958 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1884159) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20d1b expref: 32 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129569.645262:0:7085:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f568200/0x40a459093b069958 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1884159) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20d1b expref: 32 pid: 22481 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129569.645271:0:7085:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f37df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7085:1830948737493120:192.168.202.4@tcp:105: 00000100:00100000:0.0:1746129569.645353:0:7085:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a586e780 going to sleep for 11 seconds 00000100:00100000:3.0:1746129569.645404:0:20577:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0ac300 going to sleep for 11 seconds 00000100:00100000:1.0:1746129569.645407:0:4699:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5de8cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129569.651006:0:7085:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f37df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7085:1830948737493120:192.168.202.4@tcp:105: 00010000:00010000:0.0:1746129569.651025:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129569.651061:0:20577:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013575e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20577:1830948737492864:192.168.202.4@tcp:106: 00000100:00100000:0.0:1746129569.651062:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f37d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+32:1963:x1830948734071680:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 6053us (6652us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129569.651072:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8209 00010000:00010000:3.0:1746129569.651096:0:20577:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800946c6800/0x40a459093b069974 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20d37 expref: 24 pid: 20577 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129569.651110:0:20577:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800946c6800/0x40a459093b069974 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20d37 expref: 24 pid: 20577 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746129569.651129:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00010000:00010000:3.0:1746129569.651131:0:20577:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800946c6800, rc 0) 00000100:00100000:3.0:1746129569.651176:0:20577:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f37f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ada2ffba-8920-4ecb-8068-68caa9806978+23:1963:x1830948734071808:12345-192.168.202.4@tcp:101:cat.0 Request processed in 6422us (6752us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129569.651183:0:20577:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16034 00000100:00100000:1.0:1746129569.651258:0:4699:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093eddf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4699:1830948737492992:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129569.651277:0:4699:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f118c00/0x40a459093b06996d lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20d30 expref: 31 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129569.651289:0:4699:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f118c00, rc 0) 00000100:00100000:1.0:1746129569.651347:0:4699:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f37fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+31:32240:x1830948734071552:12345-192.168.202.4@tcp:101:cat.0 Request processed in 6615us (6985us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129569.651353:0:4699:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16033 00000100:00100000:2.0:1746129569.652371:0:21463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734072064 00000100:00100000:2.0:1746129569.652378:0:21463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734072064 00002000:00100000:2.0:1746129569.652412:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3ef:0x0] (2605056->2785279) req@ffff88009f37df80 x1830948734072064/t0(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:310/0 lens 488/0 e 0 to 0 dl 1746129580 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129569.652421:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f37df80 with x1830948734072064 ext(2605056->2785279) 00010000:00010000:2.0:1746129569.652428:0:21463:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a6de8e00/0x40a459093b0698f6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2605056->2785279) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20cdc expref: 39 pid: 20577 timeout: 924 lvb_type: 0 00010000:00010000:2.0:1746129569.652440:0:21463:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a6de8e00/0x40a459093b0698f6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2605056->2785279) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20cdc expref: 39 pid: 20577 timeout: 924 lvb_type: 0 00002000:00010000:2.0:1746129569.652446:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f37df80 00000100:00100000:2.0:1746129569.652471:0:21463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2407 00000100:00100000:2.0:1746129569.652478:0:21463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f37df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ada2ffba-8920-4ecb-8068-68caa9806978+39:1961:x1830948734072064:12345-192.168.202.4@tcp:4:cat.0 00000100:00100000:2.0:1746129569.657404:0:21463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f37df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ada2ffba-8920-4ecb-8068-68caa9806978+41:1961:x1830948734072064:12345-192.168.202.4@tcp:4:cat.0 Request processed in 4917us (6266us total) trans 21474841330 rc 0/0 00000100:00100000:2.0:1746129569.657414:0:21463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2407 00002000:00100000:2.0:1746129569.657425:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3ef:0x0] (2605056->2785279) req@ffff88009f37df80 x1830948734072064/t21474841330(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:310/0 lens 488/448 e 0 to 0 dl 1746129580 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129569.657434:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f37df80 with x1830948734072064 ext(2605056->2785279) 00010000:00010000:2.0:1746129569.657442:0:21463:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a6de8e00/0x40a459093b0698f6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2605056->2785279) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20cdc expref: 41 pid: 20577 timeout: 924 lvb_type: 0 00010000:00010000:2.0:1746129569.657455:0:21463:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a6de8e00/0x40a459093b0698f6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2605056->2785279) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20cdc expref: 41 pid: 20577 timeout: 924 lvb_type: 0 00002000:00010000:2.0:1746129569.657462:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f37df80 00000100:00100000:0.0:1746129569.657667:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129569.657963:0:4699:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734072192 00000100:00100000:1.0:1746129569.657969:0:4699:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734072192 00000100:00100000:1.0:1746129569.658010:0:4699:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16036 00000100:00100000:1.0:1746129569.658016:0:4699:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f37d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ada2ffba-8920-4ecb-8068-68caa9806978+41:32236:x1830948734072192:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129569.658027:0:4699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129569.658038:0:4699:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f119600/0x40a459093b069982 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20d45 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129569.658061:0:4699:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129569.658063:0:4699:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129569.658066:0:4699:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f119600/0x40a459093b069982 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [5144576->5242879] (req 5144576->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20d45 expref: 42 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129569.658076:0:4699:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f119600/0x40a459093b069982 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [5144576->5242879] (req 5144576->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20d45 expref: 42 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129569.658084:0:4699:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f119600, rc 0) 00000100:00100000:1.0:1746129569.658117:0:4699:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f37d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ada2ffba-8920-4ecb-8068-68caa9806978+42:32236:x1830948734072192:12345-192.168.202.4@tcp:101:cat.0 Request processed in 100us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129569.658122:0:4699:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16036 00000100:00100000:0.0:1746129569.658666:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129569.658859:0:21463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734072448 00000100:00100000:3.0:1746129569.658863:0:21463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734072448 00002000:00100000:3.0:1746129569.658886:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3ee:0x0] (1880064->1884159) req@ffff88009f37c000 x1830948734072448/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:310/0 lens 488/0 e 0 to 0 dl 1746129580 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129569.658894:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f37c000 with x1830948734072448 ext(1880064->1884159) 00002000:00010000:3.0:1746129569.658897:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f37c000 00000100:00100000:3.0:1746129569.658922:0:21463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7718 00000100:00100000:3.0:1746129569.658928:0:21463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f37c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+31:1962:x1830948734072448:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:3.0:1746129569.659053:0:21463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f37c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+31:1962:x1830948734072448:12345-192.168.202.4@tcp:3:cat.0 Request processed in 124us (386us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129569.659059:0:21463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7718 00002000:00100000:3.0:1746129569.659064:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3ee:0x0] (1880064->1884159) req@ffff88009f37c000 x1830948734072448/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:310/0 lens 488/4536 e 0 to 0 dl 1746129580 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129569.659071:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f37c000 with x1830948734072448 ext(1880064->1884159) 00002000:00010000:3.0:1746129569.659074:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f37c000 00000100:00100000:0.0:1746129569.662144:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129569.663845:0:20861:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734072704 00000100:00100000:2.0:1746129569.663853:0:20861:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734072704 00000100:00100000:2.0:1746129569.663919:0:20861:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4745 00000100:00100000:2.0:1746129569.663925:0:20861:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f37c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+23:32232:x1830948734072704:12345-192.168.202.4@tcp:35:multiop.0 00000100:00100000:2.0:1746129569.664116:0:20861:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f37c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+24:32232:x1830948734072704:12345-192.168.202.4@tcp:35:multiop.0 Request processed in 190us (1982us total) trans 8589945285 rc 0/0 00000100:00100000:2.0:1746129569.664129:0:20861:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4745 00000100:00100000:2.0:1746129569.664202:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129569.664222:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734072832 00000100:00100000:2.0:1746129569.664225:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734072832 00010000:00010000:2.0:1746129569.664241:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6de8e00/0x40a459093b0698f6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2605056->2785279) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20cdc expref: 42 pid: 20577 timeout: 924 lvb_type: 0 00000100:00100000:2.0:1746129569.664269:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8210 00000100:00100000:2.0:1746129569.664274:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013575ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ada2ffba-8920-4ecb-8068-68caa9806978+42:1961:x1830948734072832:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129569.664284:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746129569.664336:0:7085:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb mtime from disk: 1746129569 -> 1746129570 00002000:00010000:2.0:1746129569.664507:0:7085:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb ctime from disk: 1746129569 -> 1746129570 00010000:00010000:2.0:1746129569.664513:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a6de8e00/0x40a459093b0698f6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2605056->2785279) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20cdc expref: 42 pid: 20577 timeout: 924 lvb_type: 0 00010000:00010000:2.0:1746129569.664524:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a6de8e00/0x40a459093b0698f6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2605056->2785279) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20cdc expref: 42 pid: 20577 timeout: 924 lvb_type: 0 00010000:00010000:2.0:1746129569.664548:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a6de8e00/0x40a459093b0698f6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2605056->2785279) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20cdc expref: 42 pid: 20577 timeout: 924 lvb_type: 0 00010000:00010000:2.0:1746129569.664559:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129569.664560:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129569.664566:0:7085:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f118c00/0x40a459093b06996d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20d30 expref: 30 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129569.664642:0:7085:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f118c00/0x40a459093b06996d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20d30 expref: 30 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129569.664650:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129569.664652:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129569.664655:0:7085:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f119600/0x40a459093b069982 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5144576->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20d45 expref: 41 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129569.664660:0:7085:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f119600/0x40a459093b069982 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5144576->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20d45 expref: 41 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129569.664685:0:7085:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f119600/0x40a459093b069982 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5144576->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20d45 expref: 41 pid: 4699 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129569.664696:0:7085:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013575f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7085:1830948737493248:192.168.202.4@tcp:105: 00010000:00010000:2.0:1746129569.664789:0:7085:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f118c00/0x40a459093b06996d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20d30 expref: 30 pid: 4699 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129569.664797:0:7085:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013575d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7085:1830948737493376:192.168.202.4@tcp:105: 00000100:00100000:2.0:1746129569.664824:0:7085:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0ac600 going to sleep for 11 seconds 00000100:00100000:0.0:1746129569.670349:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129569.670510:0:7085:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013575f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7085:1830948737493248:192.168.202.4@tcp:105: 00000100:00100000:2.0:1746129569.670522:0:7085:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013575d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7085:1830948737493376:192.168.202.4@tcp:105: 00010000:00010000:2.0:1746129569.670542:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129569.670578:0:20577:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734072960 00000100:00100000:3.0:1746129569.670587:0:20577:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734072960 00000100:00100000:2.0:1746129569.670598:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013575ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ada2ffba-8920-4ecb-8068-68caa9806978+41:1961:x1830948734072832:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 6321us (6395us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129569.670608:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8210 00000100:00100000:0.0:1746129569.670689:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129569.671497:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129569.671538:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129569.671591:0:20577:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734073088 00000100:00100000:3.0:1746129569.671596:0:20577:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734073088 00000100:00100000:2.0:1746129569.671603:0:22481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16037 00000100:00100000:2.0:1746129569.671615:0:22481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bf7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ada2ffba-8920-4ecb-8068-68caa9806978+23:1963:x1830948734072960:12345-192.168.202.4@tcp:101:cat.0 00000100:00100000:3.0:1746129569.671621:0:20577:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16038 00000100:00100000:3.0:1746129569.671627:0:20577:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136016300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ada2ffba-8920-4ecb-8068-68caa9806978+41:1962:x1830948734073088:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129569.671630:0:22481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129569.671640:0:20577:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129569.671644:0:22481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d873c00/0x40a459093b069989 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20d4c expref: -99 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129569.671654:0:20577:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f569200/0x40a459093b069990 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20d53 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129569.671708:0:20577:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a07ac700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20577:1830948737493504:192.168.202.4@tcp:106: 00000100:00100000:2.0:1746129569.671708:0:22481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013575d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:22481:1830948737493632:192.168.202.4@tcp:106: 00000100:00100000:3.0:1746129569.671766:0:21463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734073344 00000100:00100000:3.0:1746129569.671770:0:21463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734073344 00000100:00100000:3.0:1746129569.671787:0:20577:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a6ce8240 going to sleep for 11 seconds 00002000:00100000:3.0:1746129569.671820:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3ef:0x0] (2097152->3145727) req@ffff880136017b80 x1830948734073344/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:310/0 lens 488/0 e 0 to 0 dl 1746129580 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129569.671828:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136017b80 with x1830948734073344 ext(2097152->3145727) 00002000:00010000:3.0:1746129569.671833:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136017b80 00000100:00100000:3.0:1746129569.671849:0:31519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734073600 00000100:00100000:3.0:1746129569.671851:0:31519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734073600 00002000:00100000:3.0:1746129569.671863:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->4194303) req@ffff880136015c00 x1830948734073600/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:310/0 lens 488/0 e 0 to 0 dl 1746129580 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129569.671869:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136015c00 with x1830948734073600 ext(3145728->4194303) 00002000:00010000:3.0:1746129569.671872:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136015c00 00000100:00100000:3.0:1746129569.671883:0:31519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7719 00000100:00100000:3.0:1746129569.671887:0:31519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136017b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+32:1961:x1830948734073344:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:1.0:1746129569.673242:0:31520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7720 00000100:00100000:1.0:1746129569.673253:0:31520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136015c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+33:1960:x1830948734073600:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:2.0:1746129569.675415:0:22481:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0ac600 going to sleep for 11 seconds 00000100:00100000:1.0:1746129569.679105:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129569.679196:0:2271:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734073728 00000100:00100000:2.0:1746129569.679207:0:2271:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734073728 00000100:00100000:2.0:1746129569.679279:0:2271:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11194 00000100:00100000:2.0:1746129569.679287:0:2271:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093eddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:068dab75-d300-4ead-a742-d14572ad1e50+14:32245:x1830948734073728:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:2.0:1746129569.679347:0:2271:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129569.679363:0:2271:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d873a00/0x40a459093b069997 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20d5a expref: -99 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129569.679412:0:2271:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d872a00/0x40a459093b06999e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129569.679422:0:2271:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d872a00/0x40a459093b06999e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129569.679429:0:2271:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d872a00/0x40a459093b06999e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129569.679440:0:2271:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800946c7600/0x40a459093b0699a5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129569.679447:0:2271:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800946c7600/0x40a459093b0699a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129569.679451:0:2271:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800946c7600/0x40a459093b0699a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129569.679533:0:2271:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091b4e000/0x40a459093b0699ac lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129569.679540:0:2271:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091b4e000/0x40a459093b0699ac lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129569.679544:0:2271:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091b4e000/0x40a459093b0699ac lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00000004:00200000:2.0:1746129569.679567:0:2271:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00000004:00200000:2.0:1746129569.679570:0:2271:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746129569.679580:0:2271:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880091b4e000/0x40a459093b0699ac lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129569.679588:0:2271:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091b4e000/0x40a459093b0699ac lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129569.679593:0:2271:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d872a00/0x40a459093b06999e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129569.679597:0:2271:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d872a00/0x40a459093b06999e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129569.679602:0:2271:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d872a00/0x40a459093b06999e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129569.679606:0:2271:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d872a00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746129569.679609:0:2271:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d872a00/0x40a459093b06999e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129569.679616:0:2271:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d872a00/0x40a459093b06999e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129569.679625:0:2271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880132ef8f00) 00010000:00010000:2.0:1746129569.679628:0:2271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129569.679631:0:2271:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d872a00/0x40a459093b06999e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129569.679636:0:2271:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d872a00/0x40a459093b06999e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129569.679656:0:2271:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800946c7600/0x40a459093b0699a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129569.679661:0:2271:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800946c7600/0x40a459093b0699a5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129569.679666:0:2271:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800946c7600/0x40a459093b0699a5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129569.679669:0:2271:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800946c7600 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746129569.679671:0:2271:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800946c7600/0x40a459093b0699a5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129569.679675:0:2271:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800946c7600/0x40a459093b0699a5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129569.679681:0:2271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800900d1100) 00010000:00010000:2.0:1746129569.679682:0:2271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129569.679684:0:2271:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800946c7600/0x40a459093b0699a5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129569.679688:0:2271:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800946c7600/0x40a459093b0699a5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129569.679710:0:2271:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d873a00/0x40a459093b069997 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20d5a expref: 16 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129569.679719:0:2271:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091b4e000/0x40a459093b0699ac lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20d5a expref: 15 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129569.679724:0:2271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:2.0:1746129569.679726:0:2271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746129569.679728:0:2271:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091b4e000, rc 0) 00000100:00100000:2.0:1746129569.679770:0:2271:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093eddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:068dab75-d300-4ead-a742-d14572ad1e50+15:32245:x1830948734073728:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 484us (676us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129569.679776:0:2271:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11194 00000100:00100000:2.0:1746129569.685388:0:22481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013575d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:22481:1830948737493632:192.168.202.4@tcp:106: 00010000:00010000:2.0:1746129569.685421:0:22481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d873c00/0x40a459093b069989 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20d4c expref: 24 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129569.685433:0:22481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d873c00/0x40a459093b069989 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20d4c expref: 24 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129569.685442:0:22481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d873c00, rc 0) 00000100:00100000:2.0:1746129569.685517:0:22481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bf7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ada2ffba-8920-4ecb-8068-68caa9806978+23:1963:x1830948734072960:12345-192.168.202.4@tcp:101:cat.0 Request processed in 13905us (15178us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129569.685519:0:20577:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a07ac700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20577:1830948737493504:192.168.202.4@tcp:106: 00000100:00100000:2.0:1746129569.685526:0:22481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16037 00010000:00010000:3.0:1746129569.685546:0:20577:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f569200/0x40a459093b069990 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20d53 expref: 42 pid: 20577 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129569.685559:0:20577:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f569200/0x40a459093b069990 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20d53 expref: 42 pid: 20577 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129569.685573:0:20577:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f569200, rc 0) 00000100:00100000:3.0:1746129569.685602:0:20577:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136016300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ada2ffba-8920-4ecb-8068-68caa9806978+41:1962:x1830948734073088:12345-192.168.202.4@tcp:101:cat.0 Request processed in 13975us (14913us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129569.685609:0:20577:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16038 00000100:00100000:3.0:1746129569.685927:0:31519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136017b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+33:1961:x1830948734073344:12345-192.168.202.4@tcp:3:cat.0 Request processed in 14039us (14432us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129569.685935:0:31519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7719 00002000:00100000:3.0:1746129569.685943:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3ef:0x0] (2097152->3145727) req@ffff880136017b80 x1830948734073344/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:310/0 lens 488/440 e 0 to 0 dl 1746129580 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129569.685953:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136017b80 with x1830948734073344 ext(2097152->3145727) 00002000:00010000:3.0:1746129569.685958:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136017b80 00000100:00100000:0.0:1746129569.690098:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129569.690172:0:31519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734073984 00000100:00100000:3.0:1746129569.690184:0:31519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734073984 00002000:00100000:3.0:1746129569.690233:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3ef:0x0] (5144576->5148671) req@ffff880136017480 x1830948734073984/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:310/0 lens 488/0 e 0 to 0 dl 1746129580 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129569.690243:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136017480 with x1830948734073984 ext(5144576->5148671) 00002000:00010000:3.0:1746129569.690248:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136017480 00000100:00100000:3.0:1746129569.690274:0:31519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7721 00000100:00100000:3.0:1746129569.690281:0:31519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136017480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ada2ffba-8920-4ecb-8068-68caa9806978+41:1962:x1830948734073984:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:1.0:1746129569.690397:0:31520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136015c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+31:1960:x1830948734073600:12345-192.168.202.4@tcp:3:cat.0 Request processed in 17145us (18855us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129569.690407:0:31520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7720 00002000:00100000:1.0:1746129569.690415:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->4194303) req@ffff880136015c00 x1830948734073600/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:310/0 lens 488/440 e 0 to 0 dl 1746129580 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129569.690423:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136015c00 with x1830948734073600 ext(3145728->4194303) 00002000:00010000:1.0:1746129569.690428:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136015c00 00000100:00100000:3.0:1746129569.690500:0:31519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136017480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ada2ffba-8920-4ecb-8068-68caa9806978+41:1962:x1830948734073984:12345-192.168.202.4@tcp:3:cat.0 Request processed in 217us (408us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129569.690507:0:31519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7721 00002000:00100000:3.0:1746129569.690512:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3ef:0x0] (5144576->5148671) req@ffff880136017480 x1830948734073984/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:310/0 lens 488/4536 e 0 to 0 dl 1746129580 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129569.690519:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136017480 with x1830948734073984 ext(5144576->5148671) 00002000:00010000:3.0:1746129569.690521:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136017480 00000100:00100000:2.0:1746129569.694371:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129569.694392:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129569.694472:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129569.694518:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734074112 00000100:00100000:1.0:1746129569.694525:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734074112 00000100:00100000:1.0:1746129569.694554:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734074240 00000100:00100000:1.0:1746129569.694556:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734074240 00000100:00100000:1.0:1746129569.694565:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734074368 00000100:00100000:1.0:1746129569.694566:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734074368 00000100:00100000:1.0:1746129569.694577:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16039 00000100:00100000:1.0:1746129569.694583:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013575c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:068dab75-d300-4ead-a742-d14572ad1e50+7:1962:x1830948734074112:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:1.0:1746129569.694597:0:7149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129569.694610:0:7149:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f118200/0x40a459093b0699b3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20d61 expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129569.694651:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093edce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7149:1830948737493760:192.168.202.4@tcp:106: 00000100:00100000:3.0:1746129569.694700:0:20577:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16040 00000100:00100000:1.0:1746129569.694705:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5de8cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746129569.694708:0:20577:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013575c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:068dab75-d300-4ead-a742-d14572ad1e50+16:1962:x1830948734074240:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:3.0:1746129569.694717:0:20577:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746129569.694719:0:4699:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16041 00000100:00100000:1.0:1746129569.694724:0:4699:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013575ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:068dab75-d300-4ead-a742-d14572ad1e50+16:1962:x1830948734074368:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:3.0:1746129569.694726:0:20577:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cdfd000/0x40a459093b0699ba lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20d68 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129569.694730:0:4699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129569.694737:0:4699:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f8d5000/0x40a459093b0699c1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20d6f expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129569.694747:0:4699:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746129569.694748:0:20577:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a07ac700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20577:1830948737493888:192.168.202.4@tcp:106: 00010000:00010000:1.0:1746129569.694749:0:4699:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129569.694755:0:4699:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f8d5000/0x40a459093b0699c1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20d6f expref: 18 pid: 4699 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129569.694769:0:4699:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f8d5000/0x40a459093b0699c1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20d6f expref: 18 pid: 4699 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746129569.694770:0:20577:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a6ce8f00 going to sleep for 11 seconds 00010000:00010000:1.0:1746129569.694777:0:4699:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f8d5000, rc 0) 00000100:00100000:1.0:1746129569.694795:0:4699:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013575ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:068dab75-d300-4ead-a742-d14572ad1e50+18:1962:x1830948734074368:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 70us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129569.694801:0:4699:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16041 00000100:00100000:1.0:1746129569.701561:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129569.701641:0:8416:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734074624 00000100:00100000:0.0:1746129569.701649:0:8416:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734074624 00002000:00100000:0.0:1746129569.701680:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3ef:0x0] (4194304->5148671) req@ffff880093ede300 x1830948734074624/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:310/0 lens 488/0 e 0 to 0 dl 1746129580 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129569.701688:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ede300 with x1830948734074624 ext(4194304->5148671) 00002000:00010000:0.0:1746129569.701693:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093ede300 00000100:00100000:0.0:1746129569.701713:0:8416:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7722 00000100:00100000:0.0:1746129569.701719:0:8416:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ede300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+31:1962:x1830948734074624:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:1.0:1746129569.708211:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093edce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7149:1830948737493760:192.168.202.4@tcp:106: 00010000:00010000:1.0:1746129569.708245:0:7149:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f118200/0x40a459093b0699b3 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20d61 expref: 8 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129569.708258:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f118200/0x40a459093b0699b3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20d61 expref: 8 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129569.708281:0:7149:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f118200, rc 0) 00000100:00100000:1.0:1746129569.708369:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013575c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:068dab75-d300-4ead-a742-d14572ad1e50+7:1962:x1830948734074112:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 13784us (14003us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129569.708377:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16039 00000100:00100000:3.0:1746129569.708778:0:20577:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a07ac700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20577:1830948737493888:192.168.202.4@tcp:106: 00010000:00010000:3.0:1746129569.708796:0:20577:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009cdfd000/0x40a459093b0699ba lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20d68 expref: 17 pid: 20577 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129569.708804:0:20577:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cdfd000/0x40a459093b0699ba lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20d68 expref: 17 pid: 20577 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129569.708816:0:20577:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cdfd000, rc 0) 00000100:00100000:3.0:1746129569.708837:0:20577:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013575c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:068dab75-d300-4ead-a742-d14572ad1e50+16:1962:x1830948734074240:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 14130us (14443us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129569.708844:0:20577:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16040 00000100:00100000:0.0:1746129569.711699:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129569.711722:0:2271:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734074880 00000100:00100000:0.0:1746129569.711728:0:2271:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734074880 00000100:00100000:0.0:1746129569.711759:0:2271:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11195 00000100:00100000:0.0:1746129569.711765:0:2271:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136015880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:068dab75-d300-4ead-a742-d14572ad1e50+15:32245:x1830948734074880:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:0.0:1746129569.711780:0:2271:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129569.711793:0:2271:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b8e400/0x40a459093b0699c8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20d76 expref: -99 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129569.711862:0:2271:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b8fe00/0x40a459093b0699cf lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129569.711874:0:2271:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880091b4e000/0x40a459093b0699ac lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20d5a expref: 16 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129569.711880:0:2271:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b8fe00/0x40a459093b0699cf lrc: 4/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129569.711902:0:2271:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880091b4e000/0x40a459093b0699ac lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20d5a expref: 16 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129569.711911:0:2271:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880091b4e000/0x40a459093b0699ac lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20d5a expref: 16 pid: 2271 timeout: 925 lvb_type: 0 00000100:00100000:0.0:1746129569.711922:0:2271:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136014700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:2271:1830948737494016:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129569.711971:0:2271:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a586e840 going to sleep for 11 seconds 00000100:00100000:0.0:1746129569.721852:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129569.721899:0:2271:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136014700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:2271:1830948737494016:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129569.721917:0:2271:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b8fe00/0x40a459093b0699cf lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00000100:00100000:2.0:1746129569.722895:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734075008 00000100:00100000:2.0:1746129569.722902:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734075008 00010000:00010000:2.0:1746129569.722928:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091b4e000/0x40a459093b0699ac lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20d5a expref: 17 pid: 2271 timeout: 925 lvb_type: 0 00000100:00100000:2.0:1746129569.722950:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8211 00000100:00100000:2.0:1746129569.722956:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6ce3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:068dab75-d300-4ead-a742-d14572ad1e50+17:1963:x1830948734075008:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129569.722966:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129569.722970:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880091b4e000/0x40a459093b0699ac lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20d5a expref: 17 pid: 2271 timeout: 925 lvb_type: 0 00010000:00010000:2.0:1746129569.722978:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880091b4e000/0x40a459093b0699ac lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20d5a expref: 17 pid: 2271 timeout: 925 lvb_type: 0 00010000:00010000:2.0:1746129569.722996:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091b4e000/0x40a459093b0699ac lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20d5a expref: 17 pid: 2271 timeout: 925 lvb_type: 0 00010000:00010000:2.0:1746129569.723009:0:7085:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:2.0:1746129569.723013:0:7085:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b8fe00/0x40a459093b0699cf lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129569.723021:0:7085:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b8fe00/0x40a459093b0699cf lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129569.723026:0:7085:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b8fe00/0x40a459093b0699cf lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129569.723037:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129569.723075:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6ce3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:068dab75-d300-4ead-a742-d14572ad1e50+16:1963:x1830948734075008:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 119us (1228us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129569.723084:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8211 00010000:00010000:0.0:1746129569.728886:0:2271:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b8fe00/0x40a459093b0699cf lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129569.728899:0:2271:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b8fe00/0x40a459093b0699cf lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00000004:00200000:0.0:1746129569.728917:0:2271:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:0.0:1746129569.729041:0:2271:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b8e400/0x40a459093b0699c8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20d76 expref: 17 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129569.729075:0:2271:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b8fe00/0x40a459093b0699cf lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20d76 expref: 16 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129569.729082:0:2271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:0.0:1746129569.729084:0:2271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746129569.729088:0:2271:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5b8fe00, rc 0) 00000100:00100000:0.0:1746129569.729132:0:2271:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136015880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:068dab75-d300-4ead-a742-d14572ad1e50+16:32245:x1830948734074880:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 17365us (17438us total) trans 8589945286 rc 0/0 00000100:00100000:0.0:1746129569.729140:0:2271:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11195 00000100:00100000:0.0:1746129569.729729:0:8416:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ede300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+31:1962:x1830948734074624:12345-192.168.202.4@tcp:3:cat.0 Request processed in 28009us (28173us total) trans 0 rc 954368/954368 00000100:00100000:0.0:1746129569.729735:0:8416:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7722 00002000:00100000:0.0:1746129569.729742:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3ef:0x0] (4194304->5148671) req@ffff880093ede300 x1830948734074624/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:310/0 lens 488/440 e 0 to 0 dl 1746129580 ref 1 fl Complete:/200/0 rc 954368/954368 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129569.729750:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ede300 with x1830948734074624 ext(4194304->5148671) 00002000:00010000:0.0:1746129569.729754:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093ede300 00000100:00100000:0.0:1746129569.740751:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129569.740790:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129569.740810:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734075136 00000100:00100000:0.0:1746129569.740817:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734075136 00000100:00100000:0.0:1746129569.740846:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734075264 00000100:00100000:0.0:1746129569.740848:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734075264 00000100:00100000:0.0:1746129569.740859:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16042 00000100:00100000:0.0:1746129569.740865:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136014700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:068dab75-d300-4ead-a742-d14572ad1e50+7:1963:x1830948734075136:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:0.0:1746129569.740879:0:7149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129569.740891:0:7149:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a95ed800/0x40a459093b0699dd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20d7d expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129569.740934:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136014e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7149:1830948737494144:192.168.202.4@tcp:106: 00000100:00100000:0.0:1746129569.740998:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a586e840 going to sleep for 11 seconds 00000100:00100000:0.0:1746129569.741012:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16043 00000100:00100000:0.0:1746129569.741017:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136016680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:068dab75-d300-4ead-a742-d14572ad1e50+16:1962:x1830948734075264:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:0.0:1746129569.741024:0:4385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129569.741032:0:4385:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800946f1800/0x40a459093b0699e4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20d84 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129569.741057:0:4385:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136017800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:4385:1830948737494272:192.168.202.4@tcp:106: 00000100:00100000:0.0:1746129569.741075:0:4385:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a586e9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129569.746803:0:4385:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136017800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:4385:1830948737494272:192.168.202.4@tcp:106: 00010000:00010000:0.0:1746129569.746830:0:4385:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800946f1800/0x40a459093b0699e4 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20d84 expref: 17 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129569.746843:0:4385:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800946f1800/0x40a459093b0699e4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20d84 expref: 17 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129569.746852:0:4385:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800946f1800, rc 0) 00000100:00100000:0.0:1746129569.746888:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136016680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:068dab75-d300-4ead-a742-d14572ad1e50+16:1962:x1830948734075264:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 5870us (6097us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129569.746896:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16043 00000100:00100000:0.0:1746129569.746937:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136014e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7149:1830948737494144:192.168.202.4@tcp:106: 00010000:00010000:0.0:1746129569.746950:0:7149:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a95ed800/0x40a459093b0699dd lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20d7d expref: 8 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129569.746958:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a95ed800/0x40a459093b0699dd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20d7d expref: 8 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129569.746964:0:7149:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a95ed800, rc 0) 00000100:00100000:0.0:1746129569.746978:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136014700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:068dab75-d300-4ead-a742-d14572ad1e50+7:1963:x1830948734075136:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 6113us (6234us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129569.746983:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16042 00000100:00100000:0.0:1746129569.754707:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129569.754731:0:2271:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734075520 00000100:00100000:0.0:1746129569.754738:0:2271:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734075520 00000100:00100000:0.0:1746129569.754770:0:2271:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11196 00000100:00100000:0.0:1746129569.754776:0:2271:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136014e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:068dab75-d300-4ead-a742-d14572ad1e50+16:32245:x1830948734075520:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:0.0:1746129569.754795:0:2271:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129569.754797:0:2271:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1746129569.754817:0:2271:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b8fe00/0x40a459093b0699cf lrc: 0/0,0 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20d76 expref: 16 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129569.754831:0:2271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:0.0:1746129569.754834:0:2271:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746129569.754842:0:2271:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800946f1c00/0x40a459093b0699eb lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20d8b expref: -99 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129569.754908:0:2271:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800946f1400/0x40a459093b0699f2 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129569.754917:0:2271:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800946f1400/0x40a459093b0699f2 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129569.754925:0:2271:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800946f1400/0x40a459093b0699f2 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00000004:00200000:0.0:1746129569.754934:0:2271:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:0.0:1746129569.755009:0:2271:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800946f1c00/0x40a459093b0699eb lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x1/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20d8b expref: 18 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129569.755020:0:2271:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800946f1400/0x40a459093b0699f2 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20d8b expref: 17 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129569.755029:0:2271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:0.0:1746129569.755032:0:2271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746129569.755034:0:2271:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800946f1400, rc 0) 00000100:00100000:0.0:1746129569.755068:0:2271:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136014e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:068dab75-d300-4ead-a742-d14572ad1e50+17:32245:x1830948734075520:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 292us (368us total) trans 8589945287 rc 0/0 00000100:00100000:0.0:1746129569.755074:0:2271:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11196 00000100:00100000:1.0:1746129569.758962:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129569.758984:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129569.758995:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129569.759008:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129569.759019:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129569.759042:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129569.759061:0:20577:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734075648 00000100:00100000:1.0:1746129569.759067:0:20577:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734075648 00000100:00100000:1.0:1746129569.759093:0:20577:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734075904 00000100:00100000:1.0:1746129569.759095:0:20577:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734075904 00000100:00100000:1.0:1746129569.759105:0:20577:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734075776 00000100:00100000:1.0:1746129569.759106:0:20577:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734075776 00000100:00100000:1.0:1746129569.759117:0:20577:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16044 00000100:00100000:1.0:1746129569.759123:0:20577:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093edce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:068dab75-d300-4ead-a742-d14572ad1e50+16:1963:x1830948734075648:12345-192.168.202.4@tcp:1:lfs.0 00010000:00010000:1.0:1746129569.759156:0:20577:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009f8d4200/0x40a459093b069a00 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129569.759171:0:20577:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a051d400/0x40a459093b06956f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20add expref: 30 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129569.759177:0:20577:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f359a00/0x40a459093b0695df lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20b1c expref: 16 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129569.759184:0:20577:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009faa2c00/0x40a459093b06958b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20aeb expref: 40 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129569.759189:0:20577:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129569.759190:0:20577:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129569.759193:0:20577:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f8d4200/0x40a459093b069a00 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129569.759217:0:20577:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009faa2c00/0x40a459093b06958b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20aeb expref: 40 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129569.759227:0:20577:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009faa2c00/0x40a459093b06958b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20aeb expref: 40 pid: 4385 timeout: 925 lvb_type: 1 00000100:00100000:1.0:1746129569.759239:0:20577:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009016b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20577:1830948737494400:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129569.759316:0:20577:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f359a00/0x40a459093b0695df lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20b1c expref: 16 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129569.759337:0:20577:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f359a00/0x40a459093b0695df lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20b1c expref: 16 pid: 8410 timeout: 925 lvb_type: 1 00000100:00100000:1.0:1746129569.759345:0:20577:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090168a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20577:1830948737494528:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129569.759373:0:20577:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a051d400/0x40a459093b06956f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20add expref: 30 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129569.759380:0:20577:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a051d400/0x40a459093b06956f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20add expref: 30 pid: 4385 timeout: 925 lvb_type: 0 00000100:00100000:1.0:1746129569.759387:0:20577:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009016ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20577:1830948737494656:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129569.759401:0:20577:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5de8900 going to sleep for 11 seconds 00000100:00100000:1.0:1746129569.759414:0:4699:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734076160 00000100:00100000:1.0:1746129569.759417:0:4699:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734076160 00000100:00100000:1.0:1746129569.759430:0:4699:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734076032 00000100:00100000:1.0:1746129569.759432:0:4699:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734076032 00000100:00100000:1.0:1746129569.759439:0:4699:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734076288 00000100:00100000:1.0:1746129569.759441:0:4699:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734076288 00000100:00100000:1.0:1746129569.759450:0:4699:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16045 00000100:00100000:1.0:1746129569.759455:0:4699:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093eded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:068dab75-d300-4ead-a742-d14572ad1e50+9:1963:x1830948734075904:12345-192.168.202.4@tcp:1:lfs.0 00010000:00010000:1.0:1746129569.759470:0:4699:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a0641800/0x40a459093b069a07 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129569.759479:0:4699:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009efe9400/0x40a459093b06993c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1884160->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20d06 expref: 9 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129569.759488:0:4699:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129569.759489:0:4699:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129569.759491:0:4699:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0641800/0x40a459093b069a07 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129569.759504:0:4699:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009efe9400/0x40a459093b06993c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1884160->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20d06 expref: 9 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129569.759510:0:4699:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009efe9400/0x40a459093b06993c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1884160->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20d06 expref: 9 pid: 22481 timeout: 925 lvb_type: 0 00000100:00100000:1.0:1746129569.759518:0:4699:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009016a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4699:1830948737494784:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129569.759536:0:4699:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5de8cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746129569.759549:0:8410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16046 00000100:00100000:1.0:1746129569.759555:0:8410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ede680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:068dab75-d300-4ead-a742-d14572ad1e50+9:1962:x1830948734075776:12345-192.168.202.4@tcp:1:lfs.0 00010000:00010000:1.0:1746129569.759570:0:8410:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a0640c00/0x40a459093b069a0e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129569.759580:0:8410:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094275000/0x40a459093b069886 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20c8f expref: 22 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129569.759586:0:8410:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f599800/0x40a459093b0698e1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20cce expref: 9 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129569.759592:0:8410:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008e798600/0x40a459093b0698be lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20cb2 expref: 9 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129569.759598:0:8410:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129569.759599:0:8410:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129569.759600:0:8410:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0640c00/0x40a459093b069a0e lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129569.759614:0:8410:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008e798600/0x40a459093b0698be lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20cb2 expref: 9 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129569.759622:0:8410:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008e798600/0x40a459093b0698be lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20cb2 expref: 9 pid: 7149 timeout: 925 lvb_type: 1 00000100:00100000:1.0:1746129569.759629:0:8410:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009016aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8410:1830948737494912:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129569.759652:0:8410:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f599800/0x40a459093b0698e1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20cce expref: 9 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129569.759659:0:8410:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f599800/0x40a459093b0698e1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20cce expref: 9 pid: 4699 timeout: 925 lvb_type: 0 00000100:00100000:1.0:1746129569.759666:0:8410:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090169180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8410:1830948737495040:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129569.759684:0:8410:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094275000/0x40a459093b069886 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20c8f expref: 22 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129569.759691:0:8410:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094275000/0x40a459093b069886 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20c8f expref: 22 pid: 4385 timeout: 925 lvb_type: 0 00000100:00100000:1.0:1746129569.759703:0:8410:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090169500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8410:1830948737495168:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129569.759714:0:8410:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a6dc8a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746129569.759728:0:11014:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16047 00000100:00100000:1.0:1746129569.759733:0:11014:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093eddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:068dab75-d300-4ead-a742-d14572ad1e50+18:1963:x1830948734076160:12345-192.168.202.4@tcp:1:lfs.0 00010000:00010000:1.0:1746129569.759746:0:11014:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a60bf800/0x40a459093b069a15 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129569.759755:0:11014:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f118c00/0x40a459093b06996d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20d30 expref: 30 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129569.759762:0:11014:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f8d5000/0x40a459093b0699c1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20d6f expref: 18 pid: 4699 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129569.759768:0:11014:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f119600/0x40a459093b069982 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 5144576->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20d45 expref: 40 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129569.759772:0:11014:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129569.759773:0:11014:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129569.759775:0:11014:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a60bf800/0x40a459093b069a15 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129569.759787:0:11014:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f119600/0x40a459093b069982 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 5144576->5242879) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20d45 expref: 40 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129569.759794:0:11014:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f119600/0x40a459093b069982 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 5144576->5242879) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20d45 expref: 40 pid: 4699 timeout: 925 lvb_type: 0 00000100:00100000:1.0:1746129569.759802:0:11014:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090169c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11014:1830948737495296:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129569.759821:0:11014:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f8d5000/0x40a459093b0699c1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20d6f expref: 18 pid: 4699 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129569.759827:0:11014:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f8d5000/0x40a459093b0699c1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20d6f expref: 18 pid: 4699 timeout: 925 lvb_type: 1 00000100:00100000:1.0:1746129569.759834:0:11014:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009016b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11014:1830948737495424:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129569.759848:0:11014:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f118c00/0x40a459093b06996d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20d30 expref: 30 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129569.759855:0:11014:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f118c00/0x40a459093b06996d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20d30 expref: 30 pid: 4699 timeout: 925 lvb_type: 0 00000100:00100000:1.0:1746129569.759862:0:11014:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090168000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11014:1830948737495552:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129569.759870:0:11014:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a6dc8300 going to sleep for 11 seconds 00000100:00100000:1.0:1746129569.759976:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16048 00000100:00100000:1.0:1746129569.759981:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009016a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:068dab75-d300-4ead-a742-d14572ad1e50+18:1962:x1830948734076032:12345-192.168.202.4@tcp:1:lfs.0 00010000:00010000:1.0:1746129569.759993:0:7148:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012e91e000/0x40a459093b069a1c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129569.760002:0:7148:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f568200/0x40a459093b069958 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1884159) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20d1b expref: 30 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129569.760012:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129569.760013:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129569.760015:0:7148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e91e000/0x40a459093b069a1c lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129569.760029:0:7148:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f568200/0x40a459093b069958 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1884159) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20d1b expref: 30 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129569.760037:0:7148:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f568200/0x40a459093b069958 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1884159) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20d1b expref: 30 pid: 22481 timeout: 925 lvb_type: 0 00000100:00100000:1.0:1746129569.760044:0:7148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092fd1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7148:1830948737495680:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129569.760063:0:7148:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130fc9180 going to sleep for 11 seconds 00000100:00100000:1.0:1746129569.760073:0:8411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16049 00000100:00100000:1.0:1746129569.760078:0:8411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090169880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:068dab75-d300-4ead-a742-d14572ad1e50+9:1962:x1830948734076288:12345-192.168.202.4@tcp:1:lfs.0 00010000:00010000:1.0:1746129569.760091:0:8411:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012e91e600/0x40a459093b069a23 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129569.760100:0:8411:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a051cc00/0x40a459093b0694ea lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20a9e expref: 22 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129569.760106:0:8411:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f359000/0x40a459093b0695fb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20b38 expref: 9 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129569.760112:0:8411:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d144800/0x40a459093b069568 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20ad6 expref: 9 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129569.760119:0:8411:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129569.760120:0:8411:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129569.760121:0:8411:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e91e600/0x40a459093b069a23 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129569.760133:0:8411:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009d144800/0x40a459093b069568 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20ad6 expref: 9 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129569.760140:0:8411:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009d144800/0x40a459093b069568 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20ad6 expref: 9 pid: 7148 timeout: 925 lvb_type: 1 00000100:00100000:1.0:1746129569.760148:0:8411:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092fd1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8411:1830948737495808:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129569.760165:0:8411:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012f359000/0x40a459093b0695fb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20b38 expref: 9 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129569.760172:0:8411:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012f359000/0x40a459093b0695fb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20b38 expref: 9 pid: 8410 timeout: 925 lvb_type: 1 00000100:00100000:1.0:1746129569.760179:0:8411:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092fd0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8411:1830948737495936:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129569.760193:0:8411:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a051cc00/0x40a459093b0694ea lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20a9e expref: 22 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129569.760200:0:8411:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a051cc00/0x40a459093b0694ea lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20a9e expref: 22 pid: 11014 timeout: 925 lvb_type: 0 00000100:00100000:1.0:1746129569.760212:0:8411:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092fd2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8411:1830948737496064:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129569.760220:0:8411:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130fc90c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746129569.770561:0:11014:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090169c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11014:1830948737495296:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129569.770573:0:11014:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009016b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11014:1830948737495424:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129569.770580:0:11014:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090168000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11014:1830948737495552:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129569.770604:0:11014:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800a60bf800/0x40a459093b069a15 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129569.771010:0:8410:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009016aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8410:1830948737494912:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129569.771019:0:8410:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090169180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8410:1830948737495040:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129569.771027:0:8410:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090169500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8410:1830948737495168:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129569.771041:0:8410:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a0640c00/0x40a459093b069a0e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129569.771184:0:20577:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009016b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20577:1830948737494400:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129569.771194:0:20577:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090168a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20577:1830948737494528:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129569.771201:0:20577:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009016ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20577:1830948737494656:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129569.771216:0:20577:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009f8d4200/0x40a459093b069a00 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129569.771780:0:4699:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009016a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4699:1830948737494784:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129569.771791:0:4699:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a0641800/0x40a459093b069a07 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129569.771811:0:7148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092fd1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7148:1830948737495680:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129569.771819:0:7148:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012e91e000/0x40a459093b069a1c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129569.771836:0:8411:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092fd1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8411:1830948737495808:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129569.771843:0:8411:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092fd0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8411:1830948737495936:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129569.771849:0:8411:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092fd2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8411:1830948737496064:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129569.771859:0:8411:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012e91e600/0x40a459093b069a23 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129569.776817:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129569.776838:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129569.776851:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129569.776864:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129569.776877:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129569.776891:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129569.776904:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129569.776920:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129569.776931:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129569.776945:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129569.776954:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129569.776965:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129569.776987:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129569.777005:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734077056 00000100:00100000:1.0:1746129569.777013:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734077056 00010000:00010000:1.0:1746129569.777040:0:7087:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f119600/0x40a459093b069982 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 5144576->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20d45 expref: 41 pid: 4699 timeout: 925 lvb_type: 0 00000100:00100000:1.0:1746129569.777060:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734076928 00000100:00100000:1.0:1746129569.777062:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734076928 00010000:00010000:1.0:1746129569.777071:0:7087:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009faa2c00/0x40a459093b06958b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20aeb expref: 42 pid: 4385 timeout: 925 lvb_type: 1 00000100:00100000:1.0:1746129569.777080:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734077184 00000100:00100000:1.0:1746129569.777081:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734077184 00010000:00010000:1.0:1746129569.777089:0:7087:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f8d5000/0x40a459093b0699c1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20d6f expref: 19 pid: 4699 timeout: 925 lvb_type: 1 00000100:00100000:1.0:1746129569.777097:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734076544 00000100:00100000:1.0:1746129569.777099:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734076544 00010000:00010000:1.0:1746129569.777107:0:7087:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008e798600/0x40a459093b0698be lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20cb2 expref: 10 pid: 7149 timeout: 925 lvb_type: 1 00000100:00100000:1.0:1746129569.777115:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734076800 00000100:00100000:1.0:1746129569.777117:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734076800 00010000:00010000:1.0:1746129569.777124:0:7087:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a051d400/0x40a459093b06956f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20add expref: 31 pid: 4385 timeout: 925 lvb_type: 0 00000100:00100000:1.0:1746129569.777137:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734077696 00000100:00100000:1.0:1746129569.777138:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734077696 00010000:00010000:1.0:1746129569.777145:0:7087:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012f359000/0x40a459093b0695fb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20b38 expref: 11 pid: 8410 timeout: 925 lvb_type: 1 00000100:00100000:1.0:1746129569.777153:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734076416 00000100:00100000:1.0:1746129569.777154:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734076416 00010000:00010000:1.0:1746129569.777160:0:7087:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f359a00/0x40a459093b0695df lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20b1c expref: 20 pid: 8410 timeout: 925 lvb_type: 1 00000100:00100000:1.0:1746129569.777168:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734077312 00000100:00100000:1.0:1746129569.777169:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734077312 00010000:00010000:1.0:1746129569.777176:0:7087:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f599800/0x40a459093b0698e1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20cce expref: 10 pid: 4699 timeout: 925 lvb_type: 0 00000100:00100000:1.0:1746129569.777183:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734077568 00000100:00100000:1.0:1746129569.777185:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734077568 00010000:00010000:1.0:1746129569.777192:0:7087:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094275000/0x40a459093b069886 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20c8f expref: 23 pid: 4385 timeout: 925 lvb_type: 0 00000100:00100000:1.0:1746129569.777199:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734077824 00000100:00100000:1.0:1746129569.777201:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734077824 00010000:00010000:1.0:1746129569.777207:0:7087:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009d144800/0x40a459093b069568 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20ad6 expref: 11 pid: 7148 timeout: 925 lvb_type: 1 00000100:00100000:1.0:1746129569.777215:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734077952 00000100:00100000:1.0:1746129569.777216:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734077952 00010000:00010000:1.0:1746129569.777223:0:7087:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f118c00/0x40a459093b06996d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20d30 expref: 32 pid: 4699 timeout: 925 lvb_type: 0 00000100:00100000:1.0:1746129569.777232:0:7087:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8212 00000100:00100000:1.0:1746129569.777238:0:7087:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092fd2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ada2ffba-8920-4ecb-8068-68caa9806978+42:1960:x1830948734077056:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129569.777249:0:7087:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129569.777267:0:7087:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f119600/0x40a459093b069982 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 5144576->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20d45 expref: 42 pid: 4699 timeout: 925 lvb_type: 0 00010000:00010000:1.0:1746129569.777276:0:7087:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f119600/0x40a459093b069982 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 5144576->5242879) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20d45 expref: 42 pid: 4699 timeout: 925 lvb_type: 0 00010000:00010000:1.0:1746129569.777315:0:7087:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f119600/0x40a459093b069982 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 5144576->5242879) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20d45 expref: 42 pid: 4699 timeout: 925 lvb_type: 0 00010000:00010000:1.0:1746129569.777340:0:7087:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129569.777359:0:15749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8213 00000100:00100000:1.0:1746129569.777364:0:15749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092fd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ada2ffba-8920-4ecb-8068-68caa9806978+41:1960:x1830948734076928:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129569.777370:0:15749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746129569.777378:0:15749:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3ec:0x0] updating lvb blocks from disk: 1981 -> 2073 00010000:00010000:1.0:1746129569.777382:0:15749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009faa2c00/0x40a459093b06958b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20aeb expref: 41 pid: 4385 timeout: 925 lvb_type: 1 00010000:00010000:1.0:1746129569.777389:0:15749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009faa2c00/0x40a459093b06958b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20aeb expref: 41 pid: 4385 timeout: 925 lvb_type: 1 00010000:00010000:1.0:1746129569.777398:0:15749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009faa2c00/0x40a459093b06958b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20aeb expref: 41 pid: 4385 timeout: 925 lvb_type: 1 00010000:00010000:1.0:1746129569.777406:0:15749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129569.777435:0:15749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092fd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ada2ffba-8920-4ecb-8068-68caa9806978+40:1960:x1830948734076928:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 70us (596us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129569.777441:0:15749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8213 00000100:00100000:1.0:1746129569.777455:0:15749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8214 00000100:00100000:1.0:1746129569.777459:0:15749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092fd1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:068dab75-d300-4ead-a742-d14572ad1e50+20:1960:x1830948734077184:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129569.777464:0:15749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129569.777470:0:15749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f8d5000/0x40a459093b0699c1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20d6f expref: 20 pid: 4699 timeout: 925 lvb_type: 1 00010000:00010000:1.0:1746129569.777477:0:15749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f8d5000/0x40a459093b0699c1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20d6f expref: 20 pid: 4699 timeout: 925 lvb_type: 1 00010000:00010000:1.0:1746129569.777487:0:15749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f8d5000/0x40a459093b0699c1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20d6f expref: 20 pid: 4699 timeout: 925 lvb_type: 1 00010000:00010000:1.0:1746129569.777494:0:15749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129569.777507:0:15749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092fd1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:068dab75-d300-4ead-a742-d14572ad1e50+19:1960:x1830948734077184:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 48us (655us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129569.777512:0:15749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8214 00000100:00100000:1.0:1746129569.777520:0:15749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8215 00000100:00100000:1.0:1746129569.777524:0:15749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092fd1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:068dab75-d300-4ead-a742-d14572ad1e50+11:1962:x1830948734076544:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129569.777531:0:15749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129569.777541:0:15749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008e798600/0x40a459093b0698be lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20cb2 expref: 11 pid: 7149 timeout: 925 lvb_type: 1 00010000:00010000:1.0:1746129569.777549:0:15749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008e798600/0x40a459093b0698be lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20cb2 expref: 11 pid: 7149 timeout: 925 lvb_type: 1 00010000:00010000:1.0:1746129569.777560:0:15749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008e798600/0x40a459093b0698be lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20cb2 expref: 11 pid: 7149 timeout: 925 lvb_type: 1 00010000:00010000:1.0:1746129569.777568:0:15749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129569.777579:0:15749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092fd1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:068dab75-d300-4ead-a742-d14572ad1e50+10:1962:x1830948734076544:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 55us (715us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129569.777584:0:15749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8215 00000100:00100000:1.0:1746129569.777592:0:15749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8216 00000100:00100000:1.0:1746129569.777597:0:15749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092fd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+32:1962:x1830948734076800:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129569.777601:0:15749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129569.777608:0:15749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a051d400/0x40a459093b06956f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20add expref: 32 pid: 4385 timeout: 925 lvb_type: 0 00010000:00010000:1.0:1746129569.777614:0:15749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a051d400/0x40a459093b06956f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20add expref: 32 pid: 4385 timeout: 925 lvb_type: 0 00010000:00010000:1.0:1746129569.777625:0:15749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a051d400/0x40a459093b06956f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20add expref: 32 pid: 4385 timeout: 925 lvb_type: 0 00010000:00010000:1.0:1746129569.777632:0:15749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129569.777643:0:15749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092fd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+31:1962:x1830948734076800:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 46us (765us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129569.777650:0:15749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8216 00000100:00100000:1.0:1746129569.777659:0:15749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8217 00000100:00100000:1.0:1746129569.777663:0:15749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092fd0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:068dab75-d300-4ead-a742-d14572ad1e50+9:1962:x1830948734077696:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129569.777667:0:15749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129569.777676:0:15749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012f359000/0x40a459093b0695fb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20b38 expref: 9 pid: 8410 timeout: 925 lvb_type: 1 00010000:00010000:1.0:1746129569.777683:0:15749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012f359000/0x40a459093b0695fb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20b38 expref: 9 pid: 8410 timeout: 925 lvb_type: 1 00010000:00010000:1.0:1746129569.777692:0:15749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f359000/0x40a459093b0695fb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20b38 expref: 9 pid: 8410 timeout: 925 lvb_type: 1 00010000:00010000:1.0:1746129569.777699:0:15749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129569.777710:0:15749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092fd0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:068dab75-d300-4ead-a742-d14572ad1e50+8:1962:x1830948734077696:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 48us (805us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129569.777715:0:15749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8217 00000100:00100000:1.0:1746129569.777724:0:15749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8218 00000100:00100000:1.0:1746129569.777727:0:15749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6ce3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:068dab75-d300-4ead-a742-d14572ad1e50+18:1962:x1830948734076416:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129569.777732:0:15749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129569.777738:0:15749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f359a00/0x40a459093b0695df lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20b1c expref: 18 pid: 8410 timeout: 925 lvb_type: 1 00010000:00010000:1.0:1746129569.777745:0:15749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f359a00/0x40a459093b0695df lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20b1c expref: 18 pid: 8410 timeout: 925 lvb_type: 1 00010000:00010000:1.0:1746129569.777759:0:15749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f359a00/0x40a459093b0695df lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20b1c expref: 18 pid: 8410 timeout: 925 lvb_type: 1 00010000:00010000:1.0:1746129569.777766:0:15749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129569.777768:0:15749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129569.777772:0:15749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f8d4200/0x40a459093b069a00 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129569.777779:0:15749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f8d4200/0x40a459093b069a00 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129569.777796:0:15749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129569.777808:0:15749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6ce3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:068dab75-d300-4ead-a742-d14572ad1e50+17:1962:x1830948734076416:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 80us (887us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129569.777813:0:15749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8218 00000100:00100000:1.0:1746129569.777821:0:15749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8219 00000100:00100000:1.0:1746129569.777825:0:15749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092fd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+11:1962:x1830948734077312:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129569.777830:0:15749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129569.777836:0:15749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f599800/0x40a459093b0698e1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20cce expref: 11 pid: 4699 timeout: 925 lvb_type: 0 00010000:00010000:1.0:1746129569.777843:0:15749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f599800/0x40a459093b0698e1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20cce expref: 11 pid: 4699 timeout: 925 lvb_type: 0 00010000:00010000:1.0:1746129569.777853:0:15749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f599800/0x40a459093b0698e1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20cce expref: 11 pid: 4699 timeout: 925 lvb_type: 0 00010000:00010000:1.0:1746129569.777864:0:15749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129569.777876:0:15749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092fd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+10:1962:x1830948734077312:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 50us (930us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129569.777880:0:15749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8219 00000100:00100000:1.0:1746129569.777888:0:15749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8220 00000100:00100000:1.0:1746129569.777892:0:15749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092fd0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ada2ffba-8920-4ecb-8068-68caa9806978+23:1962:x1830948734077568:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129569.777897:0:15749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129569.777902:0:15749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094275000/0x40a459093b069886 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20c8f expref: 23 pid: 4385 timeout: 925 lvb_type: 0 00010000:00010000:1.0:1746129569.777909:0:15749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094275000/0x40a459093b069886 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20c8f expref: 23 pid: 4385 timeout: 925 lvb_type: 0 00010000:00010000:1.0:1746129569.777918:0:15749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094275000/0x40a459093b069886 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20c8f expref: 23 pid: 4385 timeout: 925 lvb_type: 0 00010000:00010000:1.0:1746129569.777926:0:15749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129569.777927:0:15749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129569.777930:0:15749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0640c00/0x40a459093b069a0e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129569.777935:0:15749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0640c00/0x40a459093b069a0e lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129569.777947:0:15749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129569.777960:0:15749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092fd0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ada2ffba-8920-4ecb-8068-68caa9806978+22:1962:x1830948734077568:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 67us (1004us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129569.777964:0:15749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8220 00000100:00100000:1.0:1746129569.777973:0:15749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8221 00000100:00100000:1.0:1746129569.777977:0:15749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baedc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+9:1962:x1830948734077824:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129569.777983:0:15749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129569.777989:0:15749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009d144800/0x40a459093b069568 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20ad6 expref: 9 pid: 7148 timeout: 925 lvb_type: 1 00010000:00010000:1.0:1746129569.777995:0:15749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009d144800/0x40a459093b069568 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20ad6 expref: 9 pid: 7148 timeout: 925 lvb_type: 1 00010000:00010000:1.0:1746129569.778004:0:15749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d144800/0x40a459093b069568 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20ad6 expref: 9 pid: 7148 timeout: 925 lvb_type: 1 00010000:00010000:1.0:1746129569.778011:0:15749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129569.778019:0:15749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baedc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+8:1962:x1830948734077824:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 42us (1054us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129569.778023:0:15749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8221 00000100:00100000:1.0:1746129569.778031:0:15749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8222 00000100:00100000:1.0:1746129569.778035:0:15749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+30:1961:x1830948734077952:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129569.778040:0:15749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129569.778047:0:15749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f118c00/0x40a459093b06996d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20d30 expref: 30 pid: 4699 timeout: 925 lvb_type: 0 00010000:00010000:1.0:1746129569.778053:0:15749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f118c00/0x40a459093b06996d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20d30 expref: 30 pid: 4699 timeout: 925 lvb_type: 0 00010000:00010000:1.0:1746129569.778063:0:15749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f118c00/0x40a459093b06996d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20d30 expref: 30 pid: 4699 timeout: 925 lvb_type: 0 00010000:00010000:1.0:1746129569.778070:0:15749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129569.778071:0:15749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129569.778074:0:15749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a60bf800/0x40a459093b069a15 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129569.778079:0:15749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a60bf800/0x40a459093b069a15 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129569.778091:0:15749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129569.778099:0:15749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+29:1961:x1830948734077952:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 64us (1112us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129569.778103:0:15749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8222 00000100:00100000:1.0:1746129569.778242:0:7087:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092fd2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ada2ffba-8920-4ecb-8068-68caa9806978+39:1960:x1830948734077056:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 1003us (1431us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129569.778247:0:7087:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8212 00000100:00100000:3.0:1746129569.778368:0:31519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734077440 00000100:00100000:3.0:1746129569.778372:0:31519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734077440 00002000:00100000:3.0:1746129569.778399:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3ee:0x0] (1048576->1884159) req@ffff880092fd1880 x1830948734077440/t0(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:310/0 lens 488/0 e 0 to 0 dl 1746129580 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129569.778407:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092fd1880 with x1830948734077440 ext(1048576->1884159) 00010000:00010000:3.0:1746129569.778412:0:31519:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f568200/0x40a459093b069958 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1884159) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20d1b expref: 29 pid: 22481 timeout: 925 lvb_type: 0 00010000:00010000:3.0:1746129569.778424:0:31519:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f568200/0x40a459093b069958 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1884159) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20d1b expref: 29 pid: 22481 timeout: 925 lvb_type: 0 00002000:00010000:3.0:1746129569.778430:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092fd1880 00000100:00100000:3.0:1746129569.778441:0:31519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734076672 00000100:00100000:3.0:1746129569.778443:0:31519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734076672 00002000:00100000:3.0:1746129569.778454:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f4:0x0] (1884160->2097151) req@ffff880092fd3b80 x1830948734076672/t0(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:310/0 lens 488/0 e 0 to 0 dl 1746129580 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129569.778460:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092fd3b80 with x1830948734076672 ext(1884160->2097151) 00010000:00010000:3.0:1746129569.778464:0:31519:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009efe9400/0x40a459093b06993c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1884160->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20d06 expref: 8 pid: 22481 timeout: 925 lvb_type: 0 00010000:00010000:3.0:1746129569.778470:0:31519:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009efe9400/0x40a459093b06993c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1884160->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20d06 expref: 8 pid: 22481 timeout: 925 lvb_type: 0 00002000:00010000:3.0:1746129569.778475:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092fd3b80 00000100:00100000:3.0:1746129569.778486:0:31519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2408 00000100:00100000:3.0:1746129569.778491:0:31519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092fd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+29:1962:x1830948734077440:12345-192.168.202.4@tcp:4:cat.0 00000100:00100000:3.0:1746129569.779130:0:21463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2409 00000100:00100000:3.0:1746129569.779136:0:21463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092fd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+8:1962:x1830948734076672:12345-192.168.202.4@tcp:4:cat.0 00010000:00010000:3.0:1746129569.779388:0:20577:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009f8d4200/0x40a459093b069a00 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129569.779395:0:20577:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f8d4200/0x40a459093b069a00 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129569.779411:0:20577:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009f8d4200/0x40a459093b069a00 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129569.779419:0:20577:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009f8d4200/0x40a459093b069a00 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129569.779426:0:20577:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009f8d4200/0x40a459093b069a00 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129569.779431:0:20577:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f8d4200 already unused, calling callback (ffffffffa086ed70) 00010000:00010000:3.0:1746129569.779434:0:20577:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f8d4200/0x40a459093b069a00 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129569.779441:0:20577:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f8d4200/0x40a459093b069a00 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129569.779450:0:20577:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009f8d4200/0x40a459093b069a00 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129569.779455:0:20577:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f8d4200/0x40a459093b069a00 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129569.779487:0:20577:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093edce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:068dab75-d300-4ead-a742-d14572ad1e50+16:1963:x1830948734075648:12345-192.168.202.4@tcp:1:lfs.0 Request processed in 20365us (20531us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129569.779493:0:20577:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16044 00010000:00010000:0.0:1746129569.779864:0:8410:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a0640c00/0x40a459093b069a0e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129569.779871:0:8410:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0640c00/0x40a459093b069a0e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129569.779885:0:8410:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a0640c00/0x40a459093b069a0e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129569.779891:0:8410:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0640c00/0x40a459093b069a0e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129569.779900:0:8410:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a0640c00/0x40a459093b069a0e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129569.779905:0:8410:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0640c00 already unused, calling callback (ffffffffa086ed70) 00010000:00010000:0.0:1746129569.779908:0:8410:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a0640c00/0x40a459093b069a0e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129569.779913:0:8410:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a0640c00/0x40a459093b069a0e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129569.779922:0:8410:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a0640c00/0x40a459093b069a0e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129569.779927:0:8410:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0640c00/0x40a459093b069a0e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129569.779958:0:8410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ede680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:068dab75-d300-4ead-a742-d14572ad1e50+7:1962:x1830948734075776:12345-192.168.202.4@tcp:1:lfs.0 Request processed in 20403us (20961us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129569.779963:0:8410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16046 00000100:00100000:0.0:1746129569.780721:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129569.780801:0:7086:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734078080 00000100:00100000:0.0:1746129569.780806:0:7086:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734078080 00010000:00010000:0.0:1746129569.780823:0:7086:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a051cc00/0x40a459093b0694ea lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20a9e expref: 22 pid: 11014 timeout: 925 lvb_type: 0 00000100:00100000:0.0:1746129569.780840:0:7086:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8223 00000100:00100000:0.0:1746129569.780845:0:7086:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136017800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ada2ffba-8920-4ecb-8068-68caa9806978+22:1963:x1830948734078080:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129569.780853:0:7086:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129569.780864:0:7086:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a051cc00/0x40a459093b0694ea lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20a9e expref: 22 pid: 11014 timeout: 925 lvb_type: 0 00010000:00010000:0.0:1746129569.780873:0:7086:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a051cc00/0x40a459093b0694ea lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20a9e expref: 22 pid: 11014 timeout: 925 lvb_type: 0 00010000:00010000:0.0:1746129569.780885:0:7086:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a051cc00/0x40a459093b0694ea lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20a9e expref: 22 pid: 11014 timeout: 925 lvb_type: 0 00010000:00010000:0.0:1746129569.780894:0:7086:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129569.780895:0:7086:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129569.780899:0:7086:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e91e600/0x40a459093b069a23 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129569.780905:0:7086:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e91e600/0x40a459093b069a23 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129569.780921:0:7086:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129569.780939:0:7086:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136017800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ada2ffba-8920-4ecb-8068-68caa9806978+21:1963:x1830948734078080:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 93us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129569.780944:0:7086:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8223 00010000:00010000:2.0:1746129569.781444:0:11014:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a60bf800/0x40a459093b069a15 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129569.781458:0:11014:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a60bf800/0x40a459093b069a15 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129569.781475:0:11014:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a60bf800/0x40a459093b069a15 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129569.781480:0:11014:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a60bf800/0x40a459093b069a15 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129569.781490:0:11014:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a60bf800/0x40a459093b069a15 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129569.781495:0:11014:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a60bf800 already unused, calling callback (ffffffffa086ed70) 00010000:00010000:2.0:1746129569.781497:0:11014:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a60bf800/0x40a459093b069a15 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129569.781507:0:11014:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a60bf800/0x40a459093b069a15 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129569.781519:0:11014:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a60bf800/0x40a459093b069a15 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129569.781525:0:11014:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a60bf800/0x40a459093b069a15 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129569.781575:0:11014:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093eddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:068dab75-d300-4ead-a742-d14572ad1e50+15:1963:x1830948734076160:12345-192.168.202.4@tcp:1:lfs.0 Request processed in 21841us (22565us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129569.781580:0:11014:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16047 00010000:00010000:1.0:1746129569.784834:0:8411:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012e91e600/0x40a459093b069a23 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129569.784849:0:8411:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e91e600/0x40a459093b069a23 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129569.784879:0:8411:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012e91e600/0x40a459093b069a23 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129569.784891:0:8411:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012e91e600/0x40a459093b069a23 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129569.784897:0:8411:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012e91e600/0x40a459093b069a23 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129569.784903:0:8411:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e91e600 already unused, calling callback (ffffffffa086ed70) 00010000:00010000:1.0:1746129569.784907:0:8411:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012e91e600/0x40a459093b069a23 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129569.784914:0:8411:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012e91e600/0x40a459093b069a23 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129569.784928:0:8411:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012e91e600/0x40a459093b069a23 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129569.784934:0:8411:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e91e600/0x40a459093b069a23 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129569.785002:0:8411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090169880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:068dab75-d300-4ead-a742-d14572ad1e50+6:1962:x1830948734076288:12345-192.168.202.4@tcp:1:lfs.0 Request processed in 24919us (25954us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129569.785011:0:8411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16049 00000100:00100000:0.0:1746129569.812229:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129569.812254:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734078336 00000100:00100000:0.0:1746129569.812261:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734078336 00000100:00100000:0.0:1746129569.812311:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11197 00000100:00100000:0.0:1746129569.812317:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136015180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ada2ffba-8920-4ecb-8068-68caa9806978+309:32250:x1830948734078336:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:0.0:1746129569.812344:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129569.812358:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800946f0200/0x40a459093b069a2a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20d92 expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129569.812426:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800946f1800/0x40a459093b069a31 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129569.812438:0:14549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800946f1400/0x40a459093b0699f2 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20d8b expref: 16 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129569.812443:0:14549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800946f1800/0x40a459093b069a31 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129569.812467:0:14549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800946f1400/0x40a459093b0699f2 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20d8b expref: 16 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129569.812475:0:14549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800946f1400/0x40a459093b0699f2 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20d8b expref: 16 pid: 2271 timeout: 925 lvb_type: 0 00000100:00100000:0.0:1746129569.812485:0:14549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136014000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830948737496192:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129569.812542:0:14549:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4123d80 going to sleep for 11 seconds 00000100:00100000:3.0:1746129569.817225:0:21463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092fd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+10:1962:x1830948734076672:12345-192.168.202.4@tcp:4:cat.0 Request processed in 38082us (40286us total) trans 17179874087 rc 0/0 00000100:00100000:3.0:1746129569.817235:0:21463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2409 00002000:00100000:3.0:1746129569.817245:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3f4:0x0] (1884160->2097151) req@ffff880092fd3b80 x1830948734076672/t17179874087(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:310/0 lens 488/448 e 0 to 0 dl 1746129580 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129569.817254:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092fd3b80 with x1830948734076672 ext(1884160->2097151) 00010000:00010000:3.0:1746129569.817263:0:21463:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009efe9400/0x40a459093b06993c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1884160->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20d06 expref: 10 pid: 22481 timeout: 925 lvb_type: 0 00010000:00010000:3.0:1746129569.817276:0:21463:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009efe9400/0x40a459093b06993c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1884160->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20d06 expref: 10 pid: 22481 timeout: 925 lvb_type: 0 00002000:00010000:3.0:1746129569.817282:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092fd3b80 00000100:00100000:1.0:1746129569.827451:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129569.827483:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129569.827500:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129569.827513:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129569.827528:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129569.827540:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129569.827554:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129569.829979:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129569.830025:0:8411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734078720 00000100:00100000:1.0:1746129569.830032:0:8411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734078720 00000100:00100000:1.0:1746129569.830063:0:8411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734078848 00000100:00100000:1.0:1746129569.830065:0:8411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734078848 00000100:00100000:1.0:1746129569.830074:0:8411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734078976 00000100:00100000:1.0:1746129569.830076:0:8411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734078976 00000100:00100000:1.0:1746129569.830084:0:8411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734079104 00000100:00100000:1.0:1746129569.830085:0:8411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734079104 00000100:00100000:1.0:1746129569.830093:0:8411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734079232 00000100:00100000:1.0:1746129569.830094:0:8411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734079232 00000100:00100000:1.0:1746129569.830100:0:8411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734079360 00000100:00100000:1.0:1746129569.830102:0:8411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734079360 00000100:00100000:1.0:1746129569.830111:0:8411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16050 00000100:00100000:1.0:1746129569.830116:0:8411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ada2ffba-8920-4ecb-8068-68caa9806978+41:1960:x1830948734078720:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129569.830130:0:8411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129569.830144:0:8411:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e91ec00/0x40a459093b069a38 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20d99 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746129569.830163:0:8411:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3ec:0x0] initial LVB size: 1048576, mtime: 0x6813d2a1, atime: 0x6813d2a0, ctime: 0x6813d2a1, blocks: 0x819 00010000:00010000:1.0:1746129569.830178:0:8411:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129569.830179:0:8411:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129569.830186:0:8411:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e91ec00/0x40a459093b069a38 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20d99 expref: 42 pid: 8411 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129569.830199:0:8411:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012e91ec00/0x40a459093b069a38 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20d99 expref: 42 pid: 8411 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129569.830213:0:8411:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e91ec00, rc 0) 00000100:00100000:1.0:1746129569.830252:0:8411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ada2ffba-8920-4ecb-8068-68caa9806978+42:1960:x1830948734078720:12345-192.168.202.4@tcp:101:cat.0 Request processed in 135us (2751us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129569.830257:0:8411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16050 00000100:00100000:1.0:1746129569.830270:0:8411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16051 00000100:00100000:1.0:1746129569.830274:0:8411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baeed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ada2ffba-8920-4ecb-8068-68caa9806978+23:1960:x1830948734078848:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129569.830281:0:8411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129569.830289:0:8411:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e91f600/0x40a459093b069a3f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20da0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129569.830379:0:22481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16052 00000100:00100000:1.0:1746129569.830384:0:22481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092fd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ada2ffba-8920-4ecb-8068-68caa9806978+23:1960:x1830948734078976:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129569.830390:0:22481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129569.830395:0:22481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e91f200/0x40a459093b069a46 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20da7 expref: -99 pid: 22481 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129569.830425:0:22481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092fd0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:22481:1830948737496320:192.168.202.4@tcp:106: 00000100:00100000:1.0:1746129569.830461:0:22481:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130fc9180 going to sleep for 11 seconds 00000100:00100000:1.0:1746129569.830475:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16053 00000100:00100000:1.0:1746129569.830480:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092fd1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ada2ffba-8920-4ecb-8068-68caa9806978+41:1960:x1830948734079104:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129569.830485:0:4385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129569.830490:0:4385:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e91e600/0x40a459093b069a4d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20dae expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129569.830513:0:4385:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092fd2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:4385:1830948737496448:192.168.202.4@tcp:106: 00000100:00100000:1.0:1746129569.830528:0:4385:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934d2480 going to sleep for 11 seconds 00000100:00100000:1.0:1746129569.830540:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16054 00000100:00100000:1.0:1746129569.830544:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092fd1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ada2ffba-8920-4ecb-8068-68caa9806978+42:1960:x1830948734079232:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129569.830549:0:7149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129569.830555:0:7149:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e91fa00/0x40a459093b069a54 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20db5 expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746129569.830565:0:7149:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3ef:0x0] initial LVB size: 5146336, mtime: 0x6813d2a2, atime: 0x6813d2a2, ctime: 0x6813d2a2, blocks: 0x1791 00010000:00010000:1.0:1746129569.830571:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129569.830572:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129569.830576:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e91fa00/0x40a459093b069a54 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20db5 expref: 43 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129569.830585:0:7149:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012e91fa00/0x40a459093b069a54 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20db5 expref: 43 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129569.830591:0:7149:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e91fa00, rc 0) 00000100:00100000:1.0:1746129569.830603:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092fd1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ada2ffba-8920-4ecb-8068-68caa9806978+43:1960:x1830948734079232:12345-192.168.202.4@tcp:101:cat.0 Request processed in 59us (3048us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129569.830608:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16054 00000100:00100000:1.0:1746129569.830616:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16055 00000100:00100000:1.0:1746129569.830620:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092fd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ada2ffba-8920-4ecb-8068-68caa9806978+24:1960:x1830948734079360:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129569.830625:0:7149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129569.830630:0:7149:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e91e800/0x40a459093b069a5b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20dbc expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746129569.830642:0:7149:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3f5:0x0] initial LVB size: 4194304, mtime: 0x6813d2a0, atime: 0x6813d2a0, ctime: 0x6813d2a0, blocks: 0x1029 00010000:00010000:1.0:1746129569.830647:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129569.830648:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129569.830652:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e91e800/0x40a459093b069a5b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20dbc expref: 25 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129569.830659:0:7149:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012e91e800/0x40a459093b069a5b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20dbc expref: 25 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129569.830665:0:7149:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e91e800, rc 0) 00000100:00100000:1.0:1746129569.830676:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092fd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ada2ffba-8920-4ecb-8068-68caa9806978+25:1960:x1830948734079360:12345-192.168.202.4@tcp:101:cat.0 Request processed in 56us (704us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129569.830681:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16055 00000100:00100000:0.0:1746129569.831121:0:14549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136014000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830948737496192:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129569.831136:0:14549:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800946f1800/0x40a459093b069a31 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000100:00100000:0.0:1746129569.831153:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734078464 00000100:00100000:0.0:1746129569.831156:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734078464 00010000:00010000:0.0:1746129569.831171:0:7087:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800946f1400/0x40a459093b0699f2 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20d8b expref: 17 pid: 2271 timeout: 925 lvb_type: 0 00000100:00100000:0.0:1746129569.831188:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734078592 00000100:00100000:0.0:1746129569.831190:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734078592 00010000:00010000:0.0:1746129569.831199:0:7087:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009efe9400/0x40a459093b06993c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1884160->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20d06 expref: 10 pid: 22481 timeout: 925 lvb_type: 0 00000100:00100000:0.0:1746129569.831211:0:7087:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8224 00000100:00100000:0.0:1746129569.831215:0:7087:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baef800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:068dab75-d300-4ead-a742-d14572ad1e50+17:1963:x1830948734078464:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129569.831223:0:7087:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129569.831227:0:7087:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800946f1400/0x40a459093b0699f2 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20d8b expref: 17 pid: 2271 timeout: 925 lvb_type: 0 00010000:00010000:0.0:1746129569.831235:0:7087:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800946f1400/0x40a459093b0699f2 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20d8b expref: 17 pid: 2271 timeout: 925 lvb_type: 0 00010000:00010000:0.0:1746129569.831250:0:7087:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800946f1400/0x40a459093b0699f2 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20d8b expref: 17 pid: 2271 timeout: 925 lvb_type: 0 00010000:00010000:0.0:1746129569.831259:0:7087:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:0.0:1746129569.831263:0:7087:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800946f1800/0x40a459093b069a31 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129569.831270:0:7087:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800946f1800/0x40a459093b069a31 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129569.831276:0:7087:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800946f1800/0x40a459093b069a31 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129569.831286:0:7087:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129569.831316:0:7087:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baef800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:068dab75-d300-4ead-a742-d14572ad1e50+16:1963:x1830948734078464:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 101us (3874us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129569.831331:0:7087:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8224 00000100:00100000:0.0:1746129569.831342:0:7087:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8225 00000100:00100000:0.0:1746129569.831347:0:7087:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6ce3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+10:1963:x1830948734078592:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129569.831352:0:7087:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129569.831362:0:7087:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009efe9400/0x40a459093b06993c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1884160->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20d06 expref: 10 pid: 22481 timeout: 925 lvb_type: 0 00010000:00010000:0.0:1746129569.831369:0:7087:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009efe9400/0x40a459093b06993c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1884160->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20d06 expref: 10 pid: 22481 timeout: 925 lvb_type: 0 00010000:00010000:0.0:1746129569.831380:0:7087:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129569.831381:0:7087:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129569.831384:0:7087:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0641800/0x40a459093b069a07 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129569.831389:0:7087:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0641800/0x40a459093b069a07 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129569.831401:0:7087:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129569.831414:0:7087:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6ce3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+10:1963:x1830948734078592:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 67us (3930us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129569.831419:0:7087:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8225 00010000:00010000:0.0:1746129569.831469:0:4699:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a0641800/0x40a459093b069a07 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129569.831476:0:4699:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0641800/0x40a459093b069a07 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129569.831491:0:4699:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a0641800/0x40a459093b069a07 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129569.831498:0:4699:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0641800/0x40a459093b069a07 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129569.831504:0:4699:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a0641800/0x40a459093b069a07 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129569.831510:0:4699:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0641800 already unused, calling callback (ffffffffa086ed70) 00010000:00010000:0.0:1746129569.831513:0:4699:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a0641800/0x40a459093b069a07 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129569.831519:0:4699:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a0641800/0x40a459093b069a07 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129569.831528:0:4699:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a0641800/0x40a459093b069a07 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129569.831533:0:4699:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0641800/0x40a459093b069a07 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129569.831557:0:4699:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093eded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:068dab75-d300-4ead-a742-d14572ad1e50+5:1963:x1830948734075904:12345-192.168.202.4@tcp:1:lfs.0 Request processed in 72102us (72572us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129569.831562:0:4699:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16045 00010000:00010000:0.0:1746129569.831576:0:14549:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800946f1800/0x40a459093b069a31 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129569.831581:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800946f1800/0x40a459093b069a31 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00200000:0.0:1746129569.831594:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:0.0:1746129569.831693:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800946f0200/0x40a459093b069a2a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20d92 expref: 312 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129569.831704:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800946f1800/0x40a459093b069a31 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20d92 expref: 311 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129569.831709:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:0.0:1746129569.831712:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746129569.831713:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800946f1800, rc 0) 00000100:00100000:0.0:1746129569.831732:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136015180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ada2ffba-8920-4ecb-8068-68caa9806978+311:32250:x1830948734078336:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 19415us (19510us total) trans 8589945288 rc 0/0 00000100:00100000:0.0:1746129569.831737:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11197 00002000:00010000:0.0:1746129569.831883:0:8411:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3f3:0x0] initial LVB size: 2097152, mtime: 0x6813d2a1, atime: 0x6813d2a1, ctime: 0x6813d2a1, blocks: 0x81f 00010000:00010000:0.0:1746129569.831893:0:8411:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129569.831895:0:8411:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129569.831899:0:8411:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e91f600/0x40a459093b069a3f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20da0 expref: 25 pid: 8411 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129569.831908:0:8411:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012e91f600/0x40a459093b069a3f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20da0 expref: 25 pid: 8411 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129569.831915:0:8411:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e91f600, rc 0) 00000100:00100000:0.0:1746129569.831929:0:8411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baeed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ada2ffba-8920-4ecb-8068-68caa9806978+25:1960:x1830948734078848:12345-192.168.202.4@tcp:101:cat.0 Request processed in 1654us (4415us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129569.831934:0:8411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16051 00000100:00100000:2.0:1746129569.836423:0:31519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092fd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+31:1962:x1830948734077440:12345-192.168.202.4@tcp:4:cat.0 Request processed in 57925us (59523us total) trans 21474841331 rc 0/0 00000100:00100000:2.0:1746129569.836434:0:31519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2408 00002000:00100000:2.0:1746129569.836443:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3ee:0x0] (1048576->1884159) req@ffff880092fd1880 x1830948734077440/t21474841331(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:310/0 lens 488/448 e 0 to 0 dl 1746129580 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129569.836451:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092fd1880 with x1830948734077440 ext(1048576->1884159) 00010000:00010000:2.0:1746129569.836458:0:31519:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f568200/0x40a459093b069958 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1884159) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20d1b expref: 31 pid: 22481 timeout: 925 lvb_type: 0 00010000:00010000:2.0:1746129569.836472:0:31519:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f568200/0x40a459093b069958 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1884159) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20d1b expref: 31 pid: 22481 timeout: 925 lvb_type: 0 00002000:00010000:2.0:1746129569.836478:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092fd1880 00000100:00100000:1.0:1746129569.839839:0:4385:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092fd2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:4385:1830948737496448:192.168.202.4@tcp:106: 00010000:00010000:1.0:1746129569.839869:0:4385:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012e91e600/0x40a459093b069a4d lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20dae expref: 42 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129569.839883:0:4385:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e91e600/0x40a459093b069a4d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20dae expref: 42 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129569.839895:0:4385:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e91e600, rc 0) 00000100:00100000:1.0:1746129569.839936:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092fd1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ada2ffba-8920-4ecb-8068-68caa9806978+41:1960:x1830948734079104:12345-192.168.202.4@tcp:101:cat.0 Request processed in 9455us (12394us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129569.839944:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16053 00010000:00010000:1.0:1746129569.839980:0:22481:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.202.4@tcp) returned -22 from glimpse AST (req@ffff880092fd0000 x1830948737496320) - normal race ns: filter-lustre-OST0001_UUID lock: ffff88009efe9400/0x40a459093b06993c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1884160->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20d06 expref: 9 pid: 22481 timeout: 925 lvb_type: 0 00010000:00010000:1.0:1746129569.840001:0:22481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009efe9400/0x40a459093b06993c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1884160->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20d06 expref: 9 pid: 22481 timeout: 925 lvb_type: 0 00000100:00100000:1.0:1746129569.840009:0:22481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092fd0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:22481:1830948737496320:192.168.202.4@tcp:106: 00010000:00010000:1.0:1746129569.840024:0:22481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012e91f200/0x40a459093b069a46 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20da7 expref: 24 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129569.840033:0:22481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e91f200/0x40a459093b069a46 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20da7 expref: 24 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129569.840043:0:22481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e91f200, rc 0) 00000100:00100000:1.0:1746129569.840058:0:22481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092fd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ada2ffba-8920-4ecb-8068-68caa9806978+23:1960:x1830948734078976:12345-192.168.202.4@tcp:101:cat.0 Request processed in 9674us (12530us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129569.840063:0:22481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16052 00000100:00100000:0.0:1746129569.852495:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129569.852562:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129569.857489:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734079488 00000100:00100000:2.0:1746129569.857499:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734079488 00010000:00010000:2.0:1746129569.857529:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f568200/0x40a459093b069958 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1884159) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20d1b expref: 31 pid: 22481 timeout: 925 lvb_type: 0 00000100:00100000:2.0:1746129569.857553:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8226 00000100:00100000:2.0:1746129569.857559:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136017800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+31:1962:x1830948734079488:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129569.857569:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129569.857585:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f568200/0x40a459093b069958 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1884159) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20d1b expref: 31 pid: 22481 timeout: 925 lvb_type: 0 00010000:00010000:2.0:1746129569.857594:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f568200/0x40a459093b069958 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1884159) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20d1b expref: 31 pid: 22481 timeout: 925 lvb_type: 0 00010000:00010000:2.0:1746129569.857611:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f568200/0x40a459093b069958 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1884159) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20d1b expref: 31 pid: 22481 timeout: 925 lvb_type: 0 00010000:00010000:2.0:1746129569.857622:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129569.857624:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129569.857628:0:7085:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012e91e000/0x40a459093b069a1c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129569.857635:0:7085:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e91e000/0x40a459093b069a1c lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129569.857660:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129569.857701:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136017800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+30:1962:x1830948734079488:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 142us (5211us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129569.857709:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8226 00000100:00100000:2.0:1746129569.857729:0:31519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734079744 00000100:00100000:2.0:1746129569.857732:0:31519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734079744 00002000:00100000:2.0:1746129569.857749:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3ec:0x0] (0->1048575) req@ffff880136014000 x1830948734079744/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:310/0 lens 488/0 e 0 to 0 dl 1746129580 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129569.857758:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136014000 with x1830948734079744 ext(0->1048575) 00002000:00010000:2.0:1746129569.857761:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136014000 00000100:00100000:2.0:1746129569.857775:0:21463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7723 00000100:00100000:2.0:1746129569.857779:0:21463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136014000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ada2ffba-8920-4ecb-8068-68caa9806978+41:1961:x1830948734079744:12345-192.168.202.4@tcp:3:cat.0 00010000:00010000:1.0:1746129569.860034:0:7148:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012e91e000/0x40a459093b069a1c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129569.860044:0:7148:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e91e000/0x40a459093b069a1c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129569.860067:0:7148:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012e91e000/0x40a459093b069a1c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129569.860078:0:7148:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012e91e000/0x40a459093b069a1c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129569.860084:0:7148:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012e91e000/0x40a459093b069a1c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129569.860089:0:7148:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e91e000 already unused, calling callback (ffffffffa086ed70) 00010000:00010000:1.0:1746129569.860092:0:7148:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012e91e000/0x40a459093b069a1c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129569.860098:0:7148:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012e91e000/0x40a459093b069a1c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129569.860111:0:7148:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012e91e000/0x40a459093b069a1c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129569.860116:0:7148:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e91e000/0x40a459093b069a1c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129569.860160:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009016a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:068dab75-d300-4ead-a742-d14572ad1e50+14:1962:x1830948734076032:12345-192.168.202.4@tcp:1:lfs.0 Request processed in 100177us (101137us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129569.860167:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16048 00000100:00100000:2.0:1746129569.862943:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129569.863632:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129569.863649:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129569.863723:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129569.863806:0:22481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734080000 00000100:00100000:0.0:1746129569.863820:0:22481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734080000 00000100:00100000:2.0:1746129569.863909:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129569.863925:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129569.863978:0:20577:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734080128 00000100:00100000:3.0:1746129569.863985:0:20577:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734080128 00000100:00100000:3.0:1746129569.864017:0:20577:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734080256 00000100:00100000:3.0:1746129569.864019:0:20577:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734080256 00000100:00100000:3.0:1746129569.864028:0:20577:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734080384 00000100:00100000:3.0:1746129569.864029:0:20577:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734080384 00000100:00100000:3.0:1746129569.864039:0:20577:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734080512 00000100:00100000:3.0:1746129569.864041:0:20577:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734080512 00000100:00100000:3.0:1746129569.864049:0:20577:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734080640 00000100:00100000:3.0:1746129569.864050:0:20577:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734080640 00000100:00100000:3.0:1746129569.864062:0:20577:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16056 00000100:00100000:3.0:1746129569.864068:0:20577:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013575fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+32:1963:x1830948734080000:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129569.864085:0:20577:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129569.864098:0:20577:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e94d400/0x40a459093b069a69 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20dc3 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129569.864120:0:20577:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129569.864122:0:20577:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129569.864129:0:20577:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e94d400/0x40a459093b069a69 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20dc3 expref: 33 pid: 20577 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129569.864140:0:20577:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012e94d400/0x40a459093b069a69 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20dc3 expref: 33 pid: 20577 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129569.864148:0:20577:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e94d400, rc 0) 00000100:00100000:3.0:1746129569.864183:0:20577:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013575fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+33:1963:x1830948734080000:12345-192.168.202.4@tcp:101:cat.0 Request processed in 114us (1245us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129569.864188:0:20577:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16056 00000100:00100000:3.0:1746129569.864202:0:20577:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16057 00000100:00100000:3.0:1746129569.864206:0:20577:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013575ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+11:1963:x1830948734080128:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129569.864212:0:20577:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129569.864219:0:20577:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e94ce00/0x40a459093b069a70 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20dca expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129569.864230:0:20577:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129569.864231:0:20577:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129569.864234:0:20577:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e94ce00/0x40a459093b069a70 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20dca expref: 12 pid: 20577 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129569.864242:0:20577:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012e94ce00/0x40a459093b069a70 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20dca expref: 12 pid: 20577 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129569.864253:0:20577:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e94ce00, rc 0) 00000100:00100000:0.0:1746129569.864256:0:22481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16058 00000100:00100000:0.0:1746129569.864266:0:22481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013575f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+12:1963:x1830948734080256:12345-192.168.202.4@tcp:101:cat.0 00000100:00100000:3.0:1746129569.864267:0:20577:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013575ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+12:1963:x1830948734080128:12345-192.168.202.4@tcp:101:cat.0 Request processed in 61us (636us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129569.864272:0:20577:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16057 00010000:00010000:0.0:1746129569.864280:0:22481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746129569.864308:0:20577:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16059 00000100:00100000:3.0:1746129569.864313:0:20577:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013575d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+32:1963:x1830948734080384:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129569.864316:0:22481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800946f0000/0x40a459093b069a77 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20dd1 expref: -99 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129569.864318:0:20577:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129569.864333:0:20577:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e94d000/0x40a459093b069a7e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20dd8 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746129569.864349:0:20577:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3ee:0x0] initial LVB size: 2097152, mtime: 0x6813d2a2, atime: 0x6813d2a2, ctime: 0x6813d2a2, blocks: 0x81d 00002000:00010000:0.0:1746129569.864353:0:22481:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3f4:0x0] initial LVB size: 2097152, mtime: 0x6813d2a2, atime: 0x6813d2a2, ctime: 0x6813d2a2, blocks: 0x821 00010000:00010000:3.0:1746129569.864358:0:20577:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129569.864359:0:20577:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129569.864362:0:20577:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e94d000/0x40a459093b069a7e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20dd8 expref: 33 pid: 20577 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129569.864367:0:22481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129569.864369:0:22481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129569.864370:0:20577:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012e94d000/0x40a459093b069a7e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20dd8 expref: 33 pid: 20577 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129569.864375:0:20577:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e94d000, rc 0) 00010000:00010000:0.0:1746129569.864376:0:22481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800946f0000/0x40a459093b069a77 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20dd1 expref: 12 pid: 22481 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746129569.864387:0:20577:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013575d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+33:1963:x1830948734080384:12345-192.168.202.4@tcp:101:cat.0 Request processed in 74us (664us total) trans 0 rc 0/0 00010000:00010000:0.0:1746129569.864388:0:22481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800946f0000/0x40a459093b069a77 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20dd1 expref: 12 pid: 22481 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746129569.864391:0:20577:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16059 00010000:00010000:0.0:1746129569.864398:0:22481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800946f0000, rc 0) 00000100:00100000:3.0:1746129569.864401:0:20577:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16060 00000100:00100000:3.0:1746129569.864404:0:20577:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013575f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+32:1963:x1830948734080512:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129569.864409:0:20577:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129569.864413:0:20577:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cdfce00/0x40a459093b069a85 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20ddf expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129569.864421:0:20577:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129569.864422:0:20577:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129569.864424:0:20577:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cdfce00/0x40a459093b069a85 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20ddf expref: 33 pid: 20577 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129569.864431:0:20577:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009cdfce00/0x40a459093b069a85 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20ddf expref: 33 pid: 20577 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746129569.864436:0:22481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013575f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+12:1963:x1830948734080256:12345-192.168.202.4@tcp:101:cat.0 Request processed in 172us (785us total) trans 0 rc 0/0 00010000:00010000:3.0:1746129569.864437:0:20577:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cdfce00, rc 0) 00000100:00100000:0.0:1746129569.864442:0:22481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16058 00000100:00100000:3.0:1746129569.864448:0:20577:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013575f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+33:1963:x1830948734080512:12345-192.168.202.4@tcp:101:cat.0 Request processed in 43us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129569.864453:0:20577:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16060 00000100:00100000:3.0:1746129569.864460:0:20577:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16061 00000100:00100000:3.0:1746129569.864464:0:20577:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013575df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+12:1963:x1830948734080640:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129569.864468:0:20577:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129569.864472:0:20577:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cdfc200/0x40a459093b069a8c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20de6 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129569.864479:0:20577:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129569.864480:0:20577:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129569.864482:0:20577:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cdfc200/0x40a459093b069a8c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20de6 expref: 12 pid: 20577 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129569.864489:0:20577:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009cdfc200/0x40a459093b069a8c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20de6 expref: 12 pid: 20577 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129569.864494:0:20577:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cdfc200, rc 0) 00000100:00100000:3.0:1746129569.864503:0:20577:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013575df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+12:1963:x1830948734080640:12345-192.168.202.4@tcp:101:cat.0 Request processed in 39us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129569.864507:0:20577:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16061 00000100:00100000:2.0:1746129569.864596:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129569.864680:0:31519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734080768 00000100:00100000:2.0:1746129569.864684:0:31519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734080768 00002000:00100000:2.0:1746129569.864704:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff88013575ca80 x1830948734080768/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:310/0 lens 488/0 e 0 to 0 dl 1746129580 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129569.864751:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013575ca80 with x1830948734080768 ext(1048576->2097151) 00002000:00010000:2.0:1746129569.864754:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013575ca80 00000100:00100000:2.0:1746129569.864771:0:31520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7724 00000100:00100000:2.0:1746129569.864776:0:31520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013575ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ada2ffba-8920-4ecb-8068-68caa9806978+23:1961:x1830948734080768:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:2.0:1746129569.874462:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129569.874578:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734081024 00000100:00100000:1.0:1746129569.874587:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734081024 00000100:00100000:1.0:1746129569.874641:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11198 00000100:00100000:1.0:1746129569.874648:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013575d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:068dab75-d300-4ead-a742-d14572ad1e50+16:32245:x1830948734081024:12345-192.168.202.4@tcp:36:lfs.0 00010000:00010000:1.0:1746129569.874690:0:14549:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1746129569.874718:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f598c00/0x40a459093b069919 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20cea expref: 16 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129569.874739:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009efe8c00/0x40a459093b0698ef lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20cd5 expref: 15 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129569.874753:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:1.0:1746129569.874757:0:14549:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129569.874816:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013575d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:068dab75-d300-4ead-a742-d14572ad1e50+14:32245:x1830948734081024:12345-192.168.202.4@tcp:36:lfs.0 Request processed in 168us (366us total) trans 0 rc -116/-116 00000100:00100000:1.0:1746129569.874822:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11198 00000100:00100000:2.0:1746129569.883079:0:21463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136014000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ada2ffba-8920-4ecb-8068-68caa9806978+41:1961:x1830948734079744:12345-192.168.202.4@tcp:3:cat.0 Request processed in 25290us (30507us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129569.883092:0:21463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7723 00002000:00100000:2.0:1746129569.883105:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3ec:0x0] (0->1048575) req@ffff880136014000 x1830948734079744/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:310/0 lens 488/440 e 0 to 0 dl 1746129580 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129569.883114:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136014000 with x1830948734079744 ext(0->1048575) 00002000:00010000:2.0:1746129569.883121:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136014000 00000100:00100000:3.0:1746129569.891613:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129569.891640:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129569.891651:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129569.891663:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129569.891751:0:8416:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734081536 00000100:00100000:0.0:1746129569.891761:0:8416:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734081536 00002000:00100000:0.0:1746129569.891806:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3f4:0x0] (1048576->2097151) req@ffff8800a07ac700 x1830948734081536/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:310/0 lens 488/0 e 0 to 0 dl 1746129580 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129569.891817:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a07ac700 with x1830948734081536 ext(1048576->2097151) 00002000:00010000:0.0:1746129569.891822:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a07ac700 00000100:00100000:0.0:1746129569.891836:0:8416:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734081408 00000100:00100000:0.0:1746129569.891838:0:8416:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734081408 00002000:00100000:0.0:1746129569.891846:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff8800a07ae680 x1830948734081408/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:310/0 lens 488/0 e 0 to 0 dl 1746129580 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129569.891853:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a07ae680 with x1830948734081408 ext(1048576->2097151) 00002000:00010000:0.0:1746129569.891856:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a07ae680 00000100:00100000:0.0:1746129569.891864:0:8416:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734081920 00000100:00100000:0.0:1746129569.891866:0:8416:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734081920 00002000:00100000:0.0:1746129569.891877:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3ee:0x0] (1048576->2097151) req@ffff8800a07ac380 x1830948734081920/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:310/0 lens 488/0 e 0 to 0 dl 1746129580 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129569.891884:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a07ac380 with x1830948734081920 ext(1048576->2097151) 00002000:00010000:0.0:1746129569.891887:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a07ac380 00000100:00100000:0.0:1746129569.891894:0:8416:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734081792 00000100:00100000:0.0:1746129569.891896:0:8416:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734081792 00002000:00100000:0.0:1746129569.891903:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3ec:0x0] (0->1048575) req@ffff8800a07aed80 x1830948734081792/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:310/0 lens 488/0 e 0 to 0 dl 1746129580 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129569.891910:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a07aed80 with x1830948734081792 ext(0->1048575) 00000100:00100000:2.0:1746129569.891913:0:21463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7725 00002000:00010000:0.0:1746129569.891913:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a07aed80 00000100:00100000:2.0:1746129569.891923:0:21463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a07ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+13:1963:x1830948734081536:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:3.0:1746129569.892112:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129569.892395:0:16680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734082304 00000100:00100000:1.0:1746129569.892399:0:16680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734082304 00000100:00100000:1.0:1746129569.892426:0:16680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4746 00000100:00100000:1.0:1746129569.892431:0:16680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a07afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:068dab75-d300-4ead-a742-d14572ad1e50+14:32245:x1830948734082304:12345-192.168.202.4@tcp:35:lfs.0 00000100:00100000:0.0:1746129569.892531:0:8416:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7726 00000100:00100000:0.0:1746129569.892537:0:8416:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a07ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+13:1962:x1830948734081408:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129569.892578:0:31518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7727 00000100:00100000:0.0:1746129569.892583:0:31518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a07ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+34:1962:x1830948734081920:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:3.0:1746129569.893056:0:21725:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7728 00000100:00100000:3.0:1746129569.893070:0:21725:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a07aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+34:1962:x1830948734081792:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:1.0:1746129569.893875:0:16680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a07afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:068dab75-d300-4ead-a742-d14572ad1e50+15:32245:x1830948734082304:12345-192.168.202.4@tcp:35:lfs.0 Request processed in 1439us (1760us total) trans 8589945289 rc 0/0 00000100:00100000:1.0:1746129569.893884:0:16680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4746 00000100:00100000:3.0:1746129569.896727:0:31520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013575ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ada2ffba-8920-4ecb-8068-68caa9806978+23:1961:x1830948734080768:12345-192.168.202.4@tcp:3:cat.0 Request processed in 31942us (32122us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129569.896738:0:31520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7724 00002000:00100000:3.0:1746129569.896749:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff88013575ca80 x1830948734080768/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:310/0 lens 488/440 e 0 to 0 dl 1746129580 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129569.896758:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013575ca80 with x1830948734080768 ext(1048576->2097151) 00002000:00010000:3.0:1746129569.896763:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013575ca80 00000100:00100000:1.0:1746129569.906129:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129569.906173:0:8410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734082432 00000100:00100000:3.0:1746129569.906185:0:8410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734082432 00000100:00100000:3.0:1746129569.906230:0:8410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16062 00000100:00100000:1.0:1746129569.906230:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129569.906238:0:8410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092fd0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ada2ffba-8920-4ecb-8068-68caa9806978+23:32250:x1830948734082432:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:3.0:1746129569.906255:0:8410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746129569.906257:0:16680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734082688 00000100:00100000:1.0:1746129569.906263:0:16680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734082688 00010000:00010000:3.0:1746129569.906270:0:8410:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800957f8c00/0x40a459093b069a93 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20ded expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129569.906310:0:16680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4747 00000100:00100000:1.0:1746129569.906317:0:16680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092fd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:068dab75-d300-4ead-a742-d14572ad1e50+15:32245:x1830948734082688:12345-192.168.202.4@tcp:35:lfs.0 00010000:00010000:3.0:1746129569.906320:0:8410:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e91e800/0x40a459093b069a5b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20dbc expref: 24 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129569.906338:0:8410:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009cdfc200/0x40a459093b069a8c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20de6 expref: 15 pid: 20577 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129569.906344:0:8410:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129569.906345:0:8410:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129569.906349:0:8410:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800957f8c00/0x40a459093b069a93 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [2412544->2891775] (req 2412544->2891775) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20ded expref: 24 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129569.906376:0:8410:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009cdfc200/0x40a459093b069a8c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20de6 expref: 15 pid: 20577 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129569.906387:0:8410:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009cdfc200/0x40a459093b069a8c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20de6 expref: 15 pid: 20577 timeout: 925 lvb_type: 1 00000100:00100000:3.0:1746129569.906399:0:8410:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a07af100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8410:1830948737496576:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129569.906484:0:8410:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012e91e800/0x40a459093b069a5b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20dbc expref: 24 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129569.906492:0:8410:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012e91e800/0x40a459093b069a5b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20dbc expref: 24 pid: 7149 timeout: 925 lvb_type: 1 00000100:00100000:3.0:1746129569.906501:0:8410:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a07aea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8410:1830948737496704:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129569.906529:0:8410:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a6ce8c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746129569.906530:0:16680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092fd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:068dab75-d300-4ead-a742-d14572ad1e50+16:32245:x1830948734082688:12345-192.168.202.4@tcp:35:lfs.0 Request processed in 212us (298us total) trans 8589945290 rc 0/0 00000100:00100000:1.0:1746129569.906538:0:16680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4747 00000100:00100000:3.0:1746129569.911508:0:21463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a07ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+14:1963:x1830948734081536:12345-192.168.202.4@tcp:3:cat.0 Request processed in 19579us (19893us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129569.911518:0:21463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7725 00002000:00100000:3.0:1746129569.911529:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3f4:0x0] (1048576->2097151) req@ffff8800a07ac700 x1830948734081536/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:310/0 lens 488/440 e 0 to 0 dl 1746129580 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129569.911537:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a07ac700 with x1830948734081536 ext(1048576->2097151) 00002000:00010000:3.0:1746129569.911542:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a07ac700 00000100:00100000:1.0:1746129569.916556:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129569.916604:0:8410:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a07af100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8410:1830948737496576:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129569.916685:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734082816 00000100:00100000:1.0:1746129569.916691:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734082816 00000100:00100000:3.0:1746129569.916701:0:8410:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a07aea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8410:1830948737496704:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129569.916728:0:9823:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009cdfc200/0x40a459093b069a8c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20de6 expref: 14 pid: 20577 timeout: 925 lvb_type: 1 00010000:00010000:3.0:1746129569.916731:0:8410:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800957f8c00/0x40a459093b069a93 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [2412544->2891775] (req 2412544->2891775) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20ded expref: 24 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129569.916747:0:8410:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800957f8c00, rc 0) 00000100:00100000:1.0:1746129569.916754:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8227 00000100:00100000:1.0:1746129569.916761:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092fd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+14:1960:x1830948734082816:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129569.916774:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129569.916797:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009cdfc200/0x40a459093b069a8c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20de6 expref: 14 pid: 20577 timeout: 925 lvb_type: 1 00000100:00100000:3.0:1746129569.916799:0:8410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092fd0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ada2ffba-8920-4ecb-8068-68caa9806978+24:32250:x1830948734082432:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 10562us (10683us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129569.916807:0:8410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16062 00010000:00010000:1.0:1746129569.916808:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009cdfc200/0x40a459093b069a8c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20de6 expref: 14 pid: 20577 timeout: 925 lvb_type: 1 00010000:00010000:1.0:1746129569.916829:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cdfc200/0x40a459093b069a8c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20de6 expref: 14 pid: 20577 timeout: 925 lvb_type: 1 00010000:00010000:1.0:1746129569.916842:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129569.918451:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092fd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+13:1960:x1830948734082816:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 1682us (1899us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129569.918464:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8227 00000100:00100000:2.0:1746129569.920223:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129569.920249:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129569.920365:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734083072 00000100:00100000:1.0:1746129569.920374:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734083072 00000100:00100000:0.0:1746129569.920613:0:8410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734082944 00000100:00100000:0.0:1746129569.920618:0:8410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734082944 00000100:00100000:0.0:1746129569.920658:0:8410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16063 00000100:00100000:0.0:1746129569.920666:0:8410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013575e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ada2ffba-8920-4ecb-8068-68caa9806978+25:32253:x1830948734082944:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129569.920682:0:8410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129569.920697:0:8410:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012eca4c00/0x40a459093b069a9a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20df4 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129569.920721:0:8410:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129569.920723:0:8410:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129569.920730:0:8410:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012eca4c00/0x40a459093b069a9a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20df4 expref: 26 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129569.920745:0:8410:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012eca4c00/0x40a459093b069a9a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20df4 expref: 26 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129569.920756:0:8410:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012eca4c00, rc 0) 00010000:00010000:1.0:1746129569.920842:0:9823:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012e91e800/0x40a459093b069a5b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20dbc expref: 24 pid: 7149 timeout: 925 lvb_type: 1 00000100:00100000:1.0:1746129569.920876:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8228 00000100:00100000:1.0:1746129569.920883:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009016a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ada2ffba-8920-4ecb-8068-68caa9806978+26:1962:x1830948734083072:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129569.920893:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129569.920914:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012e91e800/0x40a459093b069a5b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20dbc expref: 26 pid: 7149 timeout: 925 lvb_type: 1 00010000:00010000:1.0:1746129569.920924:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012e91e800/0x40a459093b069a5b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20dbc expref: 26 pid: 7149 timeout: 925 lvb_type: 1 00010000:00010000:1.0:1746129569.920940:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e91e800/0x40a459093b069a5b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20dbc expref: 26 pid: 7149 timeout: 925 lvb_type: 1 00010000:00010000:1.0:1746129569.920952:0:9823:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129569.920954:0:9823:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129569.920958:0:9823:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800957f8c00/0x40a459093b069a93 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2412544->2891775) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20ded expref: 25 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129569.920965:0:9823:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800957f8c00/0x40a459093b069a93 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2412544->2891775) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20ded expref: 25 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129569.920992:0:9823:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800957f8c00/0x40a459093b069a93 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2412544->2891775) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20ded expref: 25 pid: 8410 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129569.921003:0:9823:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092fd0380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9823:1830948737496832:192.168.202.4@tcp:105: 00000100:00100000:3.0:1746129569.921475:0:31518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a07ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+35:1962:x1830948734081920:12345-192.168.202.4@tcp:3:cat.0 Request processed in 28873us (29805us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129569.921477:0:8410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013575e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ada2ffba-8920-4ecb-8068-68caa9806978+25:32253:x1830948734082944:12345-192.168.202.4@tcp:101:cat.0 Request processed in 811us (1260us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129569.921484:0:8410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16063 00000100:00100000:1.0:1746129569.921497:0:9823:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934d2b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746129569.921499:0:31518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7727 00002000:00100000:3.0:1746129569.921527:0:31518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3ee:0x0] (1048576->2097151) req@ffff8800a07ac380 x1830948734081920/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:310/0 lens 488/440 e 0 to 0 dl 1746129580 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129569.921552:0:31518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a07ac380 with x1830948734081920 ext(1048576->2097151) 00002000:00010000:3.0:1746129569.921567:0:31518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a07ac380 00000100:00100000:3.0:1746129569.922063:0:21725:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a07aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+33:1962:x1830948734081792:12345-192.168.202.4@tcp:3:cat.0 Request processed in 28998us (30397us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129569.922069:0:21725:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7728 00002000:00100000:3.0:1746129569.922075:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ec:0x0] (0->1048575) req@ffff8800a07aed80 x1830948734081792/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:310/0 lens 488/440 e 0 to 0 dl 1746129580 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129569.922082:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a07aed80 with x1830948734081792 ext(0->1048575) 00002000:00010000:3.0:1746129569.922086:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a07aed80 00000100:00100000:3.0:1746129569.924201:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129569.925876:0:2271:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734083328 00000100:00100000:2.0:1746129569.925888:0:2271:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734083328 00000100:00100000:2.0:1746129569.925939:0:2271:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11199 00000100:00100000:2.0:1746129569.925947:0:2271:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a07aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+24:32258:x1830948734083328:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:2.0:1746129569.925972:0:2271:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129569.925992:0:2271:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095044600/0x40a459093b069aa1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20dfb expref: -99 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129569.926088:0:2271:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880095045a00/0x40a459093b069aa8 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129569.926104:0:2271:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095045a00/0x40a459093b069aa8 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129569.926114:0:2271:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095045a00/0x40a459093b069aa8 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00000004:00200000:2.0:1746129569.926126:0:2271:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:2.0:1746129569.926238:0:2271:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095044600/0x40a459093b069aa1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20dfb expref: 27 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129569.926252:0:2271:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095045a00/0x40a459093b069aa8 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20dfb expref: 26 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129569.926259:0:2271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:2.0:1746129569.926262:0:2271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746129569.926265:0:2271:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095045a00, rc 0) 00000100:00100000:2.0:1746129569.926345:0:2271:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a07aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+26:32258:x1830948734083328:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 399us (2150us total) trans 8589945291 rc 0/0 00000100:00100000:2.0:1746129569.926351:0:2271:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11199 00000100:00100000:0.0:1746129569.926999:0:9823:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092fd0380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9823:1830948737496832:192.168.202.4@tcp:105: 00010000:00010000:0.0:1746129569.927019:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129569.927566:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009016a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ada2ffba-8920-4ecb-8068-68caa9806978+24:1962:x1830948734083072:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 6682us (7314us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129569.927576:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8228 00000100:00100000:1.0:1746129569.927769:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129569.927828:0:21725:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734083584 00000100:00100000:3.0:1746129569.927834:0:21725:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734083584 00002000:00100000:3.0:1746129569.927872:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f5:0x0] (2412544->2416639) req@ffff880092fd0380 x1830948734083584/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:310/0 lens 488/0 e 0 to 0 dl 1746129580 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129569.927881:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092fd0380 with x1830948734083584 ext(2412544->2416639) 00002000:00010000:3.0:1746129569.927885:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092fd0380 00000100:00100000:3.0:1746129569.927907:0:21725:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7729 00000100:00100000:3.0:1746129569.927913:0:21725:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092fd0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ada2ffba-8920-4ecb-8068-68caa9806978+24:1962:x1830948734083584:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:3.0:1746129569.928081:0:21725:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092fd0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ada2ffba-8920-4ecb-8068-68caa9806978+24:1962:x1830948734083584:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 167us (319us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129569.928086:0:21725:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7729 00002000:00100000:3.0:1746129569.928091:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f5:0x0] (2412544->2416639) req@ffff880092fd0380 x1830948734083584/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:310/0 lens 488/4536 e 0 to 0 dl 1746129580 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129569.928097:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092fd0380 with x1830948734083584 ext(2412544->2416639) 00002000:00010000:3.0:1746129569.928100:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092fd0380 00000100:00100000:0.0:1746129569.931834:0:8416:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a07ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+11:1962:x1830948734081408:12345-192.168.202.4@tcp:3:cat.0 Request processed in 39284us (40180us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129569.931846:0:8416:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7726 00002000:00100000:0.0:1746129569.931860:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff8800a07ae680 x1830948734081408/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:310/0 lens 488/440 e 0 to 0 dl 1746129580 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129569.931870:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a07ae680 with x1830948734081408 ext(1048576->2097151) 00002000:00010000:0.0:1746129569.931877:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a07ae680 00000100:00100000:0.0:1746129569.931949:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129569.932142:0:8416:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734083840 00000100:00100000:0.0:1746129569.932151:0:8416:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734083840 00002000:00100000:0.0:1746129569.932527:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3f4:0x0] (1048576->2097151) req@ffff880136015500 x1830948734083840/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:310/0 lens 488/0 e 0 to 0 dl 1746129580 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129569.932534:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136015500 with x1830948734083840 ext(1048576->2097151) 00002000:00010000:0.0:1746129569.932537:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136015500 00000100:00100000:0.0:1746129569.932550:0:8416:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7730 00000100:00100000:0.0:1746129569.932555:0:8416:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136015500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ada2ffba-8920-4ecb-8068-68caa9806978+24:1963:x1830948734083840:12345-192.168.202.4@tcp:3:multiop.0 00000001:00080000:0.0:1746129569.937400:0:564:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841328 is committed 00000001:00080000:0.0:1746129569.937430:0:564:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841323 is committed 00000001:00080000:0.0:1746129569.937452:0:564:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841304 is committed 00000001:00080000:0.0:1746129569.937530:0:564:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841293 is committed 00000001:00080000:0.0:1746129569.937660:0:564:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841330 is committed 00000001:00080000:0.0:1746129569.937680:0:564:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841305 is committed 00000100:00100000:0.0:1746129569.944837:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129569.944882:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129569.944949:0:8410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734084224 00000100:00100000:1.0:1746129569.944961:0:8410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734084224 00000100:00100000:1.0:1746129569.945024:0:8410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16064 00000100:00100000:1.0:1746129569.945031:0:8410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136016d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+11:32258:x1830948734084224:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:1.0:1746129569.945047:0:8410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129569.945061:0:8410:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a6ef4200/0x40a459093b069ab6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20e02 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129569.945087:0:8410:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800946f0000/0x40a459093b069a77 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20dd1 expref: 12 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129569.945095:0:8410:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012eca4c00/0x40a459093b069a9a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20df4 expref: 25 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129569.945105:0:8410:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129569.945106:0:8410:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129569.945112:0:8410:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6ef4200/0x40a459093b069ab6 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [1855488->2097151] (req 1855488->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20e02 expref: 12 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129569.945140:0:8410:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012eca4c00/0x40a459093b069a9a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20df4 expref: 25 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129569.945150:0:8410:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012eca4c00/0x40a459093b069a9a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20df4 expref: 25 pid: 8410 timeout: 925 lvb_type: 0 00000100:00100000:1.0:1746129569.945159:0:8410:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a77b2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8410:1830948737496960:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129569.945239:0:8410:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800946f0000/0x40a459093b069a77 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20dd1 expref: 12 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129569.945246:0:8410:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800946f0000/0x40a459093b069a77 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20dd1 expref: 12 pid: 22481 timeout: 925 lvb_type: 1 00000100:00100000:1.0:1746129569.945253:0:8410:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a77b0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8410:1830948737497088:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129569.945265:0:8410:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934d2480 going to sleep for 11 seconds 00000100:00100000:2.0:1746129569.945496:0:31518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734084096 00000100:00100000:2.0:1746129569.945500:0:31518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734084096 00002000:00100000:2.0:1746129569.945524:0:31518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3f5:0x0] (2887680->2891775) req@ffff880136014a80 x1830948734084096/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:310/0 lens 488/0 e 0 to 0 dl 1746129580 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129569.945533:0:31518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136014a80 with x1830948734084096 ext(2887680->2891775) 00002000:00010000:2.0:1746129569.945537:0:31518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136014a80 00000100:00100000:2.0:1746129569.945551:0:31518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7731 00000100:00100000:2.0:1746129569.945555:0:31518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136014a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ada2ffba-8920-4ecb-8068-68caa9806978+26:1961:x1830948734084096:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:2.0:1746129569.947261:0:31518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136014a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ada2ffba-8920-4ecb-8068-68caa9806978+26:1961:x1830948734084096:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 1697us (2427us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129569.947270:0:31518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7731 00002000:00100000:2.0:1746129569.947276:0:31518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3f5:0x0] (2887680->2891775) req@ffff880136014a80 x1830948734084096/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:310/0 lens 488/4536 e 0 to 0 dl 1746129580 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129569.947284:0:31518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136014a80 with x1830948734084096 ext(2887680->2891775) 00002000:00010000:2.0:1746129569.947289:0:31518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136014a80 00000100:00100000:0.0:1746129569.948781:0:8416:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136015500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ada2ffba-8920-4ecb-8068-68caa9806978+24:1963:x1830948734083840:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 16216us (16822us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129569.948796:0:8416:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7730 00002000:00100000:0.0:1746129569.948806:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3f4:0x0] (1048576->2097151) req@ffff880136015500 x1830948734083840/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:310/0 lens 488/440 e 0 to 0 dl 1746129580 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129569.948815:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136015500 with x1830948734083840 ext(1048576->2097151) 00010000:00010000:0.0:1746129569.948826:0:8416:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012eca4c00/0x40a459093b069a9a lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20df4 expref: 24 pid: 8410 timeout: 925 lvb_type: 0 00010000:00010000:0.0:1746129569.948838:0:8416:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012eca4c00/0x40a459093b069a9a lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20df4 expref: 24 pid: 8410 timeout: 925 lvb_type: 0 00002000:00010000:0.0:1746129569.948845:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880136015500 00000100:00100000:1.0:1746129569.948936:0:8410:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a77b2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8410:1830948737496960:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129569.949705:0:8410:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a77b0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8410:1830948737497088:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129569.949740:0:8410:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a6ef4200/0x40a459093b069ab6 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [1855488->2097151] (req 1855488->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20e02 expref: 12 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129569.949758:0:8410:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6ef4200, rc 0) 00000100:00100000:1.0:1746129569.949987:0:8410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136016d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+12:32258:x1830948734084224:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 4955us (5103us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129569.949995:0:8410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16064 00000100:00100000:0.0:1746129569.952193:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129569.952238:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129569.952261:0:8416:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734084480 00000100:00100000:2.0:1746129569.952271:0:8416:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734084480 00002000:00100000:2.0:1746129569.952346:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3ef:0x0] (2097152->3145727) req@ffff880136016a00 x1830948734084480/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:310/0 lens 488/0 e 0 to 0 dl 1746129580 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129569.952356:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136016a00 with x1830948734084480 ext(2097152->3145727) 00002000:00010000:2.0:1746129569.952361:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136016a00 00000100:00100000:2.0:1746129569.952390:0:8416:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7732 00000100:00100000:2.0:1746129569.952396:0:8416:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136016a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+11:1961:x1830948734084480:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:1.0:1746129569.952398:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734084608 00000100:00100000:1.0:1746129569.952405:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734084608 00010000:00010000:1.0:1746129569.952434:0:9823:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800946f0000/0x40a459093b069a77 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20dd1 expref: 12 pid: 22481 timeout: 925 lvb_type: 1 00000100:00100000:1.0:1746129569.952470:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8229 00000100:00100000:1.0:1746129569.952477:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136017100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+12:1963:x1830948734084608:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129569.952490:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129569.952510:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800946f0000/0x40a459093b069a77 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20dd1 expref: 12 pid: 22481 timeout: 925 lvb_type: 1 00010000:00010000:1.0:1746129569.952523:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800946f0000/0x40a459093b069a77 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20dd1 expref: 12 pid: 22481 timeout: 925 lvb_type: 1 00010000:00010000:1.0:1746129569.952548:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800946f0000/0x40a459093b069a77 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20dd1 expref: 12 pid: 22481 timeout: 925 lvb_type: 1 00010000:00010000:1.0:1746129569.952561:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129569.952599:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136017100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+11:1963:x1830948734084608:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 121us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129569.952605:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8229 00000100:00100000:0.0:1746129569.955344:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129569.955445:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129569.955967:0:8410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734084736 00000100:00100000:1.0:1746129569.955977:0:8410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734084736 00000100:00100000:1.0:1746129569.956034:0:8410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16065 00000100:00100000:1.0:1746129569.956042:0:8410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ada2ffba-8920-4ecb-8068-68caa9806978+13:32253:x1830948734084736:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129569.956059:0:8410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129569.956078:0:8410:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009be05400/0x40a459093b069abd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20e09 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129569.956103:0:8410:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129569.956106:0:8410:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129569.956113:0:8410:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009be05400/0x40a459093b069abd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20e09 expref: 14 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129569.956128:0:8410:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009be05400/0x40a459093b069abd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20e09 expref: 14 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129569.956142:0:8410:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009be05400, rc 0) 00000100:00100000:1.0:1746129569.957957:0:8410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ada2ffba-8920-4ecb-8068-68caa9806978+14:32253:x1830948734084736:12345-192.168.202.4@tcp:101:cat.0 Request processed in 1904us (2655us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129569.957968:0:8410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16065 00000100:00100000:1.0:1746129569.958010:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734084864 00000100:00100000:1.0:1746129569.958016:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734084864 00010000:00010000:1.0:1746129569.958045:0:9823:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012eca4c00/0x40a459093b069a9a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20df4 expref: 24 pid: 8410 timeout: 925 lvb_type: 0 00000100:00100000:1.0:1746129569.958086:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8230 00000100:00100000:1.0:1746129569.958092:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ada2ffba-8920-4ecb-8068-68caa9806978+24:1963:x1830948734084864:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129569.958105:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129569.958129:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012eca4c00/0x40a459093b069a9a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20df4 expref: 24 pid: 8410 timeout: 925 lvb_type: 0 00010000:00010000:1.0:1746129569.958141:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012eca4c00/0x40a459093b069a9a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20df4 expref: 24 pid: 8410 timeout: 925 lvb_type: 0 00010000:00010000:1.0:1746129569.958163:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012eca4c00/0x40a459093b069a9a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20df4 expref: 24 pid: 8410 timeout: 925 lvb_type: 0 00010000:00010000:1.0:1746129569.958177:0:9823:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129569.958179:0:9823:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129569.958185:0:9823:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a6ef4200/0x40a459093b069ab6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1855488->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20e02 expref: 10 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129569.958196:0:9823:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6ef4200/0x40a459093b069ab6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1855488->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20e02 expref: 10 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129569.958230:0:9823:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a6ef4200/0x40a459093b069ab6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1855488->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20e02 expref: 10 pid: 8410 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129569.958242:0:9823:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a77b0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9823:1830948737497216:192.168.202.4@tcp:105: 00000100:00100000:1.0:1746129569.958343:0:9823:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934d2480 going to sleep for 11 seconds 00000100:00100000:1.0:1746129569.965469:0:9823:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a77b0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9823:1830948737497216:192.168.202.4@tcp:105: 00010000:00010000:1.0:1746129569.965488:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129569.965527:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ada2ffba-8920-4ecb-8068-68caa9806978+23:1963:x1830948734084864:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 7433us (10081us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129569.965536:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8230 00000100:00100000:2.0:1746129569.966169:0:8416:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136016a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+11:1961:x1830948734084480:12345-192.168.202.4@tcp:3:cat.0 Request processed in 13772us (13983us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129569.966177:0:8416:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7732 00002000:00100000:2.0:1746129569.966185:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3ef:0x0] (2097152->3145727) req@ffff880136016a00 x1830948734084480/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:310/0 lens 488/440 e 0 to 0 dl 1746129580 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129569.966193:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136016a00 with x1830948734084480 ext(2097152->3145727) 00002000:00010000:2.0:1746129569.966197:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136016a00 00000100:00100000:0.0:1746129569.967747:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129569.967865:0:8416:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734085120 00000100:00100000:2.0:1746129569.967871:0:8416:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734085120 00002000:00100000:2.0:1746129569.967903:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3f4:0x0] (1855488->1859583) req@ffff88012baef800 x1830948734085120/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:310/0 lens 488/0 e 0 to 0 dl 1746129580 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129569.967911:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012baef800 with x1830948734085120 ext(1855488->1859583) 00002000:00010000:2.0:1746129569.967915:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012baef800 00000100:00100000:2.0:1746129569.967941:0:8416:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7733 00000100:00100000:2.0:1746129569.967947:0:8416:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+11:1961:x1830948734085120:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:2.0:1746129569.968098:0:8416:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+11:1961:x1830948734085120:12345-192.168.202.4@tcp:3:cat.0 Request processed in 150us (355us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129569.968104:0:8416:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7733 00002000:00100000:2.0:1746129569.968109:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3f4:0x0] (1855488->1859583) req@ffff88012baef800 x1830948734085120/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:310/0 lens 488/4536 e 0 to 0 dl 1746129580 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129569.968115:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012baef800 with x1830948734085120 ext(1855488->1859583) 00002000:00010000:2.0:1746129569.968117:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012baef800 00000100:00100000:0.0:1746129569.973057:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129569.973167:0:8416:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734085376 00000100:00100000:2.0:1746129569.973176:0:8416:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734085376 00002000:00100000:2.0:1746129569.973219:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3ee:0x0] (1048576->2097151) req@ffff88012e956a00 x1830948734085376/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:310/0 lens 488/0 e 0 to 0 dl 1746129580 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129569.973227:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e956a00 with x1830948734085376 ext(1048576->2097151) 00002000:00010000:2.0:1746129569.973232:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e956a00 00000100:00100000:2.0:1746129569.973260:0:8416:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7734 00000100:00100000:2.0:1746129569.973266:0:8416:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e956a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ada2ffba-8920-4ecb-8068-68caa9806978+14:1962:x1830948734085376:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:0.0:1746129569.982186:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129569.982283:0:8410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734085504 00000100:00100000:1.0:1746129569.982340:0:8410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734085504 00000100:00100000:1.0:1746129569.982397:0:8410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16066 00000100:00100000:1.0:1746129569.982405:0:8410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e956300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+11:32256:x1830948734085504:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129569.982420:0:8410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129569.982435:0:8410:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009be04400/0x40a459093b069ac4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20e10 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129569.982461:0:8410:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800957f8c00/0x40a459093b069a93 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2412544->2891775) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20ded expref: 22 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129569.982468:0:8410:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129569.982471:0:8410:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129569.982475:0:8410:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009be04400/0x40a459093b069ac4 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20e10 expref: 12 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129569.982500:0:8410:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800957f8c00/0x40a459093b069a93 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2412544->2891775) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20ded expref: 22 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129569.982512:0:8410:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800957f8c00/0x40a459093b069a93 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2412544->2891775) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20ded expref: 22 pid: 8410 timeout: 925 lvb_type: 0 00000100:00100000:1.0:1746129569.982522:0:8410:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a77b0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8410:1830948737497344:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129569.982616:0:8410:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934d2480 going to sleep for 11 seconds 00000100:00100000:0.0:1746129569.983176:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129569.984282:0:22480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734085632 00000100:00100000:3.0:1746129569.984335:0:22480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734085632 00000100:00100000:3.0:1746129569.984389:0:22480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16067 00000100:00100000:3.0:1746129569.984397:0:22480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e954000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+11:32258:x1830948734085632:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:3.0:1746129569.984416:0:22480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129569.984434:0:22480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800957f8600/0x40a459093b069acb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20e17 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129569.984464:0:22480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012e94d000/0x40a459093b069a7e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20dd8 expref: 12 pid: 20577 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129569.984472:0:22480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009be05400/0x40a459093b069abd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20e09 expref: 15 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129569.984478:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129569.984480:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129569.984483:0:22480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800957f8600/0x40a459093b069acb lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [1048576->1175551] (req 1048576->1175551) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20e17 expref: 12 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129569.984512:0:22480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009be05400/0x40a459093b069abd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20e09 expref: 15 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129569.984523:0:22480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009be05400/0x40a459093b069abd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20e09 expref: 15 pid: 8410 timeout: 925 lvb_type: 0 00000100:00100000:3.0:1746129569.984535:0:22480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a07af100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22480:1830948737497472:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129569.984617:0:22480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012e94d000/0x40a459093b069a7e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20dd8 expref: 12 pid: 20577 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129569.984629:0:22480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012e94d000/0x40a459093b069a7e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20dd8 expref: 12 pid: 20577 timeout: 925 lvb_type: 1 00000100:00100000:3.0:1746129569.984636:0:22480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a07af480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22480:1830948737497600:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129569.984654:0:22480:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a6ce8900 going to sleep for 11 seconds 00000100:00100000:1.0:1746129569.985142:0:8410:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a77b0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8410:1830948737497344:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129569.985169:0:8410:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009be04400/0x40a459093b069ac4 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20e10 expref: 12 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129569.985187:0:8410:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009be04400, rc 0) 00000100:00100000:1.0:1746129569.985242:0:8410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e956300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+12:32256:x1830948734085504:12345-192.168.202.4@tcp:101:cat.0 Request processed in 2838us (3065us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129569.985249:0:8410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16066 00000100:00100000:2.0:1746129569.986933:0:8416:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e956a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ada2ffba-8920-4ecb-8068-68caa9806978+14:1962:x1830948734085376:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 13662us (13879us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129569.986943:0:8416:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7734 00002000:00100000:2.0:1746129569.986952:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3ee:0x0] (1048576->2097151) req@ffff88012e956a00 x1830948734085376/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:310/0 lens 488/440 e 0 to 0 dl 1746129580 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129569.986960:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e956a00 with x1830948734085376 ext(1048576->2097151) 00010000:00010000:2.0:1746129569.986968:0:8416:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009be05400/0x40a459093b069abd lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20e09 expref: 14 pid: 8410 timeout: 925 lvb_type: 0 00010000:00010000:2.0:1746129569.986979:0:8416:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009be05400/0x40a459093b069abd lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20e09 expref: 14 pid: 8410 timeout: 925 lvb_type: 0 00002000:00010000:2.0:1746129569.986984:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012e956a00 00000100:00100000:3.0:1746129569.987026:0:22480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a07af100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22480:1830948737497472:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129569.987168:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129569.987210:0:8416:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734085760 00000100:00100000:2.0:1746129569.987215:0:8416:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734085760 00002000:00100000:2.0:1746129569.987241:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3f5:0x0] (2412544->2891775) req@ffff8800a07ad880 x1830948734085760/t0(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:310/0 lens 488/0 e 0 to 0 dl 1746129580 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129569.987248:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a07ad880 with x1830948734085760 ext(2412544->2891775) 00010000:00010000:2.0:1746129569.987254:0:8416:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800957f8c00/0x40a459093b069a93 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2412544->2891775) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20ded expref: 23 pid: 8410 timeout: 925 lvb_type: 0 00010000:00010000:2.0:1746129569.987262:0:8416:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800957f8c00/0x40a459093b069a93 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2412544->2891775) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20ded expref: 23 pid: 8410 timeout: 925 lvb_type: 0 00002000:00010000:2.0:1746129569.987267:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a07ad880 00000100:00100000:2.0:1746129569.987310:0:8416:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2410 00000100:00100000:2.0:1746129569.987316:0:8416:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a07ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ada2ffba-8920-4ecb-8068-68caa9806978+23:1963:x1830948734085760:12345-192.168.202.4@tcp:4:multiop.0 00000100:00100000:0.0:1746129569.987589:0:22480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a07af480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22480:1830948737497600:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129569.987621:0:22480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800957f8600/0x40a459093b069acb lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [1048576->1175551] (req 1048576->1175551) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20e17 expref: 12 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129569.987634:0:22480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800957f8600, rc 0) 00000100:00100000:0.0:1746129569.987680:0:22480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e954000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+12:32258:x1830948734085632:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 3283us (4505us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129569.987689:0:22480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16067 00000100:00100000:0.0:1746129569.989276:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129569.989387:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734085888 00000100:00100000:1.0:1746129569.989400:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734085888 00010000:00010000:1.0:1746129569.989430:0:9823:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012e94d000/0x40a459093b069a7e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20dd8 expref: 12 pid: 20577 timeout: 925 lvb_type: 1 00000100:00100000:1.0:1746129569.989467:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8231 00000100:00100000:1.0:1746129569.989473:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e954a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+12:1962:x1830948734085888:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129569.989486:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129569.989507:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012e94d000/0x40a459093b069a7e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20dd8 expref: 12 pid: 20577 timeout: 925 lvb_type: 1 00010000:00010000:1.0:1746129569.989516:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012e94d000/0x40a459093b069a7e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20dd8 expref: 12 pid: 20577 timeout: 925 lvb_type: 1 00010000:00010000:1.0:1746129569.989534:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e94d000/0x40a459093b069a7e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20dd8 expref: 12 pid: 20577 timeout: 925 lvb_type: 1 00010000:00010000:1.0:1746129569.989560:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129569.989603:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e954a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+11:1962:x1830948734085888:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 130us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129569.989608:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8231 00000100:00100000:0.0:1746129570.002680:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129570.002726:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129570.002741:0:31518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734086144 00000100:00100000:3.0:1746129570.002749:0:31518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734086144 00002000:00100000:3.0:1746129570.002786:0:31518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3ef:0x0] (2097152->3145727) req@ffff88012e957480 x1830948734086144/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:311/0 lens 488/0 e 0 to 0 dl 1746129581 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129570.002796:0:31518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e957480 with x1830948734086144 ext(2097152->3145727) 00002000:00010000:3.0:1746129570.002801:0:31518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e957480 00000100:00100000:3.0:1746129570.002832:0:31518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7735 00000100:00100000:3.0:1746129570.002839:0:31518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e957480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ada2ffba-8920-4ecb-8068-68caa9806978+14:1962:x1830948734086144:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129570.005775:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734086272 00000100:00100000:0.0:1746129570.005786:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734086272 00010000:00010000:0.0:1746129570.005817:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009be05400/0x40a459093b069abd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20e09 expref: 15 pid: 8410 timeout: 925 lvb_type: 0 00000100:00100000:0.0:1746129570.005856:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8232 00000100:00100000:0.0:1746129570.005863:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6ce2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ada2ffba-8920-4ecb-8068-68caa9806978+15:1960:x1830948734086272:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129570.005874:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129570.005891:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009be05400/0x40a459093b069abd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20e09 expref: 15 pid: 8410 timeout: 925 lvb_type: 0 00010000:00010000:0.0:1746129570.005901:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009be05400/0x40a459093b069abd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20e09 expref: 15 pid: 8410 timeout: 925 lvb_type: 0 00010000:00010000:0.0:1746129570.005919:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009be05400/0x40a459093b069abd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20e09 expref: 15 pid: 8410 timeout: 925 lvb_type: 0 00010000:00010000:0.0:1746129570.005934:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129570.005936:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129570.005942:0:7085:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800957f8600/0x40a459093b069acb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1175551) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20e17 expref: 10 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129570.005948:0:7085:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800957f8600/0x40a459093b069acb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1175551) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20e17 expref: 10 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129570.005975:0:7085:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800957f8600/0x40a459093b069acb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1175551) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20e17 expref: 10 pid: 22480 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129570.005986:0:7085:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e955180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7085:1830948737497728:192.168.202.4@tcp:105: 00000100:00100000:0.0:1746129570.006052:0:7085:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e29f600 going to sleep for 11 seconds 00000100:00100000:3.0:1746129570.016470:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129570.016478:0:7085:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e955180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7085:1830948737497728:192.168.202.4@tcp:105: 00010000:00010000:0.0:1746129570.016504:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129570.016527:0:8416:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a07ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ada2ffba-8920-4ecb-8068-68caa9806978+25:1963:x1830948734085760:12345-192.168.202.4@tcp:4:multiop.0 Request processed in 28865us (29014us total) trans 17179874088 rc 0/0 00000100:00100000:1.0:1746129570.016539:0:8416:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2410 00000100:00100000:0.0:1746129570.016552:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6ce2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ada2ffba-8920-4ecb-8068-68caa9806978+15:1960:x1830948734086272:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 10690us (13825us total) trans 0 rc 0/0 00002000:00100000:1.0:1746129570.016553:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3f5:0x0] (2412544->2891775) req@ffff8800a07ad880 x1830948734085760/t17179874088(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:310/0 lens 488/448 e 0 to 0 dl 1746129580 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129570.016562:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a07ad880 with x1830948734085760 ext(2412544->2891775) 00000100:00100000:0.0:1746129570.016562:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8232 00010000:00010000:1.0:1746129570.016576:0:8416:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800957f8c00/0x40a459093b069a93 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2412544->2891775) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20ded expref: 25 pid: 8410 timeout: 925 lvb_type: 0 00010000:00010000:1.0:1746129570.016591:0:8416:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800957f8c00/0x40a459093b069a93 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2412544->2891775) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20ded expref: 25 pid: 8410 timeout: 925 lvb_type: 0 00002000:00010000:1.0:1746129570.016604:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a07ad880 00000100:00100000:1.0:1746129570.016625:0:8416:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734086528 00000100:00100000:1.0:1746129570.016633:0:8416:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734086528 00002000:00100000:1.0:1746129570.016666:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3ee:0x0] (1171456->1175551) req@ffff8800a07ace00 x1830948734086528/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:311/0 lens 488/0 e 0 to 0 dl 1746129581 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129570.016672:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a07ace00 with x1830948734086528 ext(1171456->1175551) 00002000:00010000:1.0:1746129570.016675:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a07ace00 00000100:00100000:1.0:1746129570.017427:0:8416:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7736 00000100:00100000:1.0:1746129570.017433:0:8416:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a07ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+11:1962:x1830948734086528:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:1.0:1746129570.017539:0:8416:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a07ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+11:1962:x1830948734086528:12345-192.168.202.4@tcp:3:cat.0 Request processed in 107us (1082us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746129570.017544:0:8416:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7736 00002000:00100000:1.0:1746129570.017548:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3ee:0x0] (1171456->1175551) req@ffff8800a07ace00 x1830948734086528/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:311/0 lens 488/4536 e 0 to 0 dl 1746129581 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129570.017554:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a07ace00 with x1830948734086528 ext(1171456->1175551) 00002000:00010000:1.0:1746129570.017556:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a07ace00 00000100:00100000:0.0:1746129570.024505:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129570.024575:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734086656 00000100:00100000:1.0:1746129570.024583:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734086656 00010000:00010000:1.0:1746129570.024613:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800957f8c00/0x40a459093b069a93 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2412544->2891775) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20ded expref: 25 pid: 8410 timeout: 925 lvb_type: 0 00000100:00100000:1.0:1746129570.024648:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8233 00000100:00100000:1.0:1746129570.024655:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e954a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ada2ffba-8920-4ecb-8068-68caa9806978+25:1962:x1830948734086656:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129570.024672:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746129570.024686:0:7085:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f5:0x0] updating lvb mtime from disk: 1746129568 -> 1746129570 00002000:00010000:1.0:1746129570.024689:0:7085:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f5:0x0] updating lvb ctime from disk: 1746129568 -> 1746129570 00010000:00010000:1.0:1746129570.024694:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800957f8c00/0x40a459093b069a93 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2412544->2891775) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20ded expref: 25 pid: 8410 timeout: 925 lvb_type: 0 00010000:00010000:1.0:1746129570.024705:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800957f8c00/0x40a459093b069a93 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2412544->2891775) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20ded expref: 25 pid: 8410 timeout: 925 lvb_type: 0 00010000:00010000:1.0:1746129570.024722:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800957f8c00/0x40a459093b069a93 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2412544->2891775) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20ded expref: 25 pid: 8410 timeout: 925 lvb_type: 0 00010000:00010000:1.0:1746129570.024737:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129570.024739:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129570.024744:0:7085:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009be04400/0x40a459093b069ac4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20e10 expref: 11 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129570.024751:0:7085:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009be04400/0x40a459093b069ac4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20e10 expref: 11 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129570.024776:0:7085:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009be04400/0x40a459093b069ac4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20e10 expref: 11 pid: 8410 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129570.024786:0:7085:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a77b0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7085:1830948737497856:192.168.202.4@tcp:105: 00000100:00100000:3.0:1746129570.024824:0:31518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e957480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ada2ffba-8920-4ecb-8068-68caa9806978+13:1962:x1830948734086144:12345-192.168.202.4@tcp:3:cat.0 Request processed in 21984us (22150us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129570.024832:0:31518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7735 00002000:00100000:3.0:1746129570.024840:0:31518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3ef:0x0] (2097152->3145727) req@ffff88012e957480 x1830948734086144/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:311/0 lens 488/440 e 0 to 0 dl 1746129581 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129570.024847:0:31518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e957480 with x1830948734086144 ext(2097152->3145727) 00002000:00010000:3.0:1746129570.024851:0:31518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e957480 00000100:00100000:1.0:1746129570.025160:0:7085:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934d2000 going to sleep for 11 seconds 00000100:00100000:1.0:1746129570.028681:0:7085:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a77b0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7085:1830948737497856:192.168.202.4@tcp:105: 00010000:00010000:1.0:1746129570.028702:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129570.028748:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e954a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ada2ffba-8920-4ecb-8068-68caa9806978+24:1962:x1830948734086656:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 4093us (4248us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129570.028756:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8233 00000100:00100000:2.0:1746129570.031690:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129570.031823:0:22480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734086784 00000100:00100000:0.0:1746129570.031831:0:22480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734086784 00000100:00100000:0.0:1746129570.031877:0:22480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16068 00000100:00100000:0.0:1746129570.031884:0:22480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009016ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ada2ffba-8920-4ecb-8068-68caa9806978+24:32253:x1830948734086784:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129570.031899:0:22480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129570.031913:0:22480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012dc1b200/0x40a459093b069ad2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20e1e expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129570.031934:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129570.031936:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129570.031942:0:22480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dc1b200/0x40a459093b069ad2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20e1e expref: 25 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129570.031955:0:22480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012dc1b200/0x40a459093b069ad2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20e1e expref: 25 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129570.031965:0:22480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dc1b200, rc 0) 00000100:00100000:0.0:1746129570.032696:0:22480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009016ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ada2ffba-8920-4ecb-8068-68caa9806978+25:32253:x1830948734086784:12345-192.168.202.4@tcp:101:cat.0 Request processed in 121us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129570.032702:0:22480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16068 00000100:00100000:0.0:1746129570.048084:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129570.048116:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129570.050114:0:31518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734087040 00000100:00100000:3.0:1746129570.050124:0:31518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734087040 00000100:00100000:0.0:1746129570.050159:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00080000:1.0:1746129570.050371:0:7097:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00100000:3.0:1746129570.050380:0:31518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3f5:0x0] (2097152->3145727) req@ffff88012e955180 x1830948734087040/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:311/0 lens 488/0 e 0 to 0 dl 1746129581 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129570.050389:0:31518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e955180 with x1830948734087040 ext(2097152->3145727) 00002000:00010000:3.0:1746129570.050394:0:31518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e955180 00000100:00100000:1.0:1746129570.050631:0:21725:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734087296 00000100:00100000:1.0:1746129570.050635:0:21725:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734087296 00002000:00100000:1.0:1746129570.050653:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->4194303) req@ffff88012e956d80 x1830948734087296/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:311/0 lens 488/0 e 0 to 0 dl 1746129581 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129570.050660:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e956d80 with x1830948734087296 ext(3145728->4194303) 00002000:00010000:1.0:1746129570.050664:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e956d80 00000100:00100000:1.0:1746129570.050684:0:21725:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734087424 00000100:00100000:1.0:1746129570.050687:0:21725:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734087424 00002000:00100000:1.0:1746129570.050695:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f5:0x0] (3145728->4194303) req@ffff88012e955f80 x1830948734087424/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:311/0 lens 488/0 e 0 to 0 dl 1746129581 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129570.050702:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e955f80 with x1830948734087424 ext(3145728->4194303) 00002000:00010000:1.0:1746129570.050704:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e955f80 00000100:00100000:1.0:1746129570.050719:0:21725:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7737 00000100:00100000:1.0:1746129570.050725:0:21725:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e955180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+13:1963:x1830948734087040:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:3.0:1746129570.051177:0:31520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7738 00000100:00100000:3.0:1746129570.051183:0:31520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e956d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+11:1963:x1830948734087296:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:2.0:1746129570.052531:0:21463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7739 00000100:00100000:2.0:1746129570.052540:0:21463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e955f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+13:1962:x1830948734087424:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:3.0:1746129570.069893:0:31520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e956d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+11:1963:x1830948734087296:12345-192.168.202.4@tcp:3:cat.0 Request processed in 18700us (21766us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129570.069904:0:31520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7738 00002000:00100000:3.0:1746129570.069915:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->4194303) req@ffff88012e956d80 x1830948734087296/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:311/0 lens 488/440 e 0 to 0 dl 1746129581 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129570.069923:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e956d80 with x1830948734087296 ext(3145728->4194303) 00002000:00010000:3.0:1746129570.069929:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e956d80 00000100:00100000:0.0:1746129570.071507:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129570.071526:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129570.071547:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129570.071562:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734087808 00000100:00100000:0.0:1746129570.071568:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734087808 00002000:00100000:0.0:1746129570.071598:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f5:0x0] (2097152->3145727) req@ffff88012e954e00 x1830948734087808/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:311/0 lens 488/0 e 0 to 0 dl 1746129581 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129570.071607:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e954e00 with x1830948734087808 ext(2097152->3145727) 00002000:00010000:0.0:1746129570.071611:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e954e00 00000100:00100000:0.0:1746129570.071642:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734088064 00000100:00100000:0.0:1746129570.071644:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734088064 00002000:00100000:0.0:1746129570.071653:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f5:0x0] (3145728->4194303) req@ffff88012e955500 x1830948734088064/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:311/0 lens 488/0 e 0 to 0 dl 1746129581 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129570.071661:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e955500 with x1830948734088064 ext(3145728->4194303) 00002000:00010000:0.0:1746129570.071663:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e955500 00000100:00100000:0.0:1746129570.071670:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734088320 00000100:00100000:0.0:1746129570.071672:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734088320 00002000:00100000:0.0:1746129570.071679:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->4194303) req@ffff88012e957800 x1830948734088320/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:311/0 lens 488/0 e 0 to 0 dl 1746129581 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129570.071685:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e957800 with x1830948734088320 ext(3145728->4194303) 00002000:00010000:0.0:1746129570.071688:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e957800 00000100:00100000:0.0:1746129570.071698:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7740 00000100:00100000:0.0:1746129570.071703:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e954e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+26:1960:x1830948734087808:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:1.0:1746129570.071832:0:31521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7741 00000100:00100000:1.0:1746129570.071840:0:31521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e955500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ada2ffba-8920-4ecb-8068-68caa9806978+26:1960:x1830948734088064:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:1.0:1746129570.072914:0:8416:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7742 00000100:00100000:1.0:1746129570.072922:0:8416:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e957800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ada2ffba-8920-4ecb-8068-68caa9806978+13:1961:x1830948734088320:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:1.0:1746129570.084623:0:21725:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e955180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+14:1963:x1830948734087040:12345-192.168.202.4@tcp:3:cat.0 Request processed in 33889us (36537us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129570.084715:0:21725:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7737 00002000:00100000:1.0:1746129570.084726:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f5:0x0] (2097152->3145727) req@ffff88012e955180 x1830948734087040/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:311/0 lens 488/440 e 0 to 0 dl 1746129581 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129570.084735:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e955180 with x1830948734087040 ext(2097152->3145727) 00002000:00010000:1.0:1746129570.084740:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e955180 00000100:00100000:2.0:1746129570.094769:0:21463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e955f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+12:1962:x1830948734087424:12345-192.168.202.4@tcp:3:cat.0 Request processed in 42223us (44605us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129570.094782:0:21463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7739 00002000:00100000:2.0:1746129570.094792:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3f5:0x0] (3145728->4194303) req@ffff88012e955f80 x1830948734087424/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:311/0 lens 488/440 e 0 to 0 dl 1746129581 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129570.094802:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e955f80 with x1830948734087424 ext(3145728->4194303) 00002000:00010000:2.0:1746129570.094807:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e955f80 00000100:00100000:1.0:1746129570.103680:0:31521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e955500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ada2ffba-8920-4ecb-8068-68caa9806978+27:1960:x1830948734088064:12345-192.168.202.4@tcp:3:cat.0 Request processed in 31828us (32138us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129570.103690:0:31521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7741 00002000:00100000:1.0:1746129570.103701:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f5:0x0] (3145728->4194303) req@ffff88012e955500 x1830948734088064/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:311/0 lens 488/440 e 0 to 0 dl 1746129581 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129570.103710:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e955500 with x1830948734088064 ext(3145728->4194303) 00002000:00010000:1.0:1746129570.103715:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e955500 00000100:00100000:0.0:1746129570.106503:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a07af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737497984:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1746129570.106715:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129570.106780:0:8414:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737497984 00000100:00100000:2.0:1746129570.106786:0:8414:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737497984 00000100:00100000:2.0:1746129570.106829:0:8414:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:2.0:1746129570.106836:0:8414:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e955880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1830948737497984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1746129570.106853:0:8414:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 1703936 granted 578879488 pending 1703936 free 3852468224 avail 3824156672 00000100:00100000:2.0:1746129570.106883:0:8414:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e955880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1830948737497984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 48us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129570.106889:0:8414:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00080000:2.0:1746129570.106921:0:7097:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746129570.112186:0:3300:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474841323 gen 2 00000004:00080000:0.0:1746129570.112195:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ea93b80, transno 21474841243 00000004:00080000:0.0:1746129570.112203:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ea90380, transno 21474841244 00000004:00080000:0.0:1746129570.112205:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ea91c00, transno 21474841245 00000004:00080000:0.0:1746129570.112207:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ea90e00, transno 21474841246 00000004:00080000:0.0:1746129570.112209:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ea92a00, transno 21474841247 00000004:00080000:0.0:1746129570.112211:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ea90700, transno 21474841248 00000004:00080000:0.0:1746129570.112213:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093ceea00, transno 21474841249 00000004:00080000:0.0:1746129570.112214:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ea90a80, transno 21474841250 00000004:00080000:0.0:1746129570.112216:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ea90000, transno 21474841251 00000004:00080000:0.0:1746129570.112218:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f325f80, transno 21474841256 00000004:00080000:0.0:1746129570.112221:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013145ca80, transno 21474841257 00000004:00080000:0.0:1746129570.112223:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fa24700, transno 21474841258 00000004:00080000:0.0:1746129570.112225:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013145f480, transno 21474841259 00000004:00080000:0.0:1746129570.112226:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f326680, transno 21474841260 00000004:00080000:0.0:1746129570.112229:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013145d500, transno 21474841261 00000004:00080000:0.0:1746129570.112230:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f327100, transno 21474841262 00000004:00080000:0.0:1746129570.112232:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013145ed80, transno 21474841263 00000004:00080000:0.0:1746129570.112234:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013145fb80, transno 21474841264 00000004:00080000:0.0:1746129570.112236:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009507ca80, transno 21474841265 00000004:00080000:0.0:1746129570.112239:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013145dc00, transno 21474841266 00000004:00080000:0.0:1746129570.112241:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e956680, transno 21474841267 00000004:00080000:0.0:1746129570.112243:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009507fb80, transno 21474841268 00000004:00080000:0.0:1746129570.112245:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e957b80, transno 21474841269 00000004:00080000:0.0:1746129570.112247:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e954700, transno 21474841270 00000004:00080000:0.0:1746129570.112248:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013145c380, transno 21474841271 00000004:00080000:0.0:1746129570.112250:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e955c00, transno 21474841272 00000004:00080000:0.0:1746129570.112252:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013145e680, transno 21474841273 00000004:00080000:0.0:1746129570.112253:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093ceed80, transno 21474841294 00000004:00080000:0.0:1746129570.112255:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f959500, transno 21474841295 00000004:00080000:0.0:1746129570.112257:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012baefb80, transno 21474841296 00000004:00080000:0.0:1746129570.112259:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a07ae300, transno 21474841297 00000004:00080000:0.0:1746129570.112261:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f95b480, transno 21474841298 00000004:00080000:0.0:1746129570.112262:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f95bb80, transno 21474841299 00000004:00080000:0.0:1746129570.112264:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093ced880, transno 21474841300 00000004:00080000:0.0:1746129570.112265:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880132c25180, transno 21474841301 00000004:00080000:0.0:1746129570.112267:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012baec700, transno 21474841302 00000004:00080000:0.0:1746129570.112269:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009507e300, transno 21474841306 00000004:00080000:0.0:1746129570.112270:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094065500, transno 21474841307 00000004:00080000:0.0:1746129570.112272:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009507d180, transno 21474841308 00000004:00080000:0.0:1746129570.112274:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094065880, transno 21474841309 00000004:00080000:0.0:1746129570.112275:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009507ce00, transno 21474841310 00000004:00080000:0.0:1746129570.112277:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094065f80, transno 21474841311 00000004:00080000:0.0:1746129570.112278:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094064700, transno 21474841312 00000004:00080000:0.0:1746129570.112280:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009507d880, transno 21474841313 00000004:00080000:0.0:1746129570.112282:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094067800, transno 21474841314 00000004:00080000:0.0:1746129570.112284:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ea91500, transno 21474841315 00000004:00080000:0.0:1746129570.112286:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093edd500, transno 21474841316 00000004:00080000:0.0:1746129570.112287:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012baef100, transno 21474841317 00000004:00080000:0.0:1746129570.112289:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093edc380, transno 21474841318 00000004:00080000:0.0:1746129570.112306:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ea93800, transno 21474841319 00000004:00080000:0.0:1746129570.112308:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093edd880, transno 21474841320 00000004:00080000:0.0:1746129570.112310:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ea91f80, transno 21474841321 00000004:00080000:0.0:1746129570.112312:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093edfb80, transno 21474841322 00000004:00080000:0.0:1746129570.112314:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880090e6c380, transno 21474841323 00000100:00100000:0.0:1746129570.112336:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a07af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737497984:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1746129570.112475:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129570.112560:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129570.112919:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e954e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+25:1960:x1830948734087808:12345-192.168.202.4@tcp:3:cat.0 Request processed in 41214us (41416us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129570.112927:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7740 00002000:00100000:2.0:1746129570.112936:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f5:0x0] (2097152->3145727) req@ffff88012e954e00 x1830948734087808/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:311/0 lens 488/440 e 0 to 0 dl 1746129581 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129570.112945:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e954e00 with x1830948734087808 ext(2097152->3145727) 00002000:00010000:2.0:1746129570.112950:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e954e00 00000100:00100000:2.0:1746129570.112967:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734088704 00000100:00100000:2.0:1746129570.112973:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734088704 00002000:00100000:2.0:1746129570.112996:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ef:0x0] (4194304->5148671) req@ffff88009016b480 x1830948734088704/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:311/0 lens 488/0 e 0 to 0 dl 1746129581 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129570.113001:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009016b480 with x1830948734088704 ext(4194304->5148671) 00002000:00010000:2.0:1746129570.113003:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009016b480 00000100:00100000:2.0:1746129570.113017:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7743 00000100:00100000:2.0:1746129570.113022:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009016b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+11:1962:x1830948734088704:12345-192.168.202.4@tcp:3:cat.0 00000004:00080000:1.0:1746129570.115488:0:14586:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 54 done 00000100:00100000:0.0:1746129570.115673:0:22480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734088448 00000100:00100000:0.0:1746129570.115678:0:22480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734088448 00000100:00100000:0.0:1746129570.115710:0:22480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16069 00000100:00100000:0.0:1746129570.115716:0:22480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090168a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ada2ffba-8920-4ecb-8068-68caa9806978+15:32263:x1830948734088448:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:0.0:1746129570.115728:0:22480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129570.115741:0:22480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012dc1a400/0x40a459093b069ad9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20e25 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129570.115764:0:22480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012e91ec00/0x40a459093b069a38 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20d99 expref: 16 pid: 8411 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129570.115772:0:22480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012e94d400/0x40a459093b069a69 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20dc3 expref: 12 pid: 20577 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129570.115778:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129570.115780:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129570.115783:0:22480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dc1a400/0x40a459093b069ad9 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [987136->1048575] (req 987136->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20e25 expref: 16 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129570.115806:0:22480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012e94d400/0x40a459093b069a69 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20dc3 expref: 12 pid: 20577 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129570.115821:0:22480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012e94d400/0x40a459093b069a69 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20dc3 expref: 12 pid: 20577 timeout: 925 lvb_type: 1 00000100:00100000:0.0:1746129570.115831:0:22480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e956680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22480:1830948737498112:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129570.116674:0:22480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012e91ec00/0x40a459093b069a38 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20d99 expref: 16 pid: 8411 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129570.116683:0:22480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012e91ec00/0x40a459093b069a38 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20d99 expref: 16 pid: 8411 timeout: 925 lvb_type: 1 00000100:00100000:0.0:1746129570.116692:0:22480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e957b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22480:1830948737498240:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129570.116714:0:22480:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e29fcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746129570.118277:0:8416:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e957800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ada2ffba-8920-4ecb-8068-68caa9806978+15:1961:x1830948734088320:12345-192.168.202.4@tcp:3:cat.0 Request processed in 45349us (46722us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129570.118286:0:8416:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7742 00002000:00100000:1.0:1746129570.118326:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->4194303) req@ffff88012e957800 x1830948734088320/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:311/0 lens 488/440 e 0 to 0 dl 1746129581 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129570.118335:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e957800 with x1830948734088320 ext(3145728->4194303) 00002000:00010000:1.0:1746129570.118341:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e957800 00000100:00100000:1.0:1746129570.123004:0:22480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e956680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22480:1830948737498112:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129570.123016:0:22480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e957b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22480:1830948737498240:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129570.123042:0:22480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012dc1a400/0x40a459093b069ad9 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [987136->1048575] (req 987136->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20e25 expref: 14 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129570.123056:0:22480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dc1a400, rc 0) 00000100:00100000:1.0:1746129570.123107:0:22480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090168a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ada2ffba-8920-4ecb-8068-68caa9806978+14:32263:x1830948734088448:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 7390us (10633us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129570.123114:0:22480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16069 00000100:00100000:2.0:1746129570.123605:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009016b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+11:1962:x1830948734088704:12345-192.168.202.4@tcp:3:cat.0 Request processed in 10582us (11043us total) trans 0 rc 954368/954368 00000100:00100000:2.0:1746129570.123613:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7743 00002000:00100000:2.0:1746129570.123620:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ef:0x0] (4194304->5148671) req@ffff88009016b480 x1830948734088704/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:311/0 lens 488/440 e 0 to 0 dl 1746129581 ref 1 fl Complete:/200/0 rc 954368/954368 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129570.123627:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009016b480 with x1830948734088704 ext(4194304->5148671) 00002000:00010000:2.0:1746129570.123631:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009016b480 00000100:00100000:2.0:1746129570.126547:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129570.126574:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129570.126593:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129570.126604:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129570.126639:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129570.126660:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734089088 00000100:00100000:2.0:1746129570.126666:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734089088 00000100:00100000:2.0:1746129570.126693:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734089216 00000100:00100000:2.0:1746129570.126695:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734089216 00000100:00100000:2.0:1746129570.126704:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734089344 00000100:00100000:2.0:1746129570.126705:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734089344 00000100:00100000:2.0:1746129570.126716:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16070 00000100:00100000:2.0:1746129570.126722:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009016aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ada2ffba-8920-4ecb-8068-68caa9806978+15:1963:x1830948734089088:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129570.126735:0:7149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129570.126748:0:7149:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095b5e600/0x40a459093b069ae0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20e2c expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129570.126750:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734088832 00000100:00100000:1.0:1746129570.126755:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734088832 00010000:00010000:2.0:1746129570.126766:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129570.126774:0:7149:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095b5e600/0x40a459093b069ae0 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 6 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20e2c expref: 16 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129570.126774:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012e94d400/0x40a459093b069a69 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20dc3 expref: 11 pid: 20577 timeout: 925 lvb_type: 1 00010000:00010000:2.0:1746129570.126784:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095b5e600/0x40a459093b069ae0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20e2c expref: 16 pid: 7149 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746129570.126790:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734088960 00000100:00100000:1.0:1746129570.126791:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734088960 00010000:00010000:2.0:1746129570.126795:0:7149:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095b5e600, rc 0) 00010000:00010000:1.0:1746129570.126799:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012e91ec00/0x40a459093b069a38 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20d99 expref: 16 pid: 8411 timeout: 925 lvb_type: 1 00000100:00100000:1.0:1746129570.126810:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8234 00000100:00100000:1.0:1746129570.126815:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090169500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+11:1963:x1830948734088832:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129570.126822:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746129570.126823:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009016aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ada2ffba-8920-4ecb-8068-68caa9806978+16:1963:x1830948734089088:12345-192.168.202.4@tcp:101:cat.0 Request processed in 101us (229us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129570.126828:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16070 00010000:00010000:1.0:1746129570.126836:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012e94d400/0x40a459093b069a69 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20dc3 expref: 11 pid: 20577 timeout: 925 lvb_type: 1 00000100:00100000:2.0:1746129570.126838:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16071 00000100:00100000:2.0:1746129570.126842:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090168000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ada2ffba-8920-4ecb-8068-68caa9806978+25:1963:x1830948734089216:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129570.126845:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012e94d400/0x40a459093b069a69 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20dc3 expref: 11 pid: 20577 timeout: 925 lvb_type: 1 00010000:00010000:2.0:1746129570.126848:0:7149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129570.126855:0:7149:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095b5fa00/0x40a459093b069ae7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20e33 expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129570.126860:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e94d400/0x40a459093b069a69 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20dc3 expref: 11 pid: 20577 timeout: 925 lvb_type: 1 00010000:00010000:1.0:1746129570.126873:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129570.126883:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090169c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7149:1830948737498368:192.168.202.4@tcp:106: 00000100:00100000:1.0:1746129570.126895:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090169500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+10:1963:x1830948734088832:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 79us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129570.126900:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8234 00000100:00100000:1.0:1746129570.126911:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8235 00000100:00100000:1.0:1746129570.126916:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090169180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ada2ffba-8920-4ecb-8068-68caa9806978+15:1962:x1830948734088960:12345-192.168.202.4@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746129570.126920:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a00c00 going to sleep for 11 seconds 00010000:00010000:1.0:1746129570.126921:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129570.126927:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012e91ec00/0x40a459093b069a38 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20d99 expref: 15 pid: 8411 timeout: 925 lvb_type: 1 00010000:00010000:1.0:1746129570.126935:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012e91ec00/0x40a459093b069a38 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20d99 expref: 15 pid: 8411 timeout: 925 lvb_type: 1 00000100:00100000:2.0:1746129570.126936:0:8412:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16072 00000100:00100000:2.0:1746129570.126941:0:8412:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009016b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ada2ffba-8920-4ecb-8068-68caa9806978+15:1963:x1830948734089344:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129570.126944:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e91ec00/0x40a459093b069a38 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20d99 expref: 15 pid: 8411 timeout: 925 lvb_type: 1 00010000:00010000:2.0:1746129570.126947:0:8412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129570.126951:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129570.126953:0:8412:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ec95e00/0x40a459093b069aee lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20e3a expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129570.126953:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129570.126958:0:7085:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012dc1a400/0x40a459093b069ad9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 987136->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20e25 expref: 14 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129570.126964:0:7085:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dc1a400/0x40a459093b069ad9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 987136->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20e25 expref: 15 pid: 22480 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129570.126972:0:8412:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009016a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8412:1830948737498496:192.168.202.4@tcp:106: 00010000:00010000:1.0:1746129570.126982:0:7085:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012dc1a400/0x40a459093b069ad9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 987136->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20e25 expref: 15 pid: 22480 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129570.126989:0:8412:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a00f00 going to sleep for 11 seconds 00000100:00100000:1.0:1746129570.126990:0:7085:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a77b0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7085:1830948737498624:192.168.202.4@tcp:105: 00000100:00100000:1.0:1746129570.127012:0:7085:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934d2000 going to sleep for 11 seconds 00000100:00100000:2.0:1746129570.133236:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129570.133262:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129570.133346:0:8412:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009016a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8412:1830948737498496:192.168.202.4@tcp:106: 00010000:00010000:2.0:1746129570.133372:0:8412:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ec95e00/0x40a459093b069aee lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20e3a expref: 15 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129570.133389:0:8412:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ec95e00/0x40a459093b069aee lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20e3a expref: 15 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129570.133398:0:8412:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ec95e00, rc 0) 00000100:00100000:2.0:1746129570.133435:0:8412:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009016b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ada2ffba-8920-4ecb-8068-68caa9806978+14:1963:x1830948734089344:12345-192.168.202.4@tcp:101:cat.0 Request processed in 6493us (6795us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129570.133442:0:8412:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16072 00000100:00100000:2.0:1746129570.133462:0:8412:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734089728 00000100:00100000:2.0:1746129570.133466:0:8412:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734089728 00000100:00100000:2.0:1746129570.133490:0:8412:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16073 00000100:00100000:2.0:1746129570.133496:0:8412:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cda5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+10:1961:x1830948734089728:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129570.133506:0:8412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129570.133517:0:8412:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ec95c00/0x40a459093b069af5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20e41 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129570.133553:0:8412:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cda6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8412:1830948737498752:192.168.202.4@tcp:106: 00000100:00100000:2.0:1746129570.133589:0:8412:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a00f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746129570.133602:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734089600 00000100:00100000:2.0:1746129570.133604:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734089600 00002000:00100000:2.0:1746129570.133623:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ec:0x0] (987136->991231) req@ffff88012cda4700 x1830948734089600/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:311/0 lens 488/0 e 0 to 0 dl 1746129581 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129570.133631:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cda4700 with x1830948734089600 ext(987136->991231) 00002000:00010000:2.0:1746129570.133635:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012cda4700 00000100:00100000:2.0:1746129570.133644:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7744 00000100:00100000:2.0:1746129570.133648:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cda4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+14:1963:x1830948734089600:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:1.0:1746129570.133740:0:7085:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a77b0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7085:1830948737498624:192.168.202.4@tcp:105: 00010000:00010000:1.0:1746129570.133752:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129570.133770:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090169180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ada2ffba-8920-4ecb-8068-68caa9806978+14:1962:x1830948734088960:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 6853us (7195us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129570.133777:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8235 00000100:00100000:2.0:1746129570.133789:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cda4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+13:1963:x1830948734089600:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 139us (560us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129570.133794:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7744 00002000:00100000:2.0:1746129570.133798:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ec:0x0] (987136->991231) req@ffff88012cda4700 x1830948734089600/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:311/0 lens 488/4536 e 0 to 0 dl 1746129581 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129570.133805:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cda4700 with x1830948734089600 ext(987136->991231) 00002000:00010000:2.0:1746129570.133808:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012cda4700 00000100:00100000:3.0:1746129570.134370:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090169c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7149:1830948737498368:192.168.202.4@tcp:106: 00010000:00010000:3.0:1746129570.134387:0:7149:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095b5fa00/0x40a459093b069ae7 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20e33 expref: 26 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129570.134396:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095b5fa00/0x40a459093b069ae7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20e33 expref: 26 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129570.134406:0:7149:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095b5fa00, rc 0) 00000100:00100000:3.0:1746129570.134425:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090168000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ada2ffba-8920-4ecb-8068-68caa9806978+25:1963:x1830948734089216:12345-192.168.202.4@tcp:101:cat.0 Request processed in 7582us (7820us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129570.134431:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16071 00002000:00010000:2.0:1746129570.136842:0:8412:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3ec:0x0] updating lvb mtime: 1746129569 -> 1746129570 00002000:00010000:2.0:1746129570.136848:0:8412:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3ec:0x0] updating lvb atime: 1746129568 -> 1746129570 00002000:00010000:2.0:1746129570.136849:0:8412:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3ec:0x0] updating lvb ctime: 1746129569 -> 1746129570 00000100:00100000:2.0:1746129570.136865:0:8412:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cda6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8412:1830948737498752:192.168.202.4@tcp:106: 00010000:00010000:2.0:1746129570.136887:0:8412:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ec95c00/0x40a459093b069af5 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20e41 expref: 11 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129570.136898:0:8412:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ec95c00/0x40a459093b069af5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20e41 expref: 11 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129570.136907:0:8412:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ec95c00, rc 0) 00000100:00100000:1.0:1746129570.138671:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a77b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737498880:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1746129570.138716:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129570.138823:0:8412:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cda5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+10:1961:x1830948734089728:12345-192.168.202.4@tcp:101:cat.0 Request processed in 5323us (5557us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129570.138832:0:8412:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16073 00000100:00100000:2.0:1746129570.138862:0:12977:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737498880 00000100:00100000:2.0:1746129570.138870:0:12977:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737498880 00000100:00100000:2.0:1746129570.138896:0:12977:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:2.0:1746129570.138900:0:12977:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a77b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1830948737498880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1746129570.138915:0:12977:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 1703936 granted 577044480 pending 6815744 free 3853516800 avail 3832545280 00000100:00100000:2.0:1746129570.138938:0:12977:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a77b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1830948737498880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 38us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129570.138942:0:12977:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00080000:2.0:1746129570.138992:0:7097:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746129570.139049:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cda7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1830948737499136:0@lo:400:kworker.0 00000100:00100000:0.0:1746129570.139054:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cda6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1830948737499264:0@lo:400:kworker.0 00000100:00100000:3.0:1746129570.139074:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129570.139084:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737499136 00000100:00100000:0.0:1746129570.139087:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737499136 00000100:00100000:3.0:1746129570.139090:0:3303:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1746129570.139094:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cda6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f03f6bde-e986-4df5-86c3-48805e205677:3303:1830948737499008:0@lo:400:kworker.0 00000100:00100000:0.0:1746129570.139109:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1746129570.139113:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a07af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1830948737499136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746129570.139116:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129570.139145:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a07af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1830948737499136:12345-0@lo:400:kworker.0 Request processed in 32us (71us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129570.139147:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cda7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1830948737499136:0@lo:400:kworker.0 00000100:00100000:0.0:1746129570.139150:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1746129570.139163:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129570.139173:0:3300:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1746129570.139178:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cda7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1830948737499392:0@lo:400:kworker.0 00000100:00100000:3.0:1746129570.139179:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129570.139192:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129570.139208:0:14547:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737499264 00000100:00100000:0.0:1746129570.139210:0:14547:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737499264 00000100:00100000:0.0:1746129570.139224:0:14547:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737499392 00000100:00100000:0.0:1746129570.139225:0:14547:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737499392 00000100:00100000:0.0:1746129570.139241:0:14547:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1746129570.139245:0:14547:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e954700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1830948737499264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746129570.139253:0:15096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1746129570.139257:0:15096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e955c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1830948737499392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746129570.139269:0:14547:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e954700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1830948737499264:12345-0@lo:400:kworker.0 Request processed in 24us (105us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129570.139273:0:14547:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1746129570.139274:0:15096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e955c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1830948737499392:12345-0@lo:400:kworker.0 Request processed in 18us (82us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129570.139279:0:15096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1746129570.139310:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cda7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1830948737499392:0@lo:400:kworker.0 00000100:00100000:0.0:1746129570.139333:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cda6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1830948737499264:0@lo:400:kworker.0 00000100:00100000:3.0:1746129570.139338:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129570.139354:0:8416:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734090112 00000100:00100000:3.0:1746129570.139357:0:8416:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734090112 00002000:00100000:3.0:1746129570.139377:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3ef:0x0] (4194304->5148671) req@ffff8800a07ae300 x1830948734090112/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:311/0 lens 488/0 e 0 to 0 dl 1746129581 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129570.139386:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a07ae300 with x1830948734090112 ext(4194304->5148671) 00002000:00010000:3.0:1746129570.139389:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a07ae300 00000100:00100000:3.0:1746129570.139405:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7745 00000100:00100000:3.0:1746129570.139410:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a07ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+13:1963:x1830948734090112:12345-192.168.202.4@tcp:3:cat.0 00000100:00080000:2.0:1746129570.139645:0:7097:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746129570.139652:0:8412:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734089856 00000100:00100000:2.0:1746129570.139654:0:8412:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734089856 00000100:00100000:2.0:1746129570.139675:0:8412:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16074 00000100:00100000:2.0:1746129570.139679:0:8412:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a07ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ada2ffba-8920-4ecb-8068-68caa9806978+25:32263:x1830948734089856:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:2.0:1746129570.139687:0:8412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129570.139697:0:8412:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ec95200/0x40a459093b069afc lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20e48 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129570.139715:0:8412:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e91f600/0x40a459093b069a3f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20da0 expref: 26 pid: 8411 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129570.139733:0:8412:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e94ce00/0x40a459093b069a70 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20dca expref: 11 pid: 20577 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129570.139739:0:8412:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129570.139741:0:8412:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129570.139743:0:8412:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ec95200/0x40a459093b069afc lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [1048576->1523711] (req 1048576->1523711) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20e48 expref: 26 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129570.139761:0:8412:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012e94ce00/0x40a459093b069a70 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20dca expref: 11 pid: 20577 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129570.139770:0:8412:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012e94ce00/0x40a459093b069a70 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20dca expref: 11 pid: 20577 timeout: 925 lvb_type: 1 00000100:00100000:2.0:1746129570.139777:0:8412:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cda6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8412:1830948737499520:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129570.139815:0:8412:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012e91f600/0x40a459093b069a3f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20da0 expref: 26 pid: 8411 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129570.139821:0:8412:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012e91f600/0x40a459093b069a3f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20da0 expref: 26 pid: 8411 timeout: 925 lvb_type: 1 00000100:00100000:2.0:1746129570.139828:0:8412:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cda7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8412:1830948737499648:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129570.139839:0:8412:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a00f00 going to sleep for 11 seconds 00000100:00100000:1.0:1746129570.139959:0:14545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737499008 00000100:00100000:1.0:1746129570.139962:0:14545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737499008 00000100:00100000:1.0:1746129570.139980:0:14545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1746129570.139985:0:14545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098ecfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f03f6bde-e986-4df5-86c3-48805e205677+18:3303:x1830948737499008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746129570.140021:0:14545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098ecfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f03f6bde-e986-4df5-86c3-48805e205677+18:3303:x1830948737499008:12345-0@lo:400:kworker.0 Request processed in 36us (904us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129570.140026:0:14545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1746129570.140049:0:3301:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179874079 gen 2 00000004:00080000:1.0:1746129570.140052:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800903a0000, transno 17179874012 00000004:00080000:1.0:1746129570.140057:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ea91880, transno 17179874013 00000004:00080000:1.0:1746129570.140060:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800903a2300, transno 17179874014 00000004:00080000:1.0:1746129570.140061:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ea93480, transno 17179874015 00000004:00080000:1.0:1746129570.140064:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800903a1880, transno 17179874016 00000004:00080000:1.0:1746129570.140065:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ea92680, transno 17179874017 00000004:00080000:1.0:1746129570.140068:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880090e6ca80, transno 17179874018 00000004:00080000:1.0:1746129570.140070:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800903a1500, transno 17179874019 00000004:00080000:1.0:1746129570.140072:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009feedc00, transno 17179874021 00000004:00080000:1.0:1746129570.140074:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009feee680, transno 17179874022 00000004:00080000:1.0:1746129570.140076:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009feeca80, transno 17179874023 00000004:00080000:1.0:1746129570.140078:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009feee300, transno 17179874024 00000004:00080000:1.0:1746129570.140081:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009feec380, transno 17179874025 00000004:00080000:1.0:1746129570.140083:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009feec700, transno 17179874026 00000004:00080000:1.0:1746129570.140085:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009feed880, transno 17179874027 00000004:00080000:1.0:1746129570.140086:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009feef100, transno 17179874028 00000004:00080000:1.0:1746129570.140088:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880132c24000, transno 17179874029 00000004:00080000:1.0:1746129570.140090:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a77b3480, transno 17179874030 00000004:00080000:1.0:1746129570.140092:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a77b1880, transno 17179874031 00000004:00080000:1.0:1746129570.140094:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095626d80, transno 17179874032 00000004:00080000:1.0:1746129570.140096:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880132c24380, transno 17179874033 00000004:00080000:1.0:1746129570.140098:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880090e6f800, transno 17179874034 00000004:00080000:1.0:1746129570.140100:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a77b0e00, transno 17179874035 00000004:00080000:1.0:1746129570.140693:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009feef800, transno 17179874036 00000004:00080000:1.0:1746129570.140696:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800947bd880, transno 17179874053 00000004:00080000:1.0:1746129570.140699:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092fd3100, transno 17179874054 00000004:00080000:1.0:1746129570.140701:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800947bd180, transno 17179874055 00000004:00080000:1.0:1746129570.140703:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800947bfb80, transno 17179874056 00000004:00080000:1.0:1746129570.140704:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800947be300, transno 17179874057 00000004:00080000:1.0:1746129570.140706:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800947bce00, transno 17179874058 00000004:00080000:1.0:1746129570.140708:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800947bf480, transno 17179874059 00000004:00080000:1.0:1746129570.140710:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092fd3480, transno 17179874060 00000004:00080000:1.0:1746129570.140712:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b552d80, transno 17179874064 00000004:00080000:1.0:1746129570.140714:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b551880, transno 17179874065 00000004:00080000:1.0:1746129570.140716:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b550a80, transno 17179874066 00000004:00080000:1.0:1746129570.140718:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b550e00, transno 17179874067 00000004:00080000:1.0:1746129570.140720:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b552300, transno 17179874068 00000004:00080000:1.0:1746129570.140722:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b552a00, transno 17179874069 00000004:00080000:1.0:1746129570.140724:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b553100, transno 17179874070 00000004:00080000:1.0:1746129570.140726:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b550000, transno 17179874071 00000004:00080000:1.0:1746129570.140728:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fbaf100, transno 17179874072 00000004:00080000:1.0:1746129570.140730:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012cda5c00, transno 17179874073 00000004:00080000:1.0:1746129570.140732:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c7dbb80, transno 17179874074 00000004:00080000:1.0:1746129570.140734:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fbac700, transno 17179874075 00000004:00080000:1.0:1746129570.140736:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c7db480, transno 17179874076 00000004:00080000:1.0:1746129570.140738:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fbaed80, transno 17179874077 00000004:00080000:1.0:1746129570.140740:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009feed180, transno 17179874078 00000004:00080000:1.0:1746129570.140742:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fbae300, transno 17179874079 00000100:00100000:1.0:1746129570.140750:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a77b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737498880:0@lo:13:osp-pre-1-0.0 00000004:00080000:1.0:1746129570.141039:0:14589:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 48 done 00000100:00100000:2.0:1746129570.142165:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cda6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f03f6bde-e986-4df5-86c3-48805e205677:3303:1830948737499008:0@lo:400:kworker.0 00000100:00100000:0.0:1746129570.146267:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129570.146389:0:8412:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cda6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8412:1830948737499520:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129570.146403:0:8412:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cda7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8412:1830948737499648:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129570.146430:0:8412:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012ec95200/0x40a459093b069afc lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [1048576->1523711] (req 1048576->1523711) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20e48 expref: 26 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129570.146444:0:8412:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ec95200, rc 0) 00000100:00100000:2.0:1746129570.146496:0:8412:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a07ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ada2ffba-8920-4ecb-8068-68caa9806978+26:32263:x1830948734089856:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 6814us (7315us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129570.146505:0:8412:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16074 00000100:00100000:0.0:1746129570.147348:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129570.147411:0:8412:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734090240 00000100:00100000:2.0:1746129570.147418:0:8412:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734090240 00000100:00100000:1.0:1746129570.147606:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734090368 00000100:00100000:1.0:1746129570.147610:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734090368 00010000:00010000:1.0:1746129570.147627:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012e94ce00/0x40a459093b069a70 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20dca expref: 12 pid: 20577 timeout: 925 lvb_type: 1 00000100:00100000:1.0:1746129570.147646:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8236 00000100:00100000:1.0:1746129570.147652:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e956680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+12:1962:x1830948734090368:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129570.147663:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129570.147683:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012e94ce00/0x40a459093b069a70 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20dca expref: 12 pid: 20577 timeout: 925 lvb_type: 1 00010000:00010000:1.0:1746129570.147692:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012e94ce00/0x40a459093b069a70 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20dca expref: 12 pid: 20577 timeout: 925 lvb_type: 1 00010000:00010000:1.0:1746129570.147711:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e94ce00/0x40a459093b069a70 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20dca expref: 12 pid: 20577 timeout: 925 lvb_type: 1 00010000:00010000:1.0:1746129570.147725:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129570.147748:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e956680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+11:1962:x1830948734090368:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 96us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129570.147753:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8236 00000100:00100000:2.0:1746129570.147892:0:8412:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16075 00000100:00100000:2.0:1746129570.147898:0:8412:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e957b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+10:1962:x1830948734090240:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129570.147910:0:8412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129570.147920:0:8412:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ec95e00/0x40a459093b069b03 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20e4f expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129570.147955:0:8412:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cda7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8412:1830948737499776:192.168.202.4@tcp:106: 00000100:00100000:2.0:1746129570.148012:0:8412:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a00f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746129570.148434:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129570.148449:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734090496 00000100:00100000:0.0:1746129570.148452:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734090496 00010000:00010000:0.0:1746129570.148464:0:7087:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012e91f600/0x40a459093b069a3f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20da0 expref: 26 pid: 8411 timeout: 925 lvb_type: 1 00000100:00100000:0.0:1746129570.148477:0:7087:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8237 00000100:00100000:0.0:1746129570.148481:0:7087:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092fd3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ada2ffba-8920-4ecb-8068-68caa9806978+26:1963:x1830948734090496:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129570.148488:0:7087:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129570.148497:0:7087:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012e91f600/0x40a459093b069a3f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20da0 expref: 26 pid: 8411 timeout: 925 lvb_type: 1 00010000:00010000:0.0:1746129570.148504:0:7087:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012e91f600/0x40a459093b069a3f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20da0 expref: 26 pid: 8411 timeout: 925 lvb_type: 1 00010000:00010000:0.0:1746129570.148521:0:7087:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e91f600/0x40a459093b069a3f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20da0 expref: 26 pid: 8411 timeout: 925 lvb_type: 1 00010000:00010000:0.0:1746129570.148533:0:7087:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129570.148535:0:7087:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129570.148540:0:7087:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ec95200/0x40a459093b069afc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1523711) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20e48 expref: 25 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129570.148547:0:7087:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ec95200/0x40a459093b069afc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1523711) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20e48 expref: 25 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129570.148566:0:7087:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012ec95200/0x40a459093b069afc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1523711) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20e48 expref: 25 pid: 8412 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129570.148574:0:7087:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092fd3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7087:1830948737499904:192.168.202.4@tcp:105: 00000100:00100000:0.0:1746129570.148596:0:7087:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e29fc00 going to sleep for 11 seconds 00000100:00100000:3.0:1746129570.149090:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a07ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+13:1963:x1830948734090112:12345-192.168.202.4@tcp:3:cat.0 Request processed in 9678us (9750us total) trans 0 rc 954368/954368 00000100:00100000:3.0:1746129570.149098:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7745 00002000:00100000:3.0:1746129570.149106:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ef:0x0] (4194304->5148671) req@ffff8800a07ae300 x1830948734090112/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:311/0 lens 488/440 e 0 to 0 dl 1746129581 ref 1 fl Complete:/200/0 rc 954368/954368 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129570.149114:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a07ae300 with x1830948734090112 ext(4194304->5148671) 00002000:00010000:3.0:1746129570.149118:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a07ae300 00000100:00100000:2.0:1746129570.151176:0:8412:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cda7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8412:1830948737499776:192.168.202.4@tcp:106: 00010000:00010000:2.0:1746129570.151200:0:8412:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ec95e00/0x40a459093b069b03 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20e4f expref: 11 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129570.151211:0:8412:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ec95e00/0x40a459093b069b03 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20e4f expref: 11 pid: 8412 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746129570.151650:0:7087:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092fd3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7087:1830948737499904:192.168.202.4@tcp:105: 00010000:00010000:0.0:1746129570.151662:0:7087:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129570.151705:0:7087:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092fd3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ada2ffba-8920-4ecb-8068-68caa9806978+25:1963:x1830948734090496:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 3221us (3270us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129570.151713:0:7087:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8237 00010000:00010000:2.0:1746129570.151873:0:8412:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ec95e00, rc 0) 00000100:00100000:2.0:1746129570.151895:0:8412:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e957b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+10:1962:x1830948734090240:12345-192.168.202.4@tcp:101:cat.0 Request processed in 3997us (5634us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129570.151902:0:8412:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16075 00000100:00100000:0.0:1746129570.154877:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129570.155359:0:8412:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734090752 00000100:00100000:2.0:1746129570.155366:0:8412:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734090752 00000100:00100000:2.0:1746129570.156003:0:8412:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16076 00000100:00100000:2.0:1746129570.156012:0:8412:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092fd3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ada2ffba-8920-4ecb-8068-68caa9806978+13:1963:x1830948734090752:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129570.156027:0:8412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129570.156041:0:8412:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ec94600/0x40a459093b069b0a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20e5d expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129570.156082:0:8412:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cda7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8412:1830948737500032:192.168.202.4@tcp:106: 00000100:00100000:2.0:1746129570.156154:0:8412:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a00f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746129570.156290:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129570.156388:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129570.156434:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734090624 00000100:00100000:3.0:1746129570.156438:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734090624 00000100:00100000:3.0:1746129570.156458:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16077 00000100:00100000:3.0:1746129570.156462:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092fd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ada2ffba-8920-4ecb-8068-68caa9806978+25:1963:x1830948734090624:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129570.156469:0:7149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129570.156478:0:7149:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f8d5800/0x40a459093b069b11 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20e56 expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129570.156501:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a07af480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7149:1830948737500160:192.168.202.4@tcp:106: 00000100:00100000:3.0:1746129570.156525:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a6ce8900 going to sleep for 11 seconds 00000100:00100000:3.0:1746129570.156537:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734091008 00000100:00100000:3.0:1746129570.156540:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734091008 00002000:00100000:3.0:1746129570.156559:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f3:0x0] (1519616->1523711) req@ffff880136017800 x1830948734091008/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:311/0 lens 488/0 e 0 to 0 dl 1746129581 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129570.156567:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136017800 with x1830948734091008 ext(1519616->1523711) 00002000:00010000:3.0:1746129570.156571:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136017800 00000100:00100000:3.0:1746129570.156581:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7746 00000100:00100000:3.0:1746129570.156585:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136017800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+27:1961:x1830948734091008:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:3.0:1746129570.156727:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136017800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+27:1961:x1830948734091008:12345-192.168.202.4@tcp:3:cat.0 Request processed in 141us (340us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129570.156733:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7746 00002000:00100000:3.0:1746129570.156738:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f3:0x0] (1519616->1523711) req@ffff880136017800 x1830948734091008/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:311/0 lens 488/4536 e 0 to 0 dl 1746129581 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129570.156743:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136017800 with x1830948734091008 ext(1519616->1523711) 00002000:00010000:3.0:1746129570.156746:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136017800 00000100:00100000:2.0:1746129570.161389:0:8412:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cda7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8412:1830948737500032:192.168.202.4@tcp:106: 00010000:00010000:2.0:1746129570.161426:0:8412:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ec94600/0x40a459093b069b0a lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20e5d expref: 14 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129570.161441:0:8412:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ec94600/0x40a459093b069b0a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20e5d expref: 14 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129570.161459:0:8412:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ec94600, rc 0) 00000100:00100000:2.0:1746129570.161503:0:8412:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092fd3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ada2ffba-8920-4ecb-8068-68caa9806978+13:1963:x1830948734090752:12345-192.168.202.4@tcp:101:cat.0 Request processed in 5492us (6636us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129570.161511:0:8412:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16076 00000100:00100000:3.0:1746129570.161998:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a07af480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7149:1830948737500160:192.168.202.4@tcp:106: 00010000:00010000:3.0:1746129570.162029:0:7149:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f8d5800/0x40a459093b069b11 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20e56 expref: 26 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129570.162042:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f8d5800/0x40a459093b069b11 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20e56 expref: 26 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129570.162066:0:7149:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f8d5800, rc 0) 00000100:00100000:3.0:1746129570.162108:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092fd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ada2ffba-8920-4ecb-8068-68caa9806978+25:1963:x1830948734090624:12345-192.168.202.4@tcp:101:cat.0 Request processed in 5645us (5818us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129570.162116:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16077 00000100:00100000:0.0:1746129570.172396:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129570.172484:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129570.172577:0:8412:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734091264 00000100:00100000:2.0:1746129570.172586:0:8412:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734091264 00000100:00100000:2.0:1746129570.172628:0:8412:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734091136 00000100:00100000:2.0:1746129570.172631:0:8412:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734091136 00000100:00100000:2.0:1746129570.172652:0:8412:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16078 00000100:00100000:2.0:1746129570.172660:0:8412:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136017100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ada2ffba-8920-4ecb-8068-68caa9806978+13:1961:x1830948734091264:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129570.172676:0:8412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129570.172692:0:8412:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ec95400/0x40a459093b069b18 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20e6b expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129570.172737:0:8412:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cda7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8412:1830948737500288:192.168.202.4@tcp:106: 00000100:00100000:2.0:1746129570.172811:0:8412:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a00f00 going to sleep for 11 seconds 00000100:00100000:1.0:1746129570.173732:0:22480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16079 00000100:00100000:1.0:1746129570.173742:0:22480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ada2ffba-8920-4ecb-8068-68caa9806978+25:1960:x1830948734091136:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129570.173751:0:22480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129570.173763:0:22480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095c59000/0x40a459093b069b1f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20e64 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129570.173792:0:22480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a77b3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22480:1830948737500416:192.168.202.4@tcp:106: 00000100:00100000:1.0:1746129570.173841:0:22480:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934d20c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746129570.179243:0:22480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a77b3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22480:1830948737500416:192.168.202.4@tcp:106: 00010000:00010000:1.0:1746129570.179273:0:22480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095c59000/0x40a459093b069b1f lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20e64 expref: 26 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129570.179284:0:22480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095c59000/0x40a459093b069b1f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20e64 expref: 26 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129570.179346:0:22480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095c59000, rc 0) 00000100:00100000:1.0:1746129570.179385:0:22480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ada2ffba-8920-4ecb-8068-68caa9806978+25:1960:x1830948734091136:12345-192.168.202.4@tcp:101:cat.0 Request processed in 5645us (6900us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129570.179393:0:22480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16079 00000100:00100000:2.0:1746129570.179486:0:8412:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cda7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8412:1830948737500288:192.168.202.4@tcp:106: 00010000:00010000:2.0:1746129570.179502:0:8412:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ec95400/0x40a459093b069b18 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20e6b expref: 14 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129570.179511:0:8412:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ec95400/0x40a459093b069b18 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20e6b expref: 14 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129570.179842:0:8412:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ec95400, rc 0) 00000100:00100000:2.0:1746129570.179875:0:8412:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136017100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ada2ffba-8920-4ecb-8068-68caa9806978+13:1961:x1830948734091264:12345-192.168.202.4@tcp:101:cat.0 Request processed in 7215us (7485us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129570.179880:0:8412:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16078 00000100:00100000:0.0:1746129570.282419:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129570.283853:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129570.283923:0:22480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734091392 00000100:00100000:0.0:1746129570.283931:0:22480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734091392 00000100:00100000:0.0:1746129570.283961:0:22480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734091520 00000100:00100000:0.0:1746129570.283963:0:22480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734091520 00000100:00100000:0.0:1746129570.283988:0:22480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16080 00000100:00100000:0.0:1746129570.283995:0:22480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+10:1960:x1830948734091392:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129570.284012:0:22480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746129570.284023:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16081 00010000:00010000:0.0:1746129570.284026:0:22480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012dc1a200/0x40a459093b069b26 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20e72 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129570.284032:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a77b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+11:1961:x1830948734091520:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129570.284041:0:7149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129570.284050:0:7149:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f8d4400/0x40a459093b069b2d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20e79 expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129570.284069:0:22480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012baef100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22480:1830948737500544:192.168.202.4@tcp:106: 00000100:00100000:3.0:1746129570.284084:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a07af480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7149:1830948737500672:192.168.202.4@tcp:106: 00000100:00100000:3.0:1746129570.285218:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a6ce8900 going to sleep for 11 seconds 00000100:00100000:0.0:1746129570.285383:0:22480:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e29fc00 going to sleep for 11 seconds 00000100:00100000:0.0:1746129570.289044:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00002000:00010000:3.0:1746129570.290799:0:7149:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb mtime: 1746129569 -> 1746129570 00002000:00010000:3.0:1746129570.290805:0:7149:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb atime: 1746129569 -> 1746129570 00002000:00010000:3.0:1746129570.290807:0:7149:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb ctime: 1746129569 -> 1746129570 00000100:00100000:1.0:1746129570.290816:0:22480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012baef100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22480:1830948737500544:192.168.202.4@tcp:106: 00000100:00100000:3.0:1746129570.290820:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a07af480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7149:1830948737500672:192.168.202.4@tcp:106: 00010000:00010000:3.0:1746129570.290841:0:7149:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f8d4400/0x40a459093b069b2d lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20e79 expref: 12 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129570.290841:0:22480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012dc1a200/0x40a459093b069b26 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20e72 expref: 11 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129570.290853:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f8d4400/0x40a459093b069b2d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20e79 expref: 12 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129570.290853:0:22480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012dc1a200/0x40a459093b069b26 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20e72 expref: 11 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129570.290866:0:22480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dc1a200, rc 0) 00010000:00010000:3.0:1746129570.290867:0:7149:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f8d4400, rc 0) 00000100:00100000:3.0:1746129570.290910:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a77b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+11:1961:x1830948734091520:12345-192.168.202.4@tcp:101:cat.0 Request processed in 6880us (7059us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129570.290918:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16081 00000100:00100000:3.0:1746129570.290941:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734091648 00000100:00100000:3.0:1746129570.290946:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734091648 00000100:00100000:3.0:1746129570.290975:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16082 00000100:00100000:3.0:1746129570.290981:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bf7a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ada2ffba-8920-4ecb-8068-68caa9806978+13:32271:x1830948734091648:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:3.0:1746129570.290992:0:7149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129570.291002:0:7149:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f8d5000/0x40a459093b069b34 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20e80 expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129570.291022:0:7149:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012e91fa00/0x40a459093b069a54 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20db5 expref: 14 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129570.291029:0:7149:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cdfce00/0x40a459093b069a85 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20ddf expref: 10 pid: 20577 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129570.291040:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129570.291042:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129570.291045:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f8d5000/0x40a459093b069b34 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [2334720->2355199] (req 2334720->2355199) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20e80 expref: 14 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129570.291068:0:7149:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009cdfce00/0x40a459093b069a85 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20ddf expref: 10 pid: 20577 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129570.291078:0:7149:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009cdfce00/0x40a459093b069a85 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20ddf expref: 10 pid: 20577 timeout: 925 lvb_type: 1 00000100:00100000:3.0:1746129570.291088:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a07af480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7149:1830948737500800:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129570.291132:0:7149:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012e91fa00/0x40a459093b069a54 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20db5 expref: 14 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129570.291139:0:7149:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012e91fa00/0x40a459093b069a54 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20db5 expref: 14 pid: 7149 timeout: 925 lvb_type: 1 00000100:00100000:3.0:1746129570.291147:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094f47800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7149:1830948737500928:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129570.291166:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a6ce8900 going to sleep for 11 seconds 00000100:00100000:1.0:1746129570.291386:0:22480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+10:1960:x1830948734091392:12345-192.168.202.4@tcp:101:cat.0 Request processed in 6908us (8490us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129570.291392:0:22480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16080 00000100:00100000:1.0:1746129570.302208:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129570.302688:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a07af480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7149:1830948737500800:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129570.302697:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094f47800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7149:1830948737500928:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129570.302718:0:7149:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f8d5000/0x40a459093b069b34 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [2334720->2355199] (req 2334720->2355199) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20e80 expref: 14 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129570.302733:0:7149:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f8d5000, rc 0) 00000100:00100000:0.0:1746129570.302782:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bf7a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ada2ffba-8920-4ecb-8068-68caa9806978+14:32271:x1830948734091648:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 11800us (13746us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129570.302790:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16082 00000100:00100000:3.0:1746129570.303105:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734091776 00000100:00100000:3.0:1746129570.303111:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734091776 00000100:00100000:3.0:1746129570.303140:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16083 00000100:00100000:3.0:1746129570.303145:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a77b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+10:32273:x1830948734091776:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129570.303157:0:7149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129570.303168:0:7149:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f8d5a00/0x40a459093b069b3b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20e87 expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129570.303186:0:7149:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012dc1a400/0x40a459093b069ad9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 987136->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20e25 expref: 13 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129570.303192:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129570.303194:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129570.303196:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f8d5a00/0x40a459093b069b3b lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20e87 expref: 11 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129570.303214:0:7149:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012dc1a400/0x40a459093b069ad9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 987136->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20e25 expref: 13 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129570.303223:0:7149:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012dc1a400/0x40a459093b069ad9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 987136->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20e25 expref: 13 pid: 22480 timeout: 925 lvb_type: 0 00000100:00100000:3.0:1746129570.303232:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094f44380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7149:1830948737501056:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129570.303279:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a6ce8cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129570.315715:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129570.315751:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129570.315848:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094f44380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7149:1830948737501056:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129570.315875:0:7149:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f8d5a00/0x40a459093b069b3b lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20e87 expref: 11 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129570.315892:0:7149:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f8d5a00, rc 0) 00000100:00100000:3.0:1746129570.315928:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a77b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+11:32273:x1830948734091776:12345-192.168.202.4@tcp:101:cat.0 Request processed in 12783us (13729us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129570.315936:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16083 00000100:00100000:1.0:1746129570.316005:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734091904 00000100:00100000:1.0:1746129570.316011:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734091904 00010000:00010000:1.0:1746129570.316033:0:7087:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009cdfce00/0x40a459093b069a85 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20ddf expref: 11 pid: 20577 timeout: 925 lvb_type: 1 00000100:00100000:1.0:1746129570.316050:0:7087:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8238 00000100:00100000:1.0:1746129570.316054:0:7087:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baeed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+11:1963:x1830948734091904:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129570.316063:0:7087:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129570.316081:0:7087:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009cdfce00/0x40a459093b069a85 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20ddf expref: 11 pid: 20577 timeout: 925 lvb_type: 1 00010000:00010000:1.0:1746129570.316091:0:7087:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009cdfce00/0x40a459093b069a85 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20ddf expref: 11 pid: 20577 timeout: 925 lvb_type: 1 00010000:00010000:1.0:1746129570.316109:0:7087:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cdfce00/0x40a459093b069a85 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20ddf expref: 11 pid: 20577 timeout: 925 lvb_type: 1 00010000:00010000:1.0:1746129570.316125:0:7087:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129570.316140:0:7087:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baeed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+10:1963:x1830948734091904:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 86us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129570.316145:0:7087:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8238 00000100:00100000:2.0:1746129570.316221:0:8416:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734092032 00000100:00100000:2.0:1746129570.316225:0:8416:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734092032 00002000:00100000:2.0:1746129570.316247:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3ec:0x0] (987136->1048575) req@ffff88012baee680 x1830948734092032/t0(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:311/0 lens 488/0 e 0 to 0 dl 1746129581 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129570.316254:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012baee680 with x1830948734092032 ext(987136->1048575) 00010000:00010000:2.0:1746129570.316259:0:8416:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012dc1a400/0x40a459093b069ad9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 987136->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20e25 expref: 14 pid: 22480 timeout: 925 lvb_type: 0 00010000:00010000:2.0:1746129570.316268:0:8416:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012dc1a400/0x40a459093b069ad9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 987136->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20e25 expref: 14 pid: 22480 timeout: 925 lvb_type: 0 00002000:00010000:2.0:1746129570.316273:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012baee680 00000100:00100000:2.0:1746129570.316283:0:8416:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2411 00000100:00100000:2.0:1746129570.316287:0:8416:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ada2ffba-8920-4ecb-8068-68caa9806978+14:1961:x1830948734092032:12345-192.168.202.4@tcp:4:multiop.0 00000100:00100000:0.0:1746129570.327804:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129570.327851:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129570.327919:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734092160 00000100:00100000:1.0:1746129570.327926:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734092160 00010000:00010000:1.0:1746129570.327955:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012e91fa00/0x40a459093b069a54 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20db5 expref: 16 pid: 7149 timeout: 925 lvb_type: 1 00000100:00100000:1.0:1746129570.327980:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8239 00000100:00100000:1.0:1746129570.327986:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6ce2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ada2ffba-8920-4ecb-8068-68caa9806978+16:1962:x1830948734092160:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129570.327997:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129570.328016:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012e91fa00/0x40a459093b069a54 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20db5 expref: 16 pid: 7149 timeout: 925 lvb_type: 1 00010000:00010000:1.0:1746129570.328026:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012e91fa00/0x40a459093b069a54 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20db5 expref: 16 pid: 7149 timeout: 925 lvb_type: 1 00010000:00010000:1.0:1746129570.328046:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e91fa00/0x40a459093b069a54 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20db5 expref: 16 pid: 7149 timeout: 925 lvb_type: 1 00010000:00010000:1.0:1746129570.328063:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129570.328065:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129570.328070:0:7085:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f8d5000/0x40a459093b069b34 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2334720->2355199) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20e80 expref: 15 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129570.328081:0:7085:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f8d5000/0x40a459093b069b34 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2334720->2355199) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20e80 expref: 15 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129570.328106:0:7085:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f8d5000/0x40a459093b069b34 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2334720->2355199) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20e80 expref: 15 pid: 7149 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129570.328115:0:7085:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a77b0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7085:1830948737501184:192.168.202.4@tcp:105: 00000100:00100000:1.0:1746129570.328177:0:7085:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934d20c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746129570.328396:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734092288 00000100:00100000:3.0:1746129570.328401:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734092288 00000100:00100000:3.0:1746129570.328420:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16084 00000100:00100000:3.0:1746129570.328424:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+11:32268:x1830948734092288:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:3.0:1746129570.328436:0:7149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129570.328446:0:7149:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f8d5800/0x40a459093b069b42 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20e8e expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129570.328460:0:7149:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009be04400/0x40a459093b069ac4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20e10 expref: 12 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129570.328467:0:7149:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012dc1b200/0x40a459093b069ad2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20e1e expref: 24 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129570.328471:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129570.328472:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129570.328475:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f8d5800/0x40a459093b069b42 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [3588096->4050943] (req 3588096->4050943) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20e8e expref: 12 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129570.328488:0:7149:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012dc1b200/0x40a459093b069ad2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20e1e expref: 24 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129570.328497:0:7149:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012dc1b200/0x40a459093b069ad2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20e1e expref: 24 pid: 22480 timeout: 925 lvb_type: 0 00000100:00100000:3.0:1746129570.328505:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094f44380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7149:1830948737501312:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129570.328546:0:7149:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009be04400/0x40a459093b069ac4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20e10 expref: 12 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129570.328554:0:7149:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009be04400/0x40a459093b069ac4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20e10 expref: 12 pid: 8410 timeout: 925 lvb_type: 0 00000100:00100000:3.0:1746129570.328562:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094f46d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7149:1830948737501440:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129570.328579:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a6ce8cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746129570.331336:0:8416:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ada2ffba-8920-4ecb-8068-68caa9806978+16:1961:x1830948734092032:12345-192.168.202.4@tcp:4:multiop.0 Request processed in 15042us (15623us total) trans 21474841332 rc 0/0 00000100:00100000:3.0:1746129570.331346:0:8416:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2411 00002000:00100000:3.0:1746129570.331354:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3ec:0x0] (987136->1048575) req@ffff88012baee680 x1830948734092032/t21474841332(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:311/0 lens 488/448 e 0 to 0 dl 1746129581 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129570.331363:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012baee680 with x1830948734092032 ext(987136->1048575) 00010000:00010000:3.0:1746129570.331371:0:8416:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012dc1a400/0x40a459093b069ad9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 987136->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20e25 expref: 16 pid: 22480 timeout: 925 lvb_type: 0 00010000:00010000:3.0:1746129570.331382:0:8416:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012dc1a400/0x40a459093b069ad9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 987136->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20e25 expref: 16 pid: 22480 timeout: 925 lvb_type: 0 00002000:00010000:3.0:1746129570.331388:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012baee680 00000100:00100000:0.0:1746129570.333991:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129570.334101:0:8416:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734092544 00000100:00100000:2.0:1746129570.334109:0:8416:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734092544 00002000:00100000:2.0:1746129570.334145:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3ef:0x0] (2334720->2338815) req@ffff88012baefb80 x1830948734092544/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:311/0 lens 488/0 e 0 to 0 dl 1746129581 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129570.334156:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012baefb80 with x1830948734092544 ext(2334720->2338815) 00002000:00010000:2.0:1746129570.334160:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012baefb80 00000100:00100000:2.0:1746129570.334183:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7747 00000100:00100000:2.0:1746129570.334190:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+16:1960:x1830948734092544:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:2.0:1746129570.334383:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+16:1960:x1830948734092544:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 188us (393us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129570.334389:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7747 00002000:00100000:2.0:1746129570.334395:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ef:0x0] (2334720->2338815) req@ffff88012baefb80 x1830948734092544/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:311/0 lens 488/4536 e 0 to 0 dl 1746129581 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129570.334401:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012baefb80 with x1830948734092544 ext(2334720->2338815) 00002000:00010000:2.0:1746129570.334404:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012baefb80 00000100:00100000:1.0:1746129570.334577:0:7085:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a77b0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7085:1830948737501184:192.168.202.4@tcp:105: 00010000:00010000:1.0:1746129570.334603:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129570.334632:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6ce2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ada2ffba-8920-4ecb-8068-68caa9806978+15:1962:x1830948734092160:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 6646us (6836us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129570.334645:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8239 00000100:00100000:3.0:1746129570.334806:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094f44380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7149:1830948737501312:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129570.334816:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094f46d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7149:1830948737501440:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129570.334836:0:7149:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f8d5800/0x40a459093b069b42 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [3588096->4050943] (req 3588096->4050943) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20e8e expref: 12 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129570.334851:0:7149:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f8d5800, rc 0) 00000100:00100000:3.0:1746129570.334878:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+12:32268:x1830948734092288:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 6452us (7026us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129570.334884:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16084 00000100:00100000:0.0:1746129570.346748:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129570.346790:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129570.346873:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129570.346905:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734092672 00000100:00100000:0.0:1746129570.346912:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734092672 00010000:00010000:0.0:1746129570.346943:0:7087:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012dc1b200/0x40a459093b069ad2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20e1e expref: 25 pid: 22480 timeout: 925 lvb_type: 0 00000100:00100000:0.0:1746129570.346973:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734093056 00000100:00100000:0.0:1746129570.346975:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734093056 00010000:00010000:0.0:1746129570.346985:0:7087:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012dc1a400/0x40a459093b069ad9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 987136->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20e25 expref: 15 pid: 22480 timeout: 925 lvb_type: 0 00000100:00100000:0.0:1746129570.347007:0:7087:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8240 00000100:00100000:0.0:1746129570.347013:0:7087:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ada2ffba-8920-4ecb-8068-68caa9806978+25:1962:x1830948734092672:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129570.347028:0:7087:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129570.347053:0:7087:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012dc1b200/0x40a459093b069ad2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20e1e expref: 25 pid: 22480 timeout: 925 lvb_type: 0 00010000:00010000:0.0:1746129570.347064:0:7087:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012dc1b200/0x40a459093b069ad2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20e1e expref: 25 pid: 22480 timeout: 925 lvb_type: 0 00010000:00010000:0.0:1746129570.347087:0:7087:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012dc1b200/0x40a459093b069ad2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20e1e expref: 25 pid: 22480 timeout: 925 lvb_type: 0 00010000:00010000:0.0:1746129570.347124:0:7087:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129570.347171:0:7087:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ada2ffba-8920-4ecb-8068-68caa9806978+24:1962:x1830948734092672:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 157us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129570.347177:0:7087:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8240 00000100:00100000:0.0:1746129570.347264:0:7087:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8241 00000100:00100000:0.0:1746129570.347278:0:7087:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baeed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ada2ffba-8920-4ecb-8068-68caa9806978+15:1960:x1830948734093056:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129570.347337:0:7087:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129570.347350:0:7087:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012dc1a400/0x40a459093b069ad9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 987136->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20e25 expref: 15 pid: 22480 timeout: 925 lvb_type: 0 00010000:00010000:0.0:1746129570.347422:0:7087:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012dc1a400/0x40a459093b069ad9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 987136->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20e25 expref: 15 pid: 22480 timeout: 925 lvb_type: 0 00010000:00010000:0.0:1746129570.347442:0:7087:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012dc1a400/0x40a459093b069ad9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 987136->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20e25 expref: 15 pid: 22480 timeout: 925 lvb_type: 0 00010000:00010000:0.0:1746129570.347450:0:7087:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129570.347456:0:7087:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129570.347461:0:7087:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f8d5a00/0x40a459093b069b3b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20e87 expref: 9 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129570.347468:0:7087:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f8d5a00/0x40a459093b069b3b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20e87 expref: 9 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129570.347500:0:7087:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f8d5a00/0x40a459093b069b3b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20e87 expref: 9 pid: 7149 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129570.347502:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129570.347516:0:7087:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012baef100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7087:1830948737501568:192.168.202.4@tcp:105: 00000100:00100000:0.0:1746129570.347575:0:7087:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e29f240 going to sleep for 11 seconds 00000100:00100000:3.0:1746129570.347577:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734093184 00000100:00100000:3.0:1746129570.347581:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734093184 00010000:00010000:3.0:1746129570.347593:0:9823:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009be04400/0x40a459093b069ac4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20e10 expref: 12 pid: 8410 timeout: 925 lvb_type: 0 00000100:00100000:3.0:1746129570.347610:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8242 00000100:00100000:3.0:1746129570.347615:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f46d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+12:1962:x1830948734093184:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129570.347621:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129570.347629:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009be04400/0x40a459093b069ac4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20e10 expref: 12 pid: 8410 timeout: 925 lvb_type: 0 00010000:00010000:3.0:1746129570.347638:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009be04400/0x40a459093b069ac4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20e10 expref: 12 pid: 8410 timeout: 925 lvb_type: 0 00010000:00010000:3.0:1746129570.347650:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009be04400/0x40a459093b069ac4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20e10 expref: 12 pid: 8410 timeout: 925 lvb_type: 0 00010000:00010000:3.0:1746129570.347660:0:9823:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129570.347661:0:9823:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129570.347665:0:9823:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f8d5800/0x40a459093b069b42 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3588096->4050943) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20e8e expref: 11 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129570.347671:0:9823:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f8d5800/0x40a459093b069b42 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3588096->4050943) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20e8e expref: 11 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129570.347688:0:9823:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f8d5800/0x40a459093b069b42 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3588096->4050943) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20e8e expref: 11 pid: 7149 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129570.347695:0:9823:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094f44380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9823:1830948737501696:192.168.202.4@tcp:105: 00000100:00100000:3.0:1746129570.347717:0:9823:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a6ce8cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746129570.348259:0:8416:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734092928 00000100:00100000:2.0:1746129570.348264:0:8416:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734092928 00002000:00100000:2.0:1746129570.348289:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3ef:0x0] (2351104->2355199) req@ffff88012baec380 x1830948734092928/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:311/0 lens 488/0 e 0 to 0 dl 1746129581 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129570.348315:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012baec380 with x1830948734092928 ext(2351104->2355199) 00002000:00010000:2.0:1746129570.348330:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012baec380 00000100:00100000:2.0:1746129570.348356:0:8416:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7748 00000100:00100000:2.0:1746129570.348361:0:8416:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ada2ffba-8920-4ecb-8068-68caa9806978+15:1961:x1830948734092928:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:2.0:1746129570.348505:0:8416:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ada2ffba-8920-4ecb-8068-68caa9806978+15:1961:x1830948734092928:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 143us (1713us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129570.348510:0:8416:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7748 00002000:00100000:2.0:1746129570.348515:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3ef:0x0] (2351104->2355199) req@ffff88012baec380 x1830948734092928/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:311/0 lens 488/4536 e 0 to 0 dl 1746129581 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129570.348522:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012baec380 with x1830948734092928 ext(2351104->2355199) 00002000:00010000:2.0:1746129570.348545:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012baec380 00000100:00100000:3.0:1746129570.349084:0:9823:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094f44380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9823:1830948737501696:192.168.202.4@tcp:105: 00010000:00010000:3.0:1746129570.349098:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129570.349119:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f46d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+11:1962:x1830948734093184:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 1503us (1618us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129570.349125:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8242 00000100:00100000:0.0:1746129570.350841:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129570.350949:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734093312 00000100:00100000:2.0:1746129570.350955:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734093312 00000100:00100000:2.0:1746129570.350986:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16085 00000100:00100000:2.0:1746129570.350993:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013575ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ada2ffba-8920-4ecb-8068-68caa9806978+15:1960:x1830948734093312:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129570.351005:0:7149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129570.351018:0:7149:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ec94600/0x40a459093b069b49 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20e95 expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129570.351036:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129570.351038:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129570.351043:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ec94600/0x40a459093b069b49 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20e95 expref: 16 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129570.351061:0:7149:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ec94600/0x40a459093b069b49 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20e95 expref: 16 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129570.351069:0:7149:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ec94600, rc 0) 00000100:00100000:2.0:1746129570.351099:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013575ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ada2ffba-8920-4ecb-8068-68caa9806978+16:1960:x1830948734093312:12345-192.168.202.4@tcp:101:cat.0 Request processed in 106us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129570.351104:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16085 00000100:00100000:1.0:1746129570.351427:0:7087:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012baef100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7087:1830948737501568:192.168.202.4@tcp:105: 00010000:00010000:1.0:1746129570.351449:0:7087:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129570.351481:0:7087:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baeed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ada2ffba-8920-4ecb-8068-68caa9806978+15:1960:x1830948734093056:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 4211us (4607us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129570.351487:0:7087:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8241 00000100:00100000:0.0:1746129570.354552:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129570.354582:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129570.354649:0:22480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734093440 00000100:00100000:2.0:1746129570.354657:0:22480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734093440 00000100:00100000:2.0:1746129570.354714:0:22480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16086 00000100:00100000:2.0:1746129570.354721:0:22480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013575c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ada2ffba-8920-4ecb-8068-68caa9806978+24:1960:x1830948734093440:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129570.354745:0:22480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129570.354764:0:22480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ec95c00/0x40a459093b069b50 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20e9c expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129570.354822:0:22480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cda7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22480:1830948737501824:192.168.202.4@tcp:106: 00000100:00100000:0.0:1746129570.355500:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129570.355522:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129570.355535:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734093824 00000100:00100000:0.0:1746129570.355538:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734093824 00000100:00100000:0.0:1746129570.355561:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734093952 00000100:00100000:0.0:1746129570.355563:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734093952 00000100:00100000:0.0:1746129570.355575:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16087 00000100:00100000:0.0:1746129570.355580:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013575fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ada2ffba-8920-4ecb-8068-68caa9806978+15:1960:x1830948734093824:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129570.355587:0:7148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746129570.355588:0:8410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16088 00000100:00100000:1.0:1746129570.355595:0:8410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013575ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ada2ffba-8920-4ecb-8068-68caa9806978+26:1960:x1830948734093952:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129570.355595:0:7148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012dc1b200/0x40a459093b069b57 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20ea3 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129570.355602:0:8410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129570.355609:0:8410:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c460600/0x40a459093b069b5e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20eaa expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129570.355619:0:7148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013575d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7148:1830948737501952:192.168.202.4@tcp:106: 00000100:00100000:1.0:1746129570.355636:0:8410:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a77b0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8410:1830948737502080:192.168.202.4@tcp:106: 00000100:00100000:2.0:1746129570.355735:0:22480:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a00f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746129570.355806:0:7148:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e29f240 going to sleep for 11 seconds 00000100:00100000:1.0:1746129570.355819:0:8410:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934d2480 going to sleep for 11 seconds 00002000:00010000:2.0:1746129570.356103:0:22480:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb mtime: 1746129570 -> 1746129571 00002000:00010000:2.0:1746129570.356106:0:22480:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb atime: 1746129570 -> 1746129571 00002000:00010000:2.0:1746129570.356107:0:22480:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb ctime: 1746129570 -> 1746129571 00000100:00100000:2.0:1746129570.356122:0:22480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cda7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22480:1830948737501824:192.168.202.4@tcp:106: 00000100:00100000:3.0:1746129570.356288:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734093696 00000100:00100000:3.0:1746129570.356328:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734093696 00010000:00010000:2.0:1746129570.356392:0:22480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012ec95c00/0x40a459093b069b50 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20e9c expref: 27 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129570.356407:0:22480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ec95c00/0x40a459093b069b50 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20e9c expref: 27 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129570.356423:0:22480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ec95c00, rc 0) 00000100:00100000:2.0:1746129570.356452:0:22480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013575c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ada2ffba-8920-4ecb-8068-68caa9806978+26:1960:x1830948734093440:12345-192.168.202.4@tcp:101:cat.0 Request processed in 1731us (1869us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129570.356457:0:22480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16086 00002000:00100000:3.0:1746129570.356581:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f5:0x0] (3588096->3592191) req@ffff88013575c380 x1830948734093696/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:311/0 lens 488/0 e 0 to 0 dl 1746129581 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129570.356595:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013575c380 with x1830948734093696 ext(3588096->3592191) 00002000:00010000:3.0:1746129570.356598:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013575c380 00000100:00100000:3.0:1746129570.356612:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7749 00000100:00100000:3.0:1746129570.356623:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013575c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+11:1963:x1830948734093696:12345-192.168.202.4@tcp:3:multiop.0 00002000:00010000:1.0:1746129570.357076:0:8410:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3f5:0x0] updating lvb mtime: 1746129570 -> 1746129571 00002000:00010000:1.0:1746129570.357079:0:8410:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3f5:0x0] updating lvb atime: 1746129568 -> 1746129571 00002000:00010000:1.0:1746129570.357081:0:8410:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3f5:0x0] updating lvb ctime: 1746129570 -> 1746129571 00000100:00100000:1.0:1746129570.357088:0:8410:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a77b0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8410:1830948737502080:192.168.202.4@tcp:106: 00010000:00010000:1.0:1746129570.357104:0:8410:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c460600/0x40a459093b069b5e lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20eaa expref: 25 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129570.357112:0:8410:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c460600/0x40a459093b069b5e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20eaa expref: 25 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129570.357121:0:8410:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c460600, rc 0) 00000100:00100000:1.0:1746129570.357139:0:8410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013575ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ada2ffba-8920-4ecb-8068-68caa9806978+24:1960:x1830948734093952:12345-192.168.202.4@tcp:101:cat.0 Request processed in 1545us (1616us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129570.357144:0:8410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16088 00002000:00010000:1.0:1746129570.357166:0:7148:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb mtime: 1746129570 -> 1746129571 00002000:00010000:1.0:1746129570.357168:0:7148:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb atime: 1746129570 -> 1746129571 00002000:00010000:1.0:1746129570.357170:0:7148:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb ctime: 1746129570 -> 1746129571 00000100:00100000:1.0:1746129570.357180:0:7148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013575d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7148:1830948737501952:192.168.202.4@tcp:106: 00010000:00010000:1.0:1746129570.357193:0:7148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012dc1b200/0x40a459093b069b57 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20ea3 expref: 16 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129570.357200:0:7148:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012dc1b200/0x40a459093b069b57 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20ea3 expref: 16 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129570.357208:0:7148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dc1b200, rc 0) 00000100:00100000:1.0:1746129570.357220:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013575fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ada2ffba-8920-4ecb-8068-68caa9806978+15:1960:x1830948734093824:12345-192.168.202.4@tcp:101:cat.0 Request processed in 1641us (1721us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129570.357224:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16087 00000100:00100000:3.0:1746129570.358850:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013575c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+11:1963:x1830948734093696:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 2223us (4294us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129570.358861:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7749 00002000:00100000:3.0:1746129570.358872:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f5:0x0] (3588096->3592191) req@ffff88013575c380 x1830948734093696/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:311/0 lens 488/4536 e 0 to 0 dl 1746129581 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129570.358880:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013575c380 with x1830948734093696 ext(3588096->3592191) 00002000:00010000:3.0:1746129570.358885:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013575c380 00000100:00100000:0.0:1746129570.358902:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129570.358920:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734094208 00000100:00100000:3.0:1746129570.358924:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734094208 00002000:00100000:3.0:1746129570.358947:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ec:0x0] (0->1048575) req@ffff88013575f100 x1830948734094208/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:311/0 lens 488/0 e 0 to 0 dl 1746129581 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129570.358954:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013575f100 with x1830948734094208 ext(0->1048575) 00002000:00010000:3.0:1746129570.358957:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013575f100 00000100:00100000:3.0:1746129570.358982:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7750 00000100:00100000:3.0:1746129570.358987:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013575f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+10:1961:x1830948734094208:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:0.0:1746129570.363943:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129570.364031:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129570.364173:0:8416:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734094592 00000100:00100000:2.0:1746129570.364181:0:8416:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734094592 00002000:00100000:2.0:1746129570.364217:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3f3:0x0] (1523712->2097151) req@ffff88013575f800 x1830948734094592/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:311/0 lens 488/0 e 0 to 0 dl 1746129581 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129570.364225:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013575f800 with x1830948734094592 ext(1523712->2097151) 00002000:00010000:2.0:1746129570.364230:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013575f800 00000100:00100000:2.0:1746129570.364243:0:8416:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734094720 00000100:00100000:2.0:1746129570.364245:0:8416:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734094720 00002000:00100000:2.0:1746129570.364254:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3ec:0x0] (0->1048575) req@ffff88013575df80 x1830948734094720/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:311/0 lens 488/0 e 0 to 0 dl 1746129581 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129570.364259:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013575df80 with x1830948734094720 ext(0->1048575) 00002000:00010000:2.0:1746129570.364261:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013575df80 00000100:00100000:2.0:1746129570.364286:0:8416:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7751 00000100:00100000:2.0:1746129570.364303:0:8416:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013575f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ada2ffba-8920-4ecb-8068-68caa9806978+24:1963:x1830948734094592:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:1.0:1746129570.364328:0:21725:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7752 00000100:00100000:1.0:1746129570.364336:0:21725:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013575df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ada2ffba-8920-4ecb-8068-68caa9806978+15:1963:x1830948734094720:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:2.0:1746129570.374955:0:8416:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013575f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ada2ffba-8920-4ecb-8068-68caa9806978+24:1963:x1830948734094592:12345-192.168.202.4@tcp:3:cat.0 Request processed in 10652us (11006us total) trans 0 rc 573440/573440 00000100:00100000:2.0:1746129570.374967:0:8416:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7751 00002000:00100000:2.0:1746129570.374978:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3f3:0x0] (1523712->2097151) req@ffff88013575f800 x1830948734094592/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:311/0 lens 488/440 e 0 to 0 dl 1746129581 ref 1 fl Complete:/200/0 rc 573440/573440 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129570.374986:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013575f800 with x1830948734094592 ext(1523712->2097151) 00002000:00010000:2.0:1746129570.374991:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013575f800 00000100:00100000:0.0:1746129570.384909:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129570.386033:0:8416:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734094976 00000100:00100000:2.0:1746129570.386041:0:8416:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734094976 00002000:00100000:2.0:1746129570.386075:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3f5:0x0] (4046848->4050943) req@ffff88013575e300 x1830948734094976/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:311/0 lens 488/0 e 0 to 0 dl 1746129581 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129570.386083:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013575e300 with x1830948734094976 ext(4046848->4050943) 00002000:00010000:2.0:1746129570.386087:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013575e300 00000100:00100000:2.0:1746129570.386118:0:8416:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7753 00000100:00100000:2.0:1746129570.386125:0:8416:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013575e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+11:1963:x1830948734094976:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:2.0:1746129570.386275:0:8416:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013575e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+11:1963:x1830948734094976:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 149us (1373us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129570.386280:0:8416:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7753 00002000:00100000:2.0:1746129570.386285:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3f5:0x0] (4046848->4050943) req@ffff88013575e300 x1830948734094976/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:311/0 lens 488/4536 e 0 to 0 dl 1746129581 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129570.386290:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013575e300 with x1830948734094976 ext(4046848->4050943) 00002000:00010000:2.0:1746129570.386325:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013575e300 00000100:00100000:1.0:1746129570.399377:0:21725:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013575df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ada2ffba-8920-4ecb-8068-68caa9806978+15:1963:x1830948734094720:12345-192.168.202.4@tcp:3:cat.0 Request processed in 35033us (35337us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129570.399386:0:21725:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7752 00002000:00100000:1.0:1746129570.399396:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ec:0x0] (0->1048575) req@ffff88013575df80 x1830948734094720/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:311/0 lens 488/440 e 0 to 0 dl 1746129581 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129570.399404:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013575df80 with x1830948734094720 ext(0->1048575) 00002000:00010000:1.0:1746129570.399409:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013575df80 00000100:00100000:2.0:1746129570.405556:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013575f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+10:1961:x1830948734094208:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 46561us (46647us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129570.405566:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7750 00002000:00100000:2.0:1746129570.405577:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ec:0x0] (0->1048575) req@ffff88013575f100 x1830948734094208/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:311/0 lens 488/440 e 0 to 0 dl 1746129581 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129570.405591:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013575f100 with x1830948734094208 ext(0->1048575) 00002000:00010000:2.0:1746129570.405596:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013575f100 00000100:00100000:0.0:1746129570.411965:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129570.412031:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734095104 00000100:00100000:1.0:1746129570.412038:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734095104 00000100:00100000:0.0:1746129570.412054:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129570.412091:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734095232 00000100:00100000:1.0:1746129570.412093:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734095232 00000100:00100000:1.0:1746129570.412110:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16089 00000100:00100000:1.0:1746129570.412116:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013575d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ada2ffba-8920-4ecb-8068-68caa9806978+24:32276:x1830948734095104:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129570.412130:0:7148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129570.412143:0:7148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c460400/0x40a459093b069b65 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20eb1 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129570.412164:0:7148:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a6ef4200/0x40a459093b069ab6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1855488->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20e02 expref: 11 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129570.412171:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129570.412173:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129570.412176:0:7148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c460400/0x40a459093b069b65 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20eb1 expref: 25 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129570.412197:0:7148:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a6ef4200/0x40a459093b069ab6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1855488->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20e02 expref: 11 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129570.412206:0:7148:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a6ef4200/0x40a459093b069ab6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1855488->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20e02 expref: 11 pid: 8410 timeout: 925 lvb_type: 0 00000100:00100000:1.0:1746129570.412215:0:7148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a77b0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:7148:1830948737502208:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129570.412280:0:7148:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934d2480 going to sleep for 11 seconds 00000100:00100000:2.0:1746129570.412348:0:8410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16090 00000100:00100000:2.0:1746129570.412354:0:8410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e954a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+11:32273:x1830948734095232:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129570.412360:0:8410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129570.412367:0:8410:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095b5f400/0x40a459093b069b6c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20eb8 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129570.412379:0:8410:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ec95200/0x40a459093b069afc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1523711) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20e48 expref: 25 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129570.412384:0:8410:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129570.412385:0:8410:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129570.412388:0:8410:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095b5f400/0x40a459093b069b6c lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20eb8 expref: 12 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129570.412400:0:8410:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012ec95200/0x40a459093b069afc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1523711) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20e48 expref: 25 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129570.412411:0:8410:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012ec95200/0x40a459093b069afc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1523711) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20e48 expref: 25 pid: 8412 timeout: 925 lvb_type: 0 00000100:00100000:2.0:1746129570.412418:0:8410:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cda7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8410:1830948737502336:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129570.412447:0:8410:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a000c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746129570.417306:0:7148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a77b0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:7148:1830948737502208:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129570.417358:0:7148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c460400/0x40a459093b069b65 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20eb1 expref: 25 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129570.417375:0:7148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c460400, rc 0) 00000100:00100000:0.0:1746129570.417885:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129570.418078:0:8410:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cda7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8410:1830948737502336:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129570.418092:0:8410:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095b5f400/0x40a459093b069b6c lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20eb8 expref: 12 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129570.418101:0:8410:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095b5f400, rc 0) 00000100:00100000:2.0:1746129570.418128:0:8410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e954a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+12:32273:x1830948734095232:12345-192.168.202.4@tcp:101:cat.0 Request processed in 5774us (6074us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129570.418136:0:8410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16090 00000100:00100000:1.0:1746129570.418219:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013575d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ada2ffba-8920-4ecb-8068-68caa9806978+25:32276:x1830948734095104:12345-192.168.202.4@tcp:101:cat.0 Request processed in 6101us (6260us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129570.418225:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16089 00000100:00100000:0.0:1746129570.418431:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129570.418471:0:21725:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734095360 00000100:00100000:1.0:1746129570.418476:0:21725:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734095360 00002000:00100000:1.0:1746129570.418505:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f4:0x0] (1855488->2097151) req@ffff88012e956680 x1830948734095360/t0(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:311/0 lens 488/0 e 0 to 0 dl 1746129581 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129570.418518:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e956680 with x1830948734095360 ext(1855488->2097151) 00010000:00010000:1.0:1746129570.418524:0:21725:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a6ef4200/0x40a459093b069ab6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1855488->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20e02 expref: 12 pid: 8410 timeout: 925 lvb_type: 0 00000100:00100000:3.0:1746129570.418527:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734095488 00000100:00100000:3.0:1746129570.418531:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734095488 00010000:00010000:1.0:1746129570.418534:0:21725:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a6ef4200/0x40a459093b069ab6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1855488->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20e02 expref: 12 pid: 8410 timeout: 925 lvb_type: 0 00002000:00010000:1.0:1746129570.418540:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012e956680 00002000:00100000:3.0:1746129570.418548:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->1523711) req@ffff88012e956300 x1830948734095488/t0(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:311/0 lens 488/0 e 0 to 0 dl 1746129581 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129570.418555:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e956300 with x1830948734095488 ext(1048576->1523711) 00000100:00100000:1.0:1746129570.418567:0:21725:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2412 00000100:00100000:1.0:1746129570.418572:0:21725:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e956680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+12:1962:x1830948734095360:12345-192.168.202.4@tcp:4:multiop.0 00010000:00010000:3.0:1746129570.418772:0:25745:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012ec95200/0x40a459093b069afc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1523711) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20e48 expref: 25 pid: 8412 timeout: 925 lvb_type: 0 00010000:00010000:3.0:1746129570.418781:0:25745:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012ec95200/0x40a459093b069afc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1523711) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20e48 expref: 25 pid: 8412 timeout: 925 lvb_type: 0 00002000:00010000:3.0:1746129570.418791:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012e956300 00000100:00100000:3.0:1746129570.418811:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2413 00000100:00100000:3.0:1746129570.418820:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e956300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+25:1963:x1830948734095488:12345-192.168.202.4@tcp:4:cat.0 00000100:00100000:1.0:1746129570.426271:0:21725:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e956680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+14:1962:x1830948734095360:12345-192.168.202.4@tcp:4:multiop.0 Request processed in 7691us (8380us total) trans 17179874089 rc 0/0 00000100:00100000:1.0:1746129570.426282:0:21725:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2412 00002000:00100000:1.0:1746129570.426311:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f4:0x0] (1855488->2097151) req@ffff88012e956680 x1830948734095360/t17179874089(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:311/0 lens 488/448 e 0 to 0 dl 1746129581 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129570.426332:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e956680 with x1830948734095360 ext(1855488->2097151) 00010000:00010000:1.0:1746129570.426341:0:21725:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a6ef4200/0x40a459093b069ab6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1855488->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20e02 expref: 14 pid: 8410 timeout: 925 lvb_type: 0 00010000:00010000:1.0:1746129570.426352:0:21725:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a6ef4200/0x40a459093b069ab6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1855488->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20e02 expref: 14 pid: 8410 timeout: 925 lvb_type: 0 00002000:00010000:1.0:1746129570.426358:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012e956680 00000100:00100000:0.0:1746129570.431084:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129570.432192:0:2271:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734095616 00000100:00100000:3.0:1746129570.432200:0:2271:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734095616 00000100:00100000:3.0:1746129570.432256:0:2271:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11200 00000100:00100000:3.0:1746129570.432264:0:2271:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e954000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:068dab75-d300-4ead-a742-d14572ad1e50+16:32279:x1830948734095616:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:3.0:1746129570.432281:0:2271:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:0.0:1746129570.432281:0:7097:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1746129570.432311:0:2271:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba1b200/0x40a459093b069b73 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20ebf expref: -99 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129570.432372:0:2271:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1c1800/0x40a459093b069b7a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129570.432383:0:2271:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1c1800/0x40a459093b069b7a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129570.432391:0:2271:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1c1800/0x40a459093b069b7a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129570.432402:0:2271:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1c0400/0x40a459093b069b81 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129570.432407:0:2271:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1c0400/0x40a459093b069b81 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129570.432411:0:2271:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1c0400/0x40a459093b069b81 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129570.432618:0:2271:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1c1200/0x40a459093b069b88 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129570.432628:0:2271:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800946f1800/0x40a459093b069a31 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20d92 expref: 310 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129570.432634:0:2271:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095045a00/0x40a459093b069aa8 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20dfb expref: 25 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129570.432639:0:2271:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1c1200/0x40a459093b069b88 lrc: 5/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129570.432667:0:2271:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880095045a00/0x40a459093b069aa8 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20dfb expref: 25 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129570.432676:0:2271:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880095045a00/0x40a459093b069aa8 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20dfb expref: 25 pid: 2271 timeout: 925 lvb_type: 0 00000100:00100000:3.0:1746129570.433447:0:2271:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094f44380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:2271:1830948737502464:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129570.433527:0:2271:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800946f1800/0x40a459093b069a31 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20d92 expref: 310 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129570.433533:0:2271:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800946f1800/0x40a459093b069a31 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20d92 expref: 310 pid: 14549 timeout: 925 lvb_type: 0 00000100:00100000:3.0:1746129570.433539:0:2271:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094f46300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:2271:1830948737502592:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129570.433555:0:2271:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a6ce8300 going to sleep for 11 seconds 00000100:00100000:2.0:1746129570.434503:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e956300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+27:1963:x1830948734095488:12345-192.168.202.4@tcp:4:cat.0 Request processed in 15683us (16069us total) trans 17179874090 rc 0/0 00000100:00100000:2.0:1746129570.434512:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2413 00002000:00100000:2.0:1746129570.434521:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->1523711) req@ffff88012e956300 x1830948734095488/t17179874090(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:311/0 lens 488/448 e 0 to 0 dl 1746129581 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129570.434530:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e956300 with x1830948734095488 ext(1048576->1523711) 00010000:00010000:2.0:1746129570.434537:0:25745:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012ec95200/0x40a459093b069afc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1523711) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20e48 expref: 27 pid: 8412 timeout: 925 lvb_type: 0 00010000:00010000:2.0:1746129570.434547:0:25745:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012ec95200/0x40a459093b069afc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1523711) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20e48 expref: 27 pid: 8412 timeout: 925 lvb_type: 0 00002000:00010000:2.0:1746129570.434553:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012e956300 00000100:00100000:0.0:1746129570.436743:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129570.439578:0:2271:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094f44380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:2271:1830948737502464:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129570.439591:0:2271:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094f46300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:2271:1830948737502592:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129570.439612:0:2271:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1c1200/0x40a459093b069b88 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00000100:00100000:0.0:1746129570.440917:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129570.440951:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129570.440991:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129570.441025:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734095744 00000100:00100000:1.0:1746129570.441032:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734095744 00000100:00100000:1.0:1746129570.441047:0:16680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734096000 00000100:00100000:1.0:1746129570.441049:0:16680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734096000 00000100:00100000:1.0:1746129570.441098:0:16680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734096256 00000100:00100000:1.0:1746129570.441101:0:16680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734096256 00000100:00100000:1.0:1746129570.441116:0:16680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4748 00000100:00100000:1.0:1746129570.441122:0:16680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092fd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+26:27233:x1830948734096000:12345-192.168.202.4@tcp:35:ldlm_bl.0 00000001:00080000:1.0:1746129570.441417:0:16680:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589945292 00000100:00100000:1.0:1746129570.441486:0:16680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092fd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+28:27233:x1830948734096000:12345-192.168.202.4@tcp:35:ldlm_bl.0 Request processed in 363us (572us total) trans 8589945293 rc 0/0 00000100:00100000:1.0:1746129570.441493:0:16680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4748 00000020:00080000:1.0:1746129570.441496:0:16680:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1746129570.441507:0:16680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4749 00000100:00100000:1.0:1746129570.441512:0:16680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092fd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ada2ffba-8920-4ecb-8068-68caa9806978+311:23750:x1830948734096256:12345-192.168.202.4@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746129570.441570:0:16680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092fd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ada2ffba-8920-4ecb-8068-68caa9806978+312:23750:x1830948734096256:12345-192.168.202.4@tcp:35:ldlm_bl.0 Request processed in 57us (618us total) trans 8589945294 rc 0/0 00000100:00100000:1.0:1746129570.441576:0:16680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4749 00010000:00010000:1.0:1746129570.441598:0:7087:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6ef4200/0x40a459093b069ab6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1855488->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20e02 expref: 14 pid: 8410 timeout: 925 lvb_type: 0 00000100:00100000:1.0:1746129570.441618:0:7087:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8243 00000100:00100000:1.0:1746129570.441623:0:7087:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e957b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+14:1960:x1830948734095744:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129570.441630:0:7087:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129570.441647:0:7087:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a6ef4200/0x40a459093b069ab6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1855488->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20e02 expref: 14 pid: 8410 timeout: 925 lvb_type: 0 00010000:00010000:1.0:1746129570.441660:0:7087:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a6ef4200/0x40a459093b069ab6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1855488->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20e02 expref: 14 pid: 8410 timeout: 925 lvb_type: 0 00010000:00010000:1.0:1746129570.441684:0:7087:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a6ef4200/0x40a459093b069ab6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1855488->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20e02 expref: 14 pid: 8410 timeout: 925 lvb_type: 0 00010000:00010000:1.0:1746129570.441696:0:7087:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129570.441698:0:7087:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129570.441704:0:7087:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c460400/0x40a459093b069b65 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20eb1 expref: 26 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129570.441711:0:7087:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c460400/0x40a459093b069b65 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20eb1 expref: 26 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129570.441735:0:7087:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009c460400/0x40a459093b069b65 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20eb1 expref: 26 pid: 7148 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129570.441746:0:7087:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a77b0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7087:1830948737502720:192.168.202.4@tcp:105: 00000100:00100000:1.0:1746129570.441792:0:7087:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934d2480 going to sleep for 11 seconds 00000100:00080000:2.0:1746129570.442061:0:7097:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746129570.442653:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734096384 00000100:00100000:2.0:1746129570.442658:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734096384 00010000:00010000:2.0:1746129570.442675:0:9823:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012ec95200/0x40a459093b069afc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1523711) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20e48 expref: 27 pid: 8412 timeout: 925 lvb_type: 0 00000100:00100000:2.0:1746129570.442695:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8244 00000100:00100000:2.0:1746129570.442700:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092fd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ada2ffba-8920-4ecb-8068-68caa9806978+27:1963:x1830948734096384:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129570.442708:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746129570.442716:0:9823:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb mtime from disk: 1746129570 -> 1746129571 00002000:00010000:2.0:1746129570.442718:0:9823:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb atime from disk: 1746129570 -> 1746129571 00010000:00010000:2.0:1746129570.442721:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012ec95200/0x40a459093b069afc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1523711) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20e48 expref: 27 pid: 8412 timeout: 925 lvb_type: 0 00010000:00010000:2.0:1746129570.442729:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012ec95200/0x40a459093b069afc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1523711) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20e48 expref: 27 pid: 8412 timeout: 925 lvb_type: 0 00010000:00010000:2.0:1746129570.442740:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ec95200/0x40a459093b069afc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1523711) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20e48 expref: 27 pid: 8412 timeout: 925 lvb_type: 0 00010000:00010000:2.0:1746129570.442753:0:9823:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129570.442754:0:9823:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129570.442758:0:9823:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880095b5f400/0x40a459093b069b6c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20eb8 expref: 13 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129570.442764:0:9823:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095b5f400/0x40a459093b069b6c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20eb8 expref: 13 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129570.442783:0:9823:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880095b5f400/0x40a459093b069b6c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20eb8 expref: 13 pid: 8410 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129570.442793:0:9823:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cda7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9823:1830948737502848:192.168.202.4@tcp:105: 00000100:00100000:2.0:1746129570.444176:0:9823:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a000c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746129570.448482:0:7087:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a77b0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7087:1830948737502720:192.168.202.4@tcp:105: 00010000:00010000:2.0:1746129570.448502:0:7087:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129570.448550:0:7087:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e957b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+13:1960:x1830948734095744:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 6926us (11811us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129570.448560:0:7087:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8243 00000100:00100000:0.0:1746129570.448889:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129570.448977:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129570.448992:0:7086:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734096512 00000100:00100000:0.0:1746129570.448998:0:7086:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734096512 00010000:00010000:0.0:1746129570.449019:0:7086:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095045a00/0x40a459093b069aa8 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20dfb expref: 28 pid: 2271 timeout: 925 lvb_type: 0 00000100:00100000:0.0:1746129570.449036:0:7086:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734096640 00000100:00100000:0.0:1746129570.449038:0:7086:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734096640 00010000:00010000:0.0:1746129570.449046:0:7086:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800946f1800/0x40a459093b069a31 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20d92 expref: 312 pid: 14549 timeout: 925 lvb_type: 0 00000100:00100000:0.0:1746129570.449058:0:7086:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8245 00000100:00100000:0.0:1746129570.449064:0:7086:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092fd1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+28:1963:x1830948734096512:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129570.449073:0:7086:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129570.449077:0:7086:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880095045a00/0x40a459093b069aa8 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20dfb expref: 28 pid: 2271 timeout: 925 lvb_type: 0 00010000:00010000:0.0:1746129570.449087:0:7086:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880095045a00/0x40a459093b069aa8 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20dfb expref: 28 pid: 2271 timeout: 925 lvb_type: 0 00010000:00010000:0.0:1746129570.449104:0:7086:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095045a00/0x40a459093b069aa8 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20dfb expref: 28 pid: 2271 timeout: 925 lvb_type: 0 00010000:00010000:0.0:1746129570.449119:0:7086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:0.0:1746129570.449123:0:7086:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1c1200/0x40a459093b069b88 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129570.449131:0:7086:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1c1200/0x40a459093b069b88 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129570.449136:0:7086:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1c1200/0x40a459093b069b88 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129570.449141:0:7086:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129570.449159:0:7086:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092fd1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+27:1963:x1830948734096512:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 95us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129570.449164:0:7086:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8245 00000100:00100000:0.0:1746129570.449176:0:7086:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8246 00000100:00100000:0.0:1746129570.449180:0:7086:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6ce2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ada2ffba-8920-4ecb-8068-68caa9806978+312:1960:x1830948734096640:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129570.449186:0:7086:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129570.449189:0:7086:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800946f1800/0x40a459093b069a31 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20d92 expref: 312 pid: 14549 timeout: 925 lvb_type: 0 00010000:00010000:0.0:1746129570.449197:0:7086:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800946f1800/0x40a459093b069a31 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20d92 expref: 312 pid: 14549 timeout: 925 lvb_type: 0 00010000:00010000:0.0:1746129570.449207:0:7086:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800946f1800/0x40a459093b069a31 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20d92 expref: 312 pid: 14549 timeout: 925 lvb_type: 0 00010000:00010000:0.0:1746129570.449214:0:7086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:0.0:1746129570.449218:0:7086:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1c1200/0x40a459093b069b88 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129570.449224:0:7086:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1c1200/0x40a459093b069b88 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129570.449230:0:7086:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1c1200/0x40a459093b069b88 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129570.449244:0:7086:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129570.449258:0:7086:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6ce2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ada2ffba-8920-4ecb-8068-68caa9806978+311:1960:x1830948734096640:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 77us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129570.449263:0:7086:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8246 00010000:00010000:3.0:1746129570.449425:0:2271:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1c1200/0x40a459093b069b88 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129570.449432:0:2271:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1c1200/0x40a459093b069b88 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00000004:00200000:3.0:1746129570.449466:0:2271:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00000004:00200000:3.0:1746129570.449470:0:2271:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746129570.449482:0:2271:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1c1200/0x40a459093b069b88 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129570.449491:0:2271:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1c1200/0x40a459093b069b88 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129570.449498:0:2271:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1c1800/0x40a459093b069b7a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129570.449504:0:2271:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1c1800/0x40a459093b069b7a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129570.449509:0:2271:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1c1800/0x40a459093b069b7a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129570.449515:0:2271:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e1c1800 already unused, calling callback (ffffffffa136e690) 00010000:00010000:3.0:1746129570.449518:0:2271:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1c1800/0x40a459093b069b7a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129570.449524:0:2271:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1c1800/0x40a459093b069b7a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129570.449534:0:2271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880132ef8f00) 00010000:00010000:3.0:1746129570.449536:0:2271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129570.449539:0:2271:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1c1800/0x40a459093b069b7a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129570.449543:0:2271:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1c1800/0x40a459093b069b7a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129570.449556:0:2271:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1c0400/0x40a459093b069b81 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129570.449561:0:2271:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1c0400/0x40a459093b069b81 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129570.449565:0:2271:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1c0400/0x40a459093b069b81 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129570.449569:0:2271:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e1c0400 already unused, calling callback (ffffffffa136e690) 00010000:00010000:3.0:1746129570.449571:0:2271:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1c0400/0x40a459093b069b81 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129570.449576:0:2271:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1c0400/0x40a459093b069b81 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129570.449582:0:2271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f9ba600) 00010000:00010000:3.0:1746129570.449584:0:2271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129570.449586:0:2271:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1c0400/0x40a459093b069b81 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129570.449591:0:2271:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1c0400/0x40a459093b069b81 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129570.449616:0:2271:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba1b200/0x40a459093b069b73 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20ebf expref: 18 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129570.449626:0:2271:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1c1200/0x40a459093b069b88 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20ebf expref: 17 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129570.449632:0:2271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:3.0:1746129570.449634:0:2271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746129570.449649:0:2271:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e1c1200, rc 0) 00000100:00100000:3.0:1746129570.449683:0:2271:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e954000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:068dab75-d300-4ead-a742-d14572ad1e50+17:32279:x1830948734095616:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 17420us (18605us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129570.449689:0:2271:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11200 00000100:00100000:3.0:1746129570.449737:0:9823:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cda7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9823:1830948737502848:192.168.202.4@tcp:105: 00010000:00010000:3.0:1746129570.449750:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129570.449767:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092fd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ada2ffba-8920-4ecb-8068-68caa9806978+26:1963:x1830948734096384:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 7067us (8776us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129570.449773:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8244 00000100:00100000:0.0:1746129570.452256:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129570.452775:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129570.453442:0:21725:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734096896 00000100:00100000:1.0:1746129570.453449:0:21725:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734096896 00002000:00100000:1.0:1746129570.453484:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f4:0x0] (1048576->2097151) req@ffff880092fd0e00 x1830948734096896/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:311/0 lens 488/0 e 0 to 0 dl 1746129581 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129570.453493:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092fd0e00 with x1830948734096896 ext(1048576->2097151) 00002000:00010000:1.0:1746129570.453497:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092fd0e00 00000100:00100000:1.0:1746129570.453524:0:21725:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734097152 00000100:00100000:1.0:1746129570.453526:0:21725:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734097152 00002000:00100000:1.0:1746129570.453537:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff880092fd0000 x1830948734097152/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:311/0 lens 488/0 e 0 to 0 dl 1746129581 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129570.453544:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092fd0000 with x1830948734097152 ext(1048576->2097151) 00002000:00010000:1.0:1746129570.453546:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092fd0000 00000100:00100000:1.0:1746129570.453557:0:21725:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7754 00000100:00100000:1.0:1746129570.453563:0:21725:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092fd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ada2ffba-8920-4ecb-8068-68caa9806978+26:1963:x1830948734096896:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:3.0:1746129570.457910:0:31521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7755 00000100:00100000:3.0:1746129570.457925:0:31521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092fd0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+13:1963:x1830948734097152:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:0.0:1746129570.459397:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129570.460129:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129570.460976:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129570.460993:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129570.461013:0:8412:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734097280 00000100:00100000:0.0:1746129570.461019:0:8412:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734097280 00000100:00100000:0.0:1746129570.461051:0:8412:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734097408 00000100:00100000:0.0:1746129570.461053:0:8412:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734097408 00000100:00100000:0.0:1746129570.470345:0:8412:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734097536 00000100:00100000:0.0:1746129570.470356:0:8412:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734097536 00000100:00100000:1.0:1746129570.470514:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734097664 00000100:00100000:1.0:1746129570.470518:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734097664 00000100:00100000:1.0:1746129570.470545:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16091 00000100:00100000:1.0:1746129570.470552:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092fd3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:068dab75-d300-4ead-a742-d14572ad1e50+6:1960:x1830948734097280:12345-192.168.202.4@tcp:101:lfs.0 00000100:00100000:2.0:1746129570.470555:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16092 00000100:00100000:2.0:1746129570.470564:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092fd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:068dab75-d300-4ead-a742-d14572ad1e50+6:1961:x1830948734097408:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:1.0:1746129570.470567:0:7149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129570.470572:0:4385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129570.470581:0:4385:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095cb8a00/0x40a459093b069b96 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20ecd expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129570.470581:0:7149:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c460000/0x40a459093b069b8f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20ec6 expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129570.470598:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129570.470598:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129570.470600:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129570.470600:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129570.470606:0:4385:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095cb8a00/0x40a459093b069b96 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20ecd expref: 7 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129570.470606:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c460000/0x40a459093b069b8f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20ec6 expref: 7 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129570.470617:0:4385:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095cb8a00/0x40a459093b069b96 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20ecd expref: 7 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129570.470617:0:7149:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c460000/0x40a459093b069b8f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20ec6 expref: 7 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129570.470626:0:4385:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095cb8a00, rc 0) 00010000:00010000:1.0:1746129570.470626:0:7149:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c460000, rc 0) 00000100:00100000:1.0:1746129570.470668:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092fd3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:068dab75-d300-4ead-a742-d14572ad1e50+7:1960:x1830948734097280:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 116us (11274us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129570.470669:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092fd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:068dab75-d300-4ead-a742-d14572ad1e50+7:1961:x1830948734097408:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 106us (10539us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129570.470676:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16091 00000100:00100000:2.0:1746129570.470679:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16092 00000100:00100000:1.0:1746129570.470688:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16093 00000100:00100000:2.0:1746129570.470692:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16094 00000100:00100000:1.0:1746129570.470692:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092fd1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:068dab75-d300-4ead-a742-d14572ad1e50+6:1961:x1830948734097536:12345-192.168.202.4@tcp:101:lfs.0 00000100:00100000:2.0:1746129570.470697:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092fd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:068dab75-d300-4ead-a742-d14572ad1e50+6:1961:x1830948734097664:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:1.0:1746129570.470697:0:7149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129570.470702:0:7149:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c460600/0x40a459093b069b9d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20ed4 expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129570.470703:0:4385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129570.470709:0:4385:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095cb9800/0x40a459093b069ba4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20edb expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129570.470711:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129570.470712:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129570.470715:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c460600/0x40a459093b069b9d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20ed4 expref: 7 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129570.470722:0:7149:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c460600/0x40a459093b069b9d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20ed4 expref: 7 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129570.470728:0:7149:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c460600, rc 0) 00000100:00100000:1.0:1746129570.470739:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092fd1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:068dab75-d300-4ead-a742-d14572ad1e50+7:1961:x1830948734097536:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 47us (9766us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129570.470740:0:4385:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cda6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:4385:1830948737502976:192.168.202.4@tcp:106: 00000100:00100000:1.0:1746129570.470743:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16093 00010000:00010000:2.0:1746129570.470785:0:26224:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1746129570.470812:0:4385:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a00e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746129570.470816:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129570.470839:0:11014:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734097792 00000100:00100000:2.0:1746129570.470842:0:11014:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734097792 00000100:00100000:1.0:1746129570.470851:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129570.470864:0:11014:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734097920 00000100:00100000:2.0:1746129570.470866:0:11014:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734097920 00000100:00100000:1.0:1746129570.470871:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16095 00000100:00100000:1.0:1746129570.470876:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a77b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:068dab75-d300-4ead-a742-d14572ad1e50+8:1961:x1830948734097792:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:1.0:1746129570.470881:0:7148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746129570.470882:0:11014:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16096 00000100:00100000:2.0:1746129570.470885:0:11014:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a77b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:068dab75-d300-4ead-a742-d14572ad1e50+7:1961:x1830948734097920:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:1.0:1746129570.470887:0:7148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094c35600/0x40a459093b069bab lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20ee2 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129570.470891:0:11014:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129570.470897:0:11014:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009584f600/0x40a459093b069bb2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20ee9 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129570.470910:0:7148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a77b2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7148:1830948737503104:192.168.202.4@tcp:106: 00000100:00100000:2.0:1746129570.470919:0:11014:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cda6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11014:1830948737503232:192.168.202.4@tcp:106: 00000100:00100000:1.0:1746129570.470925:0:7148:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934d2a80 going to sleep for 11 seconds 00000100:00100000:2.0:1746129570.470938:0:11014:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a00a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746129570.471349:0:21725:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092fd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ada2ffba-8920-4ecb-8068-68caa9806978+26:1963:x1830948734096896:12345-192.168.202.4@tcp:3:cat.0 Request processed in 17785us (19100us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129570.471356:0:21725:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7754 00002000:00100000:1.0:1746129570.471363:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f4:0x0] (1048576->2097151) req@ffff880092fd0e00 x1830948734096896/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:311/0 lens 488/440 e 0 to 0 dl 1746129581 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129570.471371:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092fd0e00 with x1830948734096896 ext(1048576->2097151) 00002000:00010000:1.0:1746129570.471374:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092fd0e00 00002000:00010000:2.0:1746129570.476250:0:7148:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb mtime: 1746129570 -> 1746129571 00002000:00010000:2.0:1746129570.476256:0:7148:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb atime: 1746129570 -> 1746129571 00002000:00010000:2.0:1746129570.476258:0:7148:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb ctime: 1746129570 -> 1746129571 00000100:00100000:2.0:1746129570.476279:0:7148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a77b2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7148:1830948737503104:192.168.202.4@tcp:106: 00010000:00010000:2.0:1746129570.476342:0:7148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094c35600/0x40a459093b069bab lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20ee2 expref: 9 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129570.476354:0:7148:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094c35600/0x40a459093b069bab lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20ee2 expref: 9 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129570.476368:0:7148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094c35600, rc 0) 00000100:00100000:2.0:1746129570.476404:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a77b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:068dab75-d300-4ead-a742-d14572ad1e50+8:1961:x1830948734097792:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 5526us (5586us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129570.476413:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16095 00000100:00100000:3.0:1746129570.476570:0:4385:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cda6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:4385:1830948737502976:192.168.202.4@tcp:106: 00010000:00010000:3.0:1746129570.476588:0:4385:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095cb9800/0x40a459093b069ba4 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20edb expref: 7 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129570.476596:0:4385:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095cb9800/0x40a459093b069ba4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20edb expref: 7 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129570.476603:0:4385:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095cb9800, rc 0) 00000100:00100000:2.0:1746129570.476903:0:11014:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cda6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11014:1830948737503232:192.168.202.4@tcp:106: 00010000:00010000:2.0:1746129570.476917:0:11014:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009584f600/0x40a459093b069bb2 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20ee9 expref: 8 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129570.476926:0:11014:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009584f600/0x40a459093b069bb2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20ee9 expref: 8 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129570.476934:0:11014:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009584f600, rc 0) 00000100:00100000:2.0:1746129570.476952:0:11014:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a77b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:068dab75-d300-4ead-a742-d14572ad1e50+7:1961:x1830948734097920:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 6066us (6100us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129570.476957:0:11014:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16096 00000100:00100000:3.0:1746129570.477415:0:31521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092fd0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+13:1963:x1830948734097152:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 19494us (24639us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129570.477422:0:31521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7755 00002000:00100000:3.0:1746129570.477429:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff880092fd0000 x1830948734097152/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:311/0 lens 488/440 e 0 to 0 dl 1746129581 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129570.477437:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092fd0000 with x1830948734097152 ext(1048576->2097151) 00002000:00010000:3.0:1746129570.477441:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092fd0000 00000100:00100000:3.0:1746129570.477466:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092fd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:068dab75-d300-4ead-a742-d14572ad1e50+6:1961:x1830948734097664:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 6769us (16471us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129570.477471:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16094 00000100:00100000:1.0:1746129570.480160:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129570.481106:0:2271:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734098176 00000100:00100000:3.0:1746129570.481113:0:2271:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734098176 00000100:00100000:3.0:1746129570.482333:0:2271:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11201 00000100:00100000:3.0:1746129570.482343:0:2271:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a77b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:068dab75-d300-4ead-a742-d14572ad1e50+17:32279:x1830948734098176:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:3.0:1746129570.482360:0:2271:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129570.482375:0:2271:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093c7b400/0x40a459093b069bb9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20ef0 expref: -99 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129570.482870:0:2271:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093c7a000/0x40a459093b069bc0 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129570.482884:0:2271:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1c1200/0x40a459093b069b88 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20ebf expref: 18 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129570.482890:0:2271:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093c7a000/0x40a459093b069bc0 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129570.482915:0:2271:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1c1200/0x40a459093b069b88 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20ebf expref: 18 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129570.482927:0:2271:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1c1200/0x40a459093b069b88 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20ebf expref: 18 pid: 2271 timeout: 925 lvb_type: 0 00000100:00100000:3.0:1746129570.482937:0:2271:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094f46d80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:2271:1830948737503360:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129570.483021:0:2271:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a6ce8e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746129570.483678:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129570.483716:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129570.483736:0:11014:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734098304 00000100:00100000:2.0:1746129570.483741:0:11014:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734098304 00000100:00100000:2.0:1746129570.483769:0:11014:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734098432 00000100:00100000:2.0:1746129570.483771:0:11014:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734098432 00000100:00100000:2.0:1746129570.483784:0:11014:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16097 00000100:00100000:2.0:1746129570.483789:0:11014:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136016300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ada2ffba-8920-4ecb-8068-68caa9806978+15:32276:x1830948734098304:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129570.483798:0:11014:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129570.483806:0:11014:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009584f400/0x40a459093b069bc7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20ef7 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129570.483823:0:11014:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800957f8600/0x40a459093b069acb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1175551) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20e17 expref: 9 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129570.483830:0:11014:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129570.483831:0:11014:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129570.483833:0:11014:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009584f400/0x40a459093b069bc7 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20ef7 expref: 16 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129570.483847:0:11014:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800957f8600/0x40a459093b069acb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1175551) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20e17 expref: 9 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129570.483853:0:11014:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800957f8600/0x40a459093b069acb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1175551) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20e17 expref: 9 pid: 22480 timeout: 925 lvb_type: 0 00000100:00100000:2.0:1746129570.483860:0:11014:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cda6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11014:1830948737503488:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129570.483897:0:11014:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a00a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746129570.483998:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16098 00000100:00100000:0.0:1746129570.484005:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136016680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+13:32273:x1830948734098432:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129570.484013:0:7148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129570.484022:0:7148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a6cf7e00/0x40a459093b069bce lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20efe expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129570.484033:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129570.484035:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129570.484040:0:7148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6cf7e00/0x40a459093b069bce lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20efe expref: 14 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129570.484051:0:7148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a6cf7e00/0x40a459093b069bce lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20efe expref: 14 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129570.484060:0:7148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6cf7e00, rc 0) 00000100:00100000:0.0:1746129570.484079:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136016680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+14:32273:x1830948734098432:12345-192.168.202.4@tcp:101:cat.0 Request processed in 75us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129570.484085:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16098 00000100:00100000:0.0:1746129570.493406:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129570.493446:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129570.493497:0:15749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734098560 00000100:00100000:1.0:1746129570.493504:0:15749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734098560 00010000:00010000:1.0:1746129570.493534:0:15749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1c1200/0x40a459093b069b88 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20ebf expref: 19 pid: 2271 timeout: 925 lvb_type: 0 00000100:00100000:1.0:1746129570.493559:0:15749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8247 00000100:00100000:1.0:1746129570.493566:0:15749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136014700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:068dab75-d300-4ead-a742-d14572ad1e50+19:1963:x1830948734098560:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129570.493576:0:15749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129570.493582:0:15749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1c1200/0x40a459093b069b88 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20ebf expref: 19 pid: 2271 timeout: 925 lvb_type: 0 00010000:00010000:1.0:1746129570.493592:0:15749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1c1200/0x40a459093b069b88 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20ebf expref: 19 pid: 2271 timeout: 925 lvb_type: 0 00010000:00010000:1.0:1746129570.493610:0:15749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:1.0:1746129570.493616:0:15749:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880093c7a000/0x40a459093b069bc0 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:1.0:1746129570.493624:0:15749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093c7a000/0x40a459093b069bc0 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50290000000000 pid: 2271 initiator: MDT0 00010000:00010000:1.0:1746129570.493631:0:15749:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093c7a000/0x40a459093b069bc0 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50290000000000 pid: 2271 initiator: MDT0 00000100:00100000:2.0:1746129570.493636:0:11014:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cda6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11014:1830948737503488:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129570.493643:0:15749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746129570.493657:0:11014:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009584f400/0x40a459093b069bc7 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20ef7 expref: 16 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129570.493670:0:11014:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009584f400, rc 0) 00000100:00100000:1.0:1746129570.493684:0:15749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136014700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:068dab75-d300-4ead-a742-d14572ad1e50+19:1963:x1830948734098560:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 118us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129570.493690:0:15749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8247 00000100:00100000:2.0:1746129570.493691:0:11014:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136016300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ada2ffba-8920-4ecb-8068-68caa9806978+16:32276:x1830948734098304:12345-192.168.202.4@tcp:101:cat.0 Request processed in 9900us (10014us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129570.493697:0:11014:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16097 00010000:00010000:3.0:1746129570.497700:0:2271:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1c1200/0x40a459093b069b88 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20ebf expref: 18 pid: 2271 timeout: 925 lvb_type: 0 00000100:00100000:3.0:1746129570.497735:0:2271:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094f46d80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:2271:1830948737503360:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129570.497751:0:2271:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880093c7a000/0x40a459093b069bc0 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129570.497758:0:2271:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880093c7a000/0x40a459093b069bc0 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129570.497762:0:2271:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093c7a000/0x40a459093b069bc0 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00000004:00200000:3.0:1746129570.497780:0:2271:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:3.0:1746129570.497907:0:2271:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093c7b400/0x40a459093b069bb9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20ef0 expref: 19 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129570.497918:0:2271:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093c7a000/0x40a459093b069bc0 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20ef0 expref: 18 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129570.497925:0:2271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:3.0:1746129570.497927:0:2271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746129570.497931:0:2271:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093c7a000, rc 0) 00000100:00100000:3.0:1746129570.497978:0:2271:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a77b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:068dab75-d300-4ead-a742-d14572ad1e50+18:32279:x1830948734098176:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 15637us (17823us total) trans 8589945295 rc 0/0 00000100:00100000:3.0:1746129570.497986:0:2271:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11201 00000100:00100000:0.0:1746129570.498179:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129570.498230:0:31521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734098688 00000100:00100000:3.0:1746129570.498235:0:31521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734098688 00002000:00100000:3.0:1746129570.498262:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3ee:0x0] (1048576->1175551) req@ffff880136016d80 x1830948734098688/t0(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:311/0 lens 488/0 e 0 to 0 dl 1746129581 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129570.498270:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136016d80 with x1830948734098688 ext(1048576->1175551) 00010000:00010000:3.0:1746129570.498276:0:31521:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800957f8600/0x40a459093b069acb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1175551) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20e17 expref: 10 pid: 22480 timeout: 925 lvb_type: 0 00010000:00010000:3.0:1746129570.498286:0:31521:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800957f8600/0x40a459093b069acb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1175551) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20e17 expref: 10 pid: 22480 timeout: 925 lvb_type: 0 00002000:00010000:3.0:1746129570.498313:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880136016d80 00000100:00100000:3.0:1746129570.498332:0:31521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734098944 00000100:00100000:3.0:1746129570.498335:0:31521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734098944 00002000:00100000:3.0:1746129570.498346:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f4:0x0] (1048576->2097151) req@ffff880136017100 x1830948734098944/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:311/0 lens 488/0 e 0 to 0 dl 1746129581 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129570.498352:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136017100 with x1830948734098944 ext(1048576->2097151) 00002000:00010000:3.0:1746129570.498355:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136017100 00000100:00100000:3.0:1746129570.498363:0:31521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2414 00000100:00100000:3.0:1746129570.498368:0:31521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136016d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+10:1963:x1830948734098688:12345-192.168.202.4@tcp:4:multiop.0 00000100:00100000:3.0:1746129570.498538:0:8416:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7756 00000100:00100000:3.0:1746129570.498542:0:8416:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136017100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+14:1963:x1830948734098944:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:3.0:1746129570.507546:0:31521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136016d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+12:1963:x1830948734098688:12345-192.168.202.4@tcp:4:multiop.0 Request processed in 9171us (14093us total) trans 21474841333 rc 0/0 00000100:00100000:3.0:1746129570.507556:0:31521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2414 00002000:00100000:3.0:1746129570.507566:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3ee:0x0] (1048576->1175551) req@ffff880136016d80 x1830948734098688/t21474841333(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:311/0 lens 488/448 e 0 to 0 dl 1746129581 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129570.507575:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136016d80 with x1830948734098688 ext(1048576->1175551) 00010000:00010000:3.0:1746129570.507583:0:31521:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800957f8600/0x40a459093b069acb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1175551) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20e17 expref: 12 pid: 22480 timeout: 925 lvb_type: 0 00010000:00010000:3.0:1746129570.507594:0:31521:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800957f8600/0x40a459093b069acb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1175551) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20e17 expref: 12 pid: 22480 timeout: 925 lvb_type: 0 00002000:00010000:3.0:1746129570.507601:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880136016d80 00000100:00100000:0.0:1746129570.508349:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129570.508521:0:2271:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734099072 00000100:00100000:3.0:1746129570.508527:0:2271:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734099072 00000100:00100000:3.0:1746129570.508555:0:2271:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11202 00000100:00100000:3.0:1746129570.508561:0:2271:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a07ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:068dab75-d300-4ead-a742-d14572ad1e50+18:32279:x1830948734099072:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:3.0:1746129570.508576:0:2271:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129570.508590:0:2271:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093c7a600/0x40a459093b069bdc lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20f05 expref: -99 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129570.508646:0:2271:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093c7b200/0x40a459093b069be3 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129570.508658:0:2271:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093c7a000/0x40a459093b069bc0 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20ef0 expref: 19 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129570.508668:0:2271:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093c7b200/0x40a459093b069be3 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129570.508692:0:2271:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093c7a000/0x40a459093b069bc0 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20ef0 expref: 19 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129570.508701:0:2271:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093c7a000/0x40a459093b069bc0 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20ef0 expref: 19 pid: 2271 timeout: 925 lvb_type: 0 00000100:00100000:3.0:1746129570.508711:0:2271:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094f46d80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:2271:1830948737503616:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129570.508768:0:2271:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a6ce8e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746129570.508839:0:8416:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136017100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+14:1963:x1830948734098944:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 10294us (10658us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129570.508846:0:8416:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7756 00002000:00100000:2.0:1746129570.508853:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3f4:0x0] (1048576->2097151) req@ffff880136017100 x1830948734098944/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:311/0 lens 488/440 e 0 to 0 dl 1746129581 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129570.508860:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136017100 with x1830948734098944 ext(1048576->2097151) 00002000:00010000:2.0:1746129570.508864:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136017100 00000100:00100000:0.0:1746129570.513421:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129570.513762:0:2271:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094f46d80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:2271:1830948737503616:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129570.513783:0:2271:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880093c7b200/0x40a459093b069be3 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00000100:00100000:1.0:1746129570.514078:0:20578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734099200 00000100:00100000:1.0:1746129570.514084:0:20578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734099200 00010000:00010000:1.0:1746129570.514110:0:20578:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093c7a000/0x40a459093b069bc0 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20ef0 expref: 20 pid: 2271 timeout: 925 lvb_type: 0 00000100:00100000:1.0:1746129570.514143:0:20578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8248 00000100:00100000:1.0:1746129570.514150:0:20578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a07af480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:068dab75-d300-4ead-a742-d14572ad1e50+20:1961:x1830948734099200:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129570.514162:0:20578:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129570.514167:0:20578:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093c7a000/0x40a459093b069bc0 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20ef0 expref: 20 pid: 2271 timeout: 925 lvb_type: 0 00010000:00010000:1.0:1746129570.514176:0:20578:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093c7a000/0x40a459093b069bc0 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20ef0 expref: 20 pid: 2271 timeout: 925 lvb_type: 0 00010000:00010000:1.0:1746129570.514193:0:20578:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093c7a000/0x40a459093b069bc0 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20ef0 expref: 20 pid: 2271 timeout: 925 lvb_type: 0 00010000:00010000:1.0:1746129570.514223:0:20578:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:1.0:1746129570.514227:0:20578:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880093c7b200/0x40a459093b069be3 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00010000:00010000:1.0:1746129570.514235:0:20578:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093c7b200/0x40a459093b069be3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 2271 initiator: MDT0 00010000:00010000:1.0:1746129570.514241:0:20578:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093c7b200/0x40a459093b069be3 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 2271 initiator: MDT0 00010000:00010000:1.0:1746129570.514265:0:20578:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746129570.514291:0:2271:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880093c7b200/0x40a459093b069be3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129570.514314:0:2271:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093c7b200/0x40a459093b069be3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00000100:00100000:1.0:1746129570.514325:0:20578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a07af480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:068dab75-d300-4ead-a742-d14572ad1e50+19:1961:x1830948734099200:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 165us (902us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129570.514332:0:20578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8248 00000004:00200000:2.0:1746129570.514362:0:2271:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00000004:00200000:2.0:1746129570.514366:0:2271:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746129570.514378:0:2271:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880093c7b200/0x40a459093b069be3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129570.514405:0:2271:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093c7a600/0x40a459093b069bdc lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20f05 expref: 19 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129570.514485:0:2271:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093c7b200/0x40a459093b069be3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20f05 expref: 18 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129570.514492:0:2271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:2.0:1746129570.514494:0:2271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746129570.514496:0:2271:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093c7b200, rc 0) 00000100:00100000:2.0:1746129570.514520:0:2271:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a07ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:068dab75-d300-4ead-a742-d14572ad1e50+18:32279:x1830948734099072:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 5960us (6173us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129570.514526:0:2271:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11202 00000100:00100000:0.0:1746129570.521409:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129570.521438:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129570.521464:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129570.521481:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129570.521505:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129570.521524:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734099456 00000100:00100000:0.0:1746129570.521531:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734099456 00000100:00100000:0.0:1746129570.521560:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734099584 00000100:00100000:0.0:1746129570.521561:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734099584 00000100:00100000:0.0:1746129570.521571:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734099712 00000100:00100000:0.0:1746129570.521572:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734099712 00000100:00100000:3.0:1746129570.521577:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734099840 00000100:00100000:3.0:1746129570.521581:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734099840 00000100:00100000:0.0:1746129570.521583:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16099 00000100:00100000:0.0:1746129570.521589:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009507fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+12:32273:x1830948734099456:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129570.521603:0:7148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746129570.521607:0:8410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16100 00000100:00100000:3.0:1746129570.521614:0:8410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009507e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:068dab75-d300-4ead-a742-d14572ad1e50+7:1962:x1830948734099584:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:0.0:1746129570.521617:0:7148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012dc1b000/0x40a459093b069bea lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20f0c expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129570.521621:0:8410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129570.521627:0:8410:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093c7b600/0x40a459093b069bf1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20f13 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129570.521640:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129570.521645:0:7148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dc1b000/0x40a459093b069bea lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20f0c expref: 13 pid: 7148 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129570.521654:0:20577:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16101 00000100:00100000:2.0:1746129570.521662:0:20577:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009507d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:068dab75-d300-4ead-a742-d14572ad1e50+8:1962:x1830948734099712:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:2.0:1746129570.521669:0:20577:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129570.521677:0:20577:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009584ec00/0x40a459093b069bf8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20f1a expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129570.521695:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16102 00000100:00100000:1.0:1746129570.521703:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009507ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:068dab75-d300-4ead-a742-d14572ad1e50+7:1962:x1830948734099840:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:1.0:1746129570.521711:0:7149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746129570.521713:0:20577:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cda6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20577:1830948737503744:192.168.202.4@tcp:106: 00010000:00010000:1.0:1746129570.521719:0:7149:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800909cfc00/0x40a459093b069bff lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20f21 expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129570.521769:0:20577:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a00a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746129570.521825:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a77b3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7149:1830948737503872:192.168.202.4@tcp:106: 00000100:00100000:1.0:1746129570.521847:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934d2b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746129570.521859:0:20578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734099328 00000100:00100000:1.0:1746129570.521862:0:20578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734099328 00010000:00010000:1.0:1746129570.522201:0:20578:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800957f8600/0x40a459093b069acb lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1175551) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20e17 expref: 14 pid: 22480 timeout: 925 lvb_type: 0 00000100:00100000:3.0:1746129570.522205:0:8410:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094f46d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8410:1830948737504000:192.168.202.4@tcp:106: 00000100:00100000:1.0:1746129570.522230:0:20578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8249 00000100:00100000:3.0:1746129570.522232:0:8410:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a6ce8e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746129570.522236:0:20578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009507ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+14:1962:x1830948734099328:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129570.523468:0:20578:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129570.525842:0:20578:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800957f8600/0x40a459093b069acb lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->1175551) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20e17 expref: 14 pid: 22480 timeout: 925 lvb_type: 0 00010000:00010000:1.0:1746129570.525857:0:20578:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800957f8600/0x40a459093b069acb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->1175551) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20e17 expref: 14 pid: 22480 timeout: 925 lvb_type: 0 00010000:00010000:1.0:1746129570.525879:0:20578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129570.525881:0:20578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129570.525887:0:20578:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009584f400/0x40a459093b069bc7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20ef7 expref: 15 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129570.525894:0:20578:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009584f400/0x40a459093b069bc7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20ef7 expref: 15 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129570.525900:0:20578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129570.525901:0:20578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129570.525904:0:20578:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012dc1b000/0x40a459093b069bea lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20f0c expref: 14 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129570.525909:0:20578:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dc1b000/0x40a459093b069bea lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20f0c expref: 14 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129570.526143:0:7148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012dc1b000/0x40a459093b069bea lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20f0c expref: 14 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129570.526157:0:7148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dc1b000, rc 0) 00000100:00100000:0.0:1746129570.526256:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009507fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+14:32273:x1830948734099456:12345-192.168.202.4@tcp:101:cat.0 Request processed in 4665us (4815us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129570.526264:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16099 00000100:00100000:3.0:1746129570.526527:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a77b3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7149:1830948737503872:192.168.202.4@tcp:106: 00010000:00010000:3.0:1746129570.526547:0:7149:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800909cfc00/0x40a459093b069bff lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20f21 expref: 8 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129570.526555:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800909cfc00/0x40a459093b069bff lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20f21 expref: 8 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129570.526566:0:7149:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800909cfc00, rc 0) 00000100:00100000:3.0:1746129570.526582:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009507ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:068dab75-d300-4ead-a742-d14572ad1e50+7:1962:x1830948734099840:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 4881us (5077us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129570.526587:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16102 00010000:00010000:3.0:1746129570.526641:0:8410:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.202.4@tcp) returned -22 from glimpse AST (req@ffff880094f46d80 x1830948737504000) - normal race ns: filter-lustre-OST0000_UUID lock: ffff8800957f8600/0x40a459093b069acb lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->1175551) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20e17 expref: 13 pid: 22480 timeout: 925 lvb_type: 0 00010000:00010000:3.0:1746129570.526658:0:8410:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800957f8600/0x40a459093b069acb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->1175551) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20e17 expref: 13 pid: 22480 timeout: 925 lvb_type: 0 00000100:00100000:3.0:1746129570.526667:0:8410:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094f46d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8410:1830948737504000:192.168.202.4@tcp:106: 00010000:00010000:3.0:1746129570.526681:0:8410:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093c7b600/0x40a459093b069bf1 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20f13 expref: 9 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129570.526688:0:8410:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093c7b600/0x40a459093b069bf1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20f13 expref: 9 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129570.526694:0:8410:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093c7b600, rc 0) 00000100:00100000:3.0:1746129570.526709:0:8410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009507e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:068dab75-d300-4ead-a742-d14572ad1e50+8:1962:x1830948734099584:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 5096us (5244us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129570.526714:0:8410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16100 00010000:00010000:1.0:1746129570.526793:0:20578:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012dc1b000/0x40a459093b069bea lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20f0c expref: 12 pid: 7148 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129570.526805:0:20578:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a77b1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:20578:1830948737504128:192.168.202.4@tcp:105: 00010000:00010000:1.0:1746129570.526850:0:20578:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009584f400/0x40a459093b069bc7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20ef7 expref: 15 pid: 11014 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129570.526857:0:20578:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a77b0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:20578:1830948737504256:192.168.202.4@tcp:105: 00000100:00100000:1.0:1746129570.526869:0:20578:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934d2900 going to sleep for 11 seconds 00000100:00100000:2.0:1746129570.526976:0:20577:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cda6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20577:1830948737503744:192.168.202.4@tcp:106: 00010000:00010000:2.0:1746129570.526991:0:20577:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009584ec00/0x40a459093b069bf8 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20f1a expref: 7 pid: 20577 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129570.527000:0:20577:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009584ec00/0x40a459093b069bf8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20f1a expref: 7 pid: 20577 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129570.527010:0:20577:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009584ec00, rc 0) 00000100:00100000:2.0:1746129570.527030:0:20577:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009507d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:068dab75-d300-4ead-a742-d14572ad1e50+6:1962:x1830948734099712:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 5369us (5547us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129570.527035:0:20577:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16101 00000100:00100000:1.0:1746129570.529882:0:20578:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a77b1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:20578:1830948737504128:192.168.202.4@tcp:105: 00000100:00100000:1.0:1746129570.529894:0:20578:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a77b0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:20578:1830948737504256:192.168.202.4@tcp:105: 00010000:00010000:1.0:1746129570.529910:0:20578:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129570.530971:0:20578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009507ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+12:1962:x1830948734099328:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 8731us (9564us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129570.530981:0:20578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8249 00000100:00100000:2.0:1746129570.534504:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129570.534504:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129570.534539:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129570.534557:0:31521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734100096 00000100:00100000:2.0:1746129570.534568:0:31521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734100096 00002000:00100000:2.0:1746129570.534604:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3ee:0x0] (1048576->2097151) req@ffff88009507d880 x1830948734100096/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:311/0 lens 488/0 e 0 to 0 dl 1746129581 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129570.534613:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009507d880 with x1830948734100096 ext(1048576->2097151) 00002000:00010000:2.0:1746129570.534617:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009507d880 00000100:00100000:2.0:1746129570.534641:0:31521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734100352 00000100:00100000:2.0:1746129570.534644:0:31521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734100352 00002000:00100000:2.0:1746129570.534657:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3ee:0x0] (1048576->2097151) req@ffff88009507c700 x1830948734100352/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:311/0 lens 488/0 e 0 to 0 dl 1746129581 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129570.534664:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009507c700 with x1830948734100352 ext(1048576->2097151) 00002000:00010000:2.0:1746129570.534666:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009507c700 00000100:00100000:2.0:1746129570.534679:0:31521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7757 00000100:00100000:2.0:1746129570.534685:0:31521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009507d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ada2ffba-8920-4ecb-8068-68caa9806978+16:1962:x1830948734100096:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:3.0:1746129570.535079:0:2271:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734100608 00000100:00100000:3.0:1746129570.535084:0:2271:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734100608 00000100:00100000:3.0:1746129570.535119:0:2271:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11203 00000100:00100000:3.0:1746129570.535125:0:2271:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cda6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:068dab75-d300-4ead-a742-d14572ad1e50+18:32279:x1830948734100608:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:3.0:1746129570.535134:0:2271:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129570.535148:0:2271:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093c7ac00/0x40a459093b069c06 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20f28 expref: -99 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129570.535219:0:2271:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093c7b800/0x40a459093b069c0d lrc: 3/0,1 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129570.535230:0:2271:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093c7b800/0x40a459093b069c0d lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129570.535238:0:2271:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093c7b800/0x40a459093b069c0d lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00000004:00200000:3.0:1746129570.535247:0:2271:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:3.0:1746129570.535360:0:2271:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093c7ac00/0x40a459093b069c06 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x1/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20f28 expref: 21 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129570.535375:0:2271:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093c7b800/0x40a459093b069c0d lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20f28 expref: 20 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129570.535381:0:2271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:3.0:1746129570.535384:0:2271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746129570.535386:0:2271:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093c7b800, rc 0) 00000100:00100000:3.0:1746129570.535419:0:2271:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cda6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:068dab75-d300-4ead-a742-d14572ad1e50+20:32279:x1830948734100608:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 295us (922us total) trans 8589945296 rc 0/0 00000100:00100000:3.0:1746129570.535425:0:2271:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11203 00000100:00100000:3.0:1746129570.535498:0:8416:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7758 00000100:00100000:3.0:1746129570.535504:0:8416:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009507c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+12:1962:x1830948734100352:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:0.0:1746129570.542151:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129570.542180:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129570.542199:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129570.542211:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129570.542231:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129570.542250:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129570.542709:0:20577:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734100736 00000100:00100000:2.0:1746129570.542716:0:20577:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734100736 00000100:00100000:2.0:1746129570.542746:0:20577:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734100864 00000100:00100000:2.0:1746129570.542747:0:20577:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734100864 00000100:00100000:2.0:1746129570.542756:0:20577:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734100992 00000100:00100000:2.0:1746129570.542757:0:20577:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734100992 00000100:00100000:2.0:1746129570.542765:0:20577:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734101120 00000100:00100000:2.0:1746129570.542766:0:20577:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734101120 00000100:00100000:2.0:1746129570.542773:0:20577:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734101248 00000100:00100000:2.0:1746129570.542774:0:20577:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734101248 00000100:00100000:2.0:1746129570.542780:0:20577:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734101376 00000100:00100000:2.0:1746129570.542782:0:20577:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734101376 00000100:00100000:2.0:1746129570.542792:0:20577:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16103 00000100:00100000:2.0:1746129570.542798:0:20577:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009507f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:068dab75-d300-4ead-a742-d14572ad1e50+8:1962:x1830948734100736:12345-192.168.202.4@tcp:1:lfs.0 00010000:00010000:2.0:1746129570.542831:0:20577:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800915dd400/0x40a459093b069c1b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129570.542851:0:20577:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f8d5a00/0x40a459093b069b3b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20e87 expref: 13 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129570.542858:0:20577:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c460000/0x40a459093b069b8f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20ec6 expref: 8 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129570.542865:0:20577:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ec94600/0x40a459093b069b49 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20e95 expref: 17 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129570.542870:0:20577:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129570.542872:0:20577:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129570.542874:0:20577:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800915dd400/0x40a459093b069c1b lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129570.542898:0:20577:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012ec94600/0x40a459093b069b49 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20e95 expref: 17 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129570.542908:0:20577:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012ec94600/0x40a459093b069b49 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20e95 expref: 17 pid: 7149 timeout: 925 lvb_type: 1 00000100:00100000:2.0:1746129570.542919:0:20577:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cda7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20577:1830948737504384:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129570.542982:0:20577:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c460000/0x40a459093b069b8f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20ec6 expref: 8 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129570.542989:0:20577:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c460000/0x40a459093b069b8f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20ec6 expref: 8 pid: 7149 timeout: 925 lvb_type: 1 00000100:00100000:2.0:1746129570.543001:0:20577:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cda6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20577:1830948737504512:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129570.543017:0:20577:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f8d5a00/0x40a459093b069b3b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20e87 expref: 13 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129570.543024:0:20577:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f8d5a00/0x40a459093b069b3b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20e87 expref: 13 pid: 7149 timeout: 925 lvb_type: 0 00000100:00100000:2.0:1746129570.543030:0:20577:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cda7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20577:1830948737504640:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129570.543041:0:20577:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a00a80 going to sleep for 11 seconds 00000100:00100000:2.0:1746129570.543056:0:11014:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16104 00000100:00100000:2.0:1746129570.543061:0:11014:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009507ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:068dab75-d300-4ead-a742-d14572ad1e50+9:1963:x1830948734100864:12345-192.168.202.4@tcp:1:lfs.0 00010000:00010000:2.0:1746129570.543075:0:11014:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012eb5b800/0x40a459093b069c22 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129570.543083:0:11014:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095b5f400/0x40a459093b069b6c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20eb8 expref: 13 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129570.543090:0:11014:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095cb8a00/0x40a459093b069b96 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20ecd expref: 9 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129570.543095:0:11014:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129570.543096:0:11014:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129570.543098:0:11014:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012eb5b800/0x40a459093b069c22 lrc: 5/0,1 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129570.543115:0:11014:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095cb8a00/0x40a459093b069b96 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20ecd expref: 9 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129570.543122:0:11014:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095cb8a00/0x40a459093b069b96 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20ecd expref: 9 pid: 4385 timeout: 925 lvb_type: 1 00000100:00100000:2.0:1746129570.543131:0:11014:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cda5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11014:1830948737504768:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129570.543150:0:11014:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095b5f400/0x40a459093b069b6c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20eb8 expref: 13 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129570.543157:0:11014:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095b5f400/0x40a459093b069b6c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20eb8 expref: 13 pid: 8410 timeout: 925 lvb_type: 0 00000100:00100000:2.0:1746129570.543163:0:11014:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cda5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11014:1830948737504896:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129570.543177:0:11014:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a00300 going to sleep for 11 seconds 00000100:00100000:2.0:1746129570.543191:0:8412:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16105 00000100:00100000:2.0:1746129570.543195:0:8412:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009507f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:068dab75-d300-4ead-a742-d14572ad1e50+9:1962:x1830948734100992:12345-192.168.202.4@tcp:1:lfs.0 00010000:00010000:2.0:1746129570.543207:0:8412:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880094c08400/0x40a459093b069c29 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129570.543216:0:8412:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c460400/0x40a459093b069b65 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20eb1 expref: 25 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129570.543222:0:8412:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a6cf7e00/0x40a459093b069bce lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20efe expref: 13 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129570.543228:0:8412:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c460600/0x40a459093b069b9d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20ed4 expref: 9 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129570.543233:0:8412:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129570.543234:0:8412:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129570.543236:0:8412:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094c08400/0x40a459093b069c29 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129570.543350:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16106 00000100:00100000:1.0:1746129570.543357:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009507dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:068dab75-d300-4ead-a742-d14572ad1e50+8:1963:x1830948734101120:12345-192.168.202.4@tcp:1:lfs.0 00010000:00010000:1.0:1746129570.543372:0:7148:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800909cee00/0x40a459093b069c30 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129570.543381:0:7148:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009584f400/0x40a459093b069bc7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20ef7 expref: 17 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129570.543387:0:7148:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012dc1b000/0x40a459093b069bea lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20f0c expref: 13 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129570.543391:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129570.543392:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129570.543394:0:7148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800909cee00/0x40a459093b069c30 lrc: 5/0,1 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129570.543407:0:7148:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012dc1b000/0x40a459093b069bea lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20f0c expref: 13 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129570.543414:0:7148:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012dc1b000/0x40a459093b069bea lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20f0c expref: 13 pid: 7148 timeout: 925 lvb_type: 0 00000100:00100000:1.0:1746129570.543421:0:7148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a77b0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7148:1830948737505024:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129570.543454:0:7148:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009584f400/0x40a459093b069bc7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20ef7 expref: 17 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129570.543461:0:7148:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009584f400/0x40a459093b069bc7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20ef7 expref: 17 pid: 11014 timeout: 925 lvb_type: 0 00000100:00100000:1.0:1746129570.543467:0:7148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a77b1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7148:1830948737505152:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129570.543481:0:7148:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934d2900 going to sleep for 11 seconds 00000100:00100000:0.0:1746129570.543533:0:31503:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16107 00000100:00100000:0.0:1746129570.543539:0:31503:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009507df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:068dab75-d300-4ead-a742-d14572ad1e50+8:1962:x1830948734101248:12345-192.168.202.4@tcp:1:lfs.0 00010000:00010000:0.0:1746129570.543553:0:31503:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012dc1bc00/0x40a459093b069c37 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129570.543561:0:31503:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f8d5000/0x40a459093b069b34 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2334720->2355199) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20e80 expref: 17 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129570.543566:0:31503:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129570.543567:0:31503:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129570.543569:0:31503:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dc1bc00/0x40a459093b069c37 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129570.543581:0:31503:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f8d5000/0x40a459093b069b34 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2334720->2355199) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20e80 expref: 17 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129570.543587:0:31503:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f8d5000/0x40a459093b069b34 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2334720->2355199) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20e80 expref: 17 pid: 7149 timeout: 925 lvb_type: 0 00000100:00100000:0.0:1746129570.543593:0:31503:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094efc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:31503:1830948737505280:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129570.543611:0:31503:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e29fc00 going to sleep for 11 seconds 00000100:00100000:0.0:1746129570.543625:0:4699:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16108 00000100:00100000:0.0:1746129570.543630:0:4699:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:068dab75-d300-4ead-a742-d14572ad1e50+9:1963:x1830948734101376:12345-192.168.202.4@tcp:1:lfs.0 00010000:00010000:0.0:1746129570.543642:0:4699:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012dc1ae00/0x40a459093b069c3e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129570.543650:0:4699:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f8d5800/0x40a459093b069b42 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3588096->4050943) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20e8e expref: 13 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129570.543659:0:4699:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129570.543660:0:4699:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129570.543661:0:4699:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dc1ae00/0x40a459093b069c3e lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129570.543673:0:4699:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f8d5800/0x40a459093b069b42 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3588096->4050943) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20e8e expref: 13 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129570.543680:0:4699:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f8d5800/0x40a459093b069b42 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3588096->4050943) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20e8e expref: 13 pid: 7149 timeout: 925 lvb_type: 0 00000100:00100000:0.0:1746129570.543686:0:4699:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094effb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4699:1830948737505408:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129570.543700:0:4699:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e29fcc0 going to sleep for 11 seconds 00010000:00010000:2.0:1746129570.545156:0:8412:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c460600/0x40a459093b069b9d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20ed4 expref: 9 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129570.545164:0:8412:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c460600/0x40a459093b069b9d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20ed4 expref: 9 pid: 7149 timeout: 925 lvb_type: 1 00000100:00100000:2.0:1746129570.545173:0:8412:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090169500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8412:1830948737505536:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129570.545231:0:8412:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a6cf7e00/0x40a459093b069bce lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20efe expref: 13 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129570.545238:0:8412:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a6cf7e00/0x40a459093b069bce lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20efe expref: 13 pid: 7148 timeout: 925 lvb_type: 0 00000100:00100000:2.0:1746129570.545244:0:8412:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090169180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8412:1830948737505664:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129570.545274:0:8412:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c460400/0x40a459093b069b65 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20eb1 expref: 25 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129570.545285:0:8412:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c460400/0x40a459093b069b65 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20eb1 expref: 25 pid: 7148 timeout: 925 lvb_type: 0 00000100:00100000:2.0:1746129570.545304:0:8412:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090169880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8412:1830948737505792:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129570.545334:0:8412:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a00180 going to sleep for 11 seconds 00000100:00100000:3.0:1746129570.545435:0:31521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009507d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ada2ffba-8920-4ecb-8068-68caa9806978+16:1962:x1830948734100096:12345-192.168.202.4@tcp:3:cat.0 Request processed in 10749us (10935us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129570.545444:0:31521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7757 00002000:00100000:3.0:1746129570.545451:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3ee:0x0] (1048576->2097151) req@ffff88009507d880 x1830948734100096/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:311/0 lens 488/440 e 0 to 0 dl 1746129581 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129570.545459:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009507d880 with x1830948734100096 ext(1048576->2097151) 00010000:00010000:3.0:1746129570.545465:0:31521:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009584f400/0x40a459093b069bc7 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20ef7 expref: 16 pid: 11014 timeout: 925 lvb_type: 0 00010000:00010000:3.0:1746129570.545474:0:31521:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009584f400/0x40a459093b069bc7 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20ef7 expref: 16 pid: 11014 timeout: 925 lvb_type: 0 00002000:00010000:3.0:1746129570.545480:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009507d880 00000100:00100000:2.0:1746129570.545771:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129570.545897:0:15096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734101632 00000100:00100000:0.0:1746129570.545904:0:15096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734101632 00000100:00100000:0.0:1746129570.545939:0:15096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11204 00000100:00100000:0.0:1746129570.545944:0:15096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009016a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+27:32281:x1830948734101632:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:0.0:1746129570.545958:0:15096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129570.545972:0:15096:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc1ba00/0x40a459093b069c45 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20f2f expref: -99 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129570.546043:0:15096:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc1b600/0x40a459093b069c4c lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 15096 initiator: MDT0 00010000:00010000:0.0:1746129570.546055:0:15096:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093c7b200/0x40a459093b069be3 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20f05 expref: 19 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129570.546065:0:15096:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093c7b800/0x40a459093b069c0d lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20f28 expref: 19 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129570.546070:0:15096:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc1b600/0x40a459093b069c4c lrc: 5/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 15096 initiator: MDT0 00010000:00010000:0.0:1746129570.546087:0:15096:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093c7b800/0x40a459093b069c0d lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20f28 expref: 19 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129570.546094:0:15096:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093c7b800/0x40a459093b069c0d lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20f28 expref: 19 pid: 2271 timeout: 925 lvb_type: 0 00000100:00100000:0.0:1746129570.546101:0:15096:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094efc000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15096:1830948737505920:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129570.546137:0:15096:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093c7b200/0x40a459093b069be3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20f05 expref: 19 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129570.546143:0:15096:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093c7b200/0x40a459093b069be3 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20f05 expref: 19 pid: 2271 timeout: 925 lvb_type: 0 00000100:00100000:0.0:1746129570.546149:0:15096:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094efd500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15096:1830948737506048:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129570.546160:0:15096:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e29f240 going to sleep for 11 seconds 00000100:00100000:3.0:1746129570.546920:0:8416:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009507c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+12:1962:x1830948734100352:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 11413us (12377us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129570.546926:0:8416:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7758 00002000:00100000:3.0:1746129570.546932:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3ee:0x0] (1048576->2097151) req@ffff88009507c700 x1830948734100352/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:311/0 lens 488/440 e 0 to 0 dl 1746129581 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129570.546940:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009507c700 with x1830948734100352 ext(1048576->2097151) 00010000:00010000:3.0:1746129570.546945:0:8416:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012dc1b000/0x40a459093b069bea lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20f0c expref: 12 pid: 7148 timeout: 925 lvb_type: 0 00010000:00010000:3.0:1746129570.546954:0:8416:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012dc1b000/0x40a459093b069bea lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20f0c expref: 12 pid: 7148 timeout: 925 lvb_type: 0 00002000:00010000:3.0:1746129570.546959:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009507c700 00000100:00100000:0.0:1746129570.548948:0:20577:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cda7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20577:1830948737504384:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129570.550400:0:7148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a77b0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7148:1830948737505024:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129570.550404:0:31503:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094efc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:31503:1830948737505280:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129570.550410:0:7148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a77b1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7148:1830948737505152:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129570.550424:0:31503:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012dc1bc00/0x40a459093b069c37 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129570.550425:0:7148:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800909cee00/0x40a459093b069c30 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129570.550670:0:20577:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cda6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20577:1830948737504512:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129570.550678:0:20577:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cda7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20577:1830948737504640:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129570.550694:0:20577:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800915dd400/0x40a459093b069c1b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129570.550717:0:8412:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090169500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8412:1830948737505536:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129570.550796:0:11014:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cda5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11014:1830948737504768:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129570.550806:0:11014:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cda5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11014:1830948737504896:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129570.550821:0:11014:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012eb5b800/0x40a459093b069c22 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129570.550992:0:4699:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094effb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4699:1830948737505408:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129570.551004:0:4699:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012dc1ae00/0x40a459093b069c3e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129570.551375:0:15096:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094efc000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15096:1830948737505920:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129570.551384:0:15096:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094efd500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15096:1830948737506048:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129570.551396:0:15096:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc1b600/0x40a459093b069c4c lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 15096 initiator: MDT0 00000100:00100000:3.0:1746129570.551539:0:8412:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090169180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8412:1830948737505664:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129570.551546:0:8412:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090169880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8412:1830948737505792:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129570.551559:0:8412:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880094c08400/0x40a459093b069c29 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129570.551930:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129570.551957:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129570.551979:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129570.551995:0:15749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734102656 00000100:00100000:2.0:1746129570.552000:0:15749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734102656 00000100:00100000:3.0:1746129570.552508:0:8416:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734102400 00000100:00100000:3.0:1746129570.552512:0:8416:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734102400 00002000:00100000:3.0:1746129570.552541:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3ef:0x0] (2334720->2355199) req@ffff88009016ad80 x1830948734102400/t0(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:311/0 lens 488/0 e 0 to 0 dl 1746129581 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129570.552550:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009016ad80 with x1830948734102400 ext(2334720->2355199) 00010000:00010000:3.0:1746129570.552556:0:8416:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f8d5000/0x40a459093b069b34 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2334720->2355199) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20e80 expref: 16 pid: 7149 timeout: 925 lvb_type: 0 00010000:00010000:3.0:1746129570.552566:0:8416:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f8d5000/0x40a459093b069b34 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2334720->2355199) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20e80 expref: 16 pid: 7149 timeout: 925 lvb_type: 0 00002000:00010000:3.0:1746129570.552572:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009016ad80 00000100:00100000:3.0:1746129570.552591:0:8416:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2415 00000100:00100000:3.0:1746129570.552598:0:8416:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009016ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ada2ffba-8920-4ecb-8068-68caa9806978+16:1963:x1830948734102400:12345-192.168.202.4@tcp:4:cat.0 00000100:00100000:1.0:1746129570.552988:0:20578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734102912 00000100:00100000:1.0:1746129570.552993:0:20578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734102912 00010000:00010000:1.0:1746129570.553011:0:20578:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093c7b200/0x40a459093b069be3 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20f05 expref: 20 pid: 2271 timeout: 925 lvb_type: 0 00000100:00100000:1.0:1746129570.553033:0:20578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8250 00000100:00100000:1.0:1746129570.553038:0:20578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009016aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:068dab75-d300-4ead-a742-d14572ad1e50+20:1963:x1830948734102912:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129570.553046:0:20578:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129570.553051:0:20578:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093c7b200/0x40a459093b069be3 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20f05 expref: 20 pid: 2271 timeout: 925 lvb_type: 0 00010000:00010000:1.0:1746129570.553059:0:20578:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093c7b200/0x40a459093b069be3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20f05 expref: 20 pid: 2271 timeout: 925 lvb_type: 0 00010000:00010000:1.0:1746129570.553076:0:20578:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093c7b200/0x40a459093b069be3 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20f05 expref: 20 pid: 2271 timeout: 925 lvb_type: 0 00010000:00010000:1.0:1746129570.553089:0:20578:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:1.0:1746129570.553094:0:20578:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc1b600/0x40a459093b069c4c lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 15096 initiator: MDT0 00010000:00010000:1.0:1746129570.553100:0:20578:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc1b600/0x40a459093b069c4c lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 15096 initiator: MDT0 00010000:00010000:1.0:1746129570.553104:0:20578:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129570.553122:0:20578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009016aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:068dab75-d300-4ead-a742-d14572ad1e50+19:1963:x1830948734102912:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 84us (1142us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129570.553126:0:20578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8250 00010000:00010000:2.0:1746129570.554384:0:15749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c460400/0x40a459093b069b65 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20eb1 expref: 26 pid: 7148 timeout: 925 lvb_type: 0 00000100:00100000:0.0:1746129570.554384:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129570.554413:0:15749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734102272 00000100:00100000:2.0:1746129570.554416:0:15749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734102272 00000100:00100000:0.0:1746129570.554430:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00010000:00010000:2.0:1746129570.554436:0:15749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c460600/0x40a459093b069b9d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20ed4 expref: 10 pid: 7149 timeout: 925 lvb_type: 1 00000100:00100000:2.0:1746129570.554456:0:15749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8251 00000100:00100000:2.0:1746129570.554462:0:15749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090168a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ada2ffba-8920-4ecb-8068-68caa9806978+26:1963:x1830948734102656:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129570.554471:0:15749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129570.554488:0:15749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c460400/0x40a459093b069b65 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20eb1 expref: 26 pid: 7148 timeout: 925 lvb_type: 0 00010000:00010000:2.0:1746129570.554496:0:15749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c460400/0x40a459093b069b65 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20eb1 expref: 26 pid: 7148 timeout: 925 lvb_type: 0 00000100:00100000:0.0:1746129570.554508:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00010000:00010000:2.0:1746129570.554510:0:15749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c460400/0x40a459093b069b65 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20eb1 expref: 26 pid: 7148 timeout: 925 lvb_type: 0 00010000:00010000:2.0:1746129570.554524:0:15749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129570.554560:0:15749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090168a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ada2ffba-8920-4ecb-8068-68caa9806978+25:1963:x1830948734102656:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 97us (2600us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129570.554565:0:15749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8251 00000100:00100000:2.0:1746129570.554575:0:15749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734102784 00000100:00100000:2.0:1746129570.554577:0:15749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734102784 00010000:00010000:2.0:1746129570.554586:0:15749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093c7b800/0x40a459093b069c0d lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20f28 expref: 19 pid: 2271 timeout: 925 lvb_type: 0 00000100:00100000:2.0:1746129570.554602:0:15749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8252 00000100:00100000:2.0:1746129570.554605:0:15749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094efc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:068dab75-d300-4ead-a742-d14572ad1e50+10:1963:x1830948734102272:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129570.554610:0:15749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129570.554617:0:15749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c460600/0x40a459093b069b9d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20ed4 expref: 10 pid: 7149 timeout: 925 lvb_type: 1 00010000:00010000:2.0:1746129570.554623:0:15749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c460600/0x40a459093b069b9d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20ed4 expref: 10 pid: 7149 timeout: 925 lvb_type: 1 00010000:00010000:2.0:1746129570.554634:0:15749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c460600/0x40a459093b069b9d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20ed4 expref: 10 pid: 7149 timeout: 925 lvb_type: 1 00010000:00010000:2.0:1746129570.554641:0:15749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129570.554654:0:15749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094efc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:068dab75-d300-4ead-a742-d14572ad1e50+9:1963:x1830948734102272:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 48us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129570.554659:0:15749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8252 00000100:00100000:2.0:1746129570.554668:0:15749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8253 00000100:00100000:2.0:1746129570.554672:0:15749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6ce2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:068dab75-d300-4ead-a742-d14572ad1e50+19:1963:x1830948734102784:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129570.554677:0:15749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129570.554681:0:15749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093c7b800/0x40a459093b069c0d lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20f28 expref: 19 pid: 2271 timeout: 925 lvb_type: 0 00010000:00010000:2.0:1746129570.554687:0:15749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093c7b800/0x40a459093b069c0d lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20f28 expref: 19 pid: 2271 timeout: 925 lvb_type: 0 00010000:00010000:2.0:1746129570.554700:0:15749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093c7b800/0x40a459093b069c0d lrc: 0/0,0 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20f28 expref: 19 pid: 2271 timeout: 925 lvb_type: 0 00010000:00010000:2.0:1746129570.554708:0:15749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:2.0:1746129570.554711:0:15749:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc1b600/0x40a459093b069c4c lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129570.554718:0:15749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc1b600/0x40a459093b069c4c lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129570.554723:0:15749:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc1b600/0x40a459093b069c4c lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129570.554739:0:15749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129570.554753:0:15749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6ce2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:068dab75-d300-4ead-a742-d14572ad1e50+18:1963:x1830948734102784:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 80us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129570.554758:0:15749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8253 00010000:00010000:1.0:1746129570.555128:0:15096:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc1b600/0x40a459093b069c4c lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15096 initiator: MDT0 00010000:00010000:1.0:1746129570.555136:0:15096:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc1b600/0x40a459093b069c4c lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15096 initiator: MDT0 00000004:00200000:1.0:1746129570.555152:0:15096:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:1.0:1746129570.555258:0:15096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc1ba00/0x40a459093b069c45 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20f2f expref: 30 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129570.555270:0:15096:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc1b600/0x40a459093b069c4c lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20f2f expref: 29 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129570.555276:0:15096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:1.0:1746129570.555278:0:15096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746129570.555280:0:15096:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dc1b600, rc 0) 00000100:00100000:1.0:1746129570.555346:0:15096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009016a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+29:32281:x1830948734101632:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 9401us (9575us total) trans 8589945297 rc 0/0 00000100:00100000:1.0:1746129570.555352:0:15096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11204 00000100:00100000:3.0:1746129570.555620:0:31521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734102528 00000100:00100000:3.0:1746129570.555624:0:31521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734102528 00002000:00100000:3.0:1746129570.555647:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f5:0x0] (3588096->4050943) req@ffff880094efc380 x1830948734102528/t0(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:311/0 lens 488/0 e 0 to 0 dl 1746129581 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129570.555655:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094efc380 with x1830948734102528 ext(3588096->4050943) 00000100:00100000:0.0:1746129570.555659:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00010000:00010000:3.0:1746129570.555660:0:31521:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f8d5800/0x40a459093b069b42 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3588096->4050943) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20e8e expref: 14 pid: 7149 timeout: 925 lvb_type: 0 00010000:00010000:3.0:1746129570.555669:0:31521:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f8d5800/0x40a459093b069b42 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3588096->4050943) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20e8e expref: 14 pid: 7149 timeout: 925 lvb_type: 0 00000100:00100000:0.0:1746129570.555672:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00002000:00010000:3.0:1746129570.555675:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094efc380 00000100:00100000:0.0:1746129570.555682:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129570.555685:0:31521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2416 00000100:00100000:3.0:1746129570.555690:0:31521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094efc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+14:1963:x1830948734102528:12345-192.168.202.4@tcp:4:multiop.0 00000100:00100000:0.0:1746129570.555692:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129570.555700:0:7086:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734103040 00000100:00100000:0.0:1746129570.555703:0:7086:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734103040 00010000:00010000:0.0:1746129570.555715:0:7086:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6cf7e00/0x40a459093b069bce lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20efe expref: 15 pid: 7148 timeout: 925 lvb_type: 0 00000100:00100000:0.0:1746129570.555724:0:7086:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8254 00000100:00100000:0.0:1746129570.555729:0:7086:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094efd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+15:1963:x1830948734103040:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129570.555734:0:7086:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129570.555741:0:7086:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a6cf7e00/0x40a459093b069bce lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20efe expref: 15 pid: 7148 timeout: 925 lvb_type: 0 00010000:00010000:0.0:1746129570.555749:0:7086:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a6cf7e00/0x40a459093b069bce lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20efe expref: 15 pid: 7148 timeout: 925 lvb_type: 0 00010000:00010000:0.0:1746129570.555760:0:7086:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a6cf7e00/0x40a459093b069bce lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20efe expref: 15 pid: 7148 timeout: 925 lvb_type: 0 00010000:00010000:0.0:1746129570.555771:0:7086:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129570.555773:0:7086:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129570.555776:0:7086:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094c08400/0x40a459093b069c29 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129570.555782:0:7086:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094c08400/0x40a459093b069c29 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129570.555794:0:7086:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129570.555810:0:7086:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094efd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+14:1963:x1830948734103040:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 81us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129570.555815:0:7086:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8254 00000100:00100000:0.0:1746129570.555822:0:7086:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734101760 00000100:00100000:0.0:1746129570.555824:0:7086:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734101760 00010000:00010000:0.0:1746129570.555832:0:7086:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c460000/0x40a459093b069b8f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20ec6 expref: 9 pid: 7149 timeout: 925 lvb_type: 1 00000100:00100000:0.0:1746129570.555842:0:7086:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734102016 00000100:00100000:0.0:1746129570.555843:0:7086:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734102016 00010000:00010000:0.0:1746129570.555850:0:7086:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095cb8a00/0x40a459093b069b96 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20ecd expref: 9 pid: 4385 timeout: 925 lvb_type: 1 00000100:00100000:0.0:1746129570.555857:0:7086:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734101888 00000100:00100000:0.0:1746129570.555859:0:7086:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734101888 00010000:00010000:0.0:1746129570.555865:0:7086:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012ec94600/0x40a459093b069b49 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20e95 expref: 18 pid: 7149 timeout: 925 lvb_type: 1 00000100:00100000:0.0:1746129570.555873:0:7086:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8255 00000100:00100000:0.0:1746129570.555877:0:7086:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094efce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:068dab75-d300-4ead-a742-d14572ad1e50+9:1961:x1830948734101760:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129570.555883:0:7086:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129570.555894:0:7086:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c460000/0x40a459093b069b8f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20ec6 expref: 9 pid: 7149 timeout: 925 lvb_type: 1 00010000:00010000:0.0:1746129570.555901:0:7086:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c460000/0x40a459093b069b8f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20ec6 expref: 9 pid: 7149 timeout: 925 lvb_type: 1 00010000:00010000:0.0:1746129570.555911:0:7086:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c460000/0x40a459093b069b8f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20ec6 expref: 9 pid: 7149 timeout: 925 lvb_type: 1 00010000:00010000:0.0:1746129570.555918:0:7086:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129570.555929:0:7086:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094efce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:068dab75-d300-4ead-a742-d14572ad1e50+8:1961:x1830948734101760:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 51us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129570.555933:0:7086:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8255 00000100:00100000:0.0:1746129570.555941:0:7086:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8256 00000100:00100000:0.0:1746129570.555944:0:7086:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:068dab75-d300-4ead-a742-d14572ad1e50+9:1961:x1830948734102016:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129570.555950:0:7086:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129570.555956:0:7086:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095cb8a00/0x40a459093b069b96 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20ecd expref: 9 pid: 4385 timeout: 925 lvb_type: 1 00010000:00010000:0.0:1746129570.555963:0:7086:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095cb8a00/0x40a459093b069b96 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20ecd expref: 9 pid: 4385 timeout: 925 lvb_type: 1 00010000:00010000:0.0:1746129570.555973:0:7086:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095cb8a00/0x40a459093b069b96 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20ecd expref: 9 pid: 4385 timeout: 925 lvb_type: 1 00010000:00010000:0.0:1746129570.555984:0:7086:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129570.555994:0:7086:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:068dab75-d300-4ead-a742-d14572ad1e50+8:1961:x1830948734102016:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 49us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129570.555999:0:7086:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8256 00000100:00100000:0.0:1746129570.556006:0:7086:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8257 00000100:00100000:0.0:1746129570.556009:0:7086:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094efca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ada2ffba-8920-4ecb-8068-68caa9806978+18:1961:x1830948734101888:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129570.556014:0:7086:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129570.556019:0:7086:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012ec94600/0x40a459093b069b49 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20e95 expref: 18 pid: 7149 timeout: 925 lvb_type: 1 00010000:00010000:0.0:1746129570.556026:0:7086:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012ec94600/0x40a459093b069b49 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20e95 expref: 18 pid: 7149 timeout: 925 lvb_type: 1 00010000:00010000:0.0:1746129570.556035:0:7086:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ec94600/0x40a459093b069b49 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20e95 expref: 18 pid: 7149 timeout: 925 lvb_type: 1 00010000:00010000:0.0:1746129570.556042:0:7086:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129570.556051:0:7086:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094efca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ada2ffba-8920-4ecb-8068-68caa9806978+17:1961:x1830948734101888:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 42us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129570.556055:0:7086:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8257 00010000:00010000:3.0:1746129570.556086:0:8412:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880094c08400/0x40a459093b069c29 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129570.556093:0:8412:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094c08400/0x40a459093b069c29 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129570.556098:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00010000:00010000:3.0:1746129570.556108:0:8412:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880094c08400/0x40a459093b069c29 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129570.556111:0:7086:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734102144 00000100:00100000:0.0:1746129570.556113:0:7086:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734102144 00010000:00010000:3.0:1746129570.556114:0:8412:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880094c08400/0x40a459093b069c29 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129570.556121:0:8412:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880094c08400/0x40a459093b069c29 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129570.556121:0:7086:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f8d5a00/0x40a459093b069b3b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20e87 expref: 12 pid: 7149 timeout: 925 lvb_type: 0 00010000:00010000:3.0:1746129570.556126:0:8412:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094c08400 already unused, calling callback (ffffffffa086ed70) 00010000:00010000:3.0:1746129570.556130:0:8412:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880094c08400/0x40a459093b069c29 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129570.556131:0:7086:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8258 00000100:00100000:0.0:1746129570.556134:0:7086:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094efdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+12:1961:x1830948734102144:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129570.556137:0:8412:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880094c08400/0x40a459093b069c29 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129570.556142:0:7086:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129570.556146:0:8412:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880094c08400/0x40a459093b069c29 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129570.556148:0:7086:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f8d5a00/0x40a459093b069b3b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20e87 expref: 12 pid: 7149 timeout: 925 lvb_type: 0 00010000:00010000:3.0:1746129570.556151:0:8412:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094c08400/0x40a459093b069c29 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129570.556185:0:8412:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009507f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:068dab75-d300-4ead-a742-d14572ad1e50+7:1962:x1830948734100992:12345-192.168.202.4@tcp:1:lfs.0 Request processed in 12988us (13984us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129570.556191:0:8412:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16105 00010000:00010000:0.0:1746129570.556540:0:7086:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f8d5a00/0x40a459093b069b3b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20e87 expref: 12 pid: 7149 timeout: 925 lvb_type: 0 00010000:00010000:0.0:1746129570.556550:0:7086:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f8d5a00/0x40a459093b069b3b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20e87 expref: 12 pid: 7149 timeout: 925 lvb_type: 0 00010000:00010000:0.0:1746129570.556556:0:7086:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129570.556558:0:7086:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129570.556560:0:7086:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800915dd400/0x40a459093b069c1b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129570.556565:0:7086:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800915dd400/0x40a459093b069c1b lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129570.556586:0:7086:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129570.556601:0:7086:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094efdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+11:1961:x1830948734102144:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 465us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129570.556606:0:7086:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8258 00010000:00010000:2.0:1746129570.556865:0:20577:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800915dd400/0x40a459093b069c1b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129570.556872:0:20577:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800915dd400/0x40a459093b069c1b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129570.556884:0:20577:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800915dd400/0x40a459093b069c1b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129570.556890:0:20577:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800915dd400/0x40a459093b069c1b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129570.556900:0:20577:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800915dd400/0x40a459093b069c1b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129570.556905:0:20577:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800915dd400 already unused, calling callback (ffffffffa086ed70) 00010000:00010000:2.0:1746129570.556908:0:20577:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800915dd400/0x40a459093b069c1b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129570.556913:0:20577:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800915dd400/0x40a459093b069c1b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129570.556922:0:20577:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800915dd400/0x40a459093b069c1b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129570.556927:0:20577:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800915dd400/0x40a459093b069c1b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129570.556969:0:20577:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009507f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:068dab75-d300-4ead-a742-d14572ad1e50+7:1962:x1830948734100736:12345-192.168.202.4@tcp:1:lfs.0 Request processed in 14170us (14823us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129570.556975:0:20577:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16103 00000100:00100000:0.0:1746129570.558863:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129570.559344:0:7086:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734103168 00000100:00100000:2.0:1746129570.559352:0:7086:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734103168 00010000:00010000:2.0:1746129570.559380:0:7086:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095b5f400/0x40a459093b069b6c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20eb8 expref: 15 pid: 8410 timeout: 925 lvb_type: 0 00000100:00100000:2.0:1746129570.563380:0:7086:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8259 00000100:00100000:2.0:1746129570.563400:0:7086:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094efc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+15:1961:x1830948734103168:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129570.563418:0:7086:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129570.563441:0:7086:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095b5f400/0x40a459093b069b6c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20eb8 expref: 15 pid: 8410 timeout: 925 lvb_type: 0 00010000:00010000:2.0:1746129570.563452:0:7086:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095b5f400/0x40a459093b069b6c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20eb8 expref: 15 pid: 8410 timeout: 925 lvb_type: 0 00010000:00010000:2.0:1746129570.563470:0:7086:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095b5f400/0x40a459093b069b6c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20eb8 expref: 15 pid: 8410 timeout: 925 lvb_type: 0 00010000:00010000:2.0:1746129570.563482:0:7086:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129570.563483:0:7086:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129570.563487:0:7086:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012eb5b800/0x40a459093b069c22 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129570.563494:0:7086:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012eb5b800/0x40a459093b069c22 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129570.563537:0:7086:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746129570.563583:0:11014:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012eb5b800/0x40a459093b069c22 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129570.563583:0:7086:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094efc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+14:1961:x1830948734103168:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 193us (4726us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129570.563589:0:7086:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8259 00010000:00010000:3.0:1746129570.563591:0:11014:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012eb5b800/0x40a459093b069c22 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129570.563609:0:11014:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012eb5b800/0x40a459093b069c22 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129570.563616:0:11014:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012eb5b800/0x40a459093b069c22 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129570.563623:0:11014:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012eb5b800/0x40a459093b069c22 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129570.563628:0:11014:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012eb5b800 already unused, calling callback (ffffffffa086ed70) 00010000:00010000:3.0:1746129570.563631:0:11014:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012eb5b800/0x40a459093b069c22 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129570.563637:0:11014:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012eb5b800/0x40a459093b069c22 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129570.563646:0:11014:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012eb5b800/0x40a459093b069c22 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129570.563651:0:11014:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012eb5b800/0x40a459093b069c22 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129570.563696:0:11014:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009507ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:068dab75-d300-4ead-a742-d14572ad1e50+6:1963:x1830948734100864:12345-192.168.202.4@tcp:1:lfs.0 Request processed in 20634us (21514us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129570.563702:0:11014:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16104 00000100:00100000:3.0:1746129570.564452:0:8416:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009016ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ada2ffba-8920-4ecb-8068-68caa9806978+17:1963:x1830948734102400:12345-192.168.202.4@tcp:4:cat.0 Request processed in 11853us (12521us total) trans 21474841334 rc 0/0 00000100:00100000:3.0:1746129570.564459:0:8416:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2415 00002000:00100000:3.0:1746129570.564466:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3ef:0x0] (2334720->2355199) req@ffff88009016ad80 x1830948734102400/t21474841334(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:311/0 lens 488/448 e 0 to 0 dl 1746129581 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129570.564474:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009016ad80 with x1830948734102400 ext(2334720->2355199) 00010000:00010000:3.0:1746129570.564480:0:8416:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f8d5000/0x40a459093b069b34 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2334720->2355199) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20e80 expref: 17 pid: 7149 timeout: 925 lvb_type: 0 00010000:00010000:3.0:1746129570.564489:0:8416:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f8d5000/0x40a459093b069b34 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2334720->2355199) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20e80 expref: 17 pid: 7149 timeout: 925 lvb_type: 0 00002000:00010000:3.0:1746129570.564494:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009016ad80 00000100:00100000:0.0:1746129570.571235:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129570.571259:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129570.571283:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129570.571341:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734103296 00000100:00100000:0.0:1746129570.571347:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734103296 00010000:00010000:0.0:1746129570.571374:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012dc1b000/0x40a459093b069bea lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20f0c expref: 11 pid: 7148 timeout: 925 lvb_type: 0 00000100:00100000:0.0:1746129570.571393:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734103424 00000100:00100000:0.0:1746129570.571394:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734103424 00010000:00010000:0.0:1746129570.571401:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009584f400/0x40a459093b069bc7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20ef7 expref: 17 pid: 11014 timeout: 925 lvb_type: 0 00000100:00100000:0.0:1746129570.571412:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734103552 00000100:00100000:0.0:1746129570.571414:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734103552 00010000:00010000:0.0:1746129570.571420:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f8d5000/0x40a459093b069b34 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2334720->2355199) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20e80 expref: 18 pid: 7149 timeout: 925 lvb_type: 0 00000100:00100000:0.0:1746129570.571432:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8260 00000100:00100000:0.0:1746129570.571437:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6ce1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+11:1963:x1830948734103296:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129570.571448:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129570.571464:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012dc1b000/0x40a459093b069bea lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20f0c expref: 11 pid: 7148 timeout: 925 lvb_type: 0 00010000:00010000:0.0:1746129570.571473:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012dc1b000/0x40a459093b069bea lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20f0c expref: 11 pid: 7148 timeout: 925 lvb_type: 0 00010000:00010000:0.0:1746129570.571491:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012dc1b000/0x40a459093b069bea lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20f0c expref: 11 pid: 7148 timeout: 925 lvb_type: 0 00010000:00010000:0.0:1746129570.571503:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129570.571534:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6ce1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+10:1963:x1830948734103296:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 97us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129570.571543:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8260 00000100:00100000:0.0:1746129570.571575:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8261 00000100:00100000:0.0:1746129570.571579:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094efd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ada2ffba-8920-4ecb-8068-68caa9806978+18:1962:x1830948734103424:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129570.571585:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129570.571591:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009584f400/0x40a459093b069bc7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20ef7 expref: 18 pid: 11014 timeout: 925 lvb_type: 0 00010000:00010000:0.0:1746129570.571599:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009584f400/0x40a459093b069bc7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20ef7 expref: 18 pid: 11014 timeout: 925 lvb_type: 0 00010000:00010000:0.0:1746129570.571608:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009584f400/0x40a459093b069bc7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20ef7 expref: 18 pid: 11014 timeout: 925 lvb_type: 0 00010000:00010000:0.0:1746129570.571616:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129570.571617:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129570.571620:0:7085:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800909cee00/0x40a459093b069c30 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129570.571626:0:7085:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800909cee00/0x40a459093b069c30 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129570.571643:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129570.571655:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094efd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ada2ffba-8920-4ecb-8068-68caa9806978+17:1962:x1830948734103424:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 76us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129570.571660:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8261 00000100:00100000:0.0:1746129570.571668:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8262 00000100:00100000:0.0:1746129570.571673:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094efc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ada2ffba-8920-4ecb-8068-68caa9806978+16:1963:x1830948734103552:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129570.571678:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129570.571686:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f8d5000/0x40a459093b069b34 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2334720->2355199) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20e80 expref: 16 pid: 7149 timeout: 925 lvb_type: 0 00010000:00010000:0.0:1746129570.571692:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f8d5000/0x40a459093b069b34 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2334720->2355199) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20e80 expref: 16 pid: 7149 timeout: 925 lvb_type: 0 00010000:00010000:0.0:1746129570.571701:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f8d5000/0x40a459093b069b34 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2334720->2355199) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20e80 expref: 16 pid: 7149 timeout: 925 lvb_type: 0 00010000:00010000:0.0:1746129570.571708:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129570.571709:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129570.571711:0:7085:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012dc1bc00/0x40a459093b069c37 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129570.571716:0:7085:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dc1bc00/0x40a459093b069c37 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129570.571726:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746129570.571997:0:7148:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800909cee00/0x40a459093b069c30 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129570.572004:0:7148:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800909cee00/0x40a459093b069c30 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129570.572019:0:7148:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800909cee00/0x40a459093b069c30 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129570.572026:0:7148:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800909cee00/0x40a459093b069c30 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129570.572032:0:7148:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800909cee00/0x40a459093b069c30 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129570.572038:0:7148:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800909cee00 already unused, calling callback (ffffffffa086ed70) 00010000:00010000:1.0:1746129570.572041:0:7148:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800909cee00/0x40a459093b069c30 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129570.572046:0:7148:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800909cee00/0x40a459093b069c30 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129570.572055:0:7148:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800909cee00/0x40a459093b069c30 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129570.572060:0:7148:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800909cee00/0x40a459093b069c30 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129570.572095:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009507dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:068dab75-d300-4ead-a742-d14572ad1e50+6:1963:x1830948734101120:12345-192.168.202.4@tcp:1:lfs.0 Request processed in 28739us (29882us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129570.572102:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16106 00010000:00010000:2.0:1746129570.573723:0:31503:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012dc1bc00/0x40a459093b069c37 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129570.573733:0:31503:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012dc1bc00/0x40a459093b069c37 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129570.573755:0:31503:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012dc1bc00/0x40a459093b069c37 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129570.573761:0:31503:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012dc1bc00/0x40a459093b069c37 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129570.573767:0:31503:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012dc1bc00/0x40a459093b069c37 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129570.573772:0:31503:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012dc1bc00 already unused, calling callback (ffffffffa086ed70) 00010000:00010000:2.0:1746129570.573774:0:31503:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012dc1bc00/0x40a459093b069c37 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129570.573780:0:31503:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012dc1bc00/0x40a459093b069c37 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129570.573789:0:31503:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012dc1bc00/0x40a459093b069c37 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129570.573793:0:31503:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012dc1bc00/0x40a459093b069c37 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129570.573844:0:31503:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009507df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:068dab75-d300-4ead-a742-d14572ad1e50+5:1962:x1830948734101248:12345-192.168.202.4@tcp:1:lfs.0 Request processed in 30303us (31611us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129570.573851:0:31503:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16107 00000100:00100000:3.0:1746129570.574704:0:31521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094efc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+14:1963:x1830948734102528:12345-192.168.202.4@tcp:4:multiop.0 Request processed in 19010us (20269us total) trans 17179874091 rc 0/0 00000100:00100000:3.0:1746129570.574713:0:31521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2416 00002000:00100000:3.0:1746129570.574721:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f5:0x0] (3588096->4050943) req@ffff880094efc380 x1830948734102528/t17179874091(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:311/0 lens 488/448 e 0 to 0 dl 1746129581 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00000100:00100000:0.0:1746129570.575372:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094efc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ada2ffba-8920-4ecb-8068-68caa9806978+15:1963:x1830948734103552:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 64us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129570.575380:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8262 00000100:00100000:0.0:1746129570.575433:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00002000:00100000:3.0:1746129570.575528:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094efc380 with x1830948734102528 ext(3588096->4050943) 00010000:00010000:3.0:1746129570.575544:0:31521:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f8d5800/0x40a459093b069b42 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3588096->4050943) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20e8e expref: 14 pid: 7149 timeout: 925 lvb_type: 0 00010000:00010000:3.0:1746129570.575561:0:31521:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f8d5800/0x40a459093b069b42 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3588096->4050943) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20e8e expref: 14 pid: 7149 timeout: 925 lvb_type: 0 00002000:00010000:3.0:1746129570.575567:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094efc380 00000100:00100000:2.0:1746129570.575647:0:31503:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734103808 00000100:00100000:2.0:1746129570.575653:0:31503:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734103808 00000100:00100000:2.0:1746129570.575678:0:31503:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16109 00000100:00100000:2.0:1746129570.575683:0:31503:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094efd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+10:32273:x1830948734103808:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129570.575696:0:31503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129570.575709:0:31503:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094c09c00/0x40a459093b069c5a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20f3d expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746129570.575725:0:31503:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3ef:0x0] initial LVB size: 5146336, mtime: 0x6813d2a3, atime: 0x6813d2a2, ctime: 0x6813d2a3, blocks: 0x1791 00010000:00010000:2.0:1746129570.575738:0:31503:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129570.575739:0:31503:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129570.575745:0:31503:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094c09c00/0x40a459093b069c5a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20f3d expref: 11 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129570.575755:0:31503:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094c09c00/0x40a459093b069c5a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20f3d expref: 11 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129570.575762:0:31503:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094c09c00, rc 0) 00000100:00100000:2.0:1746129570.575793:0:31503:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094efd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+11:32273:x1830948734103808:12345-192.168.202.4@tcp:101:cat.0 Request processed in 109us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129570.575798:0:31503:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16109 00000100:00100000:0.0:1746129570.575949:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129570.576164:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734103680 00000100:00100000:1.0:1746129570.576168:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734103680 00000100:00100000:1.0:1746129570.576188:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16110 00000100:00100000:1.0:1746129570.576192:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094efce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ada2ffba-8920-4ecb-8068-68caa9806978+15:32276:x1830948734103680:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129570.576199:0:7148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129570.576206:0:7148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800909ce000/0x40a459093b069c61 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20f36 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129570.576220:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129570.576222:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129570.576225:0:7148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800909ce000/0x40a459093b069c61 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20f36 expref: 16 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129570.576232:0:7148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800909ce000/0x40a459093b069c61 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20f36 expref: 16 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129570.576238:0:7148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800909ce000, rc 0) 00000100:00100000:1.0:1746129570.576257:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094efce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ada2ffba-8920-4ecb-8068-68caa9806978+16:32276:x1830948734103680:12345-192.168.202.4@tcp:101:cat.0 Request processed in 64us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129570.576261:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16110 00000100:00100000:1.0:1746129570.580640:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129570.580672:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129570.581174:0:15749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734104192 00000100:00100000:0.0:1746129570.581182:0:15749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734104192 00010000:00010000:0.0:1746129570.581224:0:15749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f8d5800/0x40a459093b069b42 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3588096->4050943) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20e8e expref: 14 pid: 7149 timeout: 925 lvb_type: 0 00000100:00100000:0.0:1746129570.581258:0:15749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8263 00000100:00100000:0.0:1746129570.581265:0:15749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a77b1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+14:1962:x1830948734104192:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129570.581276:0:15749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129570.581314:0:15749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f8d5800/0x40a459093b069b42 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3588096->4050943) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20e8e expref: 14 pid: 7149 timeout: 925 lvb_type: 0 00010000:00010000:0.0:1746129570.581335:0:15749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f8d5800/0x40a459093b069b42 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3588096->4050943) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20e8e expref: 14 pid: 7149 timeout: 925 lvb_type: 0 00010000:00010000:0.0:1746129570.581354:0:15749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f8d5800/0x40a459093b069b42 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3588096->4050943) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20e8e expref: 14 pid: 7149 timeout: 925 lvb_type: 0 00010000:00010000:0.0:1746129570.581364:0:15749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129570.581366:0:15749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129570.581370:0:15749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012dc1ae00/0x40a459093b069c3e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129570.581377:0:15749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dc1ae00/0x40a459093b069c3e lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129570.581394:0:15749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129570.581430:0:15749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a77b1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+13:1962:x1830948734104192:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 165us (796us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129570.581436:0:15749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8263 00000100:00100000:3.0:1746129570.582312:0:31521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734104064 00000100:00100000:3.0:1746129570.582327:0:31521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734104064 00002000:00100000:3.0:1746129570.582352:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3ef:0x0] (2097152->3145727) req@ffff8800a77b0000 x1830948734104064/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:311/0 lens 488/0 e 0 to 0 dl 1746129581 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129570.582360:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a77b0000 with x1830948734104064 ext(2097152->3145727) 00002000:00010000:3.0:1746129570.582364:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a77b0000 00010000:00010000:2.0:1746129570.582364:0:4699:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012dc1ae00/0x40a459093b069c3e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129570.582372:0:4699:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012dc1ae00/0x40a459093b069c3e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129570.582376:0:31521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7759 00000100:00100000:3.0:1746129570.582380:0:31521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a77b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+11:1962:x1830948734104064:12345-192.168.202.4@tcp:3:cat.0 00010000:00010000:2.0:1746129570.582391:0:4699:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012dc1ae00/0x40a459093b069c3e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129570.582398:0:4699:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012dc1ae00/0x40a459093b069c3e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129570.582403:0:4699:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012dc1ae00/0x40a459093b069c3e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129570.582408:0:4699:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012dc1ae00 already unused, calling callback (ffffffffa086ed70) 00010000:00010000:2.0:1746129570.582411:0:4699:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012dc1ae00/0x40a459093b069c3e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129570.582417:0:4699:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012dc1ae00/0x40a459093b069c3e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129570.582426:0:4699:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012dc1ae00/0x40a459093b069c3e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129570.582430:0:4699:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012dc1ae00/0x40a459093b069c3e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129570.582466:0:4699:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:068dab75-d300-4ead-a742-d14572ad1e50+5:1963:x1830948734101376:12345-192.168.202.4@tcp:1:lfs.0 Request processed in 38835us (40214us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129570.582472:0:4699:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16108 00000100:00100000:1.0:1746129570.588557:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129570.588590:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129570.588633:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129570.588693:0:15096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734104448 00000100:00100000:0.0:1746129570.588700:0:15096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734104448 00000100:00100000:0.0:1746129570.588730:0:15096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734104704 00000100:00100000:0.0:1746129570.588732:0:15096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734104704 00000100:00100000:0.0:1746129570.588745:0:15096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11205 00000100:00100000:0.0:1746129570.588752:0:15096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a77b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ada2ffba-8920-4ecb-8068-68caa9806978+311:32283:x1830948734104448:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:0.0:1746129570.588769:0:15096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129570.588781:0:15096:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc1b200/0x40a459093b069c68 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20f44 expref: -99 pid: 15096 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129570.588827:0:2271:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11206 00000100:00100000:2.0:1746129570.588834:0:2271:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a77b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:068dab75-d300-4ead-a742-d14572ad1e50+18:32279:x1830948734104704:12345-192.168.202.4@tcp:36:lfs.0 00010000:00010000:0.0:1746129570.588850:0:15096:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc1a000/0x40a459093b069c6f lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 15096 initiator: MDT0 00010000:00010000:0.0:1746129570.588862:0:15096:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc1a000/0x40a459093b069c6f lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 15096 initiator: MDT0 00000100:00100000:2.0:1746129570.588893:0:2271:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a77b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:068dab75-d300-4ead-a742-d14572ad1e50+18:32279:x1830948734104704:12345-192.168.202.4@tcp:36:lfs.0 Request processed in 59us (302us total) trans 0 rc -116/-116 00000100:00100000:2.0:1746129570.588899:0:2271:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11206 00000100:00100000:2.0:1746129570.588919:0:4699:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734104832 00000100:00100000:2.0:1746129570.588921:0:4699:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734104832 00000100:00100000:2.0:1746129570.588938:0:4699:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16111 00000100:00100000:2.0:1746129570.588942:0:4699:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a77b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+13:32281:x1830948734104832:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:2.0:1746129570.588949:0:4699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129570.588959:0:4699:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094c09a00/0x40a459093b069c76 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20f4b expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746129570.588977:0:4699:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3f4:0x0] initial LVB size: 2097152, mtime: 0x6813d2a3, atime: 0x6813d2a2, ctime: 0x6813d2a2, blocks: 0x821 00010000:00010000:2.0:1746129570.588987:0:4699:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129570.588989:0:4699:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129570.588994:0:4699:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094c09a00/0x40a459093b069c76 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1253376->1675263) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20f4b expref: 14 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129570.589004:0:4699:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094c09a00/0x40a459093b069c76 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1253376->1675263) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20f4b expref: 14 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129570.589012:0:4699:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094c09a00, rc 0) 00010000:00010000:0.0:1746129570.589016:0:15096:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc1a000/0x40a459093b069c6f lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 15096 initiator: MDT0 00000004:00200000:0.0:1746129570.589027:0:15096:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00000100:00100000:2.0:1746129570.589028:0:4699:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a77b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+14:32281:x1830948734104832:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 85us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129570.589032:0:4699:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16111 00010000:00010000:0.0:1746129570.589107:0:15096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc1b200/0x40a459093b069c68 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20f44 expref: 314 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129570.589119:0:15096:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc1a000/0x40a459093b069c6f lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20f44 expref: 313 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129570.589125:0:15096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:0.0:1746129570.589128:0:15096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746129570.589130:0:15096:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dc1a000, rc 0) 00000100:00100000:0.0:1746129570.589150:0:15096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a77b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ada2ffba-8920-4ecb-8068-68caa9806978+313:32283:x1830948734104448:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 399us (599us total) trans 8589945298 rc 0/0 00000100:00100000:0.0:1746129570.589155:0:15096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11205 00000100:00100000:0.0:1746129570.592787:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129570.593030:0:8416:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734105088 00000100:00100000:2.0:1746129570.593038:0:8416:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734105088 00002000:00100000:2.0:1746129570.593073:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3ef:0x0] (2097152->3145727) req@ffff880094eff100 x1830948734105088/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:311/0 lens 488/0 e 0 to 0 dl 1746129581 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129570.593087:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094eff100 with x1830948734105088 ext(2097152->3145727) 00002000:00010000:2.0:1746129570.593091:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094eff100 00000100:00100000:2.0:1746129570.593124:0:8416:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7760 00000100:00100000:2.0:1746129570.593130:0:8416:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ada2ffba-8920-4ecb-8068-68caa9806978+16:1963:x1830948734105088:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129570.593822:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129570.593852:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129570.593882:0:21725:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734105600 00000100:00100000:1.0:1746129570.593886:0:21725:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734105600 00002000:00100000:1.0:1746129570.593904:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f4:0x0] (1253376->1257471) req@ffff880094efca80 x1830948734105600/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:311/0 lens 488/0 e 0 to 0 dl 1746129581 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129570.593910:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094efca80 with x1830948734105600 ext(1253376->1257471) 00002000:00010000:1.0:1746129570.593914:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094efca80 00000100:00100000:1.0:1746129570.593927:0:21725:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7761 00000100:00100000:1.0:1746129570.593932:0:21725:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094efca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+14:1962:x1830948734105600:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:3.0:1746129570.593981:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734105344 00000100:00100000:3.0:1746129570.593985:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734105344 00000100:00100000:3.0:1746129570.594005:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4750 00000100:00100000:3.0:1746129570.594009:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095f17c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:068dab75-d300-4ead-a742-d14572ad1e50+18:32279:x1830948734105344:12345-192.168.202.4@tcp:35:lfs.0 00000100:00100000:1.0:1746129570.594048:0:21725:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094efca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+14:1962:x1830948734105600:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 115us (194us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746129570.594053:0:21725:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7761 00002000:00100000:1.0:1746129570.594058:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f4:0x0] (1253376->1257471) req@ffff880094efca80 x1830948734105600/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:311/0 lens 488/4536 e 0 to 0 dl 1746129581 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129570.594064:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094efca80 with x1830948734105600 ext(1253376->1257471) 00002000:00010000:1.0:1746129570.594067:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094efca80 00000100:00100000:3.0:1746129570.594180:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095f17c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:068dab75-d300-4ead-a742-d14572ad1e50+19:32279:x1830948734105344:12345-192.168.202.4@tcp:35:lfs.0 Request processed in 169us (357us total) trans 8589945299 rc 0/0 00000100:00100000:3.0:1746129570.594185:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4750 00000100:00100000:3.0:1746129570.599668:0:31521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a77b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+11:1962:x1830948734104064:12345-192.168.202.4@tcp:3:cat.0 Request processed in 17280us (18988us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129570.599677:0:31521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7759 00002000:00100000:3.0:1746129570.599686:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3ef:0x0] (2097152->3145727) req@ffff8800a77b0000 x1830948734104064/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:311/0 lens 488/440 e 0 to 0 dl 1746129581 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129570.599694:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a77b0000 with x1830948734104064 ext(2097152->3145727) 00002000:00010000:3.0:1746129570.599699:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a77b0000 00000100:00100000:2.0:1746129570.602406:0:8416:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ada2ffba-8920-4ecb-8068-68caa9806978+16:1963:x1830948734105088:12345-192.168.202.4@tcp:3:cat.0 Request processed in 9269us (9619us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129570.602415:0:8416:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7760 00002000:00100000:2.0:1746129570.602424:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3ef:0x0] (2097152->3145727) req@ffff880094eff100 x1830948734105088/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:311/0 lens 488/440 e 0 to 0 dl 1746129581 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129570.602431:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094eff100 with x1830948734105088 ext(2097152->3145727) 00002000:00010000:2.0:1746129570.602436:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094eff100 00000100:00100000:0.0:1746129570.604041:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129570.604126:0:14551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734105856 00000100:00100000:3.0:1746129570.604133:0:14551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734105856 00000100:00100000:3.0:1746129570.604164:0:14551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4751 00000100:00100000:3.0:1746129570.604171:0:14551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094efdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:068dab75-d300-4ead-a742-d14572ad1e50+19:32279:x1830948734105856:12345-192.168.202.4@tcp:35:lfs.0 00000100:00100000:3.0:1746129570.604401:0:14551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094efdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:068dab75-d300-4ead-a742-d14572ad1e50+20:32279:x1830948734105856:12345-192.168.202.4@tcp:35:lfs.0 Request processed in 229us (362us total) trans 8589945300 rc 0/0 00000100:00100000:3.0:1746129570.604407:0:14551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4751 00000100:00100000:0.0:1746129570.607389:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129570.607456:0:8416:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734106112 00000100:00100000:2.0:1746129570.607463:0:8416:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734106112 00002000:00100000:2.0:1746129570.607499:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3f4:0x0] (1671168->1675263) req@ffff880094efc700 x1830948734106112/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:311/0 lens 488/0 e 0 to 0 dl 1746129581 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129570.607508:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094efc700 with x1830948734106112 ext(1671168->1675263) 00002000:00010000:2.0:1746129570.607513:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094efc700 00000100:00100000:2.0:1746129570.607540:0:8416:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7762 00000100:00100000:2.0:1746129570.607547:0:8416:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094efc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+14:1962:x1830948734106112:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:2.0:1746129570.607687:0:8416:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094efc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+14:1962:x1830948734106112:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 139us (303us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129570.607693:0:8416:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7762 00002000:00100000:2.0:1746129570.607698:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3f4:0x0] (1671168->1675263) req@ffff880094efc700 x1830948734106112/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:311/0 lens 488/4536 e 0 to 0 dl 1746129581 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129570.607705:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094efc700 with x1830948734106112 ext(1671168->1675263) 00002000:00010000:2.0:1746129570.607708:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094efc700 00000100:00100000:0.0:1746129570.608457:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129570.608709:0:31503:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734106368 00000100:00100000:2.0:1746129570.608714:0:31503:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734106368 00000100:00100000:2.0:1746129570.608758:0:31503:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16112 00000100:00100000:2.0:1746129570.608971:0:31503:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094effb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ada2ffba-8920-4ecb-8068-68caa9806978+16:32283:x1830948734106368:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:2.0:1746129570.608982:0:31503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129570.608996:0:31503:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094c09800/0x40a459093b069c84 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20f59 expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129570.609015:0:31503:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094c09c00/0x40a459093b069c5a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20f3d expref: 10 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129570.609023:0:31503:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800909ce000/0x40a459093b069c61 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20f36 expref: 17 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129570.609029:0:31503:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129570.609030:0:31503:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129570.609033:0:31503:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094c09800/0x40a459093b069c84 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [3280896->3440639] (req 3280896->3440639) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20f59 expref: 17 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129570.609058:0:31503:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800909ce000/0x40a459093b069c61 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20f36 expref: 17 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129570.609068:0:31503:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800909ce000/0x40a459093b069c61 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20f36 expref: 17 pid: 7148 timeout: 925 lvb_type: 0 00000100:00100000:2.0:1746129570.609079:0:31503:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009016aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:31503:1830948737506176:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129570.609137:0:31503:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094c09c00/0x40a459093b069c5a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20f3d expref: 10 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129570.609144:0:31503:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094c09c00/0x40a459093b069c5a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20f3d expref: 10 pid: 31503 timeout: 925 lvb_type: 0 00000100:00100000:2.0:1746129570.609151:0:31503:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090168a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:31503:1830948737506304:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129570.609168:0:31503:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a00e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746129570.611173:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129570.613546:0:31503:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009016aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:31503:1830948737506176:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129570.613557:0:31503:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090168a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:31503:1830948737506304:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129570.613579:0:31503:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094c09800/0x40a459093b069c84 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [3280896->3440639] (req 3280896->3440639) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20f59 expref: 17 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129570.613592:0:31503:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094c09800, rc 0) 00000100:00100000:2.0:1746129570.613625:0:31503:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094effb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ada2ffba-8920-4ecb-8068-68caa9806978+17:32283:x1830948734106368:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 4656us (5168us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129570.613631:0:31503:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16112 00000100:00100000:2.0:1746129570.613655:0:31503:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734106240 00000100:00100000:2.0:1746129570.613659:0:31503:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734106240 00000100:00100000:2.0:1746129570.614151:0:31503:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16113 00000100:00100000:2.0:1746129570.614159:0:31503:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ceea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ada2ffba-8920-4ecb-8068-68caa9806978+25:32276:x1830948734106240:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129570.614170:0:31503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129570.614183:0:31503:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094c08000/0x40a459093b069c8b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20f52 expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746129570.614202:0:31503:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3f5:0x0] initial LVB size: 4194304, mtime: 0x6813d2a3, atime: 0x6813d2a0, ctime: 0x6813d2a3, blocks: 0x1029 00010000:00010000:2.0:1746129570.614214:0:31503:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129570.614216:0:31503:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129570.614222:0:31503:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094c08000/0x40a459093b069c8b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20f52 expref: 26 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129570.614232:0:31503:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094c08000/0x40a459093b069c8b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20f52 expref: 26 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129570.614238:0:31503:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094c08000, rc 0) 00000100:00100000:2.0:1746129570.614622:0:31503:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ceea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ada2ffba-8920-4ecb-8068-68caa9806978+26:32276:x1830948734106240:12345-192.168.202.4@tcp:101:cat.0 Request processed in 463us (3452us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129570.614628:0:31503:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16113 00000100:00100000:0.0:1746129570.616373:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129570.616444:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734106624 00000100:00100000:1.0:1746129570.616451:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734106624 00010000:00010000:1.0:1746129570.616478:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800909ce000/0x40a459093b069c61 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20f36 expref: 17 pid: 7148 timeout: 925 lvb_type: 0 00000100:00100000:1.0:1746129570.616499:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8264 00000100:00100000:1.0:1746129570.616505:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ceed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ada2ffba-8920-4ecb-8068-68caa9806978+17:1962:x1830948734106624:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129570.616514:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129570.616531:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800909ce000/0x40a459093b069c61 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20f36 expref: 17 pid: 7148 timeout: 925 lvb_type: 0 00010000:00010000:1.0:1746129570.616540:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800909ce000/0x40a459093b069c61 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20f36 expref: 17 pid: 7148 timeout: 925 lvb_type: 0 00010000:00010000:1.0:1746129570.616556:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800909ce000/0x40a459093b069c61 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20f36 expref: 17 pid: 7148 timeout: 925 lvb_type: 0 00010000:00010000:1.0:1746129570.616582:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129570.616614:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ceed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ada2ffba-8920-4ecb-8068-68caa9806978+16:1962:x1830948734106624:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 108us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129570.616619:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8264 00000100:00100000:0.0:1746129570.617469:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129570.617505:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129570.617574:0:15749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734106752 00000100:00100000:2.0:1746129570.617579:0:15749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734106752 00010000:00010000:2.0:1746129570.617593:0:15749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094c09c00/0x40a459093b069c5a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20f3d expref: 11 pid: 31503 timeout: 925 lvb_type: 0 00000100:00100000:3.0:1746129570.617807:0:31503:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734106496 00000100:00100000:3.0:1746129570.617811:0:31503:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734106496 00000100:00100000:3.0:1746129570.617831:0:31503:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16114 00000100:00100000:3.0:1746129570.617836:0:31503:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+14:32273:x1830948734106496:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129570.617846:0:31503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129570.617856:0:31503:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a6c65c00/0x40a459093b069c92 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20f60 expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129570.617872:0:31503:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129570.617873:0:31503:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129570.617878:0:31503:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6c65c00/0x40a459093b069c92 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20f60 expref: 15 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129570.617888:0:31503:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a6c65c00/0x40a459093b069c92 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20f60 expref: 15 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129570.617896:0:31503:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6c65c00, rc 0) 00000100:00100000:3.0:1746129570.617916:0:31503:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+15:32273:x1830948734106496:12345-192.168.202.4@tcp:101:cat.0 Request processed in 81us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129570.617921:0:31503:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16114 00000100:00100000:2.0:1746129570.618016:0:15749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8265 00000100:00100000:2.0:1746129570.618022:0:15749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ced880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+11:1963:x1830948734106752:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129570.618029:0:15749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129570.618041:0:15749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094c09c00/0x40a459093b069c5a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20f3d expref: 11 pid: 31503 timeout: 925 lvb_type: 0 00010000:00010000:2.0:1746129570.618055:0:15749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094c09c00/0x40a459093b069c5a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20f3d expref: 11 pid: 31503 timeout: 925 lvb_type: 0 00010000:00010000:2.0:1746129570.618067:0:15749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094c09c00/0x40a459093b069c5a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20f3d expref: 11 pid: 31503 timeout: 925 lvb_type: 0 00010000:00010000:2.0:1746129570.618741:0:15749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129570.618743:0:15749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129570.618748:0:15749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094c09800/0x40a459093b069c84 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3280896->3440639) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20f59 expref: 15 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129570.618756:0:15749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094c09800/0x40a459093b069c84 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3280896->3440639) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20f59 expref: 15 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129570.618781:0:15749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094c09800/0x40a459093b069c84 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3280896->3440639) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20f59 expref: 15 pid: 31503 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129570.618790:0:15749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090168a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15749:1830948737506432:192.168.202.4@tcp:105: 00000100:00100000:2.0:1746129570.618835:0:15749:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a000c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129570.620975:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129570.621036:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129570.621097:0:31521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734107008 00000100:00100000:3.0:1746129570.621103:0:31521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734107008 00002000:00100000:3.0:1746129570.621141:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f5:0x0] (2097152->3145727) req@ffff880093cef100 x1830948734107008/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:311/0 lens 488/0 e 0 to 0 dl 1746129581 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129570.621151:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093cef100 with x1830948734107008 ext(2097152->3145727) 00002000:00010000:3.0:1746129570.621155:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093cef100 00000100:00100000:3.0:1746129570.621168:0:31521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734107264 00000100:00100000:3.0:1746129570.621170:0:31521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734107264 00002000:00100000:3.0:1746129570.621179:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3ef:0x0] (3280896->3284991) req@ffff880093cef480 x1830948734107264/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:311/0 lens 488/0 e 0 to 0 dl 1746129581 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129570.621185:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093cef480 with x1830948734107264 ext(3280896->3284991) 00002000:00010000:3.0:1746129570.621188:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093cef480 00000100:00100000:2.0:1746129570.621190:0:15749:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090168a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15749:1830948737506432:192.168.202.4@tcp:105: 00010000:00010000:2.0:1746129570.621205:0:15749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129570.621235:0:15749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ced880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+10:1963:x1830948734106752:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 3212us (3766us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129570.621243:0:15749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8265 00000100:00100000:2.0:1746129570.621798:0:8416:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7763 00000100:00100000:2.0:1746129570.621806:0:8416:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ada2ffba-8920-4ecb-8068-68caa9806978+26:1963:x1830948734107008:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:0.0:1746129570.621834:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7764 00000100:00100000:0.0:1746129570.621842:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+16:1961:x1830948734107264:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:0.0:1746129570.621946:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+16:1961:x1830948734107264:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 105us (908us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746129570.621951:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7764 00002000:00100000:0.0:1746129570.621956:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ef:0x0] (3280896->3284991) req@ffff880093cef480 x1830948734107264/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:311/0 lens 488/4536 e 0 to 0 dl 1746129581 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129570.621963:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093cef480 with x1830948734107264 ext(3280896->3284991) 00002000:00010000:0.0:1746129570.621966:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093cef480 00000100:00100000:2.0:1746129570.624631:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129570.625051:0:31521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734107520 00000100:00100000:3.0:1746129570.625059:0:31521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734107520 00002000:00100000:3.0:1746129570.625094:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f5:0x0] (2097152->3145727) req@ffff880090168a80 x1830948734107520/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:311/0 lens 488/0 e 0 to 0 dl 1746129581 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129570.625102:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090168a80 with x1830948734107520 ext(2097152->3145727) 00002000:00010000:3.0:1746129570.625107:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090168a80 00000100:00100000:3.0:1746129570.625530:0:31521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7765 00000100:00100000:3.0:1746129570.625538:0:31521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090168a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+15:1963:x1830948734107520:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:2.0:1746129570.632015:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129570.632078:0:21725:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734107776 00000100:00100000:1.0:1746129570.632088:0:21725:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734107776 00002000:00100000:1.0:1746129570.632120:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ef:0x0] (3436544->3440639) req@ffff88009016aa00 x1830948734107776/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:311/0 lens 488/0 e 0 to 0 dl 1746129581 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129570.632129:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009016aa00 with x1830948734107776 ext(3436544->3440639) 00002000:00010000:1.0:1746129570.632133:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009016aa00 00000100:00100000:1.0:1746129570.632371:0:21725:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7766 00000100:00100000:1.0:1746129570.632379:0:21725:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009016aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ada2ffba-8920-4ecb-8068-68caa9806978+16:1962:x1830948734107776:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:1.0:1746129570.632507:0:21725:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009016aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ada2ffba-8920-4ecb-8068-68caa9806978+16:1962:x1830948734107776:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 129us (499us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746129570.632513:0:21725:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7766 00002000:00100000:1.0:1746129570.632517:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ef:0x0] (3436544->3440639) req@ffff88009016aa00 x1830948734107776/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:311/0 lens 488/4536 e 0 to 0 dl 1746129581 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129570.632524:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009016aa00 with x1830948734107776 ext(3436544->3440639) 00002000:00010000:1.0:1746129570.632526:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009016aa00 00000100:00100000:3.0:1746129570.632806:0:8416:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ada2ffba-8920-4ecb-8068-68caa9806978+26:1963:x1830948734107008:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 10998us (11835us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129570.632813:0:8416:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7763 00002000:00100000:3.0:1746129570.632818:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3f5:0x0] (2097152->3145727) req@ffff880093cef100 x1830948734107008/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:311/0 lens 488/440 e 0 to 0 dl 1746129581 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129570.632825:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093cef100 with x1830948734107008 ext(2097152->3145727) 00002000:00010000:3.0:1746129570.632829:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093cef100 00000100:00100000:2.0:1746129570.637593:0:31521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090168a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+15:1963:x1830948734107520:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 12048us (12960us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129570.637601:0:31521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7765 00002000:00100000:2.0:1746129570.637610:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f5:0x0] (2097152->3145727) req@ffff880090168a80 x1830948734107520/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:311/0 lens 488/440 e 0 to 0 dl 1746129581 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129570.637618:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090168a80 with x1830948734107520 ext(2097152->3145727) 00002000:00010000:2.0:1746129570.637622:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090168a80 00000100:00100000:0.0:1746129570.643837:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129570.643887:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129570.643973:0:11014:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734108160 00000100:00100000:3.0:1746129570.643980:0:11014:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734108160 00000100:00100000:3.0:1746129570.644016:0:11014:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16115 00000100:00100000:3.0:1746129570.644023:0:11014:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+10:32273:x1830948734108160:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129570.644037:0:11014:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129570.644051:0:11014:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a6c65a00/0x40a459093b069c99 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20f67 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129570.644075:0:11014:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094c09800/0x40a459093b069c84 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3280896->3440639) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20f59 expref: 15 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129570.644080:0:11014:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129570.644082:0:11014:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129570.644084:0:11014:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6c65a00/0x40a459093b069c99 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20f67 expref: 11 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129570.644107:0:11014:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094c09800/0x40a459093b069c84 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3280896->3440639) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20f59 expref: 15 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129570.644117:0:11014:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094c09800/0x40a459093b069c84 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3280896->3440639) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20f59 expref: 15 pid: 31503 timeout: 925 lvb_type: 0 00000100:00100000:3.0:1746129570.644126:0:11014:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094f46d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11014:1830948737506560:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129570.644201:0:11014:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a6ce8d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746129570.644267:0:31521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734108032 00000100:00100000:2.0:1746129570.644271:0:31521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734108032 00002000:00100000:2.0:1746129570.644327:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->4194303) req@ffff880093cef800 x1830948734108032/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:311/0 lens 504/0 e 0 to 0 dl 1746129581 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129570.644561:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093cef800 with x1830948734108032 ext(3145728->4194303) 00010000:00010000:2.0:1746129570.644567:0:31521:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094c09800/0x40a459093b069c84 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3280896->3440639) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20f59 expref: 16 pid: 31503 timeout: 925 lvb_type: 0 00010000:00010000:2.0:1746129570.644575:0:31521:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094c09800/0x40a459093b069c84 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3280896->3440639) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20f59 expref: 16 pid: 31503 timeout: 925 lvb_type: 0 00002000:00010000:2.0:1746129570.644581:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093cef800 00000100:00100000:2.0:1746129570.644598:0:31521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2417 00000100:00100000:2.0:1746129570.644604:0:31521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ada2ffba-8920-4ecb-8068-68caa9806978+16:1962:x1830948734108032:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:0.0:1746129570.649395:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129570.649530:0:11014:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094f46d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11014:1830948737506560:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129570.649555:0:11014:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a6c65a00/0x40a459093b069c99 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20f67 expref: 11 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129570.649573:0:11014:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6c65a00, rc 0) 00000100:00100000:3.0:1746129570.649611:0:8416:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734108416 00000100:00100000:3.0:1746129570.649617:0:8416:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734108416 00000100:00100000:2.0:1746129570.649620:0:11014:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+11:32273:x1830948734108160:12345-192.168.202.4@tcp:101:cat.0 Request processed in 5596us (5730us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129570.649627:0:11014:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16115 00002000:00100000:3.0:1746129570.649645:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3f5:0x0] (3145728->4194303) req@ffff880093ced180 x1830948734108416/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:311/0 lens 488/0 e 0 to 0 dl 1746129581 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129570.649660:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ced180 with x1830948734108416 ext(3145728->4194303) 00002000:00010000:3.0:1746129570.649664:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093ced180 00000100:00100000:3.0:1746129570.649679:0:8416:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7767 00000100:00100000:3.0:1746129570.649683:0:8416:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ced180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ada2ffba-8920-4ecb-8068-68caa9806978+26:1961:x1830948734108416:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:0.0:1746129570.649770:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129570.649793:0:21725:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734108544 00000100:00100000:1.0:1746129570.649796:0:21725:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734108544 00002000:00100000:1.0:1746129570.649810:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ef:0x0] (3280896->3440639) req@ffff880093cee680 x1830948734108544/t0(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:311/0 lens 488/0 e 0 to 0 dl 1746129581 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129570.649815:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093cee680 with x1830948734108544 ext(3280896->3440639) 00010000:00010000:1.0:1746129570.649824:0:21725:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094c09800/0x40a459093b069c84 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3280896->3440639) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20f59 expref: 18 pid: 31503 timeout: 925 lvb_type: 0 00010000:00010000:1.0:1746129570.649835:0:21725:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094c09800/0x40a459093b069c84 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3280896->3440639) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20f59 expref: 18 pid: 31503 timeout: 925 lvb_type: 0 00002000:00010000:1.0:1746129570.649839:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093cee680 00000100:00100000:1.0:1746129570.649847:0:21725:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2418 00000100:00100000:1.0:1746129570.649850:0:21725:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ada2ffba-8920-4ecb-8068-68caa9806978+18:1961:x1830948734108544:12345-192.168.202.4@tcp:4:multiop.0 00000100:00100000:2.0:1746129570.652073:0:31521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ada2ffba-8920-4ecb-8068-68caa9806978+18:1962:x1830948734108032:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 7462us (8236us total) trans 0 rc 888832/888832 00000100:00100000:2.0:1746129570.652082:0:31521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2417 00002000:00100000:2.0:1746129570.652242:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->4194303) req@ffff880093cef800 x1830948734108032/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:311/0 lens 504/440 e 0 to 0 dl 1746129581 ref 1 fl Complete:H/200/0 rc 888832/888832 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129570.652252:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093cef800 with x1830948734108032 ext(3145728->4194303) 00010000:00010000:2.0:1746129570.652260:0:31521:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094c09800/0x40a459093b069c84 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3280896->3440639) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20f59 expref: 18 pid: 31503 timeout: 925 lvb_type: 0 00010000:00010000:2.0:1746129570.652272:0:31521:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094c09800/0x40a459093b069c84 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3280896->3440639) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20f59 expref: 18 pid: 31503 timeout: 925 lvb_type: 0 00002000:00010000:2.0:1746129570.652277:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093cef800 00000100:00100000:1.0:1746129570.656018:0:21725:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ada2ffba-8920-4ecb-8068-68caa9806978+18:1961:x1830948734108544:12345-192.168.202.4@tcp:4:multiop.0 Request processed in 6160us (6240us total) trans 21474841335 rc 0/0 00000100:00100000:1.0:1746129570.656028:0:21725:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2418 00002000:00100000:1.0:1746129570.656038:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ef:0x0] (3280896->3440639) req@ffff880093cee680 x1830948734108544/t21474841335(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:311/0 lens 488/448 e 0 to 0 dl 1746129581 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129570.656047:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093cee680 with x1830948734108544 ext(3280896->3440639) 00010000:00010000:1.0:1746129570.656055:0:21725:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094c09800/0x40a459093b069c84 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3280896->3440639) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20f59 expref: 18 pid: 31503 timeout: 925 lvb_type: 0 00010000:00010000:1.0:1746129570.656068:0:21725:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094c09800/0x40a459093b069c84 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3280896->3440639) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20f59 expref: 18 pid: 31503 timeout: 925 lvb_type: 0 00002000:00010000:1.0:1746129570.656074:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093cee680 00000100:00100000:0.0:1746129570.660463:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129570.660544:0:15749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734108672 00000100:00100000:2.0:1746129570.660551:0:15749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734108672 00010000:00010000:2.0:1746129570.660584:0:15749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094c09800/0x40a459093b069c84 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3280896->3440639) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20f59 expref: 18 pid: 31503 timeout: 925 lvb_type: 0 00000100:00100000:2.0:1746129570.660617:0:15749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8266 00000100:00100000:2.0:1746129570.660623:0:15749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ceca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ada2ffba-8920-4ecb-8068-68caa9806978+18:1963:x1830948734108672:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129570.660634:0:15749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129570.660648:0:15749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094c09800/0x40a459093b069c84 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3280896->3440639) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20f59 expref: 18 pid: 31503 timeout: 925 lvb_type: 0 00010000:00010000:2.0:1746129570.660659:0:15749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094c09800/0x40a459093b069c84 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3280896->3440639) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20f59 expref: 18 pid: 31503 timeout: 925 lvb_type: 0 00010000:00010000:2.0:1746129570.660678:0:15749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094c09800/0x40a459093b069c84 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3280896->3440639) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20f59 expref: 18 pid: 31503 timeout: 925 lvb_type: 0 00010000:00010000:2.0:1746129570.660699:0:15749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129570.660700:0:15749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129570.660707:0:15749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a6c65a00/0x40a459093b069c99 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20f67 expref: 10 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129570.660714:0:15749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6c65a00/0x40a459093b069c99 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20f67 expref: 10 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129570.660739:0:15749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a6c65a00/0x40a459093b069c99 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20f67 expref: 10 pid: 11014 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129570.660748:0:15749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009016b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15749:1830948737506688:192.168.202.4@tcp:105: 00000100:00100000:2.0:1746129570.660800:0:15749:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a000c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746129570.660919:0:8416:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ced180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ada2ffba-8920-4ecb-8068-68caa9806978+26:1961:x1830948734108416:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 11234us (11529us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129570.660927:0:8416:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7767 00002000:00100000:3.0:1746129570.660935:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3f5:0x0] (3145728->4194303) req@ffff880093ced180 x1830948734108416/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:311/0 lens 488/440 e 0 to 0 dl 1746129581 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129570.660943:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ced180 with x1830948734108416 ext(3145728->4194303) 00002000:00010000:3.0:1746129570.660946:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093ced180 00000100:00100000:2.0:1746129570.662945:0:15749:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009016b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15749:1830948737506688:192.168.202.4@tcp:105: 00010000:00010000:2.0:1746129570.662960:0:15749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129570.663774:0:15749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ceca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ada2ffba-8920-4ecb-8068-68caa9806978+17:1963:x1830948734108672:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 3148us (3314us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129570.663783:0:15749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8266 00000100:00100000:0.0:1746129570.666089:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129570.666217:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129570.666269:0:31503:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734108800 00000100:00100000:1.0:1746129570.666276:0:31503:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734108800 00000100:00100000:2.0:1746129570.666278:0:11014:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734108928 00000100:00100000:2.0:1746129570.666282:0:11014:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734108928 00000100:00100000:2.0:1746129570.667561:0:11014:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16116 00000100:00100000:2.0:1746129570.667570:0:11014:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ada2ffba-8920-4ecb-8068-68caa9806978+26:1960:x1830948734108928:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129570.667584:0:11014:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129570.667599:0:11014:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800915dc600/0x40a459093b069ca0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20f75 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746129570.667617:0:11014:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3f3:0x0] initial LVB size: 2097152, mtime: 0x6813d2a3, atime: 0x6813d2a3, ctime: 0x6813d2a2, blocks: 0x81f 00010000:00010000:2.0:1746129570.667632:0:11014:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129570.667634:0:11014:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129570.667641:0:11014:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800915dc600/0x40a459093b069ca0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20f75 expref: 27 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129570.667653:0:11014:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800915dc600/0x40a459093b069ca0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20f75 expref: 27 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129570.667663:0:11014:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800915dc600, rc 0) 00000100:00100000:2.0:1746129570.667698:0:11014:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ada2ffba-8920-4ecb-8068-68caa9806978+27:1960:x1830948734108928:12345-192.168.202.4@tcp:101:cat.0 Request processed in 130us (1480us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129570.667704:0:11014:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16116 00000100:00100000:0.0:1746129570.667966:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129570.667971:0:31503:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16117 00000100:00100000:1.0:1746129570.667978:0:31503:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ada2ffba-8920-4ecb-8068-68caa9806978+17:1960:x1830948734108800:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129570.667990:0:31503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129570.667999:0:31503:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d863400/0x40a459093b069ca7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20f6e expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746129570.668014:0:31503:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3ec:0x0] initial LVB size: 1048576, mtime: 0x6813d2a2, atime: 0x6813d2a0, ctime: 0x6813d2a2, blocks: 0x819 00010000:00010000:1.0:1746129570.668022:0:31503:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129570.668024:0:31503:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129570.668028:0:31503:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d863400/0x40a459093b069ca7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20f6e expref: 18 pid: 31503 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129570.668039:0:31503:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d863400/0x40a459093b069ca7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20f6e expref: 18 pid: 31503 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129570.668046:0:31503:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d863400, rc 0) 00000100:00100000:1.0:1746129570.668063:0:31503:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ada2ffba-8920-4ecb-8068-68caa9806978+18:1960:x1830948734108800:12345-192.168.202.4@tcp:101:cat.0 Request processed in 86us (1979us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129570.668068:0:31503:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16117 00000100:00100000:1.0:1746129570.668078:0:31503:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734109056 00000100:00100000:1.0:1746129570.668082:0:31503:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734109056 00000100:00100000:1.0:1746129570.668097:0:31503:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16118 00000100:00100000:1.0:1746129570.668101:0:31503:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ced500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ada2ffba-8920-4ecb-8068-68caa9806978+27:1960:x1830948734109056:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129570.668106:0:31503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129570.668113:0:31503:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d863c00/0x40a459093b069cae lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20f7c expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129570.668143:0:31503:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a77b3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:31503:1830948737506816:192.168.202.4@tcp:106: 00000100:00100000:1.0:1746129570.668189:0:31503:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934d26c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129570.668289:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129570.668652:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129570.669191:0:20577:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734109184 00000100:00100000:2.0:1746129570.669196:0:20577:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734109184 00000100:00100000:2.0:1746129570.669213:0:20577:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734109312 00000100:00100000:2.0:1746129570.669215:0:20577:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734109312 00000100:00100000:2.0:1746129570.669227:0:20577:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16119 00000100:00100000:2.0:1746129570.669232:0:20577:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ada2ffba-8920-4ecb-8068-68caa9806978+19:1960:x1830948734109184:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129570.669240:0:20577:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129570.669248:0:20577:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800915dde00/0x40a459093b069cb5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20f83 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746129570.669260:0:20577:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3ee:0x0] initial LVB size: 2097152, mtime: 0x6813d2a3, atime: 0x6813d2a2, ctime: 0x6813d2a2, blocks: 0x81d 00010000:00010000:2.0:1746129570.669269:0:20577:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129570.669270:0:20577:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129570.669275:0:20577:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800915dde00/0x40a459093b069cb5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20f83 expref: 20 pid: 20577 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129570.669285:0:20577:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800915dde00/0x40a459093b069cb5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20f83 expref: 20 pid: 20577 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129570.669327:0:20577:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800915dde00, rc 0) 00000100:00100000:3.0:1746129570.669343:0:4699:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16120 00000100:00100000:3.0:1746129570.669352:0:4699:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f325f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ada2ffba-8920-4ecb-8068-68caa9806978+20:1960:x1830948734109312:12345-192.168.202.4@tcp:101:cat.0 00000100:00100000:2.0:1746129570.669357:0:20577:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ada2ffba-8920-4ecb-8068-68caa9806978+20:1960:x1830948734109184:12345-192.168.202.4@tcp:101:cat.0 Request processed in 124us (1068us total) trans 0 rc 0/0 00010000:00010000:3.0:1746129570.669358:0:4699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746129570.669362:0:20577:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16119 00010000:00010000:3.0:1746129570.669365:0:4699:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a6c65600/0x40a459093b069cbc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20f8a expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129570.669377:0:4699:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129570.669378:0:4699:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129570.669382:0:4699:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6c65600/0x40a459093b069cbc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20f8a expref: 20 pid: 4699 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129570.669392:0:4699:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a6c65600/0x40a459093b069cbc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20f8a expref: 20 pid: 4699 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129570.669405:0:4699:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6c65600, rc 0) 00000100:00100000:3.0:1746129570.669422:0:4699:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f325f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ada2ffba-8920-4ecb-8068-68caa9806978+20:1960:x1830948734109312:12345-192.168.202.4@tcp:101:cat.0 Request processed in 73us (771us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129570.669427:0:4699:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16120 00002000:00010000:1.0:1746129570.671362:0:31503:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb atime: 1746129570 -> 1746129571 00002000:00010000:1.0:1746129570.671368:0:31503:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb ctime: 1746129570 -> 1746129571 00000100:00100000:1.0:1746129570.671383:0:31503:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a77b3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:31503:1830948737506816:192.168.202.4@tcp:106: 00010000:00010000:1.0:1746129570.671406:0:31503:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d863c00/0x40a459093b069cae lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20f7c expref: 28 pid: 31503 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129570.671417:0:31503:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d863c00/0x40a459093b069cae lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20f7c expref: 28 pid: 31503 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129570.671443:0:31503:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d863c00, rc 0) 00000100:00100000:1.0:1746129570.671481:0:31503:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ced500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ada2ffba-8920-4ecb-8068-68caa9806978+27:1960:x1830948734109056:12345-192.168.202.4@tcp:101:cat.0 Request processed in 3378us (3514us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129570.671488:0:31503:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16118 00000100:00100000:0.0:1746129570.673913:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129570.673962:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129570.674046:0:8416:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734109696 00000100:00100000:3.0:1746129570.674053:0:8416:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734109696 00002000:00100000:3.0:1746129570.674086:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3f5:0x0] (3145728->4194303) req@ffff88009f326680 x1830948734109696/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:311/0 lens 488/0 e 0 to 0 dl 1746129581 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129570.674094:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f326680 with x1830948734109696 ext(3145728->4194303) 00002000:00010000:3.0:1746129570.674098:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f326680 00000100:00100000:3.0:1746129570.674121:0:8416:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734109824 00000100:00100000:3.0:1746129570.674124:0:8416:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734109824 00002000:00100000:3.0:1746129570.674137:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->4194303) req@ffff88009f327100 x1830948734109824/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:311/0 lens 488/0 e 0 to 0 dl 1746129581 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129570.674144:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f327100 with x1830948734109824 ext(3145728->4194303) 00002000:00010000:3.0:1746129570.674147:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f327100 00000100:00100000:3.0:1746129570.674163:0:8416:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7768 00000100:00100000:3.0:1746129570.674169:0:8416:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f326680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+15:1963:x1830948734109696:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:1.0:1746129570.675499:0:21725:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7769 00000100:00100000:1.0:1746129570.675508:0:21725:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f327100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+11:1963:x1830948734109824:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:0.0:1746129570.680875:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129570.680899:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734110080 00000100:00100000:0.0:1746129570.680905:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734110080 00002000:00100000:0.0:1746129570.680936:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ef:0x0] (4194304->5148671) req@ffff88009f325c00 x1830948734110080/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:311/0 lens 488/0 e 0 to 0 dl 1746129581 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129570.680945:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f325c00 with x1830948734110080 ext(4194304->5148671) 00002000:00010000:0.0:1746129570.680950:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f325c00 00000100:00100000:0.0:1746129570.680965:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7770 00000100:00100000:0.0:1746129570.680971:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f325c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+20:1961:x1830948734110080:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:3.0:1746129570.694703:0:8416:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f326680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+15:1963:x1830948734109696:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 20525us (20787us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129570.694713:0:8416:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7768 00002000:00100000:3.0:1746129570.694724:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3f5:0x0] (3145728->4194303) req@ffff88009f326680 x1830948734109696/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:311/0 lens 488/440 e 0 to 0 dl 1746129581 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129570.694741:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f326680 with x1830948734109696 ext(3145728->4194303) 00002000:00010000:3.0:1746129570.694746:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f326680 00000100:00100000:1.0:1746129570.697616:0:21725:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f327100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+11:1963:x1830948734109824:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 22101us (23645us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129570.697625:0:21725:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7769 00002000:00100000:1.0:1746129570.697634:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->4194303) req@ffff88009f327100 x1830948734109824/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:311/0 lens 488/440 e 0 to 0 dl 1746129581 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129570.697642:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f327100 with x1830948734109824 ext(3145728->4194303) 00002000:00010000:1.0:1746129570.697646:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f327100 00000100:00100000:2.0:1746129570.699193:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f325c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+20:1961:x1830948734110080:12345-192.168.202.4@tcp:3:cat.0 Request processed in 18220us (18322us total) trans 0 rc 954368/954368 00000100:00100000:2.0:1746129570.699201:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7770 00002000:00100000:2.0:1746129570.699206:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ef:0x0] (4194304->5148671) req@ffff88009f325c00 x1830948734110080/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:311/0 lens 488/440 e 0 to 0 dl 1746129581 ref 1 fl Complete:/200/0 rc 954368/954368 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129570.699213:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f325c00 with x1830948734110080 ext(4194304->5148671) 00002000:00010000:2.0:1746129570.699217:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f325c00 00000100:00100000:0.0:1746129570.712028:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129570.712477:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129570.712479:0:31503:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734110208 00000100:00100000:1.0:1746129570.712486:0:31503:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734110208 00000100:00100000:0.0:1746129570.712514:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129570.712527:0:31503:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734110592 00000100:00100000:1.0:1746129570.712530:0:31503:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734110592 00000100:00100000:1.0:1746129570.712541:0:31503:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734110464 00000100:00100000:1.0:1746129570.712542:0:31503:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734110464 00000100:00100000:1.0:1746129570.712552:0:31503:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16121 00000100:00100000:1.0:1746129570.712562:0:31503:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f326d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+12:1962:x1830948734110208:12345-192.168.202.4@tcp:101:cat.0 00000100:00100000:0.0:1746129570.712562:0:11014:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16122 00000100:00100000:0.0:1746129570.712566:0:11014:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f324e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ada2ffba-8920-4ecb-8068-68caa9806978+27:1960:x1830948734110592:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129570.712576:0:31503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129570.712576:0:11014:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129570.712588:0:31503:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fb55400/0x40a459093b069cc3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20f91 expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129570.712588:0:11014:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800909cec00/0x40a459093b069cca lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20fa6 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129570.712607:0:31503:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129570.712609:0:31503:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129570.712615:0:31503:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb55400/0x40a459093b069cc3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20f91 expref: 13 pid: 31503 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129570.712627:0:31503:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fb55400/0x40a459093b069cc3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20f91 expref: 13 pid: 31503 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746129570.712630:0:11014:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f327b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11014:1830948737506944:192.168.202.4@tcp:106: 00010000:00010000:1.0:1746129570.712636:0:31503:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb55400, rc 0) 00000100:00100000:1.0:1746129570.712665:0:31503:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f326d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+13:1962:x1830948734110208:12345-192.168.202.4@tcp:101:cat.0 Request processed in 107us (644us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129570.712670:0:31503:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16121 00000100:00100000:1.0:1746129570.712682:0:31503:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16123 00000100:00100000:1.0:1746129570.712686:0:31503:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f327800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+12:1962:x1830948734110464:12345-192.168.202.4@tcp:101:cat.0 00000100:00100000:0.0:1746129570.712686:0:11014:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e29f240 going to sleep for 11 seconds 00010000:00010000:1.0:1746129570.712690:0:31503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129570.712696:0:31503:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fb54e00/0x40a459093b069cd1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20f9f expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129570.712706:0:31503:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129570.712707:0:31503:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129570.712710:0:31503:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb54e00/0x40a459093b069cd1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20f9f expref: 13 pid: 31503 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129570.712718:0:31503:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fb54e00/0x40a459093b069cd1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20f9f expref: 13 pid: 31503 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129570.712723:0:31503:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb54e00, rc 0) 00000100:00100000:1.0:1746129570.712735:0:31503:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f327800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+13:1962:x1830948734110464:12345-192.168.202.4@tcp:101:cat.0 Request processed in 49us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129570.712740:0:31503:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16123 00000100:00100000:0.0:1746129570.718339:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129570.719057:0:11014:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f327b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11014:1830948737506944:192.168.202.4@tcp:106: 00010000:00010000:0.0:1746129570.719176:0:11014:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800909cec00/0x40a459093b069cca lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20fa6 expref: 28 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129570.719189:0:11014:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800909cec00/0x40a459093b069cca lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20fa6 expref: 28 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129570.719214:0:11014:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800909cec00, rc 0) 00000100:00100000:0.0:1746129570.719247:0:11014:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f324e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ada2ffba-8920-4ecb-8068-68caa9806978+27:1960:x1830948734110592:12345-192.168.202.4@tcp:101:cat.0 Request processed in 6680us (6769us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129570.719254:0:11014:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16122 00000100:00100000:0.0:1746129570.719274:0:11014:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734110336 00000100:00100000:0.0:1746129570.719279:0:11014:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734110336 00000100:00100000:0.0:1746129570.719340:0:11014:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16124 00000100:00100000:0.0:1746129570.719346:0:11014:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f324a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+15:1963:x1830948734110336:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129570.719356:0:11014:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129570.719366:0:11014:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800909cfe00/0x40a459093b069cd8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20f98 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129570.719380:0:11014:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129570.719382:0:11014:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129570.719388:0:11014:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800909cfe00/0x40a459093b069cd8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20f98 expref: 16 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129570.719400:0:11014:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800909cfe00/0x40a459093b069cd8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20f98 expref: 16 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129570.719409:0:11014:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800909cfe00, rc 0) 00000100:00100000:0.0:1746129570.719426:0:11014:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f324a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+16:1963:x1830948734110336:12345-192.168.202.4@tcp:101:cat.0 Request processed in 81us (1136us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129570.719431:0:11014:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16124 00000100:00100000:0.0:1746129570.726779:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129570.726833:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129570.726895:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734110976 00000100:00100000:3.0:1746129570.726904:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734110976 00000100:00100000:2.0:1746129570.726920:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734110720 00000100:00100000:2.0:1746129570.726925:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734110720 00002000:00100000:3.0:1746129570.726941:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ef:0x0] (4194304->5148671) req@ffff88009f327480 x1830948734110976/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:311/0 lens 488/0 e 0 to 0 dl 1746129581 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129570.726951:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f327480 with x1830948734110976 ext(4194304->5148671) 00002000:00010000:3.0:1746129570.726955:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f327480 00000100:00100000:2.0:1746129570.726958:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16125 00000100:00100000:2.0:1746129570.726965:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f327b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ada2ffba-8920-4ecb-8068-68caa9806978+27:1962:x1830948734110720:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129570.726978:0:7148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746129570.726984:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7771 00010000:00010000:2.0:1746129570.726991:0:7148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800915dd000/0x40a459093b069cdf lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20fad expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129570.727029:0:7148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009016b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:7148:1830948737507072:192.168.202.4@tcp:106: 00000100:00100000:2.0:1746129570.727084:0:7148:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a00c00 going to sleep for 11 seconds 00000100:00100000:3.0:1746129570.727400:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f327480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+13:1963:x1830948734110976:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:2.0:1746129570.728619:0:7148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009016b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:7148:1830948737507072:192.168.202.4@tcp:106: 00010000:00010000:2.0:1746129570.728639:0:7148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800915dd000/0x40a459093b069cdf lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20fad expref: 28 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129570.728650:0:7148:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800915dd000/0x40a459093b069cdf lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20fad expref: 28 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129570.728675:0:7148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800915dd000, rc 0) 00000100:00100000:2.0:1746129570.728745:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f327b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ada2ffba-8920-4ecb-8068-68caa9806978+27:1962:x1830948734110720:12345-192.168.202.4@tcp:101:cat.0 Request processed in 1779us (1972us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129570.728751:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16125 00000100:00100000:3.0:1746129570.740857:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f327480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+13:1963:x1830948734110976:12345-192.168.202.4@tcp:3:cat.0 Request processed in 13858us (14014us total) trans 0 rc 954368/954368 00000100:00100000:3.0:1746129570.740868:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7771 00002000:00100000:3.0:1746129570.740878:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ef:0x0] (4194304->5148671) req@ffff88009f327480 x1830948734110976/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:311/0 lens 488/440 e 0 to 0 dl 1746129581 ref 1 fl Complete:/200/0 rc 954368/954368 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129570.740886:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f327480 with x1830948734110976 ext(4194304->5148671) 00002000:00010000:3.0:1746129570.740890:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f327480 00000100:00100000:0.0:1746129570.751066:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129570.751126:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734111104 00000100:00100000:2.0:1746129570.751133:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734111104 00000100:00100000:2.0:1746129570.751177:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16126 00000100:00100000:2.0:1746129570.751183:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f324000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ada2ffba-8920-4ecb-8068-68caa9806978+20:32290:x1830948734111104:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:2.0:1746129570.751197:0:7148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129570.751210:0:7148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800915dce00/0x40a459093b069ce6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20fb4 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129570.751233:0:7148:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a6c65a00/0x40a459093b069c99 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20f67 expref: 12 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129570.751240:0:7148:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a6c65600/0x40a459093b069cbc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20f8a expref: 21 pid: 4699 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129570.751246:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129570.751248:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129570.751251:0:7148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800915dce00/0x40a459093b069ce6 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [3821568->3850239] (req 3821568->3850239) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20fb4 expref: 21 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129570.751273:0:7148:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a6c65600/0x40a459093b069cbc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20f8a expref: 21 pid: 4699 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129570.751283:0:7148:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a6c65600/0x40a459093b069cbc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20f8a expref: 21 pid: 4699 timeout: 926 lvb_type: 1 00000100:00100000:2.0:1746129570.751334:0:7148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009016b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7148:1830948737507200:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129570.751408:0:7148:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a6c65a00/0x40a459093b069c99 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20f67 expref: 12 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129570.751415:0:7148:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a6c65a00/0x40a459093b069c99 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20f67 expref: 12 pid: 11014 timeout: 926 lvb_type: 0 00000100:00100000:2.0:1746129570.751424:0:7148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090168000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7148:1830948737507328:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129570.751440:0:7148:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a00c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746129570.753383:0:7148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009016b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7148:1830948737507200:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129570.754626:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129570.754639:0:7148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090168000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7148:1830948737507328:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129570.754660:0:7148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800915dce00/0x40a459093b069ce6 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [3821568->3850239] (req 3821568->3850239) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20fb4 expref: 21 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129570.754674:0:7148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800915dce00, rc 0) 00000100:00100000:2.0:1746129570.754706:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f324000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ada2ffba-8920-4ecb-8068-68caa9806978+21:32290:x1830948734111104:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 3523us (3647us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129570.754714:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16126 00000100:00100000:3.0:1746129570.755117:0:15749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734111232 00000100:00100000:3.0:1746129570.755122:0:15749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734111232 00010000:00010000:3.0:1746129570.755144:0:15749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6c65600/0x40a459093b069cbc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20f8a expref: 21 pid: 4699 timeout: 926 lvb_type: 1 00000100:00100000:3.0:1746129570.755177:0:15749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8267 00000100:00100000:3.0:1746129570.755182:0:15749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6ce1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ada2ffba-8920-4ecb-8068-68caa9806978+21:1963:x1830948734111232:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129570.755192:0:15749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129570.755210:0:15749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a6c65600/0x40a459093b069cbc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20f8a expref: 21 pid: 4699 timeout: 926 lvb_type: 1 00010000:00010000:3.0:1746129570.755219:0:15749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a6c65600/0x40a459093b069cbc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20f8a expref: 21 pid: 4699 timeout: 926 lvb_type: 1 00010000:00010000:3.0:1746129570.755236:0:15749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a6c65600/0x40a459093b069cbc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20f8a expref: 21 pid: 4699 timeout: 926 lvb_type: 1 00010000:00010000:3.0:1746129570.755259:0:15749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129570.755288:0:15749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6ce1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ada2ffba-8920-4ecb-8068-68caa9806978+20:1963:x1830948734111232:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 105us (664us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129570.755311:0:15749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8267 00000100:00100000:0.0:1746129570.755935:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129570.756626:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734111360 00000100:00100000:1.0:1746129570.756631:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734111360 00010000:00010000:1.0:1746129570.756650:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6c65a00/0x40a459093b069c99 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20f67 expref: 13 pid: 11014 timeout: 926 lvb_type: 0 00000100:00100000:1.0:1746129570.756673:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8268 00000100:00100000:1.0:1746129570.756679:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f326a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+13:1962:x1830948734111360:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129570.756687:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129570.756697:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a6c65a00/0x40a459093b069c99 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20f67 expref: 13 pid: 11014 timeout: 926 lvb_type: 0 00010000:00010000:1.0:1746129570.756707:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a6c65a00/0x40a459093b069c99 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20f67 expref: 13 pid: 11014 timeout: 926 lvb_type: 0 00010000:00010000:1.0:1746129570.756720:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a6c65a00/0x40a459093b069c99 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20f67 expref: 13 pid: 11014 timeout: 926 lvb_type: 0 00010000:00010000:1.0:1746129570.756747:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129570.756749:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129570.756755:0:7085:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800915dce00/0x40a459093b069ce6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3821568->3850239) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20fb4 expref: 19 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129570.756762:0:7085:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800915dce00/0x40a459093b069ce6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3821568->3850239) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20fb4 expref: 19 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129570.756787:0:7085:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800915dce00/0x40a459093b069ce6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3821568->3850239) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20fb4 expref: 19 pid: 7148 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129570.756797:0:7085:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a77b3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7085:1830948737507456:192.168.202.4@tcp:105: 00000100:00100000:1.0:1746129570.757230:0:7085:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934d26c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746129570.759913:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129570.760014:0:7085:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a77b3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7085:1830948737507456:192.168.202.4@tcp:105: 00010000:00010000:1.0:1746129570.760030:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129570.761122:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f326a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+12:1962:x1830948734111360:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 4439us (5183us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129570.761130:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8268 00000100:00100000:3.0:1746129570.761380:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734111616 00000100:00100000:3.0:1746129570.761386:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734111616 00002000:00100000:3.0:1746129570.761419:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ef:0x0] (3821568->3825663) req@ffff880090168000 x1830948734111616/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:311/0 lens 488/0 e 0 to 0 dl 1746129581 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129570.761427:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090168000 with x1830948734111616 ext(3821568->3825663) 00002000:00010000:3.0:1746129570.761432:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090168000 00000100:00100000:3.0:1746129570.761446:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7772 00000100:00100000:3.0:1746129570.761452:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090168000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+20:1963:x1830948734111616:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:3.0:1746129570.761574:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090168000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+20:1963:x1830948734111616:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 122us (1665us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129570.761581:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7772 00002000:00100000:3.0:1746129570.761587:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ef:0x0] (3821568->3825663) req@ffff880090168000 x1830948734111616/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:311/0 lens 488/4536 e 0 to 0 dl 1746129581 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129570.761594:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090168000 with x1830948734111616 ext(3821568->3825663) 00002000:00010000:3.0:1746129570.761596:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090168000 00000100:00100000:2.0:1746129570.765820:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129570.765977:0:21725:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734111872 00000100:00100000:1.0:1746129570.765984:0:21725:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734111872 00002000:00100000:1.0:1746129570.766018:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ef:0x0] (3846144->3850239) req@ffff88009016b800 x1830948734111872/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:311/0 lens 488/0 e 0 to 0 dl 1746129581 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129570.766027:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009016b800 with x1830948734111872 ext(3846144->3850239) 00002000:00010000:1.0:1746129570.766032:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009016b800 00000100:00100000:1.0:1746129570.766062:0:21725:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7773 00000100:00100000:1.0:1746129570.766070:0:21725:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009016b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ada2ffba-8920-4ecb-8068-68caa9806978+20:1962:x1830948734111872:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:1.0:1746129570.766218:0:21725:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009016b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ada2ffba-8920-4ecb-8068-68caa9806978+20:1962:x1830948734111872:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 148us (405us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746129570.766224:0:21725:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7773 00002000:00100000:1.0:1746129570.766230:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ef:0x0] (3846144->3850239) req@ffff88009016b800 x1830948734111872/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:311/0 lens 488/4536 e 0 to 0 dl 1746129581 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129570.766237:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009016b800 with x1830948734111872 ext(3846144->3850239) 00002000:00010000:1.0:1746129570.766240:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009016b800 00000100:00100000:0.0:1746129570.869932:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129570.871267:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129570.871378:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734112128 00000100:00100000:3.0:1746129570.871385:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734112128 00002000:00100000:3.0:1746129570.871424:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f4:0x0] (1679360->1683455) req@ffff88009f324700 x1830948734112128/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:311/0 lens 488/0 e 0 to 0 dl 1746129581 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129570.871438:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f324700 with x1830948734112128 ext(1679360->1683455) 00002000:00010000:3.0:1746129570.871443:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f324700 00000100:00100000:3.0:1746129570.871466:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7774 00000100:00100000:3.0:1746129570.871473:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f324700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+16:1960:x1830948734112128:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:3.0:1746129570.871633:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f324700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+16:1960:x1830948734112128:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 159us (1708us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129570.871640:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7774 00002000:00100000:3.0:1746129570.871645:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f4:0x0] (1679360->1683455) req@ffff88009f324700 x1830948734112128/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:311/0 lens 488/4536 e 0 to 0 dl 1746129581 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129570.871652:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f324700 with x1830948734112128 ext(1679360->1683455) 00002000:00010000:3.0:1746129570.871655:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f324700 00000100:00100000:2.0:1746129570.871778:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734112256 00000100:00100000:2.0:1746129570.871782:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734112256 00000100:00100000:2.0:1746129570.871805:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16127 00000100:00100000:2.0:1746129570.871810:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bf7a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ada2ffba-8920-4ecb-8068-68caa9806978+27:1962:x1830948734112256:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129570.871819:0:7148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129570.871832:0:7148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800915dda00/0x40a459093b069ced lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20fbb expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129570.871871:0:7148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090169c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:7148:1830948737507584:192.168.202.4@tcp:106: 00000100:00100000:2.0:1746129570.871917:0:7148:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a00c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746129570.874271:0:7148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090169c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:7148:1830948737507584:192.168.202.4@tcp:106: 00010000:00010000:2.0:1746129570.874580:0:7148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800915dda00/0x40a459093b069ced lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20fbb expref: 28 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129570.874599:0:7148:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800915dda00/0x40a459093b069ced lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20fbb expref: 28 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129570.875335:0:7148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800915dda00, rc 0) 00000100:00100000:2.0:1746129570.875428:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bf7a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ada2ffba-8920-4ecb-8068-68caa9806978+27:1962:x1830948734112256:12345-192.168.202.4@tcp:101:cat.0 Request processed in 3615us (4160us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129570.875435:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16127 00000100:00100000:0.0:1746129570.887715:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129570.887767:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129570.887853:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734112512 00000100:00100000:3.0:1746129570.887861:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734112512 00002000:00100000:3.0:1746129570.887901:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ec:0x0] (0->1048575) req@ffff88009f326300 x1830948734112512/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:311/0 lens 488/0 e 0 to 0 dl 1746129581 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129570.887910:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f326300 with x1830948734112512 ext(0->1048575) 00002000:00010000:3.0:1746129570.887916:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f326300 00000100:00100000:3.0:1746129570.888138:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734112768 00000100:00100000:3.0:1746129570.888141:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734112768 00002000:00100000:3.0:1746129570.888156:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff88009f324380 x1830948734112768/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:311/0 lens 488/0 e 0 to 0 dl 1746129581 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129570.888162:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f324380 with x1830948734112768 ext(1048576->2097151) 00002000:00010000:3.0:1746129570.888166:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f324380 00000100:00100000:1.0:1746129570.888191:0:21725:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7775 00000100:00100000:1.0:1746129570.888200:0:21725:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f326300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ada2ffba-8920-4ecb-8068-68caa9806978+20:1962:x1830948734112512:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:3.0:1746129570.891440:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7776 00000100:00100000:3.0:1746129570.891454:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f324380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+27:1963:x1830948734112768:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:1.0:1746129570.916884:0:21725:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f326300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ada2ffba-8920-4ecb-8068-68caa9806978+20:1962:x1830948734112512:12345-192.168.202.4@tcp:3:cat.0 Request processed in 28677us (29168us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129570.916895:0:21725:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7775 00002000:00100000:1.0:1746129570.916905:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ec:0x0] (0->1048575) req@ffff88009f326300 x1830948734112512/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:311/0 lens 488/440 e 0 to 0 dl 1746129581 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129570.916914:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f326300 with x1830948734112512 ext(0->1048575) 00002000:00010000:1.0:1746129570.916919:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f326300 00000100:00100000:3.0:1746129570.923068:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f324380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+27:1963:x1830948734112768:12345-192.168.202.4@tcp:3:cat.0 Request processed in 31610us (35292us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129570.923079:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7776 00002000:00100000:3.0:1746129570.923088:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff88009f324380 x1830948734112768/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:311/0 lens 488/440 e 0 to 0 dl 1746129581 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129570.923096:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f324380 with x1830948734112768 ext(1048576->2097151) 00002000:00010000:3.0:1746129570.923102:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f324380 00000100:00100000:0.0:1746129570.933526:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129570.934139:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734112896 00000100:00100000:2.0:1746129570.934147:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734112896 00000100:00100000:2.0:1746129570.934281:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16128 00000100:00100000:2.0:1746129570.934288:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f325880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ada2ffba-8920-4ecb-8068-68caa9806978+27:32297:x1830948734112896:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129570.934448:0:7148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129570.934462:0:7148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800915dc400/0x40a459093b069cf4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20fc2 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129570.934487:0:7148:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094c09a00/0x40a459093b069c76 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1253376->1675263) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20f4b expref: 15 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129570.934495:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129570.934496:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129570.934499:0:7148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800915dc400/0x40a459093b069cf4 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20fc2 expref: 28 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129570.934527:0:7148:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094c09a00/0x40a459093b069c76 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1253376->1675263) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20f4b expref: 15 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129570.934541:0:7148:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094c09a00/0x40a459093b069c76 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1253376->1675263) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20f4b expref: 15 pid: 4699 timeout: 926 lvb_type: 0 00000100:00100000:2.0:1746129570.934553:0:7148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090169c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:7148:1830948737507712:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129570.934632:0:7148:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a00c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746129570.936616:0:7148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090169c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:7148:1830948737507712:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129570.936638:0:7148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800915dc400/0x40a459093b069cf4 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20fc2 expref: 28 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129570.936650:0:7148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800915dc400, rc 0) 00000100:00100000:0.0:1746129570.936679:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f325880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ada2ffba-8920-4ecb-8068-68caa9806978+28:32297:x1830948734112896:12345-192.168.202.4@tcp:101:cat.0 Request processed in 2391us (3161us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129570.936685:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16128 00000100:00100000:0.0:1746129570.940527:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129570.940884:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734113024 00000100:00100000:3.0:1746129570.940893:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734113024 00002000:00100000:3.0:1746129570.940929:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f4:0x0] (1253376->1683455) req@ffff88009f325180 x1830948734113024/t0(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:311/0 lens 488/0 e 0 to 0 dl 1746129581 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129570.940938:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f325180 with x1830948734113024 ext(1253376->1683455) 00010000:00010000:3.0:1746129570.940947:0:25745:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094c09a00/0x40a459093b069c76 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1253376->1675263) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20f4b expref: 16 pid: 4699 timeout: 926 lvb_type: 0 00010000:00010000:3.0:1746129570.940958:0:25745:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094c09a00/0x40a459093b069c76 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1253376->1675263) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20f4b expref: 16 pid: 4699 timeout: 926 lvb_type: 0 00002000:00010000:3.0:1746129570.940965:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f325180 00000100:00100000:3.0:1746129570.940995:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2419 00000100:00100000:3.0:1746129570.941002:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f325180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+16:1962:x1830948734113024:12345-192.168.202.4@tcp:4:multiop.0 00000100:00100000:3.0:1746129570.966275:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f325180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+18:1962:x1830948734113024:12345-192.168.202.4@tcp:4:multiop.0 Request processed in 25264us (25745us total) trans 17179874092 rc 0/0 00000100:00100000:3.0:1746129570.966286:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2419 00002000:00100000:3.0:1746129570.966322:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f4:0x0] (1253376->1683455) req@ffff88009f325180 x1830948734113024/t17179874092(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:311/0 lens 488/448 e 0 to 0 dl 1746129581 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129570.966331:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f325180 with x1830948734113024 ext(1253376->1683455) 00010000:00010000:3.0:1746129570.966341:0:25745:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094c09a00/0x40a459093b069c76 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1253376->1675263) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20f4b expref: 18 pid: 4699 timeout: 926 lvb_type: 0 00010000:00010000:3.0:1746129570.966362:0:25745:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094c09a00/0x40a459093b069c76 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1253376->1675263) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20f4b expref: 18 pid: 4699 timeout: 926 lvb_type: 0 00002000:00010000:3.0:1746129570.966368:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f325180 00000100:00100000:2.0:1746129570.974436:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129570.974479:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734113152 00000100:00100000:0.0:1746129570.974487:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734113152 00010000:00010000:0.0:1746129570.974516:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094c09a00/0x40a459093b069c76 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1253376->1675263) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20f4b expref: 18 pid: 4699 timeout: 926 lvb_type: 0 00000100:00100000:0.0:1746129570.974555:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8269 00000100:00100000:0.0:1746129570.974563:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009016a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+18:1963:x1830948734113152:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129570.974575:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129570.974593:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094c09a00/0x40a459093b069c76 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1253376->1675263) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20f4b expref: 18 pid: 4699 timeout: 926 lvb_type: 0 00010000:00010000:0.0:1746129570.974603:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094c09a00/0x40a459093b069c76 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1253376->1675263) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20f4b expref: 18 pid: 4699 timeout: 926 lvb_type: 0 00010000:00010000:0.0:1746129570.974622:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094c09a00/0x40a459093b069c76 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1253376->1675263) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20f4b expref: 18 pid: 4699 timeout: 926 lvb_type: 0 00010000:00010000:0.0:1746129570.974639:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129570.974640:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129570.974645:0:7085:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800915dc400/0x40a459093b069cf4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20fc2 expref: 27 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129570.974654:0:7085:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800915dc400/0x40a459093b069cf4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20fc2 expref: 27 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129570.974682:0:7085:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800915dc400/0x40a459093b069cf4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20fc2 expref: 27 pid: 7148 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129570.974693:0:7085:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f325f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7085:1830948737507840:192.168.202.4@tcp:105: 00000100:00100000:0.0:1746129570.981489:0:7085:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e29f240 going to sleep for 11 seconds 00000100:00100000:0.0:1746129570.982242:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129570.982599:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129570.982618:0:11014:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734113280 00000100:00100000:0.0:1746129570.982624:0:11014:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734113280 00000100:00100000:0.0:1746129570.983033:0:11014:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734113408 00000100:00100000:0.0:1746129570.983036:0:11014:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734113408 00000100:00100000:1.0:1746129570.983081:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16129 00000100:00100000:1.0:1746129570.983090:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f326d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+18:1963:x1830948734113280:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129570.983106:0:7148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129570.983121:0:7148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a95ece00/0x40a459093b069cfb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20fc9 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129570.983146:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129570.983148:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129570.983155:0:7148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a95ece00/0x40a459093b069cfb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20fc9 expref: 19 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129570.983168:0:7148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a95ece00/0x40a459093b069cfb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20fc9 expref: 19 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129570.983177:0:7148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a95ece00, rc 0) 00000100:00100000:1.0:1746129570.983213:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f326d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+19:1963:x1830948734113280:12345-192.168.202.4@tcp:101:cat.0 Request processed in 125us (975us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129570.983218:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16129 00000100:00100000:1.0:1746129570.983233:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16130 00000100:00100000:1.0:1746129570.983238:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f327800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+12:1962:x1830948734113408:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129570.983246:0:7148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129570.983253:0:7148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a95ec000/0x40a459093b069d02 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20fd0 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129570.983285:0:7148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a77b3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7148:1830948737507968:192.168.202.4@tcp:106: 00000100:00100000:1.0:1746129570.983345:0:7148:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934d2b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746129570.983517:0:7085:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f325f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7085:1830948737507840:192.168.202.4@tcp:105: 00010000:00010000:2.0:1746129570.983532:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129570.983556:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009016a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+18:1963:x1830948734113152:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 8994us (9126us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129570.983563:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8269 00000100:00100000:0.0:1746129570.988117:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129570.988161:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00002000:00010000:1.0:1746129570.988180:0:7148:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb atime: 1746129570 -> 1746129571 00000100:00100000:0.0:1746129570.988203:0:21725:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734113664 00000100:00100000:1.0:1746129570.988204:0:7148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a77b3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7148:1830948737507968:192.168.202.4@tcp:106: 00000100:00100000:0.0:1746129570.988210:0:21725:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734113664 00010000:00010000:1.0:1746129570.988230:0:7148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a95ec000/0x40a459093b069d02 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20fd0 expref: 13 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129570.988248:0:7148:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a95ec000/0x40a459093b069d02 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20fd0 expref: 13 pid: 7148 timeout: 0 lvb_type: 1 00002000:00100000:0.0:1746129570.988251:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f4:0x0] (1048576->2097151) req@ffff88009f324e00 x1830948734113664/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:311/0 lens 488/0 e 0 to 0 dl 1746129581 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129570.988261:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f324e00 with x1830948734113664 ext(1048576->2097151) 00002000:00010000:0.0:1746129570.988266:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f324e00 00010000:00010000:1.0:1746129570.988277:0:7148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a95ec000, rc 0) 00000100:00100000:0.0:1746129570.988340:0:21725:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734113920 00000100:00100000:0.0:1746129570.988342:0:21725:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734113920 00000100:00100000:1.0:1746129570.988351:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f327800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+12:1962:x1830948734113408:12345-192.168.202.4@tcp:101:cat.0 Request processed in 5111us (5750us total) trans 0 rc 301/301 00002000:00100000:0.0:1746129570.988354:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ee:0x0] (1048576->2097151) req@ffff88009f324a80 x1830948734113920/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:311/0 lens 488/0 e 0 to 0 dl 1746129581 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746129570.988359:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16130 00002000:00100000:0.0:1746129570.988361:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f324a80 with x1830948734113920 ext(1048576->2097151) 00002000:00010000:0.0:1746129570.988364:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f324a80 00000100:00100000:0.0:1746129570.988374:0:21725:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7777 00000100:00100000:0.0:1746129570.988380:0:21725:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f324e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ada2ffba-8920-4ecb-8068-68caa9806978+28:1960:x1830948734113664:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:1.0:1746129570.989455:0:8416:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7778 00000100:00100000:1.0:1746129570.989463:0:8416:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f324a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ada2ffba-8920-4ecb-8068-68caa9806978+20:1962:x1830948734113920:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:1.0:1746129571.004208:0:21725:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f324e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ada2ffba-8920-4ecb-8068-68caa9806978+28:1960:x1830948734113664:12345-192.168.202.4@tcp:3:cat.0 Request processed in 15820us (16093us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129571.004219:0:21725:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7777 00002000:00100000:1.0:1746129571.004229:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f4:0x0] (1048576->2097151) req@ffff88009f324e00 x1830948734113664/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:311/0 lens 488/440 e 0 to 0 dl 1746129581 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129571.004237:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f324e00 with x1830948734113664 ext(1048576->2097151) 00002000:00010000:1.0:1746129571.004243:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f324e00 00000100:00100000:2.0:1746129571.014950:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129571.014979:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129571.014998:0:31521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734114176 00000100:00100000:2.0:1746129571.015005:0:31521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734114176 00000100:00080000:2.0:1746129571.015022:0:7097:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00100000:2.0:1746129571.015050:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3ec:0x0] (0->1048575) req@ffff880090169c00 x1830948734114176/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:312/0 lens 488/0 e 0 to 0 dl 1746129582 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129571.015059:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090169c00 with x1830948734114176 ext(0->1048575) 00002000:00010000:2.0:1746129571.015063:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090169c00 00000100:00100000:2.0:1746129571.015075:0:31521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734114432 00000100:00100000:2.0:1746129571.015077:0:31521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734114432 00002000:00100000:2.0:1746129571.015086:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff880090169880 x1830948734114432/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:312/0 lens 488/0 e 0 to 0 dl 1746129582 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129571.015097:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090169880 with x1830948734114432 ext(1048576->2097151) 00002000:00010000:2.0:1746129571.015099:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090169880 00000100:00100000:2.0:1746129571.015108:0:31521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7779 00000100:00100000:2.0:1746129571.015112:0:31521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090169c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+12:1962:x1830948734114176:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:2.0:1746129571.016284:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129571.016335:0:31520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734114688 00000100:00100000:2.0:1746129571.016340:0:31520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734114688 00002000:00100000:2.0:1746129571.016359:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3f4:0x0] (1048576->2097151) req@ffff880090169180 x1830948734114688/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:312/0 lens 488/0 e 0 to 0 dl 1746129582 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129571.016366:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090169180 with x1830948734114688 ext(1048576->2097151) 00002000:00010000:2.0:1746129571.016370:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090169180 00000100:00100000:2.0:1746129571.016383:0:31520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7780 00000100:00100000:2.0:1746129571.016388:0:31520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090169880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+19:1962:x1830948734114432:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:2.0:1746129571.017479:0:31518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7781 00000100:00100000:2.0:1746129571.017487:0:31518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090169180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:1962:x1830948734114688:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:1.0:1746129571.020204:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129571.020372:0:21725:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734114944 00000100:00100000:1.0:1746129571.020379:0:21725:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734114944 00002000:00100000:1.0:1746129571.020414:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ee:0x0] (1048576->2097151) req@ffff8800a77b3100 x1830948734114944/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:312/0 lens 488/0 e 0 to 0 dl 1746129582 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129571.020423:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a77b3100 with x1830948734114944 ext(1048576->2097151) 00002000:00010000:1.0:1746129571.020428:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a77b3100 00000100:00100000:1.0:1746129571.020447:0:21725:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7782 00000100:00100000:1.0:1746129571.020454:0:21725:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a77b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+14:1962:x1830948734114944:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:1.0:1746129571.021661:0:8416:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f324a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ada2ffba-8920-4ecb-8068-68caa9806978+20:1962:x1830948734113920:12345-192.168.202.4@tcp:3:cat.0 Request processed in 32194us (33495us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129571.021668:0:8416:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7778 00002000:00100000:1.0:1746129571.021675:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3ee:0x0] (1048576->2097151) req@ffff88009f324a80 x1830948734113920/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:311/0 lens 488/440 e 0 to 0 dl 1746129581 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129571.021682:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f324a80 with x1830948734113920 ext(1048576->2097151) 00002000:00010000:1.0:1746129571.021686:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f324a80 00000100:00100000:1.0:1746129571.044052:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129571.044095:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129571.044174:0:8417:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734115200 00000100:00100000:3.0:1746129571.044182:0:8417:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734115200 00000100:00080000:2.0:1746129571.044212:0:7097:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00100000:3.0:1746129571.044237:0:8417:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3ef:0x0] (2097152->3145727) req@ffff8800a77b2680 x1830948734115200/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:312/0 lens 488/0 e 0 to 0 dl 1746129582 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129571.044246:0:8417:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a77b2680 with x1830948734115200 ext(2097152->3145727) 00002000:00010000:3.0:1746129571.044251:0:8417:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a77b2680 00000100:00100000:3.0:1746129571.044265:0:8417:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734115456 00000100:00100000:3.0:1746129571.044268:0:8417:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734115456 00002000:00100000:3.0:1746129571.044278:0:8417:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->4194303) req@ffff8800a77b3b80 x1830948734115456/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:312/0 lens 504/0 e 0 to 0 dl 1746129582 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129571.044284:0:8417:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a77b3b80 with x1830948734115456 ext(3145728->4194303) 00002000:00010000:3.0:1746129571.044286:0:8417:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a77b3b80 00000100:00100000:3.0:1746129571.044324:0:8417:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7783 00000100:00100000:3.0:1746129571.044331:0:8417:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a77b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ada2ffba-8920-4ecb-8068-68caa9806978+21:1963:x1830948734115200:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:3.0:1746129571.044447:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7784 00000100:00100000:3.0:1746129571.044452:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a77b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+21:1963:x1830948734115456:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:2.0:1746129571.044722:0:31521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090169c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+14:1962:x1830948734114176:12345-192.168.202.4@tcp:3:cat.0 Request processed in 29608us (29779us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129571.044729:0:31521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7779 00002000:00100000:2.0:1746129571.044735:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3ec:0x0] (0->1048575) req@ffff880090169c00 x1830948734114176/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:312/0 lens 488/440 e 0 to 0 dl 1746129582 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129571.044742:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090169c00 with x1830948734114176 ext(0->1048575) 00002000:00010000:2.0:1746129571.044746:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090169c00 00000100:00100000:0.0:1746129571.050626:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129571.050739:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734115584 00000100:00100000:1.0:1746129571.050746:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734115584 00000100:00100000:1.0:1746129571.050790:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16131 00000100:00100000:1.0:1746129571.050797:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f327b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ada2ffba-8920-4ecb-8068-68caa9806978+28:32300:x1830948734115584:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:1.0:1746129571.050812:0:7148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129571.050826:0:7148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a95ed800/0x40a459093b069d09 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20fd7 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129571.050850:0:7148:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094c08000/0x40a459093b069c8b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20f52 expref: 29 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129571.050858:0:7148:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a6c65c00/0x40a459093b069c92 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20f60 expref: 21 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129571.050863:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129571.050865:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129571.050868:0:7148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a95ed800/0x40a459093b069d09 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [2560000->3145727] (req 2560000->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20fd7 expref: 29 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129571.050891:0:7148:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a6c65c00/0x40a459093b069c92 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20f60 expref: 21 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129571.050902:0:7148:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a6c65c00/0x40a459093b069c92 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20f60 expref: 21 pid: 31503 timeout: 926 lvb_type: 0 00000100:00100000:1.0:1746129571.050912:0:7148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a77b1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:7148:1830948737508096:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129571.050985:0:7148:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094c08000/0x40a459093b069c8b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20f52 expref: 29 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129571.050993:0:7148:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094c08000/0x40a459093b069c8b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20f52 expref: 29 pid: 31503 timeout: 926 lvb_type: 0 00000100:00100000:1.0:1746129571.051000:0:7148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a77b0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:7148:1830948737508224:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129571.051015:0:7148:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934d2b40 going to sleep for 11 seconds 00000100:00080000:1.0:1746129571.051104:0:7097:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746129571.051522:0:31520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090169880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:1962:x1830948734114432:12345-192.168.202.4@tcp:3:cat.0 Request processed in 35131us (36539us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129571.051531:0:31520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7780 00002000:00100000:2.0:1746129571.051538:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff880090169880 x1830948734114432/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:312/0 lens 488/440 e 0 to 0 dl 1746129582 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129571.051546:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090169880 with x1830948734114432 ext(1048576->2097151) 00002000:00010000:2.0:1746129571.051549:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090169880 00000100:00100000:1.0:1746129571.063670:0:21725:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a77b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+12:1962:x1830948734114944:12345-192.168.202.4@tcp:3:cat.0 Request processed in 43208us (43465us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129571.063680:0:21725:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7782 00002000:00100000:1.0:1746129571.063690:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ee:0x0] (1048576->2097151) req@ffff8800a77b3100 x1830948734114944/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:312/0 lens 488/440 e 0 to 0 dl 1746129582 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129571.063698:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a77b3100 with x1830948734114944 ext(1048576->2097151) 00002000:00010000:1.0:1746129571.063704:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a77b3100 00000100:00100000:0.0:1746129571.076265:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129571.078466:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129571.079218:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734115712 00000100:00100000:2.0:1746129571.079226:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734115712 00010000:00010000:2.0:1746129571.079257:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6c65c00/0x40a459093b069c92 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20f60 expref: 20 pid: 31503 timeout: 926 lvb_type: 0 00000100:00100000:2.0:1746129571.079289:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734115840 00000100:00100000:2.0:1746129571.079324:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734115840 00010000:00010000:2.0:1746129571.079335:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094c08000/0x40a459093b069c8b lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20f52 expref: 30 pid: 31503 timeout: 926 lvb_type: 0 00000100:00100000:2.0:1746129571.079357:0:7086:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8270 00000100:00100000:2.0:1746129571.079364:0:7086:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f324000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:1963:x1830948734115712:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129571.079375:0:7086:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129571.079396:0:7086:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a6c65c00/0x40a459093b069c92 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20f60 expref: 20 pid: 31503 timeout: 926 lvb_type: 0 00010000:00010000:2.0:1746129571.079405:0:7086:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a6c65c00/0x40a459093b069c92 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20f60 expref: 20 pid: 31503 timeout: 926 lvb_type: 0 00010000:00010000:2.0:1746129571.079431:0:7086:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129571.079472:0:7086:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f324000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:1963:x1830948734115712:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 108us (3214us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129571.079477:0:7086:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8270 00000100:00100000:2.0:1746129571.079490:0:7086:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8271 00000100:00100000:2.0:1746129571.079494:0:7086:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f325f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ada2ffba-8920-4ecb-8068-68caa9806978+30:1963:x1830948734115840:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129571.079499:0:7086:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129571.079506:0:7086:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094c08000/0x40a459093b069c8b lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20f52 expref: 30 pid: 31503 timeout: 926 lvb_type: 0 00010000:00010000:2.0:1746129571.079514:0:7086:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094c08000/0x40a459093b069c8b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20f52 expref: 30 pid: 31503 timeout: 926 lvb_type: 0 00010000:00010000:2.0:1746129571.079524:0:7086:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129571.079526:0:7086:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129571.079532:0:7086:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a95ed800/0x40a459093b069d09 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2560000->3145727) gid 0 flags: 0x50080000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20fd7 expref: 30 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129571.079540:0:7086:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a95ed800/0x40a459093b069d09 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2560000->3145727) gid 0 flags: 0x50080000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20fd7 expref: 30 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129571.079564:0:7086:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a95ed800/0x40a459093b069d09 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2560000->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20fd7 expref: 30 pid: 7148 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129571.079574:0:7086:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090169500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7086:1830948737508352:192.168.202.4@tcp:105: 00000100:00100000:2.0:1746129571.079619:0:7086:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a00780 going to sleep for 11 seconds 00010000:00010000:1.0:1746129571.080456:0:7148:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a6c65c00/0x40a459093b069c92 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20f60 expref: 19 pid: 31503 timeout: 926 lvb_type: 0 00000100:00100000:1.0:1746129571.080473:0:7148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a77b1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:7148:1830948737508096:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129571.080498:0:7148:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094c08000/0x40a459093b069c8b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20f52 expref: 30 pid: 31503 timeout: 926 lvb_type: 0 00000100:00100000:1.0:1746129571.080505:0:7148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a77b0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:7148:1830948737508224:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129571.080526:0:7148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a95ed800/0x40a459093b069d09 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2560000->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20fd7 expref: 29 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129571.080533:0:7148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a95ed800, rc 0) 00000100:00100000:1.0:1746129571.081728:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f327b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ada2ffba-8920-4ecb-8068-68caa9806978+29:32300:x1830948734115584:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 30927us (31105us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129571.081736:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16131 00000100:00100000:1.0:1746129571.083133:0:8417:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a77b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ada2ffba-8920-4ecb-8068-68caa9806978+22:1963:x1830948734115200:12345-192.168.202.4@tcp:3:cat.0 Request processed in 38798us (39086us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129571.083141:0:8417:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7783 00002000:00100000:1.0:1746129571.083151:0:8417:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3ef:0x0] (2097152->3145727) req@ffff8800a77b2680 x1830948734115200/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:312/0 lens 488/440 e 0 to 0 dl 1746129582 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129571.083158:0:8417:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a77b2680 with x1830948734115200 ext(2097152->3145727) 00002000:00010000:1.0:1746129571.083162:0:8417:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a77b2680 00000100:00100000:0.0:1746129571.083770:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a77b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+20:1963:x1830948734115456:12345-192.168.202.4@tcp:3:cat.0 Request processed in 39316us (39673us total) trans 0 rc 1019904/1019904 00000100:00100000:0.0:1746129571.083777:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7784 00002000:00100000:0.0:1746129571.083782:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->4194303) req@ffff8800a77b3b80 x1830948734115456/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:312/0 lens 504/440 e 0 to 0 dl 1746129582 ref 1 fl Complete:/200/0 rc 1019904/1019904 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129571.083788:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a77b3b80 with x1830948734115456 ext(3145728->4194303) 00002000:00010000:0.0:1746129571.083791:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a77b3b80 00000100:00100000:2.0:1746129571.084648:0:31518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090169180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+17:1962:x1830948734114688:12345-192.168.202.4@tcp:3:cat.0 Request processed in 67157us (68362us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129571.084656:0:31518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7781 00002000:00100000:2.0:1746129571.084664:0:31518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3f4:0x0] (1048576->2097151) req@ffff880090169180 x1830948734114688/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:312/0 lens 488/440 e 0 to 0 dl 1746129582 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129571.084671:0:31518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090169180 with x1830948734114688 ext(1048576->2097151) 00002000:00010000:2.0:1746129571.084674:0:31518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090169180 00000100:00100000:2.0:1746129571.086167:0:7086:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090169500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7086:1830948737508352:192.168.202.4@tcp:105: 00010000:00010000:2.0:1746129571.086183:0:7086:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129571.086228:0:7086:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f325f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ada2ffba-8920-4ecb-8068-68caa9806978+28:1963:x1830948734115840:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 6732us (7765us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129571.086237:0:7086:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8271 00000100:00100000:2.0:1746129571.089786:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129571.089854:0:31518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734116096 00000100:00100000:0.0:1746129571.089863:0:31518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734116096 00002000:00100000:0.0:1746129571.089900:0:31518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3f5:0x0] (2560000->2564095) req@ffff880090169500 x1830948734116096/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:312/0 lens 488/0 e 0 to 0 dl 1746129582 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129571.089909:0:31518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090169500 with x1830948734116096 ext(2560000->2564095) 00002000:00010000:0.0:1746129571.089914:0:31518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090169500 00000100:00100000:0.0:1746129571.089943:0:31518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7785 00000100:00100000:0.0:1746129571.089951:0:31518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090169500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ada2ffba-8920-4ecb-8068-68caa9806978+28:1962:x1830948734116096:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:0.0:1746129571.090099:0:31518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090169500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ada2ffba-8920-4ecb-8068-68caa9806978+28:1962:x1830948734116096:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 148us (319us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746129571.090105:0:31518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7785 00002000:00100000:0.0:1746129571.090110:0:31518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3f5:0x0] (2560000->2564095) req@ffff880090169500 x1830948734116096/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:312/0 lens 488/4536 e 0 to 0 dl 1746129582 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129571.090117:0:31518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090169500 with x1830948734116096 ext(2560000->2564095) 00002000:00010000:0.0:1746129571.090120:0:31518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090169500 00000100:00100000:0.0:1746129571.093981:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129571.094065:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129571.094126:0:11014:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734116224 00000100:00100000:2.0:1746129571.094134:0:11014:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734116224 00000100:00100000:2.0:1746129571.094176:0:11014:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734116352 00000100:00100000:2.0:1746129571.094178:0:11014:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734116352 00000100:00100000:2.0:1746129571.094190:0:11014:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16132 00000100:00100000:2.0:1746129571.094196:0:11014:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f959500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+12:1962:x1830948734116224:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129571.094210:0:11014:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129571.094223:0:11014:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800915ddc00/0x40a459093b069d10 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20fde expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129571.094271:0:11014:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013575ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11014:1830948737508480:192.168.202.4@tcp:106: 00000100:00100000:2.0:1746129571.094364:0:11014:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a00780 going to sleep for 11 seconds 00000100:00100000:1.0:1746129571.094463:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16133 00000100:00100000:1.0:1746129571.094470:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f95b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+17:1962:x1830948734116352:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129571.094478:0:7148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129571.094487:0:7148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f91b400/0x40a459093b069d17 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20fe5 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129571.094514:0:7148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a77b0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:7148:1830948737508608:192.168.202.4@tcp:106: 00000100:00100000:1.0:1746129571.094540:0:7148:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934d2b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746129571.101811:0:11014:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013575ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11014:1830948737508480:192.168.202.4@tcp:106: 00010000:00010000:2.0:1746129571.101839:0:11014:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800915ddc00/0x40a459093b069d10 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20fde expref: 13 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129571.101851:0:11014:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800915ddc00/0x40a459093b069d10 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20fde expref: 13 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129571.102090:0:11014:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800915ddc00, rc 0) 00000100:00100000:2.0:1746129571.102138:0:11014:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f959500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+12:1962:x1830948734116224:12345-192.168.202.4@tcp:101:cat.0 Request processed in 7941us (8164us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129571.102145:0:11014:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16132 00000100:00100000:3.0:1746129571.102554:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129571.102589:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129571.102621:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734116736 00000100:00100000:3.0:1746129571.102626:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734116736 00002000:00100000:3.0:1746129571.102656:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f5:0x0] (3149824->4194303) req@ffff880094f46300 x1830948734116736/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:312/0 lens 488/0 e 0 to 0 dl 1746129582 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129571.102664:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094f46300 with x1830948734116736 ext(3149824->4194303) 00002000:00010000:3.0:1746129571.102668:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094f46300 00000100:00100000:3.0:1746129571.102679:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734116608 00000100:00100000:3.0:1746129571.102681:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734116608 00002000:00100000:3.0:1746129571.102690:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f5:0x0] (2097152->3149823) req@ffff880094f44380 x1830948734116608/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:312/0 lens 504/0 e 0 to 0 dl 1746129582 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129571.102696:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094f44380 with x1830948734116608 ext(2097152->3149823) 00002000:00010000:3.0:1746129571.102698:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094f44380 00000100:00100000:3.0:1746129571.102707:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7786 00000100:00100000:3.0:1746129571.102713:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+29:1963:x1830948734116736:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:0.0:1746129571.103409:0:31518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7787 00000100:00100000:0.0:1746129571.103417:0:31518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ada2ffba-8920-4ecb-8068-68caa9806978+29:1963:x1830948734116608:12345-192.168.202.4@tcp:3:multiop.0 00002000:00010000:1.0:1746129571.113346:0:7148:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3f5:0x0] updating lvb atime: 1746129568 -> 1746129571 00000100:00100000:1.0:1746129571.113372:0:7148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a77b0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:7148:1830948737508608:192.168.202.4@tcp:106: 00010000:00010000:1.0:1746129571.113404:0:7148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f91b400/0x40a459093b069d17 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20fe5 expref: 18 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129571.113417:0:7148:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f91b400/0x40a459093b069d17 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20fe5 expref: 18 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129571.113437:0:7148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f91b400, rc 0) 00000100:00100000:1.0:1746129571.113497:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f95b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+17:1962:x1830948734116352:12345-192.168.202.4@tcp:101:cat.0 Request processed in 19026us (19430us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129571.113505:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16133 00000100:00100000:0.0:1746129571.123222:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129571.123409:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734116992 00000100:00100000:1.0:1746129571.123417:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734116992 00000100:00100000:1.0:1746129571.123468:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16134 00000100:00100000:1.0:1746129571.123475:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f95bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+12:32303:x1830948734116992:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129571.123492:0:7148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129571.123505:0:7148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f850800/0x40a459093b069d1e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20fec expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129571.123532:0:7148:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800915dce00/0x40a459093b069ce6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3821568->3850239) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20fb4 expref: 19 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129571.123538:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129571.123540:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129571.123542:0:7148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f850800/0x40a459093b069d1e lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20fec expref: 13 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129571.123567:0:7148:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800915dce00/0x40a459093b069ce6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3821568->3850239) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20fb4 expref: 19 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129571.123576:0:7148:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800915dce00/0x40a459093b069ce6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3821568->3850239) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20fb4 expref: 19 pid: 7148 timeout: 926 lvb_type: 0 00000100:00100000:1.0:1746129571.123587:0:7148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a77b0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7148:1830948737508736:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129571.123658:0:7148:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934d2b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746129571.123965:0:31518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ada2ffba-8920-4ecb-8068-68caa9806978+30:1963:x1830948734116608:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 20548us (21374us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129571.123972:0:31518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7787 00002000:00100000:1.0:1746129571.123981:0:31518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3f5:0x0] (2097152->3149823) req@ffff880094f44380 x1830948734116608/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:312/0 lens 504/440 e 0 to 0 dl 1746129582 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129571.123988:0:31518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094f44380 with x1830948734116608 ext(2097152->3149823) 00002000:00010000:1.0:1746129571.123992:0:31518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094f44380 00000100:00100000:3.0:1746129571.125289:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+28:1963:x1830948734116736:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 22573us (22733us total) trans 0 rc 1044480/1044480 00000100:00100000:3.0:1746129571.125328:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7786 00002000:00100000:3.0:1746129571.125334:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f5:0x0] (3149824->4194303) req@ffff880094f46300 x1830948734116736/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:312/0 lens 488/440 e 0 to 0 dl 1746129582 ref 1 fl Complete:/200/0 rc 1044480/1044480 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129571.125343:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094f46300 with x1830948734116736 ext(3149824->4194303) 00002000:00010000:3.0:1746129571.125347:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094f46300 00000100:00100000:1.0:1746129571.128087:0:7148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a77b0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7148:1830948737508736:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129571.128115:0:7148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f850800/0x40a459093b069d1e lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20fec expref: 13 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129571.128131:0:7148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f850800, rc 0) 00000100:00100000:1.0:1746129571.128165:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f95bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+13:32303:x1830948734116992:12345-192.168.202.4@tcp:101:cat.0 Request processed in 4691us (4951us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129571.128173:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16134 00000100:00100000:2.0:1746129571.129961:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129571.131557:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734117120 00000100:00100000:3.0:1746129571.131565:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734117120 00002000:00100000:3.0:1746129571.131601:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ef:0x0] (3821568->3850239) req@ffff88013575ed80 x1830948734117120/t0(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:312/0 lens 488/0 e 0 to 0 dl 1746129582 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129571.131611:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013575ed80 with x1830948734117120 ext(3821568->3850239) 00010000:00010000:3.0:1746129571.131619:0:25745:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800915dce00/0x40a459093b069ce6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3821568->3850239) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20fb4 expref: 20 pid: 7148 timeout: 926 lvb_type: 0 00010000:00010000:3.0:1746129571.131632:0:25745:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800915dce00/0x40a459093b069ce6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3821568->3850239) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20fb4 expref: 20 pid: 7148 timeout: 926 lvb_type: 0 00002000:00010000:3.0:1746129571.131639:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88013575ed80 00000100:00100000:3.0:1746129571.132451:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2420 00000100:00100000:3.0:1746129571.132460:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013575ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+20:1961:x1830948734117120:12345-192.168.202.4@tcp:4:multiop.0 00000100:00100000:0.0:1746129571.135545:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129571.135638:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129571.137415:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734117248 00000100:00100000:1.0:1746129571.137422:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734117248 00000100:00100000:1.0:1746129571.137452:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734117376 00000100:00100000:1.0:1746129571.137454:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734117376 00000100:00100000:1.0:1746129571.137469:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16135 00000100:00100000:1.0:1746129571.137475:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f95aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ada2ffba-8920-4ecb-8068-68caa9806978+24:32300:x1830948734117248:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:1.0:1746129571.137487:0:7148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129571.137500:0:7148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f851800/0x40a459093b069d25 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20ff3 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129571.137520:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129571.137522:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129571.137525:0:7148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f851800/0x40a459093b069d25 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [3145728->3313663] (req 3145728->3313663) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20ff3 expref: 25 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129571.137534:0:7148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f851800/0x40a459093b069d25 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [3145728->3313663] (req 3145728->3313663) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20ff3 expref: 25 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129571.137542:0:7148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f851800, rc 0) 00000100:00100000:3.0:1746129571.137913:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013575ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+25:1961:x1830948734117120:12345-192.168.202.4@tcp:4:multiop.0 Request processed in 5452us (7954us total) trans 21474841336 rc 0/0 00000100:00100000:3.0:1746129571.137920:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2420 00002000:00100000:3.0:1746129571.137928:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ef:0x0] (3821568->3850239) req@ffff88013575ed80 x1830948734117120/t21474841336(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:312/0 lens 488/448 e 0 to 0 dl 1746129582 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129571.137936:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013575ed80 with x1830948734117120 ext(3821568->3850239) 00010000:00010000:3.0:1746129571.137941:0:25745:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800915dce00/0x40a459093b069ce6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3821568->3850239) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20fb4 expref: 25 pid: 7148 timeout: 926 lvb_type: 0 00010000:00010000:3.0:1746129571.137950:0:25745:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800915dce00/0x40a459093b069ce6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3821568->3850239) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20fb4 expref: 25 pid: 7148 timeout: 926 lvb_type: 0 00002000:00010000:3.0:1746129571.137956:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88013575ed80 00000100:00100000:3.0:1746129571.137974:0:4699:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16136 00000100:00100000:3.0:1746129571.137979:0:4699:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f959180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ada2ffba-8920-4ecb-8068-68caa9806978+24:32297:x1830948734117376:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129571.137984:0:4699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129571.137989:0:4699:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800955d2e00/0x40a459093b069d2c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f20ffa expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.137997:0:4699:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129571.138000:0:4699:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f851800/0x40a459093b069d25 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [3145728->3313663] (req 3145728->3313663) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20ff3 expref: 25 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.138006:0:4699:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746129571.138008:0:4699:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800955d2e00/0x40a459093b069d2c lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20ffa expref: 25 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.138031:0:4699:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f851800/0x40a459093b069d25 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [3145728->3313663] (req 3145728->3313663) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20ff3 expref: 25 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.138042:0:4699:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800955d2e00/0x40a459093b069d2c lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20ffa expref: 25 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.138048:0:4699:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800955d2e00, rc 0) 00000100:00100000:1.0:1746129571.138457:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f95aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ada2ffba-8920-4ecb-8068-68caa9806978+25:32300:x1830948734117248:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 980us (2916us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129571.138464:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16135 00000100:00100000:3.0:1746129571.138721:0:4699:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f959180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ada2ffba-8920-4ecb-8068-68caa9806978+24:32297:x1830948734117376:12345-192.168.202.4@tcp:101:cat.0 Request processed in 741us (3081us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129571.138725:0:4699:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16136 00000100:00100000:0.0:1746129571.139066:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129571.139214:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734117504 00000100:00100000:1.0:1746129571.139218:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734117504 00000100:00100000:1.0:1746129571.139241:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11207 00000100:00100000:1.0:1746129571.139245:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f959c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:068dab75-d300-4ead-a742-d14572ad1e50+20:32306:x1830948734117504:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:1.0:1746129571.139256:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129571.139266:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f851200/0x40a459093b069d33 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21001 expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129571.139328:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f851c00/0x40a459093b069d3a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129571.139338:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f851c00/0x40a459093b069d3a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129571.139348:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f851c00/0x40a459093b069d3a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129571.139356:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f851e00/0x40a459093b069d41 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129571.139360:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f851e00/0x40a459093b069d41 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129571.139365:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f851e00/0x40a459093b069d41 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129571.139441:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f850600/0x40a459093b069d48 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129571.139448:0:14549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc1b600/0x40a459093b069c4c lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20f2f expref: 28 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129571.139455:0:14549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc1a000/0x40a459093b069c6f lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20f44 expref: 312 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129571.139460:0:14549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f850600/0x40a459093b069d48 lrc: 5/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129571.139476:0:14549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc1a000/0x40a459093b069c6f lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20f44 expref: 312 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129571.139483:0:14549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc1a000/0x40a459093b069c6f lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20f44 expref: 312 pid: 15096 timeout: 926 lvb_type: 0 00000100:00100000:1.0:1746129571.139491:0:14549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a77b0700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830948737508992:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129571.141863:0:14549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc1b600/0x40a459093b069c4c lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20f2f expref: 28 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129571.141877:0:14549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc1b600/0x40a459093b069c4c lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20f2f expref: 28 pid: 15096 timeout: 926 lvb_type: 0 00000100:00100000:1.0:1746129571.141889:0:14549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a77b1880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830948737509120:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129571.141925:0:14549:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934d2b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746129571.143932:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129571.145286:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129571.146339:0:7086:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734117632 00000100:00100000:2.0:1746129571.146348:0:7086:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734117632 00010000:00010000:2.0:1746129571.146382:0:7086:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800915dce00/0x40a459093b069ce6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3821568->3850239) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20fb4 expref: 24 pid: 7148 timeout: 926 lvb_type: 0 00000100:00100000:2.0:1746129571.146409:0:7086:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8272 00000100:00100000:2.0:1746129571.146416:0:7086:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f958000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ada2ffba-8920-4ecb-8068-68caa9806978+24:1960:x1830948734117632:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129571.146428:0:7086:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129571.146446:0:7086:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800915dce00/0x40a459093b069ce6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3821568->3850239) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20fb4 expref: 24 pid: 7148 timeout: 926 lvb_type: 0 00010000:00010000:2.0:1746129571.146457:0:7086:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800915dce00/0x40a459093b069ce6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3821568->3850239) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20fb4 expref: 24 pid: 7148 timeout: 926 lvb_type: 0 00010000:00010000:2.0:1746129571.146475:0:7086:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800915dce00/0x40a459093b069ce6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3821568->3850239) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20fb4 expref: 24 pid: 7148 timeout: 926 lvb_type: 0 00010000:00010000:2.0:1746129571.146504:0:7086:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129571.146505:0:7086:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129571.146512:0:7086:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f850800/0x40a459093b069d1e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20fec expref: 12 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129571.146518:0:7086:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f850800/0x40a459093b069d1e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20fec expref: 12 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129571.146525:0:7086:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129571.146526:0:7086:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129571.146529:0:7086:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f851800/0x40a459093b069d25 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3313663) gid 0 flags: 0x60080000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20ff3 expref: 23 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129571.146534:0:7086:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f851800/0x40a459093b069d25 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3313663) gid 0 flags: 0x60080000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20ff3 expref: 23 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129571.146560:0:7086:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f851800/0x40a459093b069d25 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3313663) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20ff3 expref: 23 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129571.146569:0:7086:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f851800/0x40a459093b069d25 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3313663) gid 0 flags: 0x70000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20ff3 expref: 23 pid: 7148 timeout: 926 lvb_type: 0 00000100:00100000:2.0:1746129571.146578:0:7086:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013575c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7086:1830948737509248:192.168.202.4@tcp:105: 00010000:00010000:2.0:1746129571.146652:0:7086:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f850800/0x40a459093b069d1e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20fec expref: 12 pid: 7148 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129571.146664:0:7086:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013575ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7086:1830948737509376:192.168.202.4@tcp:105: 00000100:00100000:2.0:1746129571.146681:0:7086:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a00780 going to sleep for 11 seconds 00000100:00100000:3.0:1746129571.146824:0:4699:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734117760 00000100:00100000:3.0:1746129571.146828:0:4699:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734117760 00000100:00100000:3.0:1746129571.146851:0:4699:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16137 00000100:00100000:3.0:1746129571.146855:0:4699:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f95ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+17:32305:x1830948734117760:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:3.0:1746129571.146866:0:4699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129571.146876:0:4699:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800955d3a00/0x40a459093b069d4f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21008 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.146893:0:4699:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800915dc600/0x40a459093b069ca0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20f75 expref: 27 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129571.146903:0:4699:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800909cfe00/0x40a459093b069cd8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20f98 expref: 18 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129571.146909:0:4699:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129571.146910:0:4699:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129571.146913:0:4699:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800955d3a00/0x40a459093b069d4f lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [1527808->1982463] (req 1527808->1982463) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21008 expref: 18 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.146938:0:4699:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800909cfe00/0x40a459093b069cd8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20f98 expref: 18 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129571.146945:0:4699:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800909cfe00/0x40a459093b069cd8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20f98 expref: 18 pid: 11014 timeout: 926 lvb_type: 1 00000100:00100000:3.0:1746129571.146953:0:4699:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094f45f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4699:1830948737509504:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129571.146996:0:4699:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800915dc600/0x40a459093b069ca0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20f75 expref: 27 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129571.147003:0:4699:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800915dc600/0x40a459093b069ca0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20f75 expref: 27 pid: 11014 timeout: 926 lvb_type: 1 00000100:00100000:3.0:1746129571.147010:0:4699:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094f47480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4699:1830948737509632:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129571.147024:0:4699:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a6ce8900 going to sleep for 11 seconds 00000100:00100000:1.0:1746129571.148553:0:14549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a77b0700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830948737508992:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129571.148562:0:14549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a77b1880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830948737509120:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129571.148579:0:14549:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009f850600/0x40a459093b069d48 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000100:00100000:0.0:1746129571.148688:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129571.148977:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129571.149125:0:15749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734117888 00000100:00100000:2.0:1746129571.149129:0:15749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734117888 00000100:00100000:3.0:1746129571.149258:0:20578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734118016 00000100:00100000:3.0:1746129571.149260:0:20578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734118016 00010000:00010000:3.0:1746129571.149281:0:20578:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc1b600/0x40a459093b069c4c lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20f2f expref: 29 pid: 15096 timeout: 926 lvb_type: 0 00000100:00100000:3.0:1746129571.149343:0:20578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8273 00000100:00100000:3.0:1746129571.149350:0:20578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6ce1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+29:1962:x1830948734118016:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129571.149359:0:20578:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129571.149364:0:20578:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc1b600/0x40a459093b069c4c lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20f2f expref: 29 pid: 15096 timeout: 926 lvb_type: 0 00010000:00010000:3.0:1746129571.149372:0:20578:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc1b600/0x40a459093b069c4c lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20f2f expref: 29 pid: 15096 timeout: 926 lvb_type: 0 00010000:00010000:3.0:1746129571.149387:0:20578:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc1b600/0x40a459093b069c4c lrc: 0/0,0 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20f2f expref: 29 pid: 15096 timeout: 926 lvb_type: 0 00010000:00010000:3.0:1746129571.149402:0:20578:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:3.0:1746129571.149406:0:20578:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f850600/0x40a459093b069d48 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129571.149414:0:20578:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f850600/0x40a459093b069d48 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129571.149418:0:20578:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f850600/0x40a459093b069d48 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129571.149422:0:20578:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129571.149449:0:20578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6ce1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+28:1962:x1830948734118016:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 100us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129571.149454:0:20578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8273 00010000:00010000:2.0:1746129571.149721:0:15749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc1a000/0x40a459093b069c6f lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20f44 expref: 313 pid: 15096 timeout: 926 lvb_type: 0 00000100:00100000:2.0:1746129571.149734:0:15749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8274 00000100:00100000:2.0:1746129571.149739:0:15749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f959880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ada2ffba-8920-4ecb-8068-68caa9806978+313:1962:x1830948734117888:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129571.149745:0:15749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129571.149748:0:15749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc1a000/0x40a459093b069c6f lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20f44 expref: 313 pid: 15096 timeout: 926 lvb_type: 0 00010000:00010000:2.0:1746129571.149754:0:15749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc1a000/0x40a459093b069c6f lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20f44 expref: 313 pid: 15096 timeout: 926 lvb_type: 0 00010000:00010000:2.0:1746129571.149764:0:15749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc1a000/0x40a459093b069c6f lrc: 0/0,0 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20f44 expref: 313 pid: 15096 timeout: 926 lvb_type: 0 00010000:00010000:2.0:1746129571.149770:0:15749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:2.0:1746129571.149773:0:15749:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f850600/0x40a459093b069d48 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129571.149778:0:15749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f850600/0x40a459093b069d48 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129571.149783:0:15749:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f850600/0x40a459093b069d48 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129571.149804:0:15749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129571.149821:0:15749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f959880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ada2ffba-8920-4ecb-8068-68caa9806978+312:1962:x1830948734117888:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 81us (1133us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129571.149825:0:15749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8274 00010000:00010000:0.0:1746129571.149900:0:14549:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f850600/0x40a459093b069d48 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129571.149906:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f850600/0x40a459093b069d48 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00200000:0.0:1746129571.149941:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00000004:00200000:0.0:1746129571.149944:0:14549:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746129571.149957:0:14549:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009f850600/0x40a459093b069d48 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129571.149966:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f850600/0x40a459093b069d48 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129571.149973:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f851c00/0x40a459093b069d3a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129571.149978:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f851c00/0x40a459093b069d3a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129571.149983:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f851c00/0x40a459093b069d3a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129571.149987:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f851c00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:0.0:1746129571.149990:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f851c00/0x40a459093b069d3a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129571.149996:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f851c00/0x40a459093b069d3a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129571.150002:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880132ef8f00) 00010000:00010000:0.0:1746129571.150004:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129571.150007:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f851c00/0x40a459093b069d3a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129571.150011:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f851c00/0x40a459093b069d3a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129571.150022:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f851e00/0x40a459093b069d41 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129571.150027:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f851e00/0x40a459093b069d41 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129571.150032:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f851e00/0x40a459093b069d41 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129571.150036:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f851e00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:0.0:1746129571.150038:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f851e00/0x40a459093b069d41 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129571.150042:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f851e00/0x40a459093b069d41 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129571.150048:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009cffeb00) 00010000:00010000:0.0:1746129571.150050:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129571.150052:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f851e00/0x40a459093b069d41 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129571.150060:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f851e00/0x40a459093b069d41 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129571.150085:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f851200/0x40a459093b069d33 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21001 expref: 22 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129571.150094:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f850600/0x40a459093b069d48 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21001 expref: 21 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129571.150100:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:0.0:1746129571.150101:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746129571.150103:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f850600, rc 0) 00000100:00100000:0.0:1746129571.150126:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f959c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:068dab75-d300-4ead-a742-d14572ad1e50+21:32306:x1830948734117504:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 10881us (11061us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129571.150132:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11207 00000100:00080000:1.0:1746129571.150244:0:7097:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746129571.161263:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129571.161484:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734118272 00000100:00100000:3.0:1746129571.161491:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734118272 00002000:00100000:3.0:1746129571.161528:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ef:0x0] (2097152->3145727) req@ffff88009f958a80 x1830948734118272/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:312/0 lens 488/0 e 0 to 0 dl 1746129582 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129571.161537:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f958a80 with x1830948734118272 ext(2097152->3145727) 00002000:00010000:3.0:1746129571.161542:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f958a80 00000100:00100000:3.0:1746129571.161560:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7788 00000100:00100000:3.0:1746129571.161566:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f958a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+13:1960:x1830948734118272:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:0.0:1746129571.161835:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129571.161880:0:21725:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734118528 00000100:00100000:0.0:1746129571.161883:0:21725:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734118528 00002000:00100000:0.0:1746129571.161901:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ef:0x0] (3309568->3313663) req@ffff88009f95a680 x1830948734118528/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:312/0 lens 488/0 e 0 to 0 dl 1746129582 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129571.161908:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f95a680 with x1830948734118528 ext(3309568->3313663) 00010000:00010000:0.0:1746129571.161915:0:21725:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f851800/0x40a459093b069d25 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3313663) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20ff3 expref: 24 pid: 7148 timeout: 926 lvb_type: 0 00010000:00010000:0.0:1746129571.161927:0:21725:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f851800/0x40a459093b069d25 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3313663) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20ff3 expref: 24 pid: 7148 timeout: 926 lvb_type: 0 00002000:00010000:0.0:1746129571.161937:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f95a680 00000100:00100000:0.0:1746129571.161948:0:21725:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2421 00000100:00100000:0.0:1746129571.161952:0:21725:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f95a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ada2ffba-8920-4ecb-8068-68caa9806978+24:1963:x1830948734118528:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:0.0:1746129571.162064:0:21725:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f95a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ada2ffba-8920-4ecb-8068-68caa9806978+24:1963:x1830948734118528:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 110us (227us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746129571.162069:0:21725:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2421 00002000:00100000:0.0:1746129571.162075:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ef:0x0] (3309568->3313663) req@ffff88009f95a680 x1830948734118528/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:312/0 lens 488/4536 e 0 to 0 dl 1746129582 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129571.162082:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f95a680 with x1830948734118528 ext(3309568->3313663) 00010000:00010000:0.0:1746129571.162086:0:21725:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f851800/0x40a459093b069d25 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3313663) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20ff3 expref: 24 pid: 7148 timeout: 926 lvb_type: 0 00010000:00010000:0.0:1746129571.162093:0:21725:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f851800/0x40a459093b069d25 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3313663) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20ff3 expref: 24 pid: 7148 timeout: 926 lvb_type: 0 00002000:00010000:0.0:1746129571.162098:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f95a680 00000100:00100000:0.0:1746129571.162222:0:4699:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094f45f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4699:1830948737509504:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129571.162230:0:4699:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094f47480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4699:1830948737509632:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129571.162256:0:4699:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800955d3a00/0x40a459093b069d4f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [1527808->1982463] (req 1527808->1982463) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21008 expref: 18 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129571.162268:0:4699:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800955d3a00, rc 0) 00000100:00100000:0.0:1746129571.162288:0:4699:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f95ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+18:32305:x1830948734117760:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 15433us (17007us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129571.162321:0:4699:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16137 00000100:00100000:2.0:1746129571.163095:0:7086:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013575c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7086:1830948737509248:192.168.202.4@tcp:105: 00000100:00100000:2.0:1746129571.163104:0:7086:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013575ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7086:1830948737509376:192.168.202.4@tcp:105: 00010000:00010000:2.0:1746129571.163116:0:7086:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129571.163138:0:7086:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f958000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ada2ffba-8920-4ecb-8068-68caa9806978+23:1960:x1830948734117632:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 16723us (19212us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129571.163145:0:7086:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8272 00000100:00100000:0.0:1746129571.164149:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129571.166976:0:7086:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734118784 00000100:00100000:2.0:1746129571.166986:0:7086:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734118784 00010000:00010000:2.0:1746129571.167016:0:7086:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800915dc600/0x40a459093b069ca0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20f75 expref: 28 pid: 11014 timeout: 926 lvb_type: 1 00000100:00100000:2.0:1746129571.167039:0:7086:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8275 00000100:00100000:2.0:1746129571.167045:0:7086:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f958e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ada2ffba-8920-4ecb-8068-68caa9806978+28:1960:x1830948734118784:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129571.167055:0:7086:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129571.167072:0:7086:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800915dc600/0x40a459093b069ca0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20f75 expref: 28 pid: 11014 timeout: 926 lvb_type: 1 00010000:00010000:2.0:1746129571.167081:0:7086:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800915dc600/0x40a459093b069ca0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20f75 expref: 28 pid: 11014 timeout: 926 lvb_type: 1 00010000:00010000:2.0:1746129571.167097:0:7086:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800915dc600/0x40a459093b069ca0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20f75 expref: 28 pid: 11014 timeout: 926 lvb_type: 1 00010000:00010000:2.0:1746129571.167122:0:7086:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129571.167148:0:7086:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f958e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ada2ffba-8920-4ecb-8068-68caa9806978+27:1960:x1830948734118784:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 103us (3000us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129571.167153:0:7086:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8275 00000100:00100000:0.0:1746129571.169825:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129571.169868:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129571.169895:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129571.169909:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129571.169926:0:11014:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734118912 00000100:00100000:0.0:1746129571.169932:0:11014:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734118912 00000100:00100000:0.0:1746129571.169968:0:11014:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734119040 00000100:00100000:0.0:1746129571.169970:0:11014:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734119040 00000100:00100000:0.0:1746129571.169982:0:11014:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734119168 00000100:00100000:0.0:1746129571.169984:0:11014:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734119168 00000100:00100000:0.0:1746129571.169996:0:11014:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16138 00000100:00100000:0.0:1746129571.170002:0:11014:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f959f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:068dab75-d300-4ead-a742-d14572ad1e50+5:1962:x1830948734118912:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:0.0:1746129571.170017:0:11014:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129571.170030:0:11014:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009efe8200/0x40a459093b069d56 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2100f expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129571.170048:0:11014:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129571.170050:0:11014:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129571.170057:0:11014:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009efe8200/0x40a459093b069d56 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2100f expref: 6 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129571.170071:0:11014:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009efe8200/0x40a459093b069d56 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2100f expref: 6 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129571.170080:0:11014:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009efe8200, rc 0) 00000100:00100000:0.0:1746129571.170115:0:11014:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f959f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:068dab75-d300-4ead-a742-d14572ad1e50+6:1962:x1830948734118912:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 113us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129571.170121:0:11014:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16138 00000100:00100000:0.0:1746129571.170137:0:11014:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16139 00000100:00100000:0.0:1746129571.170141:0:11014:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f95a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:068dab75-d300-4ead-a742-d14572ad1e50+6:1963:x1830948734119040:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:0.0:1746129571.170148:0:11014:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129571.170156:0:11014:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009efe8400/0x40a459093b069d5d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21016 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129571.170167:0:11014:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129571.170174:0:11014:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009efe8400/0x40a459093b069d5d lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21016 expref: 7 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129571.170181:0:11014:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009efe8400/0x40a459093b069d5d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21016 expref: 7 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129571.170194:0:11014:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009efe8400, rc 0) 00000100:00100000:0.0:1746129571.170208:0:11014:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f95a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:068dab75-d300-4ead-a742-d14572ad1e50+6:1963:x1830948734119040:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 67us (312us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129571.170213:0:11014:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16139 00000100:00100000:0.0:1746129571.170223:0:11014:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16140 00000100:00100000:0.0:1746129571.170227:0:11014:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f95b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:068dab75-d300-4ead-a742-d14572ad1e50+5:1962:x1830948734119168:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:0.0:1746129571.170232:0:11014:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129571.170238:0:11014:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009efe9200/0x40a459093b069d64 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2101d expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129571.170247:0:11014:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129571.170249:0:11014:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129571.170253:0:11014:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009efe9200/0x40a459093b069d64 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2101d expref: 6 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129571.170261:0:11014:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009efe9200/0x40a459093b069d64 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2101d expref: 6 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129571.170266:0:11014:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009efe9200, rc 0) 00000100:00100000:0.0:1746129571.170279:0:11014:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f95b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:068dab75-d300-4ead-a742-d14572ad1e50+6:1962:x1830948734119168:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 52us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129571.170283:0:11014:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16140 00000100:00100000:0.0:1746129571.170354:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129571.170367:0:8412:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734119296 00000100:00100000:0.0:1746129571.170370:0:8412:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734119296 00000100:00100000:0.0:1746129571.170384:0:8412:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16141 00000100:00100000:0.0:1746129571.170388:0:8412:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f95b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:068dab75-d300-4ead-a742-d14572ad1e50+6:1963:x1830948734119296:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:0.0:1746129571.170393:0:8412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129571.170400:0:8412:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009efe8e00/0x40a459093b069d6b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21024 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129571.170409:0:8412:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129571.170411:0:8412:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129571.170415:0:8412:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009efe8e00/0x40a459093b069d6b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21024 expref: 7 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129571.170424:0:8412:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009efe8e00/0x40a459093b069d6b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21024 expref: 7 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129571.170435:0:8412:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009efe8e00, rc 0) 00000100:00100000:0.0:1746129571.170449:0:8412:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f95b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:068dab75-d300-4ead-a742-d14572ad1e50+7:1963:x1830948734119296:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 61us (95us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129571.170453:0:8412:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16141 00000100:00100000:0.0:1746129571.170486:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129571.170664:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734118656 00000100:00100000:3.0:1746129571.170667:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734118656 00010000:00010000:3.0:1746129571.170683:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800909cfe00/0x40a459093b069cd8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20f98 expref: 18 pid: 11014 timeout: 926 lvb_type: 1 00000100:00100000:3.0:1746129571.170703:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8276 00000100:00100000:3.0:1746129571.170707:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f958380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+18:1960:x1830948734118656:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129571.170714:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129571.170731:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800909cfe00/0x40a459093b069cd8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20f98 expref: 18 pid: 11014 timeout: 926 lvb_type: 1 00010000:00010000:3.0:1746129571.170739:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800909cfe00/0x40a459093b069cd8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20f98 expref: 18 pid: 11014 timeout: 926 lvb_type: 1 00010000:00010000:3.0:1746129571.170752:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800909cfe00/0x40a459093b069cd8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20f98 expref: 18 pid: 11014 timeout: 926 lvb_type: 1 00010000:00010000:3.0:1746129571.173222:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129571.173227:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129571.173236:0:7085:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800955d3a00/0x40a459093b069d4f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1527808->1982463) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21008 expref: 17 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.173246:0:7085:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800955d3a00/0x40a459093b069d4f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1527808->1982463) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21008 expref: 17 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.173282:0:7085:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800955d3a00/0x40a459093b069d4f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1527808->1982463) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21008 expref: 17 pid: 4699 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129571.173320:0:7085:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094f45180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7085:1830948737509760:192.168.202.4@tcp:105: 00000100:00100000:3.0:1746129571.173379:0:7085:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a6ce8780 going to sleep for 11 seconds 00000100:00100000:2.0:1746129571.173836:0:20577:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734119424 00000100:00100000:2.0:1746129571.173842:0:20577:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734119424 00000100:00100000:2.0:1746129571.173876:0:20577:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16142 00000100:00100000:2.0:1746129571.173881:0:20577:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f959880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:068dab75-d300-4ead-a742-d14572ad1e50+7:1962:x1830948734119424:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:2.0:1746129571.173891:0:20577:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129571.173901:0:20577:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c173a00/0x40a459093b069d72 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2102b expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129571.173929:0:20577:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013575ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20577:1830948737509888:192.168.202.4@tcp:106: 00000100:00100000:2.0:1746129571.173955:0:20577:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a00c00 going to sleep for 11 seconds 00000100:00080000:1.0:1746129571.174047:0:7097:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1746129571.174051:0:7097:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746129571.174481:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129571.174561:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734119552 00000100:00100000:3.0:1746129571.174565:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734119552 00000100:00100000:3.0:1746129571.174583:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16143 00000100:00100000:3.0:1746129571.174588:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a77b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:068dab75-d300-4ead-a742-d14572ad1e50+6:1963:x1830948734119552:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:3.0:1746129571.174594:0:7148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129571.174602:0:7148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c16a200/0x40a459093b069d79 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21032 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129571.174625:0:7148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094f44a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:7148:1830948737510016:192.168.202.4@tcp:106: 00000100:00100000:0.0:1746129571.174654:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129571.174683:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129571.174700:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734120064 00000100:00100000:0.0:1746129571.174703:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734120064 00000100:00100000:0.0:1746129571.174734:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4752 00000100:00100000:0.0:1746129571.174740:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132c24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ada2ffba-8920-4ecb-8068-68caa9806978+312:32300:x1830948734120064:12345-192.168.202.4@tcp:35:multiop.0 00000100:00100000:1.0:1746129571.174805:0:31518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734119808 00000100:00100000:1.0:1746129571.174809:0:31518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734119808 00002000:00100000:1.0:1746129571.174829:0:31518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->3313663) req@ffff88009f958000 x1830948734119808/t0(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:312/0 lens 488/0 e 0 to 0 dl 1746129582 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129571.174836:0:31518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f958000 with x1830948734119808 ext(3145728->3313663) 00010000:00010000:1.0:1746129571.174841:0:31518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f851800/0x40a459093b069d25 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3313663) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20ff3 expref: 23 pid: 7148 timeout: 926 lvb_type: 0 00010000:00010000:1.0:1746129571.174850:0:31518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f851800/0x40a459093b069d25 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3313663) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20ff3 expref: 23 pid: 7148 timeout: 926 lvb_type: 0 00002000:00010000:1.0:1746129571.174855:0:31518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f958000 00000100:00100000:1.0:1746129571.174871:0:8417:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2422 00000100:00100000:0.0:1746129571.174875:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132c24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ada2ffba-8920-4ecb-8068-68caa9806978+313:32300:x1830948734120064:12345-192.168.202.4@tcp:35:multiop.0 Request processed in 135us (190us total) trans 8589945301 rc 0/0 00000100:00100000:1.0:1746129571.174876:0:8417:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f958000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ada2ffba-8920-4ecb-8068-68caa9806978+23:1960:x1830948734119808:12345-192.168.202.4@tcp:4:multiop.0 00000100:00100000:0.0:1746129571.174882:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4752 00000100:00100000:3.0:1746129571.175247:0:7148:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a6ce8900 going to sleep for 11 seconds 00000100:00100000:3.0:1746129571.175728:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f958a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+13:1960:x1830948734118272:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 14161us (14471us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129571.175734:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7788 00002000:00100000:3.0:1746129571.175739:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ef:0x0] (2097152->3145727) req@ffff88009f958a80 x1830948734118272/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:312/0 lens 488/440 e 0 to 0 dl 1746129582 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129571.175746:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f958a80 with x1830948734118272 ext(2097152->3145727) 00002000:00010000:3.0:1746129571.175750:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f958a80 00000100:00100000:3.0:1746129571.180358:0:7085:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094f45180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7085:1830948737509760:192.168.202.4@tcp:105: 00010000:00010000:3.0:1746129571.180378:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129571.180478:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129571.180559:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f958380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+17:1960:x1830948734118656:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 9850us (10739us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129571.180571:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8276 00000100:00100000:3.0:1746129571.180621:0:7148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094f44a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:7148:1830948737510016:192.168.202.4@tcp:106: 00010000:00010000:3.0:1746129571.180641:0:7148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c16a200/0x40a459093b069d79 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21032 expref: 7 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129571.180652:0:7148:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c16a200/0x40a459093b069d79 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21032 expref: 7 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129571.180660:0:7148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c16a200, rc 0) 00000100:00100000:3.0:1746129571.180677:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a77b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:068dab75-d300-4ead-a742-d14572ad1e50+6:1963:x1830948734119552:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 6089us (6202us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129571.180682:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16143 00000100:00100000:3.0:1746129571.180719:0:20577:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013575ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20577:1830948737509888:192.168.202.4@tcp:106: 00010000:00010000:3.0:1746129571.180732:0:20577:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c173a00/0x40a459093b069d72 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2102b expref: 8 pid: 20577 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129571.180740:0:20577:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c173a00/0x40a459093b069d72 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2102b expref: 8 pid: 20577 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129571.180747:0:20577:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c173a00, rc 0) 00000100:00100000:3.0:1746129571.180761:0:20577:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f959880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:068dab75-d300-4ead-a742-d14572ad1e50+7:1962:x1830948734119424:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 6880us (10274us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129571.180766:0:20577:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16142 00000100:00100000:3.0:1746129571.181233:0:31518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734120320 00000100:00100000:3.0:1746129571.181238:0:31518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734120320 00002000:00100000:3.0:1746129571.181463:0:31518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3f3:0x0] (1527808->1531903) req@ffff880132c24380 x1830948734120320/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:312/0 lens 488/0 e 0 to 0 dl 1746129582 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129571.181471:0:31518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880132c24380 with x1830948734120320 ext(1527808->1531903) 00002000:00010000:3.0:1746129571.181476:0:31518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880132c24380 00000100:00100000:3.0:1746129571.181493:0:31518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7789 00000100:00100000:3.0:1746129571.181500:0:31518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132c24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+17:1962:x1830948734120320:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:3.0:1746129571.181591:0:31518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132c24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+17:1962:x1830948734120320:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 91us (1114us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129571.181596:0:31518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7789 00002000:00100000:3.0:1746129571.181601:0:31518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3f3:0x0] (1527808->1531903) req@ffff880132c24380 x1830948734120320/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:312/0 lens 488/4536 e 0 to 0 dl 1746129582 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129571.181607:0:31518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880132c24380 with x1830948734120320 ext(1527808->1531903) 00002000:00010000:3.0:1746129571.181610:0:31518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880132c24380 00000100:00100000:1.0:1746129571.182116:0:8417:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f958000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ada2ffba-8920-4ecb-8068-68caa9806978+25:1960:x1830948734119808:12345-192.168.202.4@tcp:4:multiop.0 Request processed in 7238us (7461us total) trans 21474841337 rc 0/0 00000100:00100000:1.0:1746129571.182122:0:8417:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2422 00002000:00100000:1.0:1746129571.182126:0:8417:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->3313663) req@ffff88009f958000 x1830948734119808/t21474841337(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:312/0 lens 488/448 e 0 to 0 dl 1746129582 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129571.182133:0:8417:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f958000 with x1830948734119808 ext(3145728->3313663) 00010000:00010000:1.0:1746129571.182137:0:8417:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f851800/0x40a459093b069d25 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3313663) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20ff3 expref: 25 pid: 7148 timeout: 926 lvb_type: 0 00010000:00010000:1.0:1746129571.182148:0:8417:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f851800/0x40a459093b069d25 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3313663) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20ff3 expref: 25 pid: 7148 timeout: 926 lvb_type: 0 00002000:00010000:1.0:1746129571.182154:0:8417:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f958000 00000100:00100000:0.0:1746129571.183074:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129571.183831:0:20577:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734120448 00000100:00100000:3.0:1746129571.183837:0:20577:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734120448 00000100:00100000:3.0:1746129571.183921:0:20577:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16144 00000100:00100000:3.0:1746129571.183927:0:20577:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132c25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+17:32303:x1830948734120448:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129571.183938:0:20577:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129571.183960:0:20577:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c16b200/0x40a459093b069d80 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21039 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.183987:0:20577:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a95ed800/0x40a459093b069d09 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2560000->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20fd7 expref: 26 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.183999:0:20577:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129571.184002:0:20577:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129571.184005:0:20577:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c16b200/0x40a459093b069d80 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21039 expref: 18 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.184034:0:20577:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a95ed800/0x40a459093b069d09 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2560000->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20fd7 expref: 26 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.184043:0:20577:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a95ed800/0x40a459093b069d09 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2560000->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20fd7 expref: 26 pid: 7148 timeout: 926 lvb_type: 0 00000100:00100000:3.0:1746129571.184058:0:20577:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094f44a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20577:1830948737510144:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129571.184501:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129571.184590:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129571.184607:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734120832 00000100:00100000:0.0:1746129571.184622:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734120832 00000100:00100000:0.0:1746129571.184658:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11208 00000100:00100000:0.0:1746129571.184663:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132c25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:068dab75-d300-4ead-a742-d14572ad1e50+21:32306:x1830948734120832:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:0.0:1746129571.184672:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129571.184682:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009efe9600/0x40a459093b069d87 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21040 expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129571.184772:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009efe9000/0x40a459093b069d8e lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129571.184799:0:14549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f850600/0x40a459093b069d48 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21001 expref: 22 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129571.184805:0:14549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009efe9000/0x40a459093b069d8e lrc: 4/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129571.184822:0:14549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f850600/0x40a459093b069d48 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21001 expref: 22 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129571.184830:0:14549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f850600/0x40a459093b069d48 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21001 expref: 22 pid: 14549 timeout: 926 lvb_type: 0 00000100:00100000:0.0:1746129571.184838:0:14549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880132c26680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830948737510272:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129571.184973:0:20577:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a6ce8780 going to sleep for 11 seconds 00000100:00100000:3.0:1746129571.184989:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734120576 00000100:00100000:3.0:1746129571.184992:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734120576 00010000:00010000:3.0:1746129571.185118:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f851800/0x40a459093b069d25 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3313663) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20ff3 expref: 25 pid: 7148 timeout: 926 lvb_type: 0 00000100:00100000:3.0:1746129571.185138:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8277 00000100:00100000:3.0:1746129571.185157:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132c27480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ada2ffba-8920-4ecb-8068-68caa9806978+25:1962:x1830948734120576:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129571.185167:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129571.185183:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f851800/0x40a459093b069d25 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3313663) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20ff3 expref: 25 pid: 7148 timeout: 926 lvb_type: 0 00010000:00010000:3.0:1746129571.185191:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f851800/0x40a459093b069d25 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3313663) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20ff3 expref: 25 pid: 7148 timeout: 926 lvb_type: 0 00010000:00010000:3.0:1746129571.185205:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f851800/0x40a459093b069d25 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3313663) gid 0 flags: 0x44801000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20ff3 expref: 25 pid: 7148 timeout: 926 lvb_type: 0 00010000:00010000:3.0:1746129571.185216:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129571.185218:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129571.185222:0:7085:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800955d2e00/0x40a459093b069d2c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20ffa expref: 24 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.185228:0:7085:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800955d2e00/0x40a459093b069d2c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20ffa expref: 24 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.185246:0:7085:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800955d2e00/0x40a459093b069d2c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20ffa expref: 24 pid: 4699 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129571.185254:0:7085:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094f45180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7085:1830948737510400:192.168.202.4@tcp:105: 00000100:00100000:3.0:1746129571.185279:0:7085:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a6ce8c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746129571.185762:0:14549:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e29f240 going to sleep for 11 seconds 00000100:00100000:0.0:1746129571.189503:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129571.189559:0:15749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734121088 00000100:00100000:2.0:1746129571.189566:0:15749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734121088 00010000:00010000:2.0:1746129571.189592:0:15749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f850600/0x40a459093b069d48 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21001 expref: 23 pid: 14549 timeout: 926 lvb_type: 0 00000100:00100000:2.0:1746129571.189616:0:15749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8278 00000100:00100000:2.0:1746129571.189622:0:15749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132c25f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:068dab75-d300-4ead-a742-d14572ad1e50+23:1963:x1830948734121088:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129571.189633:0:15749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129571.189638:0:15749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f850600/0x40a459093b069d48 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21001 expref: 23 pid: 14549 timeout: 926 lvb_type: 0 00010000:00010000:2.0:1746129571.189652:0:15749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f850600/0x40a459093b069d48 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21001 expref: 23 pid: 14549 timeout: 926 lvb_type: 0 00010000:00010000:2.0:1746129571.189669:0:15749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:2.0:1746129571.189674:0:15749:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009efe9000/0x40a459093b069d8e lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129571.189681:0:15749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009efe9000/0x40a459093b069d8e lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50290000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129571.189687:0:15749:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009efe9000/0x40a459093b069d8e lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50290000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129571.189701:0:15749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129571.189739:0:15749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132c25f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:068dab75-d300-4ead-a742-d14572ad1e50+23:1963:x1830948734121088:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 116us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129571.189744:0:15749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8278 00000100:00100000:3.0:1746129571.189758:0:20577:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094f44a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20577:1830948737510144:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129571.189819:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f850600/0x40a459093b069d48 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21001 expref: 22 pid: 14549 timeout: 926 lvb_type: 0 00000100:00100000:1.0:1746129571.189833:0:14549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880132c26680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830948737510272:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129571.189844:0:14549:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009efe9000/0x40a459093b069d8e lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129571.189850:0:14549:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009efe9000/0x40a459093b069d8e lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129571.189854:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009efe9000/0x40a459093b069d8e lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00200000:1.0:1746129571.189870:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:1.0:1746129571.189977:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009efe9600/0x40a459093b069d87 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21040 expref: 23 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129571.189989:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009efe9000/0x40a459093b069d8e lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21040 expref: 22 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129571.189995:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:1.0:1746129571.189997:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746129571.189999:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009efe9000, rc 0) 00010000:00010000:3.0:1746129571.190015:0:20577:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c16b200/0x40a459093b069d80 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21039 expref: 18 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.190069:0:20577:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c16b200, rc 0) 00000100:00100000:3.0:1746129571.190089:0:20577:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132c25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+18:32303:x1830948734120448:12345-192.168.202.4@tcp:101:cat.0 Request processed in 6163us (7017us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129571.190094:0:20577:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16144 00000100:00100000:1.0:1746129571.190927:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132c25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:068dab75-d300-4ead-a742-d14572ad1e50+22:32306:x1830948734120832:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 6262us (6335us total) trans 8589945302 rc 0/0 00000100:00100000:1.0:1746129571.190934:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11208 00000100:00100000:0.0:1746129571.191253:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129571.191340:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129571.191427:0:8417:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734121472 00000100:00100000:1.0:1746129571.191432:0:8417:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734121472 00002000:00100000:1.0:1746129571.191458:0:8417:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3f3:0x0] (1978368->1982463) req@ffff880132c24e00 x1830948734121472/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:312/0 lens 488/0 e 0 to 0 dl 1746129582 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129571.191467:0:8417:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880132c24e00 with x1830948734121472 ext(1978368->1982463) 00002000:00010000:1.0:1746129571.191471:0:8417:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880132c24e00 00000100:00100000:1.0:1746129571.191482:0:8417:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734121344 00000100:00100000:1.0:1746129571.191484:0:8417:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734121344 00002000:00100000:1.0:1746129571.191495:0:8417:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3f5:0x0] (2560000->3145727) req@ffff880132c24a80 x1830948734121344/t0(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:312/0 lens 488/0 e 0 to 0 dl 1746129582 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129571.191501:0:8417:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880132c24a80 with x1830948734121344 ext(2560000->3145727) 00010000:00010000:1.0:1746129571.191506:0:8417:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a95ed800/0x40a459093b069d09 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2560000->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20fd7 expref: 27 pid: 7148 timeout: 926 lvb_type: 0 00010000:00010000:1.0:1746129571.191517:0:8417:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a95ed800/0x40a459093b069d09 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2560000->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20fd7 expref: 27 pid: 7148 timeout: 926 lvb_type: 0 00002000:00010000:1.0:1746129571.191522:0:8417:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880132c24a80 00000100:00100000:1.0:1746129571.191531:0:8417:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2423 00000100:00100000:1.0:1746129571.191536:0:8417:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132c24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ada2ffba-8920-4ecb-8068-68caa9806978+27:1962:x1830948734121344:12345-192.168.202.4@tcp:4:multiop.0 00000100:00100000:3.0:1746129571.192076:0:7085:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094f45180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7085:1830948737510400:192.168.202.4@tcp:105: 00010000:00010000:3.0:1746129571.192088:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129571.192107:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132c27480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ada2ffba-8920-4ecb-8068-68caa9806978+24:1962:x1830948734120576:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 6963us (7606us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129571.192113:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8277 00000100:00100000:3.0:1746129571.192141:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7790 00000100:00100000:3.0:1746129571.192146:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132c24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+18:1960:x1830948734121472:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:3.0:1746129571.192245:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132c24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+18:1960:x1830948734121472:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 99us (993us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129571.192250:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7790 00002000:00100000:3.0:1746129571.192255:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f3:0x0] (1978368->1982463) req@ffff880132c24e00 x1830948734121472/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:312/0 lens 488/4536 e 0 to 0 dl 1746129582 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129571.192261:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880132c24e00 with x1830948734121472 ext(1978368->1982463) 00002000:00010000:3.0:1746129571.192265:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880132c24e00 00000100:00100000:0.0:1746129571.193113:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129571.193825:0:31518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734121728 00000100:00100000:2.0:1746129571.193830:0:31518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734121728 00002000:00100000:2.0:1746129571.193856:0:31518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->4194303) req@ffff880132c25880 x1830948734121728/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:312/0 lens 488/0 e 0 to 0 dl 1746129582 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129571.193864:0:31518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880132c25880 with x1830948734121728 ext(3145728->4194303) 00002000:00010000:2.0:1746129571.193868:0:31518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880132c25880 00000100:00100000:2.0:1746129571.193886:0:31518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7791 00000100:00100000:2.0:1746129571.193892:0:31518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132c25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ada2ffba-8920-4ecb-8068-68caa9806978+24:1963:x1830948734121728:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:0.0:1746129571.196327:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129571.196820:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734121856 00000100:00100000:1.0:1746129571.196827:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734121856 00000100:00100000:1.0:1746129571.196866:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11209 00000100:00100000:1.0:1746129571.196872:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132c24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:068dab75-d300-4ead-a742-d14572ad1e50+22:32306:x1830948734121856:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:1.0:1746129571.196893:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129571.196909:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091570000/0x40a459093b069d9c lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21047 expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129571.196979:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091571c00/0x40a459093b069da3 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129571.196992:0:14549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009efe9000/0x40a459093b069d8e lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21040 expref: 23 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129571.196998:0:14549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091571c00/0x40a459093b069da3 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129571.197025:0:14549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009efe9000/0x40a459093b069d8e lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21040 expref: 23 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129571.197034:0:14549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009efe9000/0x40a459093b069d8e lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21040 expref: 23 pid: 14549 timeout: 926 lvb_type: 0 00000100:00100000:1.0:1746129571.197044:0:14549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a77b0700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830948737510528:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129571.197096:0:14549:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934d2b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746129571.200584:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129571.200657:0:14549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a77b0700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830948737510528:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129571.200678:0:14549:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880091571c00/0x40a459093b069da3 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000100:00100000:3.0:1746129571.200713:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129571.200735:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734122240 00000100:00100000:3.0:1746129571.200741:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734122240 00010000:00010000:3.0:1746129571.200771:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009efe9000/0x40a459093b069d8e lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21040 expref: 24 pid: 14549 timeout: 926 lvb_type: 0 00000100:00100000:3.0:1746129571.200794:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8279 00000100:00100000:3.0:1746129571.200800:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f45180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:068dab75-d300-4ead-a742-d14572ad1e50+24:1963:x1830948734122240:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129571.200811:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129571.200817:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009efe9000/0x40a459093b069d8e lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21040 expref: 24 pid: 14549 timeout: 926 lvb_type: 0 00010000:00010000:3.0:1746129571.200826:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009efe9000/0x40a459093b069d8e lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21040 expref: 24 pid: 14549 timeout: 926 lvb_type: 0 00010000:00010000:3.0:1746129571.200850:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009efe9000/0x40a459093b069d8e lrc: 0/0,0 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21040 expref: 24 pid: 14549 timeout: 926 lvb_type: 0 00010000:00010000:3.0:1746129571.200870:0:7085:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:3.0:1746129571.200874:0:7085:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880091571c00/0x40a459093b069da3 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129571.200883:0:7085:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880091571c00/0x40a459093b069da3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129571.200888:0:7085:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091571c00/0x40a459093b069da3 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129571.200904:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129571.200935:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f45180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:068dab75-d300-4ead-a742-d14572ad1e50+23:1963:x1830948734122240:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 134us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129571.200941:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8279 00000100:00100000:2.0:1746129571.201055:0:14551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734122112 00000100:00100000:2.0:1746129571.201059:0:14551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734122112 00000100:00100000:2.0:1746129571.201083:0:14551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4753 00000100:00100000:2.0:1746129571.201088:0:14551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a77b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+28:32305:x1830948734122112:12345-192.168.202.4@tcp:35:multiop.0 00000100:00100000:2.0:1746129571.201223:0:14551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a77b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+29:32305:x1830948734122112:12345-192.168.202.4@tcp:35:multiop.0 Request processed in 134us (644us total) trans 8589945303 rc 0/0 00000100:00100000:2.0:1746129571.201228:0:14551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4753 00000100:00100000:1.0:1746129571.203635:0:8417:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132c24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ada2ffba-8920-4ecb-8068-68caa9806978+29:1962:x1830948734121344:12345-192.168.202.4@tcp:4:multiop.0 Request processed in 11875us (12072us total) trans 17179874093 rc 0/0 00000100:00100000:1.0:1746129571.203645:0:8417:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2423 00002000:00100000:1.0:1746129571.203656:0:8417:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3f5:0x0] (2560000->3145727) req@ffff880132c24a80 x1830948734121344/t17179874093(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:312/0 lens 488/448 e 0 to 0 dl 1746129582 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129571.203664:0:8417:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880132c24a80 with x1830948734121344 ext(2560000->3145727) 00010000:00010000:1.0:1746129571.203672:0:8417:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a95ed800/0x40a459093b069d09 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2560000->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20fd7 expref: 29 pid: 7148 timeout: 926 lvb_type: 0 00010000:00010000:1.0:1746129571.203685:0:8417:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a95ed800/0x40a459093b069d09 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2560000->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20fd7 expref: 29 pid: 7148 timeout: 926 lvb_type: 0 00002000:00010000:1.0:1746129571.203692:0:8417:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880132c24a80 00010000:00010000:1.0:1746129571.203717:0:14549:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880091571c00/0x40a459093b069da3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129571.203723:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091571c00/0x40a459093b069da3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00200000:1.0:1746129571.203752:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00000004:00200000:1.0:1746129571.203755:0:14549:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746129571.203768:0:14549:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880091571c00/0x40a459093b069da3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129571.203792:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091570000/0x40a459093b069d9c lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21047 expref: 23 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129571.203824:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091571c00/0x40a459093b069da3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21047 expref: 22 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129571.203830:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:1.0:1746129571.203832:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746129571.203835:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091571c00, rc 0) 00000100:00100000:1.0:1746129571.203866:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132c24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:068dab75-d300-4ead-a742-d14572ad1e50+22:32306:x1830948734121856:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 6994us (7574us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129571.203872:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11209 00000100:00100000:0.0:1746129571.208260:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129571.208290:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129571.208403:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129571.208414:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734122368 00000100:00100000:1.0:1746129571.208422:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734122368 00000100:00100000:1.0:1746129571.208458:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734122496 00000100:00100000:1.0:1746129571.208460:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734122496 00000100:00100000:1.0:1746129571.208471:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734122624 00000100:00100000:1.0:1746129571.208472:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734122624 00000100:00100000:1.0:1746129571.208486:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16145 00000100:00100000:1.0:1746129571.208493:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132c25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:068dab75-d300-4ead-a742-d14572ad1e50+7:1962:x1830948734122368:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:1.0:1746129571.208507:0:7148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129571.208522:0:7148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091570a00/0x40a459093b069daa lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2104e expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129571.208567:0:7148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a77b0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:7148:1830948737510656:192.168.202.4@tcp:106: 00000100:00100000:1.0:1746129571.208634:0:7148:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934d2b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746129571.208651:0:31503:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16146 00000100:00100000:1.0:1746129571.208657:0:31503:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132c26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:068dab75-d300-4ead-a742-d14572ad1e50+7:1962:x1830948734122496:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:1.0:1746129571.208663:0:31503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129571.208671:0:31503:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136b1d400/0x40a459093b069db1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21055 expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129571.208682:0:31503:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129571.208684:0:31503:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129571.208690:0:31503:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136b1d400/0x40a459093b069db1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21055 expref: 8 pid: 31503 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129571.208706:0:31503:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880136b1d400/0x40a459093b069db1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21055 expref: 8 pid: 31503 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129571.208714:0:31503:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136b1d400, rc 0) 00000100:00100000:1.0:1746129571.208730:0:31503:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132c26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:068dab75-d300-4ead-a742-d14572ad1e50+8:1962:x1830948734122496:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 73us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129571.208735:0:31503:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16146 00000100:00100000:1.0:1746129571.208749:0:31503:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16147 00000100:00100000:1.0:1746129571.208753:0:31503:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132c26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:068dab75-d300-4ead-a742-d14572ad1e50+8:1962:x1830948734122624:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:1.0:1746129571.208757:0:31503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129571.208763:0:31503:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136b1c400/0x40a459093b069db8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2105c expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129571.208780:0:31503:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a77b1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:31503:1830948737510784:192.168.202.4@tcp:106: 00000100:00100000:1.0:1746129571.208798:0:31503:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934d29c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746129571.209426:0:31518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132c25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ada2ffba-8920-4ecb-8068-68caa9806978+24:1963:x1830948734121728:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 15531us (16310us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129571.209433:0:31518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7791 00002000:00100000:2.0:1746129571.209441:0:31518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->4194303) req@ffff880132c25880 x1830948734121728/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:312/0 lens 488/440 e 0 to 0 dl 1746129582 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129571.209453:0:31518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880132c25880 with x1830948734121728 ext(3145728->4194303) 00002000:00010000:2.0:1746129571.209457:0:31518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880132c25880 00010000:00010000:1.0:1746129571.213572:0:31503:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.202.4@tcp) returned -22 from glimpse AST (req@ffff8800a77b1500 x1830948737510784) - normal race ns: filter-lustre-OST0001_UUID lock: ffff8800a95ed800/0x40a459093b069d09 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2560000->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20fd7 expref: 28 pid: 7148 timeout: 926 lvb_type: 0 00010000:00010000:1.0:1746129571.213603:0:31503:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a95ed800/0x40a459093b069d09 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2560000->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20fd7 expref: 28 pid: 7148 timeout: 926 lvb_type: 0 00010000:00010000:1.0:1746129571.213625:0:31503:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a95ed800/0x40a459093b069d09 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2560000->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20fd7 expref: 28 pid: 7148 timeout: 926 lvb_type: 0 00000100:00100000:1.0:1746129571.213642:0:31503:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a77b1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:31503:1830948737510784:192.168.202.4@tcp:106: 00010000:00010000:1.0:1746129571.213661:0:31503:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129571.213663:0:31503:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129571.213668:0:31503:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c16b200/0x40a459093b069d80 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21039 expref: 17 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129571.213675:0:31503:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c16b200/0x40a459093b069d80 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21039 expref: 17 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129571.213704:0:31503:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012c16b200/0x40a459093b069d80 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21039 expref: 17 pid: 20577 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129571.213716:0:31503:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a77b1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:31503:1830948737510912:192.168.202.4@tcp:105: 00000100:00100000:1.0:1746129571.213766:0:31503:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934d29c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129571.213778:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00002000:00010000:1.0:1746129571.213785:0:7148:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb ctime: 1746129570 -> 1746129571 00000100:00100000:1.0:1746129571.213794:0:7148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a77b0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:7148:1830948737510656:192.168.202.4@tcp:106: 00010000:00010000:1.0:1746129571.213811:0:7148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091570a00/0x40a459093b069daa lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2104e expref: 9 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129571.213819:0:7148:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091570a00/0x40a459093b069daa lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2104e expref: 9 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129571.213826:0:7148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091570a00, rc 0) 00000100:00100000:2.0:1746129571.213845:0:7086:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734122752 00000100:00100000:1.0:1746129571.213849:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132c25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:068dab75-d300-4ead-a742-d14572ad1e50+8:1962:x1830948734122368:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 5356us (5596us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129571.213851:0:7086:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734122752 00000100:00100000:1.0:1746129571.213857:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16145 00000100:00100000:2.0:1746129571.213883:0:7086:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 789 00000100:00100000:2.0:1746129571.213888:0:7086:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009402a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ada2ffba-8920-4ecb-8068-68caa9806978+28:1962:x1830948734122752:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129571.213896:0:7086:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129571.213898:0:7086:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 40a459093b069d09) 00010000:00010000:2.0:1746129571.213900:0:7086:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129571.213919:0:7086:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009402a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ada2ffba-8920-4ecb-8068-68caa9806978+28:1962:x1830948734122752:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 31us (309us total) trans 0 rc 116/116 00000100:00100000:2.0:1746129571.213924:0:7086:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 789 00000100:00100000:0.0:1746129571.217629:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129571.217826:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734122880 00000100:00100000:1.0:1746129571.217834:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734122880 00000100:00100000:1.0:1746129571.217883:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16148 00000100:00100000:1.0:1746129571.217891:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009402ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ada2ffba-8920-4ecb-8068-68caa9806978+28:32297:x1830948734122880:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129571.217906:0:7148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129571.217920:0:7148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136b1ca00/0x40a459093b069dbf lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21063 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129571.217941:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129571.217943:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129571.217949:0:7148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136b1ca00/0x40a459093b069dbf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21063 expref: 29 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129571.217962:0:7148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880136b1ca00/0x40a459093b069dbf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21063 expref: 29 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129571.217971:0:7148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136b1ca00, rc 0) 00000100:00100000:1.0:1746129571.218032:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009402ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ada2ffba-8920-4ecb-8068-68caa9806978+29:32297:x1830948734122880:12345-192.168.202.4@tcp:101:cat.0 Request processed in 141us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129571.218037:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16148 00000100:00100000:1.0:1746129571.218071:0:31503:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a77b1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:31503:1830948737510912:192.168.202.4@tcp:105: 00010000:00010000:1.0:1746129571.218094:0:31503:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880136b1c400/0x40a459093b069db8 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2105c expref: 7 pid: 31503 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129571.218103:0:31503:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136b1c400/0x40a459093b069db8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2105c expref: 7 pid: 31503 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129571.218111:0:31503:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136b1c400, rc 0) 00000100:00100000:1.0:1746129571.218146:0:31503:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132c26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:068dab75-d300-4ead-a742-d14572ad1e50+6:1962:x1830948734122624:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 9391us (9742us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129571.218151:0:31503:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16147 00000100:00100000:0.0:1746129571.221186:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129571.221493:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734123136 00000100:00100000:1.0:1746129571.221501:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734123136 00000100:00100000:1.0:1746129571.221536:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11210 00000100:00100000:1.0:1746129571.221543:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009402b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:068dab75-d300-4ead-a742-d14572ad1e50+22:32306:x1830948734123136:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:1.0:1746129571.221559:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129571.221572:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1c600/0x40a459093b069dc6 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2106a expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129571.221642:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1ce00/0x40a459093b069dcd lrc: 3/0,1 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129571.221653:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1ce00/0x40a459093b069dcd lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129571.221662:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1ce00/0x40a459093b069dcd lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00200000:1.0:1746129571.221970:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:1.0:1746129571.222186:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1c600/0x40a459093b069dc6 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x1/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2106a expref: 25 pid: 14549 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129571.222195:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00010000:00010000:1.0:1746129571.222200:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1ce00/0x40a459093b069dcd lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2106a expref: 24 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129571.222211:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:1.0:1746129571.222213:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746129571.222216:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136b1ce00, rc 0) 00000100:00100000:1.0:1746129571.222250:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009402b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:068dab75-d300-4ead-a742-d14572ad1e50+24:32306:x1830948734123136:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 708us (1071us total) trans 8589945304 rc 0/0 00000100:00100000:1.0:1746129571.222256:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11210 00000100:00100000:2.0:1746129571.222436:0:31518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734123392 00000100:00100000:2.0:1746129571.222440:0:31518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734123392 00002000:00100000:2.0:1746129571.222463:0:31518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3f5:0x0] (2097152->3145727) req@ffff88009402b100 x1830948734123392/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:312/0 lens 488/0 e 0 to 0 dl 1746129582 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129571.222516:0:31518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009402b100 with x1830948734123392 ext(2097152->3145727) 00002000:00010000:2.0:1746129571.222520:0:31518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009402b100 00000100:00100000:2.0:1746129571.222611:0:31518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7792 00000100:00100000:2.0:1746129571.222618:0:31518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009402b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+18:1963:x1830948734123392:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:0.0:1746129571.223865:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129571.223929:0:8417:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734123648 00000100:00100000:1.0:1746129571.223934:0:8417:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734123648 00002000:00100000:1.0:1746129571.223956:0:8417:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3f5:0x0] (3145728->4194303) req@ffff880094028380 x1830948734123648/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:312/0 lens 488/0 e 0 to 0 dl 1746129582 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129571.223963:0:8417:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094028380 with x1830948734123648 ext(3145728->4194303) 00002000:00010000:1.0:1746129571.223967:0:8417:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094028380 00000100:00100000:1.0:1746129571.223979:0:8417:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7793 00000100:00100000:1.0:1746129571.223983:0:8417:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094028380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ada2ffba-8920-4ecb-8068-68caa9806978+29:1962:x1830948734123648:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:0.0:1746129571.224470:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129571.226098:0:11014:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734123776 00000100:00100000:3.0:1746129571.226106:0:11014:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734123776 00000100:00100000:3.0:1746129571.226147:0:11014:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16149 00000100:00100000:3.0:1746129571.226153:0:11014:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094029500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:068dab75-d300-4ead-a742-d14572ad1e50+8:1962:x1830948734123776:12345-192.168.202.4@tcp:1:lfs.0 00010000:00010000:3.0:1746129571.226187:0:11014:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009fab5e00/0x40a459093b069ddb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.226202:0:11014:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d863400/0x40a459093b069ca7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20f6e expref: 23 pid: 31503 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129571.226209:0:11014:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009efe8200/0x40a459093b069d56 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2100f expref: 8 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129571.226215:0:11014:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fb55400/0x40a459093b069cc3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20f91 expref: 12 pid: 31503 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129571.226220:0:11014:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129571.226222:0:11014:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129571.226225:0:11014:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fab5e00/0x40a459093b069ddb lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.226252:0:11014:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fb55400/0x40a459093b069cc3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20f91 expref: 12 pid: 31503 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129571.226262:0:11014:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fb55400/0x40a459093b069cc3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20f91 expref: 12 pid: 31503 timeout: 926 lvb_type: 1 00000100:00100000:3.0:1746129571.226273:0:11014:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094f44a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11014:1830948737511040:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129571.226366:0:11014:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009efe8200/0x40a459093b069d56 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2100f expref: 8 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129571.226373:0:11014:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009efe8200/0x40a459093b069d56 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2100f expref: 8 pid: 11014 timeout: 926 lvb_type: 1 00000100:00100000:3.0:1746129571.226381:0:11014:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094f46680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11014:1830948737511168:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129571.226402:0:11014:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d863400/0x40a459093b069ca7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20f6e expref: 23 pid: 31503 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129571.226413:0:11014:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d863400/0x40a459093b069ca7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20f6e expref: 23 pid: 31503 timeout: 926 lvb_type: 1 00000100:00100000:3.0:1746129571.226419:0:11014:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094f44000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11014:1830948737511296:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129571.226430:0:11014:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a6ce8c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746129571.226657:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129571.226689:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129571.226702:0:4699:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734124032 00000100:00100000:0.0:1746129571.226705:0:4699:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734124032 00000100:00100000:0.0:1746129571.226730:0:4699:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734124288 00000100:00100000:0.0:1746129571.226732:0:4699:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734124288 00000100:00100000:0.0:1746129571.226744:0:4699:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16150 00000100:00100000:0.0:1746129571.226748:0:4699:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094028a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:068dab75-d300-4ead-a742-d14572ad1e50+6:1962:x1830948734124032:12345-192.168.202.4@tcp:1:lfs.0 00010000:00010000:0.0:1746129571.226765:0:4699:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012c16a000/0x40a459093b069de2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129571.226776:0:4699:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800915dc400/0x40a459093b069cf4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20fc2 expref: 30 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129571.226783:0:4699:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009efe9200/0x40a459093b069d64 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2101d expref: 6 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129571.226789:0:4699:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a95ece00/0x40a459093b069cfb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20fc9 expref: 19 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129571.226795:0:4699:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129571.226796:0:4699:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129571.226798:0:4699:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c16a000/0x40a459093b069de2 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129571.226803:0:8412:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16151 00000100:00100000:2.0:1746129571.226809:0:8412:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009402bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:068dab75-d300-4ead-a742-d14572ad1e50+9:1962:x1830948734124288:12345-192.168.202.4@tcp:1:lfs.0 00010000:00010000:0.0:1746129571.226812:0:4699:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a95ece00/0x40a459093b069cfb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20fc9 expref: 19 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129571.226820:0:4699:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a95ece00/0x40a459093b069cfb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20fc9 expref: 19 pid: 7148 timeout: 926 lvb_type: 1 00010000:00010000:2.0:1746129571.226823:0:8412:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012c172600/0x40a459093b069de9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129571.226831:0:8412:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f850800/0x40a459093b069d1e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20fec expref: 12 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129571.226837:0:8412:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800955d2e00/0x40a459093b069d2c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f20ffa expref: 23 pid: 4699 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129571.226837:0:4699:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094029880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4699:1830948737511424:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129571.226843:0:8412:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880136b1d400/0x40a459093b069db1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21055 expref: 9 pid: 31503 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129571.226848:0:8412:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129571.226849:0:8412:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129571.226851:0:8412:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c172600/0x40a459093b069de9 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129571.226861:0:4699:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009efe9200/0x40a459093b069d64 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2101d expref: 6 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129571.226863:0:8412:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880136b1d400/0x40a459093b069db1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21055 expref: 9 pid: 31503 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129571.226868:0:4699:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009efe9200/0x40a459093b069d64 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2101d expref: 6 pid: 11014 timeout: 926 lvb_type: 1 00010000:00010000:2.0:1746129571.226875:0:8412:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880136b1d400/0x40a459093b069db1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21055 expref: 9 pid: 31503 timeout: 926 lvb_type: 1 00000100:00100000:0.0:1746129571.226876:0:4699:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009402aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4699:1830948737511552:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129571.226882:0:8412:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013575c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8412:1830948737511680:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129571.226893:0:4699:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800915dc400/0x40a459093b069cf4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20fc2 expref: 30 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129571.226900:0:4699:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800915dc400/0x40a459093b069cf4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20fc2 expref: 30 pid: 7148 timeout: 926 lvb_type: 0 00010000:00010000:2.0:1746129571.226902:0:8412:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800955d2e00/0x40a459093b069d2c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20ffa expref: 23 pid: 4699 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129571.226906:0:4699:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094028e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4699:1830948737511808:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129571.226909:0:8412:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800955d2e00/0x40a459093b069d2c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20ffa expref: 23 pid: 4699 timeout: 926 lvb_type: 0 00000100:00100000:2.0:1746129571.226915:0:8412:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013575fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8412:1830948737511936:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129571.226919:0:4699:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e29f240 going to sleep for 11 seconds 00010000:00010000:2.0:1746129571.226931:0:8412:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f850800/0x40a459093b069d1e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20fec expref: 12 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129571.226938:0:8412:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f850800/0x40a459093b069d1e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20fec expref: 12 pid: 7148 timeout: 926 lvb_type: 0 00000100:00100000:0.0:1746129571.226939:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129571.226945:0:8412:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013575d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8412:1830948737512064:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129571.226957:0:8412:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a00b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746129571.226974:0:20577:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734123904 00000100:00100000:3.0:1746129571.226978:0:20577:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734123904 00000100:00100000:3.0:1746129571.226996:0:20577:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16152 00000100:00100000:3.0:1746129571.227000:0:20577:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094029f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:068dab75-d300-4ead-a742-d14572ad1e50+7:1962:x1830948734123904:12345-192.168.202.4@tcp:1:lfs.0 00000100:00100000:2.0:1746129571.227007:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00010000:00010000:3.0:1746129571.227015:0:20577:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009fab5600/0x40a459093b069df0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129571.227017:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734124160 00000100:00100000:2.0:1746129571.227019:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734124160 00010000:00010000:3.0:1746129571.227025:0:20577:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800955d3a00/0x40a459093b069d4f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1527808->1982463) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21008 expref: 19 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.227030:0:20577:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129571.227031:0:20577:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00000100:00100000:0.0:1746129571.227032:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00010000:00010000:3.0:1746129571.227033:0:20577:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fab5600/0x40a459093b069df0 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129571.227036:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16153 00000100:00100000:2.0:1746129571.227040:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013575ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:068dab75-d300-4ead-a742-d14572ad1e50+10:1962:x1830948734124160:12345-192.168.202.4@tcp:1:lfs.0 00010000:00010000:3.0:1746129571.227046:0:20577:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800955d3a00/0x40a459093b069d4f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1527808->1982463) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21008 expref: 19 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.227052:0:20577:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800955d3a00/0x40a459093b069d4f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1527808->1982463) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21008 expref: 19 pid: 4699 timeout: 926 lvb_type: 0 00010000:00010000:2.0:1746129571.227054:0:4385:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012c173c00/0x40a459093b069df7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129571.227063:0:20577:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094f47480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20577:1830948737512192:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129571.227063:0:4385:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800915dde00/0x40a459093b069cb5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20f83 expref: 23 pid: 20577 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129571.227069:0:4385:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009efe8e00/0x40a459093b069d6b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21024 expref: 10 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129571.227075:0:4385:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fb54e00/0x40a459093b069cd1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20f9f expref: 12 pid: 31503 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129571.227079:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129571.227080:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129571.227082:0:4385:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c173c00/0x40a459093b069df7 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129571.227087:0:20577:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a6ce8780 going to sleep for 11 seconds 00010000:00010000:2.0:1746129571.227096:0:4385:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fb54e00/0x40a459093b069cd1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20f9f expref: 12 pid: 31503 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746129571.227098:0:22480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734124416 00000100:00100000:3.0:1746129571.227100:0:22480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734124416 00010000:00010000:2.0:1746129571.227103:0:4385:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fb54e00/0x40a459093b069cd1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20f9f expref: 12 pid: 31503 timeout: 926 lvb_type: 1 00000100:00100000:2.0:1746129571.227110:0:4385:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009016a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:4385:1830948737512320:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129571.227117:0:22480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16154 00000100:00100000:3.0:1746129571.227121:0:22480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094028700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:068dab75-d300-4ead-a742-d14572ad1e50+8:1962:x1830948734124416:12345-192.168.202.4@tcp:1:lfs.0 00010000:00010000:3.0:1746129571.227134:0:22480:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009fab4e00/0x40a459093b069dfe lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129571.227135:0:4385:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009efe8e00/0x40a459093b069d6b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21024 expref: 10 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129571.227144:0:22480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c16b200/0x40a459093b069d80 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21039 expref: 19 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129571.227146:0:4385:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009efe8e00/0x40a459093b069d6b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21024 expref: 10 pid: 8412 timeout: 926 lvb_type: 1 00010000:00010000:3.0:1746129571.227150:0:22480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880136b1ca00/0x40a459093b069dbf lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21063 expref: 30 pid: 7148 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129571.227154:0:4385:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f326a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:4385:1830948737512448:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129571.227155:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129571.227156:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129571.227158:0:22480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fab4e00/0x40a459093b069dfe lrc: 5/0,1 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.227171:0:22480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880136b1ca00/0x40a459093b069dbf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21063 expref: 30 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129571.227174:0:4385:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800915dde00/0x40a459093b069cb5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20f83 expref: 23 pid: 20577 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129571.227179:0:22480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880136b1ca00/0x40a459093b069dbf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21063 expref: 30 pid: 7148 timeout: 926 lvb_type: 0 00010000:00010000:2.0:1746129571.227181:0:4385:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800915dde00/0x40a459093b069cb5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20f83 expref: 23 pid: 20577 timeout: 926 lvb_type: 1 00000100:00100000:2.0:1746129571.227189:0:4385:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f324000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:4385:1830948737512704:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129571.227191:0:22480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094f45f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22480:1830948737512576:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129571.227204:0:4385:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1a12240 going to sleep for 11 seconds 00010000:00010000:3.0:1746129571.227215:0:22480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c16b200/0x40a459093b069d80 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21039 expref: 19 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.227222:0:22480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c16b200/0x40a459093b069d80 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21039 expref: 19 pid: 20577 timeout: 926 lvb_type: 0 00000100:00100000:3.0:1746129571.227228:0:22480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094f46d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22480:1830948737512832:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129571.227241:0:22480:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a6ce8cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746129571.236085:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129571.236187:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129571.236199:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129571.236222:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129571.236459:0:7086:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734124544 00000100:00100000:2.0:1746129571.236466:0:7086:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734124544 00010000:00010000:2.0:1746129571.236495:0:7086:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009efe8200/0x40a459093b069d56 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2100f expref: 11 pid: 11014 timeout: 926 lvb_type: 1 00000100:00100000:2.0:1746129571.236516:0:7086:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734124800 00000100:00100000:2.0:1746129571.236517:0:7086:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734124800 00010000:00010000:2.0:1746129571.236527:0:7086:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009efe9200/0x40a459093b069d64 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2101d expref: 9 pid: 11014 timeout: 926 lvb_type: 1 00000100:00100000:2.0:1746129571.236536:0:7086:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734124672 00000100:00100000:2.0:1746129571.236538:0:7086:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734124672 00010000:00010000:2.0:1746129571.236544:0:7086:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d863400/0x40a459093b069ca7 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20f6e expref: 24 pid: 31503 timeout: 926 lvb_type: 1 00000100:00100000:2.0:1746129571.236555:0:7086:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734124928 00000100:00100000:2.0:1746129571.236557:0:7086:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734124928 00010000:00010000:2.0:1746129571.236563:0:7086:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880136b1d400/0x40a459093b069db1 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21055 expref: 12 pid: 31503 timeout: 926 lvb_type: 1 00000100:00100000:2.0:1746129571.236573:0:7086:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8280 00000100:00100000:2.0:1746129571.236578:0:7086:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6ce0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:068dab75-d300-4ead-a742-d14572ad1e50+12:1961:x1830948734124544:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129571.236588:0:7086:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129571.236606:0:7086:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009efe8200/0x40a459093b069d56 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2100f expref: 12 pid: 11014 timeout: 926 lvb_type: 1 00010000:00010000:2.0:1746129571.236616:0:7086:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009efe8200/0x40a459093b069d56 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2100f expref: 12 pid: 11014 timeout: 926 lvb_type: 1 00010000:00010000:2.0:1746129571.236636:0:7086:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129571.236669:0:7086:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6ce0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:068dab75-d300-4ead-a742-d14572ad1e50+12:1961:x1830948734124544:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 91us (591us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129571.236675:0:7086:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8280 00000100:00100000:2.0:1746129571.236711:0:7086:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8281 00000100:00100000:2.0:1746129571.236716:0:7086:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a77b1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:068dab75-d300-4ead-a742-d14572ad1e50+9:1961:x1830948734124800:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129571.236723:0:7086:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129571.236734:0:7086:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009efe9200/0x40a459093b069d64 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2101d expref: 9 pid: 11014 timeout: 926 lvb_type: 1 00010000:00010000:2.0:1746129571.236742:0:7086:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009efe9200/0x40a459093b069d64 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2101d expref: 9 pid: 11014 timeout: 926 lvb_type: 1 00010000:00010000:2.0:1746129571.236755:0:7086:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129571.236769:0:7086:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a77b1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:068dab75-d300-4ead-a742-d14572ad1e50+9:1961:x1830948734124800:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 52us (582us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129571.236773:0:7086:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8281 00000100:00100000:2.0:1746129571.236781:0:7086:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8282 00000100:00100000:2.0:1746129571.236784:0:7086:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a77b0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ada2ffba-8920-4ecb-8068-68caa9806978+24:1961:x1830948734124672:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129571.236789:0:7086:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129571.236795:0:7086:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d863400/0x40a459093b069ca7 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20f6e expref: 24 pid: 31503 timeout: 926 lvb_type: 1 00010000:00010000:2.0:1746129571.236801:0:7086:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d863400/0x40a459093b069ca7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20f6e expref: 24 pid: 31503 timeout: 926 lvb_type: 1 00010000:00010000:2.0:1746129571.236810:0:7086:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129571.236819:0:7086:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a77b0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ada2ffba-8920-4ecb-8068-68caa9806978+24:1961:x1830948734124672:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 35us (620us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129571.236823:0:7086:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8282 00000100:00100000:2.0:1746129571.236830:0:7086:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8283 00000100:00100000:2.0:1746129571.236834:0:7086:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a77b1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:068dab75-d300-4ead-a742-d14572ad1e50+11:1961:x1830948734124928:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129571.236838:0:7086:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129571.236844:0:7086:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880136b1d400/0x40a459093b069db1 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21055 expref: 11 pid: 31503 timeout: 926 lvb_type: 1 00010000:00010000:2.0:1746129571.236850:0:7086:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880136b1d400/0x40a459093b069db1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21055 expref: 11 pid: 31503 timeout: 926 lvb_type: 1 00010000:00010000:2.0:1746129571.236858:0:7086:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129571.236867:0:7086:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a77b1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:068dab75-d300-4ead-a742-d14572ad1e50+11:1961:x1830948734124928:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 33us (645us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129571.236871:0:7086:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8283 00000100:00100000:2.0:1746129571.236905:0:4385:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009016a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:4385:1830948737512320:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129571.236913:0:4385:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f326a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:4385:1830948737512448:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129571.236919:0:4385:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f324000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:4385:1830948737512704:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129571.236935:0:4385:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012c173c00/0x40a459093b069df7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129571.236953:0:8412:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136b1d400/0x40a459093b069db1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21055 expref: 10 pid: 31503 timeout: 926 lvb_type: 1 00000100:00100000:2.0:1746129571.236964:0:8412:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013575c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8412:1830948737511680:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129571.236971:0:8412:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013575fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8412:1830948737511936:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129571.236976:0:8412:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013575d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8412:1830948737512064:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129571.236987:0:8412:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012c172600/0x40a459093b069de9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129571.237584:0:22480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094f45f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22480:1830948737512576:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129571.237595:0:22480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094f46d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22480:1830948737512832:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129571.237608:0:22480:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009fab4e00/0x40a459093b069dfe lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129571.237629:0:11014:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094f44a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11014:1830948737511040:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129571.237637:0:11014:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009efe8200/0x40a459093b069d56 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2100f expref: 9 pid: 11014 timeout: 926 lvb_type: 1 00000100:00100000:3.0:1746129571.237657:0:11014:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094f46680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11014:1830948737511168:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129571.237666:0:11014:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d863400/0x40a459093b069ca7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20f6e expref: 23 pid: 31503 timeout: 926 lvb_type: 1 00000100:00100000:3.0:1746129571.237678:0:11014:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094f44000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11014:1830948737511296:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129571.237688:0:11014:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009fab5e00/0x40a459093b069ddb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129571.237709:0:20577:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094f47480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20577:1830948737512192:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129571.237717:0:20577:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009fab5600/0x40a459093b069df0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129571.238288:0:31518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009402b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+18:1963:x1830948734123392:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 15669us (16091us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129571.238306:0:31518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7792 00002000:00100000:2.0:1746129571.238326:0:31518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3f5:0x0] (2097152->3145727) req@ffff88009402b100 x1830948734123392/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:312/0 lens 488/440 e 0 to 0 dl 1746129582 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129571.238333:0:31518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009402b100 with x1830948734123392 ext(2097152->3145727) 00010000:00010000:2.0:1746129571.238339:0:31518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012c16b200/0x40a459093b069d80 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21039 expref: 18 pid: 20577 timeout: 926 lvb_type: 0 00010000:00010000:2.0:1746129571.238347:0:31518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012c16b200/0x40a459093b069d80 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21039 expref: 18 pid: 20577 timeout: 926 lvb_type: 0 00000100:00100000:0.0:1746129571.238348:0:4699:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094029880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4699:1830948737511424:192.168.202.4@tcp:104: 00002000:00010000:2.0:1746129571.238353:0:31518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009402b100 00010000:00010000:0.0:1746129571.238356:0:4699:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009efe9200/0x40a459093b069d64 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2101d expref: 8 pid: 11014 timeout: 926 lvb_type: 1 00000100:00100000:0.0:1746129571.238368:0:4699:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009402aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4699:1830948737511552:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129571.238375:0:4699:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094028e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4699:1830948737511808:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129571.238388:0:4699:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012c16a000/0x40a459093b069de2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129571.238439:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129571.238482:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734125184 00000100:00100000:3.0:1746129571.238487:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734125184 00000100:00100000:1.0:1746129571.238493:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00010000:00010000:3.0:1746129571.238504:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a95ece00/0x40a459093b069cfb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20fc9 expref: 18 pid: 7148 timeout: 926 lvb_type: 1 00000100:00100000:1.0:1746129571.238518:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129571.238522:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734125440 00000100:00100000:3.0:1746129571.238524:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734125440 00010000:00010000:3.0:1746129571.238532:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f850800/0x40a459093b069d1e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20fec expref: 13 pid: 7148 timeout: 926 lvb_type: 0 00000100:00100000:1.0:1746129571.238533:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129571.238543:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734125056 00000100:00100000:3.0:1746129571.238545:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734125056 00000100:00100000:1.0:1746129571.238547:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00010000:00010000:3.0:1746129571.238550:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb55400/0x40a459093b069cc3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20f91 expref: 14 pid: 31503 timeout: 926 lvb_type: 1 00000100:00100000:3.0:1746129571.238557:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734125312 00000100:00100000:3.0:1746129571.238559:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734125312 00000100:00100000:1.0:1746129571.238560:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00010000:00010000:3.0:1746129571.238566:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800955d2e00/0x40a459093b069d2c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20ffa expref: 23 pid: 4699 timeout: 926 lvb_type: 0 00000100:00100000:1.0:1746129571.238569:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129571.238575:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734125952 00000100:00100000:3.0:1746129571.238576:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734125952 00000100:00100000:1.0:1746129571.238579:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00010000:00010000:3.0:1746129571.238583:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb54e00/0x40a459093b069cd1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20f9f expref: 15 pid: 31503 timeout: 926 lvb_type: 1 00000100:00100000:3.0:1746129571.238590:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734125696 00000100:00100000:3.0:1746129571.238591:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734125696 00010000:00010000:3.0:1746129571.238597:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800915dc400/0x40a459093b069cf4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20fc2 expref: 31 pid: 7148 timeout: 926 lvb_type: 0 00000100:00100000:1.0:1746129571.238599:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129571.238604:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734125824 00000100:00100000:3.0:1746129571.238605:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734125824 00010000:00010000:3.0:1746129571.238612:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009efe8e00/0x40a459093b069d6b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21024 expref: 9 pid: 8412 timeout: 926 lvb_type: 1 00000100:00100000:3.0:1746129571.238617:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734126080 00000100:00100000:3.0:1746129571.238619:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734126080 00010000:00010000:3.0:1746129571.238624:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800915dde00/0x40a459093b069cb5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20f83 expref: 24 pid: 20577 timeout: 926 lvb_type: 1 00000100:00100000:3.0:1746129571.238632:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8284 00000100:00100000:3.0:1746129571.238637:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a77b3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+18:1963:x1830948734125184:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129571.238644:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746129571.238646:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8285 00000100:00100000:2.0:1746129571.238652:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a77b2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+15:1963:x1830948734125440:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129571.238654:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a95ece00/0x40a459093b069cfb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20fc9 expref: 18 pid: 7148 timeout: 926 lvb_type: 1 00010000:00010000:2.0:1746129571.238659:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129571.238661:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a95ece00/0x40a459093b069cfb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20fc9 expref: 18 pid: 7148 timeout: 926 lvb_type: 1 00010000:00010000:2.0:1746129571.238669:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f850800/0x40a459093b069d1e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20fec expref: 15 pid: 7148 timeout: 926 lvb_type: 0 00010000:00010000:3.0:1746129571.238673:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a95ece00/0x40a459093b069cfb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20fc9 expref: 18 pid: 7148 timeout: 926 lvb_type: 1 00010000:00010000:2.0:1746129571.238677:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f850800/0x40a459093b069d1e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20fec expref: 15 pid: 7148 timeout: 926 lvb_type: 0 00010000:00010000:3.0:1746129571.238681:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746129571.238694:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f850800/0x40a459093b069d1e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20fec expref: 15 pid: 7148 timeout: 926 lvb_type: 0 00000100:00100000:3.0:1746129571.238701:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a77b3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+17:1963:x1830948734125184:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 63us (262us total) trans 0 rc 0/0 00010000:00010000:2.0:1746129571.238702:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129571.238706:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8284 00000100:00100000:3.0:1746129571.238717:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8286 00000100:00100000:2.0:1746129571.238717:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a77b2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+14:1963:x1830948734125440:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 66us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129571.238721:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a77b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+14:1963:x1830948734125056:12345-192.168.202.4@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746129571.238722:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8285 00010000:00010000:3.0:1746129571.238726:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129571.238734:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fb55400/0x40a459093b069cc3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20f91 expref: 13 pid: 31503 timeout: 926 lvb_type: 1 00000100:00100000:2.0:1746129571.238734:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8287 00000100:00100000:2.0:1746129571.238738:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6ce1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ada2ffba-8920-4ecb-8068-68caa9806978+24:1963:x1830948734125312:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129571.238741:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fb55400/0x40a459093b069cc3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20f91 expref: 13 pid: 31503 timeout: 926 lvb_type: 1 00010000:00010000:2.0:1746129571.238743:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129571.238750:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fb55400/0x40a459093b069cc3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20f91 expref: 13 pid: 31503 timeout: 926 lvb_type: 1 00010000:00010000:2.0:1746129571.238750:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800955d2e00/0x40a459093b069d2c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20ffa expref: 24 pid: 4699 timeout: 926 lvb_type: 0 00010000:00010000:3.0:1746129571.238757:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129571.238757:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800955d2e00/0x40a459093b069d2c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20ffa expref: 24 pid: 4699 timeout: 926 lvb_type: 0 00010000:00010000:3.0:1746129571.238758:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129571.238762:0:7085:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fab5e00/0x40a459093b069ddb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129571.238766:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800955d2e00/0x40a459093b069d2c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20ffa expref: 24 pid: 4699 timeout: 926 lvb_type: 0 00010000:00010000:3.0:1746129571.238768:0:7085:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fab5e00/0x40a459093b069ddb lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129571.238773:0:9823:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129571.238774:0:9823:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129571.238777:0:9823:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c172600/0x40a459093b069de9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129571.238782:0:9823:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c172600/0x40a459093b069de9 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129571.238792:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746129571.238800:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129571.238805:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6ce1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ada2ffba-8920-4ecb-8068-68caa9806978+23:1963:x1830948734125312:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 67us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129571.238809:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8287 00000100:00100000:3.0:1746129571.238815:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a77b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+12:1963:x1830948734125056:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 93us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129571.238818:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8288 00000100:00100000:3.0:1746129571.238821:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8286 00000100:00100000:2.0:1746129571.238822:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baedc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+12:1962:x1830948734125952:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129571.238827:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129571.238835:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fb54e00/0x40a459093b069cd1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20f9f expref: 11 pid: 31503 timeout: 926 lvb_type: 1 00010000:00010000:2.0:1746129571.238841:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fb54e00/0x40a459093b069cd1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20f9f expref: 11 pid: 31503 timeout: 926 lvb_type: 1 00000100:00100000:3.0:1746129571.238847:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8289 00010000:00010000:2.0:1746129571.238849:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fb54e00/0x40a459093b069cd1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20f9f expref: 11 pid: 31503 timeout: 926 lvb_type: 1 00000100:00100000:3.0:1746129571.238852:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ada2ffba-8920-4ecb-8068-68caa9806978+31:1961:x1830948734125696:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129571.238855:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746129571.238857:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129571.238864:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800915dc400/0x40a459093b069cf4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20fc2 expref: 31 pid: 7148 timeout: 926 lvb_type: 0 00000100:00100000:2.0:1746129571.238867:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baedc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+10:1962:x1830948734125952:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 45us (306us total) trans 0 rc 0/0 00010000:00010000:3.0:1746129571.238872:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800915dc400/0x40a459093b069cf4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20fc2 expref: 31 pid: 7148 timeout: 926 lvb_type: 0 00000100:00100000:2.0:1746129571.238872:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8288 00010000:00010000:3.0:1746129571.238882:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800915dc400/0x40a459093b069cf4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f20fc2 expref: 31 pid: 7148 timeout: 926 lvb_type: 0 00000100:00100000:2.0:1746129571.238885:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8290 00010000:00010000:3.0:1746129571.238889:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746129571.238889:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baeed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:068dab75-d300-4ead-a742-d14572ad1e50+9:1961:x1830948734125824:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129571.238890:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129571.238892:0:7085:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c16a000/0x40a459093b069de2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129571.238894:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129571.238898:0:7085:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c16a000/0x40a459093b069de2 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129571.238899:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009efe8e00/0x40a459093b069d6b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21024 expref: 9 pid: 8412 timeout: 926 lvb_type: 1 00010000:00010000:2.0:1746129571.238905:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009efe8e00/0x40a459093b069d6b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21024 expref: 9 pid: 8412 timeout: 926 lvb_type: 1 00010000:00010000:3.0:1746129571.238909:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746129571.238914:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009efe8e00/0x40a459093b069d6b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21024 expref: 9 pid: 8412 timeout: 926 lvb_type: 1 00010000:00010000:1.0:1746129571.238917:0:4699:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012c16a000/0x40a459093b069de2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129571.238921:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129571.238924:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ada2ffba-8920-4ecb-8068-68caa9806978+30:1961:x1830948734125696:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 72us (354us total) trans 0 rc 0/0 00010000:00010000:1.0:1746129571.238924:0:4699:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c16a000/0x40a459093b069de2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129571.238930:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8289 00000100:00100000:2.0:1746129571.238932:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baeed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:068dab75-d300-4ead-a742-d14572ad1e50+8:1961:x1830948734125824:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 43us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129571.238937:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8290 00000100:00100000:3.0:1746129571.238940:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8291 00010000:00010000:1.0:1746129571.238940:0:4699:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012c16a000/0x40a459093b069de2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129571.238944:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baef100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ada2ffba-8920-4ecb-8068-68caa9806978+22:1961:x1830948734126080:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129571.238946:0:4699:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012c16a000/0x40a459093b069de2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.238949:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129571.238952:0:4699:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012c16a000/0x40a459093b069de2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.238956:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800915dde00/0x40a459093b069cb5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20f83 expref: 22 pid: 20577 timeout: 926 lvb_type: 1 00010000:00010000:1.0:1746129571.238958:0:4699:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c16a000 already unused, calling callback (ffffffffa086ed70) 00010000:00010000:1.0:1746129571.238961:0:4699:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012c16a000/0x40a459093b069de2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.238963:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800915dde00/0x40a459093b069cb5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20f83 expref: 22 pid: 20577 timeout: 926 lvb_type: 1 00010000:00010000:1.0:1746129571.238968:0:4699:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012c16a000/0x40a459093b069de2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.238972:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800915dde00/0x40a459093b069cb5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20f83 expref: 22 pid: 20577 timeout: 926 lvb_type: 1 00010000:00010000:2.0:1746129571.238972:0:8412:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012c172600/0x40a459093b069de9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129571.238976:0:4699:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012c16a000/0x40a459093b069de2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.238979:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129571.238981:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129571.238982:0:4699:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c16a000/0x40a459093b069de2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.238983:0:7085:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c173c00/0x40a459093b069df7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.238989:0:7085:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c173c00/0x40a459093b069df7 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129571.238993:0:8412:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c172600/0x40a459093b069de9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.239001:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746129571.239005:0:8412:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012c172600/0x40a459093b069de9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129571.239011:0:8412:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012c172600/0x40a459093b069de9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129571.239014:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baef100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ada2ffba-8920-4ecb-8068-68caa9806978+21:1961:x1830948734126080:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 69us (414us total) trans 0 rc 0/0 00010000:00010000:2.0:1746129571.239017:0:8412:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012c172600/0x40a459093b069de9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129571.239017:0:4699:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094028a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:068dab75-d300-4ead-a742-d14572ad1e50+7:1962:x1830948734124032:12345-192.168.202.4@tcp:1:lfs.0 Request processed in 12268us (12361us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129571.239018:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8291 00010000:00010000:2.0:1746129571.239022:0:8412:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c172600 already unused, calling callback (ffffffffa086ed70) 00000100:00100000:1.0:1746129571.239024:0:4699:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16150 00010000:00010000:2.0:1746129571.239025:0:8412:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012c172600/0x40a459093b069de9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129571.239031:0:8412:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012c172600/0x40a459093b069de9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129571.239039:0:8412:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012c172600/0x40a459093b069de9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129571.239044:0:8412:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c172600/0x40a459093b069de9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129571.239071:0:8412:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009402bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:068dab75-d300-4ead-a742-d14572ad1e50+7:1962:x1830948734124288:12345-192.168.202.4@tcp:1:lfs.0 Request processed in 12262us (12381us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129571.239076:0:8412:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16151 00010000:00010000:0.0:1746129571.239078:0:11014:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009fab5e00/0x40a459093b069ddb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129571.239084:0:11014:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fab5e00/0x40a459093b069ddb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129571.239090:0:4385:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012c173c00/0x40a459093b069df7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129571.239095:0:4385:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c173c00/0x40a459093b069df7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129571.239096:0:11014:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009fab5e00/0x40a459093b069ddb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129571.239101:0:11014:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009fab5e00/0x40a459093b069ddb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129571.239105:0:4385:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012c173c00/0x40a459093b069df7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129571.239106:0:11014:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009fab5e00/0x40a459093b069ddb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129571.239109:0:4385:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012c173c00/0x40a459093b069df7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129571.239110:0:11014:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fab5e00 already unused, calling callback (ffffffffa086ed70) 00010000:00010000:0.0:1746129571.239112:0:11014:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009fab5e00/0x40a459093b069ddb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129571.239114:0:4385:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012c173c00/0x40a459093b069df7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129571.239117:0:11014:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009fab5e00/0x40a459093b069ddb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129571.239118:0:4385:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c173c00 already unused, calling callback (ffffffffa086ed70) 00010000:00010000:0.0:1746129571.239125:0:11014:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009fab5e00/0x40a459093b069ddb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129571.239130:0:11014:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fab5e00/0x40a459093b069ddb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129571.239137:0:4385:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012c173c00/0x40a459093b069df7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129571.239142:0:4385:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012c173c00/0x40a459093b069df7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129571.239149:0:4385:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012c173c00/0x40a459093b069df7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129571.239155:0:4385:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c173c00/0x40a459093b069df7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129571.239161:0:11014:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094029500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:068dab75-d300-4ead-a742-d14572ad1e50+6:1962:x1830948734123776:12345-192.168.202.4@tcp:1:lfs.0 Request processed in 13007us (14691us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129571.239166:0:11014:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16149 00000100:00100000:2.0:1746129571.239180:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013575ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:068dab75-d300-4ead-a742-d14572ad1e50+5:1962:x1830948734124160:12345-192.168.202.4@tcp:1:lfs.0 Request processed in 12139us (12173us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129571.239185:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16153 00000100:00100000:2.0:1746129571.239199:0:31518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734125568 00000100:00100000:2.0:1746129571.239201:0:31518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734125568 00002000:00100000:2.0:1746129571.239215:0:31518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3f3:0x0] (1527808->1982463) req@ffff8800a77b3480 x1830948734125568/t0(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:312/0 lens 488/0 e 0 to 0 dl 1746129582 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129571.239222:0:31518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a77b3480 with x1830948734125568 ext(1527808->1982463) 00010000:00010000:2.0:1746129571.239226:0:31518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800955d3a00/0x40a459093b069d4f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1527808->1982463) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21008 expref: 17 pid: 4699 timeout: 926 lvb_type: 0 00010000:00010000:2.0:1746129571.239233:0:31518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800955d3a00/0x40a459093b069d4f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1527808->1982463) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21008 expref: 17 pid: 4699 timeout: 926 lvb_type: 0 00002000:00010000:2.0:1746129571.239237:0:31518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a77b3480 00000100:00100000:2.0:1746129571.239256:0:31518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2424 00000100:00100000:2.0:1746129571.239260:0:31518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a77b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+17:1963:x1830948734125568:12345-192.168.202.4@tcp:4:multiop.0 00000100:00100000:1.0:1746129571.240930:0:8417:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094028380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ada2ffba-8920-4ecb-8068-68caa9806978+28:1962:x1830948734123648:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 16940us (17061us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129571.240938:0:8417:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7793 00002000:00100000:1.0:1746129571.240946:0:8417:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3f5:0x0] (3145728->4194303) req@ffff880094028380 x1830948734123648/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:312/0 lens 488/440 e 0 to 0 dl 1746129582 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129571.240953:0:8417:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094028380 with x1830948734123648 ext(3145728->4194303) 00010000:00010000:1.0:1746129571.240960:0:8417:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880136b1ca00/0x40a459093b069dbf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21063 expref: 28 pid: 7148 timeout: 926 lvb_type: 0 00010000:00010000:1.0:1746129571.240968:0:8417:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880136b1ca00/0x40a459093b069dbf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21063 expref: 28 pid: 7148 timeout: 926 lvb_type: 0 00002000:00010000:1.0:1746129571.240973:0:8417:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094028380 00000100:00100000:2.0:1746129571.246018:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129571.247415:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129571.247429:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129571.247446:0:8412:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734126208 00000100:00100000:2.0:1746129571.247453:0:8412:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734126208 00000100:00100000:2.0:1746129571.247484:0:8412:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16155 00000100:00100000:2.0:1746129571.247491:0:8412:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f324000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ada2ffba-8920-4ecb-8068-68caa9806978+21:1960:x1830948734126208:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129571.247506:0:8412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129571.247522:0:8412:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090079800/0x40a459093b069e05 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21071 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746129571.247542:0:8412:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3ec:0x0] initial LVB size: 1048576, mtime: 0x6813d2a2, atime: 0x6813d2a0, ctime: 0x6813d2a2, blocks: 0x819 00010000:00010000:2.0:1746129571.247557:0:8412:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129571.247559:0:8412:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129571.247567:0:8412:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090079800/0x40a459093b069e05 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21071 expref: 22 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129571.247579:0:8412:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090079800/0x40a459093b069e05 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21071 expref: 22 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129571.247587:0:8412:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090079800, rc 0) 00000100:00100000:2.0:1746129571.247622:0:8412:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f324000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ada2ffba-8920-4ecb-8068-68caa9806978+22:1960:x1830948734126208:12345-192.168.202.4@tcp:101:cat.0 Request processed in 132us (1613us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129571.247628:0:8412:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16155 00000100:00100000:2.0:1746129571.247641:0:8412:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734126464 00000100:00100000:2.0:1746129571.247644:0:8412:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734126464 00000100:00100000:2.0:1746129571.247655:0:8412:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734126592 00000100:00100000:2.0:1746129571.247656:0:8412:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734126592 00000100:00100000:2.0:1746129571.247666:0:8412:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16156 00000100:00100000:2.0:1746129571.247670:0:8412:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f326a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ada2ffba-8920-4ecb-8068-68caa9806978+29:1961:x1830948734126464:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129571.247677:0:8412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129571.247685:0:8412:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090078800/0x40a459093b069e0c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21078 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129571.247718:0:8412:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013575d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8412:1830948737512960:192.168.202.4@tcp:106: 00000100:00100000:2.0:1746129571.247757:0:8412:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1a12b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746129571.247771:0:31503:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16157 00000100:00100000:2.0:1746129571.247775:0:31503:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f325f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ada2ffba-8920-4ecb-8068-68caa9806978+30:1960:x1830948734126592:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129571.247781:0:31503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129571.247788:0:31503:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c172e00/0x40a459093b069e13 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2107f expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746129571.247800:0:31503:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3f4:0x0] initial LVB size: 2097152, mtime: 0x6813d2a3, atime: 0x6813d2a2, ctime: 0x6813d2a3, blocks: 0x821 00010000:00010000:2.0:1746129571.247807:0:31503:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129571.247808:0:31503:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129571.247812:0:31503:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c172e00/0x40a459093b069e13 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2107f expref: 31 pid: 31503 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129571.247821:0:31503:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c172e00/0x40a459093b069e13 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2107f expref: 31 pid: 31503 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129571.247827:0:31503:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c172e00, rc 0) 00000100:00100000:2.0:1746129571.247841:0:31503:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f325f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ada2ffba-8920-4ecb-8068-68caa9806978+31:1960:x1830948734126592:12345-192.168.202.4@tcp:101:cat.0 Request processed in 66us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129571.247846:0:31503:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16157 00000100:00100000:2.0:1746129571.247870:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129571.247881:0:31503:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734126720 00000100:00100000:2.0:1746129571.247883:0:31503:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734126720 00000100:00100000:2.0:1746129571.247894:0:31503:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16158 00000100:00100000:2.0:1746129571.247899:0:31503:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013575fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ada2ffba-8920-4ecb-8068-68caa9806978+22:1961:x1830948734126720:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129571.247904:0:31503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129571.247911:0:31503:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c173a00/0x40a459093b069e1a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21086 expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746129571.247921:0:31503:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3ee:0x0] initial LVB size: 2097152, mtime: 0x6813d2a3, atime: 0x6813d2a2, ctime: 0x6813d2a2, blocks: 0x81d 00010000:00010000:2.0:1746129571.247928:0:31503:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129571.247929:0:31503:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129571.247933:0:31503:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c173a00/0x40a459093b069e1a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21086 expref: 23 pid: 31503 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129571.247942:0:31503:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c173a00/0x40a459093b069e1a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21086 expref: 23 pid: 31503 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129571.247948:0:31503:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c173a00, rc 0) 00000100:00100000:2.0:1746129571.247961:0:31503:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013575fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ada2ffba-8920-4ecb-8068-68caa9806978+23:1961:x1830948734126720:12345-192.168.202.4@tcp:101:cat.0 Request processed in 62us (91us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129571.247966:0:31503:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16158 00000100:00100000:2.0:1746129571.248006:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129571.248014:0:31503:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734126848 00000100:00100000:2.0:1746129571.248017:0:31503:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734126848 00000100:00100000:2.0:1746129571.248030:0:31503:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16159 00000100:00100000:2.0:1746129571.248034:0:31503:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013575c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ada2ffba-8920-4ecb-8068-68caa9806978+23:1960:x1830948734126848:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129571.248040:0:31503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129571.248046:0:31503:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c172200/0x40a459093b069e21 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2108d expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746129571.248059:0:31503:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3ef:0x0] initial LVB size: 5146336, mtime: 0x6813d2a3, atime: 0x6813d2a3, ctime: 0x6813d2a3, blocks: 0x1791 00010000:00010000:2.0:1746129571.248066:0:31503:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129571.248068:0:31503:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129571.248071:0:31503:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c172200/0x40a459093b069e21 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2108d expref: 24 pid: 31503 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129571.248079:0:31503:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c172200/0x40a459093b069e21 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2108d expref: 24 pid: 31503 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129571.248085:0:31503:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c172200, rc 0) 00000100:00100000:2.0:1746129571.248100:0:31503:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013575c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ada2ffba-8920-4ecb-8068-68caa9806978+24:1960:x1830948734126848:12345-192.168.202.4@tcp:101:cat.0 Request processed in 65us (93us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129571.248372:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129571.248386:0:22481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734126976 00000100:00100000:0.0:1746129571.248389:0:22481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734126976 00000100:00100000:0.0:1746129571.248406:0:22481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16160 00000100:00100000:0.0:1746129571.248410:0:22481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094028e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ada2ffba-8920-4ecb-8068-68caa9806978+31:1961:x1830948734126976:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129571.248417:0:22481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129571.248423:0:22481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f9c5a00/0x40a459093b069e28 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21094 expref: -99 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129571.248506:0:22481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129571.248514:0:22481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f9c5a00/0x40a459093b069e28 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21094 expref: 32 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129571.248521:0:22481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f9c5a00/0x40a459093b069e28 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21094 expref: 32 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129571.248530:0:22481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f9c5a00, rc 0) 00000100:00100000:0.0:1746129571.248545:0:22481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094028e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ada2ffba-8920-4ecb-8068-68caa9806978+31:1961:x1830948734126976:12345-192.168.202.4@tcp:101:cat.0 Request processed in 135us (174us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129571.248550:0:22481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16160 00000100:00100000:0.0:1746129571.248583:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129571.248649:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129571.248719:0:7086:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734126336 00000100:00100000:3.0:1746129571.248723:0:7086:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734126336 00010000:00010000:3.0:1746129571.248739:0:7086:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c16b200/0x40a459093b069d80 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21039 expref: 19 pid: 20577 timeout: 926 lvb_type: 0 00000100:00100000:3.0:1746129571.248754:0:7086:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734127104 00000100:00100000:3.0:1746129571.248755:0:7086:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734127104 00010000:00010000:3.0:1746129571.248763:0:7086:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880136b1ca00/0x40a459093b069dbf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21063 expref: 31 pid: 7148 timeout: 926 lvb_type: 0 00000100:00100000:3.0:1746129571.248775:0:7086:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8292 00000100:00100000:3.0:1746129571.248779:0:7086:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009402aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+19:1962:x1830948734126336:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129571.248787:0:7086:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129571.248798:0:7086:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c16b200/0x40a459093b069d80 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21039 expref: 19 pid: 20577 timeout: 926 lvb_type: 0 00010000:00010000:3.0:1746129571.248807:0:7086:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c16b200/0x40a459093b069d80 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21039 expref: 19 pid: 20577 timeout: 926 lvb_type: 0 00010000:00010000:3.0:1746129571.248820:0:7086:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c16b200/0x40a459093b069d80 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21039 expref: 19 pid: 20577 timeout: 926 lvb_type: 0 00010000:00010000:3.0:1746129571.248828:0:7086:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129571.248843:0:7086:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009402aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+18:1962:x1830948734126336:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 64us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129571.248848:0:7086:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8292 00000100:00100000:3.0:1746129571.248859:0:7086:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8293 00000100:00100000:3.0:1746129571.248863:0:7086:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094029880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ada2ffba-8920-4ecb-8068-68caa9806978+31:1962:x1830948734127104:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129571.248870:0:7086:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129571.248876:0:7086:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880136b1ca00/0x40a459093b069dbf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21063 expref: 31 pid: 7148 timeout: 926 lvb_type: 0 00010000:00010000:3.0:1746129571.248882:0:7086:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880136b1ca00/0x40a459093b069dbf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21063 expref: 31 pid: 7148 timeout: 926 lvb_type: 0 00010000:00010000:3.0:1746129571.248891:0:7086:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136b1ca00/0x40a459093b069dbf lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21063 expref: 31 pid: 7148 timeout: 926 lvb_type: 0 00010000:00010000:3.0:1746129571.248899:0:7086:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129571.248900:0:7086:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129571.248903:0:7086:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fab4e00/0x40a459093b069dfe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.248909:0:7086:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fab4e00/0x40a459093b069dfe lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.248924:0:7086:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129571.248937:0:7086:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094029880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ada2ffba-8920-4ecb-8068-68caa9806978+30:1962:x1830948734127104:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 74us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129571.248942:0:7086:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8293 00010000:00010000:3.0:1746129571.248961:0:22480:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009fab4e00/0x40a459093b069dfe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.248968:0:22480:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fab4e00/0x40a459093b069dfe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.248987:0:22480:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009fab4e00/0x40a459093b069dfe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.248993:0:22480:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009fab4e00/0x40a459093b069dfe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.248999:0:22480:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009fab4e00/0x40a459093b069dfe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.249004:0:22480:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fab4e00 already unused, calling callback (ffffffffa086ed70) 00010000:00010000:3.0:1746129571.249007:0:22480:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009fab4e00/0x40a459093b069dfe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.249013:0:22480:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009fab4e00/0x40a459093b069dfe lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.249021:0:22480:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009fab4e00/0x40a459093b069dfe lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.249026:0:22480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fab4e00/0x40a459093b069dfe lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129571.249054:0:22480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094028700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:068dab75-d300-4ead-a742-d14572ad1e50+6:1962:x1830948734124416:12345-192.168.202.4@tcp:1:lfs.0 Request processed in 21932us (22021us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129571.249059:0:22480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16154 00000100:00100000:1.0:1746129571.249781:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129571.249838:0:11014:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734127232 00000100:00100000:0.0:1746129571.249843:0:11014:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734127232 00000100:00100000:0.0:1746129571.249862:0:11014:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16161 00000100:00100000:0.0:1746129571.249867:0:11014:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093edce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+10:32303:x1830948734127232:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129571.249876:0:11014:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129571.249884:0:11014:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f9c4c00/0x40a459093b069e2f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2109b expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129571.249898:0:11014:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129571.249899:0:11014:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129571.249904:0:11014:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f9c4c00/0x40a459093b069e2f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2109b expref: 11 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129571.249913:0:11014:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f9c4c00/0x40a459093b069e2f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2109b expref: 11 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129571.249920:0:11014:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f9c4c00, rc 0) 00000100:00100000:0.0:1746129571.249932:0:11014:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093edce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+11:32303:x1830948734127232:12345-192.168.202.4@tcp:101:cat.0 Request processed in 66us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129571.249937:0:11014:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16161 00000100:00100000:2.0:1746129571.250185:0:31503:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16159 00000100:00100000:2.0:1746129571.253518:0:31518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a77b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+18:1963:x1830948734125568:12345-192.168.202.4@tcp:4:multiop.0 Request processed in 14248us (14961us total) trans 17179874094 rc 0/0 00000100:00100000:2.0:1746129571.253528:0:31518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2424 00002000:00100000:2.0:1746129571.253538:0:31518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3f3:0x0] (1527808->1982463) req@ffff8800a77b3480 x1830948734125568/t17179874094(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:312/0 lens 488/448 e 0 to 0 dl 1746129582 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129571.253547:0:31518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a77b3480 with x1830948734125568 ext(1527808->1982463) 00010000:00010000:2.0:1746129571.253555:0:31518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800955d3a00/0x40a459093b069d4f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1527808->1982463) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21008 expref: 18 pid: 4699 timeout: 926 lvb_type: 0 00010000:00010000:2.0:1746129571.253568:0:31518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800955d3a00/0x40a459093b069d4f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1527808->1982463) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21008 expref: 18 pid: 4699 timeout: 926 lvb_type: 0 00002000:00010000:2.0:1746129571.253580:0:31518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a77b3480 00000100:00100000:2.0:1746129571.254538:0:8412:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013575d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8412:1830948737512960:192.168.202.4@tcp:106: 00010000:00010000:2.0:1746129571.254563:0:8412:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090078800/0x40a459093b069e0c lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21078 expref: 29 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129571.254575:0:8412:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090078800/0x40a459093b069e0c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21078 expref: 29 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129571.255242:0:8412:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090078800, rc 0) 00000100:00100000:2.0:1746129571.255797:0:8412:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f326a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ada2ffba-8920-4ecb-8068-68caa9806978+28:1961:x1830948734126464:12345-192.168.202.4@tcp:101:cat.0 Request processed in 8123us (8382us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129571.255804:0:8412:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16156 00000100:00100000:0.0:1746129571.257008:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129571.257095:0:31518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734127488 00000100:00100000:2.0:1746129571.257101:0:31518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734127488 00002000:00100000:2.0:1746129571.257134:0:31518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->4194303) req@ffff88009402b480 x1830948734127488/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:312/0 lens 488/0 e 0 to 0 dl 1746129582 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129571.257143:0:31518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009402b480 with x1830948734127488 ext(3145728->4194303) 00002000:00010000:2.0:1746129571.257148:0:31518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009402b480 00000100:00100000:2.0:1746129571.257172:0:31518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7794 00000100:00100000:2.0:1746129571.257177:0:31518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009402b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+11:1961:x1830948734127488:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:0.0:1746129571.263601:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129571.263768:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129571.263885:0:8417:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734127744 00000100:00100000:2.0:1746129571.263892:0:8417:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734127744 00002000:00100000:2.0:1746129571.263928:0:8417:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3ef:0x0] (4194304->5148671) req@ffff880094028000 x1830948734127744/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:312/0 lens 488/0 e 0 to 0 dl 1746129582 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129571.263943:0:8417:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094028000 with x1830948734127744 ext(4194304->5148671) 00002000:00010000:2.0:1746129571.263948:0:8417:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094028000 00000100:00100000:2.0:1746129571.263966:0:8417:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7795 00000100:00100000:2.0:1746129571.263973:0:8417:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094028000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ada2ffba-8920-4ecb-8068-68caa9806978+24:1960:x1830948734127744:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:3.0:1746129571.264003:0:20578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734127872 00000100:00100000:3.0:1746129571.264007:0:20578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734127872 00010000:00010000:3.0:1746129571.264026:0:20578:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800955d3a00/0x40a459093b069d4f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1527808->1982463) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21008 expref: 18 pid: 4699 timeout: 926 lvb_type: 0 00000100:00100000:3.0:1746129571.264044:0:20578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8294 00000100:00100000:3.0:1746129571.264048:0:20578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6ce0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+18:1963:x1830948734127872:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129571.264055:0:20578:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129571.264069:0:20578:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800955d3a00/0x40a459093b069d4f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1527808->1982463) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21008 expref: 18 pid: 4699 timeout: 926 lvb_type: 0 00010000:00010000:3.0:1746129571.264079:0:20578:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800955d3a00/0x40a459093b069d4f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1527808->1982463) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21008 expref: 18 pid: 4699 timeout: 926 lvb_type: 0 00010000:00010000:3.0:1746129571.264096:0:20578:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800955d3a00/0x40a459093b069d4f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1527808->1982463) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21008 expref: 18 pid: 4699 timeout: 926 lvb_type: 0 00010000:00010000:3.0:1746129571.264117:0:20578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129571.264118:0:20578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129571.264122:0:20578:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fab5600/0x40a459093b069df0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.264129:0:20578:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fab5600/0x40a459093b069df0 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.264146:0:20578:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129571.264177:0:20578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6ce0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+17:1963:x1830948734127872:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 128us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129571.264183:0:20578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8294 00010000:00010000:3.0:1746129571.264216:0:20577:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009fab5600/0x40a459093b069df0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.264223:0:20577:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fab5600/0x40a459093b069df0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.264239:0:20577:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009fab5600/0x40a459093b069df0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.264245:0:20577:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009fab5600/0x40a459093b069df0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.264251:0:20577:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009fab5600/0x40a459093b069df0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.264255:0:20577:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fab5600 already unused, calling callback (ffffffffa086ed70) 00010000:00010000:3.0:1746129571.264258:0:20577:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009fab5600/0x40a459093b069df0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.264264:0:20577:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009fab5600/0x40a459093b069df0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.264272:0:20577:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009fab5600/0x40a459093b069df0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.264277:0:20577:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fab5600/0x40a459093b069df0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129571.264340:0:20577:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094029f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:068dab75-d300-4ead-a742-d14572ad1e50+5:1962:x1830948734123904:12345-192.168.202.4@tcp:1:lfs.0 Request processed in 37339us (37399us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129571.264346:0:20577:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16152 00000100:00100000:3.0:1746129571.265516:0:31518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009402b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+11:1961:x1830948734127488:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 8337us (8509us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129571.265523:0:31518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7794 00002000:00100000:3.0:1746129571.265530:0:31518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->4194303) req@ffff88009402b480 x1830948734127488/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:312/0 lens 488/440 e 0 to 0 dl 1746129582 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129571.265537:0:31518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009402b480 with x1830948734127488 ext(3145728->4194303) 00002000:00010000:3.0:1746129571.265541:0:31518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009402b480 00000100:00100000:0.0:1746129571.274076:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129571.274118:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129571.274181:0:20577:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734128256 00000100:00100000:3.0:1746129571.274191:0:20577:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734128256 00000100:00100000:3.0:1746129571.274237:0:20577:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16162 00000100:00100000:3.0:1746129571.274243:0:20577:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094029880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+17:32303:x1830948734128256:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129571.274257:0:20577:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129571.274271:0:20577:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fab5200/0x40a459093b069e36 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f210a2 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746129571.274290:0:20577:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3f5:0x0] initial LVB size: 4194304, mtime: 0x6813d2a3, atime: 0x6813d2a3, ctime: 0x6813d2a3, blocks: 0x1029 00010000:00010000:3.0:1746129571.274341:0:20577:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129571.274342:0:20577:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129571.274349:0:20577:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fab5200/0x40a459093b069e36 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f210a2 expref: 18 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.274361:0:20577:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fab5200/0x40a459093b069e36 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f210a2 expref: 18 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.274370:0:20577:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fab5200, rc 0) 00000100:00100000:3.0:1746129571.274407:0:20577:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094029880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+18:32303:x1830948734128256:12345-192.168.202.4@tcp:101:cat.0 Request processed in 164us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129571.274412:0:20577:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16162 00000100:00100000:1.0:1746129571.274514:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734128128 00000100:00100000:1.0:1746129571.274518:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734128128 00000100:00100000:1.0:1746129571.274540:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11211 00000100:00100000:1.0:1746129571.274545:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009402aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:068dab75-d300-4ead-a742-d14572ad1e50+24:32306:x1830948734128128:12345-192.168.202.4@tcp:36:lfs.0 00010000:00010000:1.0:1746129571.274574:0:14549:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129571.274591:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091571c00/0x40a459093b069da3 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21047 expref: 24 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129571.274609:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:1.0:1746129571.274613:0:14549:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746129571.274631:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009efb3600/0x40a459093b069e3d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129571.274639:0:14549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1ae00/0x40a459093b069473 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20a27 expref: 312 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129571.274645:0:14549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d863a00/0x40a459093b069481 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20a35 expref: 28 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129571.274650:0:14549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1a600/0x40a459093b06948f lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20a43 expref: 312 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129571.274655:0:14549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a051d600/0x40a459093b069553 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20ac8 expref: 28 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129571.274661:0:14549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6cf6800/0x40a459093b06957d lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20ae4 expref: 312 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129571.274665:0:14549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06b5000/0x40a459093b0696bf lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20b8c expref: 312 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129571.274670:0:14549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94ec00/0x40a459093b06971a lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f20baf expref: 28 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129571.274675:0:14549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009efb3600/0x40a459093b069e3d lrc: 10/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129571.274698:0:14549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94ec00/0x40a459093b06971a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20baf expref: 28 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129571.274707:0:14549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94ec00/0x40a459093b06971a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20baf expref: 28 pid: 14549 timeout: 926 lvb_type: 0 00000100:00100000:1.0:1746129571.274717:0:14549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ede680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830948737513088:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129571.274759:0:14549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06b5000/0x40a459093b0696bf lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20b8c expref: 312 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129571.274766:0:14549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06b5000/0x40a459093b0696bf lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20b8c expref: 312 pid: 2271 timeout: 926 lvb_type: 0 00000100:00100000:1.0:1746129571.274773:0:14549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093eddc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830948737513216:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129571.274792:0:14549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6cf6800/0x40a459093b06957d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20ae4 expref: 312 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129571.274798:0:14549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6cf6800/0x40a459093b06957d lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20ae4 expref: 312 pid: 2271 timeout: 926 lvb_type: 0 00000100:00100000:1.0:1746129571.274804:0:14549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093eded80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830948737513344:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129571.274819:0:14549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a051d600/0x40a459093b069553 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20ac8 expref: 28 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129571.274824:0:14549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a051d600/0x40a459093b069553 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20ac8 expref: 28 pid: 2271 timeout: 926 lvb_type: 0 00000100:00100000:1.0:1746129571.274834:0:14549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093edd500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830948737513472:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129571.274847:0:14549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1a600/0x40a459093b06948f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20a43 expref: 312 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129571.274853:0:14549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1a600/0x40a459093b06948f lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20a43 expref: 312 pid: 14547 timeout: 926 lvb_type: 0 00000100:00100000:1.0:1746129571.274858:0:14549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093edc380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830948737513600:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129571.274872:0:14549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012d863a00/0x40a459093b069481 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20a35 expref: 28 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129571.274877:0:14549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d863a00/0x40a459093b069481 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20a35 expref: 28 pid: 2271 timeout: 926 lvb_type: 0 00000100:00100000:1.0:1746129571.274883:0:14549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093edd880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830948737513728:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129571.274896:0:14549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1ae00/0x40a459093b069473 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20a27 expref: 312 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129571.274901:0:14549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1ae00/0x40a459093b069473 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20a27 expref: 312 pid: 14549 timeout: 926 lvb_type: 0 00000100:00100000:1.0:1746129571.274906:0:14549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093edfb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830948737513856:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129571.274916:0:14549:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934d2840 going to sleep for 11 seconds 00000100:00100000:2.0:1746129571.280232:0:8417:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094028000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ada2ffba-8920-4ecb-8068-68caa9806978+24:1960:x1830948734127744:12345-192.168.202.4@tcp:3:cat.0 Request processed in 16251us (16629us total) trans 0 rc 954368/954368 00000100:00100000:2.0:1746129571.280243:0:8417:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7795 00002000:00100000:2.0:1746129571.280252:0:8417:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3ef:0x0] (4194304->5148671) req@ffff880094028000 x1830948734127744/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:312/0 lens 488/440 e 0 to 0 dl 1746129582 ref 1 fl Complete:/200/0 rc 954368/954368 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129571.280260:0:8417:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094028000 with x1830948734127744 ext(4194304->5148671) 00002000:00010000:2.0:1746129571.280265:0:8417:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094028000 00000100:00100000:0.0:1746129571.281763:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129571.281830:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734128384 00000100:00100000:3.0:1746129571.281836:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734128384 00010000:00010000:3.0:1746129571.281863:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94ec00/0x40a459093b06971a lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20baf expref: 29 pid: 14549 timeout: 926 lvb_type: 0 00000100:00100000:3.0:1746129571.281884:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8295 00000100:00100000:3.0:1746129571.281889:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009402a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+29:1963:x1830948734128384:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129571.281899:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129571.281903:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94ec00/0x40a459093b06971a lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20baf expref: 29 pid: 14549 timeout: 926 lvb_type: 0 00010000:00010000:3.0:1746129571.281912:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94ec00/0x40a459093b06971a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20baf expref: 29 pid: 14549 timeout: 926 lvb_type: 0 00010000:00010000:3.0:1746129571.281930:0:7085:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:3.0:1746129571.281934:0:7085:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009efb3600/0x40a459093b069e3d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129571.281941:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129571.281965:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009402a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+29:1963:x1830948734128384:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 76us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129571.281969:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8295 00000100:00100000:0.0:1746129571.282916:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00010000:00010000:2.0:1746129571.283011:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94ec00/0x40a459093b06971a lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20baf expref: 28 pid: 14549 timeout: 926 lvb_type: 0 00000100:00100000:3.0:1746129571.283325:0:20578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734128512 00000100:00100000:3.0:1746129571.283330:0:20578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734128512 00010000:00010000:3.0:1746129571.283346:0:20578:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6cf6800/0x40a459093b06957d lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20ae4 expref: 313 pid: 2271 timeout: 926 lvb_type: 0 00000100:00100000:3.0:1746129571.283363:0:20578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8296 00000100:00100000:3.0:1746129571.283369:0:20578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013577e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ada2ffba-8920-4ecb-8068-68caa9806978+313:1963:x1830948734128512:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129571.283377:0:20578:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746129571.283378:0:14549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ede680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830948737513088:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129571.283380:0:20578:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6cf6800/0x40a459093b06957d lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20ae4 expref: 313 pid: 2271 timeout: 926 lvb_type: 0 00010000:00010000:3.0:1746129571.283387:0:20578:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6cf6800/0x40a459093b06957d lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20ae4 expref: 313 pid: 2271 timeout: 926 lvb_type: 0 00000100:00100000:2.0:1746129571.283390:0:14549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093eded80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830948737513344:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129571.283400:0:20578:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6cf6800/0x40a459093b06957d lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20ae4 expref: 313 pid: 2271 timeout: 926 lvb_type: 0 00010000:00010000:3.0:1746129571.283408:0:20578:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:3.0:1746129571.283411:0:20578:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009efb3600/0x40a459093b069e3d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129571.283417:0:20578:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129571.283584:0:20578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013577e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ada2ffba-8920-4ecb-8068-68caa9806978+312:1963:x1830948734128512:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 213us (667us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129571.283590:0:20578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8296 00000100:00100000:0.0:1746129571.284493:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129571.284521:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129571.284533:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129571.284545:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129571.284566:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129571.284628:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129571.284681:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734128640 00000100:00100000:2.0:1746129571.284685:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734128640 00010000:00010000:2.0:1746129571.284700:0:7087:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06b5000/0x40a459093b0696bf lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20b8c expref: 312 pid: 2271 timeout: 926 lvb_type: 0 00000100:00100000:2.0:1746129571.284714:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734128896 00000100:00100000:2.0:1746129571.284715:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734128896 00010000:00010000:2.0:1746129571.284727:0:7087:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1a600/0x40a459093b06948f lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20a43 expref: 313 pid: 14547 timeout: 926 lvb_type: 0 00000100:00100000:2.0:1746129571.284735:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734128768 00000100:00100000:2.0:1746129571.284737:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734128768 00010000:00010000:2.0:1746129571.284743:0:7087:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a051d600/0x40a459093b069553 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20ac8 expref: 28 pid: 2271 timeout: 926 lvb_type: 0 00000100:00100000:2.0:1746129571.284749:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734129024 00000100:00100000:2.0:1746129571.284751:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734129024 00010000:00010000:2.0:1746129571.284757:0:7087:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d863a00/0x40a459093b069481 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20a35 expref: 29 pid: 2271 timeout: 926 lvb_type: 0 00000100:00100000:2.0:1746129571.284763:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734129280 00000100:00100000:2.0:1746129571.284765:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734129280 00010000:00010000:2.0:1746129571.284770:0:7087:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1ae00/0x40a459093b069473 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20a27 expref: 314 pid: 14549 timeout: 926 lvb_type: 0 00000100:00100000:2.0:1746129571.284778:0:7087:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8297 00000100:00100000:2.0:1746129571.284783:0:7087:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013577d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ada2ffba-8920-4ecb-8068-68caa9806978+314:1960:x1830948734128640:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129571.284790:0:7087:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129571.284794:0:7087:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06b5000/0x40a459093b0696bf lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20b8c expref: 314 pid: 2271 timeout: 926 lvb_type: 0 00010000:00010000:2.0:1746129571.284801:0:7087:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06b5000/0x40a459093b0696bf lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20b8c expref: 314 pid: 2271 timeout: 926 lvb_type: 0 00010000:00010000:2.0:1746129571.284813:0:7087:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:2.0:1746129571.284816:0:7087:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009efb3600/0x40a459093b069e3d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129571.284825:0:7087:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129571.284844:0:7087:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013577d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ada2ffba-8920-4ecb-8068-68caa9806978+314:1960:x1830948734128640:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 60us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129571.284849:0:7087:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8297 00000100:00100000:2.0:1746129571.284859:0:7087:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8298 00000100:00100000:2.0:1746129571.284863:0:7087:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013577dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ada2ffba-8920-4ecb-8068-68caa9806978+313:1960:x1830948734128896:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129571.284868:0:7087:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129571.284871:0:7087:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1a600/0x40a459093b06948f lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20a43 expref: 313 pid: 14547 timeout: 926 lvb_type: 0 00010000:00010000:2.0:1746129571.284877:0:7087:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1a600/0x40a459093b06948f lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20a43 expref: 313 pid: 14547 timeout: 926 lvb_type: 0 00010000:00010000:2.0:1746129571.284885:0:7087:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:2.0:1746129571.284888:0:7087:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009efb3600/0x40a459093b069e3d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129571.284892:0:7087:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129571.284902:0:7087:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013577dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ada2ffba-8920-4ecb-8068-68caa9806978+313:1960:x1830948734128896:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 38us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129571.284906:0:7087:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8298 00000100:00100000:2.0:1746129571.284914:0:7087:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8299 00000100:00100000:2.0:1746129571.284918:0:7087:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013577fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+29:1960:x1830948734128768:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129571.284922:0:7087:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129571.284925:0:7087:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a051d600/0x40a459093b069553 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20ac8 expref: 29 pid: 2271 timeout: 926 lvb_type: 0 00010000:00010000:2.0:1746129571.284936:0:7087:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a051d600/0x40a459093b069553 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20ac8 expref: 29 pid: 2271 timeout: 926 lvb_type: 0 00010000:00010000:2.0:1746129571.284944:0:7087:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:2.0:1746129571.284946:0:7087:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009efb3600/0x40a459093b069e3d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129571.284951:0:7087:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129571.284961:0:7087:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013577fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+29:1960:x1830948734128768:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 42us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129571.284965:0:7087:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8299 00000100:00100000:2.0:1746129571.284973:0:7087:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8300 00000100:00100000:2.0:1746129571.284976:0:7087:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013577ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+28:1960:x1830948734129024:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129571.284982:0:7087:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129571.284985:0:7087:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012d863a00/0x40a459093b069481 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20a35 expref: 28 pid: 2271 timeout: 926 lvb_type: 0 00010000:00010000:2.0:1746129571.284991:0:7087:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012d863a00/0x40a459093b069481 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20a35 expref: 28 pid: 2271 timeout: 926 lvb_type: 0 00010000:00010000:2.0:1746129571.284999:0:7087:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:2.0:1746129571.285001:0:7087:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009efb3600/0x40a459093b069e3d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129571.285005:0:7087:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129571.285017:0:7087:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013577ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+28:1960:x1830948734129024:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 40us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129571.285025:0:7087:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8300 00000100:00100000:2.0:1746129571.285032:0:7087:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8301 00000100:00100000:2.0:1746129571.285036:0:7087:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6ce0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ada2ffba-8920-4ecb-8068-68caa9806978+312:1961:x1830948734129280:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129571.285041:0:7087:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129571.285044:0:7087:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1ae00/0x40a459093b069473 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20a27 expref: 312 pid: 14549 timeout: 926 lvb_type: 0 00010000:00010000:2.0:1746129571.285050:0:7087:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1ae00/0x40a459093b069473 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20a27 expref: 312 pid: 14549 timeout: 926 lvb_type: 0 00010000:00010000:2.0:1746129571.285058:0:7087:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:2.0:1746129571.285061:0:7087:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009efb3600/0x40a459093b069e3d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129571.285067:0:7087:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009efb3600/0x40a459093b069e3d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50290000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129571.285072:0:7087:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009efb3600/0x40a459093b069e3d lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50290000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129571.285085:0:7087:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129571.285098:0:7087:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6ce0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ada2ffba-8920-4ecb-8068-68caa9806978+312:1961:x1830948734129280:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 61us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129571.285102:0:7087:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8301 00010000:00010000:2.0:1746129571.285144:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06b5000/0x40a459093b0696bf lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20b8c expref: 311 pid: 2271 timeout: 926 lvb_type: 0 00000100:00100000:2.0:1746129571.285154:0:14549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093eddc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830948737513216:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129571.285162:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a051d600/0x40a459093b069553 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20ac8 expref: 27 pid: 2271 timeout: 926 lvb_type: 0 00000100:00100000:2.0:1746129571.285169:0:14549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093edd500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830948737513472:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129571.285175:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1a600/0x40a459093b06948f lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20a43 expref: 310 pid: 14547 timeout: 926 lvb_type: 0 00000100:00100000:2.0:1746129571.285181:0:14549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093edc380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830948737513600:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129571.285187:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d863a00/0x40a459093b069481 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20a35 expref: 26 pid: 2271 timeout: 926 lvb_type: 0 00000100:00100000:2.0:1746129571.285195:0:14549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093edd880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830948737513728:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129571.285202:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1ae00/0x40a459093b069473 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f20a27 expref: 309 pid: 14549 timeout: 926 lvb_type: 0 00000100:00100000:2.0:1746129571.285210:0:14549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093edfb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830948737513856:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129571.285234:0:14549:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009efb3600/0x40a459093b069e3d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129571.285240:0:14549:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009efb3600/0x40a459093b069e3d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129571.285244:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009efb3600/0x40a459093b069e3d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000040:00080000:2.0:1746129571.285836:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3445, 88 off289888 00000004:00080000:2.0:1746129571.285843:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 826602548983ns, next at 776349687452ns, rc = 0 00000040:00080000:2.0:1746129571.285878:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3460, 88 off291120 00000004:00080000:2.0:1746129571.285883:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 826602589576ns, next at 776375382381ns, rc = 0 00000040:00080000:2.0:1746129571.285895:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3461, 88 off291208 00000004:00080000:2.0:1746129571.285898:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 826602604386ns, next at 776375382381ns, rc = 0 00000040:00080000:2.0:1746129571.285905:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3446, 88 off289976 00000004:00080000:2.0:1746129571.285907:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 826602613416ns, next at 776349687452ns, rc = 0 00000040:00080000:2.0:1746129571.285913:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3447, 88 off290064 00000004:00080000:2.0:1746129571.285916:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 826602622426ns, next at 776349687452ns, rc = 0 00000040:00080000:2.0:1746129571.285923:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3462, 88 off291296 00000004:00080000:2.0:1746129571.285925:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 826602631186ns, next at 776375382381ns, rc = 0 00000040:00080000:2.0:1746129571.285931:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3463, 88 off291384 00000004:00080000:2.0:1746129571.285934:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 826602640146ns, next at 776375382381ns, rc = 0 00000040:00080000:2.0:1746129571.285939:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3464, 88 off291472 00000004:00080000:2.0:1746129571.285941:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 826602647238ns, next at 776375382381ns, rc = 0 00000040:00080000:2.0:1746129571.285947:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3448, 88 off290152 00000004:00080000:2.0:1746129571.285949:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 826602654806ns, next at 776349687452ns, rc = 0 00000040:00080000:2.0:1746129571.285954:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3465, 88 off291560 00000004:00080000:2.0:1746129571.285956:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 826602662369ns, next at 776375382381ns, rc = 0 00000040:00080000:2.0:1746129571.285962:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3449, 88 off290240 00000004:00080000:2.0:1746129571.285964:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 826602670186ns, next at 776349687452ns, rc = 0 00000040:00080000:2.0:1746129571.285970:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3466, 88 off291648 00000004:00080000:2.0:1746129571.285972:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 826602678583ns, next at 776375382381ns, rc = 0 00000040:00080000:2.0:1746129571.285978:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3450, 88 off290328 00000004:00080000:2.0:1746129571.285981:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 826602686806ns, next at 776349687452ns, rc = 0 00000040:00080000:2.0:1746129571.285986:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3451, 88 off290416 00000004:00080000:2.0:1746129571.285989:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 826602695116ns, next at 776349687452ns, rc = 0 00000040:00080000:2.0:1746129571.285995:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3452, 88 off290504 00000004:00080000:2.0:1746129571.285997:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 826602703671ns, next at 776349687452ns, rc = 0 00000040:00080000:2.0:1746129571.286004:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3453, 88 off290592 00000004:00080000:2.0:1746129571.286006:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 826602712621ns, next at 776349687452ns, rc = 0 00000040:00080000:2.0:1746129571.286014:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3467, 88 off291736 00000004:00080000:2.0:1746129571.286017:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 826602722893ns, next at 776375382381ns, rc = 0 00000100:00100000:3.0:1746129571.289597:0:8417:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734129408 00000100:00100000:3.0:1746129571.289606:0:8417:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734129408 00002000:00100000:3.0:1746129571.289646:0:8417:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3f5:0x0] (3145728->4194303) req@ffff88013577c000 x1830948734129408/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:312/0 lens 488/0 e 0 to 0 dl 1746129582 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129571.289660:0:8417:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013577c000 with x1830948734129408 ext(3145728->4194303) 00002000:00010000:3.0:1746129571.289664:0:8417:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013577c000 00000100:00100000:1.0:1746129571.289789:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129571.290412:0:8417:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7796 00000100:00100000:3.0:1746129571.290421:0:8417:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013577c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+18:1962:x1830948734129408:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:2.0:1746129571.291071:0:16908:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734129536 00000100:00100000:2.0:1746129571.291075:0:16908:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734129536 00000100:00100000:2.0:1746129571.291430:0:16908:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11212 00000100:00100000:2.0:1746129571.291438:0:16908:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093edfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ada2ffba-8920-4ecb-8068-68caa9806978+309:32297:x1830948734129536:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129571.291452:0:16908:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129571.291467:0:16908:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa3400/0x40a459093b069e44 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f210a9 expref: -99 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129571.291506:0:16908:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009efb3600/0x40a459093b069e3d lrc: 2/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129571.291513:0:16908:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa3400/0x40a459093b069e44 lrc: 4/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f210a9 expref: 310 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129571.291527:0:16908:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88009efb3600/0x40a459093b069e3d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129571.291535:0:16908:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa3400/0x40a459093b069e44 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f210a9 expref: 310 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129571.291544:0:16908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:2.0:1746129571.291547:0:16908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746129571.291550:0:16908:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa3400/0x40a459093b069e44 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f210a9 expref: 310 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129571.291559:0:16908:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009faa3400, rc 0) 00000100:00100000:2.0:1746129571.291582:0:16908:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093edfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ada2ffba-8920-4ecb-8068-68caa9806978+310:32297:x1830948734129536:12345-192.168.202.4@tcp:101:cat.0 Request processed in 145us (1793us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129571.291589:0:16908:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11212 00000100:00100000:3.0:1746129571.309835:0:8417:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013577c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+18:1962:x1830948734129408:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 19408us (25260us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129571.309846:0:8417:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7796 00002000:00100000:3.0:1746129571.309855:0:8417:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3f5:0x0] (3145728->4194303) req@ffff88013577c000 x1830948734129408/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:312/0 lens 488/440 e 0 to 0 dl 1746129582 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129571.309864:0:8417:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013577c000 with x1830948734129408 ext(3145728->4194303) 00002000:00010000:3.0:1746129571.309868:0:8417:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013577c000 00000100:00100000:3.0:1746129571.319367:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129571.319569:0:15096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734129664 00000100:00100000:1.0:1746129571.319580:0:15096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734129664 00000100:00100000:1.0:1746129571.319635:0:15096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11213 00000100:00100000:1.0:1746129571.319644:0:15096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+26:32303:x1830948734129664:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129571.319668:0:15096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129571.319686:0:15096:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba31200/0x40a459093b069e4b lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f210b0 expref: -99 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129571.319745:0:15096:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba31200/0x40a459093b069e4b lrc: 3/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f210b0 expref: 27 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129571.319757:0:15096:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba31200/0x40a459093b069e4b lrc: 3/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f210b0 expref: 27 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129571.319768:0:15096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:1.0:1746129571.319771:0:15096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746129571.319775:0:15096:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa3400/0x40a459093b069e44 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f210a9 expref: 309 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129571.319781:0:15096:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ba31200, rc 0) 00000100:00100000:1.0:1746129571.319836:0:15096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+27:32303:x1830948734129664:12345-192.168.202.4@tcp:101:cat.0 Request processed in 194us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129571.319843:0:15096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11213 00000001:00080000:1.0:1746129571.326080:0:14619:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945301 is committed 00000001:00080000:1.0:1746129571.326108:0:14619:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945287 is committed 00000001:00080000:1.0:1746129571.326121:0:14619:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945249 is committed 00000001:00080000:1.0:1746129571.326131:0:14619:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945304 is committed 00000001:00080000:1.0:1746129571.326138:0:14619:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945297 is committed 00000001:00080000:1.0:1746129571.326174:0:14619:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945305 is committed 00000004:00080000:1.0:1746129571.326180:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2637 committed 00000004:00080000:1.0:1746129571.326201:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2623 committed 00000004:00080000:1.0:1746129571.326208:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2622 committed 00000004:00080000:1.0:1746129571.326210:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2621 committed 00000004:00080000:1.0:1746129571.326211:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2620 committed 00000004:00080000:1.0:1746129571.326213:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2636 committed 00000004:00080000:1.0:1746129571.326214:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2619 committed 00000004:00080000:1.0:1746129571.326216:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2635 committed 00000004:00080000:1.0:1746129571.326217:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2618 committed 00000004:00080000:1.0:1746129571.326219:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2634 committed 00000004:00080000:1.0:1746129571.326220:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2633 committed 00000004:00080000:1.0:1746129571.326221:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2632 committed 00000004:00080000:1.0:1746129571.326223:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2617 committed 00000004:00080000:1.0:1746129571.326224:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2616 committed 00000004:00080000:1.0:1746129571.326226:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2631 committed 00000004:00080000:1.0:1746129571.326229:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2630 committed 00000004:00080000:1.0:1746129571.326231:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2615 committed 00000001:00080000:1.0:1746129571.326235:0:14619:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945303 is committed 00000100:00100000:1.0:1746129571.326381:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013577c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737513984:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129571.326389:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013577d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737514240:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129571.326462:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013577c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1830948737514112:0@lo:2:osp-syn-1-0.0 00000004:00010000:2.0:1746129571.327017:0:14549:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009402aa00 reply state ffff88009009cc00 transno 8589945305 ns: mdt-lustre-MDT0000_UUID lock: ffff88009efb3600/0x40a459093b069e3d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14549 initiator: MDT0 00000100:00100000:2.0:1746129571.327027:0:14549:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1746129571.327112:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129571.327153:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013577f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737514752:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129571.327169:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129571.327179:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013577fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737515264:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129571.327192:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129571.327202:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737515776:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129571.327214:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129571.327231:0:3300:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:0.0:1746129571.327235:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013577f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737514368:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129571.327245:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129571.327254:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013577e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737514880:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129571.327266:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129571.327276:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013577ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737515392:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129571.327288:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129571.327339:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737515904:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129571.327354:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129571.327376:0:31503:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737514240 00000100:00100000:0.0:1746129571.327381:0:31503:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737514240 00000100:00100000:0.0:1746129571.327405:0:31503:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737514752 00000100:00100000:0.0:1746129571.327407:0:31503:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737514752 00000100:00100000:0.0:1746129571.327415:0:31503:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737515264 00000100:00100000:0.0:1746129571.327416:0:31503:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737515264 00000100:00100000:0.0:1746129571.327424:0:31503:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737515776 00000100:00100000:0.0:1746129571.327425:0:31503:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737515776 00000100:00100000:0.0:1746129571.327432:0:31503:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737514368 00000100:00100000:0.0:1746129571.327434:0:31503:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737514368 00000100:00100000:0.0:1746129571.327439:0:31503:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737514880 00000100:00100000:0.0:1746129571.327440:0:31503:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737514880 00000100:00100000:0.0:1746129571.327445:0:31503:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737515392 00000100:00100000:0.0:1746129571.327446:0:31503:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737515392 00000100:00100000:0.0:1746129571.327451:0:31503:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737515904 00000100:00100000:0.0:1746129571.327453:0:31503:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737515904 00000100:00100000:0.0:1746129571.327462:0:31503:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16163 00000100:00100000:0.0:1746129571.327467:0:31503:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3300:x1830948737514240:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746129571.327613:0:31503:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3f5:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746129571.327616:0:31503:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f5:0x0] updating lvb mtime from disk: 1746129571 -> 1746129571 00002000:00010000:0.0:1746129571.327618:0:31503:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f5:0x0] updating lvb atime from disk: 1746129571 -> 1746129571 00002000:00010000:0.0:1746129571.327619:0:31503:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f5:0x0] updating lvb ctime from disk: 1746129571 -> 1746129571 00002000:00010000:0.0:1746129571.327621:0:31503:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f5:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:0.0:1746129571.327642:0:31503:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+9:3300:x1830948737514240:12345-0@lo:2:osp-syn-1-0.0 Request processed in 176us (532us total) trans 17179874095 rc 0/0 00000100:00100000:0.0:1746129571.327648:0:31503:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16163 00000100:00100000:0.0:1746129571.327662:0:31503:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16164 00000100:00100000:0.0:1746129571.327666:0:31503:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3300:x1830948737514752:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129571.327753:0:31503:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+9:3300:x1830948737514752:12345-0@lo:2:osp-syn-1-0.0 Request processed in 86us (582us total) trans 17179874096 rc 0/0 00000100:00100000:0.0:1746129571.327758:0:31503:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16164 00000100:00100000:0.0:1746129571.327766:0:31503:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16165 00000100:00100000:0.0:1746129571.327770:0:31503:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3300:x1830948737515264:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746129571.327852:0:31503:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb size from disk: 5146336 -> 5146336 00002000:00010000:0.0:1746129571.327854:0:31503:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb mtime from disk: 1746129571 -> 1746129571 00002000:00010000:0.0:1746129571.327856:0:31503:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb atime from disk: 1746129571 -> 1746129571 00002000:00010000:0.0:1746129571.327857:0:31503:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb ctime from disk: 1746129571 -> 1746129571 00002000:00010000:0.0:1746129571.327858:0:31503:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb blocks from disk: 6033 -> 6033 00000100:00100000:0.0:1746129571.327875:0:31503:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+9:3300:x1830948737515264:12345-0@lo:2:osp-syn-0-0.0 Request processed in 105us (683us total) trans 21474841338 rc 0/0 00000100:00100000:0.0:1746129571.327880:0:31503:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16165 00000100:00100000:0.0:1746129571.327889:0:31503:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16166 00000100:00100000:0.0:1746129571.327893:0:31503:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3300:x1830948737515776:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746129571.327955:0:31503:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746129571.327957:0:31503:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1746129571.327959:0:31503:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746129571.327960:0:31503:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746129571.327962:0:31503:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1746129571.327977:0:31503:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+9:3300:x1830948737515776:12345-0@lo:2:osp-syn-0-0.0 Request processed in 84us (761us total) trans 21474841339 rc 0/0 00000100:00100000:0.0:1746129571.327981:0:31503:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16166 00000100:00100000:0.0:1746129571.327988:0:31503:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16167 00000100:00100000:0.0:1746129571.327992:0:31503:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3300:x1830948737514368:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746129571.328043:0:31503:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746129571.328045:0:31503:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb mtime from disk: 1746129523 -> 1746129523 00002000:00010000:0.0:1746129571.328047:0:31503:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb atime from disk: 1746129523 -> 1746129523 00002000:00010000:0.0:1746129571.328049:0:31503:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb ctime from disk: 1746129524 -> 1746129524 00002000:00010000:0.0:1746129571.328050:0:31503:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1746129571.328064:0:31503:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+9:3300:x1830948737514368:12345-0@lo:2:osp-syn-1-0.0 Request processed in 71us (817us total) trans 17179874097 rc 0/0 00000100:00100000:0.0:1746129571.328067:0:31503:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16167 00000100:00100000:0.0:1746129571.328074:0:31503:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16168 00000100:00100000:0.0:1746129571.328077:0:31503:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3300:x1830948737514880:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129571.328132:0:31503:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+9:3300:x1830948737514880:12345-0@lo:2:osp-syn-1-0.0 Request processed in 54us (865us total) trans 17179874098 rc 0/0 00000100:00100000:0.0:1746129571.328136:0:31503:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16168 00000100:00100000:0.0:1746129571.328143:0:31503:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16169 00000100:00100000:0.0:1746129571.328146:0:31503:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3300:x1830948737515392:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129571.328200:0:31503:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+9:3300:x1830948737515392:12345-0@lo:2:osp-syn-0-0.0 Request processed in 53us (911us total) trans 21474841340 rc 0/0 00000100:00100000:0.0:1746129571.328204:0:31503:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16169 00000100:00100000:0.0:1746129571.328211:0:31503:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16170 00000100:00100000:0.0:1746129571.328215:0:31503:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3300:x1830948737515904:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129571.328267:0:31503:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+9:3300:x1830948737515904:12345-0@lo:2:osp-syn-0-0.0 Request processed in 51us (911us total) trans 21474841341 rc 0/0 00000100:00100000:0.0:1746129571.328271:0:31503:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16170 00000004:00080000:0.0:1746129571.328337:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013577f480/2, rc 0, transno 17179874097 00000100:00100000:0.0:1746129571.328341:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013577f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737514368:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129571.328348:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013577e680/2, rc 0, transno 17179874098 00000100:00100000:0.0:1746129571.328351:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013577e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737514880:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129571.328356:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013577ce00/2, rc 0, transno 21474841340 00000100:00100000:0.0:1746129571.328362:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013577ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737515392:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129571.328367:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800900f5f80/2, rc 0, transno 21474841341 00000100:00100000:0.0:1746129571.328369:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737515904:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129571.328375:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013577d500/2, rc 0, transno 17179874095 00000100:00100000:0.0:1746129571.328377:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013577d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737514240:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129571.328382:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013577f100/2, rc 0, transno 17179874096 00000100:00100000:0.0:1746129571.328385:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013577f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737514752:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129571.328390:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013577fb80/2, rc 0, transno 21474841338 00000100:00100000:0.0:1746129571.328392:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013577fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737515264:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129571.328396:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800900f5500/2, rc 0, transno 21474841339 00000100:00100000:0.0:1746129571.328399:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737515776:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129571.328433:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129571.328482:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013577ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737514496:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129571.328516:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1746129571.328518:0:14549:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1746129571.328528:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013577d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737515008:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129571.328530:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009402aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:068dab75-d300-4ead-a742-d14572ad1e50+8:32306:x1830948734128128:12345-192.168.202.4@tcp:36:lfs.0 Request processed in 53982us (54460us total) trans 8589945305 rc 0/0 00000100:00100000:2.0:1746129571.328536:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11211 00000100:00100000:1.0:1746129571.328543:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129571.328553:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737515520:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129571.328556:0:8412:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737513984 00000100:00100000:2.0:1746129571.328559:0:8412:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737513984 00000100:00100000:1.0:1746129571.328566:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129571.328575:0:8412:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737514496 00000100:00100000:2.0:1746129571.328576:0:8412:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737514496 00000100:00100000:2.0:1746129571.328583:0:8412:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737515008 00000100:00100000:2.0:1746129571.328584:0:8412:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737515008 00000100:00100000:2.0:1746129571.328590:0:8412:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737515520 00000100:00100000:2.0:1746129571.328591:0:8412:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737515520 00000100:00100000:2.0:1746129571.328598:0:8412:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16171 00000100:00100000:2.0:1746129571.328602:0:8412:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bf79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+10:3302:x1830948737513984:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129571.328607:0:4699:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16172 00000100:00100000:1.0:1746129571.328617:0:4699:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093edd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+10:3302:x1830948737514496:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129571.328693:0:8412:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bf79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+11:3302:x1830948737513984:12345-0@lo:2:osp-syn-1-0.0 Request processed in 90us (263us total) trans 17179874099 rc 0/0 00000100:00100000:2.0:1746129571.328699:0:8412:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16171 00000100:00100000:1.0:1746129571.328782:0:4699:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093edd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+11:3302:x1830948737514496:12345-0@lo:2:osp-syn-1-0.0 Request processed in 168us (264us total) trans 17179874100 rc 0/0 00000100:00100000:1.0:1746129571.328789:0:4699:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16172 00000100:00100000:2.0:1746129571.328797:0:8412:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16173 00000100:00100000:2.0:1746129571.328802:0:8412:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093edc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+10:3302:x1830948737515008:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129571.328807:0:4699:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16174 00000100:00100000:1.0:1746129571.328812:0:4699:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093edd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+10:3302:x1830948737515520:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746129571.328871:0:8412:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3ec:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:2.0:1746129571.328874:0:8412:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ec:0x0] updating lvb mtime from disk: 1746129570 -> 1746129570 00002000:00010000:2.0:1746129571.328875:0:8412:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3ec:0x0] updating lvb atime from disk: 1746129568 -> 1746129568 00002000:00010000:2.0:1746129571.328877:0:8412:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ec:0x0] updating lvb ctime from disk: 1746129570 -> 1746129570 00002000:00010000:2.0:1746129571.328879:0:8412:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3ec:0x0] updating lvb blocks from disk: 2073 -> 2073 00000100:00100000:2.0:1746129571.328899:0:8412:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093edc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+12:3302:x1830948737515008:12345-0@lo:2:osp-syn-0-0.0 Request processed in 96us (355us total) trans 21474841342 rc 0/0 00000100:00100000:2.0:1746129571.328903:0:8412:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16173 00000100:00100000:1.0:1746129571.328913:0:4699:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093edd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+11:3302:x1830948737515520:12345-0@lo:2:osp-syn-0-0.0 Request processed in 100us (345us total) trans 21474841343 rc 0/0 00000100:00100000:1.0:1746129571.328918:0:4699:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16174 00000004:00080000:1.0:1746129571.328953:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013577c380/2, rc 0, transno 17179874099 00000100:00100000:1.0:1746129571.328957:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013577c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737513984:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746129571.328963:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013577ed80/2, rc 0, transno 17179874100 00000100:00100000:1.0:1746129571.328966:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013577ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737514496:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746129571.328973:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013577d880/2, rc 0, transno 21474841342 00000100:00100000:1.0:1746129571.328977:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013577d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737515008:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746129571.328982:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800900f7800/2, rc 0, transno 21474841343 00000100:00100000:1.0:1746129571.328985:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737515520:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129571.329179:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129571.329201:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013577d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1830948737514624:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129571.329218:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129571.329229:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013577dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1830948737515136:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129571.329243:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129571.329253:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1830948737515648:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129571.329264:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129571.329285:0:20577:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737514112 00000100:00100000:3.0:1746129571.329288:0:20577:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737514112 00000100:00100000:3.0:1746129571.329326:0:20577:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737514624 00000100:00100000:3.0:1746129571.329329:0:20577:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737514624 00000100:00100000:3.0:1746129571.329335:0:20577:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737515136 00000100:00100000:3.0:1746129571.329337:0:20577:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737515136 00000100:00100000:3.0:1746129571.329342:0:20577:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737515648 00000100:00100000:3.0:1746129571.329344:0:20577:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737515648 00000100:00100000:3.0:1746129571.329351:0:20577:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16175 00000100:00100000:3.0:1746129571.329355:0:20577:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+12:3303:x1830948737514112:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746129571.329437:0:20577:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746129571.329439:0:20577:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb mtime from disk: 1746129571 -> 1746129571 00002000:00010000:3.0:1746129571.329441:0:20577:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb atime from disk: 1746129570 -> 1746129570 00002000:00010000:3.0:1746129571.329442:0:20577:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb ctime from disk: 1746129571 -> 1746129571 00002000:00010000:3.0:1746129571.329444:0:20577:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:3.0:1746129571.329466:0:20577:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+13:3303:x1830948737514112:12345-0@lo:2:osp-syn-1-0.0 Request processed in 111us (287us total) trans 17179874101 rc 0/0 00000100:00100000:3.0:1746129571.329470:0:20577:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16175 00000100:00100000:3.0:1746129571.329479:0:20577:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16176 00000100:00100000:3.0:1746129571.329482:0:20577:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+12:3303:x1830948737514624:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129571.329555:0:20577:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+13:3303:x1830948737514624:12345-0@lo:2:osp-syn-1-0.0 Request processed in 72us (335us total) trans 17179874102 rc 0/0 00000100:00100000:3.0:1746129571.329560:0:20577:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16176 00000100:00100000:3.0:1746129571.329568:0:20577:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16177 00000100:00100000:3.0:1746129571.329572:0:20577:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+12:3303:x1830948737515136:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746129571.329639:0:20577:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746129571.329641:0:20577:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb mtime from disk: 1746129571 -> 1746129571 00002000:00010000:3.0:1746129571.329643:0:20577:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb atime from disk: 1746129570 -> 1746129570 00002000:00010000:3.0:1746129571.329644:0:20577:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb ctime from disk: 1746129570 -> 1746129570 00002000:00010000:3.0:1746129571.329647:0:20577:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb blocks from disk: 2077 -> 2077 00000100:00100000:3.0:1746129571.329664:0:20577:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+13:3303:x1830948737515136:12345-0@lo:2:osp-syn-0-0.0 Request processed in 91us (420us total) trans 21474841344 rc 0/0 00000100:00100000:3.0:1746129571.329668:0:20577:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16177 00000100:00100000:3.0:1746129571.329676:0:20577:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16178 00000100:00100000:3.0:1746129571.329680:0:20577:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+12:3303:x1830948737515648:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129571.329746:0:20577:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+13:3303:x1830948737515648:12345-0@lo:2:osp-syn-0-0.0 Request processed in 65us (479us total) trans 21474841345 rc 0/0 00000100:00100000:3.0:1746129571.329750:0:20577:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16178 00010000:00010000:3.0:1746129571.329778:0:3287:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009efb3600/0x40a459093b069e3d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129571.329786:0:3287:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009efb3600/0x40a459093b069e3d lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129571.329792:0:3287:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009efb3600/0x40a459093b069e3d lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129571.329797:0:3287:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009efb3600 already unused, calling callback (ffffffffa136e690) 00010000:00010000:3.0:1746129571.329800:0:3287:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009efb3600/0x40a459093b069e3d lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129571.329805:0:3287:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009efb3600/0x40a459093b069e3d lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129571.329817:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:3.0:1746129571.329820:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746129571.329825:0:3287:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa3400/0x40a459093b069e44 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f210a9 expref: 288 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.329834:0:3287:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa3400/0x40a459093b069e44 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f210a9 expref: 288 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.329841:0:3287:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa3400/0x40a459093b069e44 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f210a9 expref: 288 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.329848:0:3287:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba31200/0x40a459093b069e4b lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f210b0 expref: 6 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.329853:0:3287:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba31200/0x40a459093b069e4b lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f210b0 expref: 6 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.329859:0:3287:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba31200/0x40a459093b069e4b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f210b0 expref: 6 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.329880:0:3287:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba31200/0x40a459093b069e4b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f210b0 expref: 6 pid: 15096 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129571.329889:0:3287:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094f45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_001:lustre-MDT0000_UUID:3287:1830948737516032:192.168.202.4@tcp:105: 00010000:00010000:3.0:1746129571.329933:0:3287:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa3400/0x40a459093b069e44 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f210a9 expref: 288 pid: 16908 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129571.329939:0:3287:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094f47800 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_001:lustre-MDT0000_UUID:3287:1830948737516160:192.168.202.4@tcp:105: 00000100:00100000:3.0:1746129571.329954:0:3287:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a6ce8f00 going to sleep for 11 seconds 00000004:00080000:3.0:1746129571.330004:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013577c700/2, rc 0, transno 17179874101 00000100:00100000:3.0:1746129571.330008:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013577c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1830948737514112:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746129571.330013:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013577d180/2, rc 0, transno 17179874102 00000100:00100000:3.0:1746129571.330015:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013577d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1830948737514624:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746129571.330024:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013577dc00/2, rc 0, transno 21474841344 00000100:00100000:3.0:1746129571.330026:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013577dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1830948737515136:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746129571.330031:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800900f5880/2, rc 0, transno 21474841345 00000100:00100000:3.0:1746129571.330033:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1830948737515648:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129571.330576:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737516288:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129571.330620:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129571.330640:0:8411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737516288 00000100:00100000:0.0:1746129571.330645:0:8411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737516288 00000100:00100000:0.0:1746129571.330666:0:8411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16179 00000100:00100000:0.0:1746129571.330671:0:8411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093eddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+13:3302:x1830948737516288:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129571.331475:0:8411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093eddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+14:3302:x1830948737516288:12345-0@lo:2:osp-syn-0-0.0 Request processed in 803us (855us total) trans 21474841346 rc 0/0 00000100:00100000:0.0:1746129571.331480:0:8411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16179 00000004:00080000:2.0:1746129571.331685:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800900f6680/2, rc 0, transno 21474841346 00000100:00100000:2.0:1746129571.331689:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737516288:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129571.334745:0:3287:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094f45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_001:lustre-MDT0000_UUID:3287:1830948737516032:192.168.202.4@tcp:105: 00000100:00100000:3.0:1746129571.334761:0:3287:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094f47800 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_001:lustre-MDT0000_UUID:3287:1830948737516160:192.168.202.4@tcp:105: 00010000:00010000:3.0:1746129571.334781:0:3287:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009efb3600/0x40a459093b069e3d lrc: 2/0,0 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129571.334789:0:3287:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009efb3600/0x40a459093b069e3d lrc: 0/0,0 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14549 initiator: MDT0 00000100:00100000:0.0:1746129571.335796:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129571.335832:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129571.335866:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129571.335976:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734129792 00000100:00100000:2.0:1746129571.335982:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734129792 00000100:00100000:2.0:1746129571.336012:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734129920 00000100:00100000:2.0:1746129571.336014:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734129920 00000100:00100000:2.0:1746129571.336037:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4754 00000100:00100000:2.0:1746129571.336042:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+7:32303:x1830948734129792:12345-192.168.202.4@tcp:49:cat.0 00000100:00100000:1.0:1746129571.336086:0:16680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4755 00000100:00100000:1.0:1746129571.336103:0:16680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095f17450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ada2ffba-8920-4ecb-8068-68caa9806978+289:32297:x1830948734129920:12345-192.168.202.4@tcp:49:cat.0 00000100:00100000:2.0:1746129571.336131:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+7:32303:x1830948734129792:12345-192.168.202.4@tcp:49:cat.0 Request processed in 88us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129571.336138:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4754 00000100:00100000:2.0:1746129571.336157:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734130048 00000100:00100000:2.0:1746129571.336159:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734130048 00000100:00100000:2.0:1746129571.336176:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11214 00000100:00100000:2.0:1746129571.336180:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:068dab75-d300-4ead-a742-d14572ad1e50+7:32306:x1830948734130048:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:2.0:1746129571.336191:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746129571.336196:0:16680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095f17450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ada2ffba-8920-4ecb-8068-68caa9806978+289:32297:x1830948734129920:12345-192.168.202.4@tcp:49:cat.0 Request processed in 100us (363us total) trans 0 rc 0/0 00010000:00010000:2.0:1746129571.336203:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1d600/0x40a459093b069e52 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f210b7 expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129571.336203:0:16680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4755 00010000:00010000:2.0:1746129571.336236:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1d600/0x40a459093b069e52 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f210b7 expref: 8 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129571.336246:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1d600/0x40a459093b069e52 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f210b7 expref: 8 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129571.336258:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:2.0:1746129571.336260:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746129571.336263:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136b1d600, rc 0) 00000100:00100000:2.0:1746129571.337891:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:068dab75-d300-4ead-a742-d14572ad1e50+8:32306:x1830948734130048:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 1703us (2017us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129571.337899:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11214 00000100:00100000:0.0:1746129571.348476:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129571.348816:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734130304 00000100:00100000:2.0:1746129571.348827:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734130304 00000100:00100000:2.0:1746129571.348896:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11215 00000100:00100000:2.0:1746129571.348905:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:068dab75-d300-4ead-a742-d14572ad1e50+8:32306:x1830948734130304:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:2.0:1746129571.348928:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129571.348951:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1ca00/0x40a459093b069e59 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f210c5 expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129571.349037:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1c400/0x40a459093b069e60 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129571.349051:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1c400/0x40a459093b069e60 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129571.349062:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1c400/0x40a459093b069e60 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00200000:2.0:1746129571.349094:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00000004:00200000:2.0:1746129571.349098:0:14549:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746129571.349111:0:14549:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1c400/0x40a459093b069e60 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129571.349139:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1ca00/0x40a459093b069e59 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f210c5 expref: 10 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129571.349176:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1c400/0x40a459093b069e60 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f210c5 expref: 9 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129571.349183:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:2.0:1746129571.349186:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746129571.349189:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136b1c400, rc 0) 00000100:00100000:2.0:1746129571.349238:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:068dab75-d300-4ead-a742-d14572ad1e50+9:32306:x1830948734130304:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 334us (773us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129571.349244:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11215 00000100:00100000:0.0:1746129571.350700:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129571.350727:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129571.350757:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129571.350782:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129571.350935:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734130432 00000100:00100000:1.0:1746129571.350944:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734130432 00000100:00100000:1.0:1746129571.350981:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734130688 00000100:00100000:1.0:1746129571.350983:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734130688 00000100:00100000:1.0:1746129571.350994:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734130176 00000100:00100000:1.0:1746129571.350996:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734130176 00000100:00100000:1.0:1746129571.351173:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734130560 00000100:00100000:1.0:1746129571.351176:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734130560 00000100:00100000:1.0:1746129571.351193:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16180 00000100:00100000:1.0:1746129571.351200:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+19:1962:x1830948734130432:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129571.351217:0:7149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129571.351235:0:7149:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ba30a00/0x40a459093b069e67 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f210cc expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746129571.351258:0:7149:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3f3:0x0] initial LVB size: 2097152, mtime: 0x6813d2a3, atime: 0x6813d2a3, ctime: 0x6813d2a3, blocks: 0x81f 00010000:00010000:1.0:1746129571.351277:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129571.351279:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129571.351288:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ba30a00/0x40a459093b069e67 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f210cc expref: 20 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129571.351357:0:7149:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012ba30a00/0x40a459093b069e67 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f210cc expref: 20 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129571.351368:0:7149:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ba30a00, rc 0) 00000100:00100000:1.0:1746129571.351410:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:1962:x1830948734130432:12345-192.168.202.4@tcp:101:cat.0 Request processed in 210us (718us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129571.351416:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16180 00000100:00100000:1.0:1746129571.351431:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16181 00000100:00100000:1.0:1746129571.351436:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+12:1962:x1830948734130688:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129571.351444:0:7149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129571.351454:0:7149:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ba31a00/0x40a459093b069e6e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f210da expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129571.351464:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129571.351465:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129571.351469:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ba31a00/0x40a459093b069e6e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f210da expref: 13 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129571.351478:0:7149:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ba31a00/0x40a459093b069e6e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f210da expref: 13 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129571.351485:0:7149:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ba31a00, rc 0) 00000100:00100000:1.0:1746129571.351499:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+13:1962:x1830948734130688:12345-192.168.202.4@tcp:101:cat.0 Request processed in 62us (771us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129571.351504:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16181 00000100:00100000:1.0:1746129571.351513:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16182 00000100:00100000:1.0:1746129571.351517:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+12:1962:x1830948734130176:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129571.351522:0:7149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129571.351529:0:7149:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ba30600/0x40a459093b069e75 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f210be expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129571.351538:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129571.351540:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129571.351543:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ba30600/0x40a459093b069e75 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f210be expref: 13 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129571.351552:0:7149:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ba30600/0x40a459093b069e75 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f210be expref: 13 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129571.351559:0:7149:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ba30600, rc 0) 00000100:00100000:1.0:1746129571.351573:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+13:1962:x1830948734130176:12345-192.168.202.4@tcp:101:cat.0 Request processed in 56us (816us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129571.351577:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16182 00000100:00100000:1.0:1746129571.351586:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16183 00000100:00100000:1.0:1746129571.351590:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+19:1962:x1830948734130560:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129571.351596:0:7149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129571.351602:0:7149:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ba31e00/0x40a459093b069e7c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f210d3 expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129571.351612:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129571.351613:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129571.351617:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ba31e00/0x40a459093b069e7c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f210d3 expref: 20 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129571.351625:0:7149:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012ba31e00/0x40a459093b069e7c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f210d3 expref: 20 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129571.351631:0:7149:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ba31e00, rc 0) 00000100:00100000:1.0:1746129571.351643:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:1962:x1830948734130560:12345-192.168.202.4@tcp:101:cat.0 Request processed in 52us (861us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129571.351648:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16183 00000100:00100000:0.0:1746129571.355763:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129571.356797:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129571.356851:0:8411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734130816 00000100:00100000:3.0:1746129571.356862:0:8411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734130816 00000100:00100000:3.0:1746129571.356904:0:8411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734130944 00000100:00100000:3.0:1746129571.356905:0:8411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734130944 00000100:00100000:3.0:1746129571.356922:0:8411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16184 00000100:00100000:3.0:1746129571.356930:0:8411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:068dab75-d300-4ead-a742-d14572ad1e50+5:1961:x1830948734130816:12345-192.168.202.4@tcp:101:lfs.0 00000100:00100000:0.0:1746129571.356980:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129571.357021:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129571.357038:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129571.357050:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129571.357068:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129571.357085:0:22481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734131072 00000100:00100000:0.0:1746129571.357089:0:22481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734131072 00000100:00100000:0.0:1746129571.357104:0:22481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734131200 00010000:00010000:3.0:1746129571.357105:0:8411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746129571.357106:0:22481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734131200 00000100:00100000:0.0:1746129571.357116:0:22481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734131328 00000100:00100000:0.0:1746129571.357117:0:22481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734131328 00000100:00100000:0.0:1746129571.357125:0:22481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734131456 00000100:00100000:0.0:1746129571.357126:0:22481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734131456 00010000:00010000:3.0:1746129571.357129:0:8411:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f445200/0x40a459093b069e83 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f210e1 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129571.357138:0:22481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16185 00000100:00100000:0.0:1746129571.357143:0:22481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093eded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:068dab75-d300-4ead-a742-d14572ad1e50+7:1960:x1830948734130944:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:0.0:1746129571.357154:0:22481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129571.357155:0:8411:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129571.357157:0:8411:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129571.357168:0:8411:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f445200/0x40a459093b069e83 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f210e1 expref: 8 pid: 8411 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129571.357169:0:22481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a6729600/0x40a459093b069e8a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f210e8 expref: -99 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.357182:0:8411:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f445200/0x40a459093b069e83 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f210e1 expref: 8 pid: 8411 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129571.357187:0:22481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129571.357189:0:22481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129571.357193:0:8411:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f445200, rc 0) 00010000:00010000:0.0:1746129571.357196:0:22481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6729600/0x40a459093b069e8a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f210e8 expref: 8 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129571.357214:0:22481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a6729600/0x40a459093b069e8a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f210e8 expref: 8 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129571.357223:0:22481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6729600, rc 0) 00000100:00100000:3.0:1746129571.357259:0:8411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:068dab75-d300-4ead-a742-d14572ad1e50+8:1961:x1830948734130816:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 329us (1508us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129571.357261:0:22481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093eded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:068dab75-d300-4ead-a742-d14572ad1e50+8:1960:x1830948734130944:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 117us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129571.357267:0:8411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16184 00000100:00100000:0.0:1746129571.357899:0:22481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16185 00000100:00100000:2.0:1746129571.357908:0:8412:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16186 00000100:00100000:0.0:1746129571.357916:0:22481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16187 00000100:00100000:0.0:1746129571.357923:0:22481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:068dab75-d300-4ead-a742-d14572ad1e50+7:1960:x1830948734131200:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:0.0:1746129571.357932:0:22481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746129571.357943:0:8411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16188 00010000:00010000:0.0:1746129571.357943:0:22481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a6729c00/0x40a459093b069e91 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f210f6 expref: -99 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129571.357960:0:22481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129571.357962:0:22481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746129571.357966:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16189 00010000:00010000:0.0:1746129571.357967:0:22481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6729c00/0x40a459093b069e91 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f210f6 expref: 8 pid: 22481 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746129571.357973:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013145ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:068dab75-d300-4ead-a742-d14572ad1e50+7:1960:x1830948734131456:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:0.0:1746129571.357977:0:22481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a6729c00/0x40a459093b069e91 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f210f6 expref: 8 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129571.357981:0:7148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129571.357984:0:22481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6729c00, rc 0) 00010000:00010000:1.0:1746129571.357989:0:7148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ba30c00/0x40a459093b069e98 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21104 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129571.358000:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129571.358001:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746129571.358003:0:22481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:068dab75-d300-4ead-a742-d14572ad1e50+8:1960:x1830948734131200:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 81us (964us total) trans 0 rc 0/0 00010000:00010000:1.0:1746129571.358005:0:7148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ba30c00/0x40a459093b069e98 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21104 expref: 8 pid: 7148 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746129571.358008:0:22481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16187 00010000:00010000:1.0:1746129571.358013:0:7148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012ba30c00/0x40a459093b069e98 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21104 expref: 8 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129571.358019:0:7148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ba30c00, rc 0) 00000100:00100000:1.0:1746129571.358035:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013145ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:068dab75-d300-4ead-a742-d14572ad1e50+8:1960:x1830948734131456:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 65us (967us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129571.358040:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16189 00000100:00100000:3.0:1746129571.358066:0:8411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:068dab75-d300-4ead-a742-d14572ad1e50+7:1961:x1830948734131328:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:3.0:1746129571.358072:0:8411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129571.358078:0:8411:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f445000/0x40a459093b069e9f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f210fd expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.358087:0:8411:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129571.358088:0:8411:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129571.358092:0:8411:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f445000/0x40a459093b069e9f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f210fd expref: 8 pid: 8411 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129571.358099:0:8411:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f445000/0x40a459093b069e9f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f210fd expref: 8 pid: 8411 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129571.358105:0:8411:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f445000, rc 0) 00000100:00100000:3.0:1746129571.358117:0:8411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:068dab75-d300-4ead-a742-d14572ad1e50+8:1961:x1830948734131328:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 54us (1067us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129571.358122:0:8411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16188 00000100:00100000:1.0:1746129571.358757:0:15096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734131968 00000100:00100000:1.0:1746129571.358764:0:15096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734131968 00000100:00100000:1.0:1746129571.358800:0:15096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11216 00000100:00100000:1.0:1746129571.358805:0:15096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+7:32310:x1830948734131968:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:1.0:1746129571.358815:0:15096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129571.358828:0:15096:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06b5000/0x40a459093b069ea6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21119 expref: -99 pid: 15096 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129571.359048:0:8412:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:068dab75-d300-4ead-a742-d14572ad1e50+7:1961:x1830948734131072:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:2.0:1746129571.359197:0:8412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129571.359208:0:8412:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136b1c600/0x40a459093b069eb4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f210ef expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129571.359221:0:8412:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129571.359223:0:8412:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129571.359238:0:15096:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091571200/0x40a459093b069ead lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15096 initiator: MDT0 00010000:00010000:1.0:1746129571.359252:0:15096:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091571200/0x40a459093b069ead lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129571.359257:0:8412:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136b1c600/0x40a459093b069eb4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f210ef expref: 8 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129571.359262:0:15096:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091571200/0x40a459093b069ead lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129571.359274:0:8412:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880136b1c600/0x40a459093b069eb4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f210ef expref: 8 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129571.359274:0:15096:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091570000/0x40a459093b069ebb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15096 initiator: MDT0 00010000:00010000:1.0:1746129571.359279:0:15096:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091570000/0x40a459093b069ebb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129571.359282:0:8412:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136b1c600, rc 0) 00010000:00010000:1.0:1746129571.359284:0:15096:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091570000/0x40a459093b069ebb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15096 initiator: MDT0 00000100:00100000:2.0:1746129571.359347:0:8412:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:068dab75-d300-4ead-a742-d14572ad1e50+8:1961:x1830948734131072:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 304us (2367us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129571.359354:0:8412:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16186 00000100:00100000:0.0:1746129571.360651:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129571.360769:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129571.360843:0:8412:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734131712 00000100:00100000:2.0:1746129571.360850:0:8412:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734131712 00000100:00100000:2.0:1746129571.360880:0:8412:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734131584 00000100:00100000:2.0:1746129571.360881:0:8412:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734131584 00000100:00100000:2.0:1746129571.360894:0:8412:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16190 00000100:00100000:2.0:1746129571.360901:0:8412:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013145f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ada2ffba-8920-4ecb-8068-68caa9806978+29:1960:x1830948734131712:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129571.360913:0:8412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129571.360926:0:8412:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136b1d000/0x40a459093b069ec2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21112 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129571.360945:0:8412:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129571.360946:0:8412:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129571.360953:0:8412:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136b1d000/0x40a459093b069ec2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21112 expref: 30 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129571.360964:0:8412:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880136b1d000/0x40a459093b069ec2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21112 expref: 30 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129571.360972:0:8412:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136b1d000, rc 0) 00000100:00100000:2.0:1746129571.361001:0:8412:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013145f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ada2ffba-8920-4ecb-8068-68caa9806978+30:1960:x1830948734131712:12345-192.168.202.4@tcp:101:cat.0 Request processed in 102us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129571.361007:0:8412:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16190 00000100:00100000:2.0:1746129571.361020:0:8412:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16191 00000100:00100000:2.0:1746129571.361025:0:8412:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013145d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ada2ffba-8920-4ecb-8068-68caa9806978+29:1960:x1830948734131584:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129571.361031:0:8412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129571.361037:0:8412:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136b1d800/0x40a459093b069ec9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2110b expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129571.361046:0:8412:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129571.361047:0:8412:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129571.361051:0:8412:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136b1d800/0x40a459093b069ec9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2110b expref: 30 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129571.361059:0:8412:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880136b1d800/0x40a459093b069ec9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2110b expref: 30 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129571.361065:0:8412:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136b1d800, rc 0) 00000100:00100000:2.0:1746129571.361079:0:8412:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013145d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ada2ffba-8920-4ecb-8068-68caa9806978+30:1960:x1830948734131584:12345-192.168.202.4@tcp:101:cat.0 Request processed in 53us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129571.361083:0:8412:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16191 00010000:00010000:1.0:1746129571.361352:0:15096:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091571c00/0x40a459093b069ed0 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15096 initiator: MDT0 00010000:00010000:1.0:1746129571.361366:0:15096:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1ce00/0x40a459093b069dcd lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2106a expref: 8 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129571.361373:0:15096:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091571c00/0x40a459093b069ed0 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15096 initiator: MDT0 00010000:00010000:1.0:1746129571.361403:0:15096:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1ce00/0x40a459093b069dcd lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2106a expref: 8 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129571.361415:0:15096:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1ce00/0x40a459093b069dcd lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2106a expref: 8 pid: 14549 timeout: 926 lvb_type: 0 00000100:00100000:1.0:1746129571.361428:0:15096:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ede680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15096:1830948737516416:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129571.361486:0:15096:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934d2c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746129571.364773:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129571.364889:0:8417:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734132224 00000100:00100000:3.0:1746129571.364900:0:8417:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734132224 00002000:00100000:3.0:1746129571.364951:0:8417:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3ef:0x0] (4194304->5148671) req@ffff88013145ed80 x1830948734132224/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:312/0 lens 488/0 e 0 to 0 dl 1746129582 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129571.364962:0:8417:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013145ed80 with x1830948734132224 ext(4194304->5148671) 00002000:00010000:3.0:1746129571.364968:0:8417:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013145ed80 00000100:00100000:3.0:1746129571.365003:0:8417:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7797 00000100:00100000:3.0:1746129571.365010:0:8417:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013145ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+13:1961:x1830948734132224:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129571.367652:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129571.367750:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129571.367781:0:31518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734132608 00000100:00100000:0.0:1746129571.367789:0:31518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734132608 00000100:00100000:1.0:1746129571.367833:0:15096:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ede680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15096:1830948737516416:192.168.202.4@tcp:104: 00002000:00100000:0.0:1746129571.367834:0:31518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3ef:0x0] (5144576->5148671) req@ffff88013145dc00 x1830948734132608/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:312/0 lens 488/0 e 0 to 0 dl 1746129582 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129571.367844:0:31518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013145dc00 with x1830948734132608 ext(5144576->5148671) 00002000:00010000:0.0:1746129571.367849:0:31518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013145dc00 00010000:00010000:1.0:1746129571.367860:0:15096:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880091571c00/0x40a459093b069ed0 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15096 initiator: MDT0 00000100:00100000:0.0:1746129571.367871:0:31518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7798 00000100:00100000:0.0:1746129571.367878:0:31518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013145dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ada2ffba-8920-4ecb-8068-68caa9806978+24:1962:x1830948734132608:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:2.0:1746129571.367882:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734132480 00000100:00100000:2.0:1746129571.367887:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734132480 00010000:00010000:2.0:1746129571.367909:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1ce00/0x40a459093b069dcd lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2106a expref: 9 pid: 14549 timeout: 926 lvb_type: 0 00000100:00100000:2.0:1746129571.367931:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8302 00000100:00100000:2.0:1746129571.367936:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013145fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:068dab75-d300-4ead-a742-d14572ad1e50+9:1962:x1830948734132480:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129571.367946:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129571.367951:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1ce00/0x40a459093b069dcd lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2106a expref: 9 pid: 14549 timeout: 926 lvb_type: 0 00010000:00010000:2.0:1746129571.367959:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1ce00/0x40a459093b069dcd lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2106a expref: 9 pid: 14549 timeout: 926 lvb_type: 0 00010000:00010000:2.0:1746129571.367978:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1ce00/0x40a459093b069dcd lrc: 0/0,0 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2106a expref: 9 pid: 14549 timeout: 926 lvb_type: 0 00010000:00010000:2.0:1746129571.367995:0:7085:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:2.0:1746129571.367999:0:7085:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880091571c00/0x40a459093b069ed0 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129571.368006:0:7085:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880091571c00/0x40a459093b069ed0 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129571.368011:0:7085:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091571c00/0x40a459093b069ed0 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 15096 initiator: MDT0 00000100:00100000:0.0:1746129571.368017:0:31518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013145dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ada2ffba-8920-4ecb-8068-68caa9806978+24:1962:x1830948734132608:12345-192.168.202.4@tcp:3:cat.0 Request processed in 139us (265us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746129571.368023:0:31518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7798 00010000:00010000:2.0:1746129571.368026:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:0.0:1746129571.368027:0:31518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3ef:0x0] (5144576->5148671) req@ffff88013145dc00 x1830948734132608/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:312/0 lens 488/4536 e 0 to 0 dl 1746129582 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129571.368034:0:31518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013145dc00 with x1830948734132608 ext(5144576->5148671) 00002000:00010000:0.0:1746129571.368037:0:31518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013145dc00 00000100:00100000:2.0:1746129571.368043:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013145fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:068dab75-d300-4ead-a742-d14572ad1e50+8:1962:x1830948734132480:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 107us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129571.368046:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8302 00010000:00010000:1.0:1746129571.368113:0:15096:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880091571c00/0x40a459093b069ed0 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15096 initiator: MDT0 00010000:00010000:1.0:1746129571.368120:0:15096:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091571c00/0x40a459093b069ed0 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15096 initiator: MDT0 00000004:00200000:1.0:1746129571.368137:0:15096:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:1.0:1746129571.368324:0:15096:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091571c00/0x40a459093b069ed0 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15096 initiator: MDT0 00010000:00010000:1.0:1746129571.368332:0:15096:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091571c00/0x40a459093b069ed0 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15096 initiator: MDT0 00010000:00010000:1.0:1746129571.368337:0:15096:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091571c00/0x40a459093b069ed0 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15096 initiator: MDT0 00010000:00010000:1.0:1746129571.368342:0:15096:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091571c00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:1.0:1746129571.368346:0:15096:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091571c00/0x40a459093b069ed0 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15096 initiator: MDT0 00010000:00010000:1.0:1746129571.368353:0:15096:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091571c00/0x40a459093b069ed0 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15096 initiator: MDT0 00010000:00010000:1.0:1746129571.368361:0:15096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:1.0:1746129571.368363:0:15096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746129571.368365:0:15096:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091571c00/0x40a459093b069ed0 lrc: 2/0,0 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15096 initiator: MDT0 00010000:00010000:1.0:1746129571.368369:0:15096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091571c00/0x40a459093b069ed0 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15096 initiator: MDT0 00010000:00010000:1.0:1746129571.368400:0:15096:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091571200/0x40a459093b069ead lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15096 initiator: MDT0 00010000:00010000:1.0:1746129571.368408:0:15096:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091571200/0x40a459093b069ead lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15096 initiator: MDT0 00010000:00010000:1.0:1746129571.368412:0:15096:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091571200/0x40a459093b069ead lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15096 initiator: MDT0 00010000:00010000:1.0:1746129571.368416:0:15096:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091571200 already unused, calling callback (ffffffffa136e690) 00010000:00010000:1.0:1746129571.368418:0:15096:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091571200/0x40a459093b069ead lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15096 initiator: MDT0 00010000:00010000:1.0:1746129571.368422:0:15096:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091571200/0x40a459093b069ead lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15096 initiator: MDT0 00010000:00010000:1.0:1746129571.368429:0:15096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880132ef8f00) 00010000:00010000:1.0:1746129571.368431:0:15096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129571.368433:0:15096:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091571200/0x40a459093b069ead lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15096 initiator: MDT0 00010000:00010000:1.0:1746129571.368437:0:15096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091571200/0x40a459093b069ead lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15096 initiator: MDT0 00010000:00010000:1.0:1746129571.368445:0:15096:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091570000/0x40a459093b069ebb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15096 initiator: MDT0 00010000:00010000:1.0:1746129571.368449:0:15096:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091570000/0x40a459093b069ebb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15096 initiator: MDT0 00010000:00010000:1.0:1746129571.368454:0:15096:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091570000/0x40a459093b069ebb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15096 initiator: MDT0 00010000:00010000:1.0:1746129571.368457:0:15096:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091570000 already unused, calling callback (ffffffffa136e690) 00010000:00010000:1.0:1746129571.368459:0:15096:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091570000/0x40a459093b069ebb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15096 initiator: MDT0 00010000:00010000:1.0:1746129571.368468:0:15096:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091570000/0x40a459093b069ebb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15096 initiator: MDT0 00010000:00010000:1.0:1746129571.368473:0:15096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009cffe300) 00010000:00010000:1.0:1746129571.368475:0:15096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129571.368478:0:15096:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091570000/0x40a459093b069ebb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15096 initiator: MDT0 00010000:00010000:1.0:1746129571.368483:0:15096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091570000/0x40a459093b069ebb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15096 initiator: MDT0 00010000:00010000:1.0:1746129571.368530:0:15096:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06b5000/0x40a459093b069ea6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21119 expref: 9 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129571.368538:0:15096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06b5000/0x40a459093b069ea6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21119 expref: 9 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129571.368546:0:15096:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a06b5000, rc 0) 00000100:00100000:1.0:1746129571.368568:0:15096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+8:32310:x1830948734131968:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 9763us (11547us total) trans 8589945306 rc 301/301 00000100:00100000:1.0:1746129571.368575:0:15096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11216 00000100:00100000:0.0:1746129571.382913:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129571.382974:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129571.383191:0:21725:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734132864 00000100:00100000:2.0:1746129571.383199:0:21725:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734132864 00000100:00100000:2.0:1746129571.383249:0:21725:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7799 00000100:00100000:2.0:1746129571.383256:0:21725:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013145c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:068dab75-d300-4ead-a742-d14572ad1e50+8:1960:x1830948734132864:12345-192.168.202.4@tcp:3:lfs.0 00010000:00010000:2.0:1746129571.383339:0:21725:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880136b1ca00/0x40a459093b069ede lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129571.383352:0:21725:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129571.383354:0:21725:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129571.383358:0:21725:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136b1ca00/0x40a459093b069ede lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129571.383369:0:21725:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136b1ca00/0x40a459093b069ede lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21725 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129571.385401:0:20861:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734133120 00000100:00100000:1.0:1746129571.385411:0:20861:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734133120 00000100:00100000:1.0:1746129571.385463:0:20861:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4756 00000100:00100000:1.0:1746129571.385471:0:20861:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013145e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:ada2ffba-8920-4ecb-8068-68caa9806978+289:32297:x1830948734133120:12345-192.168.202.4@tcp:35:cat.0 00000100:00100000:2.0:1746129571.385631:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129571.385636:0:20861:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013145e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:ada2ffba-8920-4ecb-8068-68caa9806978+290:32297:x1830948734133120:12345-192.168.202.4@tcp:35:cat.0 Request processed in 165us (2661us total) trans 8589945307 rc 0/0 00000100:00100000:1.0:1746129571.385643:0:20861:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4756 00000100:00100000:2.0:1746129571.385673:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129571.385707:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129571.385722:0:31520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734133376 00000100:00100000:2.0:1746129571.385725:0:31520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734133376 00000100:00100000:2.0:1746129571.385749:0:31520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734133632 00000100:00100000:2.0:1746129571.385751:0:31520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734133632 00000100:00100000:2.0:1746129571.385769:0:31520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734133888 00000100:00100000:2.0:1746129571.385771:0:31520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734133888 00000100:00100000:2.0:1746129571.385800:0:31520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7800 00000100:00100000:2.0:1746129571.385805:0:31520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013575ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:068dab75-d300-4ead-a742-d14572ad1e50+9:1961:x1830948734133376:12345-192.168.202.4@tcp:3:lfs.0 00010000:00010000:2.0:1746129571.385825:0:31520:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009efb2a00/0x40a459093b069ee5 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129571.385835:0:31520:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129571.385836:0:31520:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129571.385840:0:31520:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009efb2a00/0x40a459093b069ee5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129571.385850:0:31520:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009efb2a00/0x40a459093b069ee5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31520 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129571.385886:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7801 00000100:00100000:3.0:1746129571.385892:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013575fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:068dab75-d300-4ead-a742-d14572ad1e50+9:1961:x1830948734133632:12345-192.168.202.4@tcp:3:lfs.0 00010000:00010000:3.0:1746129571.385905:0:25745:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88008f444200/0x40a459093b069eec lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25745 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.385911:0:25745:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129571.385912:0:25745:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129571.385915:0:25745:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f444200/0x40a459093b069eec lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25745 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.385921:0:25745:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f444200/0x40a459093b069eec lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25745 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129571.385939:0:21463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7802 00000100:00100000:0.0:1746129571.385947:0:21463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013575c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:068dab75-d300-4ead-a742-d14572ad1e50+10:1961:x1830948734133888:12345-192.168.202.4@tcp:3:lfs.0 00010000:00010000:0.0:1746129571.385965:0:21463:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012c173800/0x40a459093b069ef3 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129571.385973:0:21463:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129571.385975:0:21463:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129571.385978:0:21463:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c173800/0x40a459093b069ef3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129571.385987:0:21463:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c173800/0x40a459093b069ef3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21463 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129571.387910:0:8417:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013145ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+13:1961:x1830948734132224:12345-192.168.202.4@tcp:3:cat.0 Request processed in 22894us (23143us total) trans 0 rc 954368/954368 00000100:00100000:3.0:1746129571.387918:0:8417:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7797 00002000:00100000:3.0:1746129571.387926:0:8417:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3ef:0x0] (4194304->5148671) req@ffff88013145ed80 x1830948734132224/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:312/0 lens 488/440 e 0 to 0 dl 1746129582 ref 1 fl Complete:/200/0 rc 954368/954368 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129571.387934:0:8417:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013145ed80 with x1830948734132224 ext(4194304->5148671) 00002000:00010000:3.0:1746129571.387938:0:8417:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013145ed80 00000100:00100000:2.0:1746129571.406464:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129571.406533:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129571.406570:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129571.406615:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129571.406650:0:31521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734134144 00000100:00100000:2.0:1746129571.406660:0:31521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734134144 00000100:00100000:2.0:1746129571.406715:0:31521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734134400 00000100:00100000:2.0:1746129571.406719:0:31521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734134400 00000100:00100000:2.0:1746129571.406743:0:31521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734134656 00000100:00100000:2.0:1746129571.406747:0:31521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734134656 00000100:00100000:2.0:1746129571.406768:0:31521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734134912 00000100:00100000:2.0:1746129571.406771:0:31521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734134912 00000100:00100000:2.0:1746129571.406795:0:31521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7803 00000100:00100000:2.0:1746129571.406804:0:31521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013575d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:068dab75-d300-4ead-a742-d14572ad1e50+13:1961:x1830948734134144:12345-192.168.202.4@tcp:3:lfs.0 00010000:00010000:2.0:1746129571.406841:0:31521:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009c63ec00/0x40a459093b069efa lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129571.406856:0:31521:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129571.406858:0:31521:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129571.406863:0:31521:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c63ec00/0x40a459093b069efa lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129571.406875:0:31521:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c63ec00/0x40a459093b069efa lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31521 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129571.408151:0:31519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7804 00000100:00100000:2.0:1746129571.408158:0:31519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f325880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:068dab75-d300-4ead-a742-d14572ad1e50+13:1961:x1830948734134400:12345-192.168.202.4@tcp:3:lfs.0 00010000:00010000:2.0:1746129571.408179:0:31519:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009c63ee00/0x40a459093b069f01 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129571.408187:0:31519:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129571.408188:0:31519:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129571.408191:0:31519:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c63ee00/0x40a459093b069f01 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129571.408200:0:31519:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c63ee00/0x40a459093b069f01 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31519 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129571.409205:0:31523:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7805 00000100:00100000:2.0:1746129571.409211:0:31523:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f326d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:068dab75-d300-4ead-a742-d14572ad1e50+14:1961:x1830948734134656:12345-192.168.202.4@tcp:3:lfs.0 00010000:00010000:2.0:1746129571.409231:0:31523:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009c63e800/0x40a459093b069f08 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129571.409239:0:31523:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129571.409241:0:31523:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129571.409244:0:31523:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c63e800/0x40a459093b069f08 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129571.409252:0:31523:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c63e800/0x40a459093b069f08 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129571.410010:0:8416:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7806 00000100:00100000:1.0:1746129571.410019:0:8416:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f327800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:068dab75-d300-4ead-a742-d14572ad1e50+14:1961:x1830948734134912:12345-192.168.202.4@tcp:3:lfs.0 00010000:00010000:1.0:1746129571.410033:0:8416:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a6ca1a00/0x40a459093b069f0f lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8416 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129571.410040:0:8416:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129571.410041:0:8416:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129571.410044:0:8416:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6ca1a00/0x40a459093b069f0f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8416 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129571.410051:0:8416:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a6ca1a00/0x40a459093b069f0f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8416 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.415753:0:21725:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880136b1ca00/0x40a459093b069ede lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21725 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.415766:0:21725:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880136b1ca00/0x40a459093b069ede lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21725 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.415773:0:21725:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880136b1ca00/0x40a459093b069ede lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21725 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.415778:0:21725:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880136b1ca00 already unused, calling callback (ffffffffa086ed70) 00010000:00010000:3.0:1746129571.415782:0:21725:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880136b1ca00/0x40a459093b069ede lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21725 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.415789:0:21725:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880136b1ca00/0x40a459093b069ede lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21725 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.415805:0:21725:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880136b1ca00/0x40a459093b069ede lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21725 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.415810:0:21725:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136b1ca00/0x40a459093b069ede lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21725 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129571.415874:0:21725:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013145c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:068dab75-d300-4ead-a742-d14572ad1e50+14:1960:x1830948734132864:12345-192.168.202.4@tcp:3:lfs.0 Request processed in 32614us (32967us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129571.415882:0:21725:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7799 00000100:00100000:1.0:1746129571.417141:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129571.417278:0:14551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734135168 00000100:00100000:3.0:1746129571.417286:0:14551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734135168 00000100:00100000:3.0:1746129571.417353:0:14551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4757 00000100:00100000:3.0:1746129571.417361:0:14551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ede680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+8:32303:x1830948734135168:12345-192.168.202.4@tcp:35:cat.0 00000100:00100000:3.0:1746129571.417543:0:14551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ede680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+9:32303:x1830948734135168:12345-192.168.202.4@tcp:35:cat.0 Request processed in 181us (404us total) trans 8589945308 rc 0/0 00000100:00100000:3.0:1746129571.417550:0:14551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4757 00010000:00010000:3.0:1746129571.417838:0:31520:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009efb2a00/0x40a459093b069ee5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.417848:0:31520:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009efb2a00/0x40a459093b069ee5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.417855:0:31520:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009efb2a00/0x40a459093b069ee5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.417860:0:31520:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009efb2a00 already unused, calling callback (ffffffffa086ed70) 00010000:00010000:3.0:1746129571.417864:0:31520:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009efb2a00/0x40a459093b069ee5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.417871:0:31520:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009efb2a00/0x40a459093b069ee5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.417884:0:31520:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009efb2a00/0x40a459093b069ee5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.417889:0:31520:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009efb2a00/0x40a459093b069ee5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31520 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129571.417931:0:31520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013575ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:068dab75-d300-4ead-a742-d14572ad1e50+14:1961:x1830948734133376:12345-192.168.202.4@tcp:3:lfs.0 Request processed in 32123us (32298us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129571.417941:0:31520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7800 00010000:00010000:2.0:1746129571.424379:0:25745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88008f444200/0x40a459093b069eec lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25745 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129571.424394:0:25745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008f444200/0x40a459093b069eec lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25745 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129571.424405:0:25745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008f444200/0x40a459093b069eec lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25745 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129571.424411:0:25745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f444200 already unused, calling callback (ffffffffa086ed70) 00010000:00010000:2.0:1746129571.424415:0:25745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008f444200/0x40a459093b069eec lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25745 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129571.424421:0:25745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008f444200/0x40a459093b069eec lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25745 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129571.424436:0:25745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008f444200/0x40a459093b069eec lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25745 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129571.424441:0:25745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f444200/0x40a459093b069eec lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25745 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129571.425363:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013575fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:068dab75-d300-4ead-a742-d14572ad1e50+12:1961:x1830948734133632:12345-192.168.202.4@tcp:3:lfs.0 Request processed in 39466us (39685us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129571.425373:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7801 00010000:00010000:1.0:1746129571.427056:0:21463:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012c173800/0x40a459093b069ef3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21463 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129571.427068:0:21463:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012c173800/0x40a459093b069ef3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21463 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129571.427075:0:21463:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012c173800/0x40a459093b069ef3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21463 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129571.427080:0:21463:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c173800 already unused, calling callback (ffffffffa086ed70) 00010000:00010000:1.0:1746129571.427083:0:21463:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012c173800/0x40a459093b069ef3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21463 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129571.427089:0:21463:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012c173800/0x40a459093b069ef3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21463 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129571.427108:0:21463:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012c173800/0x40a459093b069ef3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21463 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129571.427116:0:21463:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c173800/0x40a459093b069ef3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21463 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129571.427173:0:21463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013575c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:068dab75-d300-4ead-a742-d14572ad1e50+12:1961:x1830948734133888:12345-192.168.202.4@tcp:3:lfs.0 Request processed in 41225us (41463us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129571.427181:0:21463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7802 00010000:00010000:2.0:1746129571.439361:0:31521:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009c63ec00/0x40a459093b069efa lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129571.439377:0:31521:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009c63ec00/0x40a459093b069efa lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129571.439385:0:31521:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009c63ec00/0x40a459093b069efa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129571.439391:0:31521:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c63ec00 already unused, calling callback (ffffffffa086ed70) 00010000:00010000:2.0:1746129571.439395:0:31521:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009c63ec00/0x40a459093b069efa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129571.439401:0:31521:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009c63ec00/0x40a459093b069efa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129571.439417:0:31521:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009c63ec00/0x40a459093b069efa lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129571.439422:0:31521:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c63ec00/0x40a459093b069efa lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31521 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129571.439502:0:31521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013575d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:068dab75-d300-4ead-a742-d14572ad1e50+10:1961:x1830948734134144:12345-192.168.202.4@tcp:3:lfs.0 Request processed in 32694us (33042us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129571.439512:0:31521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7803 00000100:00100000:0.0:1746129571.447279:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00010000:00010000:3.0:1746129571.447721:0:31519:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009c63ee00/0x40a459093b069f01 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.447733:0:31519:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009c63ee00/0x40a459093b069f01 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.447740:0:31519:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009c63ee00/0x40a459093b069f01 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.447746:0:31519:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c63ee00 already unused, calling callback (ffffffffa086ed70) 00010000:00010000:3.0:1746129571.447750:0:31519:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009c63ee00/0x40a459093b069f01 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.447757:0:31519:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009c63ee00/0x40a459093b069f01 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.447774:0:31519:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009c63ee00/0x40a459093b069f01 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.447780:0:31519:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c63ee00/0x40a459093b069f01 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31519 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129571.447903:0:15096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734135424 00000100:00100000:1.0:1746129571.447910:0:15096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734135424 00000100:00100000:1.0:1746129571.447949:0:15096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11217 00000100:00100000:1.0:1746129571.447955:0:15096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013145ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ada2ffba-8920-4ecb-8068-68caa9806978+290:32313:x1830948734135424:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:1.0:1746129571.447972:0:15096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129571.447985:0:15096:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095fb0400/0x40a459093b069f16 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21120 expref: -99 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129571.448068:0:15096:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095fb0e00/0x40a459093b069f1d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15096 initiator: MDT0 00010000:00010000:1.0:1746129571.448076:0:15096:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095fb0e00/0x40a459093b069f1d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15096 initiator: MDT0 00010000:00010000:1.0:1746129571.448084:0:15096:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095fb0e00/0x40a459093b069f1d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15096 initiator: MDT0 00010000:00010000:1.0:1746129571.448094:0:15096:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095fb0a00/0x40a459093b069f24 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15096 initiator: MDT0 00010000:00010000:1.0:1746129571.448101:0:15096:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095fb0a00/0x40a459093b069f24 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15096 initiator: MDT0 00010000:00010000:1.0:1746129571.448106:0:15096:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095fb0a00/0x40a459093b069f24 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15096 initiator: MDT0 00010000:00010000:1.0:1746129571.448185:0:15096:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880095fb0c00/0x40a459093b069f2b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15096 initiator: MDT0 00010000:00010000:1.0:1746129571.448191:0:15096:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095fb0c00/0x40a459093b069f2b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15096 initiator: MDT0 00010000:00010000:1.0:1746129571.448196:0:15096:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095fb0c00/0x40a459093b069f2b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15096 initiator: MDT0 00000004:00200000:1.0:1746129571.448202:0:15096:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:1.0:1746129571.448258:0:15096:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880095fb0c00/0x40a459093b069f2b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15096 initiator: MDT0 00010000:00010000:1.0:1746129571.448262:0:15096:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095fb0c00/0x40a459093b069f2b lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15096 initiator: MDT0 00010000:00010000:1.0:1746129571.448265:0:15096:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095fb0c00/0x40a459093b069f2b lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15096 initiator: MDT0 00010000:00010000:1.0:1746129571.448268:0:15096:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095fb0c00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:1.0:1746129571.448271:0:15096:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095fb0c00/0x40a459093b069f2b lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15096 initiator: MDT0 00010000:00010000:1.0:1746129571.448275:0:15096:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095fb0c00/0x40a459093b069f2b lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15096 initiator: MDT0 00010000:00010000:1.0:1746129571.448280:0:15096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:1.0:1746129571.448283:0:15096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746129571.448285:0:15096:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095fb0c00/0x40a459093b069f2b lrc: 2/0,0 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15096 initiator: MDT0 00010000:00010000:1.0:1746129571.448289:0:15096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095fb0c00/0x40a459093b069f2b lrc: 0/0,0 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15096 initiator: MDT0 00010000:00010000:1.0:1746129571.448335:0:15096:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095fb0e00/0x40a459093b069f1d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15096 initiator: MDT0 00010000:00010000:1.0:1746129571.448339:0:15096:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095fb0e00/0x40a459093b069f1d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15096 initiator: MDT0 00010000:00010000:1.0:1746129571.448343:0:15096:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095fb0e00/0x40a459093b069f1d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15096 initiator: MDT0 00010000:00010000:1.0:1746129571.448346:0:15096:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095fb0e00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:1.0:1746129571.448348:0:15096:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095fb0e00/0x40a459093b069f1d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15096 initiator: MDT0 00010000:00010000:1.0:1746129571.448351:0:15096:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095fb0e00/0x40a459093b069f1d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15096 initiator: MDT0 00010000:00010000:1.0:1746129571.448356:0:15096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880132ef8f00) 00010000:00010000:1.0:1746129571.448358:0:15096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129571.448360:0:15096:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095fb0e00/0x40a459093b069f1d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15096 initiator: MDT0 00010000:00010000:1.0:1746129571.448364:0:15096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095fb0e00/0x40a459093b069f1d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15096 initiator: MDT0 00010000:00010000:1.0:1746129571.448369:0:15096:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095fb0a00/0x40a459093b069f24 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15096 initiator: MDT0 00010000:00010000:1.0:1746129571.448373:0:15096:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095fb0a00/0x40a459093b069f24 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15096 initiator: MDT0 00010000:00010000:1.0:1746129571.448377:0:15096:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095fb0a00/0x40a459093b069f24 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15096 initiator: MDT0 00010000:00010000:1.0:1746129571.448380:0:15096:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095fb0a00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:1.0:1746129571.448382:0:15096:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095fb0a00/0x40a459093b069f24 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15096 initiator: MDT0 00010000:00010000:1.0:1746129571.448385:0:15096:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095fb0a00/0x40a459093b069f24 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15096 initiator: MDT0 00010000:00010000:1.0:1746129571.448389:0:15096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009cffe900) 00010000:00010000:1.0:1746129571.448391:0:15096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129571.448392:0:15096:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095fb0a00/0x40a459093b069f24 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15096 initiator: MDT0 00010000:00010000:1.0:1746129571.448396:0:15096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095fb0a00/0x40a459093b069f24 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15096 initiator: MDT0 00010000:00010000:1.0:1746129571.448421:0:15096:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095fb0400/0x40a459093b069f16 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21120 expref: 292 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129571.448427:0:15096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095fb0400/0x40a459093b069f16 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21120 expref: 292 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129571.448433:0:15096:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095fb0400, rc 0) 00000100:00100000:1.0:1746129571.448469:0:15096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013145ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ada2ffba-8920-4ecb-8068-68caa9806978+291:32313:x1830948734135424:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 514us (1198us total) trans 8589945309 rc 301/301 00000100:00100000:1.0:1746129571.448474:0:15096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11217 00000100:00100000:3.0:1746129571.450225:0:31519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f325880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:068dab75-d300-4ead-a742-d14572ad1e50+10:1961:x1830948734134400:12345-192.168.202.4@tcp:3:lfs.0 Request processed in 42066us (43691us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129571.450233:0:31519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7804 00010000:00010000:1.0:1746129571.459815:0:8416:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a6ca1a00/0x40a459093b069f0f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8416 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129571.459832:0:8416:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6ca1a00/0x40a459093b069f0f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8416 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129571.459839:0:8416:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a6ca1a00/0x40a459093b069f0f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8416 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129571.459843:0:8416:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a6ca1a00 already unused, calling callback (ffffffffa086ed70) 00010000:00010000:1.0:1746129571.459846:0:8416:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a6ca1a00/0x40a459093b069f0f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8416 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129571.459851:0:8416:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a6ca1a00/0x40a459093b069f0f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8416 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129571.459864:0:8416:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a6ca1a00/0x40a459093b069f0f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8416 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129571.459869:0:8416:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a6ca1a00/0x40a459093b069f0f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8416 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129571.459940:0:8416:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f327800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:068dab75-d300-4ead-a742-d14572ad1e50+8:1961:x1830948734134912:12345-192.168.202.4@tcp:3:lfs.0 Request processed in 49918us (53322us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129571.459947:0:8416:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7806 00010000:00010000:3.0:1746129571.460360:0:31523:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009c63e800/0x40a459093b069f08 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.460367:0:31523:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009c63e800/0x40a459093b069f08 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.460372:0:31523:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009c63e800/0x40a459093b069f08 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.460376:0:31523:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c63e800 already unused, calling callback (ffffffffa086ed70) 00010000:00010000:3.0:1746129571.460378:0:31523:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009c63e800/0x40a459093b069f08 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.460383:0:31523:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009c63e800/0x40a459093b069f08 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.460391:0:31523:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009c63e800/0x40a459093b069f08 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.460395:0:31523:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c63e800/0x40a459093b069f08 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31523 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129571.460422:0:31523:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f326d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:068dab75-d300-4ead-a742-d14572ad1e50+8:1961:x1830948734134656:12345-192.168.202.4@tcp:3:lfs.0 Request processed in 51212us (53853us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129571.460427:0:31523:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7805 00000100:00100000:0.0:1746129571.464807:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129571.464898:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734135680 00000100:00100000:3.0:1746129571.464906:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734135680 00000100:00100000:3.0:1746129571.464954:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11218 00000100:00100000:3.0:1746129571.464961:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013145df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+9:32310:x1830948734135680:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:3.0:1746129571.464983:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129571.464985:0:14549:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746129571.465005:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba31200/0x40a459093b069e4b lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f210b0 expref: 9 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.465031:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:3.0:1746129571.465035:0:14549:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746129571.465044:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095cde600/0x40a459093b069f39 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21127 expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.465084:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880095cdfa00/0x40a459093b069f40 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129571.465093:0:14549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa3400/0x40a459093b069e44 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f210a9 expref: 290 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.465099:0:14549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1d600/0x40a459093b069e52 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f210b7 expref: 7 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.465105:0:14549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1c400/0x40a459093b069e60 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f210c5 expref: 7 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.465110:0:14549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095cdfa00/0x40a459093b069f40 lrc: 6/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129571.465133:0:14549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1c400/0x40a459093b069e60 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f210c5 expref: 7 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.465144:0:14549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1c400/0x40a459093b069e60 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f210c5 expref: 7 pid: 14549 timeout: 926 lvb_type: 0 00000100:00100000:3.0:1746129571.465159:0:14549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094f47800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830948737516544:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129571.467947:0:14549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1d600/0x40a459093b069e52 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f210b7 expref: 7 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.467963:0:14549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1d600/0x40a459093b069e52 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f210b7 expref: 7 pid: 14549 timeout: 926 lvb_type: 0 00000100:00100000:3.0:1746129571.467975:0:14549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094f45f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830948737516672:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129571.468475:0:14549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa3400/0x40a459093b069e44 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f210a9 expref: 290 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.468484:0:14549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa3400/0x40a459093b069e44 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f210a9 expref: 290 pid: 16908 timeout: 926 lvb_type: 0 00000100:00100000:3.0:1746129571.468492:0:14549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094f45180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830948737516800:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129571.468513:0:14549:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a6ce8f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746129571.468958:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129571.469268:0:15096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734135936 00000100:00100000:1.0:1746129571.469275:0:15096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734135936 00000100:00100000:1.0:1746129571.469353:0:15096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11219 00000100:00100000:1.0:1746129571.469360:0:15096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013145f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:068dab75-d300-4ead-a742-d14572ad1e50+8:32306:x1830948734135936:12345-192.168.202.4@tcp:36:lfs.0 00010000:00010000:1.0:1746129571.469397:0:15096:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129571.469405:0:15096:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1c400/0x40a459093b069e60 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f210c5 expref: 8 pid: 14549 timeout: 926 lvb_type: 0 00010000:00010000:1.0:1746129571.469424:0:15096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:1.0:1746129571.469427:0:15096:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880095cdfa00/0x40a459093b069f40 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129571.469433:0:15096:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880095cdfa00/0x40a459093b069f40 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129571.469437:0:15096:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746129571.469471:0:15096:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880095fb0400/0x40a459093b069f47 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15096 initiator: MDT0 00010000:00010000:1.0:1746129571.469477:0:15096:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095cdfa00/0x40a459093b069f40 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129571.469482:0:15096:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095fb0400/0x40a459093b069f47 lrc: 4/0,1 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15096 initiator: MDT0 00010000:00010000:1.0:1746129571.469494:0:15096:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff880095cdfa00/0x40a459093b069f40 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129571.469502:0:15096:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880095fb0400/0x40a459093b069f47 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15096 initiator: MDT0 00010000:00010000:0.0:1746129571.472818:0:9822:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746129571.473110:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00010000:00010000:2.0:1746129571.473476:0:14549:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.202.4@tcp) returned -22 from blocking AST (req@ffff880094f47800 x1830948737516544) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1c400/0x40a459093b069e60 lrc: 1/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f210c5 expref: 8 pid: 14549 timeout: 926 lvb_type: 0 00010000:00010000:2.0:1746129571.473492:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1c400/0x40a459093b069e60 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f210c5 expref: 8 pid: 14549 timeout: 926 lvb_type: 0 00000100:00100000:2.0:1746129571.473509:0:14549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094f47800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830948737516544:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129571.473519:0:14549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094f45f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830948737516672:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129571.473526:0:14549:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.202.4@tcp) returned -22 from blocking AST (req@ffff880094f45180 x1830948737516800) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa3400/0x40a459093b069e44 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f210a9 expref: 290 pid: 16908 timeout: 926 lvb_type: 0 00010000:00010000:2.0:1746129571.473535:0:14549:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa3400/0x40a459093b069e44 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f210a9 expref: 290 pid: 16908 timeout: 926 lvb_type: 0 00010000:00010000:2.0:1746129571.473551:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa3400/0x40a459093b069e44 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f210a9 expref: 290 pid: 16908 timeout: 926 lvb_type: 0 00000100:00100000:2.0:1746129571.473564:0:14549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094f45180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830948737516800:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129571.473586:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:2.0:1746129571.473591:0:14549:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880095cdfa00/0x40a459093b069f40 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129571.473597:0:14549:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880095cdfa00/0x40a459093b069f40 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129571.473604:0:14549:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880095cdfa00/0x40a459093b069f40 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14549 initiator: MDT0 00000100:00100000:3.0:1746129571.473856:0:16908:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734136192 00000100:00100000:3.0:1746129571.473861:0:16908:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734136192 00000100:00100000:3.0:1746129571.473892:0:16908:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11220 00000100:00100000:3.0:1746129571.473898:0:16908:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013145f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ada2ffba-8920-4ecb-8068-68caa9806978+290:32313:x1830948734136192:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:3.0:1746129571.473914:0:16908:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129571.473917:0:16908:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746129571.473920:0:16908:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 40a459093b069e44) 00010000:00010000:3.0:1746129571.473921:0:16908:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746129571.473929:0:16908:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ebb2200/0x40a459093b069f4e lrc: 2/0,0 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2112e expref: -99 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.473966:0:16908:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ebb3600/0x40a459093b069f55 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129571.473974:0:16908:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095fb0400/0x40a459093b069f47 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15096 initiator: MDT0 00010000:00010000:3.0:1746129571.473978:0:16908:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ebb3600/0x40a459093b069f55 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129571.473989:0:16908:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff880095fb0400/0x40a459093b069f47 lrc: 4/0,1 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 15096 initiator: MDT0 00010000:00010000:3.0:1746129571.473995:0:16908:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008ebb3600/0x40a459093b069f55 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00000100:00100000:3.0:1746129571.474360:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129571.474404:0:20578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734136320 00000100:00100000:0.0:1746129571.474412:0:20578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734136320 00010000:00010000:0.0:1746129571.474442:0:20578:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1d600/0x40a459093b069e52 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f210b7 expref: 8 pid: 14549 timeout: 926 lvb_type: 0 00000100:00100000:0.0:1746129571.474467:0:20578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8303 00000100:00100000:0.0:1746129571.474474:0:20578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f45180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:068dab75-d300-4ead-a742-d14572ad1e50+8:1963:x1830948734136320:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129571.474488:0:20578:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129571.474493:0:20578:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1d600/0x40a459093b069e52 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f210b7 expref: 8 pid: 14549 timeout: 926 lvb_type: 0 00010000:00010000:0.0:1746129571.474503:0:20578:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1d600/0x40a459093b069e52 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f210b7 expref: 8 pid: 14549 timeout: 926 lvb_type: 0 00010000:00010000:0.0:1746129571.474520:0:20578:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1d600/0x40a459093b069e52 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f210b7 expref: 8 pid: 14549 timeout: 926 lvb_type: 0 00010000:00010000:0.0:1746129571.474595:0:20578:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:0.0:1746129571.474600:0:20578:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880095cdfa00/0x40a459093b069f40 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129571.474609:0:20578:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095cdfa00/0x40a459093b069f40 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40290400000020 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129571.474615:0:20578:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095cdfa00/0x40a459093b069f40 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40290400000020 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129571.474623:0:20578:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880095fb0400/0x40a459093b069f47 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 15096 initiator: MDT0 00010000:00010000:0.0:1746129571.474627:0:20578:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008ebb3600/0x40a459093b069f55 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129571.474657:0:20578:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129571.474717:0:20578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f45180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:068dab75-d300-4ead-a742-d14572ad1e50+7:1963:x1830948734136320:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 242us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129571.474724:0:20578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8303 00010000:00010000:3.0:1746129571.474792:0:14549:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880095cdfa00/0x40a459093b069f40 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129571.474798:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095cdfa00/0x40a459093b069f40 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 14549 initiator: MDT0 00000040:00080000:3.0:1746129571.475404:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3454, 88 off290680 00000004:00080000:3.0:1746129571.475411:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 826792117038ns, next at 776349687452ns, rc = 0 00000040:00080000:3.0:1746129571.475455:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3468, 88 off291824 00000004:00080000:3.0:1746129571.475459:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 826792165132ns, next at 776375382381ns, rc = 0 00000040:00080000:3.0:1746129571.475470:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3469, 88 off291912 00000004:00080000:3.0:1746129571.475472:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 826792178555ns, next at 776375382381ns, rc = 0 00000040:00080000:3.0:1746129571.475479:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3455, 88 off290768 00000004:00080000:3.0:1746129571.475482:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 826792187945ns, next at 776349687452ns, rc = 0 00000040:00080000:3.0:1746129571.475487:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3456, 88 off290856 00000004:00080000:3.0:1746129571.475491:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 826792196730ns, next at 776349687452ns, rc = 0 00000040:00080000:3.0:1746129571.475497:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3470, 88 off292000 00000004:00080000:3.0:1746129571.475500:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 826792206298ns, next at 776375382381ns, rc = 0 00000040:00080000:3.0:1746129571.475506:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3471, 88 off292088 00000004:00080000:3.0:1746129571.475509:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 826792214750ns, next at 776375382381ns, rc = 0 00000040:00080000:3.0:1746129571.475514:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3472, 88 off292176 00000004:00080000:3.0:1746129571.475516:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 826792222690ns, next at 776375382381ns, rc = 0 00000040:00080000:3.0:1746129571.475523:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3457, 88 off290944 00000004:00080000:3.0:1746129571.475525:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 826792230842ns, next at 776349687452ns, rc = 0 00000040:00080000:3.0:1746129571.475530:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3473, 88 off292264 00000004:00080000:3.0:1746129571.475533:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 826792239225ns, next at 776375382381ns, rc = 0 00000040:00080000:3.0:1746129571.475539:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3458, 88 off291032 00000004:00080000:3.0:1746129571.475542:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 826792247948ns, next at 776349687452ns, rc = 0 00000040:00080000:3.0:1746129571.475548:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3474, 88 off292352 00000004:00080000:3.0:1746129571.475550:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 826792256295ns, next at 776375382381ns, rc = 0 00000040:00080000:3.0:1746129571.475555:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3459, 88 off291120 00000004:00080000:3.0:1746129571.475558:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 826792263850ns, next at 776349687452ns, rc = 0 00000040:00080000:3.0:1746129571.475564:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3460, 88 off291208 00000004:00080000:3.0:1746129571.475566:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 826792272552ns, next at 776349687452ns, rc = 0 00000040:00080000:3.0:1746129571.475573:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3461, 88 off291296 00000004:00080000:3.0:1746129571.475575:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 826792281700ns, next at 776349687452ns, rc = 0 00000040:00080000:3.0:1746129571.475581:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3462, 88 off291384 00000004:00080000:3.0:1746129571.475584:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 826792290108ns, next at 776349687452ns, rc = 0 00000040:00080000:3.0:1746129571.475591:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3475, 88 off292440 00000004:00080000:3.0:1746129571.475594:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 826792299890ns, next at 776375382381ns, rc = 0 00000001:00080000:1.0:1746129571.511942:0:14619:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945309 is committed 00000001:00080000:1.0:1746129571.511959:0:14619:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945306 is committed 00000001:00080000:1.0:1746129571.511969:0:14619:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945310 is committed 00000004:00080000:1.0:1746129571.511972:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2645 committed 00010000:00010000:2.0:1746129571.511982:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095cdfa00/0x40a459093b069f40 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21127 expref: 9 pid: 14549 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1746129571.511983:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2632 committed 00000004:00080000:1.0:1746129571.511994:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2631 committed 00010000:00010000:2.0:1746129571.511995:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00000004:00080000:1.0:1746129571.511995:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2630 committed 00000004:00080000:1.0:1746129571.511997:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2629 committed 00010000:00010000:2.0:1746129571.511998:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00000004:00080000:1.0:1746129571.511999:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2644 committed 00000004:00080000:1.0:1746129571.512001:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2628 committed 00000004:00080000:1.0:1746129571.512002:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2643 committed 00010000:00010000:2.0:1746129571.512003:0:14549:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880095fb0400/0x40a459093b069f47 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 15096 initiator: MDT0 00000004:00080000:1.0:1746129571.512004:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2627 committed 00000004:00080000:1.0:1746129571.512006:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2642 committed 00000004:00080000:1.0:1746129571.512007:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2641 committed 00000004:00080000:1.0:1746129571.512008:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2640 committed 00000004:00080000:1.0:1746129571.512009:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2626 committed 00010000:00010000:2.0:1746129571.512011:0:14549:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095fb0400/0x40a459093b069f47 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40290400000020 pid: 15096 initiator: MDT0 00000004:00080000:1.0:1746129571.512011:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2625 committed 00000004:00080000:1.0:1746129571.512012:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2639 committed 00000004:00080000:1.0:1746129571.512014:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2638 committed 00010000:00010000:2.0:1746129571.512015:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095fb0400/0x40a459093b069f47 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40290400000020 pid: 15096 initiator: MDT0 00000004:00080000:1.0:1746129571.512015:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2624 committed 00010000:00010000:2.0:1746129571.512021:0:14549:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88008ebb3600/0x40a459093b069f55 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129571.512026:0:14549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095cdfa00/0x40a459093b069f40 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21127 expref: 8 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129571.512032:0:14549:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008ebb3600/0x40a459093b069f55 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00000100:00100000:1.0:1746129571.512050:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013145ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1830948737516928:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1746129571.512064:0:14549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880095cdfa00/0x40a459093b069f40 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21127 expref: 8 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129571.512077:0:14549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880095cdfa00/0x40a459093b069f40 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21127 expref: 8 pid: 14549 timeout: 926 lvb_type: 0 00000100:00100000:2.0:1746129571.512086:0:14549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f327b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830948737517440:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129571.512126:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129571.512136:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013145d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737517056:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129571.512155:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013145d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737517184:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129571.512159:0:14549:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009af1e540 going to sleep for 11 seconds 00000100:00100000:2.0:1746129571.512173:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013145e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737517312:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129571.512177:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129571.512190:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f448a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737517824:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129571.512193:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129571.512215:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737516928 00000100:00100000:1.0:1746129571.512222:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737516928 00000100:00100000:2.0:1746129571.512223:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129571.512236:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f449f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737517696:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129571.512258:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737517184 00000100:00100000:1.0:1746129571.512261:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737517184 00000100:00100000:1.0:1746129571.512272:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737517056 00000100:00100000:1.0:1746129571.512274:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737517056 00000100:00100000:1.0:1746129571.512284:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737517312 00000100:00100000:1.0:1746129571.512286:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737517312 00000100:00100000:1.0:1746129571.512333:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16192 00000100:00100000:1.0:1746129571.512340:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093edce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+16:3303:x1830948737516928:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129571.512387:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16193 00000100:00100000:3.0:1746129571.512397:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e389f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+16:3301:x1830948737517184:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746129571.512544:0:7149:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746129571.512547:0:7149:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb mtime from disk: 1746129571 -> 1746129571 00002000:00010000:1.0:1746129571.512549:0:7149:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb atime from disk: 1746129571 -> 1746129571 00002000:00010000:1.0:1746129571.512551:0:7149:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb ctime from disk: 1746129571 -> 1746129571 00002000:00010000:1.0:1746129571.512553:0:7149:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:0.0:1746129571.512601:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129571.512606:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f449500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737517952:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129571.512617:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f449880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737518208:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129571.512626:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:3.0:1746129571.512728:0:4385:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3f5:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746129571.512731:0:4385:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f5:0x0] updating lvb mtime from disk: 1746129571 -> 1746129571 00002000:00010000:3.0:1746129571.512733:0:4385:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f5:0x0] updating lvb atime from disk: 1746129571 -> 1746129571 00002000:00010000:3.0:1746129571.512734:0:4385:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f5:0x0] updating lvb ctime from disk: 1746129571 -> 1746129571 00002000:00010000:3.0:1746129571.512736:0:4385:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f5:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:3.0:1746129571.513012:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e389f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+18:3301:x1830948737517184:12345-0@lo:2:osp-syn-1-0.0 Request processed in 617us (832us total) trans 17179874104 rc 0/0 00000100:00100000:3.0:1746129571.513018:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16193 00000100:00100000:3.0:1746129571.513035:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737517696 00000100:00100000:3.0:1746129571.513039:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737517696 00000100:00100000:3.0:1746129571.513058:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737517952 00000100:00100000:3.0:1746129571.513059:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737517952 00000100:00100000:3.0:1746129571.513068:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16194 00000100:00100000:3.0:1746129571.513071:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f44b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+19:3300:x1830948737517056:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129571.513163:0:4699:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16195 00000100:00100000:0.0:1746129571.513168:0:4699:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f324000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+20:3302:x1830948737517312:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746129571.513227:0:4699:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746129571.513230:0:4699:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb mtime from disk: 1746129523 -> 1746129523 00002000:00010000:0.0:1746129571.513231:0:4699:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb atime from disk: 1746129523 -> 1746129523 00002000:00010000:0.0:1746129571.513233:0:4699:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb ctime from disk: 1746129524 -> 1746129524 00002000:00010000:0.0:1746129571.513234:0:4699:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1746129571.513257:0:4699:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f324000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+21:3302:x1830948737517312:12345-0@lo:2:osp-syn-1-0.0 Request processed in 89us (1033us total) trans 17179874106 rc 0/0 00000100:00100000:0.0:1746129571.513261:0:4699:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16195 00000100:00100000:0.0:1746129571.513269:0:4699:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16196 00000100:00100000:0.0:1746129571.513273:0:4699:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f448000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+20:3300:x1830948737517696:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129571.513276:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f44b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737518464:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129571.513327:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129571.513338:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f449180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737518976:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129571.513359:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129571.513361:0:4699:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f448000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+21:3300:x1830948737517696:12345-0@lo:2:osp-syn-1-0.0 Request processed in 88us (759us total) trans 17179874107 rc 0/0 00000100:00100000:0.0:1746129571.513366:0:4699:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16196 00000100:00100000:0.0:1746129571.513373:0:4699:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737518464 00000100:00100000:0.0:1746129571.513376:0:4699:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737518464 00000100:00100000:0.0:1746129571.513384:0:4699:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737518976 00000100:00100000:0.0:1746129571.513386:0:4699:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737518976 00000100:00100000:0.0:1746129571.513391:0:4699:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16197 00000100:00100000:0.0:1746129571.513394:0:4699:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f325f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+20:3302:x1830948737517952:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746129571.513395:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013145e300/2, rc 0, transno 17179874106 00000100:00100000:2.0:1746129571.513400:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013145e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737517312:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129571.513406:0:3302:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1746129571.513410:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f44b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737517568:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129571.513425:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129571.513433:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f448380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737518080:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129571.513445:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129571.513455:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f448700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737518592:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129571.513455:0:4699:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f325f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+21:3302:x1830948737517952:12345-0@lo:2:osp-syn-1-0.0 Request processed in 59us (828us total) trans 17179874108 rc 0/0 00000100:00100000:0.0:1746129571.513460:0:4699:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16197 00000100:00100000:0.0:1746129571.513466:0:4699:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737517568 00000100:00100000:0.0:1746129571.513468:0:4699:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737517568 00000100:00100000:2.0:1746129571.513471:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129571.513475:0:4699:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737518080 00000100:00100000:0.0:1746129571.513477:0:4699:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737518080 00000100:00100000:0.0:1746129571.513483:0:4699:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737518592 00000004:00080000:2.0:1746129571.513484:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f449500/2, rc 0, transno 17179874108 00000100:00100000:0.0:1746129571.513485:0:4699:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737518592 00000100:00100000:2.0:1746129571.513487:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f449500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737517952:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129571.513492:0:4699:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16198 00000100:00100000:0.0:1746129571.513495:0:4699:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f326a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+17:3302:x1830948737518464:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129571.513510:0:11014:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16199 00000100:00100000:2.0:1746129571.513518:0:11014:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009402ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+17:3302:x1830948737518976:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129571.513588:0:4699:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f326a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+18:3302:x1830948737518464:12345-0@lo:2:osp-syn-0-0.0 Request processed in 91us (260us total) trans 21474841347 rc 0/0 00000100:00100000:0.0:1746129571.513593:0:4699:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16198 00000100:00100000:0.0:1746129571.513604:0:4699:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16200 00000100:00100000:0.0:1746129571.513608:0:4699:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094028a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+21:3302:x1830948737517568:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129571.513642:0:11014:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009402ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+18:3302:x1830948737518976:12345-0@lo:2:osp-syn-0-0.0 Request processed in 126us (281us total) trans 21474841348 rc 0/0 00000100:00100000:2.0:1746129571.513648:0:11014:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16199 00000100:00100000:2.0:1746129571.513663:0:11014:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16201 00000100:00100000:2.0:1746129571.513667:0:11014:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009402bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+17:3302:x1830948737518080:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129571.513676:0:4699:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094028a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+22:3302:x1830948737517568:12345-0@lo:2:osp-syn-1-0.0 Request processed in 68us (250us total) trans 17179874109 rc 0/0 00000100:00100000:0.0:1746129571.513681:0:4699:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16200 00000100:00100000:0.0:1746129571.513691:0:4699:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16202 00000100:00100000:0.0:1746129571.513695:0:4699:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094029500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+17:3302:x1830948737518592:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746129571.513744:0:11014:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3ec:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:2.0:1746129571.513747:0:11014:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ec:0x0] updating lvb mtime from disk: 1746129570 -> 1746129570 00002000:00010000:2.0:1746129571.513749:0:11014:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3ec:0x0] updating lvb atime from disk: 1746129568 -> 1746129568 00002000:00010000:2.0:1746129571.513750:0:11014:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ec:0x0] updating lvb ctime from disk: 1746129570 -> 1746129570 00002000:00010000:2.0:1746129571.513752:0:11014:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3ec:0x0] updating lvb blocks from disk: 2073 -> 2073 00000100:00100000:0.0:1746129571.513772:0:4699:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094029500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+19:3302:x1830948737518592:12345-0@lo:2:osp-syn-0-0.0 Request processed in 77us (300us total) trans 21474841350 rc 0/0 00000100:00100000:2.0:1746129571.513777:0:11014:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009402bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+19:3302:x1830948737518080:12345-0@lo:2:osp-syn-0-0.0 Request processed in 109us (330us total) trans 21474841349 rc 0/0 00000100:00100000:0.0:1746129571.513778:0:4699:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16202 00000100:00100000:2.0:1746129571.513782:0:11014:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16201 00000100:00100000:0.0:1746129571.513798:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129571.513818:0:8412:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737518208 00000100:00100000:2.0:1746129571.513822:0:8412:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737518208 00000100:00100000:2.0:1746129571.513842:0:8412:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16203 00000100:00100000:2.0:1746129571.513847:0:8412:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c079880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+18:3300:x1830948737518208:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746129571.513923:0:8412:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746129571.513925:0:8412:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb mtime from disk: 1746129571 -> 1746129571 00002000:00010000:2.0:1746129571.513927:0:8412:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb atime from disk: 1746129570 -> 1746129570 00002000:00010000:2.0:1746129571.513929:0:8412:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb ctime from disk: 1746129570 -> 1746129570 00002000:00010000:2.0:1746129571.513930:0:8412:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb blocks from disk: 2077 -> 2077 00002000:00010000:3.0:1746129571.513948:0:4385:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746129571.513951:0:4385:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb mtime from disk: 1746129571 -> 1746129571 00002000:00010000:3.0:1746129571.513952:0:4385:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb atime from disk: 1746129570 -> 1746129570 00000100:00100000:2.0:1746129571.513952:0:8412:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c079880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+19:3300:x1830948737518208:12345-0@lo:2:osp-syn-0-0.0 Request processed in 105us (153us total) trans 21474841351 rc 0/0 00002000:00010000:3.0:1746129571.513954:0:4385:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb ctime from disk: 1746129571 -> 1746129571 00002000:00010000:3.0:1746129571.513956:0:4385:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:2.0:1746129571.513956:0:8412:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16203 00000004:00080000:2.0:1746129571.513980:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f44b100/2, rc 0, transno 17179874109 00000100:00100000:2.0:1746129571.513983:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f44b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737517568:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129571.513984:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f44b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+21:3300:x1830948737517056:12345-0@lo:2:osp-syn-1-0.0 Request processed in 911us (1791us total) trans 17179874105 rc 0/0 00000100:00100000:3.0:1746129571.513989:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16194 00000004:00080000:2.0:1746129571.513993:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f448380/2, rc 0, transno 21474841349 00000100:00100000:2.0:1746129571.514001:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f448380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737518080:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746129571.514007:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f448700/2, rc 0, transno 21474841350 00000100:00100000:2.0:1746129571.514010:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f448700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737518592:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746129571.514017:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f44b480/2, rc 0, transno 21474841347 00000100:00100000:2.0:1746129571.514019:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f44b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737518464:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746129571.514024:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f449180/2, rc 0, transno 21474841348 00000100:00100000:2.0:1746129571.514027:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f449180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737518976:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129571.514185:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f44aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737518720:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129571.514200:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093edce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+20:3303:x1830948737516928:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1860us (2073us total) trans 17179874103 rc 0/0 00000100:00100000:1.0:1746129571.514207:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16192 00000100:00100000:0.0:1746129571.514207:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746129571.514894:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013145d880/2, rc 0, transno 17179874105 00000100:00100000:0.0:1746129571.514900:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013145d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737517056:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129571.514908:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f449f80/2, rc 0, transno 17179874107 00000100:00100000:0.0:1746129571.514910:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f449f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737517696:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129571.514918:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f449880/2, rc 0, transno 21474841351 00000100:00100000:0.0:1746129571.514921:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f449880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737518208:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129571.515133:0:22481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737518720 00000100:00100000:3.0:1746129571.515137:0:22481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737518720 00000100:00100000:3.0:1746129571.515165:0:22481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16204 00000100:00100000:3.0:1746129571.515170:0:22481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c07a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+19:3300:x1830948737518720:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129571.515180:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129571.515209:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f44ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737518336:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129571.515233:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129571.515246:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f44bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737518848:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129571.515261:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129571.515287:0:22481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c07a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+20:3300:x1830948737518720:12345-0@lo:2:osp-syn-0-0.0 Request processed in 116us (1078us total) trans 21474841352 rc 0/0 00000004:00080000:1.0:1746129571.515290:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013145d180/2, rc 0, transno 17179874104 00000100:00100000:3.0:1746129571.515316:0:22481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16204 00000100:00100000:3.0:1746129571.515326:0:22481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737517824 00000100:00100000:1.0:1746129571.515326:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013145d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737517184:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129571.515328:0:22481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737517824 00000100:00100000:3.0:1746129571.515340:0:22481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737518336 00000100:00100000:3.0:1746129571.515341:0:22481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737518336 00000100:00100000:1.0:1746129571.515343:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737518848 00000100:00100000:1.0:1746129571.515346:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737518848 00000100:00100000:3.0:1746129571.515351:0:22481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16205 00000100:00100000:3.0:1746129571.515354:0:22481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e38bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+20:3301:x1830948737517824:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129571.515368:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16206 00000100:00100000:1.0:1746129571.515372:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e38ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+21:3301:x1830948737518336:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129571.515441:0:22481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e38bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+21:3301:x1830948737517824:12345-0@lo:2:osp-syn-1-0.0 Request processed in 85us (262us total) trans 17179874110 rc 0/0 00000100:00100000:3.0:1746129571.515447:0:22481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16205 00000100:00100000:3.0:1746129571.515456:0:22481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16207 00000100:00100000:3.0:1746129571.515461:0:22481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e388700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+22:3301:x1830948737518848:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746129571.515479:0:7148:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb size from disk: 5146336 -> 5146336 00002000:00010000:1.0:1746129571.515482:0:7148:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb mtime from disk: 1746129571 -> 1746129571 00002000:00010000:1.0:1746129571.515484:0:7148:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb atime from disk: 1746129571 -> 1746129571 00002000:00010000:1.0:1746129571.515486:0:7148:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb ctime from disk: 1746129571 -> 1746129571 00002000:00010000:1.0:1746129571.515488:0:7148:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb blocks from disk: 6033 -> 6033 00000100:00100000:1.0:1746129571.515510:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e38ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+22:3301:x1830948737518336:12345-0@lo:2:osp-syn-0-0.0 Request processed in 136us (274us total) trans 21474841353 rc 0/0 00000100:00100000:1.0:1746129571.515516:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16206 00000004:00080000:1.0:1746129571.515546:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013145ce00/2, rc 0, transno 17179874103 00000100:00100000:1.0:1746129571.515550:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013145ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1830948737516928:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129571.515559:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c07a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1830948737519104:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129571.515582:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129571.515601:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737519104 00000100:00100000:1.0:1746129571.515603:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737519104 00000100:00100000:1.0:1746129571.515617:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16208 00000100:00100000:1.0:1746129571.515621:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bf79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+22:3303:x1830948737519104:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129571.515703:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bf79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+23:3303:x1830948737519104:12345-0@lo:2:osp-syn-0-0.0 Request processed in 82us (120us total) trans 21474841354 rc 0/0 00000100:00100000:1.0:1746129571.515709:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16208 00000004:00080000:1.0:1746129571.515728:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c07a680/2, rc 0, transno 21474841354 00000100:00100000:1.0:1746129571.515732:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c07a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1830948737519104:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746129571.515745:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f448a80/2, rc 0, transno 17179874110 00000100:00100000:1.0:1746129571.515748:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f448a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737517824:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746129571.515753:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f44ad80/2, rc 0, transno 21474841353 00000100:00100000:1.0:1746129571.515755:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f44ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737518336:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129571.515772:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f44aa00/2, rc 0, transno 21474841352 00000100:00100000:0.0:1746129571.515776:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f44aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737518720:0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746129571.516956:0:22481:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746129571.516959:0:22481:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1746129571.516960:0:22481:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746129571.516962:0:22481:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1746129571.516963:0:22481:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1746129571.517014:0:22481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e388700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+23:3301:x1830948737518848:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1551us (1750us total) trans 21474841355 rc 0/0 00000100:00100000:3.0:1746129571.517022:0:22481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16207 00000100:00100000:2.0:1746129571.517172:0:14549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f327b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830948737517440:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129571.517228:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095cde600/0x40a459093b069f39 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21127 expref: 8 pid: 14549 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1746129571.517253:0:14549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880095cdfa00/0x40a459093b069f40 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21127 expref: 7 pid: 14549 timeout: 926 lvb_type: 0 00010000:00010000:2.0:1746129571.517262:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095cdfa00/0x40a459093b069f40 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21127 expref: 7 pid: 14549 timeout: 926 lvb_type: 0 00010000:00010000:0.0:1746129571.517403:0:15096:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880095fb0400/0x40a459093b069f47 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 15096 initiator: MDT0 00010000:00010000:0.0:1746129571.517412:0:15096:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095fb0400/0x40a459093b069f47 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 15096 initiator: MDT0 00000004:00010000:0.0:1746129571.517576:0:15096:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88013145f100 reply state ffff88009445d000 transno 8589945311 ns: mdt-lustre-MDT0000_UUID lock: ffff880095fb0400/0x40a459093b069f47 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 15096 initiator: MDT0 00000100:00100000:0.0:1746129571.517584:0:15096:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1746129571.517652:0:15096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013145f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:068dab75-d300-4ead-a742-d14572ad1e50+8:32306:x1830948734135936:12345-192.168.202.4@tcp:36:lfs.0 Request processed in 48292us (48695us total) trans 8589945311 rc 0/0 00000100:00100000:0.0:1746129571.517660:0:15096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11219 00010000:00010000:2.0:1746129571.517782:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095cdfa00, rc 0) 00000100:00100000:2.0:1746129571.517806:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013145df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+7:32310:x1830948734135680:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 52845us (53007us total) trans 8589945310 rc 0/0 00000100:00100000:2.0:1746129571.517812:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11218 00000004:00080000:1.0:1746129571.517945:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f44bb80/2, rc 0, transno 21474841355 00000100:00100000:1.0:1746129571.517951:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f44bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737518848:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1746129571.521696:0:3286:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880095fb0400/0x40a459093b069f47 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129571.521713:0:3286:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095fb0400/0x40a459093b069f47 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129571.521719:0:3286:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095fb0400/0x40a459093b069f47 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129571.521726:0:3286:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095fb0400 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746129571.521730:0:3286:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095fb0400/0x40a459093b069f47 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129571.521736:0:3286:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095fb0400/0x40a459093b069f47 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129571.521754:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:2.0:1746129571.521757:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129571.521760:0:3286:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88008ebb3600/0x40a459093b069f55 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129571.521771:0:3286:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095fb0400/0x40a459093b069f47 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129571.521775:0:3286:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095fb0400/0x40a459093b069f47 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 15096 initiator: MDT0 00000100:00100000:0.0:1746129571.522704:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129571.522805:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734136448 00000100:00100000:2.0:1746129571.522814:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734136448 00000100:00100000:2.0:1746129571.524609:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11221 00000100:00100000:2.0:1746129571.524626:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c078e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:068dab75-d300-4ead-a742-d14572ad1e50+7:32306:x1830948734136448:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:2.0:1746129571.524654:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129571.524676:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c63ec00/0x40a459093b069f5c lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21135 expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129571.524736:0:14549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ebb3600/0x40a459093b069f55 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129571.524744:0:14549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c63ec00/0x40a459093b069f5c lrc: 4/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21135 expref: 8 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129571.524762:0:14549:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88008ebb3600/0x40a459093b069f55 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129571.524773:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c63ec00/0x40a459093b069f5c lrc: 3/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21135 expref: 8 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129571.524784:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:2.0:1746129571.524787:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746129571.524789:0:14549:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008ebb3600/0x40a459093b069f55 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129571.524795:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c63ec00, rc 0) 00000100:00100000:2.0:1746129571.524857:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c078e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:068dab75-d300-4ead-a742-d14572ad1e50+8:32306:x1830948734136448:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 237us (2160us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129571.524864:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11221 00000100:00100000:0.0:1746129571.529401:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129571.529455:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129571.529551:0:15096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734136576 00000100:00100000:1.0:1746129571.529560:0:15096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734136576 00000100:00100000:1.0:1746129571.529625:0:15096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11222 00000100:00100000:1.0:1746129571.529634:0:15096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c079f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+7:32310:x1830948734136576:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:1.0:1746129571.529663:0:15096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129571.529682:0:15096:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c40a400/0x40a459093b069f63 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2113c expref: -99 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129571.529747:0:15096:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c40a400/0x40a459093b069f63 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2113c expref: 8 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129571.529758:0:15096:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c40a400/0x40a459093b069f63 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2113c expref: 8 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129571.529770:0:15096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:1.0:1746129571.529773:0:15096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746129571.529776:0:15096:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008ebb3600/0x40a459093b069f55 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129571.529782:0:15096:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c40a400, rc 0) 00000100:00100000:1.0:1746129571.529834:0:15096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c079f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+8:32310:x1830948734136576:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 201us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129571.529841:0:15096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11222 00000100:00100000:2.0:1746129571.531227:0:20578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734136704 00000100:00100000:2.0:1746129571.531237:0:20578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734136704 00010000:00010000:2.0:1746129571.531268:0:20578:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095cdfa00/0x40a459093b069f40 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21127 expref: 8 pid: 14549 timeout: 926 lvb_type: 0 00000100:00100000:2.0:1746129571.531553:0:20578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8304 00000100:00100000:2.0:1746129571.531563:0:20578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c079180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+8:1960:x1830948734136704:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129571.531578:0:20578:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129571.531584:0:20578:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880095cdfa00/0x40a459093b069f40 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21127 expref: 8 pid: 14549 timeout: 926 lvb_type: 0 00010000:00010000:2.0:1746129571.531596:0:20578:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880095cdfa00/0x40a459093b069f40 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21127 expref: 8 pid: 14549 timeout: 926 lvb_type: 0 00010000:00010000:2.0:1746129571.531618:0:20578:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095cdfa00/0x40a459093b069f40 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21127 expref: 8 pid: 14549 timeout: 926 lvb_type: 0 00010000:00010000:2.0:1746129571.531634:0:20578:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:2.0:1746129571.531640:0:20578:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88008ebb3600/0x40a459093b069f55 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129571.531647:0:20578:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ebb3600/0x40a459093b069f55 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290400000020 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129571.531657:0:20578:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ebb3600/0x40a459093b069f55 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290400000020 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129571.531665:0:20578:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c63ec00/0x40a459093b069f5c lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21135 expref: 7 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129571.531691:0:20578:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129571.531741:0:20578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c079180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+7:1960:x1830948734136704:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 180us (2285us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129571.531747:0:20578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8304 00010000:00010000:0.0:1746129571.532329:0:16908:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008ebb3600/0x40a459093b069f55 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129571.532337:0:16908:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ebb3600/0x40a459093b069f55 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 16908 initiator: MDT0 00000040:00080000:0.0:1746129571.533741:0:16908:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3463, 88 off291472 00000004:00080000:0.0:1746129571.533751:0:16908:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 826850456735ns, next at 776349687452ns, rc = 0 00000040:00080000:0.0:1746129571.533812:0:16908:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3476, 88 off292528 00000004:00080000:0.0:1746129571.533816:0:16908:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 826850522371ns, next at 776375382381ns, rc = 0 00000040:00080000:0.0:1746129571.533843:0:16908:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3477, 88 off292616 00000004:00080000:0.0:1746129571.533846:0:16908:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 826850552481ns, next at 776375382381ns, rc = 0 00000040:00080000:0.0:1746129571.533855:0:16908:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3464, 88 off291560 00000004:00080000:0.0:1746129571.533857:0:16908:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 826850563231ns, next at 776349687452ns, rc = 0 00000040:00080000:0.0:1746129571.533863:0:16908:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3465, 88 off291648 00000004:00080000:0.0:1746129571.533865:0:16908:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 826850571751ns, next at 776349687452ns, rc = 0 00000040:00080000:0.0:1746129571.534081:0:16908:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3478, 88 off292704 00000004:00080000:0.0:1746129571.534086:0:16908:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 826850791989ns, next at 776375382381ns, rc = 0 00000040:00080000:0.0:1746129571.534107:0:16908:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3479, 88 off292792 00000004:00080000:0.0:1746129571.534110:0:16908:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 826850815810ns, next at 776375382381ns, rc = 0 00000040:00080000:0.0:1746129571.534116:0:16908:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3480, 88 off292880 00000004:00080000:0.0:1746129571.534118:0:16908:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 826850824610ns, next at 776375382381ns, rc = 0 00000040:00080000:0.0:1746129571.534125:0:16908:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3466, 88 off291736 00000004:00080000:0.0:1746129571.534127:0:16908:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 826850833545ns, next at 776349687452ns, rc = 0 00000040:00080000:0.0:1746129571.534465:0:16908:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3481, 88 off292968 00000004:00080000:0.0:1746129571.534469:0:16908:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 826851175350ns, next at 776375382381ns, rc = 0 00000040:00080000:0.0:1746129571.535155:0:16908:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3467, 88 off291824 00000004:00080000:0.0:1746129571.535160:0:16908:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 826851865964ns, next at 776349687452ns, rc = 0 00000040:00080000:0.0:1746129571.535182:0:16908:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3482, 88 off293056 00000004:00080000:0.0:1746129571.535185:0:16908:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 826851891022ns, next at 776375382381ns, rc = 0 00000040:00080000:0.0:1746129571.535289:0:16908:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3468, 88 off291912 00000004:00080000:0.0:1746129571.535318:0:16908:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 826852024105ns, next at 776349687452ns, rc = 0 00000040:00080000:0.0:1746129571.535328:0:16908:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3469, 88 off292000 00000004:00080000:0.0:1746129571.535330:0:16908:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 826852036192ns, next at 776349687452ns, rc = 0 00000040:00080000:0.0:1746129571.535336:0:16908:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3470, 88 off292088 00000004:00080000:0.0:1746129571.535339:0:16908:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 826852044944ns, next at 776349687452ns, rc = 0 00000040:00080000:0.0:1746129571.535345:0:16908:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3471, 88 off292176 00000004:00080000:0.0:1746129571.535347:0:16908:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 826852053593ns, next at 776349687452ns, rc = 0 00000040:00080000:0.0:1746129571.535355:0:16908:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3483, 88 off293144 00000004:00080000:0.0:1746129571.535358:0:16908:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 826852063889ns, next at 776375382381ns, rc = 0 00000100:00100000:2.0:1746129571.567724:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129571.568357:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734136960 00000100:00100000:3.0:1746129571.568368:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734136960 00000001:00080000:0.0:1746129571.568452:0:14619:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945312 is committed 00000004:00080000:0.0:1746129571.568459:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2653 committed 00010000:00010000:1.0:1746129571.568550:0:16908:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ebb3600/0x40a459093b069f55 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2112e expref: 290 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129571.568565:0:16908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:1.0:1746129571.568567:0:16908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1746129571.568572:0:16908:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c63ec00/0x40a459093b069f5c lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21135 expref: 7 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129571.568582:0:16908:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c63ec00/0x40a459093b069f5c lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21135 expref: 7 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129571.568593:0:16908:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c63ec00/0x40a459093b069f5c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21135 expref: 7 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129571.568600:0:16908:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c40a400/0x40a459093b069f63 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2113c expref: 7 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129571.568606:0:16908:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c40a400/0x40a459093b069f63 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2113c expref: 7 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129571.568611:0:16908:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c40a400/0x40a459093b069f63 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2113c expref: 7 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129571.568647:0:16908:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009c40a400/0x40a459093b069f63 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2113c expref: 7 pid: 15096 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129571.568661:0:16908:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e388e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16908:1830948737519232:192.168.202.4@tcp:105: 00000100:00100000:3.0:1746129571.568796:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11223 00000100:00100000:3.0:1746129571.568806:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094028e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+7:32317:x1830948734136960:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129571.568826:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129571.568840:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c22dc00/0x40a459093b069f6a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21143 expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.568946:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c22da00/0x40a459093b069f71 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129571.568955:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c22da00/0x40a459093b069f71 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129571.568963:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c22da00/0x40a459093b069f71 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129571.568975:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c22c800/0x40a459093b069f78 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129571.568979:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c22c800/0x40a459093b069f78 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129571.568984:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c22c800/0x40a459093b069f78 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129571.569090:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c22cc00/0x40a459093b069f7f lrc: 3/1,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129571.569101:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c22cc00/0x40a459093b069f7f lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129571.569107:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c22cc00/0x40a459093b069f7f lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00080000:0.0:1746129571.569112:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2641 committed 00000004:00200000:3.0:1746129571.569115:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00000004:00080000:0.0:1746129571.569118:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2640 committed 00000004:00080000:0.0:1746129571.569120:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2639 committed 00000004:00080000:0.0:1746129571.569122:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2638 committed 00000004:00080000:0.0:1746129571.569123:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2652 committed 00000004:00080000:0.0:1746129571.569124:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2637 committed 00000004:00080000:0.0:1746129571.569126:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2651 committed 00000004:00080000:0.0:1746129571.569127:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2636 committed 00000004:00080000:0.0:1746129571.569128:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2650 committed 00000004:00080000:0.0:1746129571.569130:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2649 committed 00000004:00080000:0.0:1746129571.569131:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2648 committed 00000004:00080000:0.0:1746129571.569132:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2635 committed 00000004:00080000:0.0:1746129571.569134:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2634 committed 00000004:00080000:0.0:1746129571.569135:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2647 committed 00000004:00080000:0.0:1746129571.569136:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2646 committed 00000004:00080000:0.0:1746129571.569138:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2633 committed 00000001:00080000:0.0:1746129571.569145:0:14619:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945311 is committed 00010000:00010000:1.0:1746129571.569281:0:16908:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009c63ec00/0x40a459093b069f5c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21135 expref: 6 pid: 14549 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129571.569290:0:16908:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e389c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16908:1830948737519360:192.168.202.4@tcp:105: 00000100:00100000:1.0:1746129571.569341:0:16908:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934d2f00 going to sleep for 11 seconds 00010000:00010000:3.0:1746129571.569437:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c22cc00/0x40a459093b069f7f lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129571.569449:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c22cc00/0x40a459093b069f7f lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129571.569454:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c22cc00/0x40a459093b069f7f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129571.569459:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c22cc00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:3.0:1746129571.569462:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c22cc00/0x40a459093b069f7f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129571.569467:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c22cc00/0x40a459093b069f7f lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129571.569476:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:3.0:1746129571.569478:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746129571.569480:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c22cc00/0x40a459093b069f7f lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129571.569484:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c22cc00/0x40a459093b069f7f lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129571.569497:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c22da00/0x40a459093b069f71 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129571.569501:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c22da00/0x40a459093b069f71 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129571.569505:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c22da00/0x40a459093b069f71 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129571.569508:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c22da00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:3.0:1746129571.569510:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c22da00/0x40a459093b069f71 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129571.569517:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c22da00/0x40a459093b069f71 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129571.569522:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880132ef8f00) 00010000:00010000:3.0:1746129571.569524:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129571.569526:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c22da00/0x40a459093b069f71 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129571.569530:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c22da00/0x40a459093b069f71 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129571.569536:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c22c800/0x40a459093b069f78 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129571.569540:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c22c800/0x40a459093b069f78 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129571.569545:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c22c800/0x40a459093b069f78 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129571.569549:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c22c800 already unused, calling callback (ffffffffa136e690) 00010000:00010000:3.0:1746129571.569550:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c22c800/0x40a459093b069f78 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129571.569555:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c22c800/0x40a459093b069f78 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129571.569560:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f9bac00) 00010000:00010000:3.0:1746129571.569562:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129571.569564:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c22c800/0x40a459093b069f78 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129571.569568:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c22c800/0x40a459093b069f78 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129571.569604:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c22dc00/0x40a459093b069f6a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21143 expref: 9 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.569610:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c22dc00/0x40a459093b069f6a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21143 expref: 9 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.569616:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c22dc00, rc 0) 00000100:00100000:3.0:1746129571.569648:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094028e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+8:32317:x1830948734136960:12345-192.168.202.4@tcp:101:cat.0 Request processed in 843us (1936us total) trans 8589945313 rc 301/301 00000100:00100000:3.0:1746129571.569655:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11223 00000100:00100000:0.0:1746129571.569831:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094028700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737519488:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129571.569859:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094029f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737519616:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129571.569871:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129571.569875:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009402a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1830948737519872:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129571.569890:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009402ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737520000:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129571.569899:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129571.569916:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129571.569929:0:3300:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1746129571.569933:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094028a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737520128:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129571.569948:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129571.569970:0:8410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737519488 00000100:00100000:0.0:1746129571.569975:0:8410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737519488 00000100:00100000:0.0:1746129571.570002:0:8410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737519872 00000100:00100000:0.0:1746129571.570004:0:8410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737519872 00000100:00100000:0.0:1746129571.570013:0:8410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737520000 00000100:00100000:0.0:1746129571.570015:0:8410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737520000 00000100:00100000:0.0:1746129571.570024:0:8410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737520128 00000100:00100000:0.0:1746129571.570025:0:8410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737520128 00000100:00100000:0.0:1746129571.570035:0:8410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16209 00000100:00100000:0.0:1746129571.570040:0:8410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c07b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+26:3300:x1830948737519488:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746129571.570193:0:8410:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3ec:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746129571.570196:0:8410:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ec:0x0] updating lvb mtime from disk: 1746129570 -> 1746129570 00002000:00010000:0.0:1746129571.570198:0:8410:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3ec:0x0] updating lvb atime from disk: 1746129568 -> 1746129568 00002000:00010000:0.0:1746129571.570200:0:8410:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ec:0x0] updating lvb ctime from disk: 1746129570 -> 1746129570 00002000:00010000:0.0:1746129571.570202:0:8410:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3ec:0x0] updating lvb blocks from disk: 2073 -> 2073 00000100:00100000:0.0:1746129571.570224:0:8410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c07b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+27:3300:x1830948737519488:12345-0@lo:2:osp-syn-0-0.0 Request processed in 183us (353us total) trans 21474841356 rc 0/0 00000100:00100000:0.0:1746129571.570230:0:8410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16209 00000100:00100000:0.0:1746129571.570242:0:8410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16210 00000100:00100000:0.0:1746129571.570246:0:8410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009016a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+26:3303:x1830948737519872:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129571.570356:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009402bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1830948737520384:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129571.570362:0:8410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009016a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+27:3303:x1830948737519872:12345-0@lo:2:osp-syn-0-0.0 Request processed in 116us (462us total) trans 21474841357 rc 0/0 00000100:00100000:3.0:1746129571.570368:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129571.570368:0:8410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16210 00000100:00100000:0.0:1746129571.570389:0:8410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737519616 00000100:00100000:0.0:1746129571.570391:0:8410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737519616 00000100:00100000:3.0:1746129571.570414:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e38b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737520640:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129571.570432:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16211 00000100:00100000:3.0:1746129571.570434:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129571.570439:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c078380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+27:3300:x1830948737520000:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129571.570537:0:8411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737520640 00000100:00100000:3.0:1746129571.570539:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e38a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737521152:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129571.570541:0:8411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737520640 00000100:00100000:3.0:1746129571.570554:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129571.570563:0:8411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737521152 00000100:00100000:2.0:1746129571.570566:0:8411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737521152 00000100:00100000:3.0:1746129571.570571:0:3301:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1746129571.570574:0:8411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16212 00000100:00100000:3.0:1746129571.570575:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e38aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737520512:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129571.570579:0:8411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c079500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+27:3300:x1830948737520128:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129571.570588:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129571.570595:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e389500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737521024:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129571.570605:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129571.570620:0:8410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737520512 00000100:00100000:3.0:1746129571.570623:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094029880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737519744:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129571.570623:0:8410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737520512 00000100:00100000:0.0:1746129571.570631:0:8410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737521024 00000100:00100000:0.0:1746129571.570633:0:8410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737521024 00000100:00100000:3.0:1746129571.570638:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129571.570640:0:8410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737519744 00000100:00100000:0.0:1746129571.570642:0:8410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737519744 00000100:00100000:3.0:1746129571.570646:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094029500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737520256:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129571.570652:0:8410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16213 00000100:00100000:0.0:1746129571.570656:0:8410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+29:3301:x1830948737519616:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129571.570663:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129571.570666:0:8411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c079500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+29:3300:x1830948737520128:12345-0@lo:2:osp-syn-0-0.0 Request processed in 86us (716us total) trans 21474841358 rc 0/0 00000100:00100000:2.0:1746129571.570671:0:8411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16212 00000100:00100000:3.0:1746129571.570672:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e389180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737520768:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129571.570679:0:8411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737520256 00000100:00100000:2.0:1746129571.570681:0:8411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737520256 00000100:00100000:3.0:1746129571.570685:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129571.570691:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e38b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737521280:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129571.570691:0:8411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737520768 00000100:00100000:2.0:1746129571.570693:0:8411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737520768 00000100:00100000:3.0:1746129571.570702:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129571.570702:0:8411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16214 00000100:00100000:2.0:1746129571.570706:0:8411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+25:3301:x1830948737520640:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129571.570711:0:3302:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1746129571.570716:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e388a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737520896:0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746129571.570721:0:8410:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746129571.570723:0:8410:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb mtime from disk: 1746129571 -> 1746129571 00002000:00010000:0.0:1746129571.570725:0:8410:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb atime from disk: 1746129570 -> 1746129570 00002000:00010000:0.0:1746129571.570726:0:8410:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb ctime from disk: 1746129570 -> 1746129570 00000100:00100000:3.0:1746129571.570728:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:0.0:1746129571.570728:0:8410:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb blocks from disk: 2077 -> 2077 00000100:00100000:3.0:1746129571.570735:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e388000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737521408:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129571.570748:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129571.570752:0:8410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+30:3301:x1830948737519616:12345-0@lo:2:osp-syn-0-0.0 Request processed in 96us (387us total) trans 21474841359 rc 0/0 00000100:00100000:0.0:1746129571.570758:0:8410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16213 00000100:00100000:0.0:1746129571.570766:0:8410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737521280 00000100:00100000:0.0:1746129571.570768:0:8410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737521280 00000100:00100000:0.0:1746129571.570776:0:8410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737520896 00000100:00100000:0.0:1746129571.570777:0:8410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737520896 00000100:00100000:0.0:1746129571.570783:0:8410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737521408 00000100:00100000:0.0:1746129571.570785:0:8410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737521408 00000100:00100000:0.0:1746129571.570791:0:8410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16215 00000100:00100000:0.0:1746129571.570795:0:8410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+29:3301:x1830948737521152:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746129571.570797:0:8411:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746129571.570799:0:8411:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb mtime from disk: 1746129571 -> 1746129571 00002000:00010000:2.0:1746129571.570801:0:8411:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb atime from disk: 1746129570 -> 1746129570 00002000:00010000:2.0:1746129571.570802:0:8411:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb ctime from disk: 1746129571 -> 1746129571 00002000:00010000:2.0:1746129571.570804:0:8411:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:2.0:1746129571.570822:0:8411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+29:3301:x1830948737520640:12345-0@lo:2:osp-syn-1-0.0 Request processed in 116us (388us total) trans 17179874111 rc 0/0 00000100:00100000:2.0:1746129571.570827:0:8411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16214 00000100:00100000:2.0:1746129571.570837:0:8411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16216 00000100:00100000:2.0:1746129571.570841:0:8411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+29:3301:x1830948737520512:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129571.570866:0:8410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+29:3301:x1830948737521152:12345-0@lo:2:osp-syn-1-0.0 Request processed in 70us (310us total) trans 17179874112 rc 0/0 00000100:00100000:0.0:1746129571.570870:0:8410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16215 00000100:00100000:0.0:1746129571.570879:0:8410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16217 00000100:00100000:0.0:1746129571.570883:0:8410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+28:3301:x1830948737521024:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746129571.570903:0:8411:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746129571.570906:0:8411:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb mtime from disk: 1746129571 -> 1746129571 00002000:00010000:2.0:1746129571.570907:0:8411:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb atime from disk: 1746129571 -> 1746129571 00002000:00010000:2.0:1746129571.570909:0:8411:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb ctime from disk: 1746129571 -> 1746129571 00002000:00010000:2.0:1746129571.570911:0:8411:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:2.0:1746129571.570928:0:8411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+29:3301:x1830948737520512:12345-0@lo:2:osp-syn-1-0.0 Request processed in 86us (338us total) trans 17179874113 rc 0/0 00000100:00100000:3.0:1746129571.570932:0:31503:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16218 00000100:00100000:3.0:1746129571.570945:0:31503:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+29:3302:x1830948737519744:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129571.571009:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c078380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+30:3300:x1830948737520000:12345-0@lo:2:osp-syn-0-0.0 Request processed in 571us (1091us total) trans 21474841360 rc 0/0 00002000:00010000:3.0:1746129571.571119:0:31503:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb size from disk: 5146336 -> 5146336 00002000:00010000:3.0:1746129571.571123:0:31503:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb mtime from disk: 1746129571 -> 1746129571 00002000:00010000:3.0:1746129571.571124:0:31503:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb atime from disk: 1746129571 -> 1746129571 00002000:00010000:3.0:1746129571.571126:0:31503:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb ctime from disk: 1746129571 -> 1746129571 00002000:00010000:3.0:1746129571.571127:0:31503:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb blocks from disk: 6033 -> 6033 00000100:00100000:0.0:1746129571.571136:0:8410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+30:3301:x1830948737521024:12345-0@lo:2:osp-syn-1-0.0 Request processed in 252us (529us total) trans 17179874114 rc 0/0 00000100:00100000:3.0:1746129571.571156:0:31503:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+31:3302:x1830948737519744:12345-0@lo:2:osp-syn-0-0.0 Request processed in 217us (517us total) trans 21474841361 rc 0/0 00000100:00100000:2.0:1746129571.571411:0:8411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16216 00000100:00100000:2.0:1746129571.571422:0:8411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16219 00000100:00100000:2.0:1746129571.571427:0:8411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+31:3302:x1830948737520256:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746129571.571484:0:8411:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746129571.571487:0:8411:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1746129571.571488:0:8411:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746129571.571491:0:8411:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1746129571.571492:0:8411:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1746129571.571509:0:8411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+32:3302:x1830948737520256:12345-0@lo:2:osp-syn-0-0.0 Request processed in 83us (846us total) trans 21474841362 rc 0/0 00000100:00100000:2.0:1746129571.571514:0:8411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16219 00000100:00100000:2.0:1746129571.571521:0:8411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16220 00000100:00100000:2.0:1746129571.571525:0:8411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+29:3302:x1830948737520768:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746129571.571578:0:8411:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3f5:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746129571.571581:0:8411:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f5:0x0] updating lvb mtime from disk: 1746129571 -> 1746129571 00002000:00010000:2.0:1746129571.571582:0:8411:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f5:0x0] updating lvb atime from disk: 1746129571 -> 1746129571 00002000:00010000:2.0:1746129571.571584:0:8411:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f5:0x0] updating lvb ctime from disk: 1746129571 -> 1746129571 00002000:00010000:2.0:1746129571.571586:0:8411:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f5:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:2.0:1746129571.571599:0:8411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+30:3302:x1830948737520768:12345-0@lo:2:osp-syn-1-0.0 Request processed in 74us (913us total) trans 17179874115 rc 0/0 00000100:00100000:2.0:1746129571.571603:0:8411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16220 00000100:00100000:2.0:1746129571.571610:0:8411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16221 00000100:00100000:2.0:1746129571.571613:0:8411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+29:3302:x1830948737521280:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129571.571669:0:8411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+30:3302:x1830948737521280:12345-0@lo:2:osp-syn-1-0.0 Request processed in 56us (966us total) trans 17179874116 rc 0/0 00000100:00100000:2.0:1746129571.571673:0:8411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16221 00000100:00100000:2.0:1746129571.571681:0:8411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16222 00000100:00100000:2.0:1746129571.571684:0:8411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+29:3302:x1830948737520896:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746129571.571735:0:8411:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746129571.571737:0:8411:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb mtime from disk: 1746129523 -> 1746129523 00002000:00010000:2.0:1746129571.571738:0:8411:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb atime from disk: 1746129523 -> 1746129523 00002000:00010000:2.0:1746129571.571740:0:8411:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb ctime from disk: 1746129524 -> 1746129524 00002000:00010000:2.0:1746129571.571742:0:8411:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1746129571.571758:0:8411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+30:3302:x1830948737520896:12345-0@lo:2:osp-syn-1-0.0 Request processed in 74us (1029us total) trans 17179874117 rc 0/0 00000100:00100000:2.0:1746129571.571763:0:8411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16222 00000100:00100000:2.0:1746129571.571771:0:8411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16223 00000100:00100000:2.0:1746129571.571774:0:8411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+29:3302:x1830948737521408:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129571.571839:0:8411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+30:3302:x1830948737521408:12345-0@lo:2:osp-syn-1-0.0 Request processed in 64us (1089us total) trans 17179874118 rc 0/0 00000100:00100000:2.0:1746129571.571844:0:8411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16223 00000100:00100000:2.0:1746129571.571870:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1746129571.571906:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009402a680/2, rc 0, transno 21474841357 00000100:00100000:2.0:1746129571.571914:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009402a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1830948737519872:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129571.571927:0:11014:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737520384 00000100:00100000:2.0:1746129571.571930:0:11014:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737520384 00000100:00100000:2.0:1746129571.571945:0:11014:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16224 00000100:00100000:2.0:1746129571.571949:0:11014:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f959500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+32:3303:x1830948737520384:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129571.572026:0:11014:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f959500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+33:3303:x1830948737520384:12345-0@lo:2:osp-syn-0-0.0 Request processed in 76us (155us total) trans 21474841363 rc 0/0 00000100:00100000:2.0:1746129571.572031:0:11014:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16224 00000004:00080000:2.0:1746129571.572048:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009402bb80/2, rc 0, transno 21474841363 00000100:00100000:2.0:1746129571.572051:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009402bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1830948737520384:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129571.572122:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16211 00000100:00100000:1.0:1746129571.572421:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f95b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737521536:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129571.572445:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1746129571.572463:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094028a80/2, rc 0, transno 21474841358 00000100:00100000:1.0:1746129571.572467:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094028a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737520128:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746129571.572473:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009402ad80/2, rc 0, transno 21474841360 00000100:00100000:1.0:1746129571.572476:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009402ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737520000:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746129571.572484:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094028700/2, rc 0, transno 21474841356 00000100:00100000:1.0:1746129571.572486:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094028700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737519488:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129571.572499:0:20577:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737521536 00000100:00100000:1.0:1746129571.572502:0:20577:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737521536 00000100:00100000:1.0:1746129571.572519:0:20577:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16225 00000100:00100000:1.0:1746129571.572523:0:20577:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e388380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+32:3300:x1830948737521536:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129571.572599:0:20577:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e388380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+33:3300:x1830948737521536:12345-0@lo:2:osp-syn-0-0.0 Request processed in 76us (154us total) trans 21474841364 rc 0/0 00000100:00100000:1.0:1746129571.572604:0:20577:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16225 00000004:00080000:1.0:1746129571.572620:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f95b480/2, rc 0, transno 21474841364 00000100:00100000:1.0:1746129571.572623:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f95b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737521536:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746129571.572733:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e38aa00/2, rc 0, transno 17179874113 00000100:00100000:2.0:1746129571.572737:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e38aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737520512:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746129571.572745:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e389500/2, rc 0, transno 17179874114 00000100:00100000:2.0:1746129571.572748:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e389500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737521024:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746129571.572755:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e38b100/2, rc 0, transno 17179874111 00000100:00100000:2.0:1746129571.572758:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e38b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737520640:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746129571.572765:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e38a680/2, rc 0, transno 17179874112 00000100:00100000:2.0:1746129571.572768:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e38a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737521152:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746129571.572776:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094029f80/2, rc 0, transno 21474841359 00000100:00100000:2.0:1746129571.572778:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094029f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737519616:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129571.573454:0:8410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16217 00000100:00100000:3.0:1746129571.573510:0:31503:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16218 00000100:00100000:1.0:1746129571.573564:0:16908:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e388e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16908:1830948737519232:192.168.202.4@tcp:105: 00000004:00080000:3.0:1746129571.573586:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e388a80/2, rc 0, transno 17179874117 00000100:00100000:3.0:1746129571.573593:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e388a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737520896:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746129571.573602:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e388000/2, rc 0, transno 17179874118 00000100:00100000:3.0:1746129571.573605:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e388000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737521408:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746129571.573617:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094029880/2, rc 0, transno 21474841361 00000100:00100000:3.0:1746129571.573620:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094029880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737519744:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746129571.573628:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094029500/2, rc 0, transno 21474841362 00000100:00100000:3.0:1746129571.573630:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094029500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737520256:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746129571.573636:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e389180/2, rc 0, transno 17179874115 00000100:00100000:3.0:1746129571.573639:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e389180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737520768:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746129571.573645:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e38b480/2, rc 0, transno 17179874116 00000100:00100000:3.0:1746129571.573647:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e38b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737521280:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129571.573667:0:16908:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e389c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16908:1830948737519360:192.168.202.4@tcp:105: 00010000:00010000:1.0:1746129571.573705:0:16908:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ebb2200/0x40a459093b069f4e lrc: 0/0,0 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2112e expref: 290 pid: 16908 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1746129571.573723:0:16908:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ebb3600/0x40a459093b069f55 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2112e expref: 289 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129571.573758:0:16908:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ebb3600, rc 0) 00000100:00100000:1.0:1746129571.573812:0:16908:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013145f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ada2ffba-8920-4ecb-8068-68caa9806978+289:32313:x1830948734136192:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 99913us (100707us total) trans 8589945312 rc 0/0 00000100:00100000:1.0:1746129571.573819:0:16908:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11220 00000100:00100000:0.0:1746129571.574190:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129571.574227:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129571.574461:0:20861:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734137088 00000100:00100000:1.0:1746129571.574466:0:20861:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734137088 00000100:00100000:1.0:1746129571.574494:0:20861:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734137216 00000100:00100000:1.0:1746129571.574496:0:20861:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734137216 00000100:00100000:1.0:1746129571.574524:0:20861:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4758 00000100:00100000:1.0:1746129571.574530:0:20861:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c07ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:068dab75-d300-4ead-a742-d14572ad1e50+7:32306:x1830948734137088:12345-192.168.202.4@tcp:49:lfs.0 00000100:00100000:0.0:1746129571.574541:0:16680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4759 00000100:00100000:0.0:1746129571.574547:0:16680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c07b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+8:32310:x1830948734137216:12345-192.168.202.4@tcp:49:multiop.0 00000100:00100000:0.0:1746129571.575188:0:16680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c07b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+8:32310:x1830948734137216:12345-192.168.202.4@tcp:49:multiop.0 Request processed in 639us (959us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129571.575194:0:16680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4759 00000100:00100000:1.0:1746129571.575233:0:20861:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c07ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:068dab75-d300-4ead-a742-d14572ad1e50+7:32306:x1830948734137088:12345-192.168.202.4@tcp:49:lfs.0 Request processed in 703us (1044us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129571.575239:0:20861:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4758 00000100:00100000:0.0:1746129571.578544:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129571.578674:0:16908:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734137344 00000100:00100000:1.0:1746129571.578684:0:16908:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734137344 00000100:00100000:1.0:1746129571.578733:0:16908:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11224 00000100:00100000:1.0:1746129571.578740:0:16908:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c07bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+8:32317:x1830948734137344:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129571.578762:0:16908:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129571.578780:0:16908:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4020000/0x40a459093b069f8d lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2114a expref: -99 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129571.578864:0:16908:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4020e00/0x40a459093b069f94 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129571.578877:0:16908:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4020e00/0x40a459093b069f94 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129571.578891:0:16908:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4020e00/0x40a459093b069f94 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00000004:00200000:1.0:1746129571.578916:0:16908:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00000004:00200000:1.0:1746129571.578919:0:16908:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746129571.578934:0:16908:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4020e00/0x40a459093b069f94 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129571.578954:0:16908:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4020000/0x40a459093b069f8d lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2114a expref: 10 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129571.578970:0:16908:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4020e00/0x40a459093b069f94 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2114a expref: 9 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129571.578977:0:16908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:1.0:1746129571.578980:0:16908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746129571.578984:0:16908:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4020e00, rc 0) 00000100:00100000:1.0:1746129571.579039:0:16908:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c07bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+9:32317:x1830948734137344:12345-192.168.202.4@tcp:101:cat.0 Request processed in 299us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129571.579045:0:16908:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11224 00000100:00100000:0.0:1746129571.579468:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129571.580552:0:22481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734137472 00000100:00100000:3.0:1746129571.580560:0:22481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734137472 00000100:00100000:3.0:1746129571.580866:0:22481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16226 00000100:00100000:3.0:1746129571.580875:0:22481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c078a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+13:32310:x1830948734137472:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:3.0:1746129571.580889:0:22481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129571.580904:0:22481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c63fc00/0x40a459093b069f9b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21151 expref: -99 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.580931:0:22481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c172200/0x40a459093b069e21 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2108d expref: 23 pid: 31503 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129571.580940:0:22481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f445000/0x40a459093b069e9f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f210fd expref: 7 pid: 8411 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129571.580948:0:22481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f9c4c00/0x40a459093b069e2f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2109b expref: 14 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.580961:0:22481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129571.580963:0:22481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129571.580967:0:22481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c63fc00/0x40a459093b069f9b lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [3522560->3997695] (req 3522560->3997695) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21151 expref: 14 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.580998:0:22481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f9c4c00/0x40a459093b069e2f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2109b expref: 14 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.581010:0:22481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f9c4c00/0x40a459093b069e2f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2109b expref: 14 pid: 11014 timeout: 926 lvb_type: 0 00000100:00100000:3.0:1746129571.581025:0:22481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900f4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:22481:1830948737521664:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129571.581123:0:22481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f445000/0x40a459093b069e9f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f210fd expref: 7 pid: 8411 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129571.581132:0:22481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f445000/0x40a459093b069e9f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f210fd expref: 7 pid: 8411 timeout: 926 lvb_type: 1 00000100:00100000:3.0:1746129571.581140:0:22481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900f6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:22481:1830948737521792:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129571.581164:0:22481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c172200/0x40a459093b069e21 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2108d expref: 23 pid: 31503 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129571.581173:0:22481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c172200/0x40a459093b069e21 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2108d expref: 23 pid: 31503 timeout: 926 lvb_type: 1 00000100:00100000:3.0:1746129571.581187:0:22481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900f7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:22481:1830948737521920:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129571.581205:0:22481:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5ac93c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129571.583972:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129571.584645:0:31503:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734137600 00000100:00100000:2.0:1746129571.584655:0:31503:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734137600 00000100:00100000:2.0:1746129571.584708:0:31503:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16227 00000100:00100000:2.0:1746129571.584716:0:31503:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c079c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ada2ffba-8920-4ecb-8068-68caa9806978+24:32313:x1830948734137600:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:2.0:1746129571.584734:0:31503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129571.584751:0:31503:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009efb3000/0x40a459093b069fa2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21158 expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129571.584781:0:31503:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129571.584784:0:31503:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129571.584788:0:31503:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009efb3000/0x40a459093b069fa2 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [2748416->3080191] (req 2748416->3080191) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21158 expref: 25 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129571.584799:0:31503:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009efb3000/0x40a459093b069fa2 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [2748416->3080191] (req 2748416->3080191) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21158 expref: 25 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129571.584809:0:31503:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009efb3000, rc 0) 00000100:00100000:2.0:1746129571.584855:0:31503:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c079c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ada2ffba-8920-4ecb-8068-68caa9806978+25:32313:x1830948734137600:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 139us (893us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129571.584864:0:31503:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16227 00000100:00100000:0.0:1746129571.586870:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129571.586903:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129571.586935:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129571.586966:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129571.587055:0:22480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734137728 00000100:00100000:1.0:1746129571.587065:0:22480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734137728 00000100:00100000:1.0:1746129571.587114:0:22480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16228 00000100:00100000:1.0:1746129571.587121:0:22480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c078700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:068dab75-d300-4ead-a742-d14572ad1e50+8:32306:x1830948734137728:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:1.0:1746129571.587140:0:22480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129571.587158:0:22480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b4021600/0x40a459093b069fa9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2115f expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129571.587191:0:22480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090079800/0x40a459093b069e05 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21071 expref: 24 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129571.587199:0:22480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f445200/0x40a459093b069e83 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f210e1 expref: 9 pid: 8411 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129571.587205:0:22480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ba30600/0x40a459093b069e75 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f210be expref: 14 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129571.587211:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129571.587212:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129571.587215:0:22480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4021600/0x40a459093b069fa9 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2115f expref: 9 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129571.587246:0:22480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012ba30600/0x40a459093b069e75 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f210be expref: 14 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129571.587257:0:22480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012ba30600/0x40a459093b069e75 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f210be expref: 14 pid: 7149 timeout: 926 lvb_type: 1 00000100:00100000:1.0:1746129571.587269:0:22480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e389c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22480:1830948737522048:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129571.587390:0:22480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f445200/0x40a459093b069e83 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f210e1 expref: 9 pid: 8411 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129571.587398:0:22480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f445200/0x40a459093b069e83 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f210e1 expref: 9 pid: 8411 timeout: 926 lvb_type: 1 00000100:00100000:1.0:1746129571.587411:0:22480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e388e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22480:1830948737522176:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129571.587435:0:22480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090079800/0x40a459093b069e05 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21071 expref: 24 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129571.587443:0:22480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090079800/0x40a459093b069e05 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21071 expref: 24 pid: 8412 timeout: 926 lvb_type: 1 00000100:00100000:1.0:1746129571.587450:0:22480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e389880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22480:1830948737522304:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129571.587469:0:22480:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934d2f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746129571.587541:0:7086:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734137856 00000100:00100000:3.0:1746129571.587546:0:7086:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734137856 00010000:00010000:3.0:1746129571.587566:0:7086:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f9c4c00/0x40a459093b069e2f lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2109b expref: 15 pid: 11014 timeout: 926 lvb_type: 0 00000100:00100000:3.0:1746129571.587583:0:7086:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734138112 00000100:00100000:3.0:1746129571.587585:0:7086:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734138112 00010000:00010000:3.0:1746129571.587593:0:7086:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c172200/0x40a459093b069e21 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2108d expref: 25 pid: 31503 timeout: 926 lvb_type: 1 00000100:00100000:3.0:1746129571.587605:0:7086:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734137984 00000100:00100000:3.0:1746129571.587607:0:7086:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734137984 00010000:00010000:3.0:1746129571.587614:0:7086:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f445000/0x40a459093b069e9f lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f210fd expref: 10 pid: 8411 timeout: 926 lvb_type: 1 00000100:00100000:3.0:1746129571.587625:0:7086:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8305 00000100:00100000:3.0:1746129571.587629:0:7086:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c07aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+15:1963:x1830948734137856:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129571.587638:0:7086:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129571.587660:0:7086:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f9c4c00/0x40a459093b069e2f lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2109b expref: 15 pid: 11014 timeout: 926 lvb_type: 0 00010000:00010000:3.0:1746129571.587669:0:7086:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f9c4c00/0x40a459093b069e2f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2109b expref: 15 pid: 11014 timeout: 926 lvb_type: 0 00010000:00010000:3.0:1746129571.587691:0:7086:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129571.587710:0:7086:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c07aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+15:1963:x1830948734137856:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 80us (806us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129571.587717:0:7086:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8305 00000100:00100000:3.0:1746129571.587731:0:7086:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8306 00000100:00100000:3.0:1746129571.587736:0:7086:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c079880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ada2ffba-8920-4ecb-8068-68caa9806978+25:1963:x1830948734138112:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129571.587742:0:7086:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129571.587749:0:7086:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c172200/0x40a459093b069e21 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2108d expref: 25 pid: 31503 timeout: 926 lvb_type: 1 00010000:00010000:3.0:1746129571.587756:0:7086:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c172200/0x40a459093b069e21 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2108d expref: 25 pid: 31503 timeout: 926 lvb_type: 1 00010000:00010000:3.0:1746129571.587766:0:7086:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129571.587779:0:7086:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c079880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ada2ffba-8920-4ecb-8068-68caa9806978+25:1963:x1830948734138112:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 43us (845us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129571.587783:0:7086:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8306 00000100:00100000:3.0:1746129571.587793:0:7086:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8307 00000100:00100000:3.0:1746129571.587797:0:7086:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c07a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:068dab75-d300-4ead-a742-d14572ad1e50+10:1962:x1830948734137984:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129571.587802:0:7086:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129571.587808:0:7086:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f445000/0x40a459093b069e9f lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f210fd expref: 10 pid: 8411 timeout: 926 lvb_type: 1 00010000:00010000:3.0:1746129571.587815:0:7086:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f445000/0x40a459093b069e9f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f210fd expref: 10 pid: 8411 timeout: 926 lvb_type: 1 00010000:00010000:3.0:1746129571.587824:0:7086:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129571.587825:0:7086:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129571.587831:0:7086:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c63fc00/0x40a459093b069f9b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 7 type: EXT [3080192->18446744073709551615] (req 3522560->3997695) gid 0 flags: 0x50080000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21151 expref: 14 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.587838:0:7086:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c63fc00/0x40a459093b069f9b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 7 type: EXT [3080192->18446744073709551615] (req 3522560->3997695) gid 0 flags: 0x50080000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21151 expref: 14 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.587844:0:7086:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129571.587845:0:7086:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129571.587849:0:7086:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009efb3000/0x40a459093b069fa2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 7 type: EXT [2748416->3080191] (req 2748416->3080191) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21158 expref: 24 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.587854:0:7086:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009efb3000/0x40a459093b069fa2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 7 type: EXT [2748416->3080191] (req 2748416->3080191) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21158 expref: 24 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.587873:0:7086:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009efb3000/0x40a459093b069fa2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 7 type: EXT [2748416->3080191] (req 2748416->3080191) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21158 expref: 24 pid: 31503 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129571.587879:0:7086:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900f4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7086:1830948737522432:192.168.202.4@tcp:105: 00010000:00010000:3.0:1746129571.587902:0:7086:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009c63fc00/0x40a459093b069f9b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 7 type: EXT [3080192->18446744073709551615] (req 3522560->3997695) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21151 expref: 14 pid: 22481 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129571.587909:0:7086:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013145ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7086:1830948737522560:192.168.202.4@tcp:105: 00000100:00100000:3.0:1746129571.587921:0:7086:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5ac9c00 going to sleep for 11 seconds 00010000:00010000:3.0:1746129571.587957:0:22481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f9c4c00/0x40a459093b069e2f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2109b expref: 14 pid: 11014 timeout: 926 lvb_type: 0 00000100:00100000:3.0:1746129571.587969:0:22481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900f4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:22481:1830948737521664:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129571.587979:0:22481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f445000/0x40a459093b069e9f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f210fd expref: 10 pid: 8411 timeout: 926 lvb_type: 1 00000100:00100000:3.0:1746129571.587987:0:22481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900f6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:22481:1830948737521792:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129571.588000:0:22481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c172200/0x40a459093b069e21 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2108d expref: 24 pid: 31503 timeout: 926 lvb_type: 1 00000100:00100000:3.0:1746129571.588008:0:22481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900f7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:22481:1830948737521920:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129571.588040:0:22481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c63fc00/0x40a459093b069f9b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [3080192->18446744073709551615] (req 3522560->3997695) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21151 expref: 13 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.588048:0:22481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c63fc00, rc 0) 00000100:00100000:3.0:1746129571.588065:0:22481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c078a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+13:32310:x1830948734137472:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 7192us (8598us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129571.588071:0:22481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16226 00000100:00100000:0.0:1746129571.588220:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129571.588407:0:31503:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734138240 00000100:00100000:0.0:1746129571.588411:0:31503:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734138240 00000100:00100000:0.0:1746129571.588432:0:31503:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16229 00000100:00100000:0.0:1746129571.588436:0:31503:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f37c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+13:1962:x1830948734138240:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129571.588444:0:31503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129571.588451:0:31503:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e0ba800/0x40a459093b069fb0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21166 expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129571.588479:0:31503:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f37d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:31503:1830948737522688:192.168.202.4@tcp:106: 00000100:00100000:0.0:1746129571.589168:0:31503:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e29fcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746129571.592569:0:22480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e389c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22480:1830948737522048:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129571.592583:0:22480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e388e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22480:1830948737522176:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129571.592590:0:22480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e389880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22480:1830948737522304:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129571.592627:0:22480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b4021600/0x40a459093b069fa9 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2115f expref: 9 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129571.592646:0:22480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4021600, rc 0) 00000100:00100000:2.0:1746129571.592710:0:22480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c078700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:068dab75-d300-4ead-a742-d14572ad1e50+9:32306:x1830948734137728:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 5588us (5849us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129571.592718:0:22480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16228 00000100:00100000:0.0:1746129571.593587:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129571.593804:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129571.593846:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129571.594266:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734138496 00000100:00100000:2.0:1746129571.594266:0:20578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734138368 00000100:00100000:3.0:1746129571.594273:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734138496 00000100:00100000:2.0:1746129571.594273:0:20578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734138368 00010000:00010000:3.0:1746129571.594335:0:7087:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012ba30600/0x40a459093b069e75 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f210be expref: 15 pid: 7149 timeout: 926 lvb_type: 1 00000100:00100000:0.0:1746129571.594349:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734138624 00000100:00100000:0.0:1746129571.594351:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734138624 00000100:00100000:3.0:1746129571.594361:0:7087:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8308 00010000:00010000:0.0:1746129571.594364:0:9823:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090079800/0x40a459093b069e05 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21071 expref: 24 pid: 8412 timeout: 926 lvb_type: 1 00000100:00100000:3.0:1746129571.594369:0:7087:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f37e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+15:1962:x1830948734138496:12345-192.168.202.4@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746129571.594379:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8309 00000100:00100000:0.0:1746129571.594383:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f37f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ada2ffba-8920-4ecb-8068-68caa9806978+24:1962:x1830948734138624:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129571.594385:0:7087:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129571.594388:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129571.594406:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090079800/0x40a459093b069e05 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21071 expref: 24 pid: 8412 timeout: 926 lvb_type: 1 00010000:00010000:3.0:1746129571.594407:0:7087:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012ba30600/0x40a459093b069e75 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f210be expref: 15 pid: 7149 timeout: 926 lvb_type: 1 00010000:00010000:0.0:1746129571.594416:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090079800/0x40a459093b069e05 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21071 expref: 24 pid: 8412 timeout: 926 lvb_type: 1 00010000:00010000:3.0:1746129571.594422:0:7087:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012ba30600/0x40a459093b069e75 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f210be expref: 15 pid: 7149 timeout: 926 lvb_type: 1 00010000:00010000:0.0:1746129571.594449:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090079800/0x40a459093b069e05 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21071 expref: 24 pid: 8412 timeout: 926 lvb_type: 1 00010000:00010000:3.0:1746129571.594452:0:7087:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ba30600/0x40a459093b069e75 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f210be expref: 15 pid: 7149 timeout: 926 lvb_type: 1 00010000:00010000:3.0:1746129571.594462:0:7087:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746129571.594462:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129571.594501:0:7087:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f37e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+14:1962:x1830948734138496:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 133us (698us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129571.594502:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f37f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ada2ffba-8920-4ecb-8068-68caa9806978+23:1962:x1830948734138624:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 118us (654us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129571.594507:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8309 00000100:00100000:3.0:1746129571.594509:0:7087:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8308 00010000:00010000:2.0:1746129571.594831:0:20578:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f445200/0x40a459093b069e83 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f210e1 expref: 9 pid: 8411 timeout: 926 lvb_type: 1 00000100:00100000:2.0:1746129571.594858:0:20578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8310 00000100:00100000:2.0:1746129571.594866:0:20578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6ce0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:068dab75-d300-4ead-a742-d14572ad1e50+9:1963:x1830948734138368:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129571.594874:0:20578:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129571.594885:0:20578:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f445200/0x40a459093b069e83 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f210e1 expref: 9 pid: 8411 timeout: 926 lvb_type: 1 00010000:00010000:2.0:1746129571.594894:0:20578:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f445200/0x40a459093b069e83 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f210e1 expref: 9 pid: 8411 timeout: 926 lvb_type: 1 00010000:00010000:2.0:1746129571.594911:0:20578:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f445200/0x40a459093b069e83 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f210e1 expref: 9 pid: 8411 timeout: 926 lvb_type: 1 00010000:00010000:2.0:1746129571.594920:0:20578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129571.594922:0:20578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129571.594931:0:20578:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b4021600/0x40a459093b069fa9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2115f expref: 8 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129571.594939:0:20578:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4021600/0x40a459093b069fa9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2115f expref: 8 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129571.594973:0:20578:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800b4021600/0x40a459093b069fa9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2115f expref: 8 pid: 22480 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129571.594987:0:20578:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f95bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:20578:1830948737522816:192.168.202.4@tcp:105: 00000100:00100000:2.0:1746129571.595066:0:20578:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009af1ecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129571.596135:0:7086:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900f4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7086:1830948737522432:192.168.202.4@tcp:105: 00000100:00100000:3.0:1746129571.596234:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00002000:00010000:1.0:1746129571.596357:0:31503:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb atime: 1746129571 -> 1746129572 00002000:00010000:1.0:1746129571.596362:0:31503:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb ctime: 1746129571 -> 1746129572 00000100:00100000:1.0:1746129571.596377:0:31503:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f37d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:31503:1830948737522688:192.168.202.4@tcp:106: 00010000:00010000:1.0:1746129571.596404:0:31503:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008e0ba800/0x40a459093b069fb0 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21166 expref: 13 pid: 31503 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129571.596414:0:31503:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e0ba800/0x40a459093b069fb0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21166 expref: 13 pid: 31503 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129571.596427:0:31503:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e0ba800, rc 0) 00000100:00100000:1.0:1746129571.596462:0:31503:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f37c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+12:1962:x1830948734138240:12345-192.168.202.4@tcp:101:cat.0 Request processed in 8026us (8243us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129571.596470:0:31503:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16229 00000100:00100000:2.0:1746129571.596633:0:31523:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734139008 00000100:00100000:2.0:1746129571.596639:0:31523:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734139008 00002000:00100000:2.0:1746129571.596680:0:31523:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3ef:0x0] (3522560->3526655) req@ffff88013145f480 x1830948734139008/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:312/0 lens 488/0 e 0 to 0 dl 1746129582 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129571.596688:0:31523:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013145f480 with x1830948734139008 ext(3522560->3526655) 00002000:00010000:2.0:1746129571.596692:0:31523:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013145f480 00000100:00100000:2.0:1746129571.596707:0:31523:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7807 00000100:00100000:2.0:1746129571.596712:0:31523:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013145f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+12:1962:x1830948734139008:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:0.0:1746129571.596794:0:7086:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013145ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7086:1830948737522560:192.168.202.4@tcp:105: 00010000:00010000:0.0:1746129571.596815:0:7086:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129571.596838:0:7086:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c07a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:068dab75-d300-4ead-a742-d14572ad1e50+8:1962:x1830948734137984:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 9041us (9872us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129571.596849:0:7086:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8307 00000100:00100000:2.0:1746129571.596865:0:31523:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013145f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+12:1962:x1830948734139008:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 152us (630us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129571.596871:0:31523:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7807 00002000:00100000:2.0:1746129571.596876:0:31523:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3ef:0x0] (3522560->3526655) req@ffff88013145f480 x1830948734139008/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:312/0 lens 488/4536 e 0 to 0 dl 1746129582 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00000100:00100000:3.0:1746129571.596942:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129571.596997:0:31519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734139136 00000100:00100000:3.0:1746129571.597000:0:31519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734139136 00002000:00100000:3.0:1746129571.597015:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3ef:0x0] (2748416->2752511) req@ffff88013145d500 x1830948734139136/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:312/0 lens 488/0 e 0 to 0 dl 1746129582 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129571.597020:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013145d500 with x1830948734139136 ext(2748416->2752511) 00002000:00010000:3.0:1746129571.597023:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013145d500 00000100:00100000:3.0:1746129571.597036:0:31519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7808 00000100:00100000:3.0:1746129571.597040:0:31519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013145d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ada2ffba-8920-4ecb-8068-68caa9806978+23:1963:x1830948734139136:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:3.0:1746129571.597109:0:31519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013145d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ada2ffba-8920-4ecb-8068-68caa9806978+23:1963:x1830948734139136:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 67us (165us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129571.597118:0:31519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7808 00002000:00100000:3.0:1746129571.597123:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3ef:0x0] (2748416->2752511) req@ffff88013145d500 x1830948734139136/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:312/0 lens 488/4536 e 0 to 0 dl 1746129582 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129571.597129:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013145d500 with x1830948734139136 ext(2748416->2752511) 00002000:00010000:3.0:1746129571.597131:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013145d500 00002000:00100000:2.0:1746129571.597219:0:31523:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013145f480 with x1830948734139008 ext(3522560->3526655) 00002000:00010000:2.0:1746129571.597223:0:31523:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013145f480 00000100:00100000:2.0:1746129571.597747:0:20578:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f95bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:20578:1830948737522816:192.168.202.4@tcp:105: 00010000:00010000:2.0:1746129571.597760:0:20578:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129571.598036:0:20578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6ce0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:068dab75-d300-4ead-a742-d14572ad1e50+7:1963:x1830948734138368:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 3170us (4449us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129571.598043:0:20578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8310 00000100:00100000:0.0:1746129571.600446:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129571.600717:0:31503:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734139264 00000100:00100000:1.0:1746129571.600726:0:31503:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734139264 00000100:00100000:1.0:1746129571.600784:0:31503:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16230 00000100:00100000:1.0:1746129571.600792:0:31503:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f37fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:068dab75-d300-4ead-a742-d14572ad1e50+8:32306:x1830948734139264:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:1.0:1746129571.600811:0:31503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129571.600830:0:31503:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e94d000/0x40a459093b069fb7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2116d expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129571.600862:0:31503:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ba30a00/0x40a459093b069e67 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f210cc expref: 19 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129571.600870:0:31503:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880136b1d800/0x40a459093b069ec9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2110b expref: 29 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129571.600878:0:31503:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a6729600/0x40a459093b069e8a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f210e8 expref: 9 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129571.600884:0:31503:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129571.600886:0:31503:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129571.600889:0:31503:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e94d000/0x40a459093b069fb7 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2116d expref: 9 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129571.600921:0:31503:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a6729600/0x40a459093b069e8a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f210e8 expref: 9 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129571.600933:0:31503:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a6729600/0x40a459093b069e8a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f210e8 expref: 9 pid: 22481 timeout: 926 lvb_type: 1 00000100:00100000:1.0:1746129571.600945:0:31503:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e38b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:31503:1830948737522944:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129571.601041:0:31503:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880136b1d800/0x40a459093b069ec9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2110b expref: 29 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129571.601049:0:31503:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880136b1d800/0x40a459093b069ec9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2110b expref: 29 pid: 8412 timeout: 926 lvb_type: 1 00000100:00100000:1.0:1746129571.601056:0:31503:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e389880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:31503:1830948737523072:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129571.601079:0:31503:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012ba30a00/0x40a459093b069e67 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f210cc expref: 19 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129571.601086:0:31503:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012ba30a00/0x40a459093b069e67 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f210cc expref: 19 pid: 7149 timeout: 926 lvb_type: 1 00000100:00100000:1.0:1746129571.601092:0:31503:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e388e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:31503:1830948737523200:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129571.601106:0:31503:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934d2c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746129571.606237:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129571.606329:0:31503:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e38b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:31503:1830948737522944:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129571.606343:0:31503:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e389880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:31503:1830948737523072:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129571.606350:0:31503:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e388e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:31503:1830948737523200:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129571.606506:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129571.606936:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00010000:00010000:2.0:1746129571.607375:0:31503:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012e94d000/0x40a459093b069fb7 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2116d expref: 9 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129571.607396:0:31503:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e94d000, rc 0) 00000100:00100000:2.0:1746129571.607454:0:31503:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f37fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:068dab75-d300-4ead-a742-d14572ad1e50+9:32306:x1830948734139264:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 6661us (7015us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129571.607463:0:31503:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16230 00000100:00100000:3.0:1746129571.607594:0:20578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734139392 00000100:00100000:3.0:1746129571.607602:0:20578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734139392 00010000:00010000:3.0:1746129571.607633:0:20578:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6729600/0x40a459093b069e8a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f210e8 expref: 9 pid: 22481 timeout: 926 lvb_type: 1 00000100:00100000:3.0:1746129571.607655:0:20578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734139648 00000100:00100000:3.0:1746129571.607657:0:20578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734139648 00010000:00010000:3.0:1746129571.607666:0:20578:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012ba30a00/0x40a459093b069e67 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f210cc expref: 20 pid: 7149 timeout: 926 lvb_type: 1 00000100:00100000:3.0:1746129571.607679:0:20578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734139520 00000100:00100000:3.0:1746129571.607681:0:20578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734139520 00010000:00010000:3.0:1746129571.607690:0:20578:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880136b1d800/0x40a459093b069ec9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2110b expref: 30 pid: 8412 timeout: 926 lvb_type: 1 00000100:00100000:3.0:1746129571.607703:0:20578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8311 00000100:00100000:3.0:1746129571.607709:0:20578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e389c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:068dab75-d300-4ead-a742-d14572ad1e50+9:1960:x1830948734139392:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129571.607721:0:20578:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129571.607745:0:20578:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a6729600/0x40a459093b069e8a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f210e8 expref: 9 pid: 22481 timeout: 926 lvb_type: 1 00010000:00010000:3.0:1746129571.607761:0:20578:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a6729600/0x40a459093b069e8a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f210e8 expref: 9 pid: 22481 timeout: 926 lvb_type: 1 00010000:00010000:3.0:1746129571.607783:0:20578:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a6729600/0x40a459093b069e8a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f210e8 expref: 9 pid: 22481 timeout: 926 lvb_type: 1 00010000:00010000:3.0:1746129571.607794:0:20578:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129571.607811:0:20578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e389c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:068dab75-d300-4ead-a742-d14572ad1e50+8:1960:x1830948734139392:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 102us (1585us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129571.607816:0:20578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8311 00000100:00100000:3.0:1746129571.607827:0:20578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8312 00000100:00100000:3.0:1746129571.607831:0:20578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e389f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:1960:x1830948734139648:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129571.607838:0:20578:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129571.607845:0:20578:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012ba30a00/0x40a459093b069e67 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f210cc expref: 20 pid: 7149 timeout: 926 lvb_type: 1 00010000:00010000:3.0:1746129571.607853:0:20578:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012ba30a00/0x40a459093b069e67 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f210cc expref: 20 pid: 7149 timeout: 926 lvb_type: 1 00010000:00010000:3.0:1746129571.607864:0:20578:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ba30a00/0x40a459093b069e67 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f210cc expref: 20 pid: 7149 timeout: 926 lvb_type: 1 00010000:00010000:3.0:1746129571.607873:0:20578:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129571.607887:0:20578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e389f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+19:1960:x1830948734139648:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 55us (1381us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129571.607896:0:20578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8312 00000100:00100000:3.0:1746129571.607906:0:20578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8313 00000100:00100000:3.0:1746129571.607910:0:20578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e38bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ada2ffba-8920-4ecb-8068-68caa9806978+30:1960:x1830948734139520:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129571.607916:0:20578:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129571.607921:0:20578:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880136b1d800/0x40a459093b069ec9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2110b expref: 30 pid: 8412 timeout: 926 lvb_type: 1 00010000:00010000:3.0:1746129571.607930:0:20578:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880136b1d800/0x40a459093b069ec9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2110b expref: 30 pid: 8412 timeout: 926 lvb_type: 1 00010000:00010000:3.0:1746129571.607941:0:20578:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136b1d800/0x40a459093b069ec9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2110b expref: 30 pid: 8412 timeout: 926 lvb_type: 1 00010000:00010000:3.0:1746129571.607949:0:20578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129571.607951:0:20578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129571.607957:0:20578:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e94d000/0x40a459093b069fb7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2116d expref: 7 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.607964:0:20578:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e94d000/0x40a459093b069fb7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2116d expref: 7 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.607994:0:20578:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012e94d000/0x40a459093b069fb7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2116d expref: 7 pid: 31503 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129571.608006:0:20578:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013145fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:20578:1830948737523328:192.168.202.4@tcp:105: 00000100:00100000:3.0:1746129571.608051:0:20578:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5ac93c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746129571.608773:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129571.608814:0:31521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734139904 00000100:00100000:2.0:1746129571.608821:0:31521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734139904 00002000:00100000:2.0:1746129571.608885:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3ef:0x0] (3076096->3080191) req@ffff88012e38ad80 x1830948734139904/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:312/0 lens 488/0 e 0 to 0 dl 1746129582 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129571.608895:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e38ad80 with x1830948734139904 ext(3076096->3080191) 00002000:00010000:2.0:1746129571.608900:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e38ad80 00000100:00100000:2.0:1746129571.608956:0:31521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7809 00000100:00100000:2.0:1746129571.608962:0:31521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e38ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ada2ffba-8920-4ecb-8068-68caa9806978+23:1960:x1830948734139904:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:2.0:1746129571.609133:0:31521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e38ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ada2ffba-8920-4ecb-8068-68caa9806978+23:1960:x1830948734139904:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 171us (363us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129571.609139:0:31521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7809 00002000:00100000:2.0:1746129571.609145:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3ef:0x0] (3076096->3080191) req@ffff88012e38ad80 x1830948734139904/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:312/0 lens 488/4536 e 0 to 0 dl 1746129582 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129571.609152:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e38ad80 with x1830948734139904 ext(3076096->3080191) 00002000:00010000:2.0:1746129571.609155:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e38ad80 00000100:00100000:3.0:1746129571.610641:0:20578:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013145fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:20578:1830948737523328:192.168.202.4@tcp:105: 00010000:00010000:3.0:1746129571.610668:0:20578:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129571.611258:0:20578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e38bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ada2ffba-8920-4ecb-8068-68caa9806978+29:1960:x1830948734139520:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 3341us (4316us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129571.611269:0:20578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8313 00000100:00100000:0.0:1746129571.613289:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129571.613427:0:20861:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734140160 00000100:00100000:1.0:1746129571.613437:0:20861:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734140160 00000100:00100000:1.0:1746129571.613483:0:20861:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4760 00000100:00100000:1.0:1746129571.613490:0:20861:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095f15450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:ada2ffba-8920-4ecb-8068-68caa9806978+289:32313:x1830948734140160:12345-192.168.202.4@tcp:35:multiop.0 00000100:00100000:1.0:1746129571.614731:0:20861:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095f15450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:ada2ffba-8920-4ecb-8068-68caa9806978+290:32313:x1830948734140160:12345-192.168.202.4@tcp:35:multiop.0 Request processed in 1236us (1446us total) trans 8589945314 rc 0/0 00000100:00100000:1.0:1746129571.614744:0:20861:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4760 00000100:00100000:0.0:1746129571.615023:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129571.615576:0:31503:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734140288 00000100:00100000:3.0:1746129571.615583:0:31503:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734140288 00000100:00100000:3.0:1746129571.615626:0:31503:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16231 00000100:00100000:3.0:1746129571.615632:0:31503:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f37d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:068dab75-d300-4ead-a742-d14572ad1e50+8:32306:x1830948734140288:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:3.0:1746129571.615645:0:31503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129571.615663:0:31503:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b5384a00/0x40a459093b069fbe lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21174 expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.616280:0:31503:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c172e00/0x40a459093b069e13 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2107f expref: 28 pid: 31503 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129571.616289:0:31503:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880136b1c600/0x40a459093b069eb4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f210ef expref: 9 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129571.616323:0:31503:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ba31e00/0x40a459093b069e7c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f210d3 expref: 18 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129571.616330:0:31503:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129571.616332:0:31503:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129571.616335:0:31503:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b5384a00/0x40a459093b069fbe lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21174 expref: 9 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.616371:0:31503:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012ba31e00/0x40a459093b069e7c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f210d3 expref: 18 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129571.616384:0:31503:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012ba31e00/0x40a459093b069e7c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f210d3 expref: 18 pid: 7149 timeout: 926 lvb_type: 1 00000100:00100000:3.0:1746129571.616397:0:31503:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013145fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:31503:1830948737523456:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129571.616736:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129571.616797:0:31521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734140544 00000100:00100000:2.0:1746129571.616802:0:31521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734140544 00002000:00100000:2.0:1746129571.616835:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3ef:0x0] (3993600->3997695) req@ffff88012e388700 x1830948734140544/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:312/0 lens 488/0 e 0 to 0 dl 1746129582 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129571.616844:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e388700 with x1830948734140544 ext(3993600->3997695) 00002000:00010000:2.0:1746129571.616848:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e388700 00000100:00100000:2.0:1746129571.616869:0:31521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7810 00000100:00100000:2.0:1746129571.616874:0:31521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e388700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+12:1963:x1830948734140544:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:2.0:1746129571.617029:0:31521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e388700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+12:1963:x1830948734140544:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 155us (294us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129571.617036:0:31521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7810 00002000:00100000:2.0:1746129571.617042:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3ef:0x0] (3993600->3997695) req@ffff88012e388700 x1830948734140544/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:312/0 lens 488/4536 e 0 to 0 dl 1746129582 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129571.617049:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e388700 with x1830948734140544 ext(3993600->3997695) 00002000:00010000:2.0:1746129571.617051:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e388700 00010000:00010000:3.0:1746129571.617245:0:31503:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880136b1c600/0x40a459093b069eb4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f210ef expref: 9 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129571.617254:0:31503:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880136b1c600/0x40a459093b069eb4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f210ef expref: 9 pid: 8412 timeout: 926 lvb_type: 1 00000100:00100000:3.0:1746129571.617262:0:31503:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013145ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:31503:1830948737523584:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129571.617330:0:31503:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c172e00/0x40a459093b069e13 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2107f expref: 28 pid: 31503 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129571.617339:0:31503:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c172e00/0x40a459093b069e13 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2107f expref: 28 pid: 31503 timeout: 926 lvb_type: 1 00000100:00100000:3.0:1746129571.617347:0:31503:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013145e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:31503:1830948737523712:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129571.617371:0:31503:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5ac93c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129571.618135:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129571.618210:0:22480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734140672 00000100:00100000:2.0:1746129571.618216:0:22480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734140672 00000100:00100000:2.0:1746129571.618370:0:22480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16232 00000100:00100000:2.0:1746129571.618376:0:22480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f37d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+12:32317:x1830948734140672:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129571.618387:0:22480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129571.618402:0:22480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a6ef5e00/0x40a459093b069fc5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2117b expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129571.618429:0:22480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b4021600/0x40a459093b069fa9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2115f expref: 6 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129571.618437:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129571.618438:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129571.618441:0:22480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6ef5e00/0x40a459093b069fc5 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2117b expref: 13 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129571.618462:0:22480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b4021600/0x40a459093b069fa9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2115f expref: 6 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129571.618469:0:22480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b4021600/0x40a459093b069fa9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2115f expref: 6 pid: 22480 timeout: 926 lvb_type: 0 00000100:00100000:2.0:1746129571.618478:0:22480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f95bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22480:1830948737523840:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129571.618876:0:22480:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009af1e0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129571.622557:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129571.622700:0:20578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734140800 00000100:00100000:3.0:1746129571.622710:0:20578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734140800 00010000:00010000:3.0:1746129571.622748:0:20578:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012ba31e00/0x40a459093b069e7c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f210d3 expref: 19 pid: 7149 timeout: 926 lvb_type: 1 00000100:00100000:3.0:1746129571.622778:0:20578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8314 00000100:00100000:3.0:1746129571.622785:0:20578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094065500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+19:1962:x1830948734140800:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129571.622801:0:20578:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129571.622822:0:20578:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012ba31e00/0x40a459093b069e7c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f210d3 expref: 19 pid: 7149 timeout: 926 lvb_type: 1 00010000:00010000:3.0:1746129571.622834:0:20578:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012ba31e00/0x40a459093b069e7c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f210d3 expref: 19 pid: 7149 timeout: 926 lvb_type: 1 00010000:00010000:3.0:1746129571.622859:0:20578:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129571.623838:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129571.623920:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129571.624267:0:7086:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734140928 00000100:00100000:0.0:1746129571.624274:0:7086:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734140928 00010000:00010000:0.0:1746129571.624322:0:7086:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880136b1c600/0x40a459093b069eb4 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f210ef expref: 10 pid: 8412 timeout: 926 lvb_type: 1 00000100:00100000:0.0:1746129571.624345:0:7086:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734141056 00000100:00100000:0.0:1746129571.624347:0:7086:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734141056 00010000:00010000:0.0:1746129571.624358:0:7086:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c172e00/0x40a459093b069e13 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2107f expref: 29 pid: 31503 timeout: 926 lvb_type: 1 00000100:00100000:0.0:1746129571.624378:0:7086:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8315 00000100:00100000:0.0:1746129571.624384:0:7086:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a47c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:068dab75-d300-4ead-a742-d14572ad1e50+10:1962:x1830948734140928:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129571.624394:0:7086:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129571.624413:0:7086:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880136b1c600/0x40a459093b069eb4 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f210ef expref: 10 pid: 8412 timeout: 926 lvb_type: 1 00010000:00010000:0.0:1746129571.624423:0:7086:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880136b1c600/0x40a459093b069eb4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f210ef expref: 10 pid: 8412 timeout: 926 lvb_type: 1 00010000:00010000:0.0:1746129571.624439:0:7086:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129571.624477:0:7086:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a47c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:068dab75-d300-4ead-a742-d14572ad1e50+10:1962:x1830948734140928:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 93us (644us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129571.624485:0:7086:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8315 00000100:00100000:0.0:1746129571.624501:0:7086:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8316 00000100:00100000:0.0:1746129571.624505:0:7086:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e388e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ada2ffba-8920-4ecb-8068-68caa9806978+29:1963:x1830948734141056:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129571.624511:0:7086:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129571.624517:0:7086:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c172e00/0x40a459093b069e13 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2107f expref: 29 pid: 31503 timeout: 926 lvb_type: 1 00010000:00010000:0.0:1746129571.624524:0:7086:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c172e00/0x40a459093b069e13 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2107f expref: 29 pid: 31503 timeout: 926 lvb_type: 1 00010000:00010000:0.0:1746129571.624535:0:7086:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129571.624537:0:7086:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129571.624544:0:7086:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b5384a00/0x40a459093b069fbe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21174 expref: 9 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129571.624553:0:7086:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b5384a00/0x40a459093b069fbe lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21174 expref: 9 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129571.624584:0:7086:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800b5384a00/0x40a459093b069fbe lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21174 expref: 9 pid: 31503 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129571.624595:0:7086:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094065880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7086:1830948737523968:192.168.202.4@tcp:105: 00000100:00100000:0.0:1746129571.624647:0:7086:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e29f240 going to sleep for 11 seconds 00000100:00100000:2.0:1746129571.624749:0:22480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f95bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22480:1830948737523840:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129571.624773:0:22480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a6ef5e00/0x40a459093b069fc5 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2117b expref: 13 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129571.624784:0:22480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6ef5e00, rc 0) 00000100:00100000:2.0:1746129571.624805:0:22480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f37d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+13:32317:x1830948734140672:12345-192.168.202.4@tcp:101:cat.0 Request processed in 6430us (6674us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129571.624813:0:22480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16232 00010000:00010000:3.0:1746129571.624893:0:31503:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ba31e00/0x40a459093b069e7c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f210d3 expref: 19 pid: 7149 timeout: 926 lvb_type: 1 00000100:00100000:3.0:1746129571.624905:0:31503:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013145fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:31503:1830948737523456:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129571.624929:0:20578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094065500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+18:1962:x1830948734140800:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 2144us (2386us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129571.624935:0:20578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8314 00010000:00010000:3.0:1746129571.624978:0:31503:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136b1c600/0x40a459093b069eb4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f210ef expref: 9 pid: 8412 timeout: 926 lvb_type: 1 00000100:00100000:3.0:1746129571.624988:0:31503:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013145ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:31503:1830948737523584:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129571.624996:0:31503:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c172e00/0x40a459093b069e13 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2107f expref: 29 pid: 31503 timeout: 926 lvb_type: 1 00000100:00100000:3.0:1746129571.625009:0:31503:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013145e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:31503:1830948737523712:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129571.625035:0:31503:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b5384a00/0x40a459093b069fbe lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21174 expref: 8 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.625042:0:31503:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b5384a00, rc 0) 00000100:00100000:3.0:1746129571.625057:0:31503:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f37d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:068dab75-d300-4ead-a742-d14572ad1e50+8:32306:x1830948734140288:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 9426us (10034us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129571.625063:0:31503:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16231 00000100:00100000:1.0:1746129571.625322:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129571.625392:0:20861:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734141312 00000100:00100000:2.0:1746129571.625397:0:20861:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734141312 00000100:00100000:2.0:1746129571.625424:0:20861:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4761 00000100:00100000:2.0:1746129571.625430:0:20861:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e389880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+9:32310:x1830948734141312:12345-192.168.202.4@tcp:35:multiop.0 00000100:00100000:2.0:1746129571.625610:0:20861:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e389880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+10:32310:x1830948734141312:12345-192.168.202.4@tcp:35:multiop.0 Request processed in 180us (288us total) trans 8589945315 rc 0/0 00000100:00100000:2.0:1746129571.625616:0:20861:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4761 00000100:00100000:2.0:1746129571.632787:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129571.632899:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129571.632976:0:31503:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734141696 00000100:00100000:3.0:1746129571.632987:0:31503:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734141696 00000100:00100000:3.0:1746129571.633034:0:31503:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16233 00000100:00100000:3.0:1746129571.633041:0:31503:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f95aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:068dab75-d300-4ead-a742-d14572ad1e50+7:32306:x1830948734141696:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:3.0:1746129571.633061:0:31503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129571.633078:0:31503:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c22dc00/0x40a459093b069fcc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21189 expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.633107:0:31503:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c173a00/0x40a459093b069e1a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21086 expref: 22 pid: 31503 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129571.633115:0:31503:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a6729c00/0x40a459093b069e91 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f210f6 expref: 8 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129571.633121:0:31503:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ba31a00/0x40a459093b069e6e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f210da expref: 12 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129571.633132:0:31503:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129571.633134:0:31503:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129571.633137:0:31503:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c22dc00/0x40a459093b069fcc lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21189 expref: 8 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.633166:0:31503:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012ba31a00/0x40a459093b069e6e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f210da expref: 12 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129571.633177:0:31503:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012ba31a00/0x40a459093b069e6e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f210da expref: 12 pid: 7149 timeout: 926 lvb_type: 1 00000100:00100000:3.0:1746129571.633195:0:31503:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013145e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:31503:1830948737524096:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129571.633396:0:15096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734141568 00000100:00100000:0.0:1746129571.633400:0:15096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734141568 00010000:00010000:3.0:1746129571.633804:0:31503:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a6729c00/0x40a459093b069e91 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f210f6 expref: 8 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129571.633813:0:31503:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a6729c00/0x40a459093b069e91 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f210f6 expref: 8 pid: 22481 timeout: 926 lvb_type: 1 00000100:00100000:3.0:1746129571.633821:0:31503:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013145ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:31503:1830948737524224:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129571.633851:0:31503:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c173a00/0x40a459093b069e1a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21086 expref: 22 pid: 31503 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129571.633859:0:31503:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c173a00/0x40a459093b069e1a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21086 expref: 22 pid: 31503 timeout: 926 lvb_type: 1 00000100:00100000:3.0:1746129571.633870:0:31503:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013145fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:31503:1830948737524352:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129571.633886:0:31503:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5ac93c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129571.633973:0:15096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11225 00000100:00100000:0.0:1746129571.633981:0:15096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f95bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ada2ffba-8920-4ecb-8068-68caa9806978+290:32320:x1830948734141568:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129571.633995:0:15096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129571.634007:0:15096:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e0baa00/0x40a459093b069fd3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21182 expref: -99 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129571.634116:0:15096:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e0ba000/0x40a459093b069fda lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15096 initiator: MDT0 00010000:00010000:0.0:1746129571.634127:0:15096:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e0ba000/0x40a459093b069fda lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15096 initiator: MDT0 00010000:00010000:0.0:1746129571.634138:0:15096:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e0ba000/0x40a459093b069fda lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15096 initiator: MDT0 00010000:00010000:0.0:1746129571.634150:0:15096:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e0bb800/0x40a459093b069fe1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15096 initiator: MDT0 00010000:00010000:0.0:1746129571.634154:0:15096:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e0bb800/0x40a459093b069fe1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15096 initiator: MDT0 00010000:00010000:0.0:1746129571.634158:0:15096:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e0bb800/0x40a459093b069fe1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15096 initiator: MDT0 00010000:00010000:0.0:1746129571.634265:0:15096:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e0ba400/0x40a459093b069fe8 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15096 initiator: MDT0 00010000:00010000:0.0:1746129571.634272:0:15096:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e0ba400/0x40a459093b069fe8 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15096 initiator: MDT0 00010000:00010000:0.0:1746129571.634278:0:15096:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e0ba400/0x40a459093b069fe8 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15096 initiator: MDT0 00000004:00200000:0.0:1746129571.634286:0:15096:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:0.0:1746129571.634402:0:15096:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e0ba400/0x40a459093b069fe8 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15096 initiator: MDT0 00010000:00010000:0.0:1746129571.634409:0:15096:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e0ba400/0x40a459093b069fe8 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15096 initiator: MDT0 00010000:00010000:0.0:1746129571.634415:0:15096:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008e0ba400/0x40a459093b069fe8 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15096 initiator: MDT0 00010000:00010000:0.0:1746129571.634420:0:15096:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008e0ba400 already unused, calling callback (ffffffffa136e690) 00010000:00010000:0.0:1746129571.634424:0:15096:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e0ba400/0x40a459093b069fe8 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15096 initiator: MDT0 00010000:00010000:0.0:1746129571.634430:0:15096:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e0ba400/0x40a459093b069fe8 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15096 initiator: MDT0 00010000:00010000:0.0:1746129571.634442:0:15096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:0.0:1746129571.634445:0:15096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746129571.634448:0:15096:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008e0ba400/0x40a459093b069fe8 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15096 initiator: MDT0 00010000:00010000:0.0:1746129571.634453:0:15096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e0ba400/0x40a459093b069fe8 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15096 initiator: MDT0 00010000:00010000:0.0:1746129571.634479:0:15096:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e0ba000/0x40a459093b069fda lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15096 initiator: MDT0 00010000:00010000:0.0:1746129571.634483:0:15096:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e0ba000/0x40a459093b069fda lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15096 initiator: MDT0 00010000:00010000:0.0:1746129571.634487:0:15096:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008e0ba000/0x40a459093b069fda lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15096 initiator: MDT0 00010000:00010000:0.0:1746129571.634492:0:15096:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008e0ba000 already unused, calling callback (ffffffffa136e690) 00010000:00010000:0.0:1746129571.634494:0:15096:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e0ba000/0x40a459093b069fda lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15096 initiator: MDT0 00010000:00010000:0.0:1746129571.634502:0:15096:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e0ba000/0x40a459093b069fda lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15096 initiator: MDT0 00010000:00010000:0.0:1746129571.634508:0:15096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880132ef8f00) 00010000:00010000:0.0:1746129571.634509:0:15096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129571.634512:0:15096:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008e0ba000/0x40a459093b069fda lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15096 initiator: MDT0 00000100:00100000:1.0:1746129571.634922:0:7086:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094065880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7086:1830948737523968:192.168.202.4@tcp:105: 00010000:00010000:1.0:1746129571.634940:0:7086:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129571.634977:0:7086:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e388e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ada2ffba-8920-4ecb-8068-68caa9806978+28:1963:x1830948734141056:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 10471us (11056us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129571.634987:0:7086:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8316 00010000:00010000:0.0:1746129571.635291:0:15096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e0ba000/0x40a459093b069fda lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15096 initiator: MDT0 00010000:00010000:0.0:1746129571.635629:0:15096:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e0bb800/0x40a459093b069fe1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15096 initiator: MDT0 00010000:00010000:0.0:1746129571.635635:0:15096:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e0bb800/0x40a459093b069fe1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15096 initiator: MDT0 00010000:00010000:0.0:1746129571.635640:0:15096:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008e0bb800/0x40a459093b069fe1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15096 initiator: MDT0 00010000:00010000:0.0:1746129571.635645:0:15096:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008e0bb800 already unused, calling callback (ffffffffa136e690) 00010000:00010000:0.0:1746129571.635647:0:15096:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e0bb800/0x40a459093b069fe1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15096 initiator: MDT0 00010000:00010000:0.0:1746129571.635656:0:15096:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e0bb800/0x40a459093b069fe1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15096 initiator: MDT0 00010000:00010000:0.0:1746129571.635663:0:15096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880093d9d000) 00010000:00010000:0.0:1746129571.635665:0:15096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129571.635667:0:15096:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008e0bb800/0x40a459093b069fe1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15096 initiator: MDT0 00010000:00010000:0.0:1746129571.635672:0:15096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e0bb800/0x40a459093b069fe1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15096 initiator: MDT0 00010000:00010000:0.0:1746129571.635716:0:15096:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e0baa00/0x40a459093b069fd3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21182 expref: 292 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129571.635723:0:15096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e0baa00/0x40a459093b069fd3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21182 expref: 292 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129571.635731:0:15096:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e0baa00, rc 0) 00000100:00100000:0.0:1746129571.636501:0:15096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f95bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ada2ffba-8920-4ecb-8068-68caa9806978+291:32320:x1830948734141568:12345-192.168.202.4@tcp:101:cat.0 Request processed in 2518us (3722us total) trans 8589945316 rc 301/301 00000100:00100000:0.0:1746129571.636508:0:15096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11225 00000100:00100000:0.0:1746129571.639105:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129571.639250:0:31503:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013145e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:31503:1830948737524096:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129571.639263:0:31503:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013145ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:31503:1830948737524224:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129571.639271:0:31503:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013145fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:31503:1830948737524352:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129571.639403:0:31503:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c22dc00/0x40a459093b069fcc lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21189 expref: 8 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.639421:0:31503:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c22dc00, rc 0) 00000100:00100000:3.0:1746129571.639471:0:31503:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f95aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:068dab75-d300-4ead-a742-d14572ad1e50+8:32306:x1830948734141696:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 6429us (6570us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129571.639479:0:31503:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16233 00000100:00100000:0.0:1746129571.640177:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129571.640190:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129571.640759:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129571.640782:0:15096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734142208 00000100:00100000:0.0:1746129571.640790:0:15096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734142208 00000100:00100000:0.0:1746129571.640837:0:15096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11226 00000100:00100000:0.0:1746129571.640843:0:15096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094066680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ada2ffba-8920-4ecb-8068-68caa9806978+291:32320:x1830948734142208:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129571.640865:0:15096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129571.640884:0:15096:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e0ba600/0x40a459093b069ff6 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21190 expref: -99 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129571.640968:0:15096:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e0bae00/0x40a459093b069ffd lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15096 initiator: MDT0 00010000:00010000:0.0:1746129571.640980:0:15096:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e0bae00/0x40a459093b069ffd lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15096 initiator: MDT0 00010000:00010000:0.0:1746129571.640994:0:15096:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e0bae00/0x40a459093b069ffd lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15096 initiator: MDT0 00000004:00200000:0.0:1746129571.641020:0:15096:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00000004:00200000:0.0:1746129571.641024:0:15096:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746129571.641039:0:15096:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008e0bae00/0x40a459093b069ffd lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15096 initiator: MDT0 00010000:00010000:0.0:1746129571.641062:0:15096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e0ba600/0x40a459093b069ff6 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21190 expref: 293 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129571.641076:0:15096:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e0bae00/0x40a459093b069ffd lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21190 expref: 292 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129571.641083:0:15096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:0.0:1746129571.641085:0:15096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746129571.641089:0:15096:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e0bae00, rc 0) 00000100:00100000:0.0:1746129571.641121:0:15096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094066680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ada2ffba-8920-4ecb-8068-68caa9806978+292:32320:x1830948734142208:12345-192.168.202.4@tcp:101:cat.0 Request processed in 278us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129571.641127:0:15096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11226 00000100:00100000:3.0:1746129571.641535:0:20578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734141952 00000100:00100000:3.0:1746129571.641540:0:20578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734141952 00010000:00010000:3.0:1746129571.641561:0:20578:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6729c00/0x40a459093b069e91 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f210f6 expref: 8 pid: 22481 timeout: 926 lvb_type: 1 00000100:00100000:3.0:1746129571.641670:0:20578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734141824 00000100:00100000:3.0:1746129571.641673:0:20578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734141824 00010000:00010000:3.0:1746129571.641686:0:20578:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012ba31a00/0x40a459093b069e6e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f210da expref: 13 pid: 7149 timeout: 926 lvb_type: 1 00000100:00100000:3.0:1746129571.641704:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734142080 00000100:00100000:3.0:1746129571.641706:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734142080 00010000:00010000:3.0:1746129571.641715:0:9823:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c173a00/0x40a459093b069e1a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21086 expref: 23 pid: 31503 timeout: 926 lvb_type: 1 00000100:00100000:3.0:1746129571.641728:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8317 00000100:00100000:3.0:1746129571.641733:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094065f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:068dab75-d300-4ead-a742-d14572ad1e50+8:1960:x1830948734141952:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129571.641744:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129571.641764:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a6729c00/0x40a459093b069e91 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f210f6 expref: 8 pid: 22481 timeout: 926 lvb_type: 1 00010000:00010000:3.0:1746129571.641772:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a6729c00/0x40a459093b069e91 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f210f6 expref: 8 pid: 22481 timeout: 926 lvb_type: 1 00010000:00010000:3.0:1746129571.641787:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a6729c00/0x40a459093b069e91 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f210f6 expref: 8 pid: 22481 timeout: 926 lvb_type: 1 00010000:00010000:3.0:1746129571.641798:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129571.641820:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094065f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:068dab75-d300-4ead-a742-d14572ad1e50+7:1960:x1830948734141952:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 86us (2725us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129571.641825:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8317 00000100:00100000:3.0:1746129571.641836:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8318 00000100:00100000:3.0:1746129571.641840:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094064700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+13:1963:x1830948734141824:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129571.641848:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129571.641854:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012ba31a00/0x40a459093b069e6e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f210da expref: 13 pid: 7149 timeout: 926 lvb_type: 1 00010000:00010000:3.0:1746129571.641861:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012ba31a00/0x40a459093b069e6e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f210da expref: 13 pid: 7149 timeout: 926 lvb_type: 1 00010000:00010000:3.0:1746129571.641872:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ba31a00/0x40a459093b069e6e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f210da expref: 13 pid: 7149 timeout: 926 lvb_type: 1 00010000:00010000:3.0:1746129571.641879:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129571.641891:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094064700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+12:1963:x1830948734141824:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 51us (1716us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129571.641896:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8318 00000100:00100000:3.0:1746129571.641903:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8319 00000100:00100000:3.0:1746129571.641907:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094067800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ada2ffba-8920-4ecb-8068-68caa9806978+23:1962:x1830948734142080:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129571.641913:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129571.641919:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c173a00/0x40a459093b069e1a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21086 expref: 23 pid: 31503 timeout: 926 lvb_type: 1 00010000:00010000:3.0:1746129571.641926:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c173a00/0x40a459093b069e1a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21086 expref: 23 pid: 31503 timeout: 926 lvb_type: 1 00010000:00010000:3.0:1746129571.641937:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c173a00/0x40a459093b069e1a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21086 expref: 23 pid: 31503 timeout: 926 lvb_type: 1 00010000:00010000:3.0:1746129571.641944:0:9823:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129571.641946:0:9823:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129571.641951:0:9823:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c22dc00/0x40a459093b069fcc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21189 expref: 6 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.641958:0:9823:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c22dc00/0x40a459093b069fcc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21189 expref: 6 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.641990:0:9823:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012c22dc00/0x40a459093b069fcc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21189 expref: 6 pid: 31503 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129571.642001:0:9823:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013145fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9823:1830948737524480:192.168.202.4@tcp:105: 00000100:00100000:3.0:1746129571.642045:0:9823:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5ac93c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129571.644018:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129571.644057:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129571.644079:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129571.644357:0:9823:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013145fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9823:1830948737524480:192.168.202.4@tcp:105: 00010000:00010000:3.0:1746129571.644378:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129571.644411:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094067800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ada2ffba-8920-4ecb-8068-68caa9806978+22:1962:x1830948734142080:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 2503us (4218us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129571.644420:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8319 00000100:00100000:3.0:1746129571.644454:0:22481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734142336 00000100:00100000:3.0:1746129571.644459:0:22481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734142336 00000100:00100000:3.0:1746129571.645524:0:22481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734142464 00000100:00100000:3.0:1746129571.645531:0:22481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734142464 00000100:00100000:2.0:1746129571.645585:0:22480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734142592 00000100:00100000:2.0:1746129571.645589:0:22480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734142592 00000100:00100000:2.0:1746129571.645614:0:22480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16234 00000100:00100000:2.0:1746129571.645621:0:22480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094065180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ada2ffba-8920-4ecb-8068-68caa9806978+22:1962:x1830948734142336:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129571.645641:0:22480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129571.645659:0:22480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b4020000/0x40a459093b06a004 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21197 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129571.645717:0:22480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f959180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22480:1830948737524608:192.168.202.4@tcp:106: 00000100:00100000:3.0:1746129571.645793:0:22481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16235 00000100:00100000:3.0:1746129571.645800:0:22481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094064380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ada2ffba-8920-4ecb-8068-68caa9806978+29:1962:x1830948734142464:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129571.645808:0:22481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129571.645819:0:22481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095fb0c00/0x40a459093b06a00b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2119e expref: -99 pid: 22481 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129571.645843:0:22481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013145fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:22481:1830948737524736:192.168.202.4@tcp:106: 00000100:00100000:1.0:1746129571.646138:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16236 00000100:00100000:1.0:1746129571.646146:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094065c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ada2ffba-8920-4ecb-8068-68caa9806978+30:1962:x1830948734142592:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129571.646152:0:7149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129571.646159:0:7149:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880132fc3000/0x40a459093b06a012 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f211a5 expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129571.646181:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e38b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7149:1830948737524864:192.168.202.4@tcp:106: 00000100:00100000:2.0:1746129571.646630:0:22480:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009af1e0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746129571.646691:0:22481:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5ac93c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746129571.646796:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934d29c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746129571.646842:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129571.646908:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129571.646943:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129571.647390:0:31503:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734142848 00000100:00100000:3.0:1746129571.647395:0:31503:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734142848 00000100:00100000:3.0:1746129571.647426:0:31503:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734142720 00000100:00100000:3.0:1746129571.647430:0:31503:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734142720 00000100:00100000:3.0:1746129571.647443:0:31503:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734142976 00000100:00100000:3.0:1746129571.647444:0:31503:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734142976 00000100:00100000:3.0:1746129571.647465:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16237 00000100:00100000:3.0:1746129571.647470:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e389c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:068dab75-d300-4ead-a742-d14572ad1e50+7:32306:x1830948734142848:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:3.0:1746129571.647478:0:7148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129571.647486:0:7148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c22ca00/0x40a459093b06a019 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f211b3 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.647506:0:7148:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009efb3000/0x40a459093b069fa2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [2748416->3080191] (req 2748416->3080191) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21158 expref: 25 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.647514:0:7148:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c63fc00/0x40a459093b069f9b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [3080192->18446744073709551615] (req 3522560->3997695) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21151 expref: 11 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.647521:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746129571.647522:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746129571.647526:0:7148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c22ca00/0x40a459093b06a019 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f211b3 expref: 8 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.647545:0:7148:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c63fc00/0x40a459093b069f9b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [3080192->18446744073709551615] (req 3522560->3997695) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21151 expref: 11 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.647556:0:7148:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c63fc00/0x40a459093b069f9b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [3080192->18446744073709551615] (req 3522560->3997695) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21151 expref: 11 pid: 22481 timeout: 926 lvb_type: 0 00000100:00100000:3.0:1746129571.647564:0:7148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013145ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7148:1830948737524992:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129571.647604:0:7148:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009efb3000/0x40a459093b069fa2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [2748416->3080191] (req 2748416->3080191) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21158 expref: 25 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.647613:0:7148:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009efb3000/0x40a459093b069fa2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [2748416->3080191] (req 2748416->3080191) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21158 expref: 25 pid: 31503 timeout: 926 lvb_type: 0 00000100:00100000:3.0:1746129571.647621:0:7148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013145e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7148:1830948737525120:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129571.647636:0:7148:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5ac9f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746129571.647649:0:31503:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16238 00000100:00100000:3.0:1746129571.647654:0:31503:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e389f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ada2ffba-8920-4ecb-8068-68caa9806978+25:1962:x1830948734142720:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129571.647659:0:31503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129571.647665:0:31503:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c63e800/0x40a459093b06a020 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f211ac expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129571.647691:0:31503:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f37e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:31503:1830948737525248:192.168.202.4@tcp:106: 00000100:00100000:3.0:1746129571.647709:0:31503:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5ac9e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746129571.647764:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16239 00000100:00100000:1.0:1746129571.647770:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e38bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ada2ffba-8920-4ecb-8068-68caa9806978+26:1962:x1830948734142976:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129571.647777:0:4385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129571.647783:0:4385:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e6c1c00/0x40a459093b06a027 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f211ba expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129571.647805:0:4385:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b552d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:4385:1830948737525376:192.168.202.4@tcp:106: 00000100:00100000:1.0:1746129571.647825:0:4385:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934d2b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746129571.651881:0:7148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013145ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7148:1830948737524992:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129571.651898:0:7148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013145e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7148:1830948737525120:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129571.651933:0:7148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c22ca00/0x40a459093b06a019 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f211b3 expref: 8 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.651952:0:7148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c22ca00, rc 0) 00000100:00100000:3.0:1746129571.652016:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e389c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:068dab75-d300-4ead-a742-d14572ad1e50+8:32306:x1830948734142848:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 4544us (5173us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129571.652025:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16237 00002000:00010000:1.0:1746129571.652128:0:7149:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb atime: 1746129570 -> 1746129571 00002000:00010000:1.0:1746129571.652132:0:7149:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb ctime: 1746129571 -> 1746129572 00000100:00100000:1.0:1746129571.652155:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e38b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7149:1830948737524864:192.168.202.4@tcp:106: 00010000:00010000:1.0:1746129571.652198:0:7149:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880132fc3000/0x40a459093b06a012 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f211a5 expref: 31 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129571.652207:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880132fc3000/0x40a459093b06a012 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f211a5 expref: 31 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129571.652240:0:7149:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132fc3000, rc 0) 00000100:00100000:1.0:1746129571.652259:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094065c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ada2ffba-8920-4ecb-8068-68caa9806978+30:1962:x1830948734142592:12345-192.168.202.4@tcp:101:cat.0 Request processed in 6114us (8178us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129571.652264:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16236 00002000:00010000:2.0:1746129571.652703:0:22480:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3ec:0x0] updating lvb mtime: 1746129570 -> 1746129571 00002000:00010000:2.0:1746129571.652706:0:22480:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3ec:0x0] updating lvb atime: 1746129568 -> 1746129571 00002000:00010000:2.0:1746129571.652708:0:22480:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3ec:0x0] updating lvb ctime: 1746129570 -> 1746129572 00000100:00100000:2.0:1746129571.652722:0:22480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f959180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22480:1830948737524608:192.168.202.4@tcp:106: 00010000:00010000:2.0:1746129571.652741:0:22480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b4020000/0x40a459093b06a004 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21197 expref: 27 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129571.652749:0:22480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b4020000/0x40a459093b06a004 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21197 expref: 27 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129571.652760:0:22480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4020000, rc 0) 00000100:00100000:2.0:1746129571.652781:0:22480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094065180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ada2ffba-8920-4ecb-8068-68caa9806978+26:1962:x1830948734142336:12345-192.168.202.4@tcp:101:cat.0 Request processed in 7160us (8771us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129571.652786:0:22480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16234 00002000:00010000:3.0:1746129571.654855:0:22481:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb ctime: 1746129571 -> 1746129572 00000100:00100000:3.0:1746129571.654882:0:22481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013145fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:22481:1830948737524736:192.168.202.4@tcp:106: 00010000:00010000:3.0:1746129571.654912:0:22481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095fb0c00/0x40a459093b06a00b lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2119e expref: 29 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129571.654925:0:22481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095fb0c00/0x40a459093b06a00b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2119e expref: 29 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129571.654939:0:22481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095fb0c00, rc 0) 00000100:00100000:3.0:1746129571.654983:0:22481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094064380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ada2ffba-8920-4ecb-8068-68caa9806978+28:1962:x1830948734142464:12345-192.168.202.4@tcp:101:cat.0 Request processed in 9183us (10924us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129571.654990:0:22481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16235 00002000:00010000:0.0:1746129571.655126:0:4385:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb mtime: 1746129571 -> 1746129572 00000100:00100000:0.0:1746129571.655143:0:4385:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b552d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:4385:1830948737525376:192.168.202.4@tcp:106: 00010000:00010000:0.0:1746129571.655163:0:4385:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008e6c1c00/0x40a459093b06a027 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f211ba expref: 25 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129571.655176:0:4385:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e6c1c00/0x40a459093b06a027 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f211ba expref: 25 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129571.655188:0:4385:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e6c1c00, rc 0) 00000100:00100000:0.0:1746129571.655209:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e38bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ada2ffba-8920-4ecb-8068-68caa9806978+24:1962:x1830948734142976:12345-192.168.202.4@tcp:101:cat.0 Request processed in 7439us (8265us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129571.655215:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16239 00000100:00100000:1.0:1746129571.655332:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129571.655361:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00002000:00010000:2.0:1746129571.655703:0:31503:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb atime: 1746129570 -> 1746129571 00002000:00010000:2.0:1746129571.655707:0:31503:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb ctime: 1746129570 -> 1746129572 00000100:00100000:2.0:1746129571.655717:0:31503:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f37e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:31503:1830948737525248:192.168.202.4@tcp:106: 00010000:00010000:2.0:1746129571.655732:0:31503:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c63e800/0x40a459093b06a020 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f211ac expref: 23 pid: 31503 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129571.655741:0:31503:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c63e800/0x40a459093b06a020 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f211ac expref: 23 pid: 31503 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129571.655753:0:31503:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c63e800, rc 0) 00000100:00100000:2.0:1746129571.655777:0:31503:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e389f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ada2ffba-8920-4ecb-8068-68caa9806978+22:1962:x1830948734142720:12345-192.168.202.4@tcp:101:cat.0 Request processed in 8122us (8868us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129571.655782:0:31503:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16238 00000100:00100000:2.0:1746129571.656221:0:31521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734143104 00000100:00100000:2.0:1746129571.656227:0:31521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734143104 00002000:00100000:2.0:1746129571.656264:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3ef:0x0] (3522560->3997695) req@ffff88012b551880 x1830948734143104/t0(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:312/0 lens 488/0 e 0 to 0 dl 1746129582 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129571.656274:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b551880 with x1830948734143104 ext(3522560->3997695) 00010000:00010000:2.0:1746129571.656280:0:31521:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009c63fc00/0x40a459093b069f9b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [3080192->18446744073709551615] (req 3522560->3997695) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21151 expref: 12 pid: 22481 timeout: 926 lvb_type: 0 00010000:00010000:2.0:1746129571.656290:0:31521:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009c63fc00/0x40a459093b069f9b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [3080192->18446744073709551615] (req 3522560->3997695) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21151 expref: 12 pid: 22481 timeout: 926 lvb_type: 0 00002000:00010000:2.0:1746129571.656326:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b551880 00000100:00100000:2.0:1746129571.656793:0:31521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734143232 00000100:00100000:2.0:1746129571.656797:0:31521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734143232 00002000:00100000:2.0:1746129571.656813:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3ef:0x0] (2748416->3080191) req@ffff88012b550a80 x1830948734143232/t0(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:312/0 lens 488/0 e 0 to 0 dl 1746129582 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129571.656820:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b550a80 with x1830948734143232 ext(2748416->3080191) 00010000:00010000:2.0:1746129571.656825:0:31521:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009efb3000/0x40a459093b069fa2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [2748416->3080191] (req 2748416->3080191) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21158 expref: 22 pid: 31503 timeout: 926 lvb_type: 0 00010000:00010000:2.0:1746129571.656833:0:31521:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009efb3000/0x40a459093b069fa2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [2748416->3080191] (req 2748416->3080191) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21158 expref: 22 pid: 31503 timeout: 926 lvb_type: 0 00002000:00010000:2.0:1746129571.656839:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b550a80 00000100:00100000:3.0:1746129571.656892:0:31523:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2425 00000100:00100000:3.0:1746129571.656901:0:31523:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b551880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+12:1962:x1830948734143104:12345-192.168.202.4@tcp:4:cat.0 00000100:00100000:2.0:1746129571.657705:0:31521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2426 00000100:00100000:2.0:1746129571.657712:0:31521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b550a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ada2ffba-8920-4ecb-8068-68caa9806978+22:1963:x1830948734143232:12345-192.168.202.4@tcp:4:multiop.0 00000100:00100000:2.0:1746129571.664325:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129571.664752:0:31503:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734143360 00000100:00100000:0.0:1746129571.664763:0:31503:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734143360 00000100:00100000:0.0:1746129571.664825:0:31503:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16240 00000100:00100000:0.0:1746129571.664833:0:31503:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f959180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ada2ffba-8920-4ecb-8068-68caa9806978+24:32320:x1830948734143360:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129571.664853:0:31503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129571.664871:0:31503:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e0bb400/0x40a459093b06a02e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f211c1 expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129571.664900:0:31503:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129571.664905:0:31503:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e0bb400/0x40a459093b06a02e lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f211c1 expref: 25 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129571.664917:0:31503:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008e0bb400/0x40a459093b06a02e lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f211c1 expref: 25 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129571.664928:0:31503:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e0bb400, rc 0) 00000100:00100000:0.0:1746129571.664988:0:31503:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f959180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ada2ffba-8920-4ecb-8068-68caa9806978+25:32320:x1830948734143360:12345-192.168.202.4@tcp:101:cat.0 Request processed in 155us (700us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129571.664999:0:31503:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16240 00000100:00100000:3.0:1746129571.676116:0:31523:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b551880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+14:1962:x1830948734143104:12345-192.168.202.4@tcp:4:cat.0 Request processed in 19202us (20769us total) trans 21474841365 rc 0/0 00000100:00100000:3.0:1746129571.676130:0:31523:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2425 00002000:00100000:3.0:1746129571.676145:0:31523:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3ef:0x0] (3522560->3997695) req@ffff88012b551880 x1830948734143104/t21474841365(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:312/0 lens 488/448 e 0 to 0 dl 1746129582 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129571.676155:0:31523:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b551880 with x1830948734143104 ext(3522560->3997695) 00010000:00010000:3.0:1746129571.676166:0:31523:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009c63fc00/0x40a459093b069f9b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [3080192->18446744073709551615] (req 3522560->3997695) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21151 expref: 14 pid: 22481 timeout: 926 lvb_type: 0 00010000:00010000:3.0:1746129571.676181:0:31523:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009c63fc00/0x40a459093b069f9b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [3080192->18446744073709551615] (req 3522560->3997695) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21151 expref: 14 pid: 22481 timeout: 926 lvb_type: 0 00002000:00010000:3.0:1746129571.676192:0:31523:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b551880 00000100:00100000:2.0:1746129571.677441:0:31521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b550a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ada2ffba-8920-4ecb-8068-68caa9806978+25:1963:x1830948734143232:12345-192.168.202.4@tcp:4:multiop.0 Request processed in 19720us (22069us total) trans 21474841366 rc 0/0 00000100:00100000:2.0:1746129571.677451:0:31521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2426 00002000:00100000:2.0:1746129571.677461:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3ef:0x0] (2748416->3080191) req@ffff88012b550a80 x1830948734143232/t21474841366(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:312/0 lens 488/448 e 0 to 0 dl 1746129582 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129571.677469:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b550a80 with x1830948734143232 ext(2748416->3080191) 00010000:00010000:2.0:1746129571.677475:0:31521:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009efb3000/0x40a459093b069fa2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [2748416->3080191] (req 2748416->3080191) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21158 expref: 25 pid: 31503 timeout: 926 lvb_type: 0 00010000:00010000:2.0:1746129571.677485:0:31521:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009efb3000/0x40a459093b069fa2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [2748416->3080191] (req 2748416->3080191) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21158 expref: 25 pid: 31503 timeout: 926 lvb_type: 0 00002000:00010000:2.0:1746129571.677491:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b550a80 00000100:00100000:0.0:1746129571.680073:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129571.680169:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734143488 00000100:00100000:3.0:1746129571.680179:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734143488 00010000:00010000:3.0:1746129571.680219:0:9823:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c63fc00/0x40a459093b069f9b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [3080192->18446744073709551615] (req 3522560->3997695) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21151 expref: 14 pid: 22481 timeout: 926 lvb_type: 0 00000100:00100000:3.0:1746129571.680263:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8320 00000100:00100000:3.0:1746129571.680271:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094067100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+14:1963:x1830948734143488:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129571.680288:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746129571.680605:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129571.680664:0:7086:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734143616 00000100:00100000:1.0:1746129571.680669:0:7086:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734143616 00010000:00010000:1.0:1746129571.680686:0:7086:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009efb3000/0x40a459093b069fa2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [2748416->3080191] (req 2748416->3080191) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21158 expref: 25 pid: 31503 timeout: 926 lvb_type: 0 00000100:00100000:1.0:1746129571.680716:0:7086:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8321 00000100:00100000:1.0:1746129571.680721:0:7086:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094064000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ada2ffba-8920-4ecb-8068-68caa9806978+25:1960:x1830948734143616:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129571.680729:0:7086:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129571.680751:0:7086:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009efb3000/0x40a459093b069fa2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [2748416->3080191] (req 2748416->3080191) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21158 expref: 25 pid: 31503 timeout: 926 lvb_type: 0 00010000:00010000:1.0:1746129571.680762:0:7086:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009efb3000/0x40a459093b069fa2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [2748416->3080191] (req 2748416->3080191) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21158 expref: 25 pid: 31503 timeout: 926 lvb_type: 0 00010000:00010000:1.0:1746129571.680786:0:7086:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009efb3000/0x40a459093b069fa2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [2748416->3080191] (req 2748416->3080191) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21158 expref: 25 pid: 31503 timeout: 926 lvb_type: 0 00010000:00010000:1.0:1746129571.680809:0:7086:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129571.680854:0:7086:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094064000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ada2ffba-8920-4ecb-8068-68caa9806978+24:1960:x1830948734143616:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 132us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129571.680859:0:7086:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8321 00010000:00010000:3.0:1746129571.681202:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c63fc00/0x40a459093b069f9b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [3080192->18446744073709551615] (req 3522560->3997695) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21151 expref: 14 pid: 22481 timeout: 926 lvb_type: 0 00010000:00010000:3.0:1746129571.681210:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c63fc00/0x40a459093b069f9b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [3080192->18446744073709551615] (req 3522560->3997695) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21151 expref: 14 pid: 22481 timeout: 926 lvb_type: 0 00010000:00010000:3.0:1746129571.681223:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c63fc00/0x40a459093b069f9b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [3080192->18446744073709551615] (req 3522560->3997695) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21151 expref: 14 pid: 22481 timeout: 926 lvb_type: 0 00010000:00010000:3.0:1746129571.681724:0:9823:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129571.681727:0:9823:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129571.681735:0:9823:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c22ca00/0x40a459093b06a019 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f211b3 expref: 7 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.681743:0:9823:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c22ca00/0x40a459093b06a019 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f211b3 expref: 7 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.681787:0:9823:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012c22ca00/0x40a459093b06a019 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f211b3 expref: 7 pid: 7148 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129571.681799:0:9823:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f37f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9823:1830948737525504:192.168.202.4@tcp:105: 00000100:00100000:3.0:1746129571.681870:0:9823:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5ac93c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746129571.684879:0:9823:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f37f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9823:1830948737525504:192.168.202.4@tcp:105: 00010000:00010000:3.0:1746129571.684907:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129571.684952:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094067100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+13:1963:x1830948734143488:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 4680us (4901us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129571.684964:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8320 00000100:00100000:0.0:1746129571.687102:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129571.687838:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734143744 00000100:00100000:2.0:1746129571.687849:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734143744 00000100:00100000:2.0:1746129571.687899:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16241 00000100:00100000:2.0:1746129571.687907:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094065880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:068dab75-d300-4ead-a742-d14572ad1e50+8:32306:x1830948734143744:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:2.0:1746129571.687929:0:4385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129571.687946:0:4385:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800955d2e00/0x40a459093b06a035 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f211c8 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129571.687980:0:4385:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fab5200/0x40a459093b069e36 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f210a2 expref: 17 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129571.687989:0:4385:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880136b1d000/0x40a459093b069ec2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21112 expref: 27 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129571.687995:0:4385:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ba30c00/0x40a459093b069e98 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21104 expref: 9 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129571.688002:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129571.688003:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129571.688006:0:4385:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800955d2e00/0x40a459093b06a035 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f211c8 expref: 9 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129571.688036:0:4385:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012ba30c00/0x40a459093b069e98 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21104 expref: 9 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129571.688048:0:4385:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012ba30c00/0x40a459093b069e98 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21104 expref: 9 pid: 7148 timeout: 927 lvb_type: 1 00000100:00100000:2.0:1746129571.688060:0:4385:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f95ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:4385:1830948737525632:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129571.688166:0:4385:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880136b1d000/0x40a459093b069ec2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21112 expref: 27 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129571.688175:0:4385:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880136b1d000/0x40a459093b069ec2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21112 expref: 27 pid: 8412 timeout: 927 lvb_type: 1 00000100:00100000:2.0:1746129571.688187:0:4385:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f959f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:4385:1830948737525760:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129571.688213:0:4385:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fab5200/0x40a459093b069e36 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f210a2 expref: 17 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129571.688226:0:4385:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fab5200/0x40a459093b069e36 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f210a2 expref: 17 pid: 20577 timeout: 927 lvb_type: 0 00000100:00100000:2.0:1746129571.688233:0:4385:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f95a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:4385:1830948737525888:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129571.688251:0:4385:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009af1e0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129571.690673:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129571.690706:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129571.690736:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129571.690790:0:7086:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734144000 00000100:00100000:1.0:1746129571.690799:0:7086:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734144000 00010000:00010000:1.0:1746129571.690837:0:7086:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880136b1d000/0x40a459093b069ec2 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21112 expref: 28 pid: 8412 timeout: 927 lvb_type: 1 00000100:00100000:1.0:1746129571.690864:0:7086:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734143872 00000100:00100000:1.0:1746129571.690866:0:7086:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734143872 00010000:00010000:1.0:1746129571.690876:0:7086:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012ba30c00/0x40a459093b069e98 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21104 expref: 10 pid: 7148 timeout: 927 lvb_type: 1 00000100:00100000:1.0:1746129571.690889:0:7086:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734144128 00000100:00100000:1.0:1746129571.690891:0:7086:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734144128 00010000:00010000:1.0:1746129571.690900:0:7086:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fab5200/0x40a459093b069e36 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f210a2 expref: 18 pid: 20577 timeout: 927 lvb_type: 0 00000100:00100000:1.0:1746129571.690920:0:7086:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8322 00000100:00100000:1.0:1746129571.690927:0:7086:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a47850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ada2ffba-8920-4ecb-8068-68caa9806978+28:1962:x1830948734144000:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129571.690940:0:7086:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129571.690963:0:7086:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880136b1d000/0x40a459093b069ec2 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21112 expref: 28 pid: 8412 timeout: 927 lvb_type: 1 00010000:00010000:1.0:1746129571.690973:0:7086:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880136b1d000/0x40a459093b069ec2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21112 expref: 28 pid: 8412 timeout: 927 lvb_type: 1 00010000:00010000:1.0:1746129571.691001:0:7086:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129571.691039:0:7086:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a47850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ada2ffba-8920-4ecb-8068-68caa9806978+28:1962:x1830948734144000:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 112us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129571.691051:0:7086:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8322 00000100:00100000:3.0:1746129571.691079:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8323 00000100:00100000:3.0:1746129571.691087:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094065500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:068dab75-d300-4ead-a742-d14572ad1e50+10:1962:x1830948734143872:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129571.691094:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746129571.691097:0:7086:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8324 00000100:00100000:1.0:1746129571.691101:0:7086:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959d4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+18:1962:x1830948734144128:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129571.691102:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012ba30c00/0x40a459093b069e98 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21104 expref: 10 pid: 7148 timeout: 927 lvb_type: 1 00010000:00010000:1.0:1746129571.691106:0:7086:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129571.691111:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012ba30c00/0x40a459093b069e98 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21104 expref: 10 pid: 7148 timeout: 927 lvb_type: 1 00010000:00010000:1.0:1746129571.691725:0:7086:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fab5200/0x40a459093b069e36 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f210a2 expref: 18 pid: 20577 timeout: 927 lvb_type: 0 00010000:00010000:1.0:1746129571.691735:0:7086:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fab5200/0x40a459093b069e36 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f210a2 expref: 18 pid: 20577 timeout: 927 lvb_type: 0 00010000:00010000:1.0:1746129571.691749:0:7086:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129571.691769:0:7086:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959d4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+18:1962:x1830948734144128:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 667us (1033us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129571.691775:0:7086:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8324 00010000:00010000:3.0:1746129571.691831:0:9823:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129571.691833:0:9823:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129571.691841:0:9823:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800955d2e00/0x40a459093b06a035 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50080000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f211c8 expref: 10 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.691850:0:9823:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800955d2e00/0x40a459093b06a035 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50080000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f211c8 expref: 10 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.691885:0:9823:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800955d2e00/0x40a459093b06a035 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f211c8 expref: 10 pid: 4385 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129571.691898:0:9823:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f37f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9823:1830948737526016:192.168.202.4@tcp:105: 00000100:00100000:3.0:1746129571.691951:0:9823:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5ac93c0 going to sleep for 11 seconds 00010000:00010000:2.0:1746129571.692977:0:4385:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ba30c00/0x40a459093b069e98 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21104 expref: 10 pid: 7148 timeout: 927 lvb_type: 1 00000100:00100000:2.0:1746129571.692997:0:4385:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f95ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:4385:1830948737525632:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129571.693011:0:4385:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136b1d000/0x40a459093b069ec2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21112 expref: 27 pid: 8412 timeout: 927 lvb_type: 1 00000100:00100000:2.0:1746129571.693019:0:4385:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f959f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:4385:1830948737525760:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129571.693029:0:4385:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fab5200/0x40a459093b069e36 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f210a2 expref: 17 pid: 20577 timeout: 927 lvb_type: 0 00000100:00100000:2.0:1746129571.693037:0:4385:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f95a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:4385:1830948737525888:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129571.695767:0:4385:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800955d2e00/0x40a459093b06a035 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f211c8 expref: 9 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129571.695793:0:4385:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800955d2e00, rc 0) 00000100:00100000:2.0:1746129571.695873:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094065880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:068dab75-d300-4ead-a742-d14572ad1e50+9:32306:x1830948734143744:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 7964us (8777us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129571.695881:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16241 00000100:00100000:3.0:1746129571.696738:0:9823:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f37f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9823:1830948737526016:192.168.202.4@tcp:105: 00010000:00010000:3.0:1746129571.696754:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129571.696776:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094065500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:068dab75-d300-4ead-a742-d14572ad1e50+8:1962:x1830948734143872:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 5691us (6069us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129571.696785:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8323 00000100:00100000:0.0:1746129571.700027:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129571.700085:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129571.700824:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734144384 00000100:00100000:2.0:1746129571.700835:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734144384 00000100:00100000:1.0:1746129571.700839:0:31503:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734144256 00000100:00100000:1.0:1746129571.700843:0:31503:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734144256 00000100:00100000:1.0:1746129571.700893:0:31503:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16242 00000100:00100000:2.0:1746129571.700899:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16243 00000100:00100000:1.0:1746129571.700901:0:31503:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:068dab75-d300-4ead-a742-d14572ad1e50+8:1962:x1830948734144256:12345-192.168.202.4@tcp:2:lfs.0 00000100:00100000:2.0:1746129571.700903:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:068dab75-d300-4ead-a742-d14572ad1e50+8:1963:x1830948734144384:12345-192.168.202.4@tcp:2:lfs.0 00002000:00010000:2.0:1746129571.701089:0:4385:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746129571.701092:0:4385:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb mtime from disk: 1746129571 -> 1746129571 00002000:00010000:2.0:1746129571.701094:0:4385:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb atime from disk: 1746129571 -> 1746129571 00002000:00010000:2.0:1746129571.701096:0:4385:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb ctime from disk: 1746129572 -> 1746129572 00002000:00010000:2.0:1746129571.701098:0:4385:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:2.0:1746129571.701161:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:068dab75-d300-4ead-a742-d14572ad1e50+9:1963:x1830948734144384:12345-192.168.202.4@tcp:2:lfs.0 Request processed in 256us (1143us total) trans 17179874119 rc 0/0 00000100:00100000:2.0:1746129571.701167:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16243 00002000:00010000:1.0:1746129571.701969:0:31503:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3ec:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:1.0:1746129571.701973:0:31503:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ec:0x0] updating lvb mtime from disk: 1746129571 -> 1746129571 00002000:00010000:1.0:1746129571.701975:0:31503:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3ec:0x0] updating lvb atime from disk: 1746129571 -> 1746129571 00002000:00010000:1.0:1746129571.701977:0:31503:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ec:0x0] updating lvb ctime from disk: 1746129572 -> 1746129572 00002000:00010000:1.0:1746129571.701979:0:31503:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3ec:0x0] updating lvb blocks from disk: 2073 -> 2073 00000100:00100000:1.0:1746129571.702016:0:31503:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:068dab75-d300-4ead-a742-d14572ad1e50+9:1962:x1830948734144256:12345-192.168.202.4@tcp:2:lfs.0 Request processed in 1114us (1929us total) trans 21474841367 rc 0/0 00000100:00100000:1.0:1746129571.702021:0:31503:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16242 00000100:00100000:0.0:1746129571.702283:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129571.702367:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129571.702411:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129571.702534:0:22481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734144640 00000100:00100000:3.0:1746129571.702540:0:22481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734144640 00000100:00100000:3.0:1746129571.702567:0:22481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734144896 00000100:00100000:3.0:1746129571.702570:0:22481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734144896 00000100:00100000:3.0:1746129571.702581:0:22481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734144768 00000100:00100000:3.0:1746129571.702583:0:22481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734144768 00000100:00100000:3.0:1746129571.702596:0:22481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16244 00000100:00100000:3.0:1746129571.702601:0:22481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:068dab75-d300-4ead-a742-d14572ad1e50+10:1963:x1830948734144640:12345-192.168.202.4@tcp:2:lfs.0 00000100:00100000:0.0:1746129571.703058:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129571.703209:0:4699:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734144512 00000100:00100000:2.0:1746129571.703213:0:4699:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734144512 00000100:00100000:2.0:1746129571.703232:0:4699:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16245 00000100:00100000:2.0:1746129571.703236:0:4699:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:068dab75-d300-4ead-a742-d14572ad1e50+10:1963:x1830948734144896:12345-192.168.202.4@tcp:2:lfs.0 00002000:00010000:2.0:1746129571.703401:0:4699:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3f5:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746129571.703403:0:4699:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f5:0x0] updating lvb mtime from disk: 1746129571 -> 1746129571 00002000:00010000:2.0:1746129571.703405:0:4699:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f5:0x0] updating lvb atime from disk: 1746129571 -> 1746129571 00002000:00010000:2.0:1746129571.703407:0:4699:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f5:0x0] updating lvb ctime from disk: 1746129571 -> 1746129572 00002000:00010000:2.0:1746129571.703410:0:4699:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f5:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:2.0:1746129571.703437:0:4699:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:068dab75-d300-4ead-a742-d14572ad1e50+11:1963:x1830948734144896:12345-192.168.202.4@tcp:2:lfs.0 Request processed in 200us (1070us total) trans 17179874120 rc 0/0 00000100:00100000:2.0:1746129571.703443:0:4699:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16245 00000100:00100000:2.0:1746129571.703455:0:4699:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16246 00000100:00100000:2.0:1746129571.703459:0:4699:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:068dab75-d300-4ead-a742-d14572ad1e50+10:1963:x1830948734144768:12345-192.168.202.4@tcp:2:lfs.0 00002000:00010000:2.0:1746129571.703537:0:4699:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb size from disk: 5146336 -> 5146336 00002000:00010000:2.0:1746129571.703540:0:4699:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb mtime from disk: 1746129572 -> 1746129571 00002000:00010000:2.0:1746129571.703542:0:4699:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb atime from disk: 1746129572 -> 1746129571 00002000:00010000:2.0:1746129571.703543:0:4699:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb ctime from disk: 1746129572 -> 1746129572 00002000:00010000:2.0:1746129571.703545:0:4699:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb blocks from disk: 6033 -> 6033 00000100:00100000:2.0:1746129571.703560:0:4699:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:068dab75-d300-4ead-a742-d14572ad1e50+11:1963:x1830948734144768:12345-192.168.202.4@tcp:2:lfs.0 Request processed in 101us (1150us total) trans 21474841368 rc 0/0 00000100:00100000:2.0:1746129571.703565:0:4699:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16246 00000100:00100000:2.0:1746129571.703574:0:4699:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16247 00000100:00100000:2.0:1746129571.703579:0:4699:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bf79450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:068dab75-d300-4ead-a742-d14572ad1e50+10:1962:x1830948734144512:12345-192.168.202.4@tcp:2:lfs.0 00002000:00010000:2.0:1746129571.703635:0:4699:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746129571.703638:0:4699:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb mtime from disk: 1746129571 -> 1746129571 00002000:00010000:2.0:1746129571.703640:0:4699:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb atime from disk: 1746129571 -> 1746129571 00002000:00010000:2.0:1746129571.703641:0:4699:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb ctime from disk: 1746129572 -> 1746129572 00002000:00010000:2.0:1746129571.703643:0:4699:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:2.0:1746129571.703659:0:4699:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bf79450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:068dab75-d300-4ead-a742-d14572ad1e50+11:1962:x1830948734144512:12345-192.168.202.4@tcp:2:lfs.0 Request processed in 80us (602us total) trans 17179874121 rc 0/0 00000100:00100000:2.0:1746129571.703664:0:4699:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16247 00002000:00010000:3.0:1746129571.703961:0:22481:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746129571.703964:0:22481:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb mtime from disk: 1746129571 -> 1746129571 00002000:00010000:3.0:1746129571.703965:0:22481:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb atime from disk: 1746129571 -> 1746129571 00002000:00010000:3.0:1746129571.703967:0:22481:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb ctime from disk: 1746129572 -> 1746129572 00002000:00010000:3.0:1746129571.703969:0:22481:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb blocks from disk: 2077 -> 2077 00000100:00100000:3.0:1746129571.703988:0:22481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:068dab75-d300-4ead-a742-d14572ad1e50+11:1963:x1830948734144640:12345-192.168.202.4@tcp:2:lfs.0 Request processed in 1386us (2088us total) trans 21474841369 rc 0/0 00000100:00100000:3.0:1746129571.703996:0:22481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16244 00000100:00100000:0.0:1746129571.706377:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129571.706602:0:16680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734145152 00000100:00100000:1.0:1746129571.706623:0:16680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734145152 00000100:00100000:1.0:1746129571.706685:0:16680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4762 00000100:00100000:1.0:1746129571.706694:0:16680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:068dab75-d300-4ead-a742-d14572ad1e50+7:32306:x1830948734145152:12345-192.168.202.4@tcp:35:lfs.0 00000100:00100000:0.0:1746129571.706843:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129571.706920:0:16680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:068dab75-d300-4ead-a742-d14572ad1e50+8:32306:x1830948734145152:12345-192.168.202.4@tcp:35:lfs.0 Request processed in 227us (552us total) trans 8589945317 rc 0/0 00000100:00100000:1.0:1746129571.706926:0:16680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4762 00000100:00100000:3.0:1746129571.707224:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734145280 00000100:00100000:3.0:1746129571.707229:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734145280 00010000:00010000:3.0:1746129571.707254:0:9823:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4021600/0x40a459093b069fa9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2115f expref: 11 pid: 22480 timeout: 926 lvb_type: 0 00000100:00100000:3.0:1746129571.707288:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8325 00000100:00100000:3.0:1746129571.707331:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:068dab75-d300-4ead-a742-d14572ad1e50+11:1960:x1830948734145280:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129571.707344:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129571.707366:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: ffff8800b4021600/0x40a459093b069fa9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2115f expref: 11 pid: 22480 timeout: 926 lvb_type: 0 00010000:00010000:3.0:1746129571.707378:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b4021600/0x40a459093b069fa9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2115f expref: 11 pid: 22480 timeout: 926 lvb_type: 0 00010000:00010000:3.0:1746129571.707401:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b4021600/0x40a459093b069fa9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2115f expref: 11 pid: 22480 timeout: 926 lvb_type: 0 00010000:00010000:3.0:1746129571.707417:0:9823:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129571.707419:0:9823:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129571.707427:0:9823:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a6ef5e00/0x40a459093b069fc5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2117b expref: 12 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.707434:0:9823:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6ef5e00/0x40a459093b069fc5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2117b expref: 12 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.707442:0:9823:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129571.707444:0:9823:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129571.707447:0:9823:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008e0bb400/0x40a459093b06a02e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f211c1 expref: 23 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.707452:0:9823:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e0bb400/0x40a459093b06a02e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f211c1 expref: 23 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.707480:0:9823:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008e0bb400/0x40a459093b06a02e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f211c1 expref: 23 pid: 31503 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129571.707490:0:9823:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f37c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9823:1830948737526144:192.168.202.4@tcp:105: 00010000:00010000:3.0:1746129571.707557:0:9823:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a6ef5e00/0x40a459093b069fc5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2117b expref: 12 pid: 22480 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129571.707564:0:9823:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f37fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9823:1830948737526272:192.168.202.4@tcp:105: 00000100:00100000:3.0:1746129571.707580:0:9823:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5ac93c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129571.711717:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129571.711796:0:16680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734145536 00000100:00100000:1.0:1746129571.711805:0:16680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734145536 00000100:00100000:1.0:1746129571.711862:0:16680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4763 00000100:00100000:1.0:1746129571.711870:0:16680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:068dab75-d300-4ead-a742-d14572ad1e50+8:32306:x1830948734145536:12345-192.168.202.4@tcp:35:lfs.0 00000100:00100000:3.0:1746129571.712041:0:9823:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f37c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9823:1830948737526144:192.168.202.4@tcp:105: 00000100:00100000:3.0:1746129571.712052:0:9823:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f37fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9823:1830948737526272:192.168.202.4@tcp:105: 00010000:00010000:3.0:1746129571.712074:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129571.712075:0:16680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:068dab75-d300-4ead-a742-d14572ad1e50+9:32306:x1830948734145536:12345-192.168.202.4@tcp:35:lfs.0 Request processed in 206us (369us total) trans 8589945318 rc 0/0 00000100:00100000:1.0:1746129571.712082:0:16680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4763 00000100:00100000:3.0:1746129571.712090:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:068dab75-d300-4ead-a742-d14572ad1e50+10:1960:x1830948734145280:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 4798us (5248us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129571.712098:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8325 00000100:00100000:2.0:1746129571.713601:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129571.713649:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129571.713706:0:31521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734145792 00000100:00100000:0.0:1746129571.713714:0:31521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734145792 00002000:00100000:0.0:1746129571.713752:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3ec:0x0] (0->1048575) req@ffff88009f95a300 x1830948734145792/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:312/0 lens 488/0 e 0 to 0 dl 1746129582 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129571.713762:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f95a300 with x1830948734145792 ext(0->1048575) 00002000:00010000:0.0:1746129571.713768:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f95a300 00000100:00100000:0.0:1746129571.713793:0:31521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734146048 00000100:00100000:0.0:1746129571.713796:0:31521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734146048 00002000:00100000:0.0:1746129571.713809:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3ec:0x0] (0->1048575) req@ffff88009f959f80 x1830948734146048/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:312/0 lens 488/0 e 0 to 0 dl 1746129582 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746129571.713815:0:31519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7811 00002000:00100000:0.0:1746129571.713815:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f959f80 with x1830948734146048 ext(0->1048575) 00002000:00010000:0.0:1746129571.713819:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f959f80 00000100:00100000:2.0:1746129571.713824:0:31519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f95a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+13:1962:x1830948734145792:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129571.713843:0:31521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7812 00000100:00100000:0.0:1746129571.713847:0:31521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f959f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ada2ffba-8920-4ecb-8068-68caa9806978+24:1962:x1830948734146048:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:2.0:1746129571.756672:0:31521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f959f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ada2ffba-8920-4ecb-8068-68caa9806978+24:1962:x1830948734146048:12345-192.168.202.4@tcp:3:cat.0 Request processed in 42809us (43007us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129571.756687:0:31521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7812 00002000:00100000:2.0:1746129571.756700:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3ec:0x0] (0->1048575) req@ffff88009f959f80 x1830948734146048/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:312/0 lens 488/440 e 0 to 0 dl 1746129582 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129571.756710:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f959f80 with x1830948734146048 ext(0->1048575) 00002000:00010000:2.0:1746129571.756717:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f959f80 00000100:00100000:2.0:1746129571.766731:0:31519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f95a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+13:1962:x1830948734145792:12345-192.168.202.4@tcp:3:cat.0 Request processed in 52893us (53120us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129571.766747:0:31519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7811 00002000:00100000:2.0:1746129571.766762:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3ec:0x0] (0->1048575) req@ffff88009f95a300 x1830948734145792/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:312/0 lens 488/440 e 0 to 0 dl 1746129582 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129571.766772:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f95a300 with x1830948734145792 ext(0->1048575) 00002000:00010000:2.0:1746129571.766778:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f95a300 00000100:00100000:0.0:1746129571.775991:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129571.776553:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129571.776654:0:31503:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734146176 00000100:00100000:1.0:1746129571.776665:0:31503:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734146176 00000100:00100000:1.0:1746129571.776723:0:31503:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734146304 00000100:00100000:1.0:1746129571.776726:0:31503:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734146304 00000100:00100000:1.0:1746129571.776743:0:31503:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16248 00000100:00100000:1.0:1746129571.776752:0:31503:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+17:32317:x1830948734146176:12345-192.168.202.4@tcp:101:cat.0 00000100:00100000:3.0:1746129571.776759:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16249 00000100:00100000:3.0:1746129571.776767:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ada2ffba-8920-4ecb-8068-68caa9806978+27:32320:x1830948734146304:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129571.776771:0:31503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129571.776773:0:7148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129571.776790:0:7148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a95ece00/0x40a459093b06a03c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f211cf expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129571.776790:0:31503:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b4e59800/0x40a459093b06a043 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f211d6 expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.776823:0:7148:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e94d000/0x40a459093b069fb7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2116d expref: 10 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.776830:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129571.776833:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129571.776836:0:7148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a95ece00/0x40a459093b06a03c lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f211cf expref: 28 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129571.776856:0:31503:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129571.776860:0:31503:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b4e59800/0x40a459093b06a043 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f211d6 expref: 18 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129571.776871:0:31503:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b4e59800/0x40a459093b06a043 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f211d6 expref: 18 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129571.776880:0:31503:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4e59800, rc 0) 00010000:00010000:3.0:1746129571.776885:0:7148:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012e94d000/0x40a459093b069fb7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2116d expref: 10 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.776897:0:7148:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012e94d000/0x40a459093b069fb7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2116d expref: 10 pid: 31503 timeout: 927 lvb_type: 0 00000100:00100000:3.0:1746129571.776908:0:7148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f37fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:7148:1830948737526400:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129571.776936:0:31503:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+18:32317:x1830948734146176:12345-192.168.202.4@tcp:101:cat.0 Request processed in 186us (957us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129571.776943:0:31503:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16248 00000100:00100000:3.0:1746129571.777153:0:7148:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5ac93c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746129571.780559:0:7148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f37fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:7148:1830948737526400:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129571.780596:0:7148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a95ece00/0x40a459093b06a03c lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f211cf expref: 28 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.780614:0:7148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a95ece00, rc 0) 00000100:00100000:3.0:1746129571.780660:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ada2ffba-8920-4ecb-8068-68caa9806978+28:32320:x1830948734146304:12345-192.168.202.4@tcp:101:cat.0 Request processed in 3894us (4107us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129571.780669:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16249 00000100:00100000:0.0:1746129571.784568:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129571.786843:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734146432 00000100:00100000:3.0:1746129571.786857:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734146432 00010000:00010000:3.0:1746129571.786906:0:9823:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012e94d000/0x40a459093b069fb7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2116d expref: 11 pid: 31503 timeout: 927 lvb_type: 0 00000100:00100000:3.0:1746129571.786945:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8326 00000100:00100000:3.0:1746129571.786952:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:068dab75-d300-4ead-a742-d14572ad1e50+11:1963:x1830948734146432:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129571.786966:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129571.786990:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012e94d000/0x40a459093b069fb7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2116d expref: 11 pid: 31503 timeout: 927 lvb_type: 0 00010000:00010000:3.0:1746129571.787001:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012e94d000/0x40a459093b069fb7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2116d expref: 11 pid: 31503 timeout: 927 lvb_type: 0 00010000:00010000:3.0:1746129571.787024:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e94d000/0x40a459093b069fb7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2116d expref: 11 pid: 31503 timeout: 927 lvb_type: 0 00010000:00010000:3.0:1746129571.787052:0:9823:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129571.787054:0:9823:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129571.787061:0:9823:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a95ece00/0x40a459093b06a03c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f211cf expref: 27 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.787069:0:9823:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a95ece00/0x40a459093b06a03c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f211cf expref: 27 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.787076:0:9823:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129571.787077:0:9823:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129571.787080:0:9823:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b4e59800/0x40a459093b06a043 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f211d6 expref: 17 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.787088:0:9823:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b4e59800/0x40a459093b06a043 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f211d6 expref: 17 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.787122:0:9823:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800b4e59800/0x40a459093b06a043 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f211d6 expref: 17 pid: 31503 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129571.787134:0:9823:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f37fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9823:1830948737526528:192.168.202.4@tcp:105: 00010000:00010000:3.0:1746129571.787233:0:9823:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a95ece00/0x40a459093b06a03c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f211cf expref: 27 pid: 7148 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129571.787241:0:9823:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f37c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9823:1830948737526656:192.168.202.4@tcp:105: 00000100:00100000:3.0:1746129571.787259:0:9823:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5ac93c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746129571.789812:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129571.789893:0:16908:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734146688 00000100:00100000:2.0:1746129571.789902:0:16908:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734146688 00000100:00100000:2.0:1746129571.789949:0:16908:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11227 00000100:00100000:2.0:1746129571.789956:0:16908:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b550e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+10:32325:x1830948734146688:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:2.0:1746129571.789980:0:16908:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129571.789999:0:16908:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0b5800/0x40a459093b06a04a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f211dd expref: -99 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129571.790115:0:16908:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0b4800/0x40a459093b06a051 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129571.790128:0:16908:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0b4800/0x40a459093b06a051 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129571.790141:0:16908:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0b4800/0x40a459093b06a051 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129571.790155:0:16908:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0b4000/0x40a459093b06a058 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129571.790161:0:16908:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0b4000/0x40a459093b06a058 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129571.790166:0:16908:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0b4000/0x40a459093b06a058 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129571.790270:0:16908:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0b4a00/0x40a459093b06a05f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129571.790277:0:16908:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0b4a00/0x40a459093b06a05f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129571.790282:0:16908:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0b4a00/0x40a459093b06a05f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00000004:00200000:2.0:1746129571.790291:0:16908:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:2.0:1746129571.790402:0:16908:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0b4800/0x40a459093b06a051 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129571.790409:0:16908:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0b4800/0x40a459093b06a051 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129571.790418:0:16908:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0b4800/0x40a459093b06a051 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129571.790424:0:16908:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e0b4800 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746129571.790427:0:16908:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0b4800/0x40a459093b06a051 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129571.790434:0:16908:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0b4800/0x40a459093b06a051 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129571.790444:0:16908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880132ef8f00) 00010000:00010000:2.0:1746129571.790447:0:16908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129571.790450:0:16908:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0b4800/0x40a459093b06a051 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129571.790455:0:16908:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0b4800/0x40a459093b06a051 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129571.790482:0:16908:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0b4000/0x40a459093b06a058 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129571.790487:0:16908:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0b4000/0x40a459093b06a058 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129571.790492:0:16908:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0b4000/0x40a459093b06a058 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129571.790496:0:16908:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e0b4000 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746129571.790498:0:16908:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0b4000/0x40a459093b06a058 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129571.790502:0:16908:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0b4000/0x40a459093b06a058 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129571.790511:0:16908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880136997f00) 00010000:00010000:2.0:1746129571.790513:0:16908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129571.790515:0:16908:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0b4000/0x40a459093b06a058 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129571.790519:0:16908:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0b4000/0x40a459093b06a058 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129571.790556:0:16908:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0b5800/0x40a459093b06a04a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f211dd expref: 13 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129571.790567:0:16908:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0b4a00/0x40a459093b06a05f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f211dd expref: 12 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129571.790573:0:16908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:2.0:1746129571.790574:0:16908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746129571.790577:0:16908:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e0b4a00, rc 0) 00000100:00100000:2.0:1746129571.791676:0:16908:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b550e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+12:32325:x1830948734146688:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 1714us (1869us total) trans 8589945319 rc 0/0 00000100:00100000:2.0:1746129571.791685:0:16908:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11227 00000100:00100000:3.0:1746129571.792967:0:9823:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f37fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9823:1830948737526528:192.168.202.4@tcp:105: 00000100:00100000:3.0:1746129571.792980:0:9823:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f37c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9823:1830948737526656:192.168.202.4@tcp:105: 00010000:00010000:3.0:1746129571.793004:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129571.793046:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:068dab75-d300-4ead-a742-d14572ad1e50+10:1963:x1830948734146432:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 6094us (8489us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129571.793055:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8326 00000100:00100000:3.0:1746129571.797788:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129571.797831:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129571.797993:0:31521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734146944 00000100:00100000:2.0:1746129571.798003:0:31521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734146944 00002000:00100000:2.0:1746129571.798050:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff88009f37c380 x1830948734146944/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:312/0 lens 488/0 e 0 to 0 dl 1746129582 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129571.798059:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f37c380 with x1830948734146944 ext(1048576->2097151) 00002000:00010000:2.0:1746129571.798064:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f37c380 00000100:00100000:2.0:1746129571.798078:0:31521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734147200 00000100:00100000:2.0:1746129571.798080:0:31521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734147200 00002000:00100000:2.0:1746129571.798090:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff88009f37fb80 x1830948734147200/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:312/0 lens 488/0 e 0 to 0 dl 1746129582 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129571.798096:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f37fb80 with x1830948734147200 ext(1048576->2097151) 00002000:00010000:2.0:1746129571.798099:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f37fb80 00000100:00100000:2.0:1746129571.798122:0:31521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7813 00000100:00100000:2.0:1746129571.798129:0:31521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f37c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ada2ffba-8920-4ecb-8068-68caa9806978+28:1963:x1830948734146944:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:1.0:1746129571.798156:0:8416:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7814 00000100:00100000:1.0:1746129571.798164:0:8416:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f37fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+18:1962:x1830948734147200:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:0.0:1746129571.803877:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129571.803951:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734147328 00000100:00100000:3.0:1746129571.803961:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734147328 00000100:00100000:3.0:1746129571.804031:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 790 00000100:00100000:3.0:1746129571.804039:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+12:1962:x1830948734147328:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129571.804056:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129571.804081:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0b4a00/0x40a459093b06a05f lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f211dd expref: 12 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.804108:0:9823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:3.0:1746129571.804113:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129571.804165:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+11:1962:x1830948734147328:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 127us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129571.804171:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 790 00000100:00100000:2.0:1746129571.812229:0:31521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f37c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ada2ffba-8920-4ecb-8068-68caa9806978+28:1963:x1830948734146944:12345-192.168.202.4@tcp:3:cat.0 Request processed in 14087us (14440us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129571.812242:0:31521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7813 00002000:00100000:2.0:1746129571.812255:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff88009f37c380 x1830948734146944/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:312/0 lens 488/440 e 0 to 0 dl 1746129582 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129571.812265:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f37c380 with x1830948734146944 ext(1048576->2097151) 00002000:00010000:2.0:1746129571.812272:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f37c380 00000100:00100000:1.0:1746129571.818612:0:8416:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f37fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+18:1962:x1830948734147200:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 20436us (20767us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129571.818626:0:8416:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7814 00002000:00100000:1.0:1746129571.818639:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff88009f37fb80 x1830948734147200/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:312/0 lens 488/440 e 0 to 0 dl 1746129582 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129571.818656:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f37fb80 with x1830948734147200 ext(1048576->2097151) 00002000:00010000:1.0:1746129571.818663:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f37fb80 00000100:00100000:0.0:1746129571.820079:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129571.820154:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734147456 00000100:00100000:3.0:1746129571.820163:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734147456 00000100:00100000:3.0:1746129571.820222:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16250 00000100:00100000:3.0:1746129571.820231:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ada2ffba-8920-4ecb-8068-68caa9806978+28:32320:x1830948734147456:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129571.820248:0:7148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129571.820269:0:7148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880132eddc00/0x40a459093b06a06d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f211e4 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.820333:0:7148:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b5384a00/0x40a459093b069fbe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21174 expref: 9 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.820341:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129571.820343:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129571.820346:0:7148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880132eddc00/0x40a459093b06a06d lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f211e4 expref: 29 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.820380:0:7148:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b5384a00/0x40a459093b069fbe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21174 expref: 9 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.820397:0:7148:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b5384a00/0x40a459093b069fbe lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21174 expref: 9 pid: 31503 timeout: 927 lvb_type: 0 00000100:00100000:3.0:1746129571.820408:0:7148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f37d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:7148:1830948737526784:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129571.820493:0:7148:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5ac93c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129571.823073:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129571.824127:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129571.824202:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734147584 00000100:00100000:3.0:1746129571.824212:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734147584 00000100:00100000:3.0:1746129571.824267:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734147712 00000100:00100000:3.0:1746129571.824270:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734147712 00000100:00100000:3.0:1746129571.824291:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16251 00000100:00100000:3.0:1746129571.824337:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+19:32317:x1830948734147584:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129571.824357:0:4385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129571.824374:0:4385:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880132edd800/0x40a459093b06a074 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f211eb expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.824401:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129571.824407:0:4385:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880132edd800/0x40a459093b06a074 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f211eb expref: 20 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.824419:0:4385:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880132edd800/0x40a459093b06a074 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f211eb expref: 20 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.824430:0:4385:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132edd800, rc 0) 00000100:00100000:3.0:1746129571.824472:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:32317:x1830948734147584:12345-192.168.202.4@tcp:101:cat.0 Request processed in 137us (1407us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129571.824478:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16251 00000100:00100000:3.0:1746129571.824494:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16252 00000100:00100000:3.0:1746129571.824498:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+19:32325:x1830948734147712:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:3.0:1746129571.824503:0:4385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129571.824508:0:4385:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880132edd000/0x40a459093b06a07b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f211f2 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.824521:0:4385:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a95ece00/0x40a459093b06a03c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f211cf expref: 29 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.824528:0:4385:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b4e59800/0x40a459093b06a043 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f211d6 expref: 20 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.824533:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129571.824534:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129571.824536:0:4385:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880132edd000/0x40a459093b06a07b lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [1351680->1425407] (req 1351680->1425407) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f211f2 expref: 20 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.824561:0:4385:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b4e59800/0x40a459093b06a043 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f211d6 expref: 20 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.824569:0:4385:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b4e59800/0x40a459093b06a043 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f211d6 expref: 20 pid: 31503 timeout: 927 lvb_type: 0 00000100:00100000:3.0:1746129571.824579:0:4385:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f37d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:4385:1830948737526912:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129571.824629:0:4385:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a95ece00/0x40a459093b06a03c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f211cf expref: 29 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.824641:0:4385:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a95ece00/0x40a459093b06a03c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f211cf expref: 29 pid: 7148 timeout: 927 lvb_type: 0 00000100:00100000:3.0:1746129571.824647:0:4385:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f37f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:4385:1830948737527040:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129571.824661:0:4385:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5ac9f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746129571.828600:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129571.828667:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734147840 00000100:00100000:2.0:1746129571.828676:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734147840 00000100:00100000:0.0:1746129571.828678:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00010000:00010000:2.0:1746129571.828716:0:9823:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b5384a00/0x40a459093b069fbe lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21174 expref: 10 pid: 31503 timeout: 927 lvb_type: 0 00000100:00100000:2.0:1746129571.828740:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734147968 00000100:00100000:2.0:1746129571.828743:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734147968 00010000:00010000:2.0:1746129571.828754:0:9823:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b4e59800/0x40a459093b06a043 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f211d6 expref: 21 pid: 31503 timeout: 927 lvb_type: 0 00000100:00100000:2.0:1746129571.828770:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8327 00000100:00100000:2.0:1746129571.828777:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959d6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:068dab75-d300-4ead-a742-d14572ad1e50+10:1963:x1830948734147840:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129571.828794:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129571.828818:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b5384a00/0x40a459093b069fbe lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21174 expref: 10 pid: 31503 timeout: 927 lvb_type: 0 00010000:00010000:2.0:1746129571.828828:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b5384a00/0x40a459093b069fbe lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21174 expref: 10 pid: 31503 timeout: 927 lvb_type: 0 00010000:00010000:2.0:1746129571.828853:0:9823:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129571.828855:0:9823:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129571.828862:0:9823:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880132eddc00/0x40a459093b06a06d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f211e4 expref: 29 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129571.828871:0:9823:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880132eddc00/0x40a459093b06a06d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f211e4 expref: 29 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129571.828884:0:9823:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129571.828885:0:9823:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129571.828889:0:9823:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880132edd800/0x40a459093b06a074 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f211eb expref: 21 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129571.828894:0:9823:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880132edd800/0x40a459093b06a074 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f211eb expref: 21 pid: 4385 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129571.828918:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8328 00010000:00010000:2.0:1746129571.828925:0:9823:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880132edd800/0x40a459093b06a074 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f211eb expref: 21 pid: 4385 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129571.828925:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a47450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:1960:x1830948734147968:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129571.828932:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746129571.828937:0:9823:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f95ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9823:1830948737527168:192.168.202.4@tcp:105: 00010000:00010000:1.0:1746129571.828942:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b4e59800/0x40a459093b06a043 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f211d6 expref: 21 pid: 31503 timeout: 927 lvb_type: 0 00010000:00010000:1.0:1746129571.828949:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b4e59800/0x40a459093b06a043 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f211d6 expref: 21 pid: 31503 timeout: 927 lvb_type: 0 00010000:00010000:1.0:1746129571.828960:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746129571.829015:0:9823:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880132eddc00/0x40a459093b06a06d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f211e4 expref: 29 pid: 7148 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129571.829022:0:9823:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f95b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9823:1830948737527296:192.168.202.4@tcp:105: 00010000:00010000:3.0:1746129571.829038:0:7148:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b5384a00/0x40a459093b069fbe lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21174 expref: 10 pid: 31503 timeout: 927 lvb_type: 0 00000100:00100000:3.0:1746129571.829256:0:7148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f37d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:7148:1830948737526784:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129571.829289:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a47450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:1960:x1830948734147968:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 365us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129571.829334:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8328 00000100:00100000:2.0:1746129571.829365:0:9823:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009af1e0c0 going to sleep for 11 seconds 00010000:00010000:3.0:1746129571.829411:0:7148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880132eddc00/0x40a459093b06a06d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f211e4 expref: 29 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.829421:0:7148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132eddc00, rc 0) 00000100:00100000:3.0:1746129571.829443:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ada2ffba-8920-4ecb-8068-68caa9806978+29:32320:x1830948734147456:12345-192.168.202.4@tcp:101:cat.0 Request processed in 9215us (9373us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129571.829450:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16250 00010000:00010000:3.0:1746129571.829478:0:4385:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b4e59800/0x40a459093b06a043 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f211d6 expref: 20 pid: 31503 timeout: 927 lvb_type: 0 00000100:00100000:3.0:1746129571.829487:0:4385:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f37d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:4385:1830948737526912:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129571.829495:0:4385:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f37f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:4385:1830948737527040:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129571.829509:0:4385:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880132edd000/0x40a459093b06a07b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1351680->1425407] (req 1351680->1425407) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f211f2 expref: 19 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.829522:0:4385:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132edd000, rc 0) 00000100:00100000:3.0:1746129571.829535:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+19:32325:x1830948734147712:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 5037us (5411us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129571.829540:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16252 00000100:00100000:0.0:1746129571.833678:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129571.834175:0:9823:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f95ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9823:1830948737527168:192.168.202.4@tcp:105: 00000100:00100000:2.0:1746129571.834187:0:9823:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f95b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9823:1830948737527296:192.168.202.4@tcp:105: 00010000:00010000:2.0:1746129571.834210:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129571.834338:0:20578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734148096 00000100:00100000:3.0:1746129571.834345:0:20578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734148096 00010000:00010000:3.0:1746129571.834379:0:20578:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a95ece00/0x40a459093b06a03c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f211cf expref: 29 pid: 7148 timeout: 927 lvb_type: 0 00000100:00100000:2.0:1746129571.835103:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959d6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:068dab75-d300-4ead-a742-d14572ad1e50+9:1963:x1830948734147840:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 6322us (6510us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129571.835111:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8327 00000100:00100000:2.0:1746129571.835168:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8329 00000100:00100000:2.0:1746129571.835174:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa24700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ada2ffba-8920-4ecb-8068-68caa9806978+29:1961:x1830948734148096:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129571.835186:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129571.835208:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a95ece00/0x40a459093b06a03c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f211cf expref: 29 pid: 7148 timeout: 927 lvb_type: 0 00010000:00010000:2.0:1746129571.835221:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a95ece00/0x40a459093b06a03c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f211cf expref: 29 pid: 7148 timeout: 927 lvb_type: 0 00010000:00010000:2.0:1746129571.835243:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a95ece00/0x40a459093b06a03c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f211cf expref: 29 pid: 7148 timeout: 927 lvb_type: 0 00010000:00010000:2.0:1746129571.835265:0:9823:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129571.835266:0:9823:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129571.835274:0:9823:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880132edd000/0x40a459093b06a07b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1351680->1425407) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f211f2 expref: 18 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129571.835282:0:9823:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880132edd000/0x40a459093b06a07b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1351680->1425407) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f211f2 expref: 18 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129571.835351:0:9823:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880132edd000/0x40a459093b06a07b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1351680->1425407) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f211f2 expref: 18 pid: 4385 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129571.835363:0:9823:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f95b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9823:1830948737527424:192.168.202.4@tcp:105: 00000100:00100000:2.0:1746129571.835419:0:9823:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009af1e540 going to sleep for 11 seconds 00000100:00100000:0.0:1746129571.842143:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129571.842241:0:8416:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734148352 00000100:00100000:1.0:1746129571.842251:0:8416:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734148352 00002000:00100000:1.0:1746129571.842341:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3f4:0x0] (1048576->2097151) req@ffff88009fa24e00 x1830948734148352/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:312/0 lens 488/0 e 0 to 0 dl 1746129582 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129571.842352:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fa24e00 with x1830948734148352 ext(1048576->2097151) 00002000:00010000:1.0:1746129571.842358:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fa24e00 00000100:00100000:1.0:1746129571.842394:0:8416:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7815 00000100:00100000:1.0:1746129571.842403:0:8416:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ada2ffba-8920-4ecb-8068-68caa9806978+29:1961:x1830948734148352:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:2.0:1746129571.859053:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129571.859202:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129571.859254:0:9823:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f95b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9823:1830948737527424:192.168.202.4@tcp:105: 00010000:00010000:2.0:1746129571.859276:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129571.859368:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa24700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ada2ffba-8920-4ecb-8068-68caa9806978+30:1961:x1830948734148096:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 24192us (25699us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129571.859379:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8329 00000100:00100000:3.0:1746129571.859484:0:16908:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734148608 00000100:00100000:3.0:1746129571.859492:0:16908:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734148608 00000100:00100000:3.0:1746129571.859540:0:16908:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11228 00000100:00100000:3.0:1746129571.859547:0:16908:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f95ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ada2ffba-8920-4ecb-8068-68caa9806978+292:32328:x1830948734148608:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:3.0:1746129571.859568:0:16908:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129571.859586:0:16908:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880132edc600/0x40a459093b06a082 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f211f9 expref: -99 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.859695:0:16908:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880132edc800/0x40a459093b06a089 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129571.859708:0:16908:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880132edc800/0x40a459093b06a089 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129571.859719:0:16908:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880132edc800/0x40a459093b06a089 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129571.859731:0:16908:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880132edde00/0x40a459093b06a090 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129571.859740:0:16908:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880132edde00/0x40a459093b06a090 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129571.859745:0:16908:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880132edde00/0x40a459093b06a090 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129571.859861:0:16908:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880132edc400/0x40a459093b06a097 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129571.859870:0:16908:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880132edc400/0x40a459093b06a097 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129571.859875:0:16908:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880132edc400/0x40a459093b06a097 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00000004:00200000:3.0:1746129571.859884:0:16908:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:3.0:1746129571.859971:0:16908:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880132edc800/0x40a459093b06a089 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129571.859978:0:16908:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880132edc800/0x40a459093b06a089 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129571.859983:0:16908:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880132edc800/0x40a459093b06a089 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129571.859987:0:16908:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880132edc800 already unused, calling callback (ffffffffa136e690) 00010000:00010000:3.0:1746129571.859991:0:16908:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880132edc800/0x40a459093b06a089 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129571.859998:0:16908:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880132edc800/0x40a459093b06a089 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129571.860007:0:16908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880132ef8f00) 00010000:00010000:3.0:1746129571.860011:0:16908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129571.860015:0:16908:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880132edc800/0x40a459093b06a089 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129571.860019:0:16908:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880132edc800/0x40a459093b06a089 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16908 initiator: MDT0 00000100:00100000:0.0:1746129571.860405:0:31521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734148864 00000100:00100000:0.0:1746129571.860410:0:31521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734148864 00002000:00100000:0.0:1746129571.860437:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f3:0x0] (1351680->1355775) req@ffff88009f95b100 x1830948734148864/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:312/0 lens 488/0 e 0 to 0 dl 1746129582 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129571.860446:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f95b100 with x1830948734148864 ext(1351680->1355775) 00002000:00010000:0.0:1746129571.860451:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f95b100 00000100:00100000:0.0:1746129571.860472:0:31519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7816 00000100:00100000:0.0:1746129571.860477:0:31519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f95b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+19:1962:x1830948734148864:12345-192.168.202.4@tcp:3:multiop.0 00010000:00010000:3.0:1746129571.861964:0:16908:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880132edde00/0x40a459093b06a090 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129571.861978:0:16908:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880132edde00/0x40a459093b06a090 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129571.861986:0:16908:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880132edde00/0x40a459093b06a090 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129571.861992:0:16908:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880132edde00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:3.0:1746129571.861996:0:16908:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880132edde00/0x40a459093b06a090 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129571.862002:0:16908:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880132edde00/0x40a459093b06a090 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129571.862014:0:16908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f9bad00) 00010000:00010000:3.0:1746129571.862017:0:16908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129571.862019:0:16908:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880132edde00/0x40a459093b06a090 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129571.862024:0:16908:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880132edde00/0x40a459093b06a090 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129571.862082:0:16908:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880132edc600/0x40a459093b06a082 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f211f9 expref: 295 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.862102:0:16908:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880132edc400/0x40a459093b06a097 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f211f9 expref: 294 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.862108:0:16908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:3.0:1746129571.862111:0:16908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746129571.862113:0:16908:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132edc400, rc 0) 00000100:00100000:3.0:1746129571.863359:0:16908:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f95ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ada2ffba-8920-4ecb-8068-68caa9806978+294:32328:x1830948734148608:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 3803us (4309us total) trans 8589945320 rc 0/0 00000100:00100000:3.0:1746129571.863370:0:16908:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11228 00000100:00100000:0.0:1746129571.864136:0:31519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f95b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+19:1962:x1830948734148864:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 3654us (4930us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746129571.864147:0:31519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7816 00002000:00100000:0.0:1746129571.864162:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f3:0x0] (1351680->1355775) req@ffff88009f95b100 x1830948734148864/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:312/0 lens 488/4536 e 0 to 0 dl 1746129582 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129571.864171:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f95b100 with x1830948734148864 ext(1351680->1355775) 00002000:00010000:0.0:1746129571.864178:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f95b100 00000100:00100000:1.0:1746129571.864497:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129571.864590:0:31521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734149120 00000100:00100000:0.0:1746129571.864598:0:31521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734149120 00002000:00100000:0.0:1746129571.864632:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f4:0x0] (1048576->2097151) req@ffff88012b552300 x1830948734149120/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:312/0 lens 488/0 e 0 to 0 dl 1746129582 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129571.864639:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b552300 with x1830948734149120 ext(1048576->2097151) 00002000:00010000:0.0:1746129571.864642:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b552300 00000100:00100000:0.0:1746129571.864655:0:31521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7817 00000100:00100000:0.0:1746129571.864661:0:31521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b552300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+19:1961:x1830948734149120:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:2.0:1746129571.868948:0:8416:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ada2ffba-8920-4ecb-8068-68caa9806978+28:1961:x1830948734148352:12345-192.168.202.4@tcp:3:cat.0 Request processed in 26534us (26804us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129571.868961:0:8416:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7815 00002000:00100000:2.0:1746129571.868975:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3f4:0x0] (1048576->2097151) req@ffff88009fa24e00 x1830948734148352/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:312/0 lens 488/440 e 0 to 0 dl 1746129582 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129571.868985:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fa24e00 with x1830948734148352 ext(1048576->2097151) 00002000:00010000:2.0:1746129571.868991:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fa24e00 00000100:00100000:0.0:1746129571.878428:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129571.878487:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129571.878528:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734149376 00000100:00100000:0.0:1746129571.878537:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734149376 00000100:00100000:0.0:1746129571.878601:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 791 00000100:00100000:0.0:1746129571.878609:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa24a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ada2ffba-8920-4ecb-8068-68caa9806978+294:1961:x1830948734149376:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129571.878625:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129571.878652:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880132edc400/0x40a459093b06a097 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f211f9 expref: 294 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129571.878675:0:9823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:0.0:1746129571.878680:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129571.878725:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa24a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ada2ffba-8920-4ecb-8068-68caa9806978+293:1961:x1830948734149376:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 115us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129571.878732:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 791 00000100:00100000:3.0:1746129571.879091:0:8416:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734149504 00000100:00100000:3.0:1746129571.879095:0:8416:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734149504 00002000:00100000:3.0:1746129571.879124:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3f3:0x0] (1421312->1425407) req@ffff88009fa25c00 x1830948734149504/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:312/0 lens 488/0 e 0 to 0 dl 1746129582 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129571.879133:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fa25c00 with x1830948734149504 ext(1421312->1425407) 00002000:00010000:3.0:1746129571.879136:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fa25c00 00000100:00100000:3.0:1746129571.879149:0:8416:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7818 00000100:00100000:3.0:1746129571.879153:0:8416:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:1963:x1830948734149504:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:3.0:1746129571.879344:0:8416:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:1963:x1830948734149504:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 190us (928us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129571.879350:0:8416:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7818 00002000:00100000:3.0:1746129571.879355:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3f3:0x0] (1421312->1425407) req@ffff88009fa25c00 x1830948734149504/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:312/0 lens 488/4536 e 0 to 0 dl 1746129582 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129571.879363:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fa25c00 with x1830948734149504 ext(1421312->1425407) 00002000:00010000:3.0:1746129571.879365:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fa25c00 00000100:00100000:1.0:1746129571.883993:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129571.884176:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734149632 00000100:00100000:3.0:1746129571.884187:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734149632 00000100:00100000:3.0:1746129571.884251:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16253 00000100:00100000:3.0:1746129571.884259:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b552a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ada2ffba-8920-4ecb-8068-68caa9806978+24:32320:x1830948734149632:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129571.884279:0:4385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129571.884351:0:4385:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ee7f400/0x40a459093b06a0a5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21200 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.884383:0:4385:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c22dc00/0x40a459093b069fcc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21189 expref: 9 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.884391:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129571.884393:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129571.884396:0:4385:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ee7f400/0x40a459093b06a0a5 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21200 expref: 25 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.884427:0:4385:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c22dc00/0x40a459093b069fcc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21189 expref: 9 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.884439:0:4385:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c22dc00/0x40a459093b069fcc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21189 expref: 9 pid: 31503 timeout: 927 lvb_type: 0 00000100:00100000:3.0:1746129571.884453:0:4385:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f37f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:4385:1830948737527552:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129571.884538:0:4385:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5ac9f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746129571.886554:0:31521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b552300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+19:1961:x1830948734149120:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 21884us (22049us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129571.886565:0:31521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7817 00002000:00100000:0.0:1746129571.886577:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f4:0x0] (1048576->2097151) req@ffff88012b552300 x1830948734149120/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:312/0 lens 488/440 e 0 to 0 dl 1746129582 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129571.886586:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b552300 with x1830948734149120 ext(1048576->2097151) 00002000:00010000:0.0:1746129571.886591:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b552300 00000100:00100000:0.0:1746129571.892063:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129571.892149:0:20861:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734149888 00000100:00100000:2.0:1746129571.892158:0:20861:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734149888 00000100:00100000:0.0:1746129571.893666:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129571.893714:0:4385:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f37f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:4385:1830948737527552:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129571.893750:0:4385:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ee7f400/0x40a459093b06a0a5 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21200 expref: 25 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.893773:0:4385:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ee7f400, rc 0) 00000100:00100000:2.0:1746129571.895486:0:20861:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4764 00000100:00100000:2.0:1746129571.895503:0:20861:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+11:32325:x1830948734149888:12345-192.168.202.4@tcp:35:multiop.0 00000100:00100000:3.0:1746129571.896282:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b552a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ada2ffba-8920-4ecb-8068-68caa9806978+25:32320:x1830948734149632:12345-192.168.202.4@tcp:101:cat.0 Request processed in 12020us (12295us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129571.896290:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16253 00000100:00100000:2.0:1746129571.896517:0:20861:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+12:32325:x1830948734149888:12345-192.168.202.4@tcp:35:multiop.0 Request processed in 1019us (4468us total) trans 8589945321 rc 0/0 00000100:00100000:2.0:1746129571.896524:0:20861:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4764 00000100:00100000:0.0:1746129571.897631:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129571.897731:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734150016 00000100:00100000:1.0:1746129571.897743:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734150016 00010000:00010000:1.0:1746129571.897778:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c22dc00/0x40a459093b069fcc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21189 expref: 10 pid: 31503 timeout: 927 lvb_type: 0 00000100:00100000:1.0:1746129571.897806:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8330 00000100:00100000:1.0:1746129571.897811:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa25f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:068dab75-d300-4ead-a742-d14572ad1e50+10:1960:x1830948734150016:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129571.897822:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129571.897842:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c22dc00/0x40a459093b069fcc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21189 expref: 10 pid: 31503 timeout: 927 lvb_type: 0 00010000:00010000:1.0:1746129571.897854:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c22dc00/0x40a459093b069fcc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21189 expref: 10 pid: 31503 timeout: 927 lvb_type: 0 00010000:00010000:1.0:1746129571.897879:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c22dc00/0x40a459093b069fcc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21189 expref: 10 pid: 31503 timeout: 927 lvb_type: 0 00010000:00010000:1.0:1746129571.897905:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129571.897907:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129571.897915:0:7085:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ee7f400/0x40a459093b06a0a5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21200 expref: 24 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129571.897924:0:7085:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ee7f400/0x40a459093b06a0a5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21200 expref: 24 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129571.897962:0:7085:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009ee7f400/0x40a459093b06a0a5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21200 expref: 24 pid: 4385 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129571.897976:0:7085:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b553100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7085:1830948737527680:192.168.202.4@tcp:105: 00000100:00100000:1.0:1746129571.898044:0:7085:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934d2b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746129571.898158:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734150144 00000100:00100000:3.0:1746129571.898162:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734150144 00000100:00100000:3.0:1746129571.898184:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16254 00000100:00100000:3.0:1746129571.898189:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+13:32317:x1830948734150144:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129571.898200:0:4385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129571.898210:0:4385:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ee7fc00/0x40a459093b06a0ac lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21207 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.898223:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129571.898225:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129571.898228:0:4385:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ee7fc00/0x40a459093b06a0ac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21207 expref: 14 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.898239:0:4385:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ee7fc00/0x40a459093b06a0ac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21207 expref: 14 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129571.898247:0:4385:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ee7fc00, rc 0) 00000100:00100000:3.0:1746129571.898266:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+14:32317:x1830948734150144:12345-192.168.202.4@tcp:101:cat.0 Request processed in 77us (640us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129571.898271:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16254 00000100:00100000:1.0:1746129571.906129:0:7085:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b553100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7085:1830948737527680:192.168.202.4@tcp:105: 00010000:00010000:1.0:1746129571.906155:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129571.906205:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa25f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:068dab75-d300-4ead-a742-d14572ad1e50+9:1960:x1830948734150016:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 8391us (12541us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129571.906215:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8330 00000100:00100000:0.0:1746129571.928025:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129571.930530:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129571.943949:0:31521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734150400 00000100:00100000:1.0:1746129571.943966:0:31521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734150400 00002000:00100000:1.0:1746129571.944057:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3ee:0x0] (1048576->2097151) req@ffff88009fa27b80 x1830948734150400/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:312/0 lens 488/0 e 0 to 0 dl 1746129582 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129571.944068:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fa27b80 with x1830948734150400 ext(1048576->2097151) 00002000:00010000:1.0:1746129571.944075:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fa27b80 00000100:00100000:1.0:1746129571.948751:0:31521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734150656 00000100:00100000:1.0:1746129571.948765:0:31521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734150656 00002000:00100000:1.0:1746129571.948827:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3ee:0x0] (1048576->2097151) req@ffff88009fa25180 x1830948734150656/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:312/0 lens 488/0 e 0 to 0 dl 1746129582 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129571.948838:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fa25180 with x1830948734150656 ext(1048576->2097151) 00002000:00010000:1.0:1746129571.948845:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fa25180 00000100:00100000:1.0:1746129571.948870:0:31521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7819 00000100:00100000:1.0:1746129571.948878:0:31521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ada2ffba-8920-4ecb-8068-68caa9806978+25:1963:x1830948734150400:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:3.0:1746129571.950665:0:8416:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7820 00000100:00100000:3.0:1746129571.950680:0:8416:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+14:1961:x1830948734150656:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:3.0:1746129571.974708:0:8416:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+14:1961:x1830948734150656:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 24024us (44178us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129571.974708:0:31521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ada2ffba-8920-4ecb-8068-68caa9806978+25:1963:x1830948734150400:12345-192.168.202.4@tcp:3:cat.0 Request processed in 25819us (46682us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129571.974719:0:8416:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7820 00000100:00100000:1.0:1746129571.974724:0:31521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7819 00002000:00100000:3.0:1746129571.974732:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3ee:0x0] (1048576->2097151) req@ffff88009fa25180 x1830948734150656/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:312/0 lens 488/440 e 0 to 0 dl 1746129582 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129571.974732:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3ee:0x0] (1048576->2097151) req@ffff88009fa27b80 x1830948734150400/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:312/0 lens 488/440 e 0 to 0 dl 1746129582 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129571.974741:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fa25180 with x1830948734150656 ext(1048576->2097151) 00002000:00100000:1.0:1746129571.974741:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fa27b80 with x1830948734150400 ext(1048576->2097151) 00002000:00010000:3.0:1746129571.974747:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fa25180 00002000:00010000:1.0:1746129571.974747:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fa27b80 00000100:00100000:0.0:1746129571.984124:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129571.984187:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129571.984254:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734150912 00000100:00100000:3.0:1746129571.984266:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734150912 00000100:00100000:2.0:1746129571.984275:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734150784 00000100:00100000:2.0:1746129571.984278:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734150784 00000100:00100000:3.0:1746129571.984358:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16255 00000100:00100000:3.0:1746129571.984366:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+19:1961:x1830948734150912:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129571.984388:0:4385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129571.984408:0:4385:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ee7e400/0x40a459093b06a0b3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21215 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129571.984466:0:4385:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f37f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:4385:1830948737527808:192.168.202.4@tcp:106: 00000100:00100000:3.0:1746129571.984546:0:4385:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5ac9f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746129571.985596:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16256 00000100:00100000:3.0:1746129571.985608:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+14:1961:x1830948734150784:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129571.985622:0:7148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129571.985637:0:7148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ee7e200/0x40a459093b06a0ba lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2120e expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129571.985673:0:7148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f37d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7148:1830948737527936:192.168.202.4@tcp:106: 00000100:00100000:3.0:1746129571.985721:0:7148:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5ac90c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129571.993125:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129571.993973:0:31503:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734151168 00000100:00100000:1.0:1746129571.993985:0:31503:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734151168 00000100:00100000:0.0:1746129571.994163:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129571.994975:0:31503:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734151040 00000100:00100000:1.0:1746129571.994980:0:31503:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734151040 00000100:00100000:0.0:1746129571.994996:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129571.995184:0:31503:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734151296 00000100:00100000:1.0:1746129571.995188:0:31503:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734151296 00000100:00100000:0.0:1746129571.995200:0:8410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16257 00000100:00100000:0.0:1746129571.995210:0:8410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ada2ffba-8920-4ecb-8068-68caa9806978+25:1962:x1830948734151168:12345-192.168.202.4@tcp:101:cat.0 00000100:00100000:1.0:1746129571.995247:0:4699:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16258 00000100:00100000:2.0:1746129571.995262:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16259 00000100:00100000:2.0:1746129571.995269:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ada2ffba-8920-4ecb-8068-68caa9806978+29:1962:x1830948734151296:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129571.995284:0:7149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129571.995331:0:7149:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800955d2c00/0x40a459093b06a0c1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2122a expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129571.995390:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f95b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7149:1830948737528064:192.168.202.4@tcp:106: 00000100:00100000:2.0:1746129571.995466:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009af1e900 going to sleep for 11 seconds 00010000:00010000:0.0:1746129571.995501:0:8410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129571.995513:0:8410:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0640c00/0x40a459093b06a0c8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21223 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129571.995541:0:8410:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fa24380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8410:1830948737528192:192.168.202.4@tcp:106: 00000100:00100000:0.0:1746129571.995566:0:8410:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e29fcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746129571.995941:0:4699:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ada2ffba-8920-4ecb-8068-68caa9806978+30:1962:x1830948734151040:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129571.995948:0:4699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129571.995956:0:4699:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095f11000/0x40a459093b06a0cf lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2121c expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129571.995981:0:4699:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b553100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4699:1830948737528320:192.168.202.4@tcp:106: 00000100:00100000:1.0:1746129571.996001:0:4699:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934d2b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746129571.996605:0:7148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f37d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7148:1830948737527936:192.168.202.4@tcp:106: 00010000:00010000:0.0:1746129571.996633:0:7148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ee7e200/0x40a459093b06a0ba lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2120e expref: 15 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129571.996644:0:7148:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ee7e200/0x40a459093b06a0ba lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2120e expref: 15 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129571.996660:0:7148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ee7e200, rc 0) 00000100:00100000:0.0:1746129571.996690:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+14:1961:x1830948734150784:12345-192.168.202.4@tcp:101:cat.0 Request processed in 11086us (12502us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129571.996698:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16256 00000100:00100000:2.0:1746129571.997035:0:4385:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f37f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:4385:1830948737527808:192.168.202.4@tcp:106: 00010000:00010000:2.0:1746129571.997053:0:4385:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ee7e400/0x40a459093b06a0b3 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21215 expref: 20 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129571.997061:0:4385:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ee7e400/0x40a459093b06a0b3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21215 expref: 20 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129571.997082:0:4385:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ee7e400, rc 0) 00000100:00100000:2.0:1746129571.997104:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+19:1961:x1830948734150912:12345-192.168.202.4@tcp:101:cat.0 Request processed in 12739us (12993us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129571.997112:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16255 00002000:00010000:0.0:1746129571.998425:0:4699:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb mtime: 1746129571 -> 1746129572 00002000:00010000:0.0:1746129571.998431:0:4699:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb atime: 1746129571 -> 1746129572 00000100:00100000:0.0:1746129571.998449:0:4699:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b553100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4699:1830948737528320:192.168.202.4@tcp:106: 00010000:00010000:0.0:1746129571.998473:0:4699:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095f11000/0x40a459093b06a0cf lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2121c expref: 31 pid: 4699 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129571.998485:0:4699:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095f11000/0x40a459093b06a0cf lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2121c expref: 31 pid: 4699 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129571.998494:0:4699:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f11000, rc 0) 00000100:00100000:0.0:1746129571.998526:0:4699:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ada2ffba-8920-4ecb-8068-68caa9806978+30:1962:x1830948734151040:12345-192.168.202.4@tcp:101:cat.0 Request processed in 3272us (4363us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129571.998534:0:4699:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16258 00000100:00100000:1.0:1746129571.998741:0:8410:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fa24380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8410:1830948737528192:192.168.202.4@tcp:106: 00010000:00010000:1.0:1746129571.998772:0:8410:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0640c00/0x40a459093b06a0c8 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21223 expref: 26 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129571.998782:0:8410:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0640c00/0x40a459093b06a0c8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21223 expref: 26 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129571.998795:0:8410:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0640c00, rc 0) 00000100:00100000:1.0:1746129571.998818:0:8410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ada2ffba-8920-4ecb-8068-68caa9806978+25:1962:x1830948734151168:12345-192.168.202.4@tcp:101:cat.0 Request processed in 3611us (5710us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129571.998824:0:8410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16257 00000100:00100000:2.0:1746129571.998955:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f95b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7149:1830948737528064:192.168.202.4@tcp:106: 00010000:00010000:2.0:1746129571.998977:0:7149:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800955d2c00/0x40a459093b06a0c1 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2122a expref: 29 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129571.998986:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800955d2c00/0x40a459093b06a0c1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2122a expref: 29 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129571.998994:0:7149:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800955d2c00, rc 0) 00000100:00100000:2.0:1746129571.999017:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ada2ffba-8920-4ecb-8068-68caa9806978+28:1962:x1830948734151296:12345-192.168.202.4@tcp:101:cat.0 Request processed in 3749us (4023us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129571.999021:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16259 00000100:00100000:2.0:1746129572.000182:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129572.000366:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734151424 00000100:00100000:0.0:1746129572.000374:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734151424 00000100:00100000:0.0:1746129572.000465:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16260 00000100:00100000:0.0:1746129572.000472:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f95b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+14:32317:x1830948734151424:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129572.000490:0:7149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129572.000506:0:7149:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0640a00/0x40a459093b06a0d6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21231 expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129572.000535:0:7149:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c22ca00/0x40a459093b06a019 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f211b3 expref: 8 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129572.000541:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129572.000543:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129572.000547:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0640a00/0x40a459093b06a0d6 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21231 expref: 15 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129572.000579:0:7149:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c22ca00/0x40a459093b06a019 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f211b3 expref: 8 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129572.000593:0:7149:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c22ca00/0x40a459093b06a019 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f211b3 expref: 8 pid: 7148 timeout: 927 lvb_type: 0 00000100:00100000:0.0:1746129572.000606:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fa24380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7149:1830948737528448:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129572.001147:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e29fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129572.009358:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129572.009409:0:8410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734151552 00000100:00100000:1.0:1746129572.009419:0:8410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734151552 00000100:00100000:1.0:1746129572.009470:0:8410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16261 00000100:00100000:1.0:1746129572.009479:0:8410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800912ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ada2ffba-8920-4ecb-8068-68caa9806978+25:32320:x1830948734151552:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129572.009541:0:8410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746129572.009577:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fa24380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7149:1830948737528448:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129572.009577:0:8410:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fab5800/0x40a459093b06a0dd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21238 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129572.009606:0:8410:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129572.009613:0:8410:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fab5800/0x40a459093b06a0dd lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21238 expref: 26 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129572.009623:0:8410:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fab5800/0x40a459093b06a0dd lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21238 expref: 26 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129572.009633:0:8410:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fab5800, rc 0) 00010000:00010000:2.0:1746129572.009651:0:7149:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0640a00/0x40a459093b06a0d6 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21231 expref: 15 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129572.009661:0:7149:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0640a00, rc 0) 00000100:00100000:2.0:1746129572.009693:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f95b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+15:32317:x1830948734151424:12345-192.168.202.4@tcp:101:cat.0 Request processed in 9221us (9517us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129572.009693:0:8410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800912ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ada2ffba-8920-4ecb-8068-68caa9806978+26:32320:x1830948734151552:12345-192.168.202.4@tcp:101:cat.0 Request processed in 215us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129572.009698:0:8410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16261 00000100:00100000:2.0:1746129572.009702:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16260 00000100:00100000:0.0:1746129572.009993:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129572.010320:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734151680 00000100:00100000:1.0:1746129572.010324:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734151680 00010000:00010000:1.0:1746129572.010342:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c22ca00/0x40a459093b06a019 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f211b3 expref: 9 pid: 7148 timeout: 927 lvb_type: 0 00000100:00100000:1.0:1746129572.010362:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8331 00000100:00100000:1.0:1746129572.010367:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800912af800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:068dab75-d300-4ead-a742-d14572ad1e50+9:1963:x1830948734151680:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129572.010377:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129572.010398:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c22ca00/0x40a459093b06a019 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f211b3 expref: 9 pid: 7148 timeout: 927 lvb_type: 0 00010000:00010000:1.0:1746129572.010409:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c22ca00/0x40a459093b06a019 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f211b3 expref: 9 pid: 7148 timeout: 927 lvb_type: 0 00010000:00010000:1.0:1746129572.010430:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c22ca00/0x40a459093b06a019 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f211b3 expref: 9 pid: 7148 timeout: 927 lvb_type: 0 00010000:00010000:1.0:1746129572.010456:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129572.010457:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129572.010464:0:7085:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0640a00/0x40a459093b06a0d6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21231 expref: 14 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129572.010471:0:7085:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0640a00/0x40a459093b06a0d6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21231 expref: 14 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129572.010479:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129572.010480:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129572.010483:0:7085:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fab5800/0x40a459093b06a0dd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21238 expref: 25 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129572.010493:0:7085:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fab5800/0x40a459093b06a0dd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21238 expref: 25 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129572.010873:0:7085:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009fab5800/0x40a459093b06a0dd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21238 expref: 25 pid: 8410 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129572.010888:0:7085:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b550000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7085:1830948737528576:192.168.202.4@tcp:105: 00010000:00010000:1.0:1746129572.010979:0:7085:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0640a00/0x40a459093b06a0d6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21231 expref: 14 pid: 7149 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129572.010987:0:7085:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b550700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7085:1830948737528704:192.168.202.4@tcp:105: 00000100:00100000:1.0:1746129572.011003:0:7085:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934d2f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746129572.016487:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129572.016521:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129572.016688:0:7085:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b550000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7085:1830948737528576:192.168.202.4@tcp:105: 00000100:00100000:1.0:1746129572.016699:0:7085:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b550700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7085:1830948737528704:192.168.202.4@tcp:105: 00010000:00010000:1.0:1746129572.016720:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129572.016817:0:31521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734151936 00000100:00100000:0.0:1746129572.016824:0:31521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734151936 00002000:00100000:0.0:1746129572.016868:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3ef:0x0] (2097152->3145727) req@ffff88009f959880 x1830948734151936/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:313/0 lens 488/0 e 0 to 0 dl 1746129583 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129572.016877:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f959880 with x1830948734151936 ext(2097152->3145727) 00002000:00010000:0.0:1746129572.016881:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f959880 00000100:00100000:0.0:1746129572.016897:0:31521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734152192 00000100:00100000:0.0:1746129572.016898:0:31521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734152192 00002000:00100000:0.0:1746129572.016906:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3ef:0x0] (2097152->3145727) req@ffff88009f958e00 x1830948734152192/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:313/0 lens 488/0 e 0 to 0 dl 1746129583 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129572.016912:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f958e00 with x1830948734152192 ext(2097152->3145727) 00002000:00010000:0.0:1746129572.016915:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f958e00 00000100:00100000:0.0:1746129572.016931:0:31523:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7821 00000100:00100000:0.0:1746129572.016937:0:31523:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f959880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ada2ffba-8920-4ecb-8068-68caa9806978+26:1963:x1830948734151936:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:3.0:1746129572.018575:0:8416:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7822 00000100:00100000:3.0:1746129572.018590:0:8416:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f958e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+15:1960:x1830948734152192:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:1.0:1746129572.019809:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800912af800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:068dab75-d300-4ead-a742-d14572ad1e50+8:1963:x1830948734151680:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 9434us (9808us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129572.019821:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8331 00000100:00100000:1.0:1746129572.032906:0:31523:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f959880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ada2ffba-8920-4ecb-8068-68caa9806978+26:1963:x1830948734151936:12345-192.168.202.4@tcp:3:cat.0 Request processed in 15955us (16417us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129572.032920:0:31523:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7821 00002000:00100000:1.0:1746129572.032932:0:31523:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3ef:0x0] (2097152->3145727) req@ffff88009f959880 x1830948734151936/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:313/0 lens 488/440 e 0 to 0 dl 1746129583 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129572.032947:0:31523:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f959880 with x1830948734151936 ext(2097152->3145727) 00002000:00010000:1.0:1746129572.032954:0:31523:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f959880 00000100:00100000:3.0:1746129572.038899:0:8416:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f958e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+15:1960:x1830948734152192:12345-192.168.202.4@tcp:3:cat.0 Request processed in 20303us (22363us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129572.038913:0:8416:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7822 00002000:00100000:3.0:1746129572.038927:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3ef:0x0] (2097152->3145727) req@ffff88009f958e00 x1830948734152192/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:313/0 lens 488/440 e 0 to 0 dl 1746129583 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129572.038937:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f958e00 with x1830948734152192 ext(2097152->3145727) 00002000:00010000:3.0:1746129572.038944:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f958e00 00000100:00100000:0.0:1746129572.043941:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129572.044061:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734152320 00000100:00100000:2.0:1746129572.044070:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734152320 00000100:00100000:2.0:1746129572.044135:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16262 00000100:00100000:2.0:1746129572.044143:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800912aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ada2ffba-8920-4ecb-8068-68caa9806978+28:32320:x1830948734152320:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129572.044165:0:7149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129572.044186:0:7149:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800955d2800/0x40a459093b06a0e4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2123f expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129572.044221:0:7149:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800955d2e00/0x40a459093b06a035 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f211c8 expref: 8 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129572.044229:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129572.044231:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129572.044234:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800955d2800/0x40a459093b06a0e4 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2123f expref: 29 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129572.044270:0:7149:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800955d2e00/0x40a459093b06a035 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f211c8 expref: 8 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129572.044283:0:7149:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800955d2e00/0x40a459093b06a035 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f211c8 expref: 8 pid: 4385 timeout: 927 lvb_type: 0 00000100:00100000:2.0:1746129572.044439:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f958380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7149:1830948737528832:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129572.046411:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009af1e900 going to sleep for 11 seconds 00000100:00100000:0.0:1746129572.047083:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129572.047358:0:8410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734152448 00000100:00100000:2.0:1746129572.047367:0:8410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734152448 00000100:00100000:2.0:1746129572.047418:0:8410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16263 00000100:00100000:2.0:1746129572.047426:0:8410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800912af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+19:32317:x1830948734152448:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129572.047441:0:8410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129572.047459:0:8410:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800955d2400/0x40a459093b06a0eb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21246 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129572.047489:0:8410:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129572.047493:0:8410:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800955d2400/0x40a459093b06a0eb lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21246 expref: 20 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129572.047504:0:8410:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800955d2400/0x40a459093b06a0eb lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21246 expref: 20 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129572.047514:0:8410:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800955d2400, rc 0) 00000100:00100000:2.0:1746129572.047555:0:8410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800912af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:32317:x1830948734152448:12345-192.168.202.4@tcp:101:cat.0 Request processed in 131us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129572.047561:0:8410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16263 00000100:00080000:1.0:1746129572.047655:0:7097:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746129572.049331:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129572.049641:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f958380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7149:1830948737528832:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129572.049672:0:7149:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800955d2800/0x40a459093b06a0e4 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2123f expref: 29 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129572.049687:0:7149:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800955d2800, rc 0) 00000100:00100000:2.0:1746129572.049725:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800912aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ada2ffba-8920-4ecb-8068-68caa9806978+29:32320:x1830948734152320:12345-192.168.202.4@tcp:101:cat.0 Request processed in 5584us (5797us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129572.049733:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16262 00000100:00100000:3.0:1746129572.049989:0:16908:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734152704 00000100:00100000:3.0:1746129572.049996:0:16908:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734152704 00000100:00080000:1.0:1746129572.050064:0:7097:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746129572.050163:0:16908:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11229 00000100:00100000:3.0:1746129572.050172:0:16908:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800912aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+12:32331:x1830948734152704:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:3.0:1746129572.050192:0:16908:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129572.050209:0:16908:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1d000/0x40a459093b06a0f2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2124d expref: -99 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129572.050456:0:16908:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1c600/0x40a459093b06a0f9 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129572.050470:0:16908:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4020e00/0x40a459093b069f94 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2114a expref: 13 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129572.050476:0:16908:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e0bae00/0x40a459093b069ffd lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21190 expref: 292 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129572.050486:0:16908:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1c600/0x40a459093b06a0f9 lrc: 5/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00000100:00100000:2.0:1746129572.050504:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00010000:00010000:3.0:1746129572.050516:0:16908:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008e0bae00/0x40a459093b069ffd lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21190 expref: 292 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129572.050526:0:16908:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e0bae00/0x40a459093b069ffd lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21190 expref: 292 pid: 15096 timeout: 927 lvb_type: 0 00000100:00100000:0.0:1746129572.050559:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734152832 00000100:00100000:0.0:1746129572.050565:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734152832 00010000:00010000:0.0:1746129572.050583:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800955d2e00/0x40a459093b06a035 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f211c8 expref: 9 pid: 4385 timeout: 927 lvb_type: 0 00000100:00100000:0.0:1746129572.050600:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8332 00000100:00100000:0.0:1746129572.050605:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f958380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:068dab75-d300-4ead-a742-d14572ad1e50+9:1963:x1830948734152832:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129572.050613:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129572.050636:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800955d2e00/0x40a459093b06a035 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f211c8 expref: 9 pid: 4385 timeout: 927 lvb_type: 0 00000100:00100000:3.0:1746129572.050663:0:16908:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f37d180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16908:1830948737528960:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129572.050689:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800955d2e00/0x40a459093b06a035 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f211c8 expref: 9 pid: 4385 timeout: 927 lvb_type: 0 00010000:00010000:0.0:1746129572.050710:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800955d2e00/0x40a459093b06a035 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f211c8 expref: 9 pid: 4385 timeout: 927 lvb_type: 0 00010000:00010000:0.0:1746129572.050724:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129572.050726:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129572.050732:0:7085:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800955d2800/0x40a459093b06a0e4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2123f expref: 28 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129572.050738:0:7085:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800955d2800/0x40a459093b06a0e4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2123f expref: 28 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129572.050745:0:16908:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4020e00/0x40a459093b069f94 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2114a expref: 13 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129572.050745:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129572.050746:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129572.050750:0:7085:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800955d2400/0x40a459093b06a0eb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21246 expref: 19 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129572.050752:0:16908:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4020e00/0x40a459093b069f94 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2114a expref: 13 pid: 16908 timeout: 927 lvb_type: 0 00010000:00010000:0.0:1746129572.050756:0:7085:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800955d2400/0x40a459093b06a0eb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21246 expref: 19 pid: 8410 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129572.050760:0:16908:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f37f100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16908:1830948737529088:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129572.050773:0:7085:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800955d2400/0x40a459093b06a0eb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21246 expref: 19 pid: 8410 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129572.050776:0:16908:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5ac9e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746129572.050781:0:7085:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800912ac380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7085:1830948737529216:192.168.202.4@tcp:105: 00010000:00010000:0.0:1746129572.050807:0:7085:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800955d2800/0x40a459093b06a0e4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2123f expref: 28 pid: 7149 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129572.050819:0:7085:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800912adf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7085:1830948737529344:192.168.202.4@tcp:105: 00000100:00100000:0.0:1746129572.050835:0:7085:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e29f240 going to sleep for 11 seconds 00000100:00100000:3.0:1746129572.056502:0:16908:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f37d180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16908:1830948737528960:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129572.056522:0:16908:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f37f100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16908:1830948737529088:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129572.056551:0:16908:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1c600/0x40a459093b06a0f9 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00000100:00100000:1.0:1746129572.056672:0:7085:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800912ac380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7085:1830948737529216:192.168.202.4@tcp:105: 00000100:00100000:0.0:1746129572.060631:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129572.060685:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129572.060774:0:7085:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800912adf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7085:1830948737529344:192.168.202.4@tcp:105: 00010000:00010000:1.0:1746129572.060801:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129572.060847:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f958380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:068dab75-d300-4ead-a742-d14572ad1e50+8:1963:x1830948734152832:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 10241us (10342us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129572.060858:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8332 00000100:00100000:1.0:1746129572.061779:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734153088 00000100:00100000:1.0:1746129572.061789:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734153088 00000100:00100000:2.0:1746129572.061811:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734152960 00000100:00100000:2.0:1746129572.061815:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734152960 00010000:00010000:1.0:1746129572.061821:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4020e00/0x40a459093b069f94 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2114a expref: 14 pid: 16908 timeout: 927 lvb_type: 0 00010000:00010000:2.0:1746129572.061830:0:9823:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e0bae00/0x40a459093b069ffd lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21190 expref: 293 pid: 15096 timeout: 927 lvb_type: 0 00000100:00100000:1.0:1746129572.061856:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8333 00000100:00100000:2.0:1746129572.061860:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8334 00000100:00100000:1.0:1746129572.061862:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800912ac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+14:1963:x1830948734153088:12345-192.168.202.4@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746129572.061864:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a47050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ada2ffba-8920-4ecb-8068-68caa9806978+293:1963:x1830948734152960:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129572.061874:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129572.061874:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129572.061879:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008e0bae00/0x40a459093b069ffd lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21190 expref: 293 pid: 15096 timeout: 927 lvb_type: 0 00010000:00010000:1.0:1746129572.061879:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4020e00/0x40a459093b069f94 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2114a expref: 14 pid: 16908 timeout: 927 lvb_type: 0 00010000:00010000:1.0:1746129572.061888:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4020e00/0x40a459093b069f94 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2114a expref: 14 pid: 16908 timeout: 927 lvb_type: 0 00010000:00010000:2.0:1746129572.061900:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008e0bae00/0x40a459093b069ffd lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21190 expref: 293 pid: 15096 timeout: 927 lvb_type: 0 00010000:00010000:1.0:1746129572.061953:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4020e00/0x40a459093b069f94 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2114a expref: 14 pid: 16908 timeout: 927 lvb_type: 0 00010000:00010000:2.0:1746129572.061956:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e0bae00/0x40a459093b069ffd lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21190 expref: 293 pid: 15096 timeout: 927 lvb_type: 0 00010000:00010000:2.0:1746129572.061973:0:9823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:2.0:1746129572.061978:0:9823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1c600/0x40a459093b06a0f9 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129572.061987:0:9823:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1c600/0x40a459093b06a0f9 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129572.061993:0:9823:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1c600/0x40a459093b06a0f9 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129572.062023:0:7085:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:1.0:1746129572.062026:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746129572.062033:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129572.062051:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a47050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ada2ffba-8920-4ecb-8068-68caa9806978+292:1963:x1830948734152960:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 186us (1365us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129572.062051:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800912ac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+13:1963:x1830948734153088:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 189us (1430us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129572.062056:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8333 00000100:00100000:2.0:1746129572.062059:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8334 00010000:00010000:3.0:1746129572.062153:0:16908:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1c600/0x40a459093b06a0f9 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129572.062161:0:16908:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1c600/0x40a459093b06a0f9 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00000004:00200000:3.0:1746129572.062182:0:16908:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:3.0:1746129572.062362:0:16908:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1d000/0x40a459093b06a0f2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2124d expref: 14 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129572.062386:0:16908:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1c600/0x40a459093b06a0f9 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2124d expref: 13 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129572.062392:0:16908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:3.0:1746129572.062394:0:16908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746129572.062396:0:16908:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136b1c600, rc 0) 00000100:00100000:3.0:1746129572.062422:0:16908:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800912aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+13:32331:x1830948734152704:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 12252us (13138us total) trans 8589945322 rc 0/0 00000100:00100000:3.0:1746129572.062428:0:16908:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11229 00000100:00100000:2.0:1746129572.062937:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129572.063002:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129572.063433:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129572.063627:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129572.063643:0:8416:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734153728 00000100:00100000:3.0:1746129572.063650:0:8416:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734153728 00002000:00100000:3.0:1746129572.063693:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3f5:0x0] (2097152->3145727) req@ffff88009f958380 x1830948734153728/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:313/0 lens 488/0 e 0 to 0 dl 1746129583 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129572.063702:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f958380 with x1830948734153728 ext(2097152->3145727) 00002000:00010000:3.0:1746129572.063707:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f958380 00000100:00100000:3.0:1746129572.063723:0:8416:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734153856 00000100:00100000:3.0:1746129572.063725:0:8416:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734153856 00002000:00100000:3.0:1746129572.063736:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->4194303) req@ffff88009f959500 x1830948734153856/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:313/0 lens 488/0 e 0 to 0 dl 1746129583 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129572.063742:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f959500 with x1830948734153856 ext(3145728->4194303) 00002000:00010000:3.0:1746129572.063745:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f959500 00000100:00100000:3.0:1746129572.063763:0:8416:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734153984 00000100:00100000:3.0:1746129572.063766:0:8416:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734153984 00002000:00100000:3.0:1746129572.063776:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3f5:0x0] (3145728->4194303) req@ffff88009f95aa00 x1830948734153984/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:313/0 lens 488/0 e 0 to 0 dl 1746129583 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129572.063782:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f95aa00 with x1830948734153984 ext(3145728->4194303) 00002000:00010000:3.0:1746129572.063784:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f95aa00 00000100:00100000:3.0:1746129572.063800:0:8416:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7823 00000100:00100000:3.0:1746129572.063805:0:8416:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f958380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ada2ffba-8920-4ecb-8068-68caa9806978+30:1962:x1830948734153728:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:3.0:1746129572.064350:0:31519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7824 00000100:00100000:3.0:1746129572.064358:0:31519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f959500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ada2ffba-8920-4ecb-8068-68caa9806978+26:1962:x1830948734153856:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:1.0:1746129572.068076:0:31523:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7825 00000100:00100000:1.0:1746129572.068093:0:31523:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f95aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ada2ffba-8920-4ecb-8068-68caa9806978+31:1963:x1830948734153984:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:2.0:1746129572.071341:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129572.071371:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129572.071424:0:31520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734154240 00000100:00100000:2.0:1746129572.071434:0:31520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734154240 00002000:00100000:2.0:1746129572.071479:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3f5:0x0] (2097152->3145727) req@ffff88009f959180 x1830948734154240/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:313/0 lens 488/0 e 0 to 0 dl 1746129583 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129572.071490:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f959180 with x1830948734154240 ext(2097152->3145727) 00002000:00010000:2.0:1746129572.071495:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f959180 00000100:00100000:2.0:1746129572.071510:0:31520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734154368 00000100:00100000:2.0:1746129572.071512:0:31520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734154368 00002000:00100000:2.0:1746129572.071519:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3f5:0x0] (3145728->4194303) req@ffff88009fa24700 x1830948734154368/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:313/0 lens 488/0 e 0 to 0 dl 1746129583 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129572.071525:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fa24700 with x1830948734154368 ext(3145728->4194303) 00002000:00010000:2.0:1746129572.071527:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fa24700 00000100:00100000:2.0:1746129572.071537:0:31520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7826 00000100:00100000:2.0:1746129572.071542:0:31520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f959180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:1960:x1830948734154240:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:2.0:1746129572.072829:0:31522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734154624 00000100:00100000:2.0:1746129572.072838:0:31522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734154624 00002000:00100000:2.0:1746129572.072875:0:31522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->4194303) req@ffff88009fa24a80 x1830948734154624/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:313/0 lens 488/0 e 0 to 0 dl 1746129583 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129572.072884:0:31522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fa24a80 with x1830948734154624 ext(3145728->4194303) 00002000:00010000:2.0:1746129572.072888:0:31522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fa24a80 00000100:00100000:2.0:1746129572.072906:0:31522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7827 00000100:00100000:2.0:1746129572.072912:0:31522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+22:1960:x1830948734154368:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:3.0:1746129572.072916:0:21725:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7828 00000100:00100000:3.0:1746129572.072924:0:21725:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+15:1960:x1830948734154624:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:3.0:1746129572.083071:0:31519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f959500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ada2ffba-8920-4ecb-8068-68caa9806978+26:1962:x1830948734153856:12345-192.168.202.4@tcp:3:cat.0 Request processed in 18702us (20056us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129572.083083:0:31519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7824 00002000:00100000:3.0:1746129572.083096:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->4194303) req@ffff88009f959500 x1830948734153856/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:313/0 lens 488/440 e 0 to 0 dl 1746129583 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129572.083107:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f959500 with x1830948734153856 ext(3145728->4194303) 00002000:00010000:3.0:1746129572.083112:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f959500 00000100:00100000:0.0:1746129572.088106:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129572.089898:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734154752 00000100:00100000:3.0:1746129572.089914:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734154752 00000100:00100000:3.0:1746129572.089976:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16264 00000100:00100000:3.0:1746129572.089987:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800912ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ada2ffba-8920-4ecb-8068-68caa9806978+26:32328:x1830948734154752:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:3.0:1746129572.090009:0:7149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129572.090033:0:7149:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094fee400/0x40a459093b06a107 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21254 expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129572.090070:0:7149:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0640a00/0x40a459093b06a0d6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21231 expref: 16 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129572.090078:0:7149:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fab5800/0x40a459093b06a0dd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21238 expref: 27 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129572.090085:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129572.090087:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129572.090091:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094fee400/0x40a459093b06a107 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [4079616->4194303] (req 4079616->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21254 expref: 27 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129572.090129:0:7149:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fab5800/0x40a459093b06a0dd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21238 expref: 27 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129572.090143:0:7149:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fab5800/0x40a459093b06a0dd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21238 expref: 27 pid: 8410 timeout: 927 lvb_type: 0 00000100:00100000:3.0:1746129572.090155:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f37f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7149:1830948737529472:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129572.090277:0:7149:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0640a00/0x40a459093b06a0d6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21231 expref: 16 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129572.090287:0:7149:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a0640a00/0x40a459093b06a0d6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21231 expref: 16 pid: 7149 timeout: 927 lvb_type: 0 00000100:00100000:3.0:1746129572.090326:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f37d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7149:1830948737529600:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129572.090378:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5ac9e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746129572.095666:0:8416:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f958380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ada2ffba-8920-4ecb-8068-68caa9806978+31:1962:x1830948734153728:12345-192.168.202.4@tcp:3:cat.0 Request processed in 31844us (32713us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129572.095681:0:8416:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7823 00002000:00100000:3.0:1746129572.095695:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3f5:0x0] (2097152->3145727) req@ffff88009f958380 x1830948734153728/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:313/0 lens 488/440 e 0 to 0 dl 1746129583 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129572.095706:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f958380 with x1830948734153728 ext(2097152->3145727) 00002000:00010000:3.0:1746129572.095713:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f958380 00000100:00100000:0.0:1746129572.107107:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129572.107134:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734154880 00000100:00100000:0.0:1746129572.107143:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734154880 00010000:00010000:0.0:1746129572.107179:0:7087:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fab5800/0x40a459093b06a0dd lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21238 expref: 28 pid: 8410 timeout: 927 lvb_type: 0 00000100:00100000:1.0:1746129572.107420:0:31523:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f95aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ada2ffba-8920-4ecb-8068-68caa9806978+29:1963:x1830948734153984:12345-192.168.202.4@tcp:3:cat.0 Request processed in 39331us (43985us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129572.107431:0:31523:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7825 00002000:00100000:1.0:1746129572.107441:0:31523:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f5:0x0] (3145728->4194303) req@ffff88009f95aa00 x1830948734153984/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:313/0 lens 488/440 e 0 to 0 dl 1746129583 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129572.107450:0:31523:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f95aa00 with x1830948734153984 ext(3145728->4194303) 00000100:00100000:3.0:1746129572.108018:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f37f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7149:1830948737529472:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129572.108032:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f37d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7149:1830948737529600:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129572.108063:0:7149:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094fee400/0x40a459093b06a107 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [4079616->4194303] (req 4079616->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21254 expref: 28 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129572.108078:0:7149:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094fee400, rc 0) 00000100:00100000:3.0:1746129572.108102:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800912ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ada2ffba-8920-4ecb-8068-68caa9806978+28:32328:x1830948734154752:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 18118us (20010us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129572.108108:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16264 00002000:00010000:1.0:1746129572.108144:0:31523:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f95aa00 00000100:00100000:2.0:1746129572.110196:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8335 00000100:00100000:2.0:1746129572.110215:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800912afb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ada2ffba-8920-4ecb-8068-68caa9806978+27:1963:x1830948734154880:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129572.110237:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129572.110267:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fab5800/0x40a459093b06a0dd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21238 expref: 27 pid: 8410 timeout: 927 lvb_type: 0 00010000:00010000:2.0:1746129572.110280:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fab5800/0x40a459093b06a0dd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21238 expref: 27 pid: 8410 timeout: 927 lvb_type: 0 00010000:00010000:2.0:1746129572.110511:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fab5800/0x40a459093b06a0dd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21238 expref: 27 pid: 8410 timeout: 927 lvb_type: 0 00010000:00010000:2.0:1746129572.110531:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129572.110579:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800912afb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ada2ffba-8920-4ecb-8068-68caa9806978+26:1963:x1830948734154880:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 372us (3483us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129572.110584:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8335 00000100:00100000:3.0:1746129572.110813:0:31520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f959180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+22:1960:x1830948734154240:12345-192.168.202.4@tcp:3:cat.0 Request processed in 39269us (47185us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129572.110821:0:31520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7826 00002000:00100000:3.0:1746129572.110830:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3f5:0x0] (2097152->3145727) req@ffff88009f959180 x1830948734154240/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:313/0 lens 488/440 e 0 to 0 dl 1746129583 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129572.110839:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f959180 with x1830948734154240 ext(2097152->3145727) 00002000:00010000:3.0:1746129572.110842:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f959180 00000100:00100000:3.0:1746129572.112520:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129572.112733:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734155008 00000100:00100000:0.0:1746129572.112742:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734155008 00000100:00100000:0.0:1746129572.112893:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16265 00000100:00100000:0.0:1746129572.112900:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f37d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ada2ffba-8920-4ecb-8068-68caa9806978+26:32320:x1830948734155008:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129572.112918:0:7149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129572.112934:0:7149:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0640400/0x40a459093b06a10e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2125b expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129572.112958:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129572.112963:0:7149:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094fee400/0x40a459093b06a107 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [4079616->4194303] (req 4079616->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21254 expref: 27 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129572.112969:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129572.112973:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0640400/0x40a459093b06a10e lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2125b expref: 27 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129572.113007:0:7149:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094fee400/0x40a459093b06a107 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [4079616->4194303] (req 4079616->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21254 expref: 27 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129572.113019:0:7149:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0640400/0x40a459093b06a10e lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2125b expref: 27 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129572.113028:0:7149:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0640400, rc 0) 00000100:00100000:0.0:1746129572.113200:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f37d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ada2ffba-8920-4ecb-8068-68caa9806978+27:32320:x1830948734155008:12345-192.168.202.4@tcp:101:cat.0 Request processed in 299us (686us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129572.113205:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16265 00000100:00100000:2.0:1746129572.117153:0:31522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:1960:x1830948734154368:12345-192.168.202.4@tcp:3:cat.0 Request processed in 44230us (45813us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129572.117165:0:31522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7827 00002000:00100000:2.0:1746129572.117176:0:31522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f5:0x0] (3145728->4194303) req@ffff88009fa24700 x1830948734154368/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:313/0 lens 488/440 e 0 to 0 dl 1746129583 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129572.117186:0:31522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fa24700 with x1830948734154368 ext(3145728->4194303) 00002000:00010000:2.0:1746129572.117192:0:31522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fa24700 00000100:00100000:0.0:1746129572.117688:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129572.117742:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734155136 00000100:00100000:2.0:1746129572.117749:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734155136 00000100:00100000:2.0:1746129572.117781:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16266 00000100:00100000:2.0:1746129572.117862:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800912adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+17:32317:x1830948734155136:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129572.117880:0:7149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129572.117897:0:7149:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800955d3800/0x40a459093b06a115 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21262 expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129572.117922:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129572.117928:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800955d3800/0x40a459093b06a115 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21262 expref: 18 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129572.117938:0:7149:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800955d3800/0x40a459093b06a115 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21262 expref: 18 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129572.117948:0:7149:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800955d3800, rc 0) 00000100:00100000:2.0:1746129572.117969:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800912adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+18:32317:x1830948734155136:12345-192.168.202.4@tcp:101:cat.0 Request processed in 183us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129572.117974:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16266 00000100:00100000:3.0:1746129572.119442:0:21725:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+16:1960:x1830948734154624:12345-192.168.202.4@tcp:3:cat.0 Request processed in 46513us (48064us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129572.119451:0:21725:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7828 00002000:00100000:3.0:1746129572.119460:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->4194303) req@ffff88009fa24a80 x1830948734154624/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:313/0 lens 488/440 e 0 to 0 dl 1746129583 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129572.119469:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fa24a80 with x1830948734154624 ext(3145728->4194303) 00010000:00010000:3.0:1746129572.119476:0:21725:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a0640a00/0x40a459093b06a0d6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21231 expref: 16 pid: 7149 timeout: 927 lvb_type: 0 00010000:00010000:3.0:1746129572.119487:0:21725:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a0640a00/0x40a459093b06a0d6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21231 expref: 16 pid: 7149 timeout: 927 lvb_type: 0 00002000:00010000:3.0:1746129572.119493:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fa24a80 00000100:00100000:0.0:1746129572.119933:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129572.120064:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734155264 00000100:00100000:2.0:1746129572.120070:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734155264 00000100:00100000:2.0:1746129572.120252:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16267 00000100:00100000:2.0:1746129572.120259:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800912ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:32331:x1830948734155264:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:2.0:1746129572.120271:0:7149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129572.120284:0:7149:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800955d2600/0x40a459093b06a11c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21269 expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129572.120336:0:7149:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800955d2800/0x40a459093b06a0e4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2123f expref: 28 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129572.120349:0:7149:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800955d2400/0x40a459093b06a0eb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21246 expref: 21 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129572.120355:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129572.120356:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129572.120359:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800955d2600/0x40a459093b06a11c lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [2199552->2703359] (req 2199552->2703359) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21269 expref: 21 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129572.120387:0:7149:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800955d2400/0x40a459093b06a0eb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21246 expref: 21 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129572.120396:0:7149:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800955d2400/0x40a459093b06a0eb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21246 expref: 21 pid: 8410 timeout: 927 lvb_type: 0 00000100:00100000:2.0:1746129572.120407:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fa25f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7149:1830948737529856:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129572.120491:0:7149:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800955d2800/0x40a459093b06a0e4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2123f expref: 28 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129572.120499:0:7149:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800955d2800/0x40a459093b06a0e4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2123f expref: 28 pid: 7149 timeout: 927 lvb_type: 0 00000100:00100000:2.0:1746129572.120507:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fa24380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7149:1830948737529984:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129572.120525:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009af1eb40 going to sleep for 11 seconds 00000100:00100000:0.0:1746129572.129132:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129572.129191:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734155392 00000100:00100000:2.0:1746129572.129200:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734155392 00000100:00100000:0.0:1746129572.129206:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00010000:00010000:2.0:1746129572.129241:0:7087:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0640a00/0x40a459093b06a0d6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21231 expref: 16 pid: 7149 timeout: 927 lvb_type: 0 00000100:00100000:0.0:1746129572.129285:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129572.129373:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fa25f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7149:1830948737529856:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129572.129385:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fa24380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7149:1830948737529984:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129572.129419:0:7149:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800955d2600/0x40a459093b06a11c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [2199552->2703359] (req 2199552->2703359) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21269 expref: 21 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129572.129436:0:7149:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800955d2600, rc 0) 00000100:00100000:1.0:1746129572.129704:0:15749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734155520 00000100:00100000:1.0:1746129572.129708:0:15749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734155520 00010000:00010000:1.0:1746129572.129724:0:15749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800955d2800/0x40a459093b06a0e4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2123f expref: 29 pid: 7149 timeout: 927 lvb_type: 0 00000100:00100000:2.0:1746129572.129748:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734155648 00000100:00100000:2.0:1746129572.129750:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734155648 00010000:00010000:2.0:1746129572.129761:0:7087:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800955d2400/0x40a459093b06a0eb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21246 expref: 22 pid: 8410 timeout: 927 lvb_type: 0 00000100:00100000:2.0:1746129572.129787:0:7087:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8336 00000100:00100000:3.0:1746129572.129793:0:20578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8337 00000100:00100000:2.0:1746129572.129795:0:7087:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800912af800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+16:1963:x1830948734155392:12345-192.168.202.4@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746129572.129800:0:20578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800912adf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+22:1961:x1830948734155648:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129572.129808:0:20578:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129572.129808:0:7087:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129572.129830:0:20578:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800955d2400/0x40a459093b06a0eb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21246 expref: 22 pid: 8410 timeout: 927 lvb_type: 0 00010000:00010000:2.0:1746129572.129830:0:7087:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a0640a00/0x40a459093b06a0d6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21231 expref: 16 pid: 7149 timeout: 927 lvb_type: 0 00010000:00010000:2.0:1746129572.129841:0:7087:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a0640a00/0x40a459093b06a0d6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21231 expref: 16 pid: 7149 timeout: 927 lvb_type: 0 00010000:00010000:3.0:1746129572.129842:0:20578:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800955d2400/0x40a459093b06a0eb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21246 expref: 22 pid: 8410 timeout: 927 lvb_type: 0 00010000:00010000:3.0:1746129572.129861:0:20578:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800955d2400/0x40a459093b06a0eb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21246 expref: 22 pid: 8410 timeout: 927 lvb_type: 0 00010000:00010000:2.0:1746129572.129861:0:7087:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0640a00/0x40a459093b06a0d6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21231 expref: 16 pid: 7149 timeout: 927 lvb_type: 0 00010000:00010000:3.0:1746129572.129874:0:20578:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746129572.129875:0:7087:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129572.129877:0:7087:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129572.129884:0:7087:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094fee400/0x40a459093b06a107 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4079616->4194303) gid 0 flags: 0x60080000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21254 expref: 26 pid: 7149 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129572.129911:0:15749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8338 00000100:00100000:1.0:1746129572.129916:0:15749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800912ac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ada2ffba-8920-4ecb-8068-68caa9806978+29:1961:x1830948734155520:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129572.129922:0:15749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129572.129929:0:15749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800955d2800/0x40a459093b06a0e4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2123f expref: 29 pid: 7149 timeout: 927 lvb_type: 0 00010000:00010000:1.0:1746129572.129938:0:15749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800955d2800/0x40a459093b06a0e4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2123f expref: 29 pid: 7149 timeout: 927 lvb_type: 0 00010000:00010000:1.0:1746129572.129948:0:15749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800955d2800/0x40a459093b06a0e4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2123f expref: 29 pid: 7149 timeout: 927 lvb_type: 0 00010000:00010000:1.0:1746129572.129959:0:15749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129572.129961:0:15749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129572.129964:0:15749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800955d2600/0x40a459093b06a11c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2199552->2703359) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21269 expref: 21 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129572.129972:0:15749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800955d2600/0x40a459093b06a11c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2199552->2703359) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21269 expref: 21 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129572.129999:0:15749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800955d2600/0x40a459093b06a11c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2199552->2703359) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21269 expref: 21 pid: 7149 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129572.130012:0:15749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b550700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15749:1830948737530112:192.168.202.4@tcp:105: 00010000:00010000:2.0:1746129572.130051:0:7087:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094fee400/0x40a459093b06a107 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4079616->4194303) gid 0 flags: 0x60080000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21254 expref: 26 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129572.130078:0:7087:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094fee400/0x40a459093b06a107 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4079616->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21254 expref: 26 pid: 7149 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129572.130128:0:15749:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934d2f00 going to sleep for 11 seconds 00010000:00010000:2.0:1746129572.130147:0:7087:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094fee400/0x40a459093b06a107 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4079616->4194303) gid 0 flags: 0x70000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21254 expref: 26 pid: 7149 timeout: 927 lvb_type: 0 00000100:00100000:2.0:1746129572.130161:0:7087:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fa24380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7087:1830948737530240:192.168.202.4@tcp:105: 00000100:00100000:3.0:1746129572.130195:0:20578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800912adf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:1961:x1830948734155648:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 396us (909us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129572.130202:0:20578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8337 00000100:00100000:3.0:1746129572.130226:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800912ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:32331:x1830948734155264:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 9969us (10295us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129572.130232:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16267 00000100:00100000:2.0:1746129572.130276:0:7087:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009af1ea80 going to sleep for 11 seconds 00000100:00100000:1.0:1746129572.132601:0:15749:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b550700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15749:1830948737530112:192.168.202.4@tcp:105: 00010000:00010000:1.0:1746129572.132674:0:15749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129572.132715:0:15749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800912ac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ada2ffba-8920-4ecb-8068-68caa9806978+28:1961:x1830948734155520:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 2797us (3507us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129572.132725:0:15749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8338 00000100:00100000:3.0:1746129572.132786:0:7087:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fa24380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7087:1830948737530240:192.168.202.4@tcp:105: 00010000:00010000:3.0:1746129572.132801:0:7087:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129572.132823:0:7087:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800912af800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+15:1963:x1830948734155392:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 3028us (3700us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129572.132830:0:7087:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8336 00000100:00100000:0.0:1746129572.132894:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129572.133613:0:21725:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734156032 00000100:00100000:3.0:1746129572.133625:0:21725:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734156032 00002000:00100000:3.0:1746129572.133666:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ef:0x0] (4079616->4083711) req@ffff8800912ac380 x1830948734156032/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:313/0 lens 488/0 e 0 to 0 dl 1746129583 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129572.133675:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800912ac380 with x1830948734156032 ext(4079616->4083711) 00010000:00010000:3.0:1746129572.133683:0:21725:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094fee400/0x40a459093b06a107 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4079616->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21254 expref: 27 pid: 7149 timeout: 927 lvb_type: 0 00010000:00010000:3.0:1746129572.133696:0:21725:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094fee400/0x40a459093b06a107 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4079616->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21254 expref: 27 pid: 7149 timeout: 927 lvb_type: 0 00002000:00010000:3.0:1746129572.133703:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800912ac380 00000100:00100000:3.0:1746129572.133776:0:21725:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2427 00000100:00100000:3.0:1746129572.133784:0:21725:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800912ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ada2ffba-8920-4ecb-8068-68caa9806978+27:1963:x1830948734156032:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:0.0:1746129572.133826:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129572.134290:0:21725:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800912ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ada2ffba-8920-4ecb-8068-68caa9806978+27:1963:x1830948734156032:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 505us (1580us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129572.134330:0:21725:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2427 00002000:00100000:3.0:1746129572.134335:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ef:0x0] (4079616->4083711) req@ffff8800912ac380 x1830948734156032/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:313/0 lens 488/4536 e 0 to 0 dl 1746129583 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129572.134342:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800912ac380 with x1830948734156032 ext(4079616->4083711) 00010000:00010000:3.0:1746129572.134346:0:21725:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094fee400/0x40a459093b06a107 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4079616->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21254 expref: 27 pid: 7149 timeout: 927 lvb_type: 0 00010000:00010000:3.0:1746129572.134354:0:21725:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094fee400/0x40a459093b06a107 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4079616->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21254 expref: 27 pid: 7149 timeout: 927 lvb_type: 0 00000100:00100000:2.0:1746129572.134810:0:31522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734156160 00000100:00100000:2.0:1746129572.134817:0:31522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734156160 00002000:00100000:2.0:1746129572.134850:0:31522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f5:0x0] (2199552->2203647) req@ffff88009fbaf100 x1830948734156160/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:313/0 lens 488/0 e 0 to 0 dl 1746129583 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129572.134859:0:31522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbaf100 with x1830948734156160 ext(2199552->2203647) 00002000:00010000:2.0:1746129572.134864:0:31522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fbaf100 00000100:00100000:2.0:1746129572.134883:0:31522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7829 00000100:00100000:2.0:1746129572.134889:0:31522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:1963:x1830948734156160:12345-192.168.202.4@tcp:3:multiop.0 00002000:00010000:3.0:1746129572.134904:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800912ac380 00000100:00100000:2.0:1746129572.135057:0:31522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:1963:x1830948734156160:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 167us (1231us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129572.135063:0:31522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7829 00002000:00100000:2.0:1746129572.135070:0:31522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f5:0x0] (2199552->2203647) req@ffff88009fbaf100 x1830948734156160/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:313/0 lens 488/4536 e 0 to 0 dl 1746129583 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129572.135076:0:31522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbaf100 with x1830948734156160 ext(2199552->2203647) 00002000:00010000:2.0:1746129572.135078:0:31522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fbaf100 00000100:00100000:0.0:1746129572.138732:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129572.138841:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734156416 00000100:00100000:3.0:1746129572.138854:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734156416 00000100:00100000:3.0:1746129572.138951:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16268 00000100:00100000:3.0:1746129572.138957:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ada2ffba-8920-4ecb-8068-68caa9806978+28:32328:x1830948734156416:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:3.0:1746129572.138987:0:7149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129572.139548:0:7149:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094fef000/0x40a459093b06a123 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21270 expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129572.139592:0:7149:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800955d2600/0x40a459093b06a11c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2199552->2703359) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21269 expref: 19 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129572.139599:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129572.139600:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129572.139619:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094fef000/0x40a459093b06a123 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [3145728->4030463] (req 3145728->4030463) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21270 expref: 29 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129572.139672:0:7149:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800955d2600/0x40a459093b06a11c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2199552->2703359) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21269 expref: 19 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129572.139682:0:7149:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800955d2600/0x40a459093b06a11c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2199552->2703359) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21269 expref: 19 pid: 7149 timeout: 927 lvb_type: 0 00000100:00100000:3.0:1746129572.139706:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f37f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7149:1830948737530368:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129572.139870:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5ac9a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746129572.141898:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129572.142637:0:31523:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734156544 00000100:00100000:1.0:1746129572.142648:0:31523:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734156544 00002000:00100000:1.0:1746129572.142696:0:31523:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3ef:0x0] (4079616->4194303) req@ffff88009fbaed80 x1830948734156544/t0(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:313/0 lens 488/0 e 0 to 0 dl 1746129583 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129572.142706:0:31523:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbaed80 with x1830948734156544 ext(4079616->4194303) 00010000:00010000:1.0:1746129572.142715:0:31523:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094fee400/0x40a459093b06a107 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4079616->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21254 expref: 27 pid: 7149 timeout: 927 lvb_type: 0 00010000:00010000:1.0:1746129572.142728:0:31523:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094fee400/0x40a459093b06a107 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4079616->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21254 expref: 27 pid: 7149 timeout: 927 lvb_type: 0 00002000:00010000:1.0:1746129572.142735:0:31523:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fbaed80 00000100:00100000:1.0:1746129572.142768:0:31523:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2428 00000100:00100000:1.0:1746129572.142775:0:31523:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbaed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ada2ffba-8920-4ecb-8068-68caa9806978+27:1961:x1830948734156544:12345-192.168.202.4@tcp:4:multiop.0 00000100:00100000:3.0:1746129572.144958:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f37f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7149:1830948737530368:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129572.144993:0:7149:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094fef000/0x40a459093b06a123 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [3145728->4030463] (req 3145728->4030463) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21270 expref: 29 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129572.145011:0:7149:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094fef000, rc 0) 00000100:00100000:3.0:1746129572.145056:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ada2ffba-8920-4ecb-8068-68caa9806978+29:32328:x1830948734156416:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 6097us (6333us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129572.145065:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16268 00000100:00100000:0.0:1746129572.149722:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129572.150357:0:31522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734156800 00000100:00100000:3.0:1746129572.150366:0:31522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734156800 00002000:00100000:3.0:1746129572.150410:0:31522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f5:0x0] (2699264->2703359) req@ffff88009fbae300 x1830948734156800/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:313/0 lens 488/0 e 0 to 0 dl 1746129583 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129572.150421:0:31522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbae300 with x1830948734156800 ext(2699264->2703359) 00010000:00010000:3.0:1746129572.150430:0:31522:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800955d2600/0x40a459093b06a11c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2199552->2703359) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21269 expref: 20 pid: 7149 timeout: 927 lvb_type: 0 00010000:00010000:3.0:1746129572.150443:0:31522:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800955d2600/0x40a459093b06a11c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2199552->2703359) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21269 expref: 20 pid: 7149 timeout: 927 lvb_type: 0 00002000:00010000:3.0:1746129572.150449:0:31522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fbae300 00000100:00100000:3.0:1746129572.150486:0:31522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2429 00000100:00100000:3.0:1746129572.150495:0:31522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:1962:x1830948734156800:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:3.0:1746129572.150630:0:31522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:1962:x1830948734156800:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 137us (918us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129572.150636:0:31522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2429 00002000:00100000:3.0:1746129572.150641:0:31522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f5:0x0] (2699264->2703359) req@ffff88009fbae300 x1830948734156800/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:313/0 lens 488/4536 e 0 to 0 dl 1746129583 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129572.150648:0:31522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbae300 with x1830948734156800 ext(2699264->2703359) 00010000:00010000:3.0:1746129572.150652:0:31522:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800955d2600/0x40a459093b06a11c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2199552->2703359) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21269 expref: 20 pid: 7149 timeout: 927 lvb_type: 0 00010000:00010000:3.0:1746129572.150659:0:31522:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800955d2600/0x40a459093b06a11c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2199552->2703359) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21269 expref: 20 pid: 7149 timeout: 927 lvb_type: 0 00002000:00010000:3.0:1746129572.150669:0:31522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fbae300 00000100:00100000:1.0:1746129572.150976:0:31523:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbaed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ada2ffba-8920-4ecb-8068-68caa9806978+29:1961:x1830948734156544:12345-192.168.202.4@tcp:4:multiop.0 Request processed in 8199us (9087us total) trans 21474841370 rc 0/0 00000100:00100000:1.0:1746129572.150983:0:31523:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2428 00002000:00100000:1.0:1746129572.150988:0:31523:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3ef:0x0] (4079616->4194303) req@ffff88009fbaed80 x1830948734156544/t21474841370(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:313/0 lens 488/448 e 0 to 0 dl 1746129583 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129572.150996:0:31523:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbaed80 with x1830948734156544 ext(4079616->4194303) 00010000:00010000:1.0:1746129572.151002:0:31523:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094fee400/0x40a459093b06a107 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4079616->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21254 expref: 29 pid: 7149 timeout: 927 lvb_type: 0 00010000:00010000:1.0:1746129572.151010:0:31523:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094fee400/0x40a459093b06a107 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4079616->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21254 expref: 29 pid: 7149 timeout: 927 lvb_type: 0 00002000:00010000:1.0:1746129572.151016:0:31523:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fbaed80 00000100:00100000:0.0:1746129572.153095:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129572.153394:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734156928 00000100:00100000:3.0:1746129572.153403:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734156928 00010000:00010000:3.0:1746129572.153443:0:7087:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094fee400/0x40a459093b06a107 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4079616->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21254 expref: 29 pid: 7149 timeout: 927 lvb_type: 0 00000100:00100000:3.0:1746129572.153483:0:7087:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8339 00000100:00100000:3.0:1746129572.153491:0:7087:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ada2ffba-8920-4ecb-8068-68caa9806978+29:1963:x1830948734156928:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129572.153507:0:7087:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746129572.153527:0:7087:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb mtime from disk: 1746129571 -> 1746129572 00010000:00010000:3.0:1746129572.153533:0:7087:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094fee400/0x40a459093b06a107 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4079616->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21254 expref: 29 pid: 7149 timeout: 927 lvb_type: 0 00010000:00010000:3.0:1746129572.153543:0:7087:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094fee400/0x40a459093b06a107 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4079616->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21254 expref: 29 pid: 7149 timeout: 927 lvb_type: 0 00010000:00010000:3.0:1746129572.153568:0:7087:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094fee400/0x40a459093b06a107 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4079616->4194303) gid 0 flags: 0x44801000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21254 expref: 29 pid: 7149 timeout: 927 lvb_type: 0 00010000:00010000:3.0:1746129572.153602:0:7087:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129572.153604:0:7087:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129572.153610:0:7087:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0640400/0x40a459093b06a10e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2125b expref: 28 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129572.153618:0:7087:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0640400/0x40a459093b06a10e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2125b expref: 28 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129572.153631:0:7087:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129572.153632:0:7087:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129572.153636:0:7087:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800955d3800/0x40a459093b06a115 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21262 expref: 14 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129572.153642:0:7087:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800955d3800/0x40a459093b06a115 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21262 expref: 14 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129572.153673:0:7087:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800955d3800/0x40a459093b06a115 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21262 expref: 14 pid: 7149 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129572.153685:0:7087:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f37f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7087:1830948737530496:192.168.202.4@tcp:105: 00010000:00010000:3.0:1746129572.153776:0:7087:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0640400/0x40a459093b06a10e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2125b expref: 28 pid: 7149 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129572.153784:0:7087:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f37d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7087:1830948737530624:192.168.202.4@tcp:105: 00000100:00100000:3.0:1746129572.153801:0:7087:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5ac9300 going to sleep for 11 seconds 00000100:00100000:2.0:1746129572.154401:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129572.154463:0:31523:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734157184 00000100:00100000:0.0:1746129572.154467:0:31523:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734157184 00002000:00100000:0.0:1746129572.154497:0:31523:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f5:0x0] (2199552->2703359) req@ffff88009fa25f80 x1830948734157184/t0(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:313/0 lens 488/0 e 0 to 0 dl 1746129583 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129572.154512:0:31523:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fa25f80 with x1830948734157184 ext(2199552->2703359) 00010000:00010000:0.0:1746129572.154519:0:31523:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800955d2600/0x40a459093b06a11c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2199552->2703359) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21269 expref: 20 pid: 7149 timeout: 927 lvb_type: 0 00010000:00010000:0.0:1746129572.154530:0:31523:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800955d2600/0x40a459093b06a11c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2199552->2703359) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21269 expref: 20 pid: 7149 timeout: 927 lvb_type: 0 00002000:00010000:0.0:1746129572.154536:0:31523:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fa25f80 00000100:00100000:0.0:1746129572.154549:0:31523:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2430 00000100:00100000:0.0:1746129572.154554:0:31523:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:1961:x1830948734157184:12345-192.168.202.4@tcp:4:multiop.0 00000100:00100000:3.0:1746129572.159662:0:7087:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f37f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7087:1830948737530496:192.168.202.4@tcp:105: 00000100:00100000:3.0:1746129572.159677:0:7087:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f37d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7087:1830948737530624:192.168.202.4@tcp:105: 00010000:00010000:3.0:1746129572.159701:0:7087:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129572.159761:0:7087:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ada2ffba-8920-4ecb-8068-68caa9806978+28:1963:x1830948734156928:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 6270us (6673us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129572.159772:0:7087:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8339 00000100:00100000:0.0:1746129572.164204:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129572.164797:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129572.164906:0:31522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734157440 00000100:00100000:3.0:1746129572.164916:0:31522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734157440 00002000:00100000:3.0:1746129572.164963:0:31522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->4194303) req@ffff88009fbac000 x1830948734157440/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:313/0 lens 488/0 e 0 to 0 dl 1746129583 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129572.164972:0:31522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbac000 with x1830948734157440 ext(3145728->4194303) 00002000:00010000:3.0:1746129572.164977:0:31522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fbac000 00000100:00100000:3.0:1746129572.164995:0:31522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734157696 00000100:00100000:3.0:1746129572.164997:0:31522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734157696 00002000:00100000:3.0:1746129572.165008:0:31522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->4194303) req@ffff88009fbad880 x1830948734157696/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:313/0 lens 488/0 e 0 to 0 dl 1746129583 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129572.165014:0:31522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbad880 with x1830948734157696 ext(3145728->4194303) 00002000:00010000:3.0:1746129572.165018:0:31522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fbad880 00000100:00100000:3.0:1746129572.165030:0:31522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7830 00000100:00100000:3.0:1746129572.165038:0:31522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ada2ffba-8920-4ecb-8068-68caa9806978+28:1962:x1830948734157440:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:2.0:1746129572.165199:0:31520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7831 00000100:00100000:2.0:1746129572.165208:0:31520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+15:1962:x1830948734157696:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:1.0:1746129572.166473:0:31523:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+22:1961:x1830948734157184:12345-192.168.202.4@tcp:4:multiop.0 Request processed in 11911us (12065us total) trans 17179874122 rc 0/0 00000100:00100000:1.0:1746129572.166482:0:31523:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2430 00002000:00100000:1.0:1746129572.166490:0:31523:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f5:0x0] (2199552->2703359) req@ffff88009fa25f80 x1830948734157184/t17179874122(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:313/0 lens 488/448 e 0 to 0 dl 1746129583 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129572.166498:0:31523:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fa25f80 with x1830948734157184 ext(2199552->2703359) 00010000:00010000:1.0:1746129572.166512:0:31523:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800955d2600/0x40a459093b06a11c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2199552->2703359) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21269 expref: 22 pid: 7149 timeout: 927 lvb_type: 0 00010000:00010000:1.0:1746129572.166528:0:31523:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800955d2600/0x40a459093b06a11c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2199552->2703359) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21269 expref: 22 pid: 7149 timeout: 927 lvb_type: 0 00002000:00010000:1.0:1746129572.166534:0:31523:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fa25f80 00000100:00100000:0.0:1746129572.179026:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129572.179672:0:31520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+15:1962:x1830948734157696:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 14463us (14873us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129572.179684:0:31520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7831 00002000:00100000:2.0:1746129572.179699:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->4194303) req@ffff88009fbad880 x1830948734157696/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:313/0 lens 488/440 e 0 to 0 dl 1746129583 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129572.179708:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbad880 with x1830948734157696 ext(3145728->4194303) 00002000:00010000:2.0:1746129572.179714:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fbad880 00000100:00100000:3.0:1746129572.179844:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734157824 00000100:00100000:3.0:1746129572.179853:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734157824 00010000:00010000:3.0:1746129572.179885:0:7087:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800955d2600/0x40a459093b06a11c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2199552->2703359) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21269 expref: 22 pid: 7149 timeout: 927 lvb_type: 0 00000100:00100000:3.0:1746129572.179924:0:7087:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8340 00000100:00100000:3.0:1746129572.179932:0:7087:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbafb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+22:1962:x1830948734157824:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129572.179946:0:7087:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746129572.179965:0:7087:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f5:0x0] updating lvb mtime from disk: 1746129571 -> 1746129572 00010000:00010000:3.0:1746129572.179971:0:7087:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800955d2600/0x40a459093b06a11c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2199552->2703359) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21269 expref: 22 pid: 7149 timeout: 927 lvb_type: 0 00010000:00010000:3.0:1746129572.179984:0:7087:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800955d2600/0x40a459093b06a11c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2199552->2703359) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21269 expref: 22 pid: 7149 timeout: 927 lvb_type: 0 00010000:00010000:3.0:1746129572.180009:0:7087:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800955d2600/0x40a459093b06a11c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2199552->2703359) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21269 expref: 22 pid: 7149 timeout: 927 lvb_type: 0 00010000:00010000:3.0:1746129572.180030:0:7087:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129572.180032:0:7087:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129572.180039:0:7087:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094fef000/0x40a459093b06a123 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4030463) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21270 expref: 28 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129572.180047:0:7087:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094fef000/0x40a459093b06a123 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4030463) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21270 expref: 28 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129572.180082:0:7087:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880094fef000/0x40a459093b06a123 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4030463) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21270 expref: 28 pid: 7149 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129572.180095:0:7087:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f37d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7087:1830948737530752:192.168.202.4@tcp:105: 00000100:00100000:3.0:1746129572.180406:0:7087:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5ac9300 going to sleep for 11 seconds 00000100:00100000:3.0:1746129572.183525:0:7087:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f37d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7087:1830948737530752:192.168.202.4@tcp:105: 00010000:00010000:3.0:1746129572.183551:0:7087:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129572.183607:0:7087:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbafb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:1962:x1830948734157824:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 3675us (4591us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129572.183618:0:7087:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8340 00000100:00100000:2.0:1746129572.184158:0:31522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ada2ffba-8920-4ecb-8068-68caa9806978+28:1962:x1830948734157440:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 19120us (19964us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129572.184166:0:31522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7830 00002000:00100000:2.0:1746129572.184176:0:31522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->4194303) req@ffff88009fbac000 x1830948734157440/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:313/0 lens 488/440 e 0 to 0 dl 1746129583 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129572.184185:0:31522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbac000 with x1830948734157440 ext(3145728->4194303) 00002000:00010000:2.0:1746129572.184190:0:31522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fbac000 00000100:00100000:0.0:1746129572.185908:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129572.186576:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734157952 00000100:00100000:3.0:1746129572.186587:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734157952 00000100:00100000:3.0:1746129572.186648:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16269 00000100:00100000:3.0:1746129572.186656:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:32317:x1830948734157952:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129572.186680:0:7149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129572.186699:0:7149:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094feea00/0x40a459093b06a12a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21277 expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129572.186730:0:7149:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094fef000/0x40a459093b06a123 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4030463) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21270 expref: 28 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129572.186737:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129572.186739:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129572.186742:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094feea00/0x40a459093b06a12a lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21277 expref: 22 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129572.186773:0:7149:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094fef000/0x40a459093b06a123 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4030463) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21270 expref: 28 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129572.186784:0:7149:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094fef000/0x40a459093b06a123 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4030463) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21270 expref: 28 pid: 7149 timeout: 927 lvb_type: 0 00000100:00100000:3.0:1746129572.186796:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f37d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7149:1830948737530880:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129572.187783:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5ac9300 going to sleep for 11 seconds 00000100:00100000:0.0:1746129572.188864:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129572.188991:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f37d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7149:1830948737530880:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129572.189021:0:7149:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094feea00/0x40a459093b06a12a lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21277 expref: 22 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129572.189037:0:7149:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094feea00, rc 0) 00000100:00100000:3.0:1746129572.189101:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+22:32317:x1830948734157952:12345-192.168.202.4@tcp:101:cat.0 Request processed in 2444us (3200us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129572.189111:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16269 00000100:00100000:2.0:1746129572.189167:0:31522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734158208 00000100:00100000:2.0:1746129572.189174:0:31522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734158208 00002000:00100000:2.0:1746129572.189215:0:31522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f5:0x0] (4026368->4030463) req@ffff88009fbaea00 x1830948734158208/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:313/0 lens 488/0 e 0 to 0 dl 1746129583 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129572.189224:0:31522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbaea00 with x1830948734158208 ext(4026368->4030463) 00010000:00010000:2.0:1746129572.189231:0:31522:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094fef000/0x40a459093b06a123 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4030463) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21270 expref: 29 pid: 7149 timeout: 927 lvb_type: 0 00010000:00010000:2.0:1746129572.189256:0:31522:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094fef000/0x40a459093b06a123 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4030463) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21270 expref: 29 pid: 7149 timeout: 927 lvb_type: 0 00002000:00010000:2.0:1746129572.189263:0:31522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fbaea00 00000100:00100000:2.0:1746129572.189326:0:31522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2431 00000100:00100000:2.0:1746129572.189333:0:31522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbaea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ada2ffba-8920-4ecb-8068-68caa9806978+29:1962:x1830948734158208:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:2.0:1746129572.190471:0:31522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbaea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ada2ffba-8920-4ecb-8068-68caa9806978+29:1962:x1830948734158208:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 1134us (1608us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129572.190479:0:31522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2431 00002000:00100000:2.0:1746129572.190486:0:31522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f5:0x0] (4026368->4030463) req@ffff88009fbaea00 x1830948734158208/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:313/0 lens 488/4536 e 0 to 0 dl 1746129583 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129572.190494:0:31522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbaea00 with x1830948734158208 ext(4026368->4030463) 00010000:00010000:2.0:1746129572.190500:0:31522:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094fef000/0x40a459093b06a123 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4030463) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21270 expref: 29 pid: 7149 timeout: 927 lvb_type: 0 00010000:00010000:2.0:1746129572.190512:0:31522:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094fef000/0x40a459093b06a123 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4030463) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21270 expref: 29 pid: 7149 timeout: 927 lvb_type: 0 00002000:00010000:2.0:1746129572.190518:0:31522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fbaea00 00000100:00100000:0.0:1746129572.192405:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129572.192466:0:20861:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734158720 00000100:00100000:2.0:1746129572.192479:0:20861:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734158720 00000100:00100000:2.0:1746129572.192536:0:20861:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4765 00000100:00100000:2.0:1746129572.192545:0:20861:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:ada2ffba-8920-4ecb-8068-68caa9806978+292:32328:x1830948734158720:12345-192.168.202.4@tcp:35:multiop.0 00000100:00100000:2.0:1746129572.192796:0:20861:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:ada2ffba-8920-4ecb-8068-68caa9806978+293:32328:x1830948734158720:12345-192.168.202.4@tcp:35:multiop.0 Request processed in 251us (397us total) trans 8589945323 rc 0/0 00000100:00100000:2.0:1746129572.192804:0:20861:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4765 00000100:00100000:0.0:1746129572.193280:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129572.193330:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129572.193347:0:31520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734158848 00000100:00100000:0.0:1746129572.193350:0:31520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734158848 00002000:00100000:0.0:1746129572.193376:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3f5:0x0] (4030464->4194303) req@ffff88009fbad500 x1830948734158848/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:313/0 lens 488/0 e 0 to 0 dl 1746129583 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129572.193385:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbad500 with x1830948734158848 ext(4030464->4194303) 00010000:00010000:0.0:1746129572.193394:0:31520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094fef000/0x40a459093b06a123 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4030463) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21270 expref: 29 pid: 7149 timeout: 927 lvb_type: 0 00010000:00010000:0.0:1746129572.193413:0:31520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094fef000/0x40a459093b06a123 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4030463) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21270 expref: 29 pid: 7149 timeout: 927 lvb_type: 0 00002000:00010000:0.0:1746129572.193419:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fbad500 00000100:00100000:0.0:1746129572.193441:0:31520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734158464 00000100:00100000:0.0:1746129572.193444:0:31520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734158464 00002000:00100000:0.0:1746129572.193456:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3f5:0x0] (3145728->4030463) req@ffff88009fbaca80 x1830948734158464/t0(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:313/0 lens 488/0 e 0 to 0 dl 1746129583 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129572.193462:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbaca80 with x1830948734158464 ext(3145728->4030463) 00010000:00010000:0.0:1746129572.193466:0:31520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094fef000/0x40a459093b06a123 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4030463) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21270 expref: 30 pid: 7149 timeout: 927 lvb_type: 0 00010000:00010000:0.0:1746129572.193474:0:31520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094fef000/0x40a459093b06a123 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4030463) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21270 expref: 30 pid: 7149 timeout: 927 lvb_type: 0 00002000:00010000:0.0:1746129572.193479:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fbaca80 00000100:00100000:0.0:1746129572.193490:0:31520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2432 00000100:00100000:0.0:1746129572.193495:0:31520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ada2ffba-8920-4ecb-8068-68caa9806978+30:1963:x1830948734158848:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:2.0:1746129572.193613:0:31522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2433 00000100:00100000:2.0:1746129572.193619:0:31522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ada2ffba-8920-4ecb-8068-68caa9806978+30:1963:x1830948734158464:12345-192.168.202.4@tcp:4:multiop.0 00000100:00100000:1.0:1746129572.193913:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129572.194034:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734159104 00000100:00100000:3.0:1746129572.194039:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734159104 00000100:00100000:3.0:1746129572.194063:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16270 00000100:00100000:3.0:1746129572.194069:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b550700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ada2ffba-8920-4ecb-8068-68caa9806978+32:32320:x1830948734159104:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129572.194078:0:7149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129572.194093:0:7149:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094fefe00/0x40a459093b06a131 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2127e expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129572.194114:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129572.194119:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094fefe00/0x40a459093b06a131 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2127e expref: 33 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129572.194130:0:7149:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094fefe00/0x40a459093b06a131 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2127e expref: 33 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129572.194140:0:7149:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094fefe00, rc 0) 00000100:00100000:3.0:1746129572.194174:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b550700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ada2ffba-8920-4ecb-8068-68caa9806978+33:32320:x1830948734159104:12345-192.168.202.4@tcp:101:cat.0 Request processed in 105us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129572.194179:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16270 00000100:00100000:2.0:1746129572.196588:0:31520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ada2ffba-8920-4ecb-8068-68caa9806978+32:1963:x1830948734158848:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 3085us (3301us total) trans 0 rc 163840/163840 00000100:00100000:2.0:1746129572.196599:0:31520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2432 00002000:00100000:2.0:1746129572.196609:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3f5:0x0] (4030464->4194303) req@ffff88009fbad500 x1830948734158848/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:313/0 lens 488/440 e 0 to 0 dl 1746129583 ref 1 fl Complete:H/200/0 rc 163840/163840 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129572.196617:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbad500 with x1830948734158848 ext(4030464->4194303) 00010000:00010000:2.0:1746129572.196627:0:31520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094fef000/0x40a459093b06a123 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4030463) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21270 expref: 32 pid: 7149 timeout: 927 lvb_type: 0 00010000:00010000:2.0:1746129572.196640:0:31520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094fef000/0x40a459093b06a123 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4030463) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21270 expref: 32 pid: 7149 timeout: 927 lvb_type: 0 00002000:00010000:2.0:1746129572.196646:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fbad500 00000100:00100000:3.0:1746129572.210664:0:31522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ada2ffba-8920-4ecb-8068-68caa9806978+32:1963:x1830948734158464:12345-192.168.202.4@tcp:4:multiop.0 Request processed in 17030us (17319us total) trans 17179874123 rc 0/0 00000100:00100000:3.0:1746129572.210680:0:31522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2433 00002000:00100000:3.0:1746129572.210694:0:31522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f5:0x0] (3145728->4030463) req@ffff88009fbaca80 x1830948734158464/t17179874123(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:313/0 lens 488/448 e 0 to 0 dl 1746129583 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129572.210711:0:31522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbaca80 with x1830948734158464 ext(3145728->4030463) 00010000:00010000:3.0:1746129572.210722:0:31522:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094fef000/0x40a459093b06a123 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4030463) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21270 expref: 32 pid: 7149 timeout: 927 lvb_type: 0 00010000:00010000:3.0:1746129572.210739:0:31522:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094fef000/0x40a459093b06a123 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4030463) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21270 expref: 32 pid: 7149 timeout: 927 lvb_type: 0 00002000:00010000:3.0:1746129572.210746:0:31522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fbaca80 00000100:00100000:0.0:1746129572.214672:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129572.214775:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734159232 00000100:00100000:3.0:1746129572.214784:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734159232 00010000:00010000:3.0:1746129572.214826:0:7087:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094fef000/0x40a459093b06a123 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4030463) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21270 expref: 32 pid: 7149 timeout: 927 lvb_type: 0 00000100:00100000:3.0:1746129572.214965:0:7087:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8341 00000100:00100000:3.0:1746129572.214973:0:7087:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a46c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ada2ffba-8920-4ecb-8068-68caa9806978+32:1962:x1830948734159232:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129572.214988:0:7087:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129572.215016:0:7087:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094fef000/0x40a459093b06a123 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4030463) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21270 expref: 32 pid: 7149 timeout: 927 lvb_type: 0 00010000:00010000:3.0:1746129572.215029:0:7087:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094fef000/0x40a459093b06a123 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4030463) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21270 expref: 32 pid: 7149 timeout: 927 lvb_type: 0 00010000:00010000:3.0:1746129572.215054:0:7087:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094fef000/0x40a459093b06a123 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4030463) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21270 expref: 32 pid: 7149 timeout: 927 lvb_type: 0 00010000:00010000:3.0:1746129572.215084:0:7087:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129572.215087:0:7087:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129572.215093:0:7087:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094feea00/0x40a459093b06a12a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21277 expref: 21 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129572.215099:0:7087:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094feea00/0x40a459093b06a12a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21277 expref: 21 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129572.215106:0:7087:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129572.215107:0:7087:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129572.215109:0:7087:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094fefe00/0x40a459093b06a131 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2127e expref: 31 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129572.215112:0:7087:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094fefe00/0x40a459093b06a131 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2127e expref: 31 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129572.215148:0:7087:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880094fefe00/0x40a459093b06a131 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2127e expref: 31 pid: 7149 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129572.215158:0:7087:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f37d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7087:1830948737531008:192.168.202.4@tcp:105: 00010000:00010000:3.0:1746129572.215734:0:7087:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880094feea00/0x40a459093b06a12a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21277 expref: 21 pid: 7149 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129572.215744:0:7087:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f37f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7087:1830948737531136:192.168.202.4@tcp:105: 00000100:00100000:3.0:1746129572.215763:0:7087:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5ac9300 going to sleep for 11 seconds 00000100:00100000:3.0:1746129572.218998:0:7087:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f37d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7087:1830948737531008:192.168.202.4@tcp:105: 00000100:00100000:3.0:1746129572.219010:0:7087:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f37f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7087:1830948737531136:192.168.202.4@tcp:105: 00010000:00010000:3.0:1746129572.219035:0:7087:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129572.219221:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129572.219280:0:31522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734159488 00000100:00100000:2.0:1746129572.219287:0:31522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734159488 00002000:00100000:2.0:1746129572.219371:0:31522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f5:0x0] (3145728->4194303) req@ffff88009fbaf800 x1830948734159488/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:313/0 lens 488/0 e 0 to 0 dl 1746129583 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129572.219380:0:31522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbaf800 with x1830948734159488 ext(3145728->4194303) 00002000:00010000:2.0:1746129572.219385:0:31522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fbaf800 00000100:00100000:2.0:1746129572.219414:0:31520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7832 00000100:00100000:2.0:1746129572.219421:0:31520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ada2ffba-8920-4ecb-8068-68caa9806978+32:1961:x1830948734159488:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:3.0:1746129572.219714:0:7087:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a46c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ada2ffba-8920-4ecb-8068-68caa9806978+32:1962:x1830948734159232:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 4741us (5053us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129572.219724:0:7087:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8341 00000100:00100000:2.0:1746129572.221255:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129572.221336:0:31522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734159744 00000100:00100000:3.0:1746129572.221343:0:31522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734159744 00002000:00100000:3.0:1746129572.221661:0:31522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f5:0x0] (3145728->4194303) req@ffff88009fa24380 x1830948734159744/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:313/0 lens 488/0 e 0 to 0 dl 1746129583 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129572.221670:0:31522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fa24380 with x1830948734159744 ext(3145728->4194303) 00002000:00010000:3.0:1746129572.221675:0:31522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fa24380 00000100:00100000:3.0:1746129572.221705:0:31522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7833 00000100:00100000:3.0:1746129572.221713:0:31522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+22:1962:x1830948734159744:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:2.0:1746129572.228822:0:31520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ada2ffba-8920-4ecb-8068-68caa9806978+31:1961:x1830948734159488:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 9389us (9590us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129572.228835:0:31520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7832 00002000:00100000:2.0:1746129572.228848:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3f5:0x0] (3145728->4194303) req@ffff88009fbaf800 x1830948734159488/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:313/0 lens 488/440 e 0 to 0 dl 1746129583 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129572.228858:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbaf800 with x1830948734159488 ext(3145728->4194303) 00002000:00010000:2.0:1746129572.228864:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fbaf800 00000100:00100000:3.0:1746129572.234045:0:31522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+22:1962:x1830948734159744:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 12322us (12784us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129572.234056:0:31522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7833 00002000:00100000:3.0:1746129572.234068:0:31522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f5:0x0] (3145728->4194303) req@ffff88009fa24380 x1830948734159744/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:313/0 lens 488/440 e 0 to 0 dl 1746129583 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129572.234076:0:31522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fa24380 with x1830948734159744 ext(3145728->4194303) 00002000:00010000:3.0:1746129572.234082:0:31522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fa24380 00000100:00100000:0.0:1746129572.236264:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129572.236369:0:4699:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734159872 00000100:00100000:1.0:1746129572.236379:0:4699:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734159872 00000100:00100000:1.0:1746129572.236428:0:4699:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16271 00000100:00100000:1.0:1746129572.236435:0:4699:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ada2ffba-8920-4ecb-8068-68caa9806978+31:1960:x1830948734159872:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129572.236453:0:4699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129572.236471:0:4699:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c461200/0x40a459093b06a138 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21285 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129572.236523:0:4699:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b550000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4699:1830948737531264:192.168.202.4@tcp:106: 00000100:00100000:1.0:1746129572.236601:0:4699:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934d2f00 going to sleep for 11 seconds 00000100:00100000:1.0:1746129572.238026:0:4699:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b550000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4699:1830948737531264:192.168.202.4@tcp:106: 00010000:00010000:1.0:1746129572.238060:0:4699:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c461200/0x40a459093b06a138 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21285 expref: 32 pid: 4699 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129572.238074:0:4699:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c461200/0x40a459093b06a138 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21285 expref: 32 pid: 4699 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129572.238104:0:4699:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c461200, rc 0) 00000100:00100000:1.0:1746129572.238335:0:4699:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ada2ffba-8920-4ecb-8068-68caa9806978+31:1960:x1830948734159872:12345-192.168.202.4@tcp:101:cat.0 Request processed in 1900us (2078us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129572.238344:0:4699:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16271 00000100:00100000:0.0:1746129572.241775:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129572.241890:0:31522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734160128 00000100:00100000:3.0:1746129572.241900:0:31522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734160128 00002000:00100000:3.0:1746129572.241955:0:31522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3ef:0x0] (4194304->5148671) req@ffff88009fbae680 x1830948734160128/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:313/0 lens 488/0 e 0 to 0 dl 1746129583 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129572.241964:0:31522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbae680 with x1830948734160128 ext(4194304->5148671) 00002000:00010000:3.0:1746129572.241970:0:31522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fbae680 00000100:00100000:0.0:1746129572.242230:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129572.242264:0:31522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734160384 00000100:00100000:3.0:1746129572.242269:0:31522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734160384 00000100:00100000:0.0:1746129572.242270:0:8416:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7834 00000100:00100000:0.0:1746129572.242279:0:8416:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ada2ffba-8920-4ecb-8068-68caa9806978+28:1961:x1830948734160128:12345-192.168.202.4@tcp:3:cat.0 00002000:00100000:3.0:1746129572.242284:0:31522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3ef:0x0] (4194304->5148671) req@ffff88009fbaf480 x1830948734160384/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:313/0 lens 488/0 e 0 to 0 dl 1746129583 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129572.242291:0:31522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbaf480 with x1830948734160384 ext(4194304->5148671) 00002000:00010000:3.0:1746129572.242334:0:31522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fbaf480 00000100:00100000:3.0:1746129572.242675:0:21725:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7835 00000100:00100000:3.0:1746129572.242683:0:21725:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+15:1963:x1830948734160384:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:2.0:1746129572.257751:0:8416:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ada2ffba-8920-4ecb-8068-68caa9806978+28:1961:x1830948734160128:12345-192.168.202.4@tcp:3:cat.0 Request processed in 15461us (15975us total) trans 0 rc 954368/954368 00000100:00100000:2.0:1746129572.257762:0:8416:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7834 00002000:00100000:2.0:1746129572.257775:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3ef:0x0] (4194304->5148671) req@ffff88009fbae680 x1830948734160128/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:313/0 lens 488/440 e 0 to 0 dl 1746129583 ref 1 fl Complete:/200/0 rc 954368/954368 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129572.257784:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbae680 with x1830948734160128 ext(4194304->5148671) 00002000:00010000:2.0:1746129572.257791:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fbae680 00000100:00100000:3.0:1746129572.259708:0:21725:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+15:1963:x1830948734160384:12345-192.168.202.4@tcp:3:cat.0 Request processed in 17013us (17465us total) trans 0 rc 954368/954368 00000100:00100000:3.0:1746129572.259721:0:21725:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7835 00002000:00100000:3.0:1746129572.259732:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ef:0x0] (4194304->5148671) req@ffff88009fbaf480 x1830948734160384/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:313/0 lens 488/440 e 0 to 0 dl 1746129583 ref 1 fl Complete:/200/0 rc 954368/954368 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129572.259741:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbaf480 with x1830948734160384 ext(4194304->5148671) 00002000:00010000:3.0:1746129572.259747:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fbaf480 00000100:00100000:0.0:1746129572.263265:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129572.264225:0:4699:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734160512 00000100:00100000:1.0:1746129572.264239:0:4699:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734160512 00000100:00100000:1.0:1746129572.264349:0:4699:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16272 00000100:00100000:1.0:1746129572.264358:0:4699:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ada2ffba-8920-4ecb-8068-68caa9806978+31:1960:x1830948734160512:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129572.264378:0:4699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129572.264397:0:4699:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d94fe00/0x40a459093b06a13f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2128c expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129572.264457:0:4699:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b550000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4699:1830948737531392:192.168.202.4@tcp:106: 00000100:00100000:1.0:1746129572.264559:0:4699:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934d2f00 going to sleep for 11 seconds 00000100:00100000:1.0:1746129572.269465:0:4699:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b550000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4699:1830948737531392:192.168.202.4@tcp:106: 00010000:00010000:1.0:1746129572.269501:0:4699:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d94fe00/0x40a459093b06a13f lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2128c expref: 32 pid: 4699 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129572.269516:0:4699:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d94fe00/0x40a459093b06a13f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2128c expref: 32 pid: 4699 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129572.269549:0:4699:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d94fe00, rc 0) 00000100:00100000:1.0:1746129572.269606:0:4699:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ada2ffba-8920-4ecb-8068-68caa9806978+31:1960:x1830948734160512:12345-192.168.202.4@tcp:101:cat.0 Request processed in 5249us (6351us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129572.269614:0:4699:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16272 00000100:00100000:0.0:1746129572.270217:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129572.270269:0:16680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734160768 00000100:00100000:1.0:1746129572.270276:0:16680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734160768 00000100:00100000:1.0:1746129572.270348:0:16680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4766 00000100:00100000:1.0:1746129572.270355:0:16680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f531450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+13:32317:x1830948734160768:12345-192.168.202.4@tcp:35:cat.0 00000100:00100000:1.0:1746129572.270554:0:16680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f531450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+14:32317:x1830948734160768:12345-192.168.202.4@tcp:35:cat.0 Request processed in 199us (341us total) trans 8589945324 rc 0/0 00000100:00100000:1.0:1746129572.270560:0:16680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4766 00000100:00100000:2.0:1746129572.274361:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129572.276764:0:4699:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734160896 00000100:00100000:1.0:1746129572.276778:0:4699:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734160896 00000100:00100000:1.0:1746129572.276843:0:4699:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16273 00000100:00100000:1.0:1746129572.276861:0:4699:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ada2ffba-8920-4ecb-8068-68caa9806978+31:1960:x1830948734160896:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129572.276880:0:4699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129572.276900:0:4699:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d94ec00/0x40a459093b06a146 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21293 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129572.276960:0:4699:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b550000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4699:1830948737531520:192.168.202.4@tcp:106: 00000100:00100000:1.0:1746129572.277072:0:4699:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934d2240 going to sleep for 11 seconds 00000100:00100000:1.0:1746129572.279538:0:4699:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b550000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4699:1830948737531520:192.168.202.4@tcp:106: 00010000:00010000:1.0:1746129572.279578:0:4699:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d94ec00/0x40a459093b06a146 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21293 expref: 32 pid: 4699 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129572.279599:0:4699:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d94ec00/0x40a459093b06a146 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21293 expref: 32 pid: 4699 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129572.279621:0:4699:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d94ec00, rc 0) 00000100:00100000:1.0:1746129572.279738:0:4699:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ada2ffba-8920-4ecb-8068-68caa9806978+31:1960:x1830948734160896:12345-192.168.202.4@tcp:101:cat.0 Request processed in 2876us (5386us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129572.279746:0:4699:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16273 00000100:00100000:0.0:1746129572.285517:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129572.285874:0:20861:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734161152 00000100:00100000:2.0:1746129572.285884:0:20861:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734161152 00000100:00100000:2.0:1746129572.285945:0:20861:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4767 00000100:00100000:2.0:1746129572.285954:0:20861:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:ada2ffba-8920-4ecb-8068-68caa9806978+293:32320:x1830948734161152:12345-192.168.202.4@tcp:35:cat.0 00000100:00100000:2.0:1746129572.287251:0:20861:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:ada2ffba-8920-4ecb-8068-68caa9806978+294:32320:x1830948734161152:12345-192.168.202.4@tcp:35:cat.0 Request processed in 1290us (1736us total) trans 8589945325 rc 0/0 00000100:00100000:2.0:1746129572.287263:0:20861:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4767 00000100:00100000:0.0:1746129572.313941:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129572.314098:0:16908:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734161408 00000100:00100000:3.0:1746129572.314109:0:16908:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734161408 00000100:00100000:3.0:1746129572.314153:0:16908:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11230 00000100:00100000:3.0:1746129572.314160:0:16908:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ada2ffba-8920-4ecb-8068-68caa9806978+294:32337:x1830948734161408:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:3.0:1746129572.314181:0:16908:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129572.314198:0:16908:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95ec000/0x40a459093b06a14d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2129a expref: -99 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129572.314344:0:16908:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95ede00/0x40a459093b06a154 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129572.314358:0:16908:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95ede00/0x40a459093b06a154 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129572.314368:0:16908:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95ede00/0x40a459093b06a154 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129572.314380:0:16908:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95ece00/0x40a459093b06a15b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129572.314385:0:16908:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95ece00/0x40a459093b06a15b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129572.315428:0:16908:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95ece00/0x40a459093b06a15b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129572.315571:0:16908:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95ed800/0x40a459093b06a162 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129572.315581:0:16908:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95ed800/0x40a459093b06a162 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129572.315587:0:16908:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95ed800/0x40a459093b06a162 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00000004:00200000:3.0:1746129572.315598:0:16908:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:3.0:1746129572.315693:0:16908:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95ede00/0x40a459093b06a154 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129572.315699:0:16908:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95ede00/0x40a459093b06a154 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129572.315704:0:16908:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95ede00/0x40a459093b06a154 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129572.315710:0:16908:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a95ede00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:3.0:1746129572.315713:0:16908:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95ede00/0x40a459093b06a154 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129572.315719:0:16908:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95ede00/0x40a459093b06a154 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129572.315729:0:16908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880132ef8f00) 00010000:00010000:3.0:1746129572.315731:0:16908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129572.315735:0:16908:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95ede00/0x40a459093b06a154 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129572.315739:0:16908:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95ede00/0x40a459093b06a154 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129572.315772:0:16908:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95ece00/0x40a459093b06a15b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129572.315777:0:16908:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95ece00/0x40a459093b06a15b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129572.315780:0:16908:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95ece00/0x40a459093b06a15b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129572.315784:0:16908:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a95ece00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:3.0:1746129572.315785:0:16908:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95ece00/0x40a459093b06a15b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129572.315789:0:16908:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95ece00/0x40a459093b06a15b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129572.315795:0:16908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f9ba600) 00010000:00010000:3.0:1746129572.315796:0:16908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129572.315798:0:16908:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95ece00/0x40a459093b06a15b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129572.315802:0:16908:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95ece00/0x40a459093b06a15b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129572.315846:0:16908:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95ec000/0x40a459093b06a14d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2129a expref: 297 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129572.315858:0:16908:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95ed800/0x40a459093b06a162 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2129a expref: 296 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129572.315863:0:16908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:3.0:1746129572.315865:0:16908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746129572.315867:0:16908:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a95ed800, rc 0) 00000100:00100000:3.0:1746129572.315945:0:16908:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ada2ffba-8920-4ecb-8068-68caa9806978+296:32337:x1830948734161408:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 1784us (2014us total) trans 8589945326 rc 0/0 00000100:00100000:3.0:1746129572.315953:0:16908:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11230 00000100:00100000:0.0:1746129572.397888:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129572.398902:0:15096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734161664 00000100:00100000:2.0:1746129572.398915:0:15096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734161664 00000100:00100000:2.0:1746129572.399090:0:15096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11231 00000100:00100000:2.0:1746129572.399099:0:15096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+14:32339:x1830948734161664:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:2.0:1746129572.399126:0:15096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129572.400513:0:15096:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0b5800/0x40a459093b06a170 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f212a1 expref: -99 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129572.400653:0:15096:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0b5600/0x40a459093b06a177 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129572.400665:0:15096:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0b5600/0x40a459093b06a177 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129572.400676:0:15096:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0b5600/0x40a459093b06a177 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129572.400689:0:15096:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0b4600/0x40a459093b06a17e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129572.400694:0:15096:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0b4600/0x40a459093b06a17e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129572.400699:0:15096:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0b4600/0x40a459093b06a17e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129572.400810:0:15096:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094fef000/0x40a459093b06a185 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129572.400819:0:15096:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094fef000/0x40a459093b06a185 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129572.400825:0:15096:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094fef000/0x40a459093b06a185 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15096 initiator: MDT0 00000004:00200000:2.0:1746129572.400838:0:15096:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:2.0:1746129572.400920:0:15096:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0b5600/0x40a459093b06a177 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129572.400926:0:15096:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0b5600/0x40a459093b06a177 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129572.400932:0:15096:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0b5600/0x40a459093b06a177 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129572.400937:0:15096:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e0b5600 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746129572.400941:0:15096:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0b5600/0x40a459093b06a177 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129572.400946:0:15096:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0b5600/0x40a459093b06a177 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129572.400955:0:15096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880132ef8f00) 00010000:00010000:2.0:1746129572.400958:0:15096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129572.400961:0:15096:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0b5600/0x40a459093b06a177 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129572.400965:0:15096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0b5600/0x40a459093b06a177 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129572.400995:0:15096:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0b4600/0x40a459093b06a17e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129572.401000:0:15096:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0b4600/0x40a459093b06a17e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129572.401004:0:15096:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0b4600/0x40a459093b06a17e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129572.401011:0:15096:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e0b4600 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746129572.401013:0:15096:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0b4600/0x40a459093b06a17e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129572.401018:0:15096:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0b4600/0x40a459093b06a17e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129572.401024:0:15096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880136997f00) 00010000:00010000:2.0:1746129572.401026:0:15096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129572.401028:0:15096:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0b4600/0x40a459093b06a17e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129572.401032:0:15096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0b4600/0x40a459093b06a17e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129572.401073:0:15096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0b5800/0x40a459093b06a170 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f212a1 expref: 17 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129572.401083:0:15096:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094fef000/0x40a459093b06a185 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f212a1 expref: 16 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129572.401089:0:15096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:2.0:1746129572.401091:0:15096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746129572.401094:0:15096:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094fef000, rc 0) 00000100:00100000:2.0:1746129572.401174:0:15096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+16:32339:x1830948734161664:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 2074us (3295us total) trans 8589945327 rc 0/0 00000100:00100000:2.0:1746129572.401182:0:15096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11231 00000100:00100000:0.0:1746129572.408453:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129572.408794:0:20861:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734161920 00000100:00100000:2.0:1746129572.408804:0:20861:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734161920 00000100:00100000:2.0:1746129572.408871:0:20861:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4768 00000100:00100000:2.0:1746129572.408880:0:20861:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+16:32339:x1830948734161920:12345-192.168.202.4@tcp:35:multiop.0 00000100:00100000:2.0:1746129572.409150:0:20861:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+17:32339:x1830948734161920:12345-192.168.202.4@tcp:35:multiop.0 Request processed in 270us (711us total) trans 8589945328 rc 0/0 00000100:00100000:2.0:1746129572.409157:0:20861:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4768 00000100:00100000:0.0:1746129572.433680:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129572.434028:0:16908:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734162048 00000100:00100000:3.0:1746129572.434038:0:16908:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734162048 00000100:00080000:1.0:1746129572.434106:0:7097:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746129572.434119:0:16908:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11232 00000100:00100000:3.0:1746129572.434127:0:16908:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:068dab75-d300-4ead-a742-d14572ad1e50+9:32340:x1830948734162048:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:3.0:1746129572.434154:0:16908:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129572.434175:0:16908:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95ec000/0x40a459093b06a193 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f212a8 expref: -99 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129572.434563:0:16908:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95ece00/0x40a459093b06a19a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129572.434582:0:16908:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95ece00/0x40a459093b06a19a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129572.434592:0:16908:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95ece00/0x40a459093b06a19a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129572.434609:0:16908:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95ede00/0x40a459093b06a1a1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129572.434614:0:16908:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95ede00/0x40a459093b06a1a1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129572.434618:0:16908:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95ede00/0x40a459093b06a1a1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129572.434706:0:16908:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c22ca00/0x40a459093b06a1a8 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129572.434718:0:16908:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1c600/0x40a459093b06a0f9 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2124d expref: 16 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129572.434725:0:16908:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c22ca00/0x40a459093b06a1a8 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129572.434755:0:16908:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1c600/0x40a459093b06a0f9 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2124d expref: 16 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129572.434767:0:16908:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1c600/0x40a459093b06a0f9 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2124d expref: 16 pid: 16908 timeout: 927 lvb_type: 0 00000100:00100000:3.0:1746129572.434779:0:16908:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f37f100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16908:1830948737531648:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129572.434871:0:16908:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5ac9240 going to sleep for 11 seconds 00000100:00100000:3.0:1746129572.441488:0:16908:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f37f100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16908:1830948737531648:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129572.441515:0:16908:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012c22ca00/0x40a459093b06a1a8 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00000100:00100000:0.0:1746129572.443915:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129572.445377:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734162176 00000100:00100000:3.0:1746129572.445389:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734162176 00010000:00010000:3.0:1746129572.445426:0:7087:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1c600/0x40a459093b06a0f9 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2124d expref: 17 pid: 16908 timeout: 927 lvb_type: 0 00000100:00100000:3.0:1746129572.445479:0:7087:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8342 00000100:00100000:3.0:1746129572.445486:0:7087:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7d9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+17:1963:x1830948734162176:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129572.445498:0:7087:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129572.445503:0:7087:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1c600/0x40a459093b06a0f9 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2124d expref: 17 pid: 16908 timeout: 927 lvb_type: 0 00010000:00010000:3.0:1746129572.445513:0:7087:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1c600/0x40a459093b06a0f9 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2124d expref: 17 pid: 16908 timeout: 927 lvb_type: 0 00010000:00010000:3.0:1746129572.445530:0:7087:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1c600/0x40a459093b06a0f9 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2124d expref: 17 pid: 16908 timeout: 927 lvb_type: 0 00010000:00010000:3.0:1746129572.445557:0:7087:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:3.0:1746129572.445561:0:7087:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c22ca00/0x40a459093b06a1a8 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129572.445569:0:7087:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c22ca00/0x40a459093b06a1a8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129572.445575:0:7087:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c22ca00/0x40a459093b06a1a8 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129572.445605:0:7087:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129572.445646:0:7087:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7d9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+16:1963:x1830948734162176:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 161us (1743us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129572.445652:0:7087:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8342 00010000:00010000:2.0:1746129572.445871:0:16908:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012c22ca00/0x40a459093b06a1a8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129572.445878:0:16908:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c22ca00/0x40a459093b06a1a8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00000004:00200000:2.0:1746129572.445912:0:16908:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00000004:00200000:2.0:1746129572.445915:0:16908:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746129572.445928:0:16908:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012c22ca00/0x40a459093b06a1a8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129572.445937:0:16908:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c22ca00/0x40a459093b06a1a8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129572.445944:0:16908:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95ece00/0x40a459093b06a19a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129572.445950:0:16908:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95ece00/0x40a459093b06a19a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129572.445955:0:16908:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95ece00/0x40a459093b06a19a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129572.445960:0:16908:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a95ece00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746129572.445963:0:16908:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95ece00/0x40a459093b06a19a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129572.445969:0:16908:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95ece00/0x40a459093b06a19a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129572.445977:0:16908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880132ef8f00) 00010000:00010000:2.0:1746129572.445979:0:16908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129572.445982:0:16908:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95ece00/0x40a459093b06a19a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129572.445987:0:16908:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95ece00/0x40a459093b06a19a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129572.445999:0:16908:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95ede00/0x40a459093b06a1a1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129572.446004:0:16908:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95ede00/0x40a459093b06a1a1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129572.446009:0:16908:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95ede00/0x40a459093b06a1a1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129572.446460:0:16908:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a95ede00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746129572.446463:0:16908:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95ede00/0x40a459093b06a1a1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129572.446469:0:16908:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95ede00/0x40a459093b06a1a1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129572.446477:0:16908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f9ba600) 00010000:00010000:2.0:1746129572.446479:0:16908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129572.446481:0:16908:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95ede00/0x40a459093b06a1a1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129572.446485:0:16908:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95ede00/0x40a459093b06a1a1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129572.446514:0:16908:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95ec000/0x40a459093b06a193 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f212a8 expref: 11 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129572.446525:0:16908:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c22ca00/0x40a459093b06a1a8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f212a8 expref: 10 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129572.446531:0:16908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:2.0:1746129572.446533:0:16908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746129572.446535:0:16908:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c22ca00, rc 0) 00000100:00100000:2.0:1746129572.446564:0:16908:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:068dab75-d300-4ead-a742-d14572ad1e50+10:32340:x1830948734162048:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 12439us (12894us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129572.446570:0:16908:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11232 00000100:00100000:0.0:1746129572.451886:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129572.451922:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129572.453499:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129572.453583:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129572.453599:0:4699:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734162304 00000100:00100000:1.0:1746129572.453608:0:4699:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734162304 00000100:00100000:1.0:1746129572.453650:0:4699:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734162432 00000100:00100000:1.0:1746129572.453652:0:4699:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734162432 00000100:00100000:1.0:1746129572.453669:0:4699:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734162560 00000100:00100000:1.0:1746129572.453671:0:4699:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734162560 00000100:00100000:1.0:1746129572.453685:0:4699:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16274 00000100:00100000:1.0:1746129572.453691:0:4699:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:068dab75-d300-4ead-a742-d14572ad1e50+8:1961:x1830948734162304:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:1.0:1746129572.453709:0:4699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129572.453726:0:4699:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d94f000/0x40a459093b06a1af lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f212af expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129572.453748:0:4699:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129572.453750:0:4699:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129572.453759:0:4699:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d94f000/0x40a459093b06a1af lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f212af expref: 9 pid: 4699 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129572.453772:0:4699:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d94f000/0x40a459093b06a1af lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f212af expref: 9 pid: 4699 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129572.453786:0:4699:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d94f000, rc 0) 00000100:00100000:1.0:1746129572.453835:0:4699:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:068dab75-d300-4ead-a742-d14572ad1e50+9:1961:x1830948734162304:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 144us (1961us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129572.453841:0:4699:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16274 00000100:00100000:1.0:1746129572.453856:0:4699:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16275 00000100:00100000:1.0:1746129572.453860:0:4699:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:068dab75-d300-4ead-a742-d14572ad1e50+9:1961:x1830948734162432:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:1.0:1746129572.453867:0:4699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746129572.454073:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16276 00010000:00010000:1.0:1746129572.454122:0:4699:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d94f400/0x40a459093b06a1b6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f212b6 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129572.454188:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734162688 00000100:00100000:0.0:1746129572.454191:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734162688 00000100:00100000:3.0:1746129572.454230:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:068dab75-d300-4ead-a742-d14572ad1e50+10:1961:x1830948734162560:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:3.0:1746129572.454236:0:7149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129572.454242:0:7149:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880132edd400/0x40a459093b06a1bd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f212bd expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129572.454251:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129572.454252:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129572.454256:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880132edd400/0x40a459093b06a1bd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f212bd expref: 11 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129572.454265:0:7149:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880132edd400/0x40a459093b06a1bd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f212bd expref: 11 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129572.454271:0:7149:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132edd400, rc 0) 00000100:00100000:3.0:1746129572.454290:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:068dab75-d300-4ead-a742-d14572ad1e50+11:1961:x1830948734162560:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 69us (797us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129572.454317:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16276 00000100:00100000:2.0:1746129572.454331:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129572.454354:0:31503:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734162816 00000100:00100000:3.0:1746129572.454357:0:31503:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734162816 00000100:00100000:3.0:1746129572.454381:0:31503:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16277 00000100:00100000:3.0:1746129572.454385:0:31503:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:068dab75-d300-4ead-a742-d14572ad1e50+10:1961:x1830948734162816:12345-192.168.202.4@tcp:101:lfs.0 00000100:00100000:2.0:1746129572.454389:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00010000:00010000:3.0:1746129572.454391:0:31503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129572.454398:0:31503:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880132edc000/0x40a459093b06a1c4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f212cb expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129572.454402:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734162944 00000100:00100000:2.0:1746129572.454407:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734162944 00010000:00010000:3.0:1746129572.454412:0:31503:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129572.454414:0:31503:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129572.454419:0:31503:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880132edc000/0x40a459093b06a1c4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f212cb expref: 11 pid: 31503 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129572.454428:0:31503:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880132edc000/0x40a459093b06a1c4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f212cb expref: 11 pid: 31503 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746129572.454434:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16278 00010000:00010000:3.0:1746129572.454435:0:31503:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132edc000, rc 0) 00000100:00100000:2.0:1746129572.454439:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:068dab75-d300-4ead-a742-d14572ad1e50+11:1961:x1830948734162944:12345-192.168.202.4@tcp:101:lfs.0 00000100:00100000:3.0:1746129572.454451:0:31503:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:068dab75-d300-4ead-a742-d14572ad1e50+11:1961:x1830948734162816:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 66us (158us total) trans 0 rc 0/0 00010000:00010000:2.0:1746129572.454455:0:4385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746129572.454456:0:31503:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16277 00010000:00010000:2.0:1746129572.454468:0:4385:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e0b4600/0x40a459093b06a1cb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f212d2 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129572.454486:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129572.454487:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129572.454493:0:4385:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e0b4600/0x40a459093b06a1cb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f212d2 expref: 12 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129572.454505:0:4385:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012e0b4600/0x40a459093b06a1cb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f212d2 expref: 12 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129572.454517:0:4385:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e0b4600, rc 0) 00000100:00100000:2.0:1746129572.454546:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:068dab75-d300-4ead-a742-d14572ad1e50+12:1961:x1830948734162944:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 106us (156us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129572.454551:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16278 00000100:00100000:1.0:1746129572.454621:0:4699:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b550000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4699:1830948737531776:192.168.202.4@tcp:106: 00000100:00100000:1.0:1746129572.454680:0:4699:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934d2240 going to sleep for 11 seconds 00000100:00100000:0.0:1746129572.454778:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16279 00000100:00100000:0.0:1746129572.454785:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:068dab75-d300-4ead-a742-d14572ad1e50+10:1961:x1830948734162688:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:0.0:1746129572.454791:0:7148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129572.454799:0:7148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880132fc2600/0x40a459093b06a1d2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f212c4 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129572.454811:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129572.454812:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129572.454817:0:7148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880132fc2600/0x40a459093b06a1d2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f212c4 expref: 11 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129572.454826:0:7148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880132fc2600/0x40a459093b06a1d2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f212c4 expref: 11 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129572.454837:0:7148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132fc2600, rc 0) 00000100:00100000:0.0:1746129572.454851:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:068dab75-d300-4ead-a742-d14572ad1e50+11:1961:x1830948734162688:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 68us (1270us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129572.454856:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16279 00010000:00010000:3.0:1746129572.475121:0:7088:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746129572.477623:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129572.479057:0:8410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734163072 00000100:00100000:2.0:1746129572.479072:0:8410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734163072 00000100:00100000:2.0:1746129572.479149:0:8410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16280 00000100:00100000:2.0:1746129572.479158:0:8410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ada2ffba-8920-4ecb-8068-68caa9806978+28:32337:x1830948734163072:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:2.0:1746129572.479182:0:8410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129572.479204:0:8410:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e0b5600/0x40a459093b06a1d9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f212d9 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129572.479243:0:8410:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0640400/0x40a459093b06a10e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2125b expref: 29 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129572.479252:0:8410:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880132edc000/0x40a459093b06a1c4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f212cb expref: 10 pid: 31503 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129572.479260:0:8410:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800955d3800/0x40a459093b06a115 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21262 expref: 14 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129572.479267:0:8410:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129572.479269:0:8410:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129572.479272:0:8410:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e0b5600/0x40a459093b06a1d9 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [3497984->4194303] (req 3497984->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f212d9 expref: 29 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129572.479341:0:8410:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800955d3800/0x40a459093b06a115 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21262 expref: 14 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129572.479358:0:8410:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800955d3800/0x40a459093b06a115 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21262 expref: 14 pid: 7149 timeout: 927 lvb_type: 0 00000100:00100000:2.0:1746129572.479372:0:8410:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800959d4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8410:1830948737531904:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129572.479493:0:8410:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880132edc000/0x40a459093b06a1c4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f212cb expref: 10 pid: 31503 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129572.479501:0:8410:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880132edc000/0x40a459093b06a1c4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f212cb expref: 10 pid: 31503 timeout: 927 lvb_type: 1 00000100:00100000:2.0:1746129572.479509:0:8410:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800959d4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8410:1830948737532032:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129572.479532:0:8410:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0640400/0x40a459093b06a10e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2125b expref: 29 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129572.479539:0:8410:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a0640400/0x40a459093b06a10e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2125b expref: 29 pid: 7149 timeout: 927 lvb_type: 0 00000100:00100000:2.0:1746129572.479546:0:8410:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800959d6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8410:1830948737532160:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129572.479564:0:8410:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009af1e9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746129572.482633:0:4699:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b550000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4699:1830948737531776:192.168.202.4@tcp:106: 00010000:00010000:1.0:1746129572.482673:0:4699:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d94f400/0x40a459093b06a1b6 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f212b6 expref: 11 pid: 4699 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129572.482687:0:4699:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d94f400/0x40a459093b06a1b6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f212b6 expref: 11 pid: 4699 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129572.482705:0:4699:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d94f400, rc 0) 00000100:00100000:1.0:1746129572.482755:0:4699:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:068dab75-d300-4ead-a742-d14572ad1e50+10:1961:x1830948734162432:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 28893us (30831us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129572.482763:0:4699:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16275 00000100:00100000:0.0:1746129572.493684:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129572.493751:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129572.493784:0:15749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734163200 00000100:00100000:0.0:1746129572.493792:0:15749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734163200 00010000:00010000:0.0:1746129572.493828:0:15749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0640400/0x40a459093b06a10e lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2125b expref: 30 pid: 7149 timeout: 927 lvb_type: 0 00000100:00100000:0.0:1746129572.493858:0:15749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8343 00000100:00100000:0.0:1746129572.493866:0:15749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7d9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ada2ffba-8920-4ecb-8068-68caa9806978+30:1960:x1830948734163200:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129572.493879:0:15749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129572.493905:0:15749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a0640400/0x40a459093b06a10e lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2125b expref: 30 pid: 7149 timeout: 927 lvb_type: 0 00010000:00010000:0.0:1746129572.493916:0:15749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a0640400/0x40a459093b06a10e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2125b expref: 30 pid: 7149 timeout: 927 lvb_type: 0 00010000:00010000:0.0:1746129572.493944:0:15749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129572.493986:0:15749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7d9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ada2ffba-8920-4ecb-8068-68caa9806978+30:1960:x1830948734163200:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 121us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129572.493992:0:15749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8343 00010000:00010000:0.0:1746129572.494097:0:8410:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0640400/0x40a459093b06a10e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2125b expref: 29 pid: 7149 timeout: 927 lvb_type: 0 00000100:00100000:0.0:1746129572.494113:0:8410:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800959d6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8410:1830948737532160:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129572.497442:0:16908:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734163456 00000100:00100000:3.0:1746129572.497464:0:16908:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734163456 00000100:00100000:3.0:1746129572.497567:0:16908:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11233 00000100:00100000:3.0:1746129572.497579:0:16908:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:068dab75-d300-4ead-a742-d14572ad1e50+10:32340:x1830948734163456:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:3.0:1746129572.497613:0:16908:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129572.497648:0:16908:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880132edc800/0x40a459093b06a1e0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f212e0 expref: -99 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129572.497814:0:16908:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880132edde00/0x40a459093b06a1e7 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129572.497832:0:16908:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c22ca00/0x40a459093b06a1a8 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f212a8 expref: 11 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129572.497852:0:16908:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880132edde00/0x40a459093b06a1e7 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129572.497892:0:16908:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012c22ca00/0x40a459093b06a1a8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f212a8 expref: 11 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129572.497901:0:16908:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c22ca00/0x40a459093b06a1a8 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f212a8 expref: 11 pid: 16908 timeout: 927 lvb_type: 0 00000100:00100000:3.0:1746129572.497913:0:16908:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f37f100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16908:1830948737532288:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129572.498026:0:16908:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5ac9240 going to sleep for 11 seconds 00000100:00100000:0.0:1746129572.498110:0:8410:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800959d4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8410:1830948737531904:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129572.498153:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129572.498181:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734163712 00000100:00100000:0.0:1746129572.498184:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734163712 00000100:00100000:0.0:1746129572.498205:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11234 00000100:00100000:0.0:1746129572.498209:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+16:32343:x1830948734163712:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129572.498220:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129572.498226:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880132fc3000/0x40a459093b06a1ee lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f212e7 expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129572.498356:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd4fc00/0x40a459093b06a1f5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129572.498365:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd4fc00/0x40a459093b06a1f5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129572.498376:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd4fc00/0x40a459093b06a1f5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129572.498387:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd4f000/0x40a459093b06a1fc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129572.498392:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd4f000/0x40a459093b06a1fc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129572.498397:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd4f000/0x40a459093b06a1fc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129572.498489:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091570a00/0x40a459093b06a203 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129572.498496:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091570a00/0x40a459093b06a203 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129572.498501:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091570a00/0x40a459093b06a203 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00200000:0.0:1746129572.498509:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:0.0:1746129572.498590:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd4fc00/0x40a459093b06a1f5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129572.498597:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd4fc00/0x40a459093b06a1f5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129572.498602:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd4fc00/0x40a459093b06a1f5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129572.498607:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012fd4fc00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:0.0:1746129572.498611:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd4fc00/0x40a459093b06a1f5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129572.498617:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd4fc00/0x40a459093b06a1f5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129572.498628:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880132ef8f00) 00010000:00010000:0.0:1746129572.498630:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129572.498634:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd4fc00/0x40a459093b06a1f5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129572.498638:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd4fc00/0x40a459093b06a1f5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129572.498653:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd4f000/0x40a459093b06a1fc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129572.498658:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd4f000/0x40a459093b06a1fc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129572.498662:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd4f000/0x40a459093b06a1fc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129572.498666:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012fd4f000 already unused, calling callback (ffffffffa136e690) 00010000:00010000:0.0:1746129572.498670:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd4f000/0x40a459093b06a1fc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129572.498675:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd4f000/0x40a459093b06a1fc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129572.498682:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f9f3700) 00010000:00010000:0.0:1746129572.498684:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129572.498686:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd4f000/0x40a459093b06a1fc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129572.498690:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd4f000/0x40a459093b06a1fc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129572.498735:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880132fc3000/0x40a459093b06a1ee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f212e7 expref: 19 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129572.498754:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091570a00/0x40a459093b06a203 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f212e7 expref: 18 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129572.498760:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:0.0:1746129572.498763:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746129572.498765:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091570a00, rc 0) 00000100:00100000:0.0:1746129572.498828:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+18:32343:x1830948734163712:12345-192.168.202.4@tcp:101:cat.0 Request processed in 615us (671us total) trans 8589945329 rc 0/0 00000100:00100000:0.0:1746129572.498835:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11234 00000100:00100000:1.0:1746129572.503841:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129572.503875:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129572.503962:0:15749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734163840 00000100:00100000:1.0:1746129572.503970:0:15749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734163840 00010000:00010000:1.0:1746129572.504005:0:15749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800955d3800/0x40a459093b06a115 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21262 expref: 15 pid: 7149 timeout: 927 lvb_type: 0 00000100:00100000:1.0:1746129572.504043:0:15749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734163968 00000100:00100000:1.0:1746129572.504046:0:15749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734163968 00010000:00010000:1.0:1746129572.504056:0:15749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880132edc000/0x40a459093b06a1c4 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f212cb expref: 11 pid: 31503 timeout: 927 lvb_type: 1 00000100:00100000:1.0:1746129572.504074:0:15749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8344 00000100:00100000:1.0:1746129572.504080:0:15749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b550000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+15:1961:x1830948734163840:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129572.504094:0:15749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129572.504117:0:15749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800955d3800/0x40a459093b06a115 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21262 expref: 15 pid: 7149 timeout: 927 lvb_type: 0 00010000:00010000:1.0:1746129572.504128:0:15749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800955d3800/0x40a459093b06a115 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21262 expref: 15 pid: 7149 timeout: 927 lvb_type: 0 00010000:00010000:1.0:1746129572.504150:0:15749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800955d3800/0x40a459093b06a115 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21262 expref: 15 pid: 7149 timeout: 927 lvb_type: 0 00000100:00100000:3.0:1746129572.504217:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8345 00000100:00100000:3.0:1746129572.504225:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b551500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:068dab75-d300-4ead-a742-d14572ad1e50+11:1961:x1830948734163968:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129572.504232:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129572.504242:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880132edc000/0x40a459093b06a1c4 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f212cb expref: 11 pid: 31503 timeout: 927 lvb_type: 1 00010000:00010000:3.0:1746129572.504250:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880132edc000/0x40a459093b06a1c4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f212cb expref: 11 pid: 31503 timeout: 927 lvb_type: 1 00010000:00010000:3.0:1746129572.504263:0:9823:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129572.504265:0:9823:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129572.504273:0:9823:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012e0b5600/0x40a459093b06a1d9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3497984->4194303) gid 0 flags: 0x50080000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f212d9 expref: 28 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129572.504279:0:9823:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e0b5600/0x40a459093b06a1d9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3497984->4194303) gid 0 flags: 0x50080000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f212d9 expref: 28 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129572.504352:0:9823:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012e0b5600/0x40a459093b06a1d9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3497984->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f212d9 expref: 28 pid: 8410 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129572.504365:0:9823:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f37d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9823:1830948737532416:192.168.202.4@tcp:105: 00000100:00100000:3.0:1746129572.504448:0:9823:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5ac9e40 going to sleep for 11 seconds 00010000:00010000:1.0:1746129572.507562:0:15749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746129572.507711:0:8410:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880132edc000/0x40a459093b06a1c4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f212cb expref: 11 pid: 31503 timeout: 927 lvb_type: 1 00000100:00100000:2.0:1746129572.507739:0:8410:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800959d4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8410:1830948737532032:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129572.507777:0:8410:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012e0b5600/0x40a459093b06a1d9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3497984->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f212d9 expref: 28 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129572.507788:0:8410:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e0b5600, rc 0) 00000100:00100000:1.0:1746129572.509281:0:15749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b550000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+14:1961:x1830948734163840:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 5191us (5442us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129572.509319:0:15749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8344 00000100:00100000:2.0:1746129572.509786:0:8410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ada2ffba-8920-4ecb-8068-68caa9806978+28:32337:x1830948734163072:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 30626us (32171us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129572.509794:0:8410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16280 00000100:00100000:1.0:1746129572.510014:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129572.510675:0:15749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734164224 00000100:00100000:0.0:1746129572.510683:0:15749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734164224 00000100:00100000:0.0:1746129572.510723:0:15749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 792 00000100:00100000:0.0:1746129572.510729:0:15749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b551180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+18:1962:x1830948734164224:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129572.510740:0:15749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129572.510762:0:15749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091570a00/0x40a459093b06a203 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f212e7 expref: 18 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129572.510778:0:15749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:0.0:1746129572.510782:0:15749:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880132edde00/0x40a459093b06a1e7 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129572.510790:0:15749:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880132edde00/0x40a459093b06a1e7 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129572.510794:0:15749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129572.511032:0:16908:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f37f100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16908:1830948737532288:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129572.511057:0:16908:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880132edde00/0x40a459093b06a1e7 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00000100:00100000:2.0:1746129572.511098:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129572.511128:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734164480 00000100:00100000:2.0:1746129572.511132:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734164480 00000100:00100000:2.0:1746129572.511505:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11235 00000100:00100000:2.0:1746129572.511512:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ada2ffba-8920-4ecb-8068-68caa9806978+296:32346:x1830948734164480:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129572.511534:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129572.511546:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f445600/0x40a459093b06a211 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f212ee expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129572.511788:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129572.511826:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734164096 00000100:00100000:1.0:1746129572.511829:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734164096 00010000:00010000:1.0:1746129572.511845:0:7087:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c22ca00/0x40a459093b06a1a8 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f212a8 expref: 12 pid: 16908 timeout: 927 lvb_type: 0 00000100:00100000:1.0:1746129572.511868:0:20578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8346 00000100:00100000:1.0:1746129572.511873:0:20578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b551f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:068dab75-d300-4ead-a742-d14572ad1e50+12:1963:x1830948734164096:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129572.511879:0:20578:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129572.511883:0:20578:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012c22ca00/0x40a459093b06a1a8 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f212a8 expref: 12 pid: 16908 timeout: 927 lvb_type: 0 00010000:00010000:1.0:1746129572.511893:0:20578:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012c22ca00/0x40a459093b06a1a8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f212a8 expref: 12 pid: 16908 timeout: 927 lvb_type: 0 00010000:00010000:1.0:1746129572.511905:0:20578:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c22ca00/0x40a459093b06a1a8 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f212a8 expref: 12 pid: 16908 timeout: 927 lvb_type: 0 00010000:00010000:1.0:1746129572.511916:0:20578:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:1.0:1746129572.511919:0:20578:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880132edde00/0x40a459093b06a1e7 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129572.511925:0:20578:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880132edde00/0x40a459093b06a1e7 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129572.511931:0:20578:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880132edde00/0x40a459093b06a1e7 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129572.511946:0:20578:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129572.511968:0:20578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b551f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:068dab75-d300-4ead-a742-d14572ad1e50+11:1963:x1830948734164096:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 94us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129572.511977:0:20578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8346 00010000:00010000:1.0:1746129572.512001:0:16908:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880132edde00/0x40a459093b06a1e7 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129572.512007:0:16908:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880132edde00/0x40a459093b06a1e7 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00000100:00100000:0.0:1746129572.512254:0:15749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b551180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+17:1962:x1830948734164224:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 1523us (2238us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129572.512261:0:15749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 792 00000100:00100000:3.0:1746129572.512513:0:9823:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f37d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9823:1830948737532416:192.168.202.4@tcp:105: 00010000:00010000:3.0:1746129572.512528:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129572.512545:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b551500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:068dab75-d300-4ead-a742-d14572ad1e50+10:1961:x1830948734163968:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 8322us (8670us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129572.512551:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8345 00010000:00010000:2.0:1746129572.512674:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f444600/0x40a459093b06a218 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129572.512683:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f444600/0x40a459093b06a218 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129572.512689:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f444600/0x40a459093b06a218 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129572.512700:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f444e00/0x40a459093b06a21f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129572.512707:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f444e00/0x40a459093b06a21f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129572.512711:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f444e00/0x40a459093b06a21f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129572.512825:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f444200/0x40a459093b06a226 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129572.512833:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f444200/0x40a459093b06a226 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129572.512839:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f444200/0x40a459093b06a226 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00200000:2.0:1746129572.512848:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:2.0:1746129572.512938:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f444600/0x40a459093b06a218 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129572.512945:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f444600/0x40a459093b06a218 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129572.512951:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f444600/0x40a459093b06a218 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129572.512956:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f444600 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746129572.512959:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f444600/0x40a459093b06a218 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129572.512965:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f444600/0x40a459093b06a218 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129572.512973:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880132ef8f00) 00010000:00010000:2.0:1746129572.512977:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129572.512980:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f444600/0x40a459093b06a218 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129572.512983:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f444600/0x40a459093b06a218 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129572.512991:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f444e00/0x40a459093b06a21f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129572.512994:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f444e00/0x40a459093b06a21f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129572.512998:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f444e00/0x40a459093b06a21f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129572.513002:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f444e00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746129572.513004:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f444e00/0x40a459093b06a21f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129572.513009:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f444e00/0x40a459093b06a21f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129572.513013:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880136997000) 00010000:00010000:2.0:1746129572.513015:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129572.513017:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f444e00/0x40a459093b06a21f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129572.513020:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f444e00/0x40a459093b06a21f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129572.513058:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f445600/0x40a459093b06a211 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f212ee expref: 299 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129572.513072:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f444200/0x40a459093b06a226 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f212ee expref: 298 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129572.513078:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:2.0:1746129572.513080:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746129572.513082:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f444200, rc 0) 00000100:00100000:2.0:1746129572.513112:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ada2ffba-8920-4ecb-8068-68caa9806978+298:32346:x1830948734164480:12345-192.168.202.4@tcp:101:cat.0 Request processed in 1601us (2142us total) trans 8589945330 rc 0/0 00000100:00100000:2.0:1746129572.513118:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11235 00000004:00200000:1.0:1746129572.514341:0:16908:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:1.0:1746129572.514448:0:16908:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880132edc800/0x40a459093b06a1e0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f212e0 expref: 12 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129572.514466:0:16908:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880132edde00/0x40a459093b06a1e7 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f212e0 expref: 11 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129572.514471:0:16908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:1.0:1746129572.514474:0:16908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746129572.514476:0:16908:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132edde00, rc 0) 00000100:00100000:1.0:1746129572.514531:0:16908:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:068dab75-d300-4ead-a742-d14572ad1e50+11:32340:x1830948734163456:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 16954us (20857us total) trans 8589945331 rc 0/0 00000100:00100000:1.0:1746129572.514538:0:16908:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11233 00000100:00100000:0.0:1746129572.514834:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129572.515060:0:8410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734164608 00000100:00100000:2.0:1746129572.515067:0:8410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734164608 00000100:00100000:2.0:1746129572.515098:0:8410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16281 00000100:00100000:2.0:1746129572.515103:0:8410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+14:1962:x1830948734164608:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129572.515115:0:8410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129572.515128:0:8410:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fd4f000/0x40a459093b06a23b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f212f5 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129572.515170:0:8410:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800959d4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8410:1830948737532544:192.168.202.4@tcp:106: 00000100:00100000:2.0:1746129572.516013:0:8410:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009af1e540 going to sleep for 11 seconds 00000100:00100000:3.0:1746129572.516357:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129572.516403:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129572.516423:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734164864 00000100:00100000:3.0:1746129572.516427:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734164864 00000100:00100000:3.0:1746129572.516473:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 793 00000100:00100000:3.0:1746129572.516479:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a46850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ada2ffba-8920-4ecb-8068-68caa9806978+298:1960:x1830948734164864:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129572.516491:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129572.516509:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f444200/0x40a459093b06a226 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f212ee expref: 298 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129572.516527:0:9823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:3.0:1746129572.516532:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129572.516554:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a46850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ada2ffba-8920-4ecb-8068-68caa9806978+297:1960:x1830948734164864:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 74us (150us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129572.516560:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 793 00000100:00100000:1.0:1746129572.516854:0:4699:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734164736 00000100:00100000:1.0:1746129572.516858:0:4699:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734164736 00000100:00100000:1.0:1746129572.516879:0:4699:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16282 00000100:00100000:1.0:1746129572.516883:0:4699:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f37d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ada2ffba-8920-4ecb-8068-68caa9806978+31:1963:x1830948734164736:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129572.516892:0:4699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129572.516903:0:4699:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d94e000/0x40a459093b06a242 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f212fc expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129572.516943:0:4699:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b551c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4699:1830948737532672:192.168.202.4@tcp:106: 00000100:00100000:1.0:1746129572.516998:0:4699:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934d2240 going to sleep for 11 seconds 00000100:00100000:3.0:1746129572.517860:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129572.517936:0:16908:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734164992 00000100:00100000:0.0:1746129572.517939:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129572.517940:0:16908:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734164992 00000100:00100000:1.0:1746129572.517969:0:16908:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11236 00000100:00100000:1.0:1746129572.517974:0:16908:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f37f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:068dab75-d300-4ead-a742-d14572ad1e50+11:32340:x1830948734164992:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:1.0:1746129572.517986:0:16908:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129572.517997:0:16908:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9209a00/0x40a459093b06a249 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21303 expref: -99 pid: 16908 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129572.518062:0:4699:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b551c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4699:1830948737532672:192.168.202.4@tcp:106: 00010000:00010000:1.0:1746129572.518069:0:16908:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9208400/0x40a459093b06a250 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129572.518083:0:16908:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880132edde00/0x40a459093b06a1e7 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f212e0 expref: 12 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129572.518083:0:4699:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d94e000/0x40a459093b06a242 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f212fc expref: 32 pid: 4699 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129572.518090:0:16908:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9208400/0x40a459093b06a250 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129572.518095:0:4699:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d94e000/0x40a459093b06a242 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f212fc expref: 32 pid: 4699 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129572.518105:0:4699:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d94e000, rc 0) 00010000:00010000:1.0:1746129572.518110:0:16908:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880132edde00/0x40a459093b06a1e7 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f212e0 expref: 12 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129572.518120:0:16908:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880132edde00/0x40a459093b06a1e7 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f212e0 expref: 12 pid: 16908 timeout: 927 lvb_type: 0 00000100:00100000:1.0:1746129572.518129:0:16908:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b552680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16908:1830948737532800:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129572.518132:0:4699:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f37d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ada2ffba-8920-4ecb-8068-68caa9806978+31:1963:x1830948734164736:12345-192.168.202.4@tcp:101:cat.0 Request processed in 1247us (1775us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129572.518138:0:4699:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16282 00000100:00100000:1.0:1746129572.518166:0:16908:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934d2c00 going to sleep for 11 seconds 00002000:00010000:2.0:1746129572.518223:0:8410:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb mtime: 1746129572 -> 1746129573 00002000:00010000:2.0:1746129572.518226:0:8410:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb atime: 1746129571 -> 1746129573 00002000:00010000:2.0:1746129572.518228:0:8410:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb ctime: 1746129572 -> 1746129573 00000100:00100000:2.0:1746129572.518240:0:8410:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800959d4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8410:1830948737532544:192.168.202.4@tcp:106: 00010000:00010000:2.0:1746129572.518260:0:8410:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012fd4f000/0x40a459093b06a23b lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f212f5 expref: 15 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129572.518274:0:8410:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fd4f000/0x40a459093b06a23b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f212f5 expref: 15 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129572.518282:0:8410:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fd4f000, rc 0) 00000100:00100000:2.0:1746129572.518338:0:8410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+14:1962:x1830948734164608:12345-192.168.202.4@tcp:101:cat.0 Request processed in 3233us (3504us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129572.518344:0:8410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16281 00000100:00100000:3.0:1746129572.518524:0:21725:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734165248 00000100:00100000:3.0:1746129572.518534:0:21725:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734165248 00002000:00100000:3.0:1746129572.518578:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ef:0x0] (3497984->3502079) req@ffff88009c7d9180 x1830948734165248/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:313/0 lens 488/0 e 0 to 0 dl 1746129583 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129572.518587:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7d9180 with x1830948734165248 ext(3497984->3502079) 00002000:00010000:3.0:1746129572.518592:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c7d9180 00000100:00100000:3.0:1746129572.518865:0:21725:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7836 00000100:00100000:3.0:1746129572.518874:0:21725:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ada2ffba-8920-4ecb-8068-68caa9806978+28:1963:x1830948734165248:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:3.0:1746129572.519038:0:21725:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ada2ffba-8920-4ecb-8068-68caa9806978+28:1963:x1830948734165248:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 164us (1099us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129572.519044:0:21725:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7836 00002000:00100000:3.0:1746129572.519051:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ef:0x0] (3497984->3502079) req@ffff88009c7d9180 x1830948734165248/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:313/0 lens 488/4536 e 0 to 0 dl 1746129583 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129572.519058:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7d9180 with x1830948734165248 ext(3497984->3502079) 00002000:00010000:3.0:1746129572.519061:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c7d9180 00000100:00100000:1.0:1746129572.524617:0:16908:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b552680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16908:1830948737532800:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129572.524646:0:16908:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9208400/0x40a459093b06a250 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00000100:00100000:2.0:1746129572.531380:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129572.532380:0:8410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734165376 00000100:00100000:0.0:1746129572.532390:0:8410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734165376 00000100:00100000:0.0:1746129572.532439:0:8410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16283 00000100:00100000:0.0:1746129572.532448:0:8410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ada2ffba-8920-4ecb-8068-68caa9806978+31:32337:x1830948734165376:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:0.0:1746129572.532468:0:8410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129572.532486:0:8410:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091570000/0x40a459093b06a257 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2130a expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129572.532518:0:8410:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094feea00/0x40a459093b06a12a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21277 expref: 21 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129572.532527:0:8410:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e0b4600/0x40a459093b06a1cb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f212d2 expref: 9 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129572.532534:0:8410:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094fefe00/0x40a459093b06a131 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2127e expref: 32 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129572.532540:0:8410:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129572.532543:0:8410:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129572.532546:0:8410:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091570000/0x40a459093b06a257 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [3145728->3366911] (req 3145728->3366911) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2130a expref: 32 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129572.532581:0:8410:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094fefe00/0x40a459093b06a131 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2127e expref: 32 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129572.532593:0:8410:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094fefe00/0x40a459093b06a131 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2127e expref: 32 pid: 7149 timeout: 927 lvb_type: 0 00000100:00100000:0.0:1746129572.532606:0:8410:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7d9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8410:1830948737532928:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129572.532752:0:8410:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012e0b4600/0x40a459093b06a1cb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f212d2 expref: 9 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129572.532761:0:8410:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012e0b4600/0x40a459093b06a1cb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f212d2 expref: 9 pid: 4385 timeout: 927 lvb_type: 1 00000100:00100000:0.0:1746129572.532769:0:8410:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095626d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8410:1830948737533056:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129572.532800:0:8410:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094feea00/0x40a459093b06a12a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21277 expref: 21 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129572.532808:0:8410:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094feea00/0x40a459093b06a12a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21277 expref: 21 pid: 7149 timeout: 927 lvb_type: 0 00000100:00100000:0.0:1746129572.532815:0:8410:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095627480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8410:1830948737533184:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129572.532833:0:8410:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e29f240 going to sleep for 11 seconds 00000100:00100000:0.0:1746129572.532870:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129572.532923:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129572.532945:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129572.533011:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129572.533029:0:15749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734165504 00000100:00100000:0.0:1746129572.533032:0:15749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734165504 00010000:00010000:0.0:1746129572.533049:0:15749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880132edde00/0x40a459093b06a1e7 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f212e0 expref: 13 pid: 16908 timeout: 927 lvb_type: 0 00000100:00100000:0.0:1746129572.533068:0:15749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8347 00000100:00100000:0.0:1746129572.533074:0:15749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095625880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:068dab75-d300-4ead-a742-d14572ad1e50+13:1960:x1830948734165504:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129572.533082:0:15749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129572.533088:0:15749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880132edde00/0x40a459093b06a1e7 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f212e0 expref: 13 pid: 16908 timeout: 927 lvb_type: 0 00010000:00010000:0.0:1746129572.533097:0:15749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880132edde00/0x40a459093b06a1e7 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f212e0 expref: 13 pid: 16908 timeout: 927 lvb_type: 0 00010000:00010000:0.0:1746129572.533114:0:15749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880132edde00/0x40a459093b06a1e7 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f212e0 expref: 13 pid: 16908 timeout: 927 lvb_type: 0 00010000:00010000:0.0:1746129572.533129:0:15749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:0.0:1746129572.533134:0:15749:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9208400/0x40a459093b06a250 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129572.533143:0:15749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9208400/0x40a459093b06a250 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129572.533148:0:15749:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9208400/0x40a459093b06a250 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129572.533168:0:15749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129572.533188:0:15749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095625880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:068dab75-d300-4ead-a742-d14572ad1e50+12:1960:x1830948734165504:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 113us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129572.533194:0:15749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8347 00010000:00010000:0.0:1746129572.533224:0:16908:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9208400/0x40a459093b06a250 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129572.533231:0:16908:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9208400/0x40a459093b06a250 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00000004:00200000:0.0:1746129572.533276:0:16908:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00000004:00200000:0.0:1746129572.533281:0:16908:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746129572.533332:0:16908:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9208400/0x40a459093b06a250 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129572.533361:0:16908:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9209a00/0x40a459093b06a249 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21303 expref: 12 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129572.533372:0:16908:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9208400/0x40a459093b06a250 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21303 expref: 11 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129572.533377:0:16908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:0.0:1746129572.533379:0:16908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746129572.533381:0:16908:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a9208400, rc 0) 00000100:00100000:0.0:1746129572.533404:0:16908:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f37f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:068dab75-d300-4ead-a742-d14572ad1e50+11:32340:x1830948734164992:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 15429us (15546us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129572.533409:0:16908:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11236 00000100:00100000:0.0:1746129572.533491:0:4699:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734165632 00000100:00100000:0.0:1746129572.533494:0:4699:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734165632 00000100:00100000:0.0:1746129572.533511:0:4699:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734165760 00000100:00100000:0.0:1746129572.533513:0:4699:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734165760 00000100:00100000:0.0:1746129572.533525:0:4699:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16284 00000100:00100000:0.0:1746129572.533530:0:4699:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095626a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+14:32339:x1830948734165632:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:0.0:1746129572.533538:0:4699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129572.533548:0:4699:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f445200/0x40a459093b06a25e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21311 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129572.533564:0:4699:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012e0b5600/0x40a459093b06a1d9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3497984->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f212d9 expref: 27 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129572.533570:0:4699:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129572.533572:0:4699:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129572.533574:0:4699:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f445200/0x40a459093b06a25e lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [3502080->4194303] (req 3502080->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21311 expref: 15 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129572.533588:0:4699:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012e0b5600/0x40a459093b06a1d9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3497984->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f212d9 expref: 27 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129572.533596:0:4699:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012e0b5600/0x40a459093b06a1d9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3497984->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f212d9 expref: 27 pid: 8410 timeout: 927 lvb_type: 0 00000100:00100000:0.0:1746129572.533603:0:4699:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095624700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4699:1830948737533312:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129572.533639:0:4699:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a6ce8900 going to sleep for 11 seconds 00000100:00100000:0.0:1746129572.533654:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16285 00000100:00100000:0.0:1746129572.533659:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095625180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ada2ffba-8920-4ecb-8068-68caa9806978+33:32346:x1830948734165760:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129572.533665:0:7149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129572.533675:0:7149:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c22ca00/0x40a459093b06a265 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21318 expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129572.533689:0:7149:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880132edd000/0x40a459093b06a07b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1351680->1425407) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f211f2 expref: 21 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129572.533695:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129572.533696:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129572.533698:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c22ca00/0x40a459093b06a265 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21318 expref: 34 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129572.533711:0:7149:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880132edd000/0x40a459093b06a07b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1351680->1425407) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f211f2 expref: 21 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129572.533719:0:7149:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880132edd000/0x40a459093b06a07b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1351680->1425407) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f211f2 expref: 21 pid: 4385 timeout: 927 lvb_type: 0 00000100:00100000:0.0:1746129572.533727:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095624000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7149:1830948737533440:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129572.533745:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a6ce8a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746129572.533811:0:21725:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734166016 00000100:00100000:0.0:1746129572.533814:0:21725:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734166016 00002000:00100000:0.0:1746129572.533837:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff880095624e00 x1830948734166016/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:313/0 lens 504/0 e 0 to 0 dl 1746129583 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129572.533845:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095624e00 with x1830948734166016 ext(1048576->2097151) 00010000:00010000:0.0:1746129572.533851:0:21725:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880132edd000/0x40a459093b06a07b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1351680->1425407) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f211f2 expref: 22 pid: 4385 timeout: 927 lvb_type: 0 00010000:00010000:0.0:1746129572.533859:0:21725:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880132edd000/0x40a459093b06a07b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1351680->1425407) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f211f2 expref: 22 pid: 4385 timeout: 927 lvb_type: 0 00002000:00010000:0.0:1746129572.533866:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880095624e00 00000100:00100000:0.0:1746129572.533879:0:21725:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2434 00000100:00100000:0.0:1746129572.533884:0:21725:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095624e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+22:1963:x1830948734166016:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129572.535665:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129572.535677:0:8410:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7d9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8410:1830948737532928:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129572.535688:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734166144 00000100:00100000:2.0:1746129572.535689:0:8410:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095626d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8410:1830948737533056:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129572.535692:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734166144 00010000:00010000:0.0:1746129572.535714:0:9823:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094fefe00/0x40a459093b06a131 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2127e expref: 35 pid: 7149 timeout: 927 lvb_type: 0 00000100:00100000:0.0:1746129572.535748:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8348 00000100:00100000:0.0:1746129572.535755:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095624a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ada2ffba-8920-4ecb-8068-68caa9806978+35:1961:x1830948734166144:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129572.535766:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129572.535786:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094fefe00/0x40a459093b06a131 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2127e expref: 35 pid: 7149 timeout: 927 lvb_type: 0 00010000:00010000:0.0:1746129572.535796:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094fefe00/0x40a459093b06a131 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2127e expref: 35 pid: 7149 timeout: 927 lvb_type: 0 00010000:00010000:0.0:1746129572.535818:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094fefe00/0x40a459093b06a131 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2127e expref: 35 pid: 7149 timeout: 927 lvb_type: 0 00010000:00010000:0.0:1746129572.535832:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129572.537473:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095624a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ada2ffba-8920-4ecb-8068-68caa9806978+34:1961:x1830948734166144:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 1710us (1810us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129572.537483:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8348 00000100:00100000:3.0:1746129572.537716:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129572.537829:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095624000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7149:1830948737533440:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129572.537869:0:7149:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c22ca00/0x40a459093b06a265 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21318 expref: 33 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129572.537889:0:7149:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c22ca00, rc 0) 00000100:00100000:3.0:1746129572.537917:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095625180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ada2ffba-8920-4ecb-8068-68caa9806978+33:32346:x1830948734165760:12345-192.168.202.4@tcp:101:cat.0 Request processed in 4258us (4971us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129572.537923:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16285 00000100:00100000:3.0:1746129572.537976:0:8410:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095627480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8410:1830948737533184:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129572.538000:0:8410:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091570000/0x40a459093b06a257 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [3145728->3366911] (req 3145728->3366911) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2130a expref: 32 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129572.538007:0:8410:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091570000, rc 0) 00000100:00100000:3.0:1746129572.538020:0:8410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ada2ffba-8920-4ecb-8068-68caa9806978+32:32337:x1830948734165376:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 5575us (6653us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129572.538025:0:8410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16283 00000100:00100000:0.0:1746129572.538028:0:4699:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095624700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4699:1830948737533312:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129572.538042:0:4699:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f445200/0x40a459093b06a25e lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [3502080->4194303] (req 3502080->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21311 expref: 15 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129572.538051:0:4699:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f445200, rc 0) 00000100:00100000:0.0:1746129572.538069:0:4699:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095626a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+15:32339:x1830948734165632:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 4539us (5146us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129572.538075:0:4699:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16284 00000100:00100000:1.0:1746129572.538157:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734166272 00000100:00100000:1.0:1746129572.538163:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734166272 00010000:00010000:1.0:1746129572.538185:0:9823:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012e0b4600/0x40a459093b06a1cb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f212d2 expref: 10 pid: 4385 timeout: 927 lvb_type: 1 00000100:00100000:1.0:1746129572.538206:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8349 00000100:00100000:1.0:1746129572.538212:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f37e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:068dab75-d300-4ead-a742-d14572ad1e50+10:1961:x1830948734166272:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129572.538224:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129572.538246:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012e0b4600/0x40a459093b06a1cb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f212d2 expref: 10 pid: 4385 timeout: 927 lvb_type: 1 00010000:00010000:1.0:1746129572.538256:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012e0b4600/0x40a459093b06a1cb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f212d2 expref: 10 pid: 4385 timeout: 927 lvb_type: 1 00010000:00010000:1.0:1746129572.538276:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e0b4600/0x40a459093b06a1cb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f212d2 expref: 10 pid: 4385 timeout: 927 lvb_type: 1 00010000:00010000:1.0:1746129572.538318:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129572.538335:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f37e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:068dab75-d300-4ead-a742-d14572ad1e50+9:1961:x1830948734166272:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 124us (621us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129572.538342:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8349 00000100:00100000:2.0:1746129572.538725:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129572.538757:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129572.538769:0:15749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734166528 00000100:00100000:2.0:1746129572.538772:0:15749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734166528 00010000:00010000:2.0:1746129572.538787:0:15749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094feea00/0x40a459093b06a12a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21277 expref: 24 pid: 7149 timeout: 927 lvb_type: 0 00000100:00100000:2.0:1746129572.538811:0:15749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8350 00000100:00100000:2.0:1746129572.538816:0:15749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+24:1963:x1830948734166528:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129572.538823:0:15749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129572.538832:0:15749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094feea00/0x40a459093b06a12a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21277 expref: 24 pid: 7149 timeout: 927 lvb_type: 0 00010000:00010000:2.0:1746129572.538839:0:15749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094feea00/0x40a459093b06a12a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21277 expref: 24 pid: 7149 timeout: 927 lvb_type: 0 00010000:00010000:2.0:1746129572.538851:0:15749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094feea00/0x40a459093b06a12a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21277 expref: 24 pid: 7149 timeout: 927 lvb_type: 0 00010000:00010000:2.0:1746129572.538865:0:15749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129572.538867:0:15749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129572.538874:0:15749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091570000/0x40a459093b06a257 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3366911) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2130a expref: 31 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129572.538881:0:15749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091570000/0x40a459093b06a257 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3366911) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2130a expref: 31 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129572.538908:0:15749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091570000/0x40a459093b06a257 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3366911) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2130a expref: 31 pid: 8410 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129572.538919:0:15749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800959d6300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15749:1830948737533568:192.168.202.4@tcp:105: 00000100:00100000:2.0:1746129572.538976:0:15749:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009af1e540 going to sleep for 11 seconds 00000100:00100000:2.0:1746129572.539003:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129572.539035:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129572.539041:0:4699:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734166784 00000100:00100000:0.0:1746129572.539045:0:4699:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734166784 00000100:00100000:2.0:1746129572.539060:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129572.539060:0:4699:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734167040 00000100:00100000:0.0:1746129572.539061:0:4699:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734167040 00000100:00100000:0.0:1746129572.539074:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734166912 00000100:00100000:0.0:1746129572.539076:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734166912 00000100:00100000:0.0:1746129572.539088:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16286 00000100:00100000:0.0:1746129572.539092:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:068dab75-d300-4ead-a742-d14572ad1e50+10:1961:x1830948734166784:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:0.0:1746129572.539103:0:4385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129572.539113:0:4385:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f444e00/0x40a459093b06a26c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2131f expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129572.539117:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16287 00000100:00100000:3.0:1746129572.539124:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:068dab75-d300-4ead-a742-d14572ad1e50+11:1961:x1830948734167040:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:3.0:1746129572.539131:0:7148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746129572.539135:0:4385:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095624700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:4385:1830948737533696:192.168.202.4@tcp:106: 00010000:00010000:3.0:1746129572.539138:0:7148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090078e00/0x40a459093b06a273 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2132d expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129572.539156:0:4385:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a6ce8900 going to sleep for 11 seconds 00000100:00100000:3.0:1746129572.539159:0:7148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7d9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:7148:1830948737533824:192.168.202.4@tcp:106: 00000100:00100000:0.0:1746129572.539170:0:22480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16288 00000100:00100000:0.0:1746129572.539174:0:22480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:068dab75-d300-4ead-a742-d14572ad1e50+10:1961:x1830948734166912:12345-192.168.202.4@tcp:101:lfs.0 00000100:00100000:3.0:1746129572.539180:0:7148:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5ac9f00 going to sleep for 11 seconds 00010000:00010000:0.0:1746129572.539180:0:22480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129572.539188:0:22480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800915dde00/0x40a459093b06a27a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21326 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129572.539200:0:8416:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734166400 00000100:00100000:3.0:1746129572.539203:0:8416:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734166400 00000100:00100000:0.0:1746129572.539210:0:22480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095627b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22480:1830948737533952:192.168.202.4@tcp:106: 00000100:00100000:0.0:1746129572.539225:0:22480:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a6ce8240 going to sleep for 11 seconds 00002000:00100000:3.0:1746129572.539228:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3ef:0x0] (3497984->4194303) req@ffff8800959d6a00 x1830948734166400/t0(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:313/0 lens 488/0 e 0 to 0 dl 1746129583 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129572.539242:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800959d6a00 with x1830948734166400 ext(3497984->4194303) 00010000:00010000:3.0:1746129572.539247:0:8416:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012e0b5600/0x40a459093b06a1d9 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3497984->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f212d9 expref: 28 pid: 8410 timeout: 927 lvb_type: 0 00010000:00010000:3.0:1746129572.539559:0:8416:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012e0b5600/0x40a459093b06a1d9 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3497984->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f212d9 expref: 28 pid: 8410 timeout: 927 lvb_type: 0 00002000:00010000:3.0:1746129572.539565:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800959d6a00 00000100:00100000:3.0:1746129572.539580:0:8416:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2435 00000100:00100000:3.0:1746129572.539585:0:8416:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ada2ffba-8920-4ecb-8068-68caa9806978+28:1963:x1830948734166400:12345-192.168.202.4@tcp:4:cat.0 00000100:00100000:0.0:1746129572.542494:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129572.544118:0:31520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734166656 00000100:00100000:2.0:1746129572.544131:0:31520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734166656 00002000:00100000:2.0:1746129572.544182:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3f3:0x0] (1351680->1425407) req@ffff880095624380 x1830948734166656/t0(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:313/0 lens 488/0 e 0 to 0 dl 1746129583 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129572.544197:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095624380 with x1830948734166656 ext(1351680->1425407) 00010000:00010000:2.0:1746129572.544207:0:31520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880132edd000/0x40a459093b06a07b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1351680->1425407) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f211f2 expref: 24 pid: 4385 timeout: 927 lvb_type: 0 00010000:00010000:2.0:1746129572.544219:0:31520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880132edd000/0x40a459093b06a07b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1351680->1425407) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f211f2 expref: 24 pid: 4385 timeout: 927 lvb_type: 0 00002000:00010000:2.0:1746129572.544226:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880095624380 00000100:00100000:2.0:1746129572.544262:0:31520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2436 00000100:00100000:2.0:1746129572.544270:0:31520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095624380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+24:1962:x1830948734166656:12345-192.168.202.4@tcp:4:cat.0 00002000:00010000:3.0:1746129572.547943:0:7148:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3f5:0x0] updating lvb mtime: 1746129572 -> 1746129573 00002000:00010000:3.0:1746129572.547953:0:7148:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3f5:0x0] updating lvb atime: 1746129571 -> 1746129573 00002000:00010000:3.0:1746129572.547955:0:7148:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3f5:0x0] updating lvb ctime: 1746129572 -> 1746129573 00000100:00100000:3.0:1746129572.547982:0:7148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7d9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:7148:1830948737533824:192.168.202.4@tcp:106: 00010000:00010000:3.0:1746129572.548019:0:7148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090078e00/0x40a459093b06a273 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2132d expref: 12 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129572.548033:0:7148:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090078e00/0x40a459093b06a273 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2132d expref: 12 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129572.548048:0:7148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090078e00, rc 0) 00000100:00100000:3.0:1746129572.548105:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:068dab75-d300-4ead-a742-d14572ad1e50+11:1961:x1830948734167040:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 8979us (9067us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129572.548114:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16287 00000100:00100000:3.0:1746129572.548155:0:15749:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800959d6300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15749:1830948737533568:192.168.202.4@tcp:105: 00010000:00010000:3.0:1746129572.548166:0:15749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129572.548184:0:15749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+25:1963:x1830948734166528:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 9368us (9426us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129572.548192:0:15749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8350 00002000:00010000:0.0:1746129572.548258:0:4385:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb mtime: 1746129572 -> 1746129573 00002000:00010000:0.0:1746129572.548262:0:4385:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb atime: 1746129572 -> 1746129573 00002000:00010000:0.0:1746129572.548264:0:4385:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb ctime: 1746129572 -> 1746129573 00000100:00100000:0.0:1746129572.548273:0:4385:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095624700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:4385:1830948737533696:192.168.202.4@tcp:106: 00010000:00010000:0.0:1746129572.548290:0:4385:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f444e00/0x40a459093b06a26c lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2131f expref: 10 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129572.548326:0:4385:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f444e00/0x40a459093b06a26c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2131f expref: 10 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129572.548334:0:4385:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f444e00, rc 0) 00000100:00100000:0.0:1746129572.548351:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:068dab75-d300-4ead-a742-d14572ad1e50+9:1961:x1830948734166784:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 9259us (9347us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129572.548357:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16286 00000100:00100000:0.0:1746129572.548391:0:22480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095627b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22480:1830948737533952:192.168.202.4@tcp:106: 00010000:00010000:0.0:1746129572.548407:0:22480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800915dde00/0x40a459093b06a27a lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21326 expref: 11 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129572.548417:0:22480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800915dde00/0x40a459093b06a27a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21326 expref: 11 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129572.548429:0:22480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800915dde00, rc 0) 00000100:00100000:0.0:1746129572.548444:0:22480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:068dab75-d300-4ead-a742-d14572ad1e50+10:1961:x1830948734166912:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 9270us (9385us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129572.548449:0:22480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16288 00000100:00100000:1.0:1746129572.549488:0:21725:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095624e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+23:1963:x1830948734166016:12345-192.168.202.4@tcp:3:cat.0 Request processed in 15597us (16470us total) trans 0 rc 974848/974848 00000100:00100000:1.0:1746129572.549500:0:21725:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2434 00002000:00100000:1.0:1746129572.549510:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff880095624e00 x1830948734166016/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:313/0 lens 504/440 e 0 to 0 dl 1746129583 ref 1 fl Complete:H/200/0 rc 974848/974848 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129572.549518:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095624e00 with x1830948734166016 ext(1048576->2097151) 00010000:00010000:1.0:1746129572.549526:0:21725:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880132edd000/0x40a459093b06a07b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1351680->1425407) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f211f2 expref: 23 pid: 4385 timeout: 927 lvb_type: 0 00010000:00010000:1.0:1746129572.549536:0:21725:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880132edd000/0x40a459093b06a07b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1351680->1425407) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f211f2 expref: 23 pid: 4385 timeout: 927 lvb_type: 0 00002000:00010000:1.0:1746129572.549543:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880095624e00 00000100:00100000:0.0:1746129572.552237:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129572.552740:0:31520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095624380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+23:1962:x1830948734166656:12345-192.168.202.4@tcp:4:cat.0 Request processed in 8468us (10250us total) trans 17179874124 rc 0/0 00000100:00100000:2.0:1746129572.552751:0:31520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2436 00002000:00100000:2.0:1746129572.552762:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3f3:0x0] (1351680->1425407) req@ffff880095624380 x1830948734166656/t17179874124(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:313/0 lens 488/448 e 0 to 0 dl 1746129583 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129572.552771:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095624380 with x1830948734166656 ext(1351680->1425407) 00010000:00010000:2.0:1746129572.552781:0:31520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880132edd000/0x40a459093b06a07b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1351680->1425407) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f211f2 expref: 23 pid: 4385 timeout: 927 lvb_type: 0 00010000:00010000:2.0:1746129572.552794:0:31520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880132edd000/0x40a459093b06a07b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1351680->1425407) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f211f2 expref: 23 pid: 4385 timeout: 927 lvb_type: 0 00002000:00010000:2.0:1746129572.552801:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880095624380 00000100:00100000:2.0:1746129572.552820:0:31520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734167296 00000100:00100000:2.0:1746129572.552826:0:31520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734167296 00002000:00100000:2.0:1746129572.552849:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3f5:0x0] (3362816->3366911) req@ffff880095627b80 x1830948734167296/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:313/0 lens 488/0 e 0 to 0 dl 1746129583 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129572.552856:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095627b80 with x1830948734167296 ext(3362816->3366911) 00002000:00010000:2.0:1746129572.552860:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095627b80 00000100:00100000:2.0:1746129572.552875:0:31520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7837 00000100:00100000:2.0:1746129572.552881:0:31520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095627b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ada2ffba-8920-4ecb-8068-68caa9806978+32:1962:x1830948734167296:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:2.0:1746129572.552983:0:31520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095627b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ada2ffba-8920-4ecb-8068-68caa9806978+32:1962:x1830948734167296:12345-192.168.202.4@tcp:3:cat.0 Request processed in 102us (756us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129572.552988:0:31520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7837 00002000:00100000:2.0:1746129572.552992:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3f5:0x0] (3362816->3366911) req@ffff880095627b80 x1830948734167296/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:313/0 lens 488/4536 e 0 to 0 dl 1746129583 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129572.552997:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095627b80 with x1830948734167296 ext(3362816->3366911) 00002000:00010000:2.0:1746129572.553000:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095627b80 00000100:00100000:3.0:1746129572.556727:0:8416:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ada2ffba-8920-4ecb-8068-68caa9806978+30:1963:x1830948734166400:12345-192.168.202.4@tcp:4:cat.0 Request processed in 17128us (17988us total) trans 21474841371 rc 0/0 00000100:00100000:3.0:1746129572.556741:0:8416:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2435 00002000:00100000:3.0:1746129572.556753:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3ef:0x0] (3497984->4194303) req@ffff8800959d6a00 x1830948734166400/t21474841371(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:313/0 lens 488/448 e 0 to 0 dl 1746129583 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129572.556762:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800959d6a00 with x1830948734166400 ext(3497984->4194303) 00010000:00010000:3.0:1746129572.556772:0:8416:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012e0b5600/0x40a459093b06a1d9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3497984->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f212d9 expref: 30 pid: 8410 timeout: 927 lvb_type: 0 00010000:00010000:3.0:1746129572.556783:0:8416:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012e0b5600/0x40a459093b06a1d9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3497984->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f212d9 expref: 30 pid: 8410 timeout: 927 lvb_type: 0 00002000:00010000:3.0:1746129572.556789:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800959d6a00 00000100:00100000:2.0:1746129572.556805:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129572.556830:0:16908:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734167552 00000100:00100000:0.0:1746129572.556838:0:16908:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734167552 00000100:00100000:0.0:1746129572.556885:0:16908:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11237 00000100:00100000:0.0:1746129572.556892:0:16908:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:068dab75-d300-4ead-a742-d14572ad1e50+11:32340:x1830948734167552:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:0.0:1746129572.556908:0:16908:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129572.556926:0:16908:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800946f0e00/0x40a459093b06a281 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21334 expref: -99 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129572.557071:0:16908:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800946f1c00/0x40a459093b06a288 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129572.557085:0:16908:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800946f1c00/0x40a459093b06a288 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129572.557097:0:16908:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800946f1c00/0x40a459093b06a288 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129572.557108:0:16908:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800946f1c00/0x40a459093b06a288 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129572.557113:0:16908:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800946f1c00/0x40a459093b06a288 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129572.557118:0:16908:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800946f1c00/0x40a459093b06a288 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129572.557124:0:16908:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800946f1c00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:0.0:1746129572.557127:0:16908:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800946f1c00/0x40a459093b06a288 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129572.557133:0:16908:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800946f1c00/0x40a459093b06a288 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129572.557142:0:16908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:0.0:1746129572.557144:0:16908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746129572.557148:0:16908:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800946f1c00/0x40a459093b06a288 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129572.557153:0:16908:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800946f1c00/0x40a459093b06a288 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129572.557178:0:16908:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800946f0e00/0x40a459093b06a281 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21334 expref: 12 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129572.557185:0:16908:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800946f0e00/0x40a459093b06a281 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21334 expref: 12 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129572.557192:0:16908:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800946f0e00, rc 0) 00000100:00100000:0.0:1746129572.557226:0:16908:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:068dab75-d300-4ead-a742-d14572ad1e50+11:32340:x1830948734167552:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 334us (421us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129572.557232:0:16908:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11237 00000100:00100000:0.0:1746129572.558352:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129572.558385:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129572.558449:0:16680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734167808 00000100:00100000:3.0:1746129572.558453:0:15749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734167936 00000100:00100000:1.0:1746129572.558455:0:16680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734167808 00000100:00100000:3.0:1746129572.558458:0:15749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734167936 00010000:00010000:3.0:1746129572.558481:0:15749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880132edd000/0x40a459093b06a07b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1351680->1425407) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f211f2 expref: 23 pid: 4385 timeout: 927 lvb_type: 0 00000100:00100000:1.0:1746129572.558487:0:16680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4769 00000100:00100000:1.0:1746129572.558493:0:16680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095624700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ada2ffba-8920-4ecb-8068-68caa9806978+297:32337:x1830948734167808:12345-192.168.202.4@tcp:35:multiop.0 00000100:00100000:3.0:1746129572.558501:0:15749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8351 00000100:00100000:3.0:1746129572.558505:0:15749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095625500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+23:1962:x1830948734167936:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129572.558515:0:15749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129572.558533:0:15749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880132edd000/0x40a459093b06a07b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1351680->1425407) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f211f2 expref: 23 pid: 4385 timeout: 927 lvb_type: 0 00010000:00010000:3.0:1746129572.558542:0:15749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880132edd000/0x40a459093b06a07b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1351680->1425407) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f211f2 expref: 23 pid: 4385 timeout: 927 lvb_type: 0 00010000:00010000:3.0:1746129572.558558:0:15749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880132edd000/0x40a459093b06a07b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1351680->1425407) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f211f2 expref: 23 pid: 4385 timeout: 927 lvb_type: 0 00010000:00010000:3.0:1746129572.558569:0:15749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129572.558571:0:15749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129572.558577:0:15749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c22ca00/0x40a459093b06a265 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21318 expref: 31 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129572.558584:0:15749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c22ca00/0x40a459093b06a265 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21318 expref: 31 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129572.558610:0:15749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012c22ca00/0x40a459093b06a265 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21318 expref: 31 pid: 7149 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129572.558620:0:15749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7d9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15749:1830948737534080:192.168.202.4@tcp:105: 00000100:00100000:3.0:1746129572.558669:0:15749:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5ac9f00 going to sleep for 11 seconds 00000100:00100000:1.0:1746129572.558701:0:16680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095624700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ada2ffba-8920-4ecb-8068-68caa9806978+298:32337:x1830948734167808:12345-192.168.202.4@tcp:35:multiop.0 Request processed in 207us (353us total) trans 8589945332 rc 0/0 00000100:00100000:1.0:1746129572.558707:0:16680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4769 00000100:00100000:1.0:1746129572.558875:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129572.558933:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734168064 00000100:00100000:0.0:1746129572.558935:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734168064 00010000:00010000:0.0:1746129572.558950:0:9823:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012e0b5600/0x40a459093b06a1d9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3497984->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f212d9 expref: 30 pid: 8410 timeout: 927 lvb_type: 0 00000100:00100000:0.0:1746129572.558964:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8352 00000100:00100000:0.0:1746129572.558968:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b552680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ada2ffba-8920-4ecb-8068-68caa9806978+30:1962:x1830948734168064:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129572.558975:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129572.558987:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012e0b5600/0x40a459093b06a1d9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3497984->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f212d9 expref: 30 pid: 8410 timeout: 927 lvb_type: 0 00010000:00010000:0.0:1746129572.558995:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012e0b5600/0x40a459093b06a1d9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3497984->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f212d9 expref: 30 pid: 8410 timeout: 927 lvb_type: 0 00010000:00010000:0.0:1746129572.559007:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e0b5600/0x40a459093b06a1d9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3497984->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f212d9 expref: 30 pid: 8410 timeout: 927 lvb_type: 0 00010000:00010000:0.0:1746129572.559015:0:9823:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129572.559016:0:9823:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129572.559019:0:9823:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f445200/0x40a459093b06a25e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3502080->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21311 expref: 14 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129572.559026:0:9823:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f445200/0x40a459093b06a25e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3502080->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21311 expref: 14 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129572.559043:0:9823:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008f445200/0x40a459093b06a25e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3502080->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21311 expref: 14 pid: 4699 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129572.559051:0:9823:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095626300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9823:1830948737534208:192.168.202.4@tcp:105: 00000100:00100000:0.0:1746129572.559073:0:9823:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a6ce8240 going to sleep for 11 seconds 00000100:00100000:0.0:1746129572.559893:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129572.559953:0:20861:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734168320 00000100:00100000:2.0:1746129572.559957:0:20861:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734168320 00000100:00100000:2.0:1746129572.559989:0:20861:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4770 00000100:00100000:2.0:1746129572.559994:0:20861:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095625f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:068dab75-d300-4ead-a742-d14572ad1e50+11:32340:x1830948734168320:12345-192.168.202.4@tcp:35:lfs.0 00000100:00100000:2.0:1746129572.560135:0:20861:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095625f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:068dab75-d300-4ead-a742-d14572ad1e50+12:32340:x1830948734168320:12345-192.168.202.4@tcp:35:lfs.0 Request processed in 140us (243us total) trans 8589945333 rc 0/0 00000100:00100000:2.0:1746129572.560141:0:20861:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4770 00000100:00100000:3.0:1746129572.562259:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129572.562328:0:22480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734168448 00000100:00100000:1.0:1746129572.562336:0:22480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734168448 00000100:00100000:0.0:1746129572.562359:0:9823:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095626300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9823:1830948737534208:192.168.202.4@tcp:105: 00010000:00010000:0.0:1746129572.562380:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129572.562389:0:22480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16289 00000100:00100000:1.0:1746129572.562396:0:22480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+23:1962:x1830948734168448:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129572.562411:0:22480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746129572.562419:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b552680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ada2ffba-8920-4ecb-8068-68caa9806978+29:1962:x1830948734168064:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 3448us (3542us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129572.562428:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8352 00010000:00010000:1.0:1746129572.562432:0:22480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a9209e00/0x40a459093b06a28f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2133b expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129572.562455:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129572.562457:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129572.562464:0:22480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a9209e00/0x40a459093b06a28f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2133b expref: 24 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129572.562479:0:22480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a9209e00/0x40a459093b06a28f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2133b expref: 24 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129572.562488:0:22480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a9209e00, rc 0) 00000100:00100000:1.0:1746129572.562512:0:22480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+24:1962:x1830948734168448:12345-192.168.202.4@tcp:101:cat.0 Request processed in 116us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129572.562517:0:22480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16289 00000100:00100000:0.0:1746129572.564132:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129572.564172:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129572.565578:0:22480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734168832 00000100:00100000:1.0:1746129572.565588:0:22480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734168832 00000100:00100000:1.0:1746129572.565641:0:22480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16290 00000100:00100000:1.0:1746129572.565648:0:22480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095627480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+24:1963:x1830948734168832:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129572.565666:0:22480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746129572.565678:0:8416:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734168704 00000100:00100000:3.0:1746129572.565683:0:8416:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734168704 00010000:00010000:1.0:1746129572.565685:0:22480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a9209600/0x40a459093b06a296 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21342 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00002000:00100000:3.0:1746129572.565718:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3ef:0x0] (3502080->3506175) req@ffff880095626300 x1830948734168704/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:313/0 lens 488/0 e 0 to 0 dl 1746129583 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129572.565727:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095626300 with x1830948734168704 ext(3502080->3506175) 00002000:00010000:3.0:1746129572.565732:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095626300 00000100:00100000:1.0:1746129572.565740:0:22480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b551c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22480:1830948737534336:192.168.202.4@tcp:106: 00000100:00100000:3.0:1746129572.565744:0:8416:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7838 00000100:00100000:3.0:1746129572.565749:0:8416:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095626300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+15:1962:x1830948734168704:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:1.0:1746129572.565815:0:22480:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934d2c00 going to sleep for 11 seconds 00000100:00100000:3.0:1746129572.565904:0:15749:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7d9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15749:1830948737534080:192.168.202.4@tcp:105: 00010000:00010000:3.0:1746129572.565920:0:15749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129572.566341:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129572.566475:0:15749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095625500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+25:1962:x1830948734167936:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 7849us (7969us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129572.566484:0:15749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8351 00000100:00100000:3.0:1746129572.566522:0:8416:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095626300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+15:1962:x1830948734168704:12345-192.168.202.4@tcp:3:cat.0 Request processed in 772us (2397us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129572.566527:0:8416:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7838 00002000:00100000:3.0:1746129572.566532:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3ef:0x0] (3502080->3506175) req@ffff880095626300 x1830948734168704/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:313/0 lens 488/4536 e 0 to 0 dl 1746129583 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129572.566539:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095626300 with x1830948734168704 ext(3502080->3506175) 00002000:00010000:3.0:1746129572.566542:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095626300 00000100:00100000:3.0:1746129572.566547:0:8416:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734169088 00000100:00100000:3.0:1746129572.566550:0:8416:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734169088 00002000:00100000:3.0:1746129572.566560:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff88012b550000 x1830948734169088/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:313/0 lens 488/0 e 0 to 0 dl 1746129583 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129572.566566:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b550000 with x1830948734169088 ext(1048576->2097151) 00002000:00010000:3.0:1746129572.566568:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b550000 00000100:00100000:3.0:1746129572.566590:0:8416:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7839 00000100:00100000:3.0:1746129572.566594:0:8416:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b550000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ada2ffba-8920-4ecb-8068-68caa9806978+32:1963:x1830948734169088:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:1.0:1746129572.573069:0:22480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b551c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22480:1830948737534336:192.168.202.4@tcp:106: 00010000:00010000:1.0:1746129572.573112:0:22480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a9209600/0x40a459093b06a296 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21342 expref: 24 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129572.573127:0:22480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a9209600/0x40a459093b06a296 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21342 expref: 24 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129572.573154:0:22480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a9209600, rc 0) 00000100:00100000:1.0:1746129572.573220:0:22480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095627480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+23:1963:x1830948734168832:12345-192.168.202.4@tcp:101:cat.0 Request processed in 7570us (9046us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129572.573227:0:22480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16290 00000100:00100000:1.0:1746129572.580168:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129572.581223:0:22480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734169216 00000100:00100000:2.0:1746129572.581235:0:22480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734169216 00000100:00100000:2.0:1746129572.581288:0:22480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16291 00000100:00100000:2.0:1746129572.581319:0:22480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b551c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+23:32339:x1830948734169216:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:2.0:1746129572.581340:0:22480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129572.581358:0:22480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d94ec00/0x40a459093b06a29d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21349 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129572.581393:0:22480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091570000/0x40a459093b06a257 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3366911) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2130a expref: 33 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129572.581401:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129572.581402:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129572.581406:0:22480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d94ec00/0x40a459093b06a29d lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [3145728->3244031] (req 3145728->3244031) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21349 expref: 24 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129572.581440:0:22480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091570000/0x40a459093b06a257 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3366911) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2130a expref: 33 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129572.581452:0:22480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091570000/0x40a459093b06a257 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3366911) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2130a expref: 33 pid: 8410 timeout: 927 lvb_type: 0 00000100:00100000:2.0:1746129572.581463:0:22480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094f45f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22480:1830948737534464:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129572.581545:0:22480:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009af1e840 going to sleep for 11 seconds 00000100:00100000:1.0:1746129572.581959:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129572.582128:0:31522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734169472 00000100:00100000:0.0:1746129572.582135:0:31522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734169472 00002000:00100000:0.0:1746129572.582165:0:31522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3ef:0x0] (2097152->3145727) req@ffff88012b551f80 x1830948734169472/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:313/0 lens 488/0 e 0 to 0 dl 1746129583 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129572.582174:0:31522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b551f80 with x1830948734169472 ext(2097152->3145727) 00002000:00010000:0.0:1746129572.582179:0:31522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b551f80 00000100:00100000:0.0:1746129572.582202:0:31522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7840 00000100:00100000:0.0:1746129572.582208:0:31522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b551f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+15:1963:x1830948734169472:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:3.0:1746129572.583476:0:8416:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b550000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ada2ffba-8920-4ecb-8068-68caa9806978+32:1963:x1830948734169088:12345-192.168.202.4@tcp:3:cat.0 Request processed in 16874us (17128us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129572.583486:0:8416:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7839 00002000:00100000:3.0:1746129572.583494:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff88012b550000 x1830948734169088/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:313/0 lens 488/440 e 0 to 0 dl 1746129583 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129572.583503:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b550000 with x1830948734169088 ext(1048576->2097151) 00002000:00010000:3.0:1746129572.583507:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b550000 00000100:00100000:2.0:1746129572.586459:0:22480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094f45f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22480:1830948737534464:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129572.586493:0:22480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d94ec00/0x40a459093b06a29d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [3145728->3244031] (req 3145728->3244031) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21349 expref: 24 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129572.586513:0:22480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d94ec00, rc 0) 00000100:00100000:2.0:1746129572.591825:0:22480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b551c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+24:32339:x1830948734169216:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 10513us (11653us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129572.592165:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129572.592241:0:22480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16291 00000100:00100000:3.0:1746129572.593793:0:8416:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734169600 00000100:00100000:3.0:1746129572.593806:0:8416:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734169600 00002000:00100000:3.0:1746129572.593853:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3f5:0x0] (3145728->3366911) req@ffff88009c7d9500 x1830948734169600/t0(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:313/0 lens 488/0 e 0 to 0 dl 1746129583 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129572.593865:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7d9500 with x1830948734169600 ext(3145728->3366911) 00010000:00010000:3.0:1746129572.593875:0:8416:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091570000/0x40a459093b06a257 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3366911) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2130a expref: 32 pid: 8410 timeout: 927 lvb_type: 0 00010000:00010000:3.0:1746129572.593895:0:8416:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091570000/0x40a459093b06a257 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3366911) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2130a expref: 32 pid: 8410 timeout: 927 lvb_type: 0 00002000:00010000:3.0:1746129572.593901:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c7d9500 00000100:00100000:3.0:1746129572.593926:0:8416:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2437 00000100:00100000:3.0:1746129572.593934:0:8416:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ada2ffba-8920-4ecb-8068-68caa9806978+32:1963:x1830948734169600:12345-192.168.202.4@tcp:4:cat.0 00000100:00100000:1.0:1746129572.594087:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129572.594326:0:22480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734169728 00000100:00100000:2.0:1746129572.594330:0:22480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734169728 00000100:00100000:2.0:1746129572.594351:0:22480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16292 00000100:00100000:2.0:1746129572.594356:0:22480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b551180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ada2ffba-8920-4ecb-8068-68caa9806978+29:32346:x1830948734169728:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129572.594366:0:22480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129572.594381:0:22480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136b1cc00/0x40a459093b06a2a4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21350 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129572.594401:0:22480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f445200/0x40a459093b06a25e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3502080->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21311 expref: 16 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129572.594408:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129572.594410:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129572.594413:0:22480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136b1cc00/0x40a459093b06a2a4 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21350 expref: 30 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129572.594448:0:22480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f445200/0x40a459093b06a25e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3502080->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21311 expref: 16 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129572.594458:0:22480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f445200/0x40a459093b06a25e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3502080->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21311 expref: 16 pid: 4699 timeout: 927 lvb_type: 0 00000100:00100000:2.0:1746129572.594468:0:22480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094f45f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22480:1830948737534592:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129572.594532:0:22480:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009af1e840 going to sleep for 11 seconds 00000100:00100000:0.0:1746129572.594659:0:31522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b551f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+15:1963:x1830948734169472:12345-192.168.202.4@tcp:3:cat.0 Request processed in 12449us (12700us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129572.594666:0:31522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7840 00002000:00100000:0.0:1746129572.594671:0:31522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3ef:0x0] (2097152->3145727) req@ffff88012b551f80 x1830948734169472/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:313/0 lens 488/440 e 0 to 0 dl 1746129583 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129572.594678:0:31522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b551f80 with x1830948734169472 ext(2097152->3145727) 00010000:00010000:0.0:1746129572.594683:0:31522:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008f445200/0x40a459093b06a25e lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3502080->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21311 expref: 15 pid: 4699 timeout: 927 lvb_type: 0 00010000:00010000:0.0:1746129572.594691:0:31522:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008f445200/0x40a459093b06a25e lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3502080->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21311 expref: 15 pid: 4699 timeout: 927 lvb_type: 0 00002000:00010000:0.0:1746129572.594696:0:31522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b551f80 00000100:00100000:3.0:1746129572.597047:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129572.597276:0:31522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734169856 00000100:00100000:1.0:1746129572.597284:0:31522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734169856 00002000:00100000:1.0:1746129572.597370:0:31522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3ef:0x0] (3502080->4194303) req@ffff8800947bd880 x1830948734169856/t0(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:313/0 lens 488/0 e 0 to 0 dl 1746129583 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129572.597379:0:31522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800947bd880 with x1830948734169856 ext(3502080->4194303) 00010000:00010000:1.0:1746129572.597387:0:31522:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008f445200/0x40a459093b06a25e lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3502080->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21311 expref: 15 pid: 4699 timeout: 927 lvb_type: 0 00010000:00010000:1.0:1746129572.597398:0:31522:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008f445200/0x40a459093b06a25e lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3502080->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21311 expref: 15 pid: 4699 timeout: 927 lvb_type: 0 00002000:00010000:1.0:1746129572.597404:0:31522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800947bd880 00000100:00100000:1.0:1746129572.597422:0:31522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2438 00000100:00100000:1.0:1746129572.597430:0:31522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+15:1960:x1830948734169856:12345-192.168.202.4@tcp:4:cat.0 00000100:00100000:2.0:1746129572.597502:0:22480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094f45f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22480:1830948737534592:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129572.597528:0:22480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880136b1cc00/0x40a459093b06a2a4 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21350 expref: 30 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129572.597547:0:22480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136b1cc00, rc 0) 00000100:00100000:2.0:1746129572.597969:0:22480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b551180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ada2ffba-8920-4ecb-8068-68caa9806978+30:32346:x1830948734169728:12345-192.168.202.4@tcp:101:cat.0 Request processed in 3610us (3880us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129572.597977:0:22480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16292 00000100:00100000:3.0:1746129572.598167:0:8416:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ada2ffba-8920-4ecb-8068-68caa9806978+34:1963:x1830948734169600:12345-192.168.202.4@tcp:4:cat.0 Request processed in 4233us (6001us total) trans 17179874125 rc 0/0 00000100:00100000:3.0:1746129572.598174:0:8416:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2437 00002000:00100000:3.0:1746129572.598181:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3f5:0x0] (3145728->3366911) req@ffff88009c7d9500 x1830948734169600/t17179874125(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:313/0 lens 488/448 e 0 to 0 dl 1746129583 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129572.598189:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7d9500 with x1830948734169600 ext(3145728->3366911) 00010000:00010000:3.0:1746129572.598195:0:8416:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091570000/0x40a459093b06a257 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3366911) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2130a expref: 34 pid: 8410 timeout: 927 lvb_type: 0 00010000:00010000:3.0:1746129572.598203:0:8416:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091570000/0x40a459093b06a257 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3366911) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2130a expref: 34 pid: 8410 timeout: 927 lvb_type: 0 00002000:00010000:3.0:1746129572.598208:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c7d9500 00000100:00100000:0.0:1746129572.601144:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129572.601197:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129572.601332:0:22480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734170112 00000100:00100000:2.0:1746129572.601341:0:22480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734170112 00000100:00100000:2.0:1746129572.601387:0:22480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16293 00000100:00100000:2.0:1746129572.601395:0:22480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095626d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+24:32343:x1830948734170112:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129572.601415:0:22480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129572.601434:0:22480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136b1c800/0x40a459093b06a2ab lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21357 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129572.601461:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129572.601463:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129572.601468:0:22480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136b1c800/0x40a459093b06a2ab lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21357 expref: 25 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129572.601480:0:22480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880136b1c800/0x40a459093b06a2ab lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21357 expref: 25 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129572.601492:0:22480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136b1c800, rc 0) 00000100:00100000:2.0:1746129572.601551:0:22480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095626d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+25:32343:x1830948734170112:12345-192.168.202.4@tcp:101:cat.0 Request processed in 155us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129572.601557:0:22480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16293 00000100:00100000:3.0:1746129572.601637:0:15749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734169984 00000100:00100000:3.0:1746129572.601641:0:15749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734169984 00010000:00010000:3.0:1746129572.601660:0:15749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091570000/0x40a459093b06a257 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3366911) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2130a expref: 34 pid: 8410 timeout: 927 lvb_type: 0 00000100:00100000:3.0:1746129572.601680:0:15749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8353 00000100:00100000:3.0:1746129572.601685:0:15749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a46450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ada2ffba-8920-4ecb-8068-68caa9806978+34:1960:x1830948734169984:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129572.601694:0:15749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129572.601716:0:15749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091570000/0x40a459093b06a257 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3366911) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2130a expref: 34 pid: 8410 timeout: 927 lvb_type: 0 00010000:00010000:3.0:1746129572.601726:0:15749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091570000/0x40a459093b06a257 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3366911) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2130a expref: 34 pid: 8410 timeout: 927 lvb_type: 0 00010000:00010000:3.0:1746129572.601747:0:15749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091570000/0x40a459093b06a257 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3366911) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2130a expref: 34 pid: 8410 timeout: 927 lvb_type: 0 00010000:00010000:3.0:1746129572.601778:0:15749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129572.601780:0:15749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129572.601786:0:15749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d94ec00/0x40a459093b06a29d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3244031) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21349 expref: 24 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129572.601794:0:15749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d94ec00/0x40a459093b06a29d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3244031) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21349 expref: 24 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129572.601801:0:15749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129572.601802:0:15749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129572.601805:0:15749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136b1c800/0x40a459093b06a2ab lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21357 expref: 24 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129572.601811:0:15749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136b1c800/0x40a459093b06a2ab lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21357 expref: 24 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129572.601842:0:15749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880136b1c800/0x40a459093b06a2ab lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21357 expref: 24 pid: 22480 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129572.601856:0:15749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bd180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15749:1830948737534720:192.168.202.4@tcp:105: 00010000:00010000:3.0:1746129572.601920:0:15749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012d94ec00/0x40a459093b06a29d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3244031) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21349 expref: 24 pid: 22480 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129572.601928:0:15749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bfb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15749:1830948737534848:192.168.202.4@tcp:105: 00000100:00100000:3.0:1746129572.601948:0:15749:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5ac90c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746129572.605067:0:31522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+17:1960:x1830948734169856:12345-192.168.202.4@tcp:4:cat.0 Request processed in 7627us (8053us total) trans 21474841372 rc 0/0 00000100:00100000:1.0:1746129572.605081:0:31522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2438 00002000:00100000:1.0:1746129572.605093:0:31522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3ef:0x0] (3502080->4194303) req@ffff8800947bd880 x1830948734169856/t21474841372(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:313/0 lens 488/448 e 0 to 0 dl 1746129583 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129572.605103:0:31522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800947bd880 with x1830948734169856 ext(3502080->4194303) 00010000:00010000:1.0:1746129572.605114:0:31522:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008f445200/0x40a459093b06a25e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3502080->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21311 expref: 17 pid: 4699 timeout: 927 lvb_type: 0 00010000:00010000:1.0:1746129572.605131:0:31522:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008f445200/0x40a459093b06a25e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3502080->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21311 expref: 17 pid: 4699 timeout: 927 lvb_type: 0 00002000:00010000:1.0:1746129572.605138:0:31522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800947bd880 00000100:00100000:3.0:1746129572.606021:0:15749:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bd180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15749:1830948737534720:192.168.202.4@tcp:105: 00000100:00100000:3.0:1746129572.606034:0:15749:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bfb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15749:1830948737534848:192.168.202.4@tcp:105: 00010000:00010000:3.0:1746129572.606053:0:15749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129572.606086:0:15749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a46450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ada2ffba-8920-4ecb-8068-68caa9806978+33:1960:x1830948734169984:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 4399us (4886us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129572.606097:0:15749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8353 00000100:00100000:0.0:1746129572.606458:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129572.606494:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129572.607779:0:31522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734170368 00000100:00100000:1.0:1746129572.607791:0:31522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734170368 00002000:00100000:1.0:1746129572.607838:0:31522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f5:0x0] (2097152->3145727) req@ffff880095624000 x1830948734170368/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:313/0 lens 488/0 e 0 to 0 dl 1746129583 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129572.607847:0:31522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095624000 with x1830948734170368 ext(2097152->3145727) 00002000:00010000:1.0:1746129572.607853:0:31522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095624000 00000100:00100000:1.0:1746129572.607873:0:31522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734170624 00000100:00100000:1.0:1746129572.607876:0:31522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734170624 00002000:00100000:1.0:1746129572.607886:0:31522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f5:0x0] (3239936->3244031) req@ffff880095625880 x1830948734170624/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:313/0 lens 488/0 e 0 to 0 dl 1746129583 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129572.607892:0:31522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095625880 with x1830948734170624 ext(3239936->3244031) 00002000:00010000:1.0:1746129572.607895:0:31522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095625880 00000100:00100000:1.0:1746129572.609116:0:31522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7841 00000100:00100000:1.0:1746129572.609128:0:31522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095624000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+26:1962:x1830948734170368:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:3.0:1746129572.609528:0:8416:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7842 00000100:00100000:3.0:1746129572.609537:0:8416:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095625880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+26:1963:x1830948734170624:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:3.0:1746129572.609684:0:8416:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095625880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+26:1963:x1830948734170624:12345-192.168.202.4@tcp:3:cat.0 Request processed in 149us (3189us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129572.609689:0:8416:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7842 00002000:00100000:3.0:1746129572.609696:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3f5:0x0] (3239936->3244031) req@ffff880095625880 x1830948734170624/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:313/0 lens 488/4536 e 0 to 0 dl 1746129583 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129572.609703:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095625880 with x1830948734170624 ext(3239936->3244031) 00002000:00010000:3.0:1746129572.609708:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095625880 00000100:00100000:3.0:1746129572.610655:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129572.610741:0:15749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734170752 00000100:00100000:2.0:1746129572.610749:0:15749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734170752 00010000:00010000:2.0:1746129572.610779:0:15749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f445200/0x40a459093b06a25e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3502080->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21311 expref: 17 pid: 4699 timeout: 927 lvb_type: 0 00000100:00100000:2.0:1746129572.610813:0:15749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8354 00000100:00100000:2.0:1746129572.610819:0:15749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+17:1960:x1830948734170752:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129572.610830:0:15749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129572.610849:0:15749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f445200/0x40a459093b06a25e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3502080->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21311 expref: 17 pid: 4699 timeout: 927 lvb_type: 0 00010000:00010000:2.0:1746129572.610860:0:15749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f445200/0x40a459093b06a25e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3502080->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21311 expref: 17 pid: 4699 timeout: 927 lvb_type: 0 00010000:00010000:2.0:1746129572.610880:0:15749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f445200/0x40a459093b06a25e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3502080->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21311 expref: 17 pid: 4699 timeout: 927 lvb_type: 0 00010000:00010000:2.0:1746129572.610904:0:15749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129572.610906:0:15749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129572.610913:0:15749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880136b1cc00/0x40a459093b06a2a4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21350 expref: 29 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129572.610921:0:15749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136b1cc00/0x40a459093b06a2a4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21350 expref: 29 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129572.610953:0:15749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880136b1cc00/0x40a459093b06a2a4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21350 expref: 29 pid: 22480 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129572.610964:0:15749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094f45f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15749:1830948737534976:192.168.202.4@tcp:105: 00000100:00100000:2.0:1746129572.611035:0:15749:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009af1e840 going to sleep for 11 seconds 00000100:00100000:0.0:1746129572.615012:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129572.615072:0:20861:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734171008 00000100:00100000:2.0:1746129572.615082:0:20861:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734171008 00000100:00100000:2.0:1746129572.615145:0:20861:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4771 00000100:00100000:2.0:1746129572.615157:0:20861:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095624a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+17:32339:x1830948734171008:12345-192.168.202.4@tcp:35:multiop.0 00000100:00100000:3.0:1746129572.615217:0:15749:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094f45f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15749:1830948737534976:192.168.202.4@tcp:105: 00010000:00010000:3.0:1746129572.615241:0:15749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129572.615321:0:15749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+16:1960:x1830948734170752:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 4500us (4669us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129572.615330:0:15749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8354 00000100:00100000:2.0:1746129572.615756:0:20861:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095624a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+18:32339:x1830948734171008:12345-192.168.202.4@tcp:35:multiop.0 Request processed in 604us (756us total) trans 8589945334 rc 0/0 00000100:00100000:2.0:1746129572.615762:0:20861:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4771 00000100:00100000:0.0:1746129572.618264:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129572.618336:0:31520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734171264 00000100:00100000:2.0:1746129572.618344:0:31520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734171264 00002000:00100000:2.0:1746129572.618387:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3ef:0x0] (2097152->3145727) req@ffff880095625500 x1830948734171264/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:313/0 lens 488/0 e 0 to 0 dl 1746129583 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129572.618396:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095625500 with x1830948734171264 ext(2097152->3145727) 00002000:00010000:2.0:1746129572.618402:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095625500 00000100:00100000:2.0:1746129572.618421:0:31520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7843 00000100:00100000:2.0:1746129572.618428:0:31520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095625500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ada2ffba-8920-4ecb-8068-68caa9806978+30:1962:x1830948734171264:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:1.0:1746129572.619485:0:31522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095624000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+25:1962:x1830948734170368:12345-192.168.202.4@tcp:3:cat.0 Request processed in 10356us (13023us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129572.619494:0:31522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7841 00002000:00100000:1.0:1746129572.619501:0:31522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f5:0x0] (2097152->3145727) req@ffff880095624000 x1830948734170368/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:313/0 lens 488/440 e 0 to 0 dl 1746129583 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129572.619508:0:31522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095624000 with x1830948734170368 ext(2097152->3145727) 00002000:00010000:1.0:1746129572.619512:0:31522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095624000 00000100:00100000:0.0:1746129572.626439:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129572.626558:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734171392 00000100:00100000:2.0:1746129572.626568:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734171392 00000100:00100000:2.0:1746129572.626620:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16294 00000100:00100000:2.0:1746129572.626629:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bf79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+16:32343:x1830948734171392:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129572.626650:0:4385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129572.626669:0:4385:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a6729600/0x40a459093b06a2b2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2135e expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129572.626699:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129572.626702:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129572.626709:0:4385:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6729600/0x40a459093b06a2b2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2135e expref: 17 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129572.626724:0:4385:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a6729600/0x40a459093b06a2b2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2135e expref: 17 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129572.626735:0:4385:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6729600, rc 0) 00000100:00100000:2.0:1746129572.626799:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bf79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+17:32343:x1830948734171392:12345-192.168.202.4@tcp:101:cat.0 Request processed in 171us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129572.626804:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16294 00000100:00100000:2.0:1746129572.628459:0:31520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095625500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ada2ffba-8920-4ecb-8068-68caa9806978+30:1962:x1830948734171264:12345-192.168.202.4@tcp:3:cat.0 Request processed in 10021us (10193us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129572.628470:0:31520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7843 00002000:00100000:2.0:1746129572.628482:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3ef:0x0] (2097152->3145727) req@ffff880095625500 x1830948734171264/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:313/0 lens 488/440 e 0 to 0 dl 1746129583 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129572.628491:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095625500 with x1830948734171264 ext(2097152->3145727) 00002000:00010000:2.0:1746129572.628497:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095625500 00000100:00100000:0.0:1746129572.633941:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129572.634183:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129572.634283:0:31522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734171776 00000100:00100000:1.0:1746129572.634335:0:31522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734171776 00002000:00100000:1.0:1746129572.634387:0:31522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f5:0x0] (3244032->4194303) req@ffff880095625180 x1830948734171776/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:313/0 lens 488/0 e 0 to 0 dl 1746129583 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746129572.634800:0:31520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734171904 00000100:00100000:3.0:1746129572.634805:0:31520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734171904 00002000:00100000:3.0:1746129572.634827:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->4194303) req@ffff880095626a00 x1830948734171904/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:313/0 lens 488/0 e 0 to 0 dl 1746129583 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129572.634840:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095626a00 with x1830948734171904 ext(3145728->4194303) 00002000:00010000:3.0:1746129572.634846:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095626a00 00000100:00100000:3.0:1746129572.635003:0:31520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7844 00000100:00100000:3.0:1746129572.635012:0:31520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095626a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+17:1962:x1830948734171904:12345-192.168.202.4@tcp:3:cat.0 00002000:00100000:1.0:1746129572.635465:0:31522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095625180 with x1830948734171776 ext(3244032->4194303) 00002000:00010000:1.0:1746129572.635470:0:31522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095625180 00000100:00100000:2.0:1746129572.635474:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129572.635483:0:31522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7845 00000100:00100000:1.0:1746129572.635489:0:31522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095625180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+25:1962:x1830948734171776:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129572.635526:0:22480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734172032 00000100:00100000:0.0:1746129572.635529:0:22480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734172032 00000100:00100000:0.0:1746129572.635553:0:22480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16295 00000100:00100000:0.0:1746129572.635557:0:22480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ada2ffba-8920-4ecb-8068-68caa9806978+33:32346:x1830948734172032:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129572.635566:0:22480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129572.635581:0:22480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c460000/0x40a459093b06a2b9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21365 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129572.635602:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129572.635603:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129572.635610:0:22480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c460000/0x40a459093b06a2b9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21365 expref: 34 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129572.635622:0:22480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c460000/0x40a459093b06a2b9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21365 expref: 34 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129572.635632:0:22480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c460000, rc 0) 00000100:00100000:0.0:1746129572.635673:0:22480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ada2ffba-8920-4ecb-8068-68caa9806978+34:32346:x1830948734172032:12345-192.168.202.4@tcp:101:cat.0 Request processed in 115us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129572.635678:0:22480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16295 00000100:00100000:1.0:1746129572.648087:0:31522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095625180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+25:1962:x1830948734171776:12345-192.168.202.4@tcp:3:cat.0 Request processed in 12585us (14145us total) trans 0 rc 950272/950272 00000100:00100000:0.0:1746129572.648087:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129572.648098:0:31522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7845 00002000:00100000:1.0:1746129572.648110:0:31522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f5:0x0] (3244032->4194303) req@ffff880095625180 x1830948734171776/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:313/0 lens 488/440 e 0 to 0 dl 1746129583 ref 1 fl Complete:/200/0 rc 950272/950272 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746129572.648111:0:21725:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734172416 00000100:00100000:0.0:1746129572.648118:0:21725:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734172416 00002000:00100000:1.0:1746129572.648119:0:31522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095625180 with x1830948734171776 ext(3244032->4194303) 00002000:00010000:1.0:1746129572.648125:0:31522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095625180 00002000:00100000:0.0:1746129572.648153:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f5:0x0] (2097152->3145727) req@ffff880095627480 x1830948734172416/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:313/0 lens 488/0 e 0 to 0 dl 1746129583 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129572.648159:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095627480 with x1830948734172416 ext(2097152->3145727) 00002000:00010000:0.0:1746129572.648162:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095627480 00000100:00100000:0.0:1746129572.648176:0:21725:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7846 00000100:00100000:0.0:1746129572.648182:0:21725:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095627480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ada2ffba-8920-4ecb-8068-68caa9806978+34:1963:x1830948734172416:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:3.0:1746129572.648193:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129572.648602:0:8416:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734172544 00000100:00100000:2.0:1746129572.648607:0:8416:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734172544 00002000:00100000:2.0:1746129572.648624:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->4194303) req@ffff8800947bd180 x1830948734172544/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:313/0 lens 488/0 e 0 to 0 dl 1746129583 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129572.648630:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800947bd180 with x1830948734172544 ext(3145728->4194303) 00002000:00010000:2.0:1746129572.648633:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800947bd180 00000100:00100000:2.0:1746129572.648645:0:8416:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7847 00000100:00100000:2.0:1746129572.648650:0:8416:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ada2ffba-8920-4ecb-8068-68caa9806978+30:1963:x1830948734172544:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:2.0:1746129572.652025:0:31520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095626a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+17:1962:x1830948734171904:12345-192.168.202.4@tcp:3:cat.0 Request processed in 17000us (17828us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129572.652038:0:31520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7844 00002000:00100000:2.0:1746129572.652051:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->4194303) req@ffff880095626a00 x1830948734171904/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:313/0 lens 488/440 e 0 to 0 dl 1746129583 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129572.652061:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095626a00 with x1830948734171904 ext(3145728->4194303) 00002000:00010000:2.0:1746129572.652067:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095626a00 00000100:00100000:0.0:1746129572.662002:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129572.662362:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734172672 00000100:00100000:3.0:1746129572.662371:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734172672 00000100:00100000:3.0:1746129572.662423:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16296 00000100:00100000:3.0:1746129572.662430:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095626d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+25:1963:x1830948734172672:12345-192.168.202.4@tcp:101:cat.0 00000100:00100000:2.0:1746129572.662456:0:21725:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095627480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ada2ffba-8920-4ecb-8068-68caa9806978+34:1963:x1830948734172416:12345-192.168.202.4@tcp:3:cat.0 Request processed in 14273us (14374us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129572.662465:0:21725:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7846 00002000:00100000:2.0:1746129572.662474:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f5:0x0] (2097152->3145727) req@ffff880095627480 x1830948734172416/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:313/0 lens 488/440 e 0 to 0 dl 1746129583 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129572.662483:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095627480 with x1830948734172416 ext(2097152->3145727) 00002000:00010000:2.0:1746129572.662489:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095627480 00010000:00010000:3.0:1746129572.662760:0:4385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129572.662779:0:4385:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136b1d600/0x40a459093b06a2c0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2136c expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129572.662834:0:4385:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947be300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:4385:1830948737535104:192.168.202.4@tcp:106: 00000100:00100000:3.0:1746129572.664049:0:4385:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5ac93c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746129572.665678:0:8416:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ada2ffba-8920-4ecb-8068-68caa9806978+30:1963:x1830948734172544:12345-192.168.202.4@tcp:3:cat.0 Request processed in 17014us (17471us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129572.665691:0:8416:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7847 00002000:00100000:2.0:1746129572.665705:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->4194303) req@ffff8800947bd180 x1830948734172544/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:313/0 lens 488/440 e 0 to 0 dl 1746129583 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129572.665715:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800947bd180 with x1830948734172544 ext(3145728->4194303) 00002000:00010000:2.0:1746129572.665721:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800947bd180 00000100:00100000:3.0:1746129572.667067:0:4385:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947be300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:4385:1830948737535104:192.168.202.4@tcp:106: 00010000:00010000:3.0:1746129572.667109:0:4385:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880136b1d600/0x40a459093b06a2c0 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2136c expref: 26 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129572.667124:0:4385:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136b1d600/0x40a459093b06a2c0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2136c expref: 26 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129572.667158:0:4385:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136b1d600, rc 0) 00000100:00100000:3.0:1746129572.667205:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095626d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+25:1963:x1830948734172672:12345-192.168.202.4@tcp:101:cat.0 Request processed in 4774us (5213us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129572.667214:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16296 00000100:00100000:0.0:1746129572.672018:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129572.672126:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734172928 00000100:00100000:3.0:1746129572.672135:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734172928 00000100:00100000:3.0:1746129572.672190:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16297 00000100:00100000:3.0:1746129572.672199:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800912ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ada2ffba-8920-4ecb-8068-68caa9806978+34:32346:x1830948734172928:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129572.672220:0:4385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129572.672237:0:4385:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136b1ca00/0x40a459093b06a2c7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21373 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129572.672269:0:4385:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d94ec00/0x40a459093b06a29d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3244031) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21349 expref: 24 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129572.672277:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129572.672279:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129572.672282:0:4385:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136b1ca00/0x40a459093b06a2c7 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21373 expref: 35 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129572.672358:0:4385:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d94ec00/0x40a459093b06a29d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3244031) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21349 expref: 24 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129572.672370:0:4385:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d94ec00/0x40a459093b06a29d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3244031) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21349 expref: 24 pid: 22480 timeout: 927 lvb_type: 0 00000100:00100000:3.0:1746129572.672382:0:4385:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947be300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:4385:1830948737535232:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129572.673007:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129572.673107:0:4385:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5ac93c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746129572.673169:0:8416:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734173056 00000100:00100000:2.0:1746129572.673175:0:8416:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734173056 00002000:00100000:2.0:1746129572.673209:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3ef:0x0] (4194304->5148671) req@ffff88012b551500 x1830948734173056/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:313/0 lens 488/0 e 0 to 0 dl 1746129583 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129572.673218:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b551500 with x1830948734173056 ext(4194304->5148671) 00002000:00010000:2.0:1746129572.673223:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b551500 00000100:00100000:2.0:1746129572.673596:0:8416:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7848 00000100:00100000:2.0:1746129572.673603:0:8416:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b551500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+17:1961:x1830948734173056:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:3.0:1746129572.674950:0:4385:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947be300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:4385:1830948737535232:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129572.674984:0:4385:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880136b1ca00/0x40a459093b06a2c7 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21373 expref: 35 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129572.675001:0:4385:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136b1ca00, rc 0) 00000100:00100000:3.0:1746129572.675493:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800912ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ada2ffba-8920-4ecb-8068-68caa9806978+35:32346:x1830948734172928:12345-192.168.202.4@tcp:101:cat.0 Request processed in 3293us (3485us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129572.675502:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16297 00000100:00100000:0.0:1746129572.678107:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129572.678186:0:21725:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734173184 00000100:00100000:1.0:1746129572.678196:0:21725:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734173184 00002000:00100000:1.0:1746129572.678244:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f5:0x0] (3145728->3244031) req@ffff8800912af100 x1830948734173184/t0(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:313/0 lens 488/0 e 0 to 0 dl 1746129583 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129572.678253:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800912af100 with x1830948734173184 ext(3145728->3244031) 00010000:00010000:1.0:1746129572.678263:0:21725:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012d94ec00/0x40a459093b06a29d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3244031) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21349 expref: 25 pid: 22480 timeout: 927 lvb_type: 0 00010000:00010000:1.0:1746129572.678276:0:21725:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012d94ec00/0x40a459093b06a29d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3244031) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21349 expref: 25 pid: 22480 timeout: 927 lvb_type: 0 00002000:00010000:1.0:1746129572.678283:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800912af100 00000100:00100000:1.0:1746129572.678952:0:21725:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2439 00000100:00100000:1.0:1746129572.678960:0:21725:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800912af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+25:1962:x1830948734173184:12345-192.168.202.4@tcp:4:cat.0 00000100:00100000:3.0:1746129572.683201:0:8416:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b551500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+17:1961:x1830948734173056:12345-192.168.202.4@tcp:3:cat.0 Request processed in 9586us (10183us total) trans 0 rc 954368/954368 00000100:00100000:3.0:1746129572.683212:0:8416:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7848 00002000:00100000:3.0:1746129572.683224:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3ef:0x0] (4194304->5148671) req@ffff88012b551500 x1830948734173056/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:313/0 lens 488/440 e 0 to 0 dl 1746129583 ref 1 fl Complete:/200/0 rc 954368/954368 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129572.683233:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b551500 with x1830948734173056 ext(4194304->5148671) 00002000:00010000:3.0:1746129572.683240:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b551500 00000100:00100000:0.0:1746129572.683411:0:21725:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800912af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+27:1962:x1830948734173184:12345-192.168.202.4@tcp:4:cat.0 Request processed in 4451us (5311us total) trans 17179874126 rc 0/0 00000100:00100000:0.0:1746129572.683418:0:21725:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2439 00002000:00100000:0.0:1746129572.683423:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f5:0x0] (3145728->3244031) req@ffff8800912af100 x1830948734173184/t17179874126(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:313/0 lens 488/448 e 0 to 0 dl 1746129583 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129572.683430:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800912af100 with x1830948734173184 ext(3145728->3244031) 00010000:00010000:0.0:1746129572.683438:0:21725:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012d94ec00/0x40a459093b06a29d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3244031) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21349 expref: 27 pid: 22480 timeout: 927 lvb_type: 0 00010000:00010000:0.0:1746129572.683454:0:21725:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012d94ec00/0x40a459093b06a29d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3244031) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21349 expref: 27 pid: 22480 timeout: 928 lvb_type: 0 00002000:00010000:0.0:1746129572.683460:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800912af100 00000100:00100000:1.0:1746129572.686607:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129572.686674:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129572.687326:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734173440 00000100:00100000:2.0:1746129572.687336:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734173440 00000100:00100000:2.0:1746129572.687394:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16298 00000100:00100000:2.0:1746129572.687403:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b552d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+27:1960:x1830948734173440:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129572.687422:0:4385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129572.687442:0:4385:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a6729c00/0x40a459093b06a2ce lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2137a expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129572.687499:0:4385:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094f44000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:4385:1830948737535360:192.168.202.4@tcp:106: 00000100:00100000:2.0:1746129572.687577:0:4385:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009af1e6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746129572.689527:0:15749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734173312 00000100:00100000:3.0:1746129572.689537:0:15749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734173312 00010000:00010000:2.0:1746129572.689546:0:4385:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.202.4@tcp) returned -22 from glimpse AST (req@ffff880094f44000 x1830948737535360) - normal race ns: filter-lustre-OST0001_UUID lock: ffff88012d94ec00/0x40a459093b06a29d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->3244031) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21349 expref: 29 pid: 22480 timeout: 928 lvb_type: 0 00010000:00010000:3.0:1746129572.689568:0:15749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d94ec00/0x40a459093b06a29d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 7 type: EXT [3145728->18446744073709551615] (req 3145728->3244031) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21349 expref: 29 pid: 22480 timeout: 928 lvb_type: 0 00010000:00010000:2.0:1746129572.689583:0:4385:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d94ec00/0x40a459093b06a29d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->3244031) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21349 expref: 29 pid: 22480 timeout: 928 lvb_type: 0 00010000:00010000:2.0:1746129572.689613:0:4385:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d94ec00/0x40a459093b06a29d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->3244031) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21349 expref: 29 pid: 22480 timeout: 928 lvb_type: 0 00000100:00100000:2.0:1746129572.689637:0:4385:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094f44000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:4385:1830948737535360:192.168.202.4@tcp:106: 00010000:00010000:2.0:1746129572.689660:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129572.689662:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129572.689669:0:4385:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136b1ca00/0x40a459093b06a2c7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21373 expref: 34 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129572.689677:0:4385:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136b1ca00/0x40a459093b06a2c7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21373 expref: 34 pid: 4385 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129572.689703:0:15749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8355 00000100:00100000:3.0:1746129572.689709:0:15749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b553100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+28:1963:x1830948734173312:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129572.689712:0:4385:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880136b1ca00/0x40a459093b06a2c7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21373 expref: 34 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129572.689722:0:15749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746129572.689722:0:4385:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094f44000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:4385:1830948737535488:192.168.202.4@tcp:105: 00010000:00010000:3.0:1746129572.689724:0:15749:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 40a459093b06a29d) 00010000:00010000:3.0:1746129572.689725:0:15749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129572.689811:0:4385:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009af1e6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746129572.690124:0:15749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b553100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+28:1963:x1830948734173312:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 413us (3528us total) trans 0 rc 116/116 00000100:00100000:3.0:1746129572.690132:0:15749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8355 00000100:00100000:2.0:1746129572.691677:0:4385:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094f44000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:4385:1830948737535488:192.168.202.4@tcp:105: 00010000:00010000:2.0:1746129572.691709:0:4385:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a6729c00/0x40a459093b06a2ce lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2137a expref: 27 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129572.691725:0:4385:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a6729c00/0x40a459093b06a2ce lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2137a expref: 27 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129572.691736:0:4385:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6729c00, rc 0) 00000100:00100000:2.0:1746129572.691788:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b552d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+26:1960:x1830948734173440:12345-192.168.202.4@tcp:101:cat.0 Request processed in 4385us (5112us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129572.691798:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16298 00000100:00100000:1.0:1746129572.695213:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129572.695475:0:21725:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734173696 00000100:00100000:0.0:1746129572.695485:0:21725:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734173696 00002000:00100000:0.0:1746129572.695534:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f5:0x0] (3145728->4194303) req@ffff88012b552a00 x1830948734173696/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:313/0 lens 488/0 e 0 to 0 dl 1746129583 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129572.695543:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b552a00 with x1830948734173696 ext(3145728->4194303) 00002000:00010000:0.0:1746129572.695549:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b552a00 00000100:00100000:0.0:1746129572.695584:0:21725:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7849 00000100:00100000:0.0:1746129572.695591:0:21725:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b552a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ada2ffba-8920-4ecb-8068-68caa9806978+35:1963:x1830948734173696:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:2.0:1746129572.696163:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129572.696189:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734173824 00000100:00100000:2.0:1746129572.696193:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734173824 00000100:00100000:2.0:1746129572.696232:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16299 00000100:00100000:2.0:1746129572.696237:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+26:1960:x1830948734173824:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129572.696247:0:4385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129572.696265:0:4385:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090078800/0x40a459093b06a2d5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21381 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129572.696283:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129572.696285:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129572.696334:0:4385:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090078800/0x40a459093b06a2d5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21381 expref: 27 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129572.696351:0:4385:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090078800/0x40a459093b06a2d5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21381 expref: 27 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129572.696361:0:4385:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090078800, rc 0) 00000100:00100000:2.0:1746129572.696414:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+27:1960:x1830948734173824:12345-192.168.202.4@tcp:101:cat.0 Request processed in 177us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129572.696420:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16299 00000100:00100000:1.0:1746129572.706608:0:21725:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b552a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ada2ffba-8920-4ecb-8068-68caa9806978+35:1963:x1830948734173696:12345-192.168.202.4@tcp:3:cat.0 Request processed in 11004us (11392us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129572.706621:0:21725:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7849 00002000:00100000:1.0:1746129572.706633:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f5:0x0] (3145728->4194303) req@ffff88012b552a00 x1830948734173696/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:313/0 lens 488/440 e 0 to 0 dl 1746129583 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129572.706642:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b552a00 with x1830948734173696 ext(3145728->4194303) 00002000:00010000:1.0:1746129572.706649:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b552a00 00000100:00100000:0.0:1746129572.711459:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129572.711570:0:16680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734174080 00000100:00100000:1.0:1746129572.711581:0:16680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734174080 00000100:00100000:1.0:1746129572.711650:0:16680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4772 00000100:00100000:1.0:1746129572.711657:0:16680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f530850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+18:32343:x1830948734174080:12345-192.168.202.4@tcp:35:cat.0 00000100:00100000:1.0:1746129572.711878:0:16680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f530850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+19:32343:x1830948734174080:12345-192.168.202.4@tcp:35:cat.0 Request processed in 220us (430us total) trans 8589945335 rc 0/0 00000100:00100000:1.0:1746129572.711885:0:16680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4772 00000100:00100000:0.0:1746129572.714099:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129572.714178:0:21725:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734174336 00000100:00100000:1.0:1746129572.714186:0:21725:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734174336 00002000:00100000:1.0:1746129572.714232:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ef:0x0] (4194304->5148671) req@ffff8800912aed80 x1830948734174336/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:313/0 lens 488/0 e 0 to 0 dl 1746129583 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129572.714243:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800912aed80 with x1830948734174336 ext(4194304->5148671) 00002000:00010000:1.0:1746129572.714249:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800912aed80 00000100:00100000:1.0:1746129572.714286:0:21725:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7850 00000100:00100000:1.0:1746129572.714327:0:21725:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800912aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ada2ffba-8920-4ecb-8068-68caa9806978+30:1962:x1830948734174336:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:1.0:1746129572.731971:0:21725:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800912aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ada2ffba-8920-4ecb-8068-68caa9806978+30:1962:x1830948734174336:12345-192.168.202.4@tcp:3:cat.0 Request processed in 17660us (17864us total) trans 0 rc 954368/954368 00000100:00100000:1.0:1746129572.731988:0:21725:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7850 00002000:00100000:1.0:1746129572.732006:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ef:0x0] (4194304->5148671) req@ffff8800912aed80 x1830948734174336/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:313/0 lens 488/440 e 0 to 0 dl 1746129583 ref 1 fl Complete:/200/0 rc 954368/954368 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129572.732016:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800912aed80 with x1830948734174336 ext(4194304->5148671) 00002000:00010000:1.0:1746129572.732023:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800912aed80 00000100:00100000:0.0:1746129572.737830:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129572.738169:0:20861:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734174592 00000100:00100000:2.0:1746129572.738178:0:20861:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734174592 00000100:00100000:2.0:1746129572.738360:0:20861:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4773 00000100:00100000:2.0:1746129572.738370:0:20861:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800912ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:ada2ffba-8920-4ecb-8068-68caa9806978+298:32346:x1830948734174592:12345-192.168.202.4@tcp:35:cat.0 00000100:00100000:2.0:1746129572.738616:0:20861:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800912ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:ada2ffba-8920-4ecb-8068-68caa9806978+299:32346:x1830948734174592:12345-192.168.202.4@tcp:35:cat.0 Request processed in 248us (795us total) trans 8589945336 rc 0/0 00000100:00100000:2.0:1746129572.738623:0:20861:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4773 00000100:00100000:0.0:1746129572.796815:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129572.796992:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734174848 00000100:00100000:2.0:1746129572.797001:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734174848 00000100:00100000:2.0:1746129572.797047:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11238 00000100:00100000:2.0:1746129572.797054:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800912adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ada2ffba-8920-4ecb-8068-68caa9806978+299:32353:x1830948734174848:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:2.0:1746129572.797079:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129572.797096:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce26800/0x40a459093b06a2dc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21388 expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129572.797207:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce27400/0x40a459093b06a2e3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129572.797221:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce27400/0x40a459093b06a2e3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129572.797233:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce27400/0x40a459093b06a2e3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129572.797246:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce27800/0x40a459093b06a2ea lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129572.797250:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce27800/0x40a459093b06a2ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129572.797255:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce27800/0x40a459093b06a2ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129572.797398:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094fefe00/0x40a459093b06a2f1 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129572.797409:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094fefe00/0x40a459093b06a2f1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129572.797415:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094fefe00/0x40a459093b06a2f1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00200000:2.0:1746129572.797424:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:2.0:1746129572.797503:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce27400/0x40a459093b06a2e3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129572.797509:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce27400/0x40a459093b06a2e3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129572.797515:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce27400/0x40a459093b06a2e3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129572.797520:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ce27400 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746129572.797523:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce27400/0x40a459093b06a2e3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129572.797529:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce27400/0x40a459093b06a2e3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129572.797538:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880132ef8f00) 00010000:00010000:2.0:1746129572.797541:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129572.797544:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce27400/0x40a459093b06a2e3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129572.797549:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce27400/0x40a459093b06a2e3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129572.797579:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce27800/0x40a459093b06a2ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129572.797588:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce27800/0x40a459093b06a2ea lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129572.797592:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce27800/0x40a459093b06a2ea lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129572.797596:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ce27800 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746129572.797598:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce27800/0x40a459093b06a2ea lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129572.797602:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce27800/0x40a459093b06a2ea lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129572.797607:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880094adc500) 00010000:00010000:2.0:1746129572.797609:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129572.797611:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce27800/0x40a459093b06a2ea lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129572.797615:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce27800/0x40a459093b06a2ea lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129572.797649:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce26800/0x40a459093b06a2dc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21388 expref: 302 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129572.797658:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094fefe00/0x40a459093b06a2f1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21388 expref: 301 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129572.797665:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:2.0:1746129572.797667:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746129572.797669:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094fefe00, rc 0) 00000100:00100000:2.0:1746129572.797712:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800912adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ada2ffba-8920-4ecb-8068-68caa9806978+301:32353:x1830948734174848:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 659us (907us total) trans 8589945337 rc 0/0 00000100:00100000:2.0:1746129572.797719:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11238 00000100:00100000:2.0:1746129572.801274:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129572.803439:0:22480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734174976 00000100:00100000:1.0:1746129572.803454:0:22480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734174976 00000100:00100000:1.0:1746129572.803526:0:22480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16300 00000100:00100000:1.0:1746129572.803536:0:22480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ada2ffba-8920-4ecb-8068-68caa9806978+30:32353:x1830948734174976:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:1.0:1746129572.803560:0:22480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129572.803578:0:22480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f445000/0x40a459093b06a2ff lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2138f expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129572.803611:0:22480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ee7f400/0x40a459093b06a0a5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21200 expref: 31 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129572.803619:0:22480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880132fc2600/0x40a459093b06a1d2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f212c4 expref: 9 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129572.803625:0:22480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ee7fc00/0x40a459093b06a0ac lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21207 expref: 16 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129572.803630:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129572.803632:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129572.803634:0:22480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f445000/0x40a459093b06a2ff lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [1605632->1638399] (req 1605632->1638399) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2138f expref: 31 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129572.803664:0:22480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ee7fc00/0x40a459093b06a0ac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21207 expref: 16 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129572.803677:0:22480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ee7fc00/0x40a459093b06a0ac lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21207 expref: 16 pid: 4385 timeout: 928 lvb_type: 0 00000100:00100000:1.0:1746129572.803688:0:22480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b550700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22480:1830948737535616:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129572.803801:0:22480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880132fc2600/0x40a459093b06a1d2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f212c4 expref: 9 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129572.803808:0:22480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880132fc2600/0x40a459093b06a1d2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f212c4 expref: 9 pid: 7148 timeout: 928 lvb_type: 1 00000100:00100000:1.0:1746129572.803815:0:22480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b551c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22480:1830948737535744:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129572.803838:0:22480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ee7f400/0x40a459093b06a0a5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21200 expref: 31 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129572.803845:0:22480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ee7f400/0x40a459093b06a0a5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21200 expref: 31 pid: 4385 timeout: 928 lvb_type: 0 00000100:00100000:1.0:1746129572.803851:0:22480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b551180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22480:1830948737535872:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129572.803863:0:22480:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934d2a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746129572.807637:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129572.807714:0:15749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734175104 00000100:00100000:3.0:1746129572.807723:0:15749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734175104 00000100:00100000:0.0:1746129572.807734:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129572.807753:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734175232 00000100:00100000:0.0:1746129572.807757:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734175232 00010000:00010000:3.0:1746129572.807764:0:15749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ee7fc00/0x40a459093b06a0ac lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21207 expref: 17 pid: 4385 timeout: 928 lvb_type: 0 00010000:00010000:0.0:1746129572.807771:0:9823:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880132fc2600/0x40a459093b06a1d2 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f212c4 expref: 10 pid: 7148 timeout: 928 lvb_type: 1 00000100:00100000:0.0:1746129572.807800:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8356 00000100:00100000:0.0:1746129572.807806:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800912afb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:068dab75-d300-4ead-a742-d14572ad1e50+10:1962:x1830948734175232:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129572.807822:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129572.807845:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880132fc2600/0x40a459093b06a1d2 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f212c4 expref: 10 pid: 7148 timeout: 928 lvb_type: 1 00010000:00010000:0.0:1746129572.807961:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880132fc2600/0x40a459093b06a1d2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f212c4 expref: 10 pid: 7148 timeout: 928 lvb_type: 1 00010000:00010000:0.0:1746129572.807992:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129572.808690:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800912afb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:068dab75-d300-4ead-a742-d14572ad1e50+10:1962:x1830948734175232:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 882us (953us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129572.808697:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8356 00000100:00100000:3.0:1746129572.808709:0:15749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8357 00000100:00100000:3.0:1746129572.808716:0:15749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800912ae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+17:1962:x1830948734175104:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129572.808726:0:15749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129572.808740:0:15749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ee7fc00/0x40a459093b06a0ac lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21207 expref: 17 pid: 4385 timeout: 928 lvb_type: 0 00010000:00010000:3.0:1746129572.808750:0:15749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ee7fc00/0x40a459093b06a0ac lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21207 expref: 17 pid: 4385 timeout: 928 lvb_type: 0 00010000:00010000:3.0:1746129572.808763:0:15749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129572.808781:0:15749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800912ae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+17:1962:x1830948734175104:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 66us (1160us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129572.808786:0:15749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8357 00010000:00010000:1.0:1746129572.808937:0:22480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ee7fc00/0x40a459093b06a0ac lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21207 expref: 16 pid: 4385 timeout: 928 lvb_type: 0 00000100:00100000:1.0:1746129572.808960:0:22480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b550700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22480:1830948737535616:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129572.808971:0:22480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880132fc2600/0x40a459093b06a1d2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f212c4 expref: 9 pid: 7148 timeout: 928 lvb_type: 1 00000100:00100000:1.0:1746129572.808994:0:22480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b551c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22480:1830948737535744:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129572.809001:0:22480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b551180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22480:1830948737535872:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129572.809028:0:22480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f445000/0x40a459093b06a2ff lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1605632->1638399] (req 1605632->1638399) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2138f expref: 31 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129572.809037:0:22480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f445000, rc 0) 00000100:00100000:1.0:1746129572.809058:0:22480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ada2ffba-8920-4ecb-8068-68caa9806978+31:32353:x1830948734174976:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 5525us (7797us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129572.809065:0:22480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16300 00000100:00100000:0.0:1746129572.810146:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129572.811810:0:15749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734175360 00000100:00100000:3.0:1746129572.811828:0:15749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734175360 00010000:00010000:3.0:1746129572.811889:0:15749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ee7f400/0x40a459093b06a0a5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21200 expref: 31 pid: 4385 timeout: 928 lvb_type: 0 00000100:00100000:3.0:1746129572.811959:0:15749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8358 00000100:00100000:3.0:1746129572.812066:0:15749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800912adf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ada2ffba-8920-4ecb-8068-68caa9806978+31:1962:x1830948734175360:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129572.812085:0:15749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129572.812109:0:15749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ee7f400/0x40a459093b06a0a5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21200 expref: 31 pid: 4385 timeout: 928 lvb_type: 0 00010000:00010000:3.0:1746129572.812122:0:15749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ee7f400/0x40a459093b06a0a5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21200 expref: 31 pid: 4385 timeout: 928 lvb_type: 0 00010000:00010000:3.0:1746129572.812144:0:15749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ee7f400/0x40a459093b06a0a5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21200 expref: 31 pid: 4385 timeout: 928 lvb_type: 0 00010000:00010000:3.0:1746129572.819494:0:15749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129572.819500:0:15749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129572.819516:0:15749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f445000/0x40a459093b06a2ff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1605632->1638399) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2138f expref: 30 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129572.819526:0:15749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f445000/0x40a459093b06a2ff lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1605632->1638399) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2138f expref: 30 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129572.819583:0:15749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008f445000/0x40a459093b06a2ff lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1605632->1638399) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2138f expref: 30 pid: 22480 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129572.819597:0:15749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947be300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15749:1830948737536000:192.168.202.4@tcp:105: 00000100:00100000:3.0:1746129572.819713:0:15749:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5ac93c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746129572.824945:0:15749:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947be300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15749:1830948737536000:192.168.202.4@tcp:105: 00010000:00010000:3.0:1746129572.824974:0:15749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129572.825027:0:15749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800912adf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ada2ffba-8920-4ecb-8068-68caa9806978+30:1962:x1830948734175360:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 13057us (14884us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129572.825039:0:15749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8358 00000100:00100000:0.0:1746129572.825176:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129572.825338:0:21725:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734175616 00000100:00100000:2.0:1746129572.825344:0:21725:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734175616 00002000:00100000:2.0:1746129572.825385:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ee:0x0] (1605632->1609727) req@ffff8800912ac000 x1830948734175616/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:313/0 lens 488/0 e 0 to 0 dl 1746129583 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129572.825395:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800912ac000 with x1830948734175616 ext(1605632->1609727) 00002000:00010000:2.0:1746129572.825399:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800912ac000 00000100:00100000:2.0:1746129572.825811:0:21725:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7851 00000100:00100000:2.0:1746129572.825817:0:21725:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800912ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ada2ffba-8920-4ecb-8068-68caa9806978+30:1962:x1830948734175616:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:2.0:1746129572.825973:0:21725:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800912ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ada2ffba-8920-4ecb-8068-68caa9806978+30:1962:x1830948734175616:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 156us (798us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129572.825978:0:21725:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7851 00002000:00100000:2.0:1746129572.825983:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ee:0x0] (1605632->1609727) req@ffff8800912ac000 x1830948734175616/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:313/0 lens 488/4536 e 0 to 0 dl 1746129583 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129572.825989:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800912ac000 with x1830948734175616 ext(1605632->1609727) 00002000:00010000:2.0:1746129572.825992:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800912ac000 00000100:00100000:0.0:1746129572.843982:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129572.844998:0:8416:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734175872 00000100:00100000:3.0:1746129572.845010:0:8416:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734175872 00002000:00100000:3.0:1746129572.845066:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3ee:0x0] (1634304->1638399) req@ffff8800912af800 x1830948734175872/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:313/0 lens 488/0 e 0 to 0 dl 1746129583 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129572.845076:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800912af800 with x1830948734175872 ext(1634304->1638399) 00002000:00010000:3.0:1746129572.845082:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800912af800 00000100:00100000:3.0:1746129572.845124:0:8416:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7852 00000100:00100000:3.0:1746129572.845132:0:8416:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800912af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ada2ffba-8920-4ecb-8068-68caa9806978+30:1963:x1830948734175872:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:3.0:1746129572.845369:0:8416:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800912af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ada2ffba-8920-4ecb-8068-68caa9806978+30:1963:x1830948734175872:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 237us (1397us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129572.845375:0:8416:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7852 00002000:00100000:3.0:1746129572.845382:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3ee:0x0] (1634304->1638399) req@ffff8800912af800 x1830948734175872/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:313/0 lens 488/4536 e 0 to 0 dl 1746129583 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129572.845388:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800912af800 with x1830948734175872 ext(1634304->1638399) 00002000:00010000:3.0:1746129572.845391:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800912af800 00000100:00100000:0.0:1746129572.849563:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129572.849691:0:16908:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734176128 00000100:00100000:2.0:1746129572.849702:0:16908:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734176128 00000100:00100000:2.0:1746129572.849799:0:16908:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11239 00000100:00100000:2.0:1746129572.849808:0:16908:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009016a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+19:32357:x1830948734176128:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:2.0:1746129572.849837:0:16908:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129572.849858:0:16908:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce27400/0x40a459093b06a306 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21396 expref: -99 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129572.849979:0:16908:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce26000/0x40a459093b06a30d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129572.849993:0:16908:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce26000/0x40a459093b06a30d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129572.850005:0:16908:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce26000/0x40a459093b06a30d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129572.850019:0:16908:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce26800/0x40a459093b06a314 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129572.850024:0:16908:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce26800/0x40a459093b06a314 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129572.850029:0:16908:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce26800/0x40a459093b06a314 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129572.850160:0:16908:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880132fc2600/0x40a459093b06a31b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129572.850170:0:16908:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880132fc2600/0x40a459093b06a31b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129572.850176:0:16908:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880132fc2600/0x40a459093b06a31b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00000004:00200000:2.0:1746129572.850186:0:16908:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:2.0:1746129572.850277:0:16908:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce26000/0x40a459093b06a30d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129572.850284:0:16908:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce26000/0x40a459093b06a30d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129572.850336:0:16908:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce26000/0x40a459093b06a30d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129572.850343:0:16908:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ce26000 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746129572.850347:0:16908:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce26000/0x40a459093b06a30d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129572.850353:0:16908:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce26000/0x40a459093b06a30d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129572.850365:0:16908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880132ef8f00) 00010000:00010000:2.0:1746129572.850368:0:16908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129572.850371:0:16908:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce26000/0x40a459093b06a30d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129572.850377:0:16908:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce26000/0x40a459093b06a30d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16908 initiator: MDT0 00000100:00100000:0.0:1746129572.850617:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129572.850712:0:20861:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734176384 00000100:00100000:3.0:1746129572.850716:0:20861:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734176384 00000100:00100000:3.0:1746129572.850747:0:20861:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4774 00000100:00100000:3.0:1746129572.850752:0:20861:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:ada2ffba-8920-4ecb-8068-68caa9806978+301:32353:x1830948734176384:12345-192.168.202.4@tcp:35:multiop.0 00000100:00100000:3.0:1746129572.850889:0:20861:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:ada2ffba-8920-4ecb-8068-68caa9806978+302:32353:x1830948734176384:12345-192.168.202.4@tcp:35:multiop.0 Request processed in 136us (272us total) trans 8589945339 rc 0/0 00000100:00100000:3.0:1746129572.850895:0:20861:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4774 00010000:00010000:2.0:1746129572.851403:0:16908:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce26800/0x40a459093b06a314 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129572.851411:0:16908:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce26800/0x40a459093b06a314 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129572.851417:0:16908:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce26800/0x40a459093b06a314 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129572.851420:0:16908:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ce26800 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746129572.851423:0:16908:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce26800/0x40a459093b06a314 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129572.851427:0:16908:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce26800/0x40a459093b06a314 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129572.851438:0:16908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009c36a700) 00010000:00010000:2.0:1746129572.851440:0:16908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129572.851443:0:16908:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce26800/0x40a459093b06a314 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129572.851447:0:16908:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce26800/0x40a459093b06a314 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129572.851484:0:16908:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ce27400/0x40a459093b06a306 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21396 expref: 22 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129572.851496:0:16908:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880132fc2600/0x40a459093b06a31b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21396 expref: 21 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129572.851502:0:16908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:2.0:1746129572.851504:0:16908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746129572.851506:0:16908:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132fc2600, rc 0) 00000100:00100000:2.0:1746129572.861105:0:16908:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009016a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:32357:x1830948734176128:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 11283us (11538us total) trans 8589945338 rc 0/0 00000100:00100000:2.0:1746129572.861120:0:16908:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11239 00000100:00100000:1.0:1746129572.877764:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129572.877819:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129572.877905:0:16908:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734176896 00000100:00100000:0.0:1746129572.877905:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734176640 00000100:00100000:2.0:1746129572.877915:0:16908:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734176896 00000100:00100000:0.0:1746129572.877915:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734176640 00000100:00100000:2.0:1746129572.877972:0:16908:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11240 00000100:00100000:2.0:1746129572.877980:0:16908:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b551c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:32358:x1830948734176896:12345-192.168.202.4@tcp:101:cat.0 00000100:00100000:0.0:1746129572.878003:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11241 00000100:00100000:0.0:1746129572.878010:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b551180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ada2ffba-8920-4ecb-8068-68caa9806978+302:32362:x1830948734176640:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129572.878018:0:16908:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129572.878020:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129572.878035:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090078c00/0x40a459093b06a329 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2139d expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129572.878036:0:16908:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee7f400/0x40a459093b06a330 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f213a4 expref: -99 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129572.878135:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090078000/0x40a459093b06a337 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129572.878150:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090078000/0x40a459093b06a337 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129572.878162:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090078000/0x40a459093b06a337 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00200000:0.0:1746129572.878173:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:0.0:1746129572.878319:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090078c00/0x40a459093b06a329 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2139d expref: 305 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129572.878345:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090078000/0x40a459093b06a337 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2139d expref: 304 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129572.878353:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:0.0:1746129572.878355:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1746129572.878358:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090078000, rc 0) 00000100:00100000:0.0:1746129572.878401:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b551180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ada2ffba-8920-4ecb-8068-68caa9806978+304:32362:x1830948734176640:12345-192.168.202.4@tcp:101:cat.0 Request processed in 392us (649us total) trans 8589945340 rc 0/0 00000100:00100000:0.0:1746129572.878406:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11241 00010000:00010000:2.0:1746129572.878746:0:16908:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee7fc00/0x40a459093b06a345 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129572.878754:0:16908:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee7fc00/0x40a459093b06a345 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129572.878760:0:16908:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee7fc00/0x40a459093b06a345 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00000004:00200000:2.0:1746129572.878767:0:16908:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:2.0:1746129572.878819:0:16908:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee7f400/0x40a459093b06a330 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f213a4 expref: 24 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129572.878830:0:16908:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee7fc00/0x40a459093b06a345 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f213a4 expref: 23 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129572.878836:0:16908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:2.0:1746129572.878838:0:16908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1746129572.878840:0:16908:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ee7fc00, rc 0) 00000100:00100000:2.0:1746129572.878874:0:16908:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b551c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+23:32358:x1830948734176896:12345-192.168.202.4@tcp:101:cat.0 Request processed in 895us (1054us total) trans 8589945341 rc 0/0 00000100:00100000:2.0:1746129572.878880:0:16908:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11240 00000100:00100000:0.0:1746129572.898109:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129572.898227:0:22480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734177024 00000100:00100000:1.0:1746129572.898237:0:22480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734177024 00000100:00100000:1.0:1746129572.898341:0:22480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16301 00000100:00100000:1.0:1746129572.898350:0:22480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+16:1963:x1830948734177024:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129572.898370:0:22480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129572.898388:0:22480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f444600/0x40a459093b06a353 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f213ab expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129572.898447:0:22480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b550700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22480:1830948737536128:192.168.202.4@tcp:106: 00000100:00100000:1.0:1746129572.899511:0:22480:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934d2a80 going to sleep for 11 seconds 00002000:00010000:1.0:1746129572.901784:0:22480:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb mtime: 1746129571 -> 1746129573 00002000:00010000:1.0:1746129572.901790:0:22480:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb atime: 1746129571 -> 1746129573 00002000:00010000:1.0:1746129572.901792:0:22480:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb ctime: 1746129572 -> 1746129573 00000100:00100000:1.0:1746129572.901815:0:22480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b550700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22480:1830948737536128:192.168.202.4@tcp:106: 00010000:00010000:1.0:1746129572.901847:0:22480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f444600/0x40a459093b06a353 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f213ab expref: 17 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129572.901864:0:22480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f444600/0x40a459093b06a353 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f213ab expref: 17 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129572.901892:0:22480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f444600, rc 0) 00000100:00100000:1.0:1746129572.901935:0:22480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+16:1963:x1830948734177024:12345-192.168.202.4@tcp:101:cat.0 Request processed in 3586us (3837us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129572.901945:0:22480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16301 00000100:00100000:2.0:1746129572.904940:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129572.905353:0:21725:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734177280 00000100:00100000:0.0:1746129572.905363:0:21725:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734177280 00002000:00100000:0.0:1746129572.905407:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ee:0x0] (1048576->2097151) req@ffff880094f47800 x1830948734177280/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:313/0 lens 504/0 e 0 to 0 dl 1746129583 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129572.905416:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094f47800 with x1830948734177280 ext(1048576->2097151) 00002000:00010000:0.0:1746129572.905422:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094f47800 00000100:00100000:0.0:1746129572.905451:0:21725:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7853 00000100:00100000:0.0:1746129572.905459:0:21725:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ada2ffba-8920-4ecb-8068-68caa9806978+30:1963:x1830948734177280:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129572.929351:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129572.929484:0:8416:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734177536 00000100:00100000:1.0:1746129572.929494:0:8416:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734177536 00002000:00100000:1.0:1746129572.929539:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff8800900f7b80 x1830948734177536/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:313/0 lens 488/0 e 0 to 0 dl 1746129583 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129572.929550:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800900f7b80 with x1830948734177536 ext(1048576->2097151) 00002000:00010000:1.0:1746129572.929556:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800900f7b80 00000100:00100000:1.0:1746129572.929577:0:8416:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7854 00000100:00100000:1.0:1746129572.929585:0:8416:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+27:1963:x1830948734177536:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:1.0:1746129572.946665:0:21725:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ada2ffba-8920-4ecb-8068-68caa9806978+30:1963:x1830948734177280:12345-192.168.202.4@tcp:3:cat.0 Request processed in 41194us (41722us total) trans 0 rc 1015808/1015808 00000100:00100000:1.0:1746129572.946678:0:21725:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7853 00002000:00100000:1.0:1746129572.946691:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ee:0x0] (1048576->2097151) req@ffff880094f47800 x1830948734177280/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:313/0 lens 504/440 e 0 to 0 dl 1746129583 ref 1 fl Complete:/200/0 rc 1015808/1015808 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129572.946699:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094f47800 with x1830948734177280 ext(1048576->2097151) 00002000:00010000:1.0:1746129572.946706:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094f47800 00000100:00100000:0.0:1746129572.946898:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129572.948073:0:8416:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+27:1963:x1830948734177536:12345-192.168.202.4@tcp:3:cat.0 Request processed in 18486us (18729us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129572.948082:0:8416:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7854 00002000:00100000:0.0:1746129572.948090:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff8800900f7b80 x1830948734177536/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:313/0 lens 488/440 e 0 to 0 dl 1746129583 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129572.948098:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800900f7b80 with x1830948734177536 ext(1048576->2097151) 00002000:00010000:0.0:1746129572.948103:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800900f7b80 00000100:00100000:1.0:1746129572.948170:0:22480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734177664 00000100:00100000:1.0:1746129572.948178:0:22480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734177664 00000100:00100000:1.0:1746129572.948860:0:22480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16302 00000100:00100000:1.0:1746129572.948868:0:22480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+16:32357:x1830948734177664:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:1.0:1746129572.948884:0:22480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129572.948900:0:22480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f445800/0x40a459093b06a35a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f213b2 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129572.948931:0:22480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a6ef5e00/0x40a459093b069fc5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2117b expref: 17 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129572.948940:0:22480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d94f000/0x40a459093b06a1af lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f212af expref: 8 pid: 4699 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129572.948947:0:22480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008e0bb400/0x40a459093b06a02e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f211c1 expref: 29 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129572.948953:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129572.948955:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129572.948958:0:22480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f445800/0x40a459093b06a35a lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [225280->815103] (req 225280->815103) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f213b2 expref: 17 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129572.948986:0:22480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008e0bb400/0x40a459093b06a02e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f211c1 expref: 29 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129572.948999:0:22480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008e0bb400/0x40a459093b06a02e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f211c1 expref: 29 pid: 31503 timeout: 928 lvb_type: 0 00000100:00100000:1.0:1746129572.949011:0:22480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b550700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22480:1830948737536256:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129572.949075:0:22480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d94f000/0x40a459093b06a1af lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f212af expref: 8 pid: 4699 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129572.949083:0:22480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d94f000/0x40a459093b06a1af lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f212af expref: 8 pid: 4699 timeout: 928 lvb_type: 1 00000100:00100000:1.0:1746129572.949090:0:22480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b552680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22480:1830948737536384:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129572.949114:0:22480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a6ef5e00/0x40a459093b069fc5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2117b expref: 17 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129572.949122:0:22480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a6ef5e00/0x40a459093b069fc5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2117b expref: 17 pid: 22480 timeout: 928 lvb_type: 0 00000100:00100000:1.0:1746129572.949129:0:22480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095624700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22480:1830948737536512:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129572.949147:0:22480:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934d2a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746129572.959073:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129572.959198:0:22480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b550700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22480:1830948737536256:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129572.959210:0:22480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b552680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22480:1830948737536384:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129572.959218:0:22480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095624700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22480:1830948737536512:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129572.959254:0:22480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f445800/0x40a459093b06a35a lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [225280->815103] (req 225280->815103) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f213b2 expref: 17 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129572.959272:0:22480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f445800, rc 0) 00000100:00100000:3.0:1746129572.960281:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734178176 00000100:00100000:3.0:1746129572.960291:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734178176 00000100:00100000:3.0:1746129572.960358:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16303 00000100:00100000:3.0:1746129572.960365:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+18:32358:x1830948734178176:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129572.960381:0:7148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129572.960395:0:7148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136b1c600/0x40a459093b06a361 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f213b9 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129572.960419:0:7148:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f445000/0x40a459093b06a2ff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1605632->1638399) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2138f expref: 29 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129572.960425:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129572.960427:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129572.960430:0:7148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136b1c600/0x40a459093b06a361 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f213b9 expref: 19 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129572.960455:0:7148:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f445000/0x40a459093b06a2ff lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1605632->1638399) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2138f expref: 29 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129572.960464:0:7148:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f445000/0x40a459093b06a2ff lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1605632->1638399) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2138f expref: 29 pid: 22480 timeout: 928 lvb_type: 0 00000100:00100000:3.0:1746129572.960474:0:7148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947be300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7148:1830948737536640:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129572.960791:0:22480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+19:32357:x1830948734177664:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 11923us (13892us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129572.960803:0:22480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16302 00000100:00100000:2.0:1746129572.961627:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129572.962231:0:15749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734177792 00000100:00100000:2.0:1746129572.962237:0:15749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734177792 00010000:00010000:2.0:1746129572.962268:0:15749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d94f000/0x40a459093b06a1af lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f212af expref: 9 pid: 4699 timeout: 928 lvb_type: 1 00000100:00100000:3.0:1746129572.962409:0:7148:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5ac9c00 going to sleep for 11 seconds 00000100:00100000:3.0:1746129572.962451:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129572.963147:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129572.963156:0:15749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734178048 00000100:00100000:2.0:1746129572.963162:0:15749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734178048 00010000:00010000:2.0:1746129572.963178:0:15749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6ef5e00/0x40a459093b069fc5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2117b expref: 19 pid: 22480 timeout: 928 lvb_type: 0 00000100:00100000:2.0:1746129572.963195:0:15749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8359 00000100:00100000:2.0:1746129572.963201:0:15749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f45180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:068dab75-d300-4ead-a742-d14572ad1e50+9:1961:x1830948734177792:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129572.963213:0:15749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129572.963237:0:15749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d94f000/0x40a459093b06a1af lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f212af expref: 9 pid: 4699 timeout: 928 lvb_type: 1 00010000:00010000:2.0:1746129572.963247:0:15749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d94f000/0x40a459093b06a1af lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f212af expref: 9 pid: 4699 timeout: 928 lvb_type: 1 00000100:00100000:1.0:1746129572.963362:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8360 00000100:00100000:1.0:1746129572.963368:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a46050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+19:1961:x1830948734178048:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129572.963376:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129572.963385:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a6ef5e00/0x40a459093b069fc5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2117b expref: 19 pid: 22480 timeout: 928 lvb_type: 0 00010000:00010000:1.0:1746129572.963392:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a6ef5e00/0x40a459093b069fc5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2117b expref: 19 pid: 22480 timeout: 928 lvb_type: 0 00010000:00010000:1.0:1746129572.963404:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a6ef5e00/0x40a459093b069fc5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2117b expref: 19 pid: 22480 timeout: 928 lvb_type: 0 00010000:00010000:1.0:1746129572.963427:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129572.963457:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a46050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+18:1961:x1830948734178048:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 89us (1005us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129572.963463:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8360 00000100:00100000:0.0:1746129572.963623:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734177920 00000100:00100000:0.0:1746129572.963628:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734177920 00010000:00010000:0.0:1746129572.963642:0:7087:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008e0bb400/0x40a459093b06a02e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f211c1 expref: 30 pid: 31503 timeout: 928 lvb_type: 0 00000100:00100000:0.0:1746129572.963664:0:7087:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8361 00000100:00100000:0.0:1746129572.963669:0:7087:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947bce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ada2ffba-8920-4ecb-8068-68caa9806978+30:1961:x1830948734177920:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129572.963675:0:7087:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129572.963683:0:7087:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008e0bb400/0x40a459093b06a02e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f211c1 expref: 30 pid: 31503 timeout: 928 lvb_type: 0 00010000:00010000:0.0:1746129572.963691:0:7087:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008e0bb400/0x40a459093b06a02e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f211c1 expref: 30 pid: 31503 timeout: 928 lvb_type: 0 00010000:00010000:0.0:1746129572.963703:0:7087:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e0bb400/0x40a459093b06a02e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f211c1 expref: 30 pid: 31503 timeout: 928 lvb_type: 0 00010000:00010000:0.0:1746129572.963720:0:7087:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129572.963722:0:7087:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129572.963729:0:7087:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f445800/0x40a459093b06a35a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 225280->815103) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f213b2 expref: 17 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129572.963735:0:7087:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f445800/0x40a459093b06a35a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 225280->815103) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f213b2 expref: 17 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129572.963764:0:7087:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008f445800/0x40a459093b06a35a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 225280->815103) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f213b2 expref: 17 pid: 22480 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129572.963775:0:7087:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900f4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7087:1830948737536768:192.168.202.4@tcp:105: 00000100:00100000:0.0:1746129572.963824:0:7087:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a6ce8240 going to sleep for 11 seconds 00010000:00010000:2.0:1746129572.964129:0:15749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d94f000/0x40a459093b06a1af lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f212af expref: 9 pid: 4699 timeout: 928 lvb_type: 1 00010000:00010000:2.0:1746129572.964142:0:15749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129572.964163:0:15749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f45180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:068dab75-d300-4ead-a742-d14572ad1e50+8:1961:x1830948734177792:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 962us (2538us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129572.964169:0:15749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8359 00000100:00100000:3.0:1746129572.964518:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129572.965380:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734178304 00000100:00100000:2.0:1746129572.965385:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734178304 00000100:00100000:2.0:1746129572.965421:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16304 00000100:00100000:2.0:1746129572.965428:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ada2ffba-8920-4ecb-8068-68caa9806978+30:1961:x1830948734178304:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129572.965446:0:4385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129572.965468:0:4385:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800915dde00/0x40a459093b06a368 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f213c0 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129572.965507:0:4385:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094f45180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:4385:1830948737536896:192.168.202.4@tcp:106: 00000100:00100000:2.0:1746129572.965564:0:4385:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009af1e6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129572.966472:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129572.966737:0:7148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947be300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7148:1830948737536640:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129572.966766:0:7148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880136b1c600/0x40a459093b06a361 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f213b9 expref: 17 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129572.966781:0:7148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136b1c600, rc 0) 00000100:00100000:3.0:1746129572.966816:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+17:32358:x1830948734178176:12345-192.168.202.4@tcp:101:cat.0 Request processed in 6450us (7757us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129572.966824:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16303 00000100:00100000:1.0:1746129572.966899:0:8416:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734178432 00000100:00100000:1.0:1746129572.966905:0:8416:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734178432 00002000:00100000:1.0:1746129572.966938:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3ee:0x0] (1605632->1638399) req@ffff8800900f7100 x1830948734178432/t0(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:313/0 lens 488/0 e 0 to 0 dl 1746129583 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129572.966947:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800900f7100 with x1830948734178432 ext(1605632->1638399) 00010000:00010000:1.0:1746129572.966955:0:8416:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008f445000/0x40a459093b06a2ff lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1605632->1638399) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2138f expref: 32 pid: 22480 timeout: 928 lvb_type: 0 00010000:00010000:1.0:1746129572.966972:0:8416:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008f445000/0x40a459093b06a2ff lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1605632->1638399) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2138f expref: 32 pid: 22480 timeout: 928 lvb_type: 0 00002000:00010000:1.0:1746129572.966978:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800900f7100 00000100:00100000:1.0:1746129572.967010:0:8416:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2440 00000100:00100000:1.0:1746129572.967016:0:8416:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ada2ffba-8920-4ecb-8068-68caa9806978+32:1963:x1830948734178432:12345-192.168.202.4@tcp:4:cat.0 00000100:00100000:0.0:1746129572.969581:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129572.969638:0:7087:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900f4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7087:1830948737536768:192.168.202.4@tcp:105: 00010000:00010000:2.0:1746129572.969660:0:7087:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129572.969698:0:7087:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947bce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ada2ffba-8920-4ecb-8068-68caa9806978+33:1961:x1830948734177920:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 6028us (6551us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129572.969709:0:7087:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8361 00000100:00100000:3.0:1746129572.969759:0:21725:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734178688 00000100:00100000:3.0:1746129572.969767:0:21725:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734178688 00002000:00100000:3.0:1746129572.969816:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ec:0x0] (225280->229375) req@ffff8800900f6d80 x1830948734178688/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:313/0 lens 488/0 e 0 to 0 dl 1746129583 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129572.969826:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800900f6d80 with x1830948734178688 ext(225280->229375) 00002000:00010000:3.0:1746129572.969830:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800900f6d80 00000100:00100000:3.0:1746129572.969855:0:21725:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7855 00000100:00100000:3.0:1746129572.969861:0:21725:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+17:1962:x1830948734178688:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:3.0:1746129572.970021:0:21725:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+17:1962:x1830948734178688:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 159us (449us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129572.970026:0:21725:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7855 00002000:00100000:3.0:1746129572.970030:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ec:0x0] (225280->229375) req@ffff8800900f6d80 x1830948734178688/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:313/0 lens 488/4536 e 0 to 0 dl 1746129583 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129572.970036:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800900f6d80 with x1830948734178688 ext(225280->229375) 00002000:00010000:3.0:1746129572.970038:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800900f6d80 00000100:00100000:1.0:1746129572.971038:0:8416:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ada2ffba-8920-4ecb-8068-68caa9806978+33:1963:x1830948734178432:12345-192.168.202.4@tcp:4:cat.0 Request processed in 4020us (4566us total) trans 21474841373 rc 0/0 00000100:00100000:1.0:1746129572.971045:0:8416:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2440 00002000:00100000:1.0:1746129572.971051:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3ee:0x0] (1605632->1638399) req@ffff8800900f7100 x1830948734178432/t21474841373(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:313/0 lens 488/448 e 0 to 0 dl 1746129583 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129572.971058:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800900f7100 with x1830948734178432 ext(1605632->1638399) 00010000:00010000:1.0:1746129572.971066:0:8416:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008f445000/0x40a459093b06a2ff lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1605632->1638399) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2138f expref: 33 pid: 22480 timeout: 928 lvb_type: 0 00010000:00010000:1.0:1746129572.971079:0:8416:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008f445000/0x40a459093b06a2ff lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1605632->1638399) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2138f expref: 33 pid: 22480 timeout: 928 lvb_type: 0 00002000:00010000:1.0:1746129572.971086:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800900f7100 00002000:00010000:2.0:1746129572.973586:0:4385:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3ec:0x0] updating lvb mtime: 1746129571 -> 1746129573 00002000:00010000:2.0:1746129572.973596:0:4385:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3ec:0x0] updating lvb atime: 1746129571 -> 1746129573 00002000:00010000:2.0:1746129572.973598:0:4385:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3ec:0x0] updating lvb ctime: 1746129572 -> 1746129573 00000100:00100000:2.0:1746129572.973624:0:4385:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094f45180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:4385:1830948737536896:192.168.202.4@tcp:106: 00010000:00010000:2.0:1746129572.973658:0:4385:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800915dde00/0x40a459093b06a368 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f213c0 expref: 32 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129572.973671:0:4385:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800915dde00/0x40a459093b06a368 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f213c0 expref: 32 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129572.973681:0:4385:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800915dde00, rc 0) 00000100:00100000:2.0:1746129572.973723:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ada2ffba-8920-4ecb-8068-68caa9806978+31:1961:x1830948734178304:12345-192.168.202.4@tcp:101:cat.0 Request processed in 8294us (9204us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129572.973732:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16304 00000100:00100000:2.0:1746129572.978896:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129572.978948:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129572.979014:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734179072 00000100:00100000:1.0:1746129572.979014:0:8416:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734178944 00000100:00100000:3.0:1746129572.979023:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734179072 00000100:00100000:1.0:1746129572.979023:0:8416:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734178944 00010000:00010000:3.0:1746129572.979059:0:7087:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f445000/0x40a459093b06a2ff lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1605632->1638399) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2138f expref: 31 pid: 22480 timeout: 928 lvb_type: 0 00002000:00100000:1.0:1746129572.979065:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3ec:0x0] (811008->815103) req@ffff880094f45180 x1830948734178944/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:313/0 lens 488/0 e 0 to 0 dl 1746129583 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129572.979074:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094f45180 with x1830948734178944 ext(811008->815103) 00002000:00010000:1.0:1746129572.979079:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094f45180 00000100:00100000:3.0:1746129572.979088:0:7087:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8362 00000100:00100000:1.0:1746129572.979090:0:8416:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7856 00000100:00100000:3.0:1746129572.979094:0:7087:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f45f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ada2ffba-8920-4ecb-8068-68caa9806978+31:1960:x1830948734179072:12345-192.168.202.4@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746129572.979094:0:8416:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+17:1962:x1830948734178944:12345-192.168.202.4@tcp:3:multiop.0 00010000:00010000:3.0:1746129572.979108:0:7087:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129572.979132:0:7087:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f445000/0x40a459093b06a2ff lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1605632->1638399) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2138f expref: 31 pid: 22480 timeout: 928 lvb_type: 0 00010000:00010000:3.0:1746129572.979144:0:7087:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f445000/0x40a459093b06a2ff lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1605632->1638399) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2138f expref: 31 pid: 22480 timeout: 928 lvb_type: 0 00010000:00010000:3.0:1746129572.979164:0:7087:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f445000/0x40a459093b06a2ff lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1605632->1638399) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2138f expref: 31 pid: 22480 timeout: 928 lvb_type: 0 00010000:00010000:3.0:1746129572.979180:0:7087:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129572.979182:0:7087:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129572.979189:0:7087:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880136b1c600/0x40a459093b06a361 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f213b9 expref: 17 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129572.979196:0:7087:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136b1c600/0x40a459093b06a361 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f213b9 expref: 17 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129572.979225:0:7087:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880136b1c600/0x40a459093b06a361 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f213b9 expref: 17 pid: 7148 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129572.979235:0:7087:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947be300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7087:1830948737537024:192.168.202.4@tcp:105: 00000100:00100000:1.0:1746129572.979265:0:8416:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+17:1962:x1830948734178944:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 169us (379us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746129572.979271:0:8416:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7856 00002000:00100000:1.0:1746129572.979277:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3ec:0x0] (811008->815103) req@ffff880094f45180 x1830948734178944/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:313/0 lens 488/4536 e 0 to 0 dl 1746129583 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129572.979283:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094f45180 with x1830948734178944 ext(811008->815103) 00002000:00010000:1.0:1746129572.979285:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094f45180 00000100:00100000:3.0:1746129572.979286:0:7087:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5ac9c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746129572.986568:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129572.986593:0:7087:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947be300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7087:1830948737537024:192.168.202.4@tcp:105: 00010000:00010000:2.0:1746129572.986617:0:7087:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129572.986667:0:7087:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f45f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ada2ffba-8920-4ecb-8068-68caa9806978+30:1960:x1830948734179072:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 7571us (7716us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129572.986677:0:7087:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8362 00000100:00100000:0.0:1746129572.986833:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129572.987134:0:16680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734179584 00000100:00100000:1.0:1746129572.987142:0:16680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734179584 00000100:00100000:1.0:1746129572.987191:0:16680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4775 00000100:00100000:1.0:1746129572.987198:0:16680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+23:32357:x1830948734179584:12345-192.168.202.4@tcp:35:multiop.0 00000100:00100000:0.0:1746129572.987479:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129572.987525:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129572.987550:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734179328 00000100:00100000:2.0:1746129572.987554:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734179328 00000100:00100000:3.0:1746129572.987564:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734179456 00000100:00100000:3.0:1746129572.987568:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734179456 00000100:00100000:3.0:1746129572.987587:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16305 00000100:00100000:3.0:1746129572.987592:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013145fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ada2ffba-8920-4ecb-8068-68caa9806978+31:1960:x1830948734179328:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129572.987602:0:7148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129572.987618:0:7148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136b1d000/0x40a459093b06a36f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f213c7 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129572.987664:0:7148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7148:1830948737537152:192.168.202.4@tcp:106: 00000100:00100000:3.0:1746129572.987715:0:7148:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5ac9240 going to sleep for 11 seconds 00000100:00100000:1.0:1746129572.988085:0:16680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+24:32357:x1830948734179584:12345-192.168.202.4@tcp:35:multiop.0 Request processed in 886us (1527us total) trans 8589945342 rc 0/0 00000100:00100000:1.0:1746129572.988092:0:16680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4775 00000100:00100000:1.0:1746129572.988112:0:8416:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734179840 00000100:00100000:1.0:1746129572.988115:0:8416:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734179840 00002000:00100000:1.0:1746129572.988138:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3ee:0x0] (1048576->2097151) req@ffff8800900f4000 x1830948734179840/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:313/0 lens 488/0 e 0 to 0 dl 1746129583 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129572.988147:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800900f4000 with x1830948734179840 ext(1048576->2097151) 00002000:00010000:1.0:1746129572.988151:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800900f4000 00000100:00100000:1.0:1746129572.988165:0:8416:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7857 00000100:00100000:1.0:1746129572.988169:0:8416:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+17:1963:x1830948734179840:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:2.0:1746129572.988642:0:22480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16306 00000100:00100000:2.0:1746129572.988650:0:22480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013145e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ada2ffba-8920-4ecb-8068-68caa9806978+32:1960:x1830948734179456:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129572.988659:0:22480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129572.988668:0:22480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fd28400/0x40a459093b06a376 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f213ce expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129572.988680:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129572.988682:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129572.988691:0:22480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd28400/0x40a459093b06a376 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f213ce expref: 33 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129572.988705:0:22480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fd28400/0x40a459093b06a376 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f213ce expref: 33 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129572.988714:0:22480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd28400, rc 0) 00000100:00100000:2.0:1746129572.988733:0:22480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013145e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ada2ffba-8920-4ecb-8068-68caa9806978+33:1960:x1830948734179456:12345-192.168.202.4@tcp:101:cat.0 Request processed in 85us (1208us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129572.988738:0:22480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16306 00000100:00100000:3.0:1746129572.996537:0:7148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7148:1830948737537152:192.168.202.4@tcp:106: 00010000:00010000:3.0:1746129572.996582:0:7148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880136b1d000/0x40a459093b06a36f lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f213c7 expref: 32 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129572.996598:0:7148:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136b1d000/0x40a459093b06a36f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f213c7 expref: 32 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129572.996626:0:7148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136b1d000, rc 0) 00000100:00100000:3.0:1746129572.996687:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013145fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ada2ffba-8920-4ecb-8068-68caa9806978+31:1960:x1830948734179328:12345-192.168.202.4@tcp:101:cat.0 Request processed in 9094us (9208us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129572.996696:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16305 00000100:00100000:0.0:1746129573.003411:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129573.003678:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734179968 00000100:00100000:3.0:1746129573.003688:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734179968 00000100:00100000:3.0:1746129573.003758:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16307 00000100:00100000:3.0:1746129573.003768:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013145ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ada2ffba-8920-4ecb-8068-68caa9806978+31:1960:x1830948734179968:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129573.003788:0:7148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129573.003807:0:7148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136b1c000/0x40a459093b06a37d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f213d5 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129573.003865:0:7148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7148:1830948737537280:192.168.202.4@tcp:106: 00000100:00100000:3.0:1746129573.004402:0:7148:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5ac9240 going to sleep for 11 seconds 00000100:00080000:0.0:1746129573.004533:0:7097:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746129573.005070:0:8416:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+17:1963:x1830948734179840:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 16895us (18233us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129573.005081:0:8416:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7857 00002000:00100000:1.0:1746129573.005092:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3ee:0x0] (1048576->2097151) req@ffff8800900f4000 x1830948734179840/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:313/0 lens 488/440 e 0 to 0 dl 1746129583 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129573.005101:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800900f4000 with x1830948734179840 ext(1048576->2097151) 00002000:00010000:1.0:1746129573.005105:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800900f4000 00000100:00100000:3.0:1746129573.009718:0:7148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7148:1830948737537280:192.168.202.4@tcp:106: 00010000:00010000:3.0:1746129573.009756:0:7148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880136b1c000/0x40a459093b06a37d lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f213d5 expref: 32 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129573.009770:0:7148:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136b1c000/0x40a459093b06a37d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f213d5 expref: 32 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129573.009801:0:7148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136b1c000, rc 0) 00000100:00100000:3.0:1746129573.009865:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013145ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ada2ffba-8920-4ecb-8068-68caa9806978+31:1960:x1830948734179968:12345-192.168.202.4@tcp:101:cat.0 Request processed in 6098us (6464us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129573.009874:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16307 00000100:00100000:0.0:1746129573.011039:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129573.011248:0:16908:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734180224 00000100:00100000:2.0:1746129573.011257:0:16908:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734180224 00000100:00100000:2.0:1746129573.011562:0:16908:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11242 00000100:00100000:2.0:1746129573.011570:0:16908:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f327b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ada2ffba-8920-4ecb-8068-68caa9806978+304:32364:x1830948734180224:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:2.0:1746129573.011594:0:16908:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129573.011612:0:16908:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd28a00/0x40a459093b06a384 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f213dc expref: -99 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129573.011705:0:16908:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd28c00/0x40a459093b06a38b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129573.011722:0:16908:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9208400/0x40a459093b06a250 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21303 expref: 11 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129573.011729:0:16908:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094fefe00/0x40a459093b06a2f1 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21388 expref: 305 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129573.011736:0:16908:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880132fc2600/0x40a459093b06a31b lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21396 expref: 23 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129573.011742:0:16908:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd28c00/0x40a459093b06a38b lrc: 6/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129573.011775:0:16908:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880132fc2600/0x40a459093b06a31b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21396 expref: 23 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129573.011787:0:16908:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880132fc2600/0x40a459093b06a31b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21396 expref: 23 pid: 16908 timeout: 928 lvb_type: 0 00000100:00100000:2.0:1746129573.011799:0:16908:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800912afb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16908:1830948737537408:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129573.011902:0:16908:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094fefe00/0x40a459093b06a2f1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21388 expref: 305 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129573.011910:0:16908:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094fefe00/0x40a459093b06a2f1 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21388 expref: 305 pid: 14549 timeout: 928 lvb_type: 0 00000100:00100000:2.0:1746129573.011918:0:16908:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800912ae680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16908:1830948737537536:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129573.011943:0:16908:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9208400/0x40a459093b06a250 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21303 expref: 11 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129573.011950:0:16908:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9208400/0x40a459093b06a250 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21303 expref: 11 pid: 16908 timeout: 928 lvb_type: 0 00000100:00100000:2.0:1746129573.011958:0:16908:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800912adf80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16908:1830948737537664:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129573.011972:0:16908:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009af1e6c0 going to sleep for 11 seconds 00000100:00080000:0.0:1746129573.012248:0:7097:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746129573.015264:0:16908:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800912afb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16908:1830948737537408:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129573.015276:0:16908:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800912ae680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16908:1830948737537536:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129573.015286:0:16908:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800912adf80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16908:1830948737537664:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129573.015355:0:16908:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd28c00/0x40a459093b06a38b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00000100:00100000:0.0:1746129573.016506:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129573.017635:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129573.017838:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129573.017922:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734180480 00000100:00100000:2.0:1746129573.017931:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734180480 00010000:00010000:2.0:1746129573.017973:0:7087:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094fefe00/0x40a459093b06a2f1 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21388 expref: 306 pid: 14549 timeout: 928 lvb_type: 0 00000100:00100000:2.0:1746129573.018122:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734180352 00000100:00100000:2.0:1746129573.018125:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734180352 00010000:00010000:2.0:1746129573.018135:0:7087:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880132fc2600/0x40a459093b06a31b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21396 expref: 24 pid: 16908 timeout: 928 lvb_type: 0 00000100:00100000:1.0:1746129573.018238:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734180608 00000100:00100000:1.0:1746129573.018242:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734180608 00010000:00010000:1.0:1746129573.018259:0:9823:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9208400/0x40a459093b06a250 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21303 expref: 12 pid: 16908 timeout: 928 lvb_type: 0 00000100:00100000:1.0:1746129573.018278:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8363 00000100:00100000:1.0:1746129573.018285:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f324000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ada2ffba-8920-4ecb-8068-68caa9806978+306:1962:x1830948734180480:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129573.018321:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129573.018327:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094fefe00/0x40a459093b06a2f1 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21388 expref: 306 pid: 14549 timeout: 928 lvb_type: 0 00010000:00010000:1.0:1746129573.018337:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094fefe00/0x40a459093b06a2f1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21388 expref: 306 pid: 14549 timeout: 928 lvb_type: 0 00010000:00010000:1.0:1746129573.018356:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094fefe00/0x40a459093b06a2f1 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21388 expref: 306 pid: 14549 timeout: 928 lvb_type: 0 00010000:00010000:1.0:1746129573.018380:0:9823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:1.0:1746129573.018385:0:9823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd28c00/0x40a459093b06a38b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129573.018394:0:9823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd28c00/0x40a459093b06a38b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129573.018398:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129573.018442:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f324000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ada2ffba-8920-4ecb-8068-68caa9806978+305:1962:x1830948734180480:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 157us (1941us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129573.018448:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8363 00000100:00100000:1.0:1746129573.018464:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8364 00000100:00100000:1.0:1746129573.018468:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f325f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+24:1962:x1830948734180352:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129573.018474:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129573.018477:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880132fc2600/0x40a459093b06a31b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21396 expref: 24 pid: 16908 timeout: 928 lvb_type: 0 00000100:00100000:3.0:1746129573.018539:0:20578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8365 00000100:00100000:3.0:1746129573.018548:0:20578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f326a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:068dab75-d300-4ead-a742-d14572ad1e50+12:1962:x1830948734180608:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129573.018555:0:20578:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129573.018559:0:20578:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9208400/0x40a459093b06a250 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21303 expref: 12 pid: 16908 timeout: 928 lvb_type: 0 00010000:00010000:1.0:1746129573.019146:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880132fc2600/0x40a459093b06a31b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21396 expref: 24 pid: 16908 timeout: 928 lvb_type: 0 00010000:00010000:3.0:1746129573.019171:0:20578:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9208400/0x40a459093b06a250 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21303 expref: 12 pid: 16908 timeout: 928 lvb_type: 0 00010000:00010000:3.0:1746129573.019184:0:20578:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9208400/0x40a459093b06a250 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21303 expref: 12 pid: 16908 timeout: 928 lvb_type: 0 00010000:00010000:1.0:1746129573.019251:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880132fc2600/0x40a459093b06a31b lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21396 expref: 24 pid: 16908 timeout: 928 lvb_type: 0 00010000:00010000:1.0:1746129573.019278:0:9823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:1.0:1746129573.019281:0:9823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd28c00/0x40a459093b06a38b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129573.019287:0:9823:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd28c00/0x40a459093b06a38b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129573.019319:0:9823:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd28c00/0x40a459093b06a38b lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129573.019353:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129573.019371:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f325f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+23:1962:x1830948734180352:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 903us (1738us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129573.019377:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8364 00010000:00010000:3.0:1746129573.019507:0:20578:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:3.0:1746129573.019510:0:20578:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129573.019540:0:20578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f326a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:068dab75-d300-4ead-a742-d14572ad1e50+11:1962:x1830948734180608:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 995us (1702us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129573.019546:0:20578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8365 00010000:00010000:2.0:1746129573.019610:0:16908:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd28c00/0x40a459093b06a38b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129573.019618:0:16908:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd28c00/0x40a459093b06a38b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00000004:00200000:2.0:1746129573.019638:0:16908:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:2.0:1746129573.019785:0:16908:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd28a00/0x40a459093b06a384 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f213dc expref: 306 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129573.019802:0:16908:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd28c00/0x40a459093b06a38b lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f213dc expref: 305 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129573.019808:0:16908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:2.0:1746129573.019810:0:16908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746129573.019812:0:16908:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd28c00, rc 0) 00000100:00100000:2.0:1746129573.020943:0:16908:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f327b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ada2ffba-8920-4ecb-8068-68caa9806978+305:32364:x1830948734180224:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 9368us (9906us total) trans 8589945343 rc 0/0 00000100:00100000:2.0:1746129573.020952:0:16908:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11242 00000100:00100000:0.0:1746129573.021713:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129573.021807:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129573.022203:0:8416:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734180992 00000100:00100000:1.0:1746129573.022213:0:8416:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734180992 00000100:00080000:0.0:1746129573.022254:0:7097:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00100000:1.0:1746129573.022270:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3ef:0x0] (2097152->3145727) req@ffff880093ede680 x1830948734180992/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:314/0 lens 488/0 e 0 to 0 dl 1746129584 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129573.022279:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ede680 with x1830948734180992 ext(2097152->3145727) 00002000:00010000:1.0:1746129573.022284:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093ede680 00000100:00100000:1.0:1746129573.022338:0:8416:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734181120 00000100:00100000:1.0:1746129573.022341:0:8416:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734181120 00000100:00100000:3.0:1746129573.022352:0:31520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7858 00002000:00100000:1.0:1746129573.022354:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3f5:0x0] (3145728->4194303) req@ffff880093edd880 x1830948734181120/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:314/0 lens 488/0 e 0 to 0 dl 1746129584 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746129573.022361:0:31520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ede680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+17:1962:x1830948734180992:12345-192.168.202.4@tcp:3:cat.0 00002000:00100000:1.0:1746129573.022361:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093edd880 with x1830948734181120 ext(3145728->4194303) 00002000:00010000:1.0:1746129573.022364:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093edd880 00000100:00100000:1.0:1746129573.022753:0:8416:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7859 00000100:00100000:1.0:1746129573.022759:0:8416:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093edd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+27:1962:x1830948734181120:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129573.024546:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129573.024592:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734181248 00000100:00100000:2.0:1746129573.024598:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734181248 00000100:00100000:2.0:1746129573.024639:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16308 00000100:00100000:2.0:1746129573.024646:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093edc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ada2ffba-8920-4ecb-8068-68caa9806978+31:32364:x1830948734181248:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:2.0:1746129573.024659:0:7148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129573.024678:0:7148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fd29200/0x40a459093b06a399 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f213e3 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129573.024711:0:7148:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880136b1cc00/0x40a459093b06a2a4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21350 expref: 32 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129573.024723:0:7148:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a6729600/0x40a459093b06a2b2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2135e expref: 17 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129573.024729:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129573.024731:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129573.024734:0:7148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd29200/0x40a459093b06a399 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [3043328->3145727] (req 3043328->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f213e3 expref: 32 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129573.024764:0:7148:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a6729600/0x40a459093b06a2b2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2135e expref: 17 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129573.024776:0:7148:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a6729600/0x40a459093b06a2b2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2135e expref: 17 pid: 4385 timeout: 928 lvb_type: 0 00000100:00100000:2.0:1746129573.024788:0:7148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800912adf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7148:1830948737537792:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129573.024871:0:7148:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880136b1cc00/0x40a459093b06a2a4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21350 expref: 32 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129573.024880:0:7148:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880136b1cc00/0x40a459093b06a2a4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21350 expref: 32 pid: 22480 timeout: 928 lvb_type: 0 00000100:00100000:2.0:1746129573.024887:0:7148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800912ae680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7148:1830948737537920:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129573.024902:0:7148:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009af1e6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129573.032489:0:7148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800912adf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7148:1830948737537792:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129573.032501:0:7148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800912ae680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7148:1830948737537920:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129573.032534:0:7148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fd29200/0x40a459093b06a399 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [3043328->3145727] (req 3043328->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f213e3 expref: 32 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129573.032552:0:7148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd29200, rc 0) 00000100:00100000:0.0:1746129573.032608:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093edc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ada2ffba-8920-4ecb-8068-68caa9806978+32:32364:x1830948734181248:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 7962us (8068us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129573.032616:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16308 00000100:00100000:1.0:1746129573.039968:0:8416:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093edd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+27:1962:x1830948734181120:12345-192.168.202.4@tcp:3:cat.0 Request processed in 17198us (18149us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129573.039979:0:8416:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7859 00002000:00100000:1.0:1746129573.039991:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3f5:0x0] (3145728->4194303) req@ffff880093edd880 x1830948734181120/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:314/0 lens 488/440 e 0 to 0 dl 1746129584 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129573.040000:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093edd880 with x1830948734181120 ext(3145728->4194303) 00002000:00010000:1.0:1746129573.040007:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093edd880 00000100:00100000:0.0:1746129573.042929:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129573.045512:0:20578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734181376 00000100:00100000:3.0:1746129573.045522:0:20578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734181376 00010000:00010000:3.0:1746129573.045560:0:20578:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880136b1cc00/0x40a459093b06a2a4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21350 expref: 32 pid: 22480 timeout: 928 lvb_type: 0 00000100:00100000:3.0:1746129573.045602:0:20578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8366 00000100:00100000:3.0:1746129573.045609:0:20578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093edd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ada2ffba-8920-4ecb-8068-68caa9806978+32:1961:x1830948734181376:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129573.045622:0:20578:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129573.045641:0:20578:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880136b1cc00/0x40a459093b06a2a4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21350 expref: 32 pid: 22480 timeout: 928 lvb_type: 0 00010000:00010000:3.0:1746129573.045651:0:20578:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880136b1cc00/0x40a459093b06a2a4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21350 expref: 32 pid: 22480 timeout: 928 lvb_type: 0 00010000:00010000:3.0:1746129573.045671:0:20578:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136b1cc00/0x40a459093b06a2a4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21350 expref: 32 pid: 22480 timeout: 928 lvb_type: 0 00010000:00010000:3.0:1746129573.045689:0:20578:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129573.046030:0:20578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093edd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ada2ffba-8920-4ecb-8068-68caa9806978+31:1961:x1830948734181376:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 420us (3109us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129573.046038:0:20578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8366 00000100:00100000:2.0:1746129573.046041:0:31520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ede680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+17:1962:x1830948734180992:12345-192.168.202.4@tcp:3:cat.0 Request processed in 23674us (24322us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129573.046052:0:31520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7858 00002000:00100000:2.0:1746129573.046064:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3ef:0x0] (2097152->3145727) req@ffff880093ede680 x1830948734180992/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:314/0 lens 488/440 e 0 to 0 dl 1746129584 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129573.046074:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ede680 with x1830948734180992 ext(2097152->3145727) 00010000:00010000:2.0:1746129573.046083:0:31520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a6729600/0x40a459093b06a2b2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2135e expref: 17 pid: 4385 timeout: 928 lvb_type: 0 00010000:00010000:2.0:1746129573.046098:0:31520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a6729600/0x40a459093b06a2b2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2135e expref: 17 pid: 4385 timeout: 928 lvb_type: 0 00002000:00010000:2.0:1746129573.046104:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093ede680 00000100:00100000:0.0:1746129573.054737:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129573.054811:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734181504 00000100:00100000:2.0:1746129573.054821:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734181504 00000100:00100000:2.0:1746129573.054874:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16309 00000100:00100000:2.0:1746129573.054881:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093eddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+17:32358:x1830948734181504:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129573.054900:0:7148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129573.054917:0:7148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fd29c00/0x40a459093b06a3a0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f213ea expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129573.054940:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129573.054942:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129573.054949:0:7148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd29c00/0x40a459093b06a3a0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f213ea expref: 18 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129573.054966:0:7148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fd29c00/0x40a459093b06a3a0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f213ea expref: 18 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129573.054975:0:7148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd29c00, rc 0) 00000100:00100000:2.0:1746129573.055030:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093eddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+18:32358:x1830948734181504:12345-192.168.202.4@tcp:101:cat.0 Request processed in 150us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129573.055036:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16309 00000100:00100000:0.0:1746129573.059789:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129573.061960:0:4699:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734181632 00000100:00100000:2.0:1746129573.061973:0:4699:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734181632 00000100:00100000:2.0:1746129573.062019:0:4699:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16310 00000100:00100000:2.0:1746129573.062028:0:4699:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093eded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+18:1963:x1830948734181632:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129573.062046:0:4699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129573.062064:0:4699:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fd28800/0x40a459093b06a3a7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f213f1 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129573.062089:0:4699:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129573.062099:0:4699:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fd28800/0x40a459093b06a3a7 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f213f1 expref: 19 pid: 4699 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129573.062110:0:4699:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fd28800/0x40a459093b06a3a7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f213f1 expref: 19 pid: 4699 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129573.062134:0:4699:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd28800, rc 0) 00000100:00100000:2.0:1746129573.062196:0:4699:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093eded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+18:1963:x1830948734181632:12345-192.168.202.4@tcp:101:cat.0 Request processed in 169us (2416us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129573.062206:0:4699:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16310 00000100:00100000:0.0:1746129573.064540:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129573.064809:0:20578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734181760 00000100:00100000:3.0:1746129573.064819:0:20578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734181760 00010000:00010000:3.0:1746129573.064854:0:20578:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6729600/0x40a459093b06a2b2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2135e expref: 18 pid: 4385 timeout: 928 lvb_type: 0 00000100:00100000:3.0:1746129573.064890:0:20578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8367 00000100:00100000:3.0:1746129573.064898:0:20578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a45c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+18:1961:x1830948734181760:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129573.064912:0:20578:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129573.064937:0:20578:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a6729600/0x40a459093b06a2b2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2135e expref: 18 pid: 4385 timeout: 928 lvb_type: 0 00010000:00010000:3.0:1746129573.064952:0:20578:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a6729600/0x40a459093b06a2b2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2135e expref: 18 pid: 4385 timeout: 928 lvb_type: 0 00010000:00010000:3.0:1746129573.064969:0:20578:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a6729600/0x40a459093b06a2b2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2135e expref: 18 pid: 4385 timeout: 928 lvb_type: 0 00010000:00010000:3.0:1746129573.064989:0:20578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129573.064991:0:20578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129573.064995:0:20578:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fd29200/0x40a459093b06a399 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [3043328->3145727] (req 3043328->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f213e3 expref: 30 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129573.065002:0:20578:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd29200/0x40a459093b06a399 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [3043328->3145727] (req 3043328->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f213e3 expref: 30 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129573.065032:0:20578:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009fd29200/0x40a459093b06a399 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [3043328->3145727] (req 3043328->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f213e3 expref: 30 pid: 7148 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129573.065042:0:20578:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bd500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:20578:1830948737538048:192.168.202.4@tcp:105: 00000100:00100000:3.0:1746129573.065123:0:20578:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5ac9240 going to sleep for 11 seconds 00000100:00100000:2.0:1746129573.069837:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129573.069876:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129573.069902:0:31520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734182144 00000100:00100000:2.0:1746129573.069911:0:31520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734182144 00002000:00100000:2.0:1746129573.069958:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3ef:0x0] (4194304->5148671) req@ffff8800912afb80 x1830948734182144/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:314/0 lens 488/0 e 0 to 0 dl 1746129584 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129573.069969:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800912afb80 with x1830948734182144 ext(4194304->5148671) 00002000:00010000:2.0:1746129573.069974:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800912afb80 00000100:00100000:2.0:1746129573.069991:0:31520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734182272 00000100:00100000:2.0:1746129573.069993:0:31520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734182272 00002000:00100000:2.0:1746129573.070005:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3ef:0x0] (3043328->3047423) req@ffff8800912ae680 x1830948734182272/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:314/0 lens 488/0 e 0 to 0 dl 1746129584 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129573.070011:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800912ae680 with x1830948734182272 ext(3043328->3047423) 00002000:00010000:2.0:1746129573.070014:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800912ae680 00000100:00100000:2.0:1746129573.070025:0:31520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7860 00000100:00100000:2.0:1746129573.070032:0:31520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800912afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+18:1960:x1830948734182144:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129573.070222:0:8416:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7861 00000100:00100000:0.0:1746129573.070231:0:8416:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800912ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ada2ffba-8920-4ecb-8068-68caa9806978+31:1962:x1830948734182272:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:0.0:1746129573.070398:0:8416:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800912ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ada2ffba-8920-4ecb-8068-68caa9806978+31:1962:x1830948734182272:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 167us (519us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746129573.070405:0:8416:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7861 00002000:00100000:0.0:1746129573.070411:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3ef:0x0] (3043328->3047423) req@ffff8800912ae680 x1830948734182272/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:314/0 lens 488/4536 e 0 to 0 dl 1746129584 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129573.070417:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800912ae680 with x1830948734182272 ext(3043328->3047423) 00002000:00010000:0.0:1746129573.070421:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800912ae680 00000100:00100000:3.0:1746129573.070752:0:20578:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bd500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:20578:1830948737538048:192.168.202.4@tcp:105: 00010000:00010000:3.0:1746129573.070773:0:20578:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129573.070811:0:20578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a45c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+18:1961:x1830948734181760:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 5913us (6284us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129573.070819:0:20578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8367 00000100:00100000:0.0:1746129573.073916:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129573.074099:0:4699:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734182400 00000100:00100000:3.0:1746129573.074106:0:4699:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734182400 00000100:00100000:3.0:1746129573.074972:0:4699:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16311 00000100:00100000:3.0:1746129573.074981:0:4699:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093edce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ada2ffba-8920-4ecb-8068-68caa9806978+35:32364:x1830948734182400:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:3.0:1746129573.074995:0:4699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129573.075009:0:4699:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136b1c400/0x40a459093b06a3ae lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f213f8 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129573.075037:0:4699:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880136b1ca00/0x40a459093b06a2c7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21373 expref: 36 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129573.075046:0:4699:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880090078800/0x40a459093b06a2d5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21381 expref: 26 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129573.075052:0:4699:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880136b1c800/0x40a459093b06a2ab lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21357 expref: 26 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129573.075059:0:4699:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c460000/0x40a459093b06a2b9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21365 expref: 36 pid: 22480 timeout: 0 lvb_type: 0 00000100:00080000:1.0:1746129573.075062:0:7097:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1746129573.075064:0:4699:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746129573.075065:0:4699:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746129573.075068:0:4699:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136b1c400/0x40a459093b06a3ae lrc: 7/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [2097152->2134015] (req 2097152->2134015) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f213f8 expref: 36 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129573.075156:0:4699:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c460000/0x40a459093b06a2b9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21365 expref: 36 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129573.075166:0:4699:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c460000/0x40a459093b06a2b9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21365 expref: 36 pid: 22480 timeout: 928 lvb_type: 0 00000100:00100000:3.0:1746129573.075176:0:4699:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4699:1830948737538176:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129573.075511:0:4699:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880136b1c800/0x40a459093b06a2ab lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21357 expref: 26 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129573.075520:0:4699:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880136b1c800/0x40a459093b06a2ab lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21357 expref: 26 pid: 22480 timeout: 928 lvb_type: 0 00000100:00100000:3.0:1746129573.075529:0:4699:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4699:1830948737538304:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129573.075767:0:4699:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880090078800/0x40a459093b06a2d5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21381 expref: 26 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129573.075780:0:4699:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880090078800/0x40a459093b06a2d5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21381 expref: 26 pid: 4385 timeout: 928 lvb_type: 1 00000100:00100000:3.0:1746129573.076077:0:4699:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4699:1830948737538432:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129573.076109:0:4699:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880136b1ca00/0x40a459093b06a2c7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21373 expref: 36 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129573.076115:0:4699:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880136b1ca00/0x40a459093b06a2c7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21373 expref: 36 pid: 4385 timeout: 928 lvb_type: 0 00000100:00100000:3.0:1746129573.076122:0:4699:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4699:1830948737538560:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129573.076136:0:4699:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5ac93c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746129573.080856:0:4699:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4699:1830948737538176:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129573.080868:0:4699:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4699:1830948737538304:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129573.081631:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129573.081667:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129573.081697:0:20578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734182656 00000100:00100000:3.0:1746129573.081704:0:20578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734182656 00010000:00010000:3.0:1746129573.081744:0:20578:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880136b1c800/0x40a459093b06a2ab lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21357 expref: 27 pid: 22480 timeout: 928 lvb_type: 0 00000100:00100000:3.0:1746129573.081773:0:20578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734182528 00000100:00100000:3.0:1746129573.081775:0:20578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734182528 00010000:00010000:3.0:1746129573.081785:0:20578:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c460000/0x40a459093b06a2b9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21365 expref: 37 pid: 22480 timeout: 928 lvb_type: 0 00000100:00100000:3.0:1746129573.081814:0:20578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8368 00000100:00100000:3.0:1746129573.081820:0:20578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093edd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+27:1962:x1830948734182656:12345-192.168.202.4@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746129573.081822:0:7086:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8369 00010000:00010000:3.0:1746129573.081831:0:20578:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746129573.081834:0:7086:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f448000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ada2ffba-8920-4ecb-8068-68caa9806978+37:1962:x1830948734182528:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129573.081847:0:7086:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129573.081850:0:20578:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880136b1c800/0x40a459093b06a2ab lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21357 expref: 27 pid: 22480 timeout: 928 lvb_type: 0 00010000:00010000:3.0:1746129573.081859:0:20578:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880136b1c800/0x40a459093b06a2ab lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21357 expref: 27 pid: 22480 timeout: 928 lvb_type: 0 00010000:00010000:1.0:1746129573.081868:0:7086:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c460000/0x40a459093b06a2b9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21365 expref: 37 pid: 22480 timeout: 928 lvb_type: 0 00010000:00010000:3.0:1746129573.081877:0:20578:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136b1c800/0x40a459093b06a2ab lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21357 expref: 27 pid: 22480 timeout: 928 lvb_type: 0 00010000:00010000:1.0:1746129573.081881:0:7086:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c460000/0x40a459093b06a2b9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 9 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21365 expref: 37 pid: 22480 timeout: 928 lvb_type: 0 00010000:00010000:1.0:1746129573.081899:0:7086:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c460000/0x40a459093b06a2b9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21365 expref: 37 pid: 22480 timeout: 928 lvb_type: 0 00000100:00100000:2.0:1746129573.081945:0:4699:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4699:1830948737538432:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129573.081953:0:4699:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4699:1830948737538560:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129573.082291:0:20578:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129573.082365:0:20578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093edd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+26:1962:x1830948734182656:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 545us (741us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129573.082371:0:20578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8368 00010000:00010000:1.0:1746129573.082495:0:7086:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746129573.082503:0:4699:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880136b1c400/0x40a459093b06a3ae lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [2097152->2134015] (req 2097152->2134015) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f213f8 expref: 36 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129573.082514:0:4699:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136b1c400, rc 0) 00000100:00100000:1.0:1746129573.082527:0:7086:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f448000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ada2ffba-8920-4ecb-8068-68caa9806978+36:1962:x1830948734182528:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 697us (859us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129573.082534:0:7086:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8369 00000100:00100000:2.0:1746129573.082695:0:4699:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093edce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ada2ffba-8920-4ecb-8068-68caa9806978+35:32364:x1830948734182400:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 7712us (8782us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129573.082702:0:4699:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16311 00000100:00100000:0.0:1746129573.083698:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129573.083739:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129573.083878:0:7086:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734182784 00000100:00100000:1.0:1746129573.083885:0:7086:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734182784 00010000:00010000:1.0:1746129573.083910:0:7086:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090078800/0x40a459093b06a2d5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21381 expref: 26 pid: 4385 timeout: 928 lvb_type: 1 00000100:00100000:1.0:1746129573.083931:0:7086:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8370 00000100:00100000:1.0:1746129573.083936:0:7086:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f44b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+26:1963:x1830948734182784:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129573.083946:0:7086:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129573.083962:0:7086:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090078800/0x40a459093b06a2d5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21381 expref: 26 pid: 4385 timeout: 928 lvb_type: 1 00010000:00010000:1.0:1746129573.083972:0:7086:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090078800/0x40a459093b06a2d5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21381 expref: 26 pid: 4385 timeout: 928 lvb_type: 1 00010000:00010000:1.0:1746129573.083990:0:7086:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090078800/0x40a459093b06a2d5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21381 expref: 26 pid: 4385 timeout: 928 lvb_type: 1 00010000:00010000:1.0:1746129573.084004:0:7086:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129573.084030:0:7086:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f44b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+25:1963:x1830948734182784:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 93us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129573.084035:0:7086:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8370 00000100:00100000:1.0:1746129573.084287:0:7086:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734182912 00000100:00100000:1.0:1746129573.084291:0:7086:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734182912 00010000:00010000:1.0:1746129573.084338:0:7086:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880136b1ca00/0x40a459093b06a2c7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21373 expref: 35 pid: 4385 timeout: 928 lvb_type: 0 00000100:00100000:1.0:1746129573.084357:0:7086:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8371 00000100:00100000:1.0:1746129573.084362:0:7086:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baedc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ada2ffba-8920-4ecb-8068-68caa9806978+35:1963:x1830948734182912:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129573.084368:0:7086:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129573.084374:0:7086:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880136b1ca00/0x40a459093b06a2c7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21373 expref: 35 pid: 4385 timeout: 928 lvb_type: 0 00010000:00010000:1.0:1746129573.084382:0:7086:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880136b1ca00/0x40a459093b06a2c7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21373 expref: 35 pid: 4385 timeout: 928 lvb_type: 0 00010000:00010000:1.0:1746129573.084392:0:7086:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136b1ca00/0x40a459093b06a2c7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21373 expref: 35 pid: 4385 timeout: 928 lvb_type: 0 00010000:00010000:1.0:1746129573.084404:0:7086:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129573.084405:0:7086:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129573.084412:0:7086:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136b1c400/0x40a459093b06a3ae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2134015) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f213f8 expref: 34 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129573.084419:0:7086:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136b1c400/0x40a459093b06a3ae lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2134015) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f213f8 expref: 34 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129573.084449:0:7086:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880136b1c400/0x40a459093b06a3ae lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2134015) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f213f8 expref: 34 pid: 4699 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129573.084462:0:7086:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095624700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7086:1830948737538688:192.168.202.4@tcp:105: 00000100:00100000:1.0:1746129573.084515:0:7086:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934d2780 going to sleep for 11 seconds 00000100:00100000:2.0:1746129573.085925:0:31520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800912afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+17:1960:x1830948734182144:12345-192.168.202.4@tcp:3:cat.0 Request processed in 15887us (16092us total) trans 0 rc 954368/954368 00000100:00100000:2.0:1746129573.085935:0:31520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7860 00002000:00100000:2.0:1746129573.085945:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3ef:0x0] (4194304->5148671) req@ffff8800912afb80 x1830948734182144/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:314/0 lens 488/440 e 0 to 0 dl 1746129584 ref 1 fl Complete:/200/0 rc 954368/954368 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129573.085952:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800912afb80 with x1830948734182144 ext(4194304->5148671) 00002000:00010000:2.0:1746129573.085956:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800912afb80 00000100:00100000:1.0:1746129573.089629:0:7086:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095624700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7086:1830948737538688:192.168.202.4@tcp:105: 00010000:00010000:1.0:1746129573.089659:0:7086:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129573.089727:0:7086:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baedc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ada2ffba-8920-4ecb-8068-68caa9806978+34:1963:x1830948734182912:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 5362us (5985us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129573.089738:0:7086:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8371 00000100:00100000:0.0:1746129573.089816:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129573.090599:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129573.090659:0:4699:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734183296 00000100:00100000:2.0:1746129573.090668:0:4699:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734183296 00000100:00100000:2.0:1746129573.090705:0:4699:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16312 00000100:00100000:2.0:1746129573.090711:0:4699:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baeed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+17:1960:x1830948734183296:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129573.090728:0:4699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129573.090745:0:4699:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fd29a00/0x40a459093b06a3b5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f213ff expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129573.090773:0:4699:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fd29a00/0x40a459093b06a3b5 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f213ff expref: 18 pid: 4699 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129573.090785:0:4699:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fd29a00/0x40a459093b06a3b5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f213ff expref: 18 pid: 4699 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129573.090800:0:4699:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd29a00, rc 0) 00000100:00100000:2.0:1746129573.090826:0:4699:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baeed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+17:1960:x1830948734183296:12345-192.168.202.4@tcp:101:cat.0 Request processed in 116us (230us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129573.090835:0:4699:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16312 00000100:00100000:1.0:1746129573.090875:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129573.090987:0:31520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734183168 00000100:00100000:3.0:1746129573.090992:0:31520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734183168 00002000:00100000:3.0:1746129573.091020:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3f5:0x0] (2129920->2134015) req@ffff88012baec700 x1830948734183168/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:314/0 lens 488/0 e 0 to 0 dl 1746129584 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129573.091028:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012baec700 with x1830948734183168 ext(2129920->2134015) 00002000:00010000:3.0:1746129573.091032:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012baec700 00000100:00100000:3.0:1746129573.091044:0:31520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7862 00000100:00100000:3.0:1746129573.091048:0:31520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ada2ffba-8920-4ecb-8068-68caa9806978+34:1962:x1830948734183168:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:3.0:1746129573.091189:0:31520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ada2ffba-8920-4ecb-8068-68caa9806978+34:1962:x1830948734183168:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 141us (1374us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129573.091194:0:31520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7862 00002000:00100000:3.0:1746129573.091198:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3f5:0x0] (2129920->2134015) req@ffff88012baec700 x1830948734183168/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:314/0 lens 488/4536 e 0 to 0 dl 1746129584 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129573.091204:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012baec700 with x1830948734183168 ext(2129920->2134015) 00002000:00010000:3.0:1746129573.091207:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012baec700 00000100:00100000:2.0:1746129573.091345:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734183424 00000100:00100000:2.0:1746129573.091348:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734183424 00000100:00100000:2.0:1746129573.091549:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16313 00000100:00100000:2.0:1746129573.091554:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095624700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+25:1960:x1830948734183424:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129573.091562:0:7148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129573.091571:0:7148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fd29400/0x40a459093b06a3bc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21406 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129573.091610:0:7148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800912adf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:7148:1830948737538816:192.168.202.4@tcp:106: 00000100:00100000:2.0:1746129573.091960:0:7148:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009af1e540 going to sleep for 11 seconds 00000100:00100000:2.0:1746129573.096169:0:7148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800912adf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:7148:1830948737538816:192.168.202.4@tcp:106: 00010000:00010000:2.0:1746129573.096207:0:7148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fd29400/0x40a459093b06a3bc lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21406 expref: 26 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129573.096223:0:7148:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fd29400/0x40a459093b06a3bc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21406 expref: 26 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129573.096238:0:7148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd29400, rc 0) 00000100:00100000:2.0:1746129573.097124:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095624700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+25:1960:x1830948734183424:12345-192.168.202.4@tcp:101:cat.0 Request processed in 5563us (6244us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129573.097134:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16313 00000100:00100000:0.0:1746129573.102241:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129573.102287:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734183552 00000100:00100000:0.0:1746129573.102291:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129573.102331:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734183552 00000100:00100000:2.0:1746129573.102387:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734183680 00000100:00100000:2.0:1746129573.102390:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734183680 00000100:00100000:2.0:1746129573.102415:0:22480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16314 00000100:00100000:2.0:1746129573.102423:0:22480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+17:1961:x1830948734183552:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129573.102446:0:22480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129573.102473:0:22480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fd28a00/0x40a459093b06a3c3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2140d expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129573.102504:0:22480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fd28a00/0x40a459093b06a3c3 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2140d expref: 18 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129573.102514:0:22480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fd28a00/0x40a459093b06a3c3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2140d expref: 18 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129573.102538:0:22480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd28a00, rc 0) 00000100:00100000:2.0:1746129573.102585:0:22480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+17:1961:x1830948734183552:12345-192.168.202.4@tcp:101:cat.0 Request processed in 162us (355us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129573.102591:0:22480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16314 00000100:00100000:2.0:1746129573.102606:0:22480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16315 00000100:00100000:2.0:1746129573.102610:0:22480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a77b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+25:1961:x1830948734183680:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129573.102617:0:22480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129573.102627:0:22480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fd29000/0x40a459093b06a3ca lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21414 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129573.102667:0:22480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800912adf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22480:1830948737538944:192.168.202.4@tcp:106: 00000100:00100000:2.0:1746129573.102725:0:22480:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009af1e540 going to sleep for 11 seconds 00000100:00100000:2.0:1746129573.104497:0:22480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800912adf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22480:1830948737538944:192.168.202.4@tcp:106: 00010000:00010000:2.0:1746129573.104527:0:22480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fd29000/0x40a459093b06a3ca lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21414 expref: 26 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129573.104538:0:22480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fd29000/0x40a459093b06a3ca lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21414 expref: 26 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129573.104548:0:22480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd29000, rc 0) 00000100:00100000:2.0:1746129573.104579:0:22480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a77b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+25:1961:x1830948734183680:12345-192.168.202.4@tcp:101:cat.0 Request processed in 1967us (2287us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129573.104587:0:22480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16315 00000100:00100000:0.0:1746129573.142423:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129573.143160:0:22480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734183808 00000100:00100000:2.0:1746129573.143170:0:22480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734183808 00000100:00100000:0.0:1746129573.143180:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129573.143268:0:22480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734183936 00000100:00100000:2.0:1746129573.143271:0:22480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734183936 00000100:00100000:3.0:1746129573.143367:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16316 00000100:00100000:3.0:1746129573.143379:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a77b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ada2ffba-8920-4ecb-8068-68caa9806978+32:1962:x1830948734183808:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129573.143401:0:4385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129573.143419:0:4385:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a6729200/0x40a459093b06a3d1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2141b expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129573.143476:0:4385:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947be680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:4385:1830948737539072:192.168.202.4@tcp:106: 00000100:00100000:3.0:1746129573.143560:0:4385:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5ac9f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746129573.143592:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16317 00000100:00100000:3.0:1746129573.143598:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a77b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ada2ffba-8920-4ecb-8068-68caa9806978+33:1962:x1830948734183936:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129573.143604:0:7148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129573.143612:0:7148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a6729600/0x40a459093b06a3d8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21422 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129573.143631:0:7148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a6729600/0x40a459093b06a3d8 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21422 expref: 34 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129573.143646:0:7148:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a6729600/0x40a459093b06a3d8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21422 expref: 34 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129573.143659:0:7148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6729600, rc 0) 00000100:00100000:3.0:1746129573.143681:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a77b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ada2ffba-8920-4ecb-8068-68caa9806978+33:1962:x1830948734183936:12345-192.168.202.4@tcp:101:cat.0 Request processed in 83us (502us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129573.143687:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16317 00000100:00100000:3.0:1746129573.146244:0:4385:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947be680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:4385:1830948737539072:192.168.202.4@tcp:106: 00010000:00010000:3.0:1746129573.146280:0:4385:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a6729200/0x40a459093b06a3d1 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2141b expref: 32 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129573.146338:0:4385:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a6729200/0x40a459093b06a3d1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2141b expref: 32 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129573.146352:0:4385:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6729200, rc 0) 00000100:00100000:3.0:1746129573.146413:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a77b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ada2ffba-8920-4ecb-8068-68caa9806978+31:1962:x1830948734183808:12345-192.168.202.4@tcp:101:cat.0 Request processed in 3036us (3998us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129573.146422:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16316 00000100:00100000:0.0:1746129573.153348:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129573.154568:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734184064 00000100:00100000:3.0:1746129573.154580:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734184064 00000100:00100000:3.0:1746129573.154680:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16318 00000100:00100000:3.0:1746129573.154688:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a77b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ada2ffba-8920-4ecb-8068-68caa9806978+31:32372:x1830948734184064:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129573.154708:0:4385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129573.154728:0:4385:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a6729a00/0x40a459093b06a3df lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21429 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129573.154759:0:4385:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f445800/0x40a459093b06a35a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 225280->815103) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f213b2 expref: 16 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129573.154766:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129573.154768:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129573.154771:0:4385:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6729a00/0x40a459093b06a3df lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21429 expref: 32 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129573.154802:0:4385:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f445800/0x40a459093b06a35a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 225280->815103) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f213b2 expref: 16 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129573.154813:0:4385:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f445800/0x40a459093b06a35a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 225280->815103) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f213b2 expref: 16 pid: 22480 timeout: 928 lvb_type: 0 00000100:00100000:3.0:1746129573.154824:0:4385:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947be680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:4385:1830948737539200:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129573.155460:0:4385:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5ac9f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746129573.157936:0:4385:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947be680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:4385:1830948737539200:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129573.157978:0:4385:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a6729a00/0x40a459093b06a3df lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21429 expref: 32 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129573.157998:0:4385:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6729a00, rc 0) 00000100:00100000:3.0:1746129573.158060:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a77b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ada2ffba-8920-4ecb-8068-68caa9806978+32:32372:x1830948734184064:12345-192.168.202.4@tcp:101:cat.0 Request processed in 3372us (4766us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129573.158069:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16318 00000100:00100000:0.0:1746129573.159288:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129573.159383:0:21725:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734184192 00000100:00100000:3.0:1746129573.159391:0:21725:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734184192 00002000:00100000:3.0:1746129573.159431:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ec:0x0] (225280->815103) req@ffff8800a77b1180 x1830948734184192/t0(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:314/0 lens 488/0 e 0 to 0 dl 1746129584 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129573.159439:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a77b1180 with x1830948734184192 ext(225280->815103) 00010000:00010000:3.0:1746129573.159447:0:21725:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008f445800/0x40a459093b06a35a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 225280->815103) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f213b2 expref: 17 pid: 22480 timeout: 928 lvb_type: 0 00010000:00010000:3.0:1746129573.159458:0:21725:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008f445800/0x40a459093b06a35a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 225280->815103) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f213b2 expref: 17 pid: 22480 timeout: 928 lvb_type: 0 00002000:00010000:3.0:1746129573.159464:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a77b1180 00000100:00100000:3.0:1746129573.159481:0:21725:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2441 00000100:00100000:3.0:1746129573.159487:0:21725:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a77b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+17:1962:x1830948734184192:12345-192.168.202.4@tcp:4:cat.0 00000100:00100000:3.0:1746129573.174148:0:21725:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a77b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+19:1962:x1830948734184192:12345-192.168.202.4@tcp:4:cat.0 Request processed in 14647us (14850us total) trans 21474841374 rc 0/0 00000100:00100000:3.0:1746129573.174163:0:21725:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2441 00002000:00100000:3.0:1746129573.174176:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ec:0x0] (225280->815103) req@ffff8800a77b1180 x1830948734184192/t21474841374(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:314/0 lens 488/448 e 0 to 0 dl 1746129584 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129573.174187:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a77b1180 with x1830948734184192 ext(225280->815103) 00010000:00010000:3.0:1746129573.174198:0:21725:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008f445800/0x40a459093b06a35a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 225280->815103) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f213b2 expref: 19 pid: 22480 timeout: 928 lvb_type: 0 00010000:00010000:3.0:1746129573.174215:0:21725:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008f445800/0x40a459093b06a35a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 225280->815103) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f213b2 expref: 19 pid: 22480 timeout: 928 lvb_type: 0 00002000:00010000:3.0:1746129573.174222:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a77b1180 00000100:00100000:0.0:1746129573.176569:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129573.176664:0:7086:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734184320 00000100:00100000:1.0:1746129573.176674:0:7086:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734184320 00010000:00010000:1.0:1746129573.176710:0:7086:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f445800/0x40a459093b06a35a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 225280->815103) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f213b2 expref: 19 pid: 22480 timeout: 928 lvb_type: 0 00000100:00100000:1.0:1746129573.176751:0:7086:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8372 00000100:00100000:1.0:1746129573.176758:0:7086:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a77b3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+19:1961:x1830948734184320:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129573.176775:0:7086:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129573.176797:0:7086:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f445800/0x40a459093b06a35a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 225280->815103) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f213b2 expref: 19 pid: 22480 timeout: 928 lvb_type: 0 00010000:00010000:1.0:1746129573.176809:0:7086:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f445800/0x40a459093b06a35a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 225280->815103) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f213b2 expref: 19 pid: 22480 timeout: 928 lvb_type: 0 00010000:00010000:1.0:1746129573.176831:0:7086:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f445800/0x40a459093b06a35a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 225280->815103) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f213b2 expref: 19 pid: 22480 timeout: 928 lvb_type: 0 00010000:00010000:1.0:1746129573.176862:0:7086:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129573.176864:0:7086:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129573.176872:0:7086:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a6729a00/0x40a459093b06a3df lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21429 expref: 31 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129573.176880:0:7086:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6729a00/0x40a459093b06a3df lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21429 expref: 31 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129573.176914:0:7086:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a6729a00/0x40a459093b06a3df lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21429 expref: 31 pid: 4385 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129573.176926:0:7086:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095625f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7086:1830948737539328:192.168.202.4@tcp:105: 00000100:00100000:1.0:1746129573.177017:0:7086:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934d2780 going to sleep for 11 seconds 00000100:00100000:1.0:1746129573.178907:0:7086:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095625f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7086:1830948737539328:192.168.202.4@tcp:105: 00010000:00010000:1.0:1746129573.178927:0:7086:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129573.178964:0:7086:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a77b3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+18:1961:x1830948734184320:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 2205us (2404us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129573.178977:0:7086:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8372 00000100:00100000:1.0:1746129573.187483:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129573.187541:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129573.187564:0:21725:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734184576 00000100:00100000:3.0:1746129573.187575:0:21725:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734184576 00002000:00100000:3.0:1746129573.187629:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ec:0x0] (0->1048575) req@ffff880095625f80 x1830948734184576/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:314/0 lens 488/0 e 0 to 0 dl 1746129584 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129573.187638:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095625f80 with x1830948734184576 ext(0->1048575) 00002000:00010000:3.0:1746129573.187643:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095625f80 00000100:00100000:3.0:1746129573.187662:0:21725:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734184832 00000100:00100000:3.0:1746129573.187664:0:21725:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734184832 00002000:00100000:3.0:1746129573.187673:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ee:0x0] (1048576->2097151) req@ffff880095624a80 x1830948734184832/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:314/0 lens 488/0 e 0 to 0 dl 1746129584 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129573.187680:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095624a80 with x1830948734184832 ext(1048576->2097151) 00002000:00010000:3.0:1746129573.187683:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095624a80 00000100:00100000:3.0:1746129573.187694:0:21725:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7863 00000100:00100000:3.0:1746129573.187700:0:21725:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095625f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ada2ffba-8920-4ecb-8068-68caa9806978+33:1962:x1830948734184576:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129573.187783:0:8416:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7864 00000100:00100000:0.0:1746129573.187791:0:8416:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095624a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ada2ffba-8920-4ecb-8068-68caa9806978+33:1962:x1830948734184832:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:3.0:1746129573.201017:0:8416:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095624a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ada2ffba-8920-4ecb-8068-68caa9806978+34:1962:x1830948734184832:12345-192.168.202.4@tcp:3:cat.0 Request processed in 13213us (13461us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129573.201029:0:8416:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7864 00002000:00100000:3.0:1746129573.201041:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3ee:0x0] (1048576->2097151) req@ffff880095624a80 x1830948734184832/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:314/0 lens 488/440 e 0 to 0 dl 1746129584 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129573.201189:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095624a80 with x1830948734184832 ext(1048576->2097151) 00002000:00010000:3.0:1746129573.201196:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095624a80 00000100:00100000:2.0:1746129573.211498:0:21725:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095625f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ada2ffba-8920-4ecb-8068-68caa9806978+32:1962:x1830948734184576:12345-192.168.202.4@tcp:3:cat.0 Request processed in 23784us (24013us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129573.211511:0:21725:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7863 00002000:00100000:2.0:1746129573.211523:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ec:0x0] (0->1048575) req@ffff880095625f80 x1830948734184576/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:314/0 lens 488/440 e 0 to 0 dl 1746129584 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129573.211533:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095625f80 with x1830948734184576 ext(0->1048575) 00002000:00010000:2.0:1746129573.211539:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095625f80 00000100:00100000:0.0:1746129573.220009:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129573.220120:0:16908:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734185088 00000100:00100000:2.0:1746129573.220130:0:16908:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734185088 00000100:00100000:2.0:1746129573.220186:0:16908:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11243 00000100:00100000:2.0:1746129573.220194:0:16908:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a77b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+23:32377:x1830948734185088:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:2.0:1746129573.220220:0:16908:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129573.220237:0:16908:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd28200/0x40a459093b06a3e6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21430 expref: -99 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129573.220370:0:16908:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd28000/0x40a459093b06a3ed lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129573.220385:0:16908:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd28000/0x40a459093b06a3ed lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129573.220396:0:16908:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd28000/0x40a459093b06a3ed lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00000004:00200000:2.0:1746129573.220406:0:16908:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:2.0:1746129573.220515:0:16908:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd28200/0x40a459093b06a3e6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21430 expref: 26 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129573.220534:0:16908:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd28000/0x40a459093b06a3ed lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21430 expref: 25 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129573.220541:0:16908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:2.0:1746129573.220544:0:16908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746129573.220547:0:16908:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd28000, rc 0) 00000100:00100000:2.0:1746129573.221521:0:16908:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a77b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+25:32377:x1830948734185088:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 1323us (1524us total) trans 8589945344 rc 0/0 00000100:00100000:2.0:1746129573.221528:0:16908:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11243 00000100:00100000:0.0:1746129573.238994:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129573.239973:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734185216 00000100:00100000:3.0:1746129573.239986:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734185216 00000100:00100000:3.0:1746129573.240066:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16319 00000100:00100000:3.0:1746129573.240076:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a77b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ada2ffba-8920-4ecb-8068-68caa9806978+32:32372:x1830948734185216:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129573.240098:0:4385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129573.240120:0:4385:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800952f6e00/0x40a459093b06a3fb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21437 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129573.240153:0:4385:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fd29200/0x40a459093b06a399 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [3043328->3145727] (req 3043328->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f213e3 expref: 33 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129573.240161:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129573.240163:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129573.240166:0:4385:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800952f6e00/0x40a459093b06a3fb lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21437 expref: 33 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129573.240202:0:4385:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fd29200/0x40a459093b06a399 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [3043328->3145727] (req 3043328->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f213e3 expref: 33 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129573.240214:0:4385:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fd29200/0x40a459093b06a399 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [3043328->3145727] (req 3043328->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f213e3 expref: 33 pid: 7148 timeout: 928 lvb_type: 0 00000100:00100000:3.0:1746129573.240226:0:4385:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947be680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:4385:1830948737539456:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129573.240403:0:4385:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5ac9f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746129573.243236:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129573.243283:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129573.243376:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129573.243485:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734185344 00000100:00100000:3.0:1746129573.243495:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734185344 00000100:00100000:0.0:1746129573.244633:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734185472 00000100:00100000:2.0:1746129573.244634:0:22480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734185600 00000100:00100000:2.0:1746129573.244641:0:22480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734185600 00000100:00100000:0.0:1746129573.244641:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734185472 00000100:00100000:0.0:1746129573.244681:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16320 00000100:00100000:2.0:1746129573.244687:0:22480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16321 00000100:00100000:0.0:1746129573.244689:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094efdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+19:1961:x1830948734185344:12345-192.168.202.4@tcp:101:cat.0 00000100:00100000:2.0:1746129573.244693:0:22480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094efd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+19:1961:x1830948734185472:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129573.244723:0:22480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129573.244730:0:7149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129573.244744:0:22480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fd28600/0x40a459093b06a402 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21445 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129573.244744:0:7149:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c461200/0x40a459093b06a409 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2143e expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129573.244769:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129573.244771:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129573.244777:0:22480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fd28600/0x40a459093b06a402 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21445 expref: 21 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129573.244779:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c461200/0x40a459093b06a409 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2143e expref: 21 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129573.244787:0:22480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fd28600/0x40a459093b06a402 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21445 expref: 21 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129573.244794:0:7149:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c461200/0x40a459093b06a409 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2143e expref: 21 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129573.244803:0:22480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd28600, rc 0) 00010000:00010000:0.0:1746129573.244803:0:7149:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c461200, rc 0) 00000100:00100000:2.0:1746129573.244850:0:22480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094efd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:1961:x1830948734185472:12345-192.168.202.4@tcp:101:cat.0 Request processed in 157us (1565us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129573.244855:0:22480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16321 00000100:00100000:2.0:1746129573.244873:0:22480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16322 00000100:00100000:2.0:1746129573.244877:0:22480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094efce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+25:1961:x1830948734185600:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129573.244885:0:22480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129573.244897:0:22480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fd28e00/0x40a459093b06a410 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2144c expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129573.244940:0:22480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800912adf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22480:1830948737539584:192.168.202.4@tcp:106: 00000100:00100000:0.0:1746129573.245091:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094efdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+19:1961:x1830948734185344:12345-192.168.202.4@tcp:101:cat.0 Request processed in 402us (1864us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129573.245096:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16320 00000100:00100000:2.0:1746129573.246237:0:22480:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009af1e3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129573.248421:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129573.248438:0:4385:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947be680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:4385:1830948737539456:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129573.248478:0:4385:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800952f6e00/0x40a459093b06a3fb lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21437 expref: 33 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129573.248497:0:4385:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800952f6e00, rc 0) 00000100:00100000:2.0:1746129573.248516:0:21725:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734185728 00000100:00100000:2.0:1746129573.248525:0:21725:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734185728 00000100:00100000:3.0:1746129573.248547:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a77b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ada2ffba-8920-4ecb-8068-68caa9806978+34:32372:x1830948734185216:12345-192.168.202.4@tcp:101:cat.0 Request processed in 8472us (9564us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129573.248557:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16319 00002000:00100000:2.0:1746129573.248569:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ef:0x0] (3043328->3145727) req@ffff880094eff480 x1830948734185728/t0(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:314/0 lens 488/0 e 0 to 0 dl 1746129584 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129573.248578:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094eff480 with x1830948734185728 ext(3043328->3145727) 00010000:00010000:2.0:1746129573.248585:0:21725:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fd29200/0x40a459093b06a399 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [3043328->3145727] (req 3043328->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f213e3 expref: 33 pid: 7148 timeout: 928 lvb_type: 0 00010000:00010000:2.0:1746129573.248598:0:21725:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fd29200/0x40a459093b06a399 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [3043328->3145727] (req 3043328->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f213e3 expref: 33 pid: 7148 timeout: 928 lvb_type: 0 00002000:00010000:2.0:1746129573.248604:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094eff480 00000100:00100000:2.0:1746129573.248632:0:21725:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2442 00000100:00100000:2.0:1746129573.248639:0:21725:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ada2ffba-8920-4ecb-8068-68caa9806978+33:1963:x1830948734185728:12345-192.168.202.4@tcp:4:cat.0 00000100:00100000:3.0:1746129573.250157:0:22480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800912adf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22480:1830948737539584:192.168.202.4@tcp:106: 00010000:00010000:3.0:1746129573.250196:0:22480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fd28e00/0x40a459093b06a410 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2144c expref: 26 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129573.250207:0:22480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fd28e00/0x40a459093b06a410 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2144c expref: 26 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129573.250237:0:22480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd28e00, rc 0) 00000100:00100000:3.0:1746129573.250275:0:22480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094efce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+25:1961:x1830948734185600:12345-192.168.202.4@tcp:101:cat.0 Request processed in 5395us (6898us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129573.250283:0:22480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16322 00000100:00100000:2.0:1746129573.253528:0:21725:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ada2ffba-8920-4ecb-8068-68caa9806978+35:1963:x1830948734185728:12345-192.168.202.4@tcp:4:cat.0 Request processed in 4877us (5106us total) trans 21474841375 rc 0/0 00000100:00100000:2.0:1746129573.253541:0:21725:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2442 00002000:00100000:2.0:1746129573.253554:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ef:0x0] (3043328->3145727) req@ffff880094eff480 x1830948734185728/t21474841375(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:314/0 lens 488/448 e 0 to 0 dl 1746129584 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129573.253563:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094eff480 with x1830948734185728 ext(3043328->3145727) 00010000:00010000:2.0:1746129573.253574:0:21725:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fd29200/0x40a459093b06a399 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [3043328->3145727] (req 3043328->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f213e3 expref: 35 pid: 7148 timeout: 928 lvb_type: 0 00010000:00010000:2.0:1746129573.253590:0:21725:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fd29200/0x40a459093b06a399 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [3043328->3145727] (req 3043328->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f213e3 expref: 35 pid: 7148 timeout: 928 lvb_type: 0 00002000:00010000:2.0:1746129573.253597:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094eff480 00000100:00100000:0.0:1746129573.259713:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129573.259819:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129573.260011:0:7086:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734185856 00000100:00100000:1.0:1746129573.260020:0:7086:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734185856 00010000:00010000:1.0:1746129573.260060:0:7086:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd29200/0x40a459093b06a399 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [3043328->3145727] (req 3043328->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f213e3 expref: 35 pid: 7148 timeout: 928 lvb_type: 0 00000100:00100000:1.0:1746129573.260097:0:7086:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8373 00000100:00100000:1.0:1746129573.260105:0:7086:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094effb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ada2ffba-8920-4ecb-8068-68caa9806978+35:1962:x1830948734185856:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129573.260117:0:7086:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129573.260140:0:7086:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fd29200/0x40a459093b06a399 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [3043328->3145727] (req 3043328->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f213e3 expref: 35 pid: 7148 timeout: 928 lvb_type: 0 00010000:00010000:1.0:1746129573.260151:0:7086:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fd29200/0x40a459093b06a399 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [3043328->3145727] (req 3043328->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f213e3 expref: 35 pid: 7148 timeout: 928 lvb_type: 0 00010000:00010000:1.0:1746129573.260174:0:7086:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fd29200/0x40a459093b06a399 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [3043328->3145727] (req 3043328->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f213e3 expref: 35 pid: 7148 timeout: 928 lvb_type: 0 00010000:00010000:1.0:1746129573.260195:0:7086:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129573.260197:0:7086:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129573.260204:0:7086:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800952f6e00/0x40a459093b06a3fb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21437 expref: 34 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129573.260212:0:7086:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800952f6e00/0x40a459093b06a3fb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21437 expref: 34 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129573.260254:0:7086:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800952f6e00/0x40a459093b06a3fb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21437 expref: 34 pid: 4385 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129573.260267:0:7086:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b553100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7086:1830948737539712:192.168.202.4@tcp:105: 00000100:00100000:1.0:1746129573.260391:0:7086:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934d2780 going to sleep for 11 seconds 00000100:00100000:2.0:1746129573.262094:0:21725:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734186112 00000100:00100000:2.0:1746129573.262105:0:21725:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734186112 00002000:00100000:2.0:1746129573.262153:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ec:0x0] (0->1048575) req@ffff880094efd500 x1830948734186112/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:314/0 lens 488/0 e 0 to 0 dl 1746129584 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129573.262162:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094efd500 with x1830948734186112 ext(0->1048575) 00002000:00010000:2.0:1746129573.262168:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094efd500 00000100:00100000:2.0:1746129573.262209:0:21725:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7865 00000100:00100000:2.0:1746129573.262216:0:21725:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094efd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+19:1961:x1830948734186112:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:1.0:1746129573.265758:0:7086:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b553100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7086:1830948737539712:192.168.202.4@tcp:105: 00010000:00010000:1.0:1746129573.265785:0:7086:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129573.265835:0:7086:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094effb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ada2ffba-8920-4ecb-8068-68caa9806978+34:1962:x1830948734185856:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 5728us (6131us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129573.265847:0:7086:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8373 00000100:00100000:0.0:1746129573.272591:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129573.272627:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129573.272641:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129573.272662:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129573.272722:0:8416:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734186368 00000100:00100000:3.0:1746129573.272734:0:8416:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734186368 00002000:00100000:3.0:1746129573.272788:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3ef:0x0] (2097152->3145727) req@ffff880094efc000 x1830948734186368/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:314/0 lens 488/0 e 0 to 0 dl 1746129584 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129573.272799:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094efc000 with x1830948734186368 ext(2097152->3145727) 00002000:00010000:3.0:1746129573.272805:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094efc000 00000100:00100000:3.0:1746129573.272831:0:8416:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734186624 00000100:00100000:3.0:1746129573.272835:0:8416:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734186624 00002000:00100000:3.0:1746129573.272850:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->4194303) req@ffff880093ceea00 x1830948734186624/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:314/0 lens 488/0 e 0 to 0 dl 1746129584 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129573.272857:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ceea00 with x1830948734186624 ext(3145728->4194303) 00002000:00010000:3.0:1746129573.272860:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093ceea00 00000100:00100000:3.0:1746129573.272897:0:8416:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734186880 00000100:00100000:3.0:1746129573.272901:0:8416:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734186880 00002000:00100000:3.0:1746129573.272920:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3f5:0x0] (2134016->3182591) req@ffff880093cece00 x1830948734186880/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:314/0 lens 488/0 e 0 to 0 dl 1746129584 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129573.272927:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093cece00 with x1830948734186880 ext(2134016->3182591) 00002000:00010000:3.0:1746129573.272930:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093cece00 00000100:00100000:3.0:1746129573.272943:0:8416:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734187136 00000100:00100000:3.0:1746129573.272947:0:8416:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734187136 00002000:00100000:3.0:1746129573.272963:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3f5:0x0] (3182592->4194303) req@ffff880093cedf80 x1830948734187136/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:314/0 lens 488/0 e 0 to 0 dl 1746129584 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129573.272969:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093cedf80 with x1830948734187136 ext(3182592->4194303) 00002000:00010000:3.0:1746129573.272972:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093cedf80 00000100:00100000:3.0:1746129573.272987:0:8416:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7866 00000100:00100000:3.0:1746129573.272996:0:8416:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094efc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ada2ffba-8920-4ecb-8068-68caa9806978+35:1962:x1830948734186368:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129573.273085:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7867 00000100:00100000:0.0:1746129573.273092:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ceea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+35:1962:x1830948734186624:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:2.0:1746129573.274040:0:21725:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094efd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+19:1961:x1830948734186112:12345-192.168.202.4@tcp:3:cat.0 Request processed in 11819us (14216us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129573.274050:0:21725:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7865 00002000:00100000:2.0:1746129573.274059:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ec:0x0] (0->1048575) req@ffff880094efd500 x1830948734186112/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:314/0 lens 488/440 e 0 to 0 dl 1746129584 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129573.274322:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094efd500 with x1830948734186112 ext(0->1048575) 00002000:00010000:2.0:1746129573.274327:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094efd500 00000100:00100000:3.0:1746129573.276144:0:31521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7868 00000100:00100000:3.0:1746129573.276170:0:31521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ada2ffba-8920-4ecb-8068-68caa9806978+35:1962:x1830948734186880:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:2.0:1746129573.276474:0:21725:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7869 00000100:00100000:2.0:1746129573.276484:0:21725:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ada2ffba-8920-4ecb-8068-68caa9806978+35:1962:x1830948734187136:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:2.0:1746129573.295658:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ceea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+36:1962:x1830948734186624:12345-192.168.202.4@tcp:3:cat.0 Request processed in 22554us (23018us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129573.295671:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7867 00002000:00100000:2.0:1746129573.295686:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->4194303) req@ffff880093ceea00 x1830948734186624/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:314/0 lens 488/440 e 0 to 0 dl 1746129584 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129573.295695:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ceea00 with x1830948734186624 ext(3145728->4194303) 00002000:00010000:2.0:1746129573.295701:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093ceea00 00000100:00100000:3.0:1746129573.303571:0:31521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ada2ffba-8920-4ecb-8068-68caa9806978+36:1962:x1830948734186880:12345-192.168.202.4@tcp:3:cat.0 Request processed in 27403us (30916us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129573.303583:0:31521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7868 00002000:00100000:3.0:1746129573.303596:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f5:0x0] (2134016->3182591) req@ffff880093cece00 x1830948734186880/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:314/0 lens 488/440 e 0 to 0 dl 1746129584 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129573.303606:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093cece00 with x1830948734186880 ext(2134016->3182591) 00002000:00010000:3.0:1746129573.303612:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093cece00 00000100:00100000:2.0:1746129573.309262:0:21725:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ada2ffba-8920-4ecb-8068-68caa9806978+34:1962:x1830948734187136:12345-192.168.202.4@tcp:3:cat.0 Request processed in 32769us (36587us total) trans 0 rc 1011712/1011712 00000100:00100000:2.0:1746129573.309276:0:21725:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7869 00002000:00100000:2.0:1746129573.309315:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f5:0x0] (3182592->4194303) req@ffff880093cedf80 x1830948734187136/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:314/0 lens 488/440 e 0 to 0 dl 1746129584 ref 1 fl Complete:/200/0 rc 1011712/1011712 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129573.309327:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093cedf80 with x1830948734187136 ext(3182592->4194303) 00002000:00010000:2.0:1746129573.309333:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093cedf80 00000100:00100000:0.0:1746129573.310585:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129573.310873:0:22480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734187264 00000100:00100000:3.0:1746129573.310882:0:22480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734187264 00000100:00100000:3.0:1746129573.310924:0:22480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16323 00000100:00100000:3.0:1746129573.310931:0:22480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+19:32380:x1830948734187264:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129573.310950:0:22480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129573.310969:0:22480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800952f7e00/0x40a459093b06a417 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21453 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129573.310994:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129573.310996:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129573.311004:0:22480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800952f7e00/0x40a459093b06a417 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21453 expref: 20 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129573.311019:0:22480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800952f7e00/0x40a459093b06a417 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21453 expref: 20 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129573.311030:0:22480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800952f7e00, rc 0) 00000100:00100000:3.0:1746129573.312758:0:22480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:32380:x1830948734187264:12345-192.168.202.4@tcp:101:cat.0 Request processed in 1815us (2168us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129573.312769:0:22480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16323 00000100:00100000:3.0:1746129573.314487:0:8416:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094efc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ada2ffba-8920-4ecb-8068-68caa9806978+34:1962:x1830948734186368:12345-192.168.202.4@tcp:3:cat.0 Request processed in 41484us (41898us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129573.314496:0:8416:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7866 00002000:00100000:3.0:1746129573.314508:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3ef:0x0] (2097152->3145727) req@ffff880094efc000 x1830948734186368/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:314/0 lens 488/440 e 0 to 0 dl 1746129584 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129573.314518:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094efc000 with x1830948734186368 ext(2097152->3145727) 00002000:00010000:3.0:1746129573.314524:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094efc000 00000100:00100000:0.0:1746129573.330216:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129573.330444:0:8416:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734187520 00000100:00100000:3.0:1746129573.330456:0:8416:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734187520 00002000:00100000:3.0:1746129573.330507:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3ef:0x0] (4194304->5148671) req@ffff880093cec700 x1830948734187520/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:314/0 lens 488/0 e 0 to 0 dl 1746129584 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129573.330633:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093cec700 with x1830948734187520 ext(4194304->5148671) 00002000:00010000:3.0:1746129573.330640:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093cec700 00000100:00100000:3.0:1746129573.330679:0:8416:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7870 00000100:00100000:3.0:1746129573.330687:0:8416:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ada2ffba-8920-4ecb-8068-68caa9806978+34:1962:x1830948734187520:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129573.331235:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129573.331275:0:31521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734187776 00000100:00100000:0.0:1746129573.331280:0:31521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734187776 00002000:00100000:0.0:1746129573.331344:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3ef:0x0] (2097152->3145727) req@ffff880093cedc00 x1830948734187776/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:314/0 lens 488/0 e 0 to 0 dl 1746129584 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129573.331352:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093cedc00 with x1830948734187776 ext(2097152->3145727) 00002000:00010000:0.0:1746129573.331355:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093cedc00 00000100:00100000:0.0:1746129573.331369:0:31521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7871 00000100:00100000:0.0:1746129573.331374:0:31521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:1962:x1830948734187776:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129573.351661:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129573.352078:0:22480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734187904 00000100:00100000:3.0:1746129573.352089:0:22480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734187904 00000100:00100000:3.0:1746129573.352139:0:22480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16324 00000100:00100000:3.0:1746129573.352147:0:22480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ced500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ada2ffba-8920-4ecb-8068-68caa9806978+36:32376:x1830948734187904:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:3.0:1746129573.352168:0:22480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129573.352189:0:22480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800952f7800/0x40a459093b06a41e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2145a expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129573.352221:0:22480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880136b1c600/0x40a459093b06a361 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f213b9 expref: 21 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129573.352229:0:22480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fd28400/0x40a459093b06a376 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f213ce expref: 37 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129573.352236:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129573.352238:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129573.352241:0:22480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800952f7800/0x40a459093b06a41e lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [2039808->2097151] (req 2039808->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2145a expref: 37 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129573.352273:0:22480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fd28400/0x40a459093b06a376 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f213ce expref: 37 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129573.352285:0:22480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fd28400/0x40a459093b06a376 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f213ce expref: 37 pid: 22480 timeout: 928 lvb_type: 1 00000100:00100000:3.0:1746129573.352339:0:22480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947be680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22480:1830948737539840:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129573.355769:0:31521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:1962:x1830948734187776:12345-192.168.202.4@tcp:3:cat.0 Request processed in 24380us (24520us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129573.355783:0:31521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7871 00002000:00100000:1.0:1746129573.355799:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3ef:0x0] (2097152->3145727) req@ffff880093cedc00 x1830948734187776/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:314/0 lens 488/440 e 0 to 0 dl 1746129584 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129573.355808:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093cedc00 with x1830948734187776 ext(2097152->3145727) 00002000:00010000:1.0:1746129573.355814:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093cedc00 00010000:00010000:3.0:1746129573.355858:0:22480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880136b1c600/0x40a459093b06a361 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f213b9 expref: 19 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129573.355875:0:22480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880136b1c600/0x40a459093b06a361 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f213b9 expref: 19 pid: 7148 timeout: 928 lvb_type: 0 00000100:00100000:3.0:1746129573.355891:0:22480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22480:1830948737539968:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129573.355918:0:22480:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5ac9f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746129573.362443:0:8416:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ada2ffba-8920-4ecb-8068-68caa9806978+36:1962:x1830948734187520:12345-192.168.202.4@tcp:3:cat.0 Request processed in 31742us (32224us total) trans 0 rc 954368/954368 00000100:00100000:3.0:1746129573.362457:0:8416:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7870 00002000:00100000:3.0:1746129573.362472:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3ef:0x0] (4194304->5148671) req@ffff880093cec700 x1830948734187520/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:314/0 lens 488/440 e 0 to 0 dl 1746129584 ref 1 fl Complete:/200/0 rc 954368/954368 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129573.362482:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093cec700 with x1830948734187520 ext(4194304->5148671) 00002000:00010000:3.0:1746129573.362488:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093cec700 00000100:00100000:0.0:1746129573.363584:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129573.363631:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129573.363641:0:22480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947be680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22480:1830948737539840:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129573.363650:0:22480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22480:1830948737539968:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129573.363658:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00010000:00010000:3.0:1746129573.363687:0:22480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800952f7800/0x40a459093b06a41e lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [2039808->2097151] (req 2039808->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2145a expref: 35 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129573.363705:0:22480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800952f7800, rc 0) 00000100:00100000:0.0:1746129573.363706:0:7086:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734188160 00000100:00100000:0.0:1746129573.363712:0:7086:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734188160 00000100:00100000:3.0:1746129573.363731:0:22480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ced500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ada2ffba-8920-4ecb-8068-68caa9806978+36:32376:x1830948734187904:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 11585us (12081us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129573.363737:0:22480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16324 00010000:00010000:0.0:1746129573.363737:0:7086:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd28400/0x40a459093b06a376 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f213ce expref: 36 pid: 22480 timeout: 928 lvb_type: 1 00000100:00100000:3.0:1746129573.363750:0:22480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734188032 00000100:00100000:3.0:1746129573.363753:0:22480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734188032 00000100:00100000:0.0:1746129573.363753:0:7086:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734188288 00000100:00100000:0.0:1746129573.363754:0:7086:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734188288 00010000:00010000:0.0:1746129573.363762:0:7086:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880136b1c600/0x40a459093b06a361 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f213b9 expref: 20 pid: 7148 timeout: 928 lvb_type: 0 00000100:00100000:3.0:1746129573.363767:0:22480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16325 00000100:00100000:3.0:1746129573.363773:0:22480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ceed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+25:32380:x1830948734188032:12345-192.168.202.4@tcp:101:cat.0 00000100:00100000:0.0:1746129573.363774:0:7086:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8374 00000100:00100000:0.0:1746129573.363778:0:7086:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a45850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ada2ffba-8920-4ecb-8068-68caa9806978+35:1961:x1830948734188160:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129573.363786:0:22480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129573.363788:0:7086:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129573.363801:0:22480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800952f7c00/0x40a459093b06a425 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21461 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129573.363808:0:7086:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fd28400/0x40a459093b06a376 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f213ce expref: 35 pid: 22480 timeout: 928 lvb_type: 1 00010000:00010000:3.0:1746129573.363818:0:22480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880136b1c400/0x40a459093b06a3ae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2134015) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f213f8 expref: 33 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129573.363821:0:7086:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fd28400/0x40a459093b06a376 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f213ce expref: 35 pid: 22480 timeout: 928 lvb_type: 1 00010000:00010000:3.0:1746129573.363824:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129573.363826:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129573.363829:0:22480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800952f7c00/0x40a459093b06a425 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21461 expref: 26 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129573.363838:0:7086:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fd28400/0x40a459093b06a376 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f213ce expref: 35 pid: 22480 timeout: 928 lvb_type: 1 00010000:00010000:3.0:1746129573.363850:0:22480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880136b1c400/0x40a459093b06a3ae lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2134015) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f213f8 expref: 33 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129573.363851:0:7086:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746129573.363860:0:22480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880136b1c400/0x40a459093b06a3ae lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2134015) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f213f8 expref: 33 pid: 4699 timeout: 928 lvb_type: 0 00000100:00100000:0.0:1746129573.363864:0:7086:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a45850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ada2ffba-8920-4ecb-8068-68caa9806978+34:1961:x1830948734188160:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 86us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129573.363870:0:7086:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8374 00000100:00100000:3.0:1746129573.363875:0:22480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22480:1830948737540096:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129573.363902:0:7086:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8375 00000100:00100000:0.0:1746129573.363906:0:7086:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ced880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:1961:x1830948734188288:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129573.363914:0:7086:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129573.363921:0:7086:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880136b1c600/0x40a459093b06a361 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f213b9 expref: 20 pid: 7148 timeout: 928 lvb_type: 0 00000100:00100000:3.0:1746129573.363924:0:22480:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5ac9f00 going to sleep for 11 seconds 00010000:00010000:0.0:1746129573.363928:0:7086:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880136b1c600/0x40a459093b06a361 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f213b9 expref: 20 pid: 7148 timeout: 928 lvb_type: 0 00010000:00010000:0.0:1746129573.363939:0:7086:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136b1c600/0x40a459093b06a361 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f213b9 expref: 20 pid: 7148 timeout: 928 lvb_type: 0 00010000:00010000:0.0:1746129573.363955:0:7086:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129573.363959:0:7086:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129573.363965:0:7086:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800952f7800/0x40a459093b06a41e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2039808->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2145a expref: 33 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129573.363973:0:7086:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800952f7800/0x40a459093b06a41e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2039808->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2145a expref: 33 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129573.363991:0:7086:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800952f7800/0x40a459093b06a41e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2039808->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2145a expref: 33 pid: 22480 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129573.364000:0:7086:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ceca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7086:1830948737540224:192.168.202.4@tcp:105: 00000100:00100000:0.0:1746129573.364018:0:7086:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a6ce8f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746129573.366674:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129573.366769:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734188416 00000100:00100000:1.0:1746129573.366778:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734188416 00000100:00100000:1.0:1746129573.366822:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16326 00000100:00100000:1.0:1746129573.366829:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093edd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ada2ffba-8920-4ecb-8068-68caa9806978+34:1960:x1830948734188416:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129573.366848:0:4385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129573.366865:0:4385:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800953dce00/0x40a459093b06a42c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21468 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129573.366925:0:4385:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b553100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:4385:1830948737540352:192.168.202.4@tcp:106: 00000100:00100000:1.0:1746129573.366997:0:4385:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934d2780 going to sleep for 11 seconds 00000100:00100000:1.0:1746129573.368597:0:7086:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ceca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7086:1830948737540224:192.168.202.4@tcp:105: 00010000:00010000:1.0:1746129573.368618:0:7086:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129573.368656:0:7086:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ced880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+19:1961:x1830948734188288:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 4747us (4994us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129573.368665:0:7086:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8375 00000100:00100000:3.0:1746129573.368754:0:22480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22480:1830948737540096:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129573.368781:0:22480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800952f7c00/0x40a459093b06a425 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21461 expref: 26 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129573.368794:0:22480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800952f7c00, rc 0) 00000100:00100000:3.0:1746129573.368815:0:22480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ceed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+26:32380:x1830948734188032:12345-192.168.202.4@tcp:101:cat.0 Request processed in 5042us (5235us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129573.368821:0:22480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16325 00000100:00100000:0.0:1746129573.369759:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129573.369911:0:8416:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734188544 00000100:00100000:3.0:1746129573.369919:0:8416:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734188544 00002000:00100000:3.0:1746129573.369968:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3f5:0x0] (2097152->2134015) req@ffff88008f448000 x1830948734188544/t0(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:314/0 lens 488/0 e 0 to 0 dl 1746129584 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129573.369978:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f448000 with x1830948734188544 ext(2097152->2134015) 00010000:00010000:3.0:1746129573.369986:0:8416:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880136b1c400/0x40a459093b06a3ae lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2134015) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f213f8 expref: 34 pid: 4699 timeout: 928 lvb_type: 0 00010000:00010000:3.0:1746129573.369998:0:8416:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880136b1c400/0x40a459093b06a3ae lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2134015) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f213f8 expref: 34 pid: 4699 timeout: 928 lvb_type: 0 00002000:00010000:3.0:1746129573.370004:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008f448000 00000100:00100000:3.0:1746129573.370031:0:8416:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2443 00000100:00100000:3.0:1746129573.370038:0:8416:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f448000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ada2ffba-8920-4ecb-8068-68caa9806978+34:1963:x1830948734188544:12345-192.168.202.4@tcp:4:multiop.0 00000100:00100000:2.0:1746129573.371551:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129573.371686:0:31521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734188800 00000100:00100000:1.0:1746129573.371693:0:31521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734188800 00002000:00100000:1.0:1746129573.371732:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3ee:0x0] (2039808->2043903) req@ffff8800912adf80 x1830948734188800/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:314/0 lens 488/0 e 0 to 0 dl 1746129584 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129573.371741:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800912adf80 with x1830948734188800 ext(2039808->2043903) 00002000:00010000:1.0:1746129573.371745:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800912adf80 00000100:00100000:1.0:1746129573.371763:0:31521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7872 00000100:00100000:1.0:1746129573.371769:0:31521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800912adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ada2ffba-8920-4ecb-8068-68caa9806978+36:1963:x1830948734188800:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:1.0:1746129573.371947:0:31521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800912adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ada2ffba-8920-4ecb-8068-68caa9806978+36:1963:x1830948734188800:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 176us (403us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746129573.371953:0:31521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7872 00002000:00100000:1.0:1746129573.371958:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3ee:0x0] (2039808->2043903) req@ffff8800912adf80 x1830948734188800/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:314/0 lens 488/4536 e 0 to 0 dl 1746129584 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129573.371965:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800912adf80 with x1830948734188800 ext(2039808->2043903) 00002000:00010000:1.0:1746129573.371967:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800912adf80 00002000:00010000:2.0:1746129573.372048:0:4385:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb mtime: 1746129573 -> 1746129574 00002000:00010000:2.0:1746129573.372051:0:4385:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb atime: 1746129573 -> 1746129574 00002000:00010000:2.0:1746129573.372053:0:4385:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb ctime: 1746129573 -> 1746129574 00000100:00100000:2.0:1746129573.372064:0:4385:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b553100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:4385:1830948737540352:192.168.202.4@tcp:106: 00010000:00010000:2.0:1746129573.372095:0:4385:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800953dce00/0x40a459093b06a42c lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21468 expref: 35 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129573.372106:0:4385:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800953dce00/0x40a459093b06a42c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21468 expref: 35 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129573.372134:0:4385:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800953dce00, rc 0) 00000100:00100000:2.0:1746129573.372161:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093edd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ada2ffba-8920-4ecb-8068-68caa9806978+34:1960:x1830948734188416:12345-192.168.202.4@tcp:101:cat.0 Request processed in 5333us (5498us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129573.372168:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16326 00000100:00100000:3.0:1746129573.373023:0:8416:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f448000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ada2ffba-8920-4ecb-8068-68caa9806978+36:1963:x1830948734188544:12345-192.168.202.4@tcp:4:multiop.0 Request processed in 2978us (3265us total) trans 17179874127 rc 0/0 00000100:00100000:3.0:1746129573.373033:0:8416:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2443 00002000:00100000:3.0:1746129573.373042:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3f5:0x0] (2097152->2134015) req@ffff88008f448000 x1830948734188544/t17179874127(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:314/0 lens 488/448 e 0 to 0 dl 1746129584 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129573.373049:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f448000 with x1830948734188544 ext(2097152->2134015) 00010000:00010000:3.0:1746129573.373058:0:8416:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880136b1c400/0x40a459093b06a3ae lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2134015) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f213f8 expref: 36 pid: 4699 timeout: 928 lvb_type: 0 00010000:00010000:3.0:1746129573.373073:0:8416:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880136b1c400/0x40a459093b06a3ae lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2134015) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f213f8 expref: 36 pid: 4699 timeout: 928 lvb_type: 0 00002000:00010000:3.0:1746129573.373079:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008f448000 00000100:00100000:0.0:1746129573.375161:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129573.375433:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734188928 00000100:00100000:2.0:1746129573.375445:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734188928 00000100:00100000:2.0:1746129573.375526:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16327 00000100:00100000:2.0:1746129573.375537:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f44b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ada2ffba-8920-4ecb-8068-68caa9806978+36:1961:x1830948734188928:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129573.375564:0:4385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129573.375589:0:4385:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136b1c600/0x40a459093b06a433 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2146f expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129573.375692:0:4385:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f95b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:4385:1830948737540480:192.168.202.4@tcp:106: 00000100:00100000:2.0:1746129573.375818:0:4385:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009af1e240 going to sleep for 11 seconds 00002000:00010000:2.0:1746129573.377369:0:4385:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3f5:0x0] updating lvb mtime: 1746129573 -> 1746129574 00002000:00010000:2.0:1746129573.377374:0:4385:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3f5:0x0] updating lvb atime: 1746129573 -> 1746129574 00002000:00010000:2.0:1746129573.377376:0:4385:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3f5:0x0] updating lvb ctime: 1746129573 -> 1746129574 00000100:00100000:2.0:1746129573.377399:0:4385:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f95b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:4385:1830948737540480:192.168.202.4@tcp:106: 00010000:00010000:2.0:1746129573.377435:0:4385:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880136b1c600/0x40a459093b06a433 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2146f expref: 37 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129573.377447:0:4385:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136b1c600/0x40a459093b06a433 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2146f expref: 37 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129573.377458:0:4385:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136b1c600, rc 0) 00000100:00100000:2.0:1746129573.377707:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f44b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ada2ffba-8920-4ecb-8068-68caa9806978+36:1961:x1830948734188928:12345-192.168.202.4@tcp:101:cat.0 Request processed in 2171us (2552us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129573.377716:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16327 00000100:00100000:2.0:1746129573.382882:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129573.382962:0:7086:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734189056 00000100:00100000:1.0:1746129573.382972:0:7086:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734189056 00010000:00010000:1.0:1746129573.383009:0:7086:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880136b1c400/0x40a459093b06a3ae lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2134015) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f213f8 expref: 36 pid: 4699 timeout: 928 lvb_type: 0 00000100:00100000:1.0:1746129573.383033:0:7086:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8376 00000100:00100000:1.0:1746129573.383040:0:7086:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f95b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ada2ffba-8920-4ecb-8068-68caa9806978+36:1963:x1830948734189056:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129573.383053:0:7086:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129573.383074:0:7086:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880136b1c400/0x40a459093b06a3ae lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2134015) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f213f8 expref: 36 pid: 4699 timeout: 928 lvb_type: 0 00010000:00010000:1.0:1746129573.383085:0:7086:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880136b1c400/0x40a459093b06a3ae lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2134015) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f213f8 expref: 36 pid: 4699 timeout: 928 lvb_type: 0 00010000:00010000:1.0:1746129573.383107:0:7086:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136b1c400/0x40a459093b06a3ae lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2134015) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f213f8 expref: 36 pid: 4699 timeout: 928 lvb_type: 0 00000100:00100000:0.0:1746129573.383957:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129573.384101:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734189184 00000100:00100000:2.0:1746129573.384106:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734189184 00010000:00010000:1.0:1746129573.386424:0:7086:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129573.386429:0:7086:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129573.386445:0:7086:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800952f7c00/0x40a459093b06a425 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21461 expref: 25 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129573.386457:0:7086:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800952f7c00/0x40a459093b06a425 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21461 expref: 25 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129573.386506:0:7086:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800952f7c00/0x40a459093b06a425 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21461 expref: 25 pid: 22480 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129573.386518:0:7086:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b552680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7086:1830948737540608:192.168.202.4@tcp:105: 00000100:00100000:1.0:1746129573.386602:0:7086:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934d2240 going to sleep for 11 seconds 00000100:00100000:2.0:1746129573.387067:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16328 00000100:00100000:2.0:1746129573.387081:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ada2ffba-8920-4ecb-8068-68caa9806978+34:32376:x1830948734189184:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:2.0:1746129573.387096:0:4385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129573.387112:0:4385:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fd29200/0x40a459093b06a43a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21476 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129573.387137:0:4385:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800952f6e00/0x40a459093b06a3fb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21437 expref: 35 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129573.387144:0:4385:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800952f7e00/0x40a459093b06a417 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21453 expref: 18 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129573.387149:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129573.387150:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129573.387152:0:4385:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd29200/0x40a459093b06a43a lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [2097152->2871295] (req 2097152->2871295) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21476 expref: 35 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129573.387172:0:4385:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800952f7e00/0x40a459093b06a417 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21453 expref: 18 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129573.387182:0:4385:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800952f7e00/0x40a459093b06a417 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21453 expref: 18 pid: 22480 timeout: 928 lvb_type: 0 00000100:00100000:2.0:1746129573.387189:0:4385:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fbafb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:4385:1830948737540736:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129573.387218:0:4385:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800952f6e00/0x40a459093b06a3fb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21437 expref: 35 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129573.387225:0:4385:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800952f6e00/0x40a459093b06a3fb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21437 expref: 35 pid: 4385 timeout: 928 lvb_type: 0 00000100:00100000:2.0:1746129573.387231:0:4385:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fbac700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:4385:1830948737540864:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129573.387243:0:4385:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009af1e240 going to sleep for 11 seconds 00000100:00100000:2.0:1746129573.390029:0:4385:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fbafb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:4385:1830948737540736:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129573.390057:0:4385:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fbac700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:4385:1830948737540864:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129573.390092:0:4385:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fd29200/0x40a459093b06a43a lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [2097152->2871295] (req 2097152->2871295) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21476 expref: 35 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129573.390108:0:4385:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd29200, rc 0) 00000100:00100000:1.0:1746129573.390476:0:7086:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b552680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7086:1830948737540608:192.168.202.4@tcp:105: 00010000:00010000:1.0:1746129573.390489:0:7086:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129573.390788:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ada2ffba-8920-4ecb-8068-68caa9806978+35:32376:x1830948734189184:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 3711us (6833us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129573.390788:0:7086:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f95b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ada2ffba-8920-4ecb-8068-68caa9806978+35:1963:x1830948734189056:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 7746us (7913us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129573.390798:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16328 00000100:00100000:1.0:1746129573.390798:0:7086:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8376 00000100:00100000:2.0:1746129573.390864:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129573.390898:0:7086:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734189312 00000100:00100000:1.0:1746129573.390904:0:7086:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734189312 00010000:00010000:1.0:1746129573.390926:0:7086:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800952f7e00/0x40a459093b06a417 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21453 expref: 19 pid: 22480 timeout: 928 lvb_type: 0 00000100:00100000:1.0:1746129573.394144:0:7086:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8377 00000100:00100000:1.0:1746129573.394168:0:7086:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+19:1961:x1830948734189312:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129573.394192:0:7086:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129573.394223:0:7086:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800952f7e00/0x40a459093b06a417 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21453 expref: 19 pid: 22480 timeout: 928 lvb_type: 0 00010000:00010000:1.0:1746129573.394239:0:7086:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800952f7e00/0x40a459093b06a417 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21453 expref: 19 pid: 22480 timeout: 928 lvb_type: 0 00010000:00010000:1.0:1746129573.394265:0:7086:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800952f7e00/0x40a459093b06a417 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21453 expref: 19 pid: 22480 timeout: 928 lvb_type: 0 00010000:00010000:1.0:1746129573.394499:0:7086:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129573.394563:0:7086:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+18:1961:x1830948734189312:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 406us (3698us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129573.394573:0:7086:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8377 00000100:00100000:0.0:1746129573.396353:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129573.396392:0:7086:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734189440 00000100:00100000:1.0:1746129573.396402:0:7086:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734189440 00010000:00010000:1.0:1746129573.396436:0:7086:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800952f6e00/0x40a459093b06a3fb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21437 expref: 35 pid: 4385 timeout: 928 lvb_type: 0 00000100:00100000:1.0:1746129573.396481:0:7086:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8378 00000100:00100000:1.0:1746129573.396487:0:7086:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a77b3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ada2ffba-8920-4ecb-8068-68caa9806978+35:1962:x1830948734189440:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129573.396500:0:7086:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129573.396523:0:7086:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800952f6e00/0x40a459093b06a3fb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21437 expref: 35 pid: 4385 timeout: 928 lvb_type: 0 00010000:00010000:1.0:1746129573.396533:0:7086:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800952f6e00/0x40a459093b06a3fb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21437 expref: 35 pid: 4385 timeout: 928 lvb_type: 0 00010000:00010000:1.0:1746129573.396555:0:7086:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800952f6e00/0x40a459093b06a3fb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21437 expref: 35 pid: 4385 timeout: 928 lvb_type: 0 00010000:00010000:1.0:1746129573.396571:0:7086:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129573.396573:0:7086:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129573.396580:0:7086:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fd29200/0x40a459093b06a43a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2871295) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21476 expref: 34 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129573.396588:0:7086:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd29200/0x40a459093b06a43a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2871295) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21476 expref: 34 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129573.396628:0:7086:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009fd29200/0x40a459093b06a43a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2871295) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21476 expref: 34 pid: 4385 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129573.396642:0:7086:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b552680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7086:1830948737540992:192.168.202.4@tcp:105: 00000100:00100000:1.0:1746129573.396739:0:7086:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934d2240 going to sleep for 11 seconds 00000100:00100000:0.0:1746129573.400646:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129573.400691:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129573.400730:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129573.400874:0:31521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734189696 00000100:00100000:1.0:1746129573.400884:0:31521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734189696 00002000:00100000:1.0:1746129573.400934:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f5:0x0] (2097152->3145727) req@ffff880094effb80 x1830948734189696/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:314/0 lens 488/0 e 0 to 0 dl 1746129584 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129573.400944:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094effb80 with x1830948734189696 ext(2097152->3145727) 00002000:00010000:1.0:1746129573.400950:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094effb80 00000100:00100000:1.0:1746129573.400965:0:31521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734189952 00000100:00100000:1.0:1746129573.400967:0:31521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734189952 00002000:00100000:1.0:1746129573.400977:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f5:0x0] (3145728->4194303) req@ffff880092fd3480 x1830948734189952/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:314/0 lens 488/0 e 0 to 0 dl 1746129584 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129573.400983:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092fd3480 with x1830948734189952 ext(3145728->4194303) 00002000:00010000:1.0:1746129573.400986:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092fd3480 00000100:00100000:1.0:1746129573.400993:0:31521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734190208 00000100:00100000:1.0:1746129573.400995:0:31521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734190208 00002000:00100000:1.0:1746129573.401005:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->4194303) req@ffff880092fd1c00 x1830948734190208/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:314/0 lens 488/0 e 0 to 0 dl 1746129584 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129573.401012:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092fd1c00 with x1830948734190208 ext(3145728->4194303) 00002000:00010000:1.0:1746129573.401016:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092fd1c00 00000100:00100000:1.0:1746129573.401027:0:31521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7873 00000100:00100000:1.0:1746129573.401034:0:31521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094effb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+27:1960:x1830948734189696:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129573.401846:0:31523:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7874 00000100:00100000:0.0:1746129573.401858:0:31523:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092fd3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+28:1960:x1830948734189952:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:1.0:1746129573.402445:0:21725:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7875 00000100:00100000:1.0:1746129573.402454:0:21725:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092fd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+18:1960:x1830948734190208:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:1.0:1746129573.404637:0:7086:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b552680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7086:1830948737540992:192.168.202.4@tcp:105: 00010000:00010000:1.0:1746129573.404661:0:7086:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129573.404693:0:7086:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a77b3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ada2ffba-8920-4ecb-8068-68caa9806978+34:1962:x1830948734189440:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 8205us (8409us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129573.404703:0:7086:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8378 00000100:00100000:2.0:1746129573.408180:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129573.408485:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734190464 00000100:00100000:3.0:1746129573.408494:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734190464 00002000:00100000:3.0:1746129573.408544:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ef:0x0] (2867200->2871295) req@ffff88009fbafb80 x1830948734190464/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:314/0 lens 488/0 e 0 to 0 dl 1746129584 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129573.408555:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbafb80 with x1830948734190464 ext(2867200->2871295) 00002000:00010000:3.0:1746129573.408561:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fbafb80 00000100:00100000:3.0:1746129573.408595:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7876 00000100:00100000:3.0:1746129573.408603:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+34:1960:x1830948734190464:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:3.0:1746129573.408839:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+34:1960:x1830948734190464:12345-192.168.202.4@tcp:3:cat.0 Request processed in 236us (671us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129573.408846:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7876 00002000:00100000:3.0:1746129573.408853:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ef:0x0] (2867200->2871295) req@ffff88009fbafb80 x1830948734190464/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:314/0 lens 488/4536 e 0 to 0 dl 1746129584 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129573.408860:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbafb80 with x1830948734190464 ext(2867200->2871295) 00002000:00010000:3.0:1746129573.408863:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fbafb80 00000100:00100000:1.0:1746129573.413688:0:31521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094effb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+28:1960:x1830948734189696:12345-192.168.202.4@tcp:3:cat.0 Request processed in 12641us (13039us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129573.413702:0:31521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7873 00002000:00100000:1.0:1746129573.413719:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f5:0x0] (2097152->3145727) req@ffff880094effb80 x1830948734189696/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:314/0 lens 488/440 e 0 to 0 dl 1746129584 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129573.413728:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094effb80 with x1830948734189696 ext(2097152->3145727) 00002000:00010000:1.0:1746129573.413733:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094effb80 00000100:00100000:2.0:1746129573.417844:0:31523:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092fd3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+26:1960:x1830948734189952:12345-192.168.202.4@tcp:3:cat.0 Request processed in 15975us (17137us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129573.418070:0:31523:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7874 00002000:00100000:2.0:1746129573.418084:0:31523:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f5:0x0] (3145728->4194303) req@ffff880092fd3480 x1830948734189952/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:314/0 lens 488/440 e 0 to 0 dl 1746129584 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129573.418095:0:31523:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092fd3480 with x1830948734189952 ext(3145728->4194303) 00002000:00010000:2.0:1746129573.418102:0:31523:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092fd3480 00000100:00100000:1.0:1746129573.420774:0:21725:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092fd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+18:1960:x1830948734190208:12345-192.168.202.4@tcp:3:cat.0 Request processed in 18308us (20030us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129573.420787:0:21725:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7875 00002000:00100000:1.0:1746129573.420798:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->4194303) req@ffff880092fd1c00 x1830948734190208/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:314/0 lens 488/440 e 0 to 0 dl 1746129584 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129573.420808:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092fd1c00 with x1830948734190208 ext(3145728->4194303) 00002000:00010000:1.0:1746129573.420814:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092fd1c00 00000100:00100000:0.0:1746129573.426638:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129573.426701:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129573.426800:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734190592 00000100:00100000:2.0:1746129573.426810:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734190592 00000100:00100000:2.0:1746129573.426855:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734190720 00000100:00100000:2.0:1746129573.426857:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734190720 00000100:00100000:2.0:1746129573.426889:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16329 00000100:00100000:2.0:1746129573.426897:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092fd1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+19:1962:x1830948734190592:12345-192.168.202.4@tcp:101:cat.0 00000100:00100000:3.0:1746129573.426918:0:22480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16330 00010000:00010000:2.0:1746129573.426920:0:4385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746129573.426928:0:22480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092fd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+19:1963:x1830948734190720:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129573.426935:0:22480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129573.426940:0:4385:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fd28400/0x40a459093b06a441 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2147d expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129573.426944:0:22480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800946f1c00/0x40a459093b06a448 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21484 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129573.426971:0:22480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800946f1c00/0x40a459093b06a448 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21484 expref: 21 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129573.426980:0:22480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800946f1c00/0x40a459093b06a448 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21484 expref: 21 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129573.426996:0:22480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800946f1c00, rc 0) 00000100:00100000:2.0:1746129573.426996:0:4385:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fbadc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:4385:1830948737541120:192.168.202.4@tcp:106: 00000100:00100000:3.0:1746129573.427040:0:22480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092fd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:1963:x1830948734190720:12345-192.168.202.4@tcp:101:cat.0 Request processed in 114us (338us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129573.427045:0:22480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16330 00000100:00100000:2.0:1746129573.427689:0:4385:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009af1e240 going to sleep for 11 seconds 00000100:00100000:2.0:1746129573.428814:0:4385:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fbadc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:4385:1830948737541120:192.168.202.4@tcp:106: 00010000:00010000:2.0:1746129573.428847:0:4385:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fd28400/0x40a459093b06a441 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2147d expref: 19 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129573.428860:0:4385:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fd28400/0x40a459093b06a441 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2147d expref: 19 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129573.428887:0:4385:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd28400, rc 0) 00000100:00100000:2.0:1746129573.428936:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092fd1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+18:1962:x1830948734190592:12345-192.168.202.4@tcp:101:cat.0 Request processed in 2039us (2307us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129573.428944:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16329 00000100:00100000:0.0:1746129573.432091:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129573.432136:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129573.432267:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734190848 00000100:00100000:1.0:1746129573.432271:0:4699:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734190976 00000100:00100000:2.0:1746129573.432278:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734190848 00000100:00100000:1.0:1746129573.432278:0:4699:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734190976 00000100:00100000:0.0:1746129573.432286:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129573.432352:0:4699:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734191104 00000100:00100000:1.0:1746129573.432354:0:4699:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734191104 00000100:00100000:2.0:1746129573.432365:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16331 00000100:00100000:0.0:1746129573.432371:0:31503:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16332 00000100:00100000:2.0:1746129573.432372:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092fd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:1961:x1830948734190976:12345-192.168.202.4@tcp:101:cat.0 00000100:00100000:1.0:1746129573.432376:0:4699:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16333 00000100:00100000:0.0:1746129573.432378:0:31503:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092fd2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:32377:x1830948734190848:12345-192.168.202.4@tcp:101:multiop.0 00000100:00100000:1.0:1746129573.432381:0:4699:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092fd1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:1961:x1830948734191104:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129573.432396:0:4385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129573.432396:0:4699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129573.432396:0:31503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129573.432413:0:4385:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fd28e00/0x40a459093b06a45d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21492 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129573.432413:0:4699:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800953dce00/0x40a459093b06a456 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21499 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129573.432413:0:31503:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f444400/0x40a459093b06a44f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2148b expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129573.432440:0:31503:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fd29200/0x40a459093b06a43a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->2871295) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21476 expref: 33 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129573.432448:0:31503:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129573.432450:0:31503:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129573.432453:0:31503:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f444400/0x40a459093b06a44f lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [3141632->3145727] (req 3141632->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2148b expref: 23 pid: 31503 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129573.432464:0:4385:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fbadc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:4385:1830948737541248:192.168.202.4@tcp:106: 00010000:00010000:1.0:1746129573.432465:0:4699:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800953dce00/0x40a459093b06a456 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21499 expref: 23 pid: 4699 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129573.432473:0:4699:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800953dce00/0x40a459093b06a456 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21499 expref: 23 pid: 4699 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129573.432475:0:31503:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fd29200/0x40a459093b06a43a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->2871295) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21476 expref: 33 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129573.432486:0:31503:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fd29200/0x40a459093b06a43a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2871295) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21476 expref: 33 pid: 4385 timeout: 928 lvb_type: 0 00000100:00100000:0.0:1746129573.432495:0:31503:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e954a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:31503:1830948737541376:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129573.432498:0:4699:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800953dce00, rc 0) 00000100:00100000:2.0:1746129573.432558:0:4385:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009af1e240 going to sleep for 11 seconds 00000100:00100000:0.0:1746129573.432558:0:31503:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a6ce8f00 going to sleep for 11 seconds 00000100:00100000:1.0:1746129573.432641:0:4699:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092fd1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+22:1961:x1830948734191104:12345-192.168.202.4@tcp:101:cat.0 Request processed in 258us (354us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129573.432647:0:4699:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16333 00000100:00100000:3.0:1746129573.434111:0:4385:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fbadc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:4385:1830948737541248:192.168.202.4@tcp:106: 00010000:00010000:3.0:1746129573.434141:0:4385:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fd28e00/0x40a459093b06a45d lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21492 expref: 21 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129573.434152:0:4385:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fd28e00/0x40a459093b06a45d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21492 expref: 21 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129573.434177:0:4385:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd28e00, rc 0) 00000100:00100000:3.0:1746129573.434210:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092fd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:1961:x1830948734190976:12345-192.168.202.4@tcp:101:cat.0 Request processed in 1839us (2074us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129573.434218:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16331 00000100:00100000:0.0:1746129573.434268:0:31503:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e954a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:31503:1830948737541376:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129573.434286:0:31503:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f444400/0x40a459093b06a44f lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [3141632->3145727] (req 3141632->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2148b expref: 19 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129573.434326:0:31503:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f444400, rc 0) 00000100:00100000:0.0:1746129573.434345:0:31503:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092fd2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+19:32377:x1830948734190848:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 1967us (2271us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129573.434354:0:31503:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16332 00000100:00100000:0.0:1746129573.434532:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129573.434708:0:21725:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734191232 00000100:00100000:1.0:1746129573.434715:0:21725:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734191232 00002000:00100000:1.0:1746129573.434748:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ef:0x0] (2097152->2871295) req@ffff88012e954a80 x1830948734191232/t0(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:314/0 lens 488/0 e 0 to 0 dl 1746129584 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129573.434757:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e954a80 with x1830948734191232 ext(2097152->2871295) 00010000:00010000:1.0:1746129573.434769:0:21725:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fd29200/0x40a459093b06a43a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2871295) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21476 expref: 34 pid: 4385 timeout: 928 lvb_type: 0 00010000:00010000:1.0:1746129573.434781:0:21725:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fd29200/0x40a459093b06a43a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2871295) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21476 expref: 34 pid: 4385 timeout: 928 lvb_type: 0 00002000:00010000:1.0:1746129573.434790:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012e954a80 00000100:00100000:1.0:1746129573.434815:0:21725:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2444 00000100:00100000:1.0:1746129573.434825:0:21725:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e954a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ada2ffba-8920-4ecb-8068-68caa9806978+34:1962:x1830948734191232:12345-192.168.202.4@tcp:4:cat.0 00000100:00100000:0.0:1746129573.439416:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129573.439473:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129573.439569:0:31503:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734191488 00000100:00100000:2.0:1746129573.439579:0:31503:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734191488 00000100:00100000:3.0:1746129573.439591:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734191360 00000100:00100000:3.0:1746129573.439595:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734191360 00000100:00100000:2.0:1746129573.439638:0:31503:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16334 00000100:00100000:2.0:1746129573.439646:0:31503:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e957b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:1961:x1830948734191488:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129573.439666:0:31503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129573.439683:0:31503:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d94ec00/0x40a459093b06a464 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f214a7 expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129573.439701:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16335 00000100:00100000:3.0:1746129573.439707:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:1961:x1830948734191360:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129573.439713:0:4385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129573.439719:0:4385:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800946f1400/0x40a459093b06a46b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f214a0 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129573.439719:0:31503:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d94ec00/0x40a459093b06a464 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f214a7 expref: 21 pid: 31503 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129573.439729:0:31503:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d94ec00/0x40a459093b06a464 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f214a7 expref: 21 pid: 31503 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129573.439743:0:31503:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d94ec00, rc 0) 00000100:00100000:2.0:1746129573.439794:0:31503:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e957b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:1961:x1830948734191488:12345-192.168.202.4@tcp:101:cat.0 Request processed in 148us (388us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129573.439800:0:31503:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16334 00000100:00100000:3.0:1746129573.440064:0:4385:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:4385:1830948737541504:192.168.202.4@tcp:106: 00000100:00100000:3.0:1746129573.440124:0:4385:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5ac93c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746129573.447841:0:4385:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:4385:1830948737541504:192.168.202.4@tcp:106: 00010000:00010000:3.0:1746129573.447882:0:4385:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800946f1400/0x40a459093b06a46b lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f214a0 expref: 20 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129573.447898:0:4385:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800946f1400/0x40a459093b06a46b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f214a0 expref: 20 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129573.447914:0:4385:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800946f1400, rc 0) 00000100:00100000:3.0:1746129573.447973:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+19:1961:x1830948734191360:12345-192.168.202.4@tcp:101:cat.0 Request processed in 8265us (8498us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129573.447985:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16335 00000100:00100000:1.0:1746129573.452256:0:21725:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e954a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ada2ffba-8920-4ecb-8068-68caa9806978+36:1962:x1830948734191232:12345-192.168.202.4@tcp:4:cat.0 Request processed in 17419us (17708us total) trans 21474841376 rc 0/0 00000100:00100000:1.0:1746129573.452272:0:21725:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2444 00002000:00100000:1.0:1746129573.452288:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ef:0x0] (2097152->2871295) req@ffff88012e954a80 x1830948734191232/t21474841376(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:314/0 lens 488/448 e 0 to 0 dl 1746129584 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129573.452329:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e954a80 with x1830948734191232 ext(2097152->2871295) 00010000:00010000:1.0:1746129573.452343:0:21725:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fd29200/0x40a459093b06a43a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2871295) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21476 expref: 36 pid: 4385 timeout: 928 lvb_type: 0 00010000:00010000:1.0:1746129573.452363:0:21725:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fd29200/0x40a459093b06a43a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2871295) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21476 expref: 36 pid: 4385 timeout: 928 lvb_type: 0 00002000:00010000:1.0:1746129573.452370:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012e954a80 00000100:00100000:2.0:1746129573.455942:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129573.456662:0:7086:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734191616 00000100:00100000:1.0:1746129573.456674:0:7086:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734191616 00010000:00010000:1.0:1746129573.456725:0:7086:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd29200/0x40a459093b06a43a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2871295) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21476 expref: 36 pid: 4385 timeout: 928 lvb_type: 0 00000100:00100000:1.0:1746129573.456777:0:7086:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8379 00000100:00100000:1.0:1746129573.456786:0:7086:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ada2ffba-8920-4ecb-8068-68caa9806978+36:1962:x1830948734191616:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129573.456804:0:7086:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746129573.456828:0:7086:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb mtime from disk: 1746129573 -> 1746129574 00002000:00010000:1.0:1746129573.456831:0:7086:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb ctime from disk: 1746129573 -> 1746129574 00010000:00010000:1.0:1746129573.456837:0:7086:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fd29200/0x40a459093b06a43a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->2871295) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21476 expref: 36 pid: 4385 timeout: 928 lvb_type: 0 00010000:00010000:1.0:1746129573.456851:0:7086:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fd29200/0x40a459093b06a43a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->2871295) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21476 expref: 36 pid: 4385 timeout: 928 lvb_type: 0 00010000:00010000:1.0:1746129573.456880:0:7086:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fd29200/0x40a459093b06a43a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->2871295) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21476 expref: 36 pid: 4385 timeout: 928 lvb_type: 0 00010000:00010000:1.0:1746129573.456914:0:7086:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129573.456917:0:7086:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129573.456925:0:7086:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f444400/0x40a459093b06a44f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [3141632->3145727] (req 3141632->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2148b expref: 18 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129573.456934:0:7086:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f444400/0x40a459093b06a44f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [3141632->3145727] (req 3141632->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2148b expref: 18 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129573.456970:0:7086:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008f444400/0x40a459093b06a44f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [3141632->3145727] (req 3141632->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2148b expref: 18 pid: 31503 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129573.456983:0:7086:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b552680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7086:1830948737541632:192.168.202.4@tcp:105: 00000100:00100000:1.0:1746129573.457078:0:7086:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934d2240 going to sleep for 11 seconds 00000100:00100000:0.0:1746129573.462257:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129573.462337:0:21725:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734191872 00000100:00100000:2.0:1746129573.462349:0:21725:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734191872 00002000:00100000:2.0:1746129573.462407:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ef:0x0] (3141632->3145727) req@ffff880091b04380 x1830948734191872/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:314/0 lens 488/0 e 0 to 0 dl 1746129584 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129573.462418:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091b04380 with x1830948734191872 ext(3141632->3145727) 00002000:00010000:2.0:1746129573.462426:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091b04380 00000100:00100000:2.0:1746129573.462461:0:21725:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7877 00000100:00100000:2.0:1746129573.462470:0:21725:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+19:1963:x1830948734191872:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:2.0:1746129573.462680:0:21725:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+19:1963:x1830948734191872:12345-192.168.202.4@tcp:3:cat.0 Request processed in 210us (436us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129573.462687:0:21725:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7877 00002000:00100000:2.0:1746129573.462692:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ef:0x0] (3141632->3145727) req@ffff880091b04380 x1830948734191872/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:314/0 lens 488/4536 e 0 to 0 dl 1746129584 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129573.462698:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091b04380 with x1830948734191872 ext(3141632->3145727) 00002000:00010000:2.0:1746129573.462701:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091b04380 00000100:00100000:1.0:1746129573.462867:0:7086:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b552680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7086:1830948737541632:192.168.202.4@tcp:105: 00010000:00010000:1.0:1746129573.462887:0:7086:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129573.462910:0:7086:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ada2ffba-8920-4ecb-8068-68caa9806978+35:1962:x1830948734191616:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 6126us (6980us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129573.462917:0:7086:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8379 00000100:00100000:0.0:1746129573.464927:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129573.465024:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734192000 00000100:00100000:3.0:1746129573.465034:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734192000 00000100:00100000:3.0:1746129573.465168:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16336 00000100:00100000:3.0:1746129573.465178:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+26:32377:x1830948734192000:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:3.0:1746129573.465197:0:4385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129573.465214:0:4385:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800946f0e00/0x40a459093b06a472 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f214ae expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129573.465248:0:4385:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800952f7c00/0x40a459093b06a425 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21461 expref: 27 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129573.465255:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129573.465257:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129573.465260:0:4385:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800946f0e00/0x40a459093b06a472 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [2097152->3071999] (req 2097152->3071999) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f214ae expref: 27 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129573.465710:0:4385:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800952f7c00/0x40a459093b06a425 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21461 expref: 27 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129573.465723:0:4385:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800952f7c00/0x40a459093b06a425 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21461 expref: 27 pid: 22480 timeout: 928 lvb_type: 0 00000100:00100000:3.0:1746129573.465736:0:4385:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:4385:1830948737541760:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129573.466513:0:4385:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5ac93c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746129573.468282:0:4385:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:4385:1830948737541760:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129573.468585:0:4385:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800946f0e00/0x40a459093b06a472 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [2097152->3071999] (req 2097152->3071999) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f214ae expref: 27 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129573.468607:0:4385:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800946f0e00, rc 0) 00000100:00100000:3.0:1746129573.468819:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+27:32377:x1830948734192000:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 3641us (3901us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129573.468829:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16336 00000100:00100000:0.0:1746129573.475015:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129573.475098:0:7086:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734192128 00000100:00100000:1.0:1746129573.475109:0:7086:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734192128 00010000:00010000:1.0:1746129573.475152:0:7086:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800952f7c00/0x40a459093b06a425 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21461 expref: 27 pid: 22480 timeout: 928 lvb_type: 0 00000100:00100000:1.0:1746129573.475194:0:7086:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8380 00000100:00100000:1.0:1746129573.475202:0:7086:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b07480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+27:1962:x1830948734192128:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129573.475219:0:7086:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129573.475244:0:7086:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800952f7c00/0x40a459093b06a425 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21461 expref: 27 pid: 22480 timeout: 928 lvb_type: 0 00010000:00010000:1.0:1746129573.475256:0:7086:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800952f7c00/0x40a459093b06a425 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21461 expref: 27 pid: 22480 timeout: 928 lvb_type: 0 00010000:00010000:1.0:1746129573.475280:0:7086:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800952f7c00/0x40a459093b06a425 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21461 expref: 27 pid: 22480 timeout: 928 lvb_type: 0 00010000:00010000:1.0:1746129573.475360:0:7086:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129573.475363:0:7086:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129573.475371:0:7086:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800946f0e00/0x40a459093b06a472 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3071999) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f214ae expref: 26 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129573.475379:0:7086:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800946f0e00/0x40a459093b06a472 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3071999) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f214ae expref: 26 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129573.475419:0:7086:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800946f0e00/0x40a459093b06a472 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3071999) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f214ae expref: 26 pid: 4385 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129573.475437:0:7086:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b552680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7086:1830948737541888:192.168.202.4@tcp:105: 00000100:00100000:1.0:1746129573.475528:0:7086:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934d2240 going to sleep for 11 seconds 00010000:00010000:3.0:1746129573.477126:0:7089:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1746129573.479766:0:7086:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b552680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7086:1830948737541888:192.168.202.4@tcp:105: 00010000:00010000:1.0:1746129573.479797:0:7086:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129573.479853:0:7086:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b07480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+26:1962:x1830948734192128:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 4650us (4847us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129573.479864:0:7086:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8380 00000100:00100000:0.0:1746129573.485023:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129573.485126:0:31523:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734192384 00000100:00100000:3.0:1746129573.485136:0:31523:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734192384 00002000:00100000:3.0:1746129573.485181:0:31523:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f5:0x0] (3067904->3071999) req@ffff880091b04000 x1830948734192384/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:314/0 lens 488/0 e 0 to 0 dl 1746129584 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129573.485191:0:31523:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091b04000 with x1830948734192384 ext(3067904->3071999) 00002000:00010000:3.0:1746129573.485196:0:31523:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091b04000 00000100:00100000:3.0:1746129573.485229:0:31523:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7878 00000100:00100000:3.0:1746129573.485235:0:31523:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+26:1963:x1830948734192384:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:3.0:1746129573.485449:0:31523:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+26:1963:x1830948734192384:12345-192.168.202.4@tcp:3:cat.0 Request processed in 213us (436us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129573.485455:0:31523:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7878 00002000:00100000:3.0:1746129573.485461:0:31523:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f5:0x0] (3067904->3071999) req@ffff880091b04000 x1830948734192384/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:314/0 lens 488/4536 e 0 to 0 dl 1746129584 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129573.485469:0:31523:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091b04000 with x1830948734192384 ext(3067904->3071999) 00002000:00010000:3.0:1746129573.485471:0:31523:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091b04000 00000100:00100000:0.0:1746129573.496464:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129573.496803:0:16908:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734192512 00000100:00100000:2.0:1746129573.496818:0:16908:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734192512 00000100:00100000:2.0:1746129573.496880:0:16908:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11244 00000100:00100000:2.0:1746129573.496888:0:16908:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:068dab75-d300-4ead-a742-d14572ad1e50+11:32385:x1830948734192512:12345-192.168.202.4@tcp:101:mirror_io.0 00010000:00010000:2.0:1746129573.496912:0:16908:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129573.496930:0:16908:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94f000/0x40a459093b06a479 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f214b5 expref: -99 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129573.496991:0:16908:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94ec00/0x40a459093b06a480 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129573.497005:0:16908:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94ec00/0x40a459093b06a480 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129573.497015:0:16908:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94ec00/0x40a459093b06a480 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129573.497039:0:16908:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fafe000/0x40a459093b06a487 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129573.497045:0:16908:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fafe000/0x40a459093b06a487 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129573.497051:0:16908:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fafe000/0x40a459093b06a487 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129573.497159:0:16908:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fafe200/0x40a459093b06a48e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129573.497169:0:16908:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd28c00/0x40a459093b06a38b lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f213dc expref: 304 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129573.497176:0:16908:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd28000/0x40a459093b06a3ed lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21430 expref: 24 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129573.497182:0:16908:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fafe200/0x40a459093b06a48e lrc: 5/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129573.497212:0:16908:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd28000/0x40a459093b06a3ed lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21430 expref: 24 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129573.497222:0:16908:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd28000/0x40a459093b06a3ed lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21430 expref: 24 pid: 16908 timeout: 928 lvb_type: 0 00000100:00100000:2.0:1746129573.497234:0:16908:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fbac380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16908:1830948737542016:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129573.499718:0:16908:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd28c00/0x40a459093b06a38b lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f213dc expref: 304 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129573.499737:0:16908:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd28c00/0x40a459093b06a38b lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f213dc expref: 304 pid: 16908 timeout: 928 lvb_type: 0 00000100:00100000:2.0:1746129573.499750:0:16908:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fbadc00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16908:1830948737542144:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129573.500629:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129573.500671:0:16680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734192768 00000100:00100000:1.0:1746129573.500679:0:16680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734192768 00000100:00100000:1.0:1746129573.500730:0:16680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4776 00000100:00100000:1.0:1746129573.500736:0:16680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+25:27694:x1830948734192768:12345-192.168.202.4@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1746129573.501239:0:16908:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009af1e240 going to sleep for 11 seconds 00000100:00100000:2.0:1746129573.501262:0:16908:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fbac380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16908:1830948737542016:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129573.502022:0:16680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+26:27694:x1830948734192768:12345-192.168.202.4@tcp:35:ldlm_bl.0 Request processed in 1281us (1391us total) trans 8589945345 rc 0/0 00000100:00100000:1.0:1746129573.502032:0:16680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4776 00000100:00100000:2.0:1746129573.503228:0:16908:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fbadc00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16908:1830948737542144:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129573.503256:0:16908:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008fafe200/0x40a459093b06a48e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00000100:00100000:0.0:1746129573.504596:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129573.505037:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129573.505209:0:16680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734193024 00000100:00100000:1.0:1746129573.505218:0:16680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734193024 00000100:00100000:1.0:1746129573.505269:0:16680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4777 00000100:00100000:1.0:1746129573.505276:0:16680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ada2ffba-8920-4ecb-8068-68caa9806978+305:15417:x1830948734193024:12345-192.168.202.4@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1746129573.505659:0:7086:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734193152 00000100:00100000:2.0:1746129573.505664:0:7086:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734193152 00010000:00010000:2.0:1746129573.505689:0:7086:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd28000/0x40a459093b06a3ed lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21430 expref: 26 pid: 16908 timeout: 928 lvb_type: 0 00000100:00100000:2.0:1746129573.505712:0:7086:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8381 00000100:00100000:2.0:1746129573.505717:0:7086:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a45450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+26:1962:x1830948734193152:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129573.505726:0:7086:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129573.505732:0:7086:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd28000/0x40a459093b06a3ed lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21430 expref: 26 pid: 16908 timeout: 928 lvb_type: 0 00010000:00010000:2.0:1746129573.505743:0:7086:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd28000/0x40a459093b06a3ed lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21430 expref: 26 pid: 16908 timeout: 928 lvb_type: 0 00010000:00010000:2.0:1746129573.505763:0:7086:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd28000/0x40a459093b06a3ed lrc: 0/0,0 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21430 expref: 26 pid: 16908 timeout: 928 lvb_type: 0 00010000:00010000:2.0:1746129573.505781:0:7086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:2.0:1746129573.505786:0:7086:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008fafe200/0x40a459093b06a48e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129573.505796:0:7086:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88008fafe200/0x40a459093b06a48e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129573.505801:0:7086:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88008fafe200/0x40a459093b06a48e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129573.505805:0:7086:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129573.505861:0:7086:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a45450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+25:1962:x1830948734193152:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 143us (823us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129573.505868:0:7086:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8381 00000100:00100000:1.0:1746129573.506412:0:16680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ada2ffba-8920-4ecb-8068-68caa9806978+306:15417:x1830948734193024:12345-192.168.202.4@tcp:35:ldlm_bl.0 Request processed in 1134us (1821us total) trans 8589945346 rc 0/0 00000100:00100000:1.0:1746129573.506419:0:16680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4777 00000100:00100000:2.0:1746129573.508087:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129573.508605:0:7086:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734193280 00000100:00100000:3.0:1746129573.508615:0:7086:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734193280 00010000:00010000:3.0:1746129573.508653:0:7086:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd28c00/0x40a459093b06a38b lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f213dc expref: 306 pid: 16908 timeout: 928 lvb_type: 0 00000100:00100000:3.0:1746129573.508687:0:7086:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8382 00000100:00100000:3.0:1746129573.508694:0:7086:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ada2ffba-8920-4ecb-8068-68caa9806978+306:1962:x1830948734193280:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129573.508709:0:7086:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129573.508714:0:7086:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd28c00/0x40a459093b06a38b lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f213dc expref: 306 pid: 16908 timeout: 928 lvb_type: 0 00010000:00010000:3.0:1746129573.508726:0:7086:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd28c00/0x40a459093b06a38b lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f213dc expref: 306 pid: 16908 timeout: 928 lvb_type: 0 00010000:00010000:3.0:1746129573.508749:0:7086:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd28c00/0x40a459093b06a38b lrc: 0/0,0 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f213dc expref: 306 pid: 16908 timeout: 928 lvb_type: 0 00010000:00010000:3.0:1746129573.508770:0:7086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:3.0:1746129573.508775:0:7086:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008fafe200/0x40a459093b06a48e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129573.508784:0:7086:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fafe200/0x40a459093b06a48e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129573.508791:0:7086:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fafe200/0x40a459093b06a48e lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129573.508811:0:7086:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129573.508849:0:7086:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ada2ffba-8920-4ecb-8068-68caa9806978+305:1962:x1830948734193280:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 157us (770us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129573.508856:0:7086:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8382 00010000:00010000:3.0:1746129573.508882:0:16908:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008fafe200/0x40a459093b06a48e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129573.508889:0:16908:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fafe200/0x40a459093b06a48e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00000004:00200000:3.0:1746129573.508933:0:16908:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00000004:00200000:3.0:1746129573.508936:0:16908:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746129573.508953:0:16908:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008fafe200/0x40a459093b06a48e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129573.508962:0:16908:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fafe200/0x40a459093b06a48e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129573.508971:0:16908:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94ec00/0x40a459093b06a480 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129573.508977:0:16908:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94ec00/0x40a459093b06a480 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129573.508983:0:16908:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94ec00/0x40a459093b06a480 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129573.508989:0:16908:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d94ec00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:3.0:1746129573.508992:0:16908:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94ec00/0x40a459093b06a480 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129573.508998:0:16908:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94ec00/0x40a459093b06a480 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129573.509004:0:16908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880132ef8f00) 00010000:00010000:3.0:1746129573.509006:0:16908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129573.509009:0:16908:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94ec00/0x40a459093b06a480 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129573.509013:0:16908:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94ec00/0x40a459093b06a480 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129573.509023:0:16908:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fafe000/0x40a459093b06a487 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129573.509028:0:16908:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fafe000/0x40a459093b06a487 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129573.509033:0:16908:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008fafe000/0x40a459093b06a487 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129573.509036:0:16908:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008fafe000 already unused, calling callback (ffffffffa136e690) 00010000:00010000:3.0:1746129573.509038:0:16908:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fafe000/0x40a459093b06a487 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129573.509042:0:16908:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fafe000/0x40a459093b06a487 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129573.509047:0:16908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880132c33800) 00010000:00010000:3.0:1746129573.509048:0:16908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129573.509050:0:16908:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008fafe000/0x40a459093b06a487 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129573.509054:0:16908:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fafe000/0x40a459093b06a487 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129573.509082:0:16908:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94f000/0x40a459093b06a479 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f214b5 expref: 13 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129573.509092:0:16908:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fafe200/0x40a459093b06a48e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f214b5 expref: 12 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129573.509097:0:16908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:3.0:1746129573.509100:0:16908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746129573.509102:0:16908:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fafe200, rc 0) 00000100:00100000:3.0:1746129573.509122:0:16908:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:068dab75-d300-4ead-a742-d14572ad1e50+12:32385:x1830948734192512:12345-192.168.202.4@tcp:101:mirror_io.0 Request processed in 12235us (12670us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129573.509129:0:16908:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11244 00000100:00100000:2.0:1746129573.512085:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129573.512796:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129573.513102:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129573.513244:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734193408 00000100:00100000:3.0:1746129573.513254:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734193408 00000100:00100000:3.0:1746129573.513269:0:22480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734193536 00000100:00100000:3.0:1746129573.513271:0:22480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734193536 00000100:00100000:1.0:1746129573.513362:0:4699:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734193664 00000100:00100000:1.0:1746129573.513366:0:4699:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734193664 00000100:00100000:2.0:1746129573.513409:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129573.513425:0:31503:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734193792 00000100:00100000:2.0:1746129573.513428:0:31503:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734193792 00000100:00100000:2.0:1746129573.513473:0:31503:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16337 00000100:00100000:2.0:1746129573.513481:0:31503:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f95b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:068dab75-d300-4ead-a742-d14572ad1e50+10:1961:x1830948734193792:12345-192.168.202.4@tcp:101:mirror_io.0 00010000:00010000:2.0:1746129573.513500:0:31503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129573.513517:0:31503:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008fafe400/0x40a459093b06a495 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f214d1 expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129573.513550:0:31503:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008fafe400/0x40a459093b06a495 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f214d1 expref: 11 pid: 31503 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129573.513560:0:31503:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008fafe400/0x40a459093b06a495 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f214d1 expref: 11 pid: 31503 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746129573.513847:0:4699:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16338 00000100:00100000:1.0:1746129573.513853:0:4699:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:068dab75-d300-4ead-a742-d14572ad1e50+9:1961:x1830948734193536:12345-192.168.202.4@tcp:101:mirror_io.0 00010000:00010000:1.0:1746129573.513861:0:4699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129573.513870:0:4699:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fc8dc00/0x40a459093b06a49c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f214c3 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129573.513883:0:4699:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129573.513885:0:4699:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129573.513893:0:4699:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fc8dc00/0x40a459093b06a49c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f214c3 expref: 10 pid: 4699 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129573.513907:0:4699:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fc8dc00/0x40a459093b06a49c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f214c3 expref: 10 pid: 4699 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129573.513917:0:4699:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fc8dc00, rc 0) 00000100:00100000:1.0:1746129573.513961:0:4699:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:068dab75-d300-4ead-a742-d14572ad1e50+10:1961:x1830948734193536:12345-192.168.202.4@tcp:101:mirror_io.0 Request processed in 109us (1166us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129573.513967:0:4699:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16338 00000100:00100000:1.0:1746129573.513980:0:4699:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16339 00000100:00100000:1.0:1746129573.513984:0:4699:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:068dab75-d300-4ead-a742-d14572ad1e50+11:1961:x1830948734193664:12345-192.168.202.4@tcp:101:mirror_io.0 00010000:00010000:1.0:1746129573.513989:0:4699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129573.513995:0:4699:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fc8de00/0x40a459093b06a4a3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f214ca expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129573.514033:0:4699:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b552680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4699:1830948737542272:192.168.202.4@tcp:106: 00000100:00100000:1.0:1746129573.514078:0:4699:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934d2b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746129573.514123:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00080000:0.0:1746129573.514159:0:7097:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1746129573.514163:0:7097:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746129573.514630:0:8410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734193920 00000100:00100000:3.0:1746129573.514633:0:8410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734193920 00000100:00100000:3.0:1746129573.514651:0:8410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16340 00000100:00100000:3.0:1746129573.514654:0:8410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bf78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:068dab75-d300-4ead-a742-d14572ad1e50+10:1960:x1830948734193920:12345-192.168.202.4@tcp:101:mirror_io.0 00010000:00010000:3.0:1746129573.514660:0:8410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129573.514666:0:8410:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800946f0400/0x40a459093b06a4aa lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f214d8 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129573.514691:0:8410:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8410:1830948737542400:192.168.202.4@tcp:106: 00000100:00100000:3.0:1746129573.514720:0:8410:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5ac9a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746129573.514764:0:22480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16341 00000100:00100000:3.0:1746129573.514769:0:22480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:068dab75-d300-4ead-a742-d14572ad1e50+12:1961:x1830948734193408:12345-192.168.202.4@tcp:101:mirror_io.0 00010000:00010000:3.0:1746129573.514775:0:22480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129573.514782:0:22480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800946f1e00/0x40a459093b06a4b1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f214bc expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129573.514793:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129573.514795:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129573.514800:0:22480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800946f1e00/0x40a459093b06a4b1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f214bc expref: 13 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129573.514809:0:22480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800946f1e00/0x40a459093b06a4b1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f214bc expref: 13 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129573.514815:0:22480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800946f1e00, rc 0) 00000100:00100000:3.0:1746129573.514851:0:22480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:068dab75-d300-4ead-a742-d14572ad1e50+13:1961:x1830948734193408:12345-192.168.202.4@tcp:101:mirror_io.0 Request processed in 81us (2779us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129573.514855:0:22480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16341 00010000:00010000:2.0:1746129573.514965:0:31503:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fafe400, rc 0) 00000100:00100000:2.0:1746129573.515175:0:31503:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f95b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:068dab75-d300-4ead-a742-d14572ad1e50+11:1961:x1830948734193792:12345-192.168.202.4@tcp:101:mirror_io.0 Request processed in 1507us (1578us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129573.515182:0:31503:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16337 00000100:00100000:1.0:1746129573.517606:0:4699:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b552680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4699:1830948737542272:192.168.202.4@tcp:106: 00010000:00010000:1.0:1746129573.517647:0:4699:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fc8de00/0x40a459093b06a4a3 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f214ca expref: 10 pid: 4699 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129573.517660:0:4699:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fc8de00/0x40a459093b06a4a3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f214ca expref: 10 pid: 4699 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129573.517677:0:4699:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fc8de00, rc 0) 00000100:00100000:1.0:1746129573.517739:0:4699:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:068dab75-d300-4ead-a742-d14572ad1e50+9:1961:x1830948734193664:12345-192.168.202.4@tcp:101:mirror_io.0 Request processed in 3752us (4636us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129573.517748:0:4699:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16339 00000100:00100000:3.0:1746129573.517874:0:8410:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8410:1830948737542400:192.168.202.4@tcp:106: 00010000:00010000:3.0:1746129573.517895:0:8410:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800946f0400/0x40a459093b06a4aa lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f214d8 expref: 11 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129573.517906:0:8410:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800946f0400/0x40a459093b06a4aa lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f214d8 expref: 11 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129573.517918:0:8410:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800946f0400, rc 0) 00000100:00100000:3.0:1746129573.517938:0:8410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bf78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:068dab75-d300-4ead-a742-d14572ad1e50+10:1960:x1830948734193920:12345-192.168.202.4@tcp:101:mirror_io.0 Request processed in 3282us (3814us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129573.517944:0:8410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16340 00000100:00100000:0.0:1746129573.522184:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129573.522396:0:16908:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734194176 00000100:00100000:3.0:1746129573.522405:0:16908:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734194176 00000100:00100000:3.0:1746129573.522662:0:16908:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11245 00000100:00100000:3.0:1746129573.522672:0:16908:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:068dab75-d300-4ead-a742-d14572ad1e50+12:32385:x1830948734194176:12345-192.168.202.4@tcp:101:mirror_io.0 00010000:00010000:3.0:1746129573.522691:0:16908:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129573.522710:0:16908:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800946f0000/0x40a459093b06a4b8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f214df expref: -99 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129573.522809:0:16908:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800946f1400/0x40a459093b06a4bf lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129573.522826:0:16908:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fafe200/0x40a459093b06a48e lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f214b5 expref: 13 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129573.522832:0:16908:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800946f1400/0x40a459093b06a4bf lrc: 4/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129573.522864:0:16908:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008fafe200/0x40a459093b06a48e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f214b5 expref: 13 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129573.522876:0:16908:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fafe200/0x40a459093b06a48e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f214b5 expref: 13 pid: 16908 timeout: 928 lvb_type: 0 00000100:00100000:3.0:1746129573.522889:0:16908:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bf480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16908:1830948737542528:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129573.523919:0:16908:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5ac9a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746129573.527009:0:16908:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bf480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16908:1830948737542528:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129573.527040:0:16908:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800946f1400/0x40a459093b06a4bf lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00000100:00100000:0.0:1746129573.527535:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129573.528556:0:20578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734194304 00000100:00100000:2.0:1746129573.528567:0:20578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734194304 00010000:00010000:2.0:1746129573.528605:0:20578:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fafe200/0x40a459093b06a48e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f214b5 expref: 14 pid: 16908 timeout: 928 lvb_type: 0 00000100:00100000:2.0:1746129573.528648:0:20578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8383 00000100:00100000:2.0:1746129573.528655:0:20578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b06a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:068dab75-d300-4ead-a742-d14572ad1e50+14:1962:x1830948734194304:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129573.528670:0:20578:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129573.528675:0:20578:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008fafe200/0x40a459093b06a48e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f214b5 expref: 14 pid: 16908 timeout: 928 lvb_type: 0 00010000:00010000:2.0:1746129573.528685:0:20578:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008fafe200/0x40a459093b06a48e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f214b5 expref: 14 pid: 16908 timeout: 928 lvb_type: 0 00010000:00010000:2.0:1746129573.528705:0:20578:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fafe200/0x40a459093b06a48e lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f214b5 expref: 14 pid: 16908 timeout: 928 lvb_type: 0 00010000:00010000:2.0:1746129573.528735:0:20578:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:2.0:1746129573.528740:0:20578:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800946f1400/0x40a459093b06a4bf lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129573.528750:0:20578:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800946f1400/0x40a459093b06a4bf lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129573.528756:0:20578:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800946f1400/0x40a459093b06a4bf lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129573.528782:0:20578:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129573.528834:0:20578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b06a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:068dab75-d300-4ead-a742-d14572ad1e50+13:1962:x1830948734194304:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 178us (1299us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129573.528840:0:20578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8383 00010000:00010000:3.0:1746129573.528907:0:16908:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800946f1400/0x40a459093b06a4bf lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129573.528914:0:16908:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800946f1400/0x40a459093b06a4bf lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00000004:00200000:3.0:1746129573.528932:0:16908:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:3.0:1746129573.529078:0:16908:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800946f0000/0x40a459093b06a4b8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f214df expref: 14 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129573.529096:0:16908:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800946f1400/0x40a459093b06a4bf lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f214df expref: 13 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129573.529102:0:16908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:3.0:1746129573.529104:0:16908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746129573.529106:0:16908:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800946f1400, rc 0) 00000100:00100000:3.0:1746129573.529131:0:16908:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:068dab75-d300-4ead-a742-d14572ad1e50+13:32385:x1830948734194176:12345-192.168.202.4@tcp:101:mirror_io.0 Request processed in 6462us (6958us total) trans 8589945347 rc 0/0 00000100:00100000:3.0:1746129573.529138:0:16908:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11245 00000100:00100000:0.0:1746129573.531535:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129573.532082:0:16908:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734194560 00000100:00100000:3.0:1746129573.532091:0:16908:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734194560 00000100:00100000:3.0:1746129573.532464:0:16908:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11246 00000100:00100000:3.0:1746129573.532472:0:16908:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:068dab75-d300-4ead-a742-d14572ad1e50+13:32385:x1830948734194560:12345-192.168.202.4@tcp:101:mirror_io.0 00010000:00010000:3.0:1746129573.532497:0:16908:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129573.532500:0:16908:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746129573.532528:0:16908:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800946f1400/0x40a459093b06a4bf lrc: 0/0,0 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f214df expref: 13 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129573.532543:0:16908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:3.0:1746129573.532547:0:16908:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746129573.532556:0:16908:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94ec00/0x40a459093b06a4cd lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f214e6 expref: -99 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129573.532662:0:16908:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94e000/0x40a459093b06a4d4 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129573.532676:0:16908:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94e000/0x40a459093b06a4d4 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129573.532684:0:16908:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94e000/0x40a459093b06a4d4 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00000004:00200000:3.0:1746129573.532695:0:16908:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:3.0:1746129573.532815:0:16908:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94ec00/0x40a459093b06a4cd lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f214e6 expref: 15 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129573.532832:0:16908:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94e000/0x40a459093b06a4d4 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f214e6 expref: 14 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129573.532838:0:16908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:3.0:1746129573.532840:0:16908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746129573.532842:0:16908:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d94e000, rc 0) 00000100:00100000:3.0:1746129573.533171:0:16908:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:068dab75-d300-4ead-a742-d14572ad1e50+14:32385:x1830948734194560:12345-192.168.202.4@tcp:101:mirror_io.0 Request processed in 697us (1645us total) trans 8589945348 rc 0/0 00000100:00100000:3.0:1746129573.533177:0:16908:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11246 00000100:00100000:0.0:1746129573.536452:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129573.536495:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129573.536509:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129573.536530:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129573.536547:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129573.536549:0:4699:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734194688 00000100:00100000:1.0:1746129573.536559:0:4699:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734194688 00000100:00100000:0.0:1746129573.536573:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129573.536588:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734194816 00000100:00100000:0.0:1746129573.536591:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734194816 00000100:00100000:1.0:1746129573.536600:0:4699:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734194944 00000100:00100000:1.0:1746129573.536602:0:4699:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734194944 00000100:00100000:0.0:1746129573.536606:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734195072 00000100:00100000:0.0:1746129573.536607:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734195072 00000100:00100000:1.0:1746129573.536611:0:4699:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734195200 00000100:00100000:1.0:1746129573.536613:0:4699:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734195200 00000100:00100000:0.0:1746129573.536616:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734195328 00000100:00100000:0.0:1746129573.536618:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734195328 00000100:00100000:1.0:1746129573.536626:0:4699:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16342 00000100:00100000:1.0:1746129573.536633:0:4699:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:068dab75-d300-4ead-a742-d14572ad1e50+11:1960:x1830948734194688:12345-192.168.202.4@tcp:1:mirror_io.0 00000100:00100000:0.0:1746129573.536634:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16343 00000100:00100000:0.0:1746129573.536638:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:068dab75-d300-4ead-a742-d14572ad1e50+12:1960:x1830948734194816:12345-192.168.202.4@tcp:1:mirror_io.0 00010000:00010000:1.0:1746129573.536679:0:4699:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008fac0c00/0x40a459093b06a4e9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129573.536679:0:7149:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008f445000/0x40a459093b06a4e2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129573.536695:0:4699:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a6729a00/0x40a459093b06a3df lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21429 expref: 34 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129573.536695:0:7149:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c22ca00/0x40a459093b06a265 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21318 expref: 34 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129573.536702:0:4699:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800946f1e00/0x40a459093b06a4b1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f214bc expref: 11 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129573.536702:0:7149:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fc8dc00/0x40a459093b06a49c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f214c3 expref: 12 pid: 4699 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129573.536710:0:7149:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a9209e00/0x40a459093b06a28f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2133b expref: 25 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129573.536714:0:4699:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c461200/0x40a459093b06a409 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2143e expref: 18 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129573.536715:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129573.536716:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129573.536719:0:4699:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129573.536719:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f445000/0x40a459093b06a4e2 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129573.536720:0:4699:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129573.536722:0:4699:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008fac0c00/0x40a459093b06a4e9 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129573.536747:0:4699:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c461200/0x40a459093b06a409 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2143e expref: 18 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129573.536747:0:7149:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a9209e00/0x40a459093b06a28f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2133b expref: 25 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129573.536760:0:7149:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a9209e00/0x40a459093b06a28f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2133b expref: 25 pid: 22480 timeout: 928 lvb_type: 1 00000100:00100000:0.0:1746129573.536774:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900f5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7149:1830948737542784:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129573.536859:0:7149:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fc8dc00/0x40a459093b06a49c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f214c3 expref: 12 pid: 4699 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746129573.536890:0:8412:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16344 00000100:00100000:2.0:1746129573.536898:0:8412:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:068dab75-d300-4ead-a742-d14572ad1e50+12:1960:x1830948734194944:12345-192.168.202.4@tcp:1:mirror_io.0 00010000:00010000:2.0:1746129573.536914:0:8412:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008fafec00/0x40a459093b06a4f0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129573.536924:0:8412:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880132eddc00/0x40a459093b06a06d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f211e4 expref: 34 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129573.536931:0:8412:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880132edd400/0x40a459093b06a1bd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f212bd expref: 12 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129573.536938:0:8412:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880132edd800/0x40a459093b06a074 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f211eb expref: 25 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129573.536943:0:8412:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129573.536944:0:8412:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129573.536946:0:8412:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fafec00/0x40a459093b06a4f0 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129573.536962:0:8412:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880132edd800/0x40a459093b06a074 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f211eb expref: 25 pid: 4385 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129573.536993:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16345 00000100:00100000:3.0:1746129573.537002:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:068dab75-d300-4ead-a742-d14572ad1e50+11:1960:x1830948734195072:12345-192.168.202.4@tcp:1:mirror_io.0 00010000:00010000:3.0:1746129573.537019:0:7148:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012d94f000/0x40a459093b06a4f7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129573.537027:0:7148:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800952f7800/0x40a459093b06a41e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2039808->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2145a expref: 34 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129573.537032:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129573.537033:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129573.537035:0:7148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d94f000/0x40a459093b06a4f7 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129573.537052:0:7148:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800952f7800/0x40a459093b06a41e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2039808->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2145a expref: 34 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129573.537486:0:4699:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c461200/0x40a459093b06a409 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2143e expref: 18 pid: 7149 timeout: 928 lvb_type: 1 00000100:00100000:1.0:1746129573.537677:0:4699:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b552680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4699:1830948737542656:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129573.537719:0:4699:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800946f1e00/0x40a459093b06a4b1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f214bc expref: 11 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129573.537726:0:4699:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800946f1e00/0x40a459093b06a4b1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f214bc expref: 11 pid: 22480 timeout: 928 lvb_type: 1 00000100:00100000:1.0:1746129573.537734:0:4699:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b550700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4699:1830948737543296:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129573.537750:0:4699:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a6729a00/0x40a459093b06a3df lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21429 expref: 34 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129573.537761:0:4699:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a6729a00/0x40a459093b06a3df lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21429 expref: 34 pid: 4385 timeout: 928 lvb_type: 0 00000100:00100000:1.0:1746129573.537767:0:4699:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b552d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4699:1830948737543424:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129573.537778:0:4699:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934d2b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746129573.537801:0:22481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16346 00000100:00100000:1.0:1746129573.537807:0:22481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:068dab75-d300-4ead-a742-d14572ad1e50+11:1960:x1830948734195200:12345-192.168.202.4@tcp:1:mirror_io.0 00010000:00010000:1.0:1746129573.537822:0:22481:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008fac1a00/0x40a459093b06a4fe lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129573.537831:0:22481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f444400/0x40a459093b06a44f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [3141632->3145727] (req 3141632->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2148b expref: 18 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129573.537838:0:22481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fd29c00/0x40a459093b06a3a0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f213ea expref: 18 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129573.537842:0:22481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746129573.537843:0:22481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746129573.537845:0:22481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008fac1a00/0x40a459093b06a4fe lrc: 5/0,1 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129573.537856:0:22481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fd29c00/0x40a459093b06a3a0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f213ea expref: 18 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129573.537862:0:22481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fd29c00/0x40a459093b06a3a0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f213ea expref: 18 pid: 7148 timeout: 928 lvb_type: 0 00000100:00100000:1.0:1746129573.537870:0:22481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b553100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:22481:1830948737543552:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129573.537888:0:22481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f444400/0x40a459093b06a44f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [3141632->3145727] (req 3141632->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2148b expref: 18 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129573.537894:0:22481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f444400/0x40a459093b06a44f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [3141632->3145727] (req 3141632->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2148b expref: 18 pid: 31503 timeout: 928 lvb_type: 0 00000100:00100000:1.0:1746129573.537901:0:22481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093cefb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:22481:1830948737543680:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129573.537911:0:22481:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934d2900 going to sleep for 11 seconds 00000100:00100000:1.0:1746129573.537924:0:20577:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16347 00000100:00100000:1.0:1746129573.537928:0:20577:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:068dab75-d300-4ead-a742-d14572ad1e50+12:1960:x1830948734195328:12345-192.168.202.4@tcp:1:mirror_io.0 00010000:00010000:1.0:1746129573.537941:0:20577:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008fac0000/0x40a459093b06a505 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129573.537949:0:20577:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800946f0e00/0x40a459093b06a472 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3071999) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f214ae expref: 25 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129573.537954:0:20577:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129573.537955:0:20577:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129573.537956:0:20577:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fac0000/0x40a459093b06a505 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129573.537967:0:20577:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800946f0e00/0x40a459093b06a472 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3071999) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f214ae expref: 25 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129573.537978:0:20577:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800946f0e00/0x40a459093b06a472 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3071999) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f214ae expref: 25 pid: 4385 timeout: 928 lvb_type: 0 00000100:00100000:1.0:1746129573.537986:0:20577:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ced500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20577:1830948737543808:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129573.537998:0:20577:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934d2a80 going to sleep for 11 seconds 00010000:00010000:0.0:1746129573.538058:0:7149:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fc8dc00/0x40a459093b06a49c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f214c3 expref: 12 pid: 4699 timeout: 928 lvb_type: 1 00000100:00100000:0.0:1746129573.538068:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095626d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7149:1830948737542912:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129573.538099:0:7149:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c22ca00/0x40a459093b06a265 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21318 expref: 34 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129573.538106:0:7149:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c22ca00/0x40a459093b06a265 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21318 expref: 34 pid: 7149 timeout: 928 lvb_type: 0 00000100:00100000:0.0:1746129573.538114:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095624700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7149:1830948737543936:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129573.538132:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a6ce8f00 going to sleep for 11 seconds 00010000:00010000:2.0:1746129573.538142:0:8412:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880132edd800/0x40a459093b06a074 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f211eb expref: 25 pid: 4385 timeout: 928 lvb_type: 0 00000100:00100000:2.0:1746129573.538152:0:8412:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f95b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8412:1830948737543040:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129573.538177:0:8412:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880132edd400/0x40a459093b06a1bd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f212bd expref: 12 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129573.538184:0:8412:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880132edd400/0x40a459093b06a1bd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f212bd expref: 12 pid: 7149 timeout: 928 lvb_type: 1 00000100:00100000:2.0:1746129573.538190:0:8412:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a77b0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8412:1830948737544064:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129573.538209:0:8412:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880132eddc00/0x40a459093b06a06d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f211e4 expref: 34 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129573.538216:0:8412:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880132eddc00/0x40a459093b06a06d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f211e4 expref: 34 pid: 7148 timeout: 928 lvb_type: 0 00000100:00100000:2.0:1746129573.538222:0:8412:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a77b1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8412:1830948737544192:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129573.538237:0:8412:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009af1ef00 going to sleep for 11 seconds 00010000:00010000:3.0:1746129573.538379:0:7148:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800952f7800/0x40a459093b06a41e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2039808->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2145a expref: 34 pid: 22480 timeout: 928 lvb_type: 0 00000100:00100000:3.0:1746129573.538389:0:7148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7148:1830948737543168:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129573.538433:0:7148:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5ac9a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746129573.545466:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129573.547517:0:4699:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b550700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4699:1830948737543296:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129573.547984:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900f5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7149:1830948737542784:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129573.548133:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095626d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7149:1830948737542912:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129573.548140:0:20577:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ced500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20577:1830948737543808:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129573.548158:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095624700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7149:1830948737543936:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129573.548163:0:20577:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008fac0000/0x40a459093b06a505 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129573.548177:0:7149:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008f445000/0x40a459093b06a4e2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129573.548195:0:22481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b553100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:22481:1830948737543552:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129573.548203:0:22481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093cefb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:22481:1830948737543680:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129573.548218:0:22481:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88008fac1a00/0x40a459093b06a4fe lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 22481 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129573.548237:0:4699:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b552680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4699:1830948737542656:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129573.548245:0:4699:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b552d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4699:1830948737543424:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129573.548252:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00010000:00010000:1.0:1746129573.548261:0:4699:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88008fac0c00/0x40a459093b06a4e9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129573.548275:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129573.548311:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129573.548325:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129573.548345:0:15749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734195456 00000100:00100000:0.0:1746129573.548351:0:15749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734195456 00000100:00100000:1.0:1746129573.548357:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129573.548379:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00010000:00010000:0.0:1746129573.548381:0:15749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800946f1e00/0x40a459093b06a4b1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f214bc expref: 12 pid: 22480 timeout: 928 lvb_type: 1 00000100:00100000:1.0:1746129573.548395:0:31521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734196096 00000100:00100000:1.0:1746129573.548398:0:31521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734196096 00000100:00100000:0.0:1746129573.548401:0:15749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734195584 00000100:00100000:0.0:1746129573.548403:0:15749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734195584 00010000:00010000:0.0:1746129573.548410:0:15749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c461200/0x40a459093b06a409 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2143e expref: 19 pid: 7149 timeout: 928 lvb_type: 1 00000100:00100000:0.0:1746129573.548420:0:15749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734195840 00000100:00100000:0.0:1746129573.548422:0:15749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734195840 00010000:00010000:0.0:1746129573.548428:0:15749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a9209e00/0x40a459093b06a28f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2133b expref: 27 pid: 22480 timeout: 928 lvb_type: 1 00002000:00100000:1.0:1746129573.548430:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f5:0x0] (2097152->3071999) req@ffff88013145ca80 x1830948734196096/t0(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:314/0 lens 488/0 e 0 to 0 dl 1746129584 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746129573.548435:0:15749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734196224 00000100:00100000:0.0:1746129573.548436:0:15749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734196224 00002000:00100000:1.0:1746129573.548439:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013145ca80 with x1830948734196096 ext(2097152->3071999) 00010000:00010000:0.0:1746129573.548443:0:15749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6729a00/0x40a459093b06a3df lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21429 expref: 35 pid: 4385 timeout: 928 lvb_type: 0 00010000:00010000:1.0:1746129573.548446:0:31521:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800946f0e00/0x40a459093b06a472 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3071999) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f214ae expref: 27 pid: 4385 timeout: 928 lvb_type: 0 00000100:00100000:0.0:1746129573.548452:0:15749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8384 00000100:00100000:0.0:1746129573.548457:0:15749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013145e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:068dab75-d300-4ead-a742-d14572ad1e50+12:1962:x1830948734195456:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129573.548458:0:31521:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800946f0e00/0x40a459093b06a472 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3071999) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f214ae expref: 27 pid: 4385 timeout: 928 lvb_type: 0 00002000:00010000:1.0:1746129573.548464:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88013145ca80 00000100:00100000:3.0:1746129573.548470:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8385 00010000:00010000:0.0:1746129573.548470:0:15749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746129573.548476:0:31521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734195712 00000100:00100000:1.0:1746129573.548478:0:31521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734195712 00000100:00100000:3.0:1746129573.548481:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013145fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+19:1963:x1830948734195584:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129573.548488:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00100000:1.0:1746129573.548489:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3ef:0x0] (3141632->3145727) req@ffff880093cefb80 x1830948734195712/t0(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:314/0 lens 4584/0 e 0 to 0 dl 1746129584 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:0.0:1746129573.548491:0:15749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800946f1e00/0x40a459093b06a4b1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f214bc expref: 12 pid: 22480 timeout: 928 lvb_type: 1 00002000:00100000:1.0:1746129573.548496:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093cefb80 with x1830948734195712 ext(3141632->3145727) 00010000:00010000:3.0:1746129573.548500:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c461200/0x40a459093b06a409 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2143e expref: 20 pid: 7149 timeout: 928 lvb_type: 1 00010000:00010000:1.0:1746129573.548500:0:31521:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008f444400/0x40a459093b06a44f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [3141632->3145727] (req 3141632->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2148b expref: 20 pid: 31503 timeout: 928 lvb_type: 0 00010000:00010000:0.0:1746129573.548500:0:15749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800946f1e00/0x40a459093b06a4b1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f214bc expref: 12 pid: 22480 timeout: 928 lvb_type: 1 00010000:00010000:1.0:1746129573.548508:0:31521:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008f444400/0x40a459093b06a44f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [3141632->3145727] (req 3141632->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2148b expref: 20 pid: 31503 timeout: 928 lvb_type: 0 00002000:00010000:1.0:1746129573.548513:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093cefb80 00000100:00100000:1.0:1746129573.548521:0:31521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734196608 00000100:00100000:1.0:1746129573.548523:0:31521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734196608 00002000:00100000:1.0:1746129573.548532:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3ee:0x0] (2039808->2097151) req@ffff880093ced500 x1830948734196608/t0(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:314/0 lens 488/0 e 0 to 0 dl 1746129584 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129573.548543:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ced500 with x1830948734196608 ext(2039808->2097151) 00010000:00010000:1.0:1746129573.548547:0:31521:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800952f7800/0x40a459093b06a41e lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2039808->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2145a expref: 36 pid: 22480 timeout: 928 lvb_type: 0 00010000:00010000:1.0:1746129573.548554:0:31521:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800952f7800/0x40a459093b06a41e lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2039808->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2145a expref: 36 pid: 22480 timeout: 928 lvb_type: 0 00002000:00010000:1.0:1746129573.548558:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093ced500 00000100:00100000:2.0:1746129573.548560:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8386 00000100:00100000:2.0:1746129573.548566:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095624700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+27:1961:x1830948734195840:12345-192.168.202.4@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746129573.548569:0:31521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2445 00010000:00010000:2.0:1746129573.548574:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746129573.548574:0:31521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013145ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+27:1963:x1830948734196096:12345-192.168.202.4@tcp:4:cat.0 00010000:00010000:2.0:1746129573.548586:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a9209e00/0x40a459093b06a28f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2133b expref: 27 pid: 22480 timeout: 928 lvb_type: 1 00010000:00010000:2.0:1746129573.548594:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a9209e00/0x40a459093b06a28f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2133b expref: 27 pid: 22480 timeout: 928 lvb_type: 1 00010000:00010000:2.0:1746129573.548613:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a9209e00/0x40a459093b06a28f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2133b expref: 27 pid: 22480 timeout: 928 lvb_type: 1 00010000:00010000:3.0:1746129573.548627:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c461200/0x40a459093b06a409 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2143e expref: 20 pid: 7149 timeout: 928 lvb_type: 1 00010000:00010000:2.0:1746129573.548631:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746129573.548642:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c461200/0x40a459093b06a409 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2143e expref: 20 pid: 7149 timeout: 928 lvb_type: 1 00010000:00010000:3.0:1746129573.548657:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129573.548666:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095624700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+26:1961:x1830948734195840:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 100us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129573.548672:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8386 00000100:00100000:3.0:1746129573.548674:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013145fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+19:1963:x1830948734195584:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 197us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129573.548680:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8385 00000100:00100000:2.0:1746129573.548686:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8387 00000100:00100000:2.0:1746129573.548690:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095626d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ada2ffba-8920-4ecb-8068-68caa9806978+36:1961:x1830948734196224:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129573.548695:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129573.548701:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a6729a00/0x40a459093b06a3df lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21429 expref: 36 pid: 4385 timeout: 928 lvb_type: 0 00000100:00100000:3.0:1746129573.548706:0:7148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7148:1830948737543168:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129573.548708:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a6729a00/0x40a459093b06a3df lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21429 expref: 36 pid: 4385 timeout: 928 lvb_type: 0 00010000:00010000:3.0:1746129573.548716:0:7148:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012d94f000/0x40a459093b06a4f7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129573.548719:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a6729a00/0x40a459093b06a3df lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21429 expref: 36 pid: 4385 timeout: 928 lvb_type: 0 00010000:00010000:2.0:1746129573.548726:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129573.548735:0:31523:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2446 00000100:00100000:2.0:1746129573.548737:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095626d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ada2ffba-8920-4ecb-8068-68caa9806978+35:1961:x1830948734196224:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 47us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129573.548741:0:31523:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+18:1963:x1830948734195712:12345-192.168.202.4@tcp:4:cat.0 00000100:00100000:2.0:1746129573.548742:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8387 00000100:00100000:2.0:1746129573.548773:0:8412:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f95b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8412:1830948737543040:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129573.548779:0:8412:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a77b0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8412:1830948737544064:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129573.548786:0:8412:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a77b1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8412:1830948737544192:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129573.548804:0:8412:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008fafec00/0x40a459093b06a4f0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129573.548823:0:21725:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2447 00000100:00100000:2.0:1746129573.548827:0:21725:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ced500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ada2ffba-8920-4ecb-8068-68caa9806978+34:1961:x1830948734196608:12345-192.168.202.4@tcp:4:cat.0 00000100:00100000:3.0:1746129573.549030:0:31523:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:1963:x1830948734195712:12345-192.168.202.4@tcp:4:cat.0 Request processed in 289us (673us total) trans 21474841377 rc 0/0 00000100:00100000:3.0:1746129573.549036:0:31523:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2446 00002000:00100000:3.0:1746129573.549041:0:31523:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3ef:0x0] (3141632->3145727) req@ffff880093cefb80 x1830948734195712/t21474841377(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:314/0 lens 4584/448 e 0 to 0 dl 1746129584 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129573.549048:0:31523:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093cefb80 with x1830948734195712 ext(3141632->3145727) 00010000:00010000:3.0:1746129573.549052:0:31523:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008f444400/0x40a459093b06a44f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [3141632->3145727] (req 3141632->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2148b expref: 20 pid: 31503 timeout: 928 lvb_type: 0 00010000:00010000:3.0:1746129573.549060:0:31523:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008f444400/0x40a459093b06a44f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [3141632->3145727] (req 3141632->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2148b expref: 20 pid: 31503 timeout: 928 lvb_type: 0 00002000:00010000:3.0:1746129573.549065:0:31523:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093cefb80 00000100:00100000:1.0:1746129573.550229:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129573.550283:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129573.550352:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00010000:00010000:0.0:1746129573.550381:0:15749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800946f1e00/0x40a459093b06a4b1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f214bc expref: 12 pid: 22480 timeout: 928 lvb_type: 1 00010000:00010000:0.0:1746129573.550402:0:15749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129573.550404:0:15749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129573.550409:0:15749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008fac0c00/0x40a459093b06a4e9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129573.550417:0:15749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008fac0c00/0x40a459093b06a4e9 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129573.550437:0:15749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129573.550458:0:15749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013145e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:068dab75-d300-4ead-a742-d14572ad1e50+11:1962:x1830948734195456:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 1999us (5004us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129573.550463:0:15749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8384 00010000:00010000:1.0:1746129573.550721:0:4699:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88008fac0c00/0x40a459093b06a4e9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129573.550730:0:4699:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008fac0c00/0x40a459093b06a4e9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129573.550753:0:4699:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008fac0c00/0x40a459093b06a4e9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129573.550761:0:4699:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008fac0c00/0x40a459093b06a4e9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129573.550767:0:4699:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008fac0c00/0x40a459093b06a4e9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129573.550775:0:4699:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008fac0c00 already unused, calling callback (ffffffffa086ed70) 00010000:00010000:1.0:1746129573.550778:0:4699:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008fac0c00/0x40a459093b06a4e9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129573.550785:0:4699:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008fac0c00/0x40a459093b06a4e9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129573.550794:0:4699:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008fac0c00/0x40a459093b06a4e9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129573.550800:0:4699:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008fac0c00/0x40a459093b06a4e9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129573.550801:0:7086:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734195968 00000100:00100000:3.0:1746129573.550809:0:7086:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734195968 00000100:00100000:0.0:1746129573.550811:0:15749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734196480 00000100:00100000:0.0:1746129573.550815:0:15749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734196480 00010000:00010000:3.0:1746129573.550834:0:7086:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fc8dc00/0x40a459093b06a49c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f214c3 expref: 13 pid: 4699 timeout: 928 lvb_type: 1 00010000:00010000:0.0:1746129573.550834:0:15749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c22ca00/0x40a459093b06a265 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21318 expref: 35 pid: 7149 timeout: 928 lvb_type: 0 00000100:00100000:1.0:1746129573.550854:0:4699:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:068dab75-d300-4ead-a742-d14572ad1e50+10:1960:x1830948734194688:12345-192.168.202.4@tcp:1:mirror_io.0 Request processed in 14221us (14413us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129573.550860:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734196736 00000100:00100000:1.0:1746129573.550861:0:4699:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16342 00000100:00100000:2.0:1746129573.550864:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734196736 00010000:00010000:2.0:1746129573.550878:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880132edd800/0x40a459093b06a074 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f211eb expref: 27 pid: 4385 timeout: 928 lvb_type: 0 00000100:00100000:1.0:1746129573.550905:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129573.552696:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129573.552732:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129573.552869:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734196864 00000100:00100000:3.0:1746129573.552876:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734196864 00010000:00010000:3.0:1746129573.552908:0:9823:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880132eddc00/0x40a459093b06a06d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f211e4 expref: 36 pid: 7148 timeout: 928 lvb_type: 0 00000100:00100000:3.0:1746129573.552931:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734196352 00000100:00100000:3.0:1746129573.552933:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734196352 00010000:00010000:3.0:1746129573.552943:0:9823:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880132edd400/0x40a459093b06a1bd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f212bd expref: 14 pid: 7149 timeout: 928 lvb_type: 1 00000100:00100000:3.0:1746129573.552954:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8388 00000100:00100000:3.0:1746129573.552962:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a45050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:068dab75-d300-4ead-a742-d14572ad1e50+14:1961:x1830948734195968:12345-192.168.202.4@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746129573.552969:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8389 00010000:00010000:3.0:1746129573.552975:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746129573.552978:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ceed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ada2ffba-8920-4ecb-8068-68caa9806978+36:1961:x1830948734196480:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129573.552986:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129573.552996:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fc8dc00/0x40a459093b06a49c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f214c3 expref: 14 pid: 4699 timeout: 928 lvb_type: 1 00010000:00010000:2.0:1746129573.552997:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c22ca00/0x40a459093b06a265 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21318 expref: 36 pid: 7149 timeout: 928 lvb_type: 0 00010000:00010000:3.0:1746129573.553007:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fc8dc00/0x40a459093b06a49c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f214c3 expref: 14 pid: 4699 timeout: 928 lvb_type: 1 00010000:00010000:2.0:1746129573.553019:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c22ca00/0x40a459093b06a265 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21318 expref: 36 pid: 7149 timeout: 928 lvb_type: 0 00000100:00100000:0.0:1746129573.553041:0:15749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734196992 00000100:00100000:0.0:1746129573.553046:0:15749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734196992 00010000:00010000:0.0:1746129573.553064:0:15749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd29c00/0x40a459093b06a3a0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f213ea expref: 20 pid: 7148 timeout: 928 lvb_type: 0 00000100:00100000:0.0:1746129573.553078:0:15749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8390 00000100:00100000:0.0:1746129573.553083:0:15749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ced880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+27:1960:x1830948734196736:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129573.553090:0:15749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129573.553101:0:15749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880132edd800/0x40a459093b06a074 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f211eb expref: 27 pid: 4385 timeout: 928 lvb_type: 0 00010000:00010000:0.0:1746129573.553109:0:15749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880132edd800/0x40a459093b06a074 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f211eb expref: 27 pid: 4385 timeout: 928 lvb_type: 0 00010000:00010000:0.0:1746129573.553128:0:15749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880132edd800/0x40a459093b06a074 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f211eb expref: 27 pid: 4385 timeout: 928 lvb_type: 0 00010000:00010000:0.0:1746129573.553142:0:15749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129573.553199:0:15749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ced880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+26:1960:x1830948734196736:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 114us (2846us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129573.553205:0:15749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8390 00000100:00100000:0.0:1746129573.553219:0:15749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8391 00000100:00100000:0.0:1746129573.553224:0:15749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ceca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ada2ffba-8920-4ecb-8068-68caa9806978+36:1962:x1830948734196864:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129573.553230:0:15749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129573.553238:0:15749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880132eddc00/0x40a459093b06a06d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f211e4 expref: 36 pid: 7148 timeout: 928 lvb_type: 0 00010000:00010000:0.0:1746129573.553245:0:15749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880132eddc00/0x40a459093b06a06d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f211e4 expref: 36 pid: 7148 timeout: 928 lvb_type: 0 00010000:00010000:0.0:1746129573.553257:0:15749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880132eddc00/0x40a459093b06a06d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f211e4 expref: 36 pid: 7148 timeout: 928 lvb_type: 0 00010000:00010000:0.0:1746129573.553270:0:15749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129573.553284:0:15749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ceca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ada2ffba-8920-4ecb-8068-68caa9806978+35:1962:x1830948734196864:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 60us (2378us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129573.553318:0:15749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8391 00000100:00100000:0.0:1746129573.553331:0:15749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8392 00000100:00100000:0.0:1746129573.553336:0:15749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b552d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:068dab75-d300-4ead-a742-d14572ad1e50+14:1962:x1830948734196352:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129573.553343:0:15749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129573.553350:0:15749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880132edd400/0x40a459093b06a1bd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f212bd expref: 14 pid: 7149 timeout: 928 lvb_type: 1 00010000:00010000:0.0:1746129573.553357:0:15749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880132edd400/0x40a459093b06a1bd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f212bd expref: 14 pid: 7149 timeout: 928 lvb_type: 1 00010000:00010000:0.0:1746129573.553369:0:15749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880132edd400/0x40a459093b06a1bd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f212bd expref: 14 pid: 7149 timeout: 928 lvb_type: 1 00010000:00010000:0.0:1746129573.553378:0:15749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129573.553380:0:15749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129573.553384:0:15749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008fafec00/0x40a459093b06a4f0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129573.553391:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fc8dc00/0x40a459093b06a49c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f214c3 expref: 13 pid: 4699 timeout: 928 lvb_type: 1 00010000:00010000:0.0:1746129573.553392:0:15749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fafec00/0x40a459093b06a4f0 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129573.553402:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746129573.553413:0:15749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129573.553420:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a45050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:068dab75-d300-4ead-a742-d14572ad1e50+12:1961:x1830948734195968:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 459us (3193us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129573.553426:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8388 00000100:00100000:0.0:1746129573.553429:0:15749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b552d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:068dab75-d300-4ead-a742-d14572ad1e50+12:1962:x1830948734196352:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 92us (742us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129573.553433:0:15749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8392 00000100:00100000:0.0:1746129573.553450:0:15749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8393 00000100:00100000:0.0:1746129573.553454:0:15749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b552680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:1962:x1830948734196992:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129573.553461:0:15749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129573.553474:0:15749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fd29c00/0x40a459093b06a3a0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f213ea expref: 20 pid: 7148 timeout: 928 lvb_type: 0 00010000:00010000:0.0:1746129573.553482:0:15749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fd29c00/0x40a459093b06a3a0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f213ea expref: 20 pid: 7148 timeout: 928 lvb_type: 0 00010000:00010000:3.0:1746129573.553490:0:8412:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008fafec00/0x40a459093b06a4f0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129573.553494:0:15749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fd29c00/0x40a459093b06a3a0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f213ea expref: 20 pid: 7148 timeout: 928 lvb_type: 0 00010000:00010000:3.0:1746129573.553498:0:8412:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008fafec00/0x40a459093b06a4f0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129573.553506:0:15749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746129573.553517:0:8412:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008fafec00/0x40a459093b06a4f0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129573.553520:0:15749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b552680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+19:1962:x1830948734196992:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 66us (787us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129573.553525:0:15749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8393 00010000:00010000:2.0:1746129573.553610:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c22ca00/0x40a459093b06a265 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21318 expref: 34 pid: 7149 timeout: 928 lvb_type: 0 00010000:00010000:2.0:1746129573.553619:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129573.553620:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129573.553623:0:7085:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f445000/0x40a459093b06a4e2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129573.553630:0:7085:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f445000/0x40a459093b06a4e2 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129573.553644:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746129573.553651:0:8412:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008fafec00/0x40a459093b06a4f0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129573.553659:0:8412:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008fafec00/0x40a459093b06a4f0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129573.553665:0:8412:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008fafec00 already unused, calling callback (ffffffffa086ed70) 00010000:00010000:3.0:1746129573.553668:0:8412:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008fafec00/0x40a459093b06a4f0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129573.553676:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ceed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ada2ffba-8920-4ecb-8068-68caa9806978+33:1961:x1830948734196480:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 700us (3393us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129573.553682:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8389 00010000:00010000:0.0:1746129573.553738:0:7149:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008f445000/0x40a459093b06a4e2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129573.553745:0:7149:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f445000/0x40a459093b06a4e2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129573.553759:0:7149:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008f445000/0x40a459093b06a4e2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129573.553770:0:7149:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008f445000/0x40a459093b06a4e2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129573.553775:0:7149:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008f445000/0x40a459093b06a4e2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129573.553780:0:8412:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008fafec00/0x40a459093b06a4f0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129573.553780:0:7149:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f445000 already unused, calling callback (ffffffffa086ed70) 00010000:00010000:0.0:1746129573.553783:0:7149:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008f445000/0x40a459093b06a4e2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129573.553789:0:8412:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008fafec00/0x40a459093b06a4f0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129573.553789:0:7149:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008f445000/0x40a459093b06a4e2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129573.553795:0:8412:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008fafec00/0x40a459093b06a4f0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129573.553797:0:7149:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008f445000/0x40a459093b06a4e2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129573.553803:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f445000/0x40a459093b06a4e2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129573.553853:0:8412:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:068dab75-d300-4ead-a742-d14572ad1e50+10:1960:x1830948734194944:12345-192.168.202.4@tcp:1:mirror_io.0 Request processed in 16953us (17339us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129573.553855:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:068dab75-d300-4ead-a742-d14572ad1e50+10:1960:x1830948734194816:12345-192.168.202.4@tcp:1:mirror_io.0 Request processed in 17215us (17359us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129573.553862:0:8412:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16344 00000100:00100000:0.0:1746129573.553866:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16343 00000100:00100000:3.0:1746129573.555461:0:21725:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ced500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ada2ffba-8920-4ecb-8068-68caa9806978+36:1961:x1830948734196608:12345-192.168.202.4@tcp:4:cat.0 Request processed in 6624us (7071us total) trans 21474841378 rc 0/0 00000100:00100000:3.0:1746129573.555473:0:21725:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2447 00002000:00100000:3.0:1746129573.555484:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ee:0x0] (2039808->2097151) req@ffff880093ced500 x1830948734196608/t21474841378(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:314/0 lens 488/448 e 0 to 0 dl 1746129584 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129573.555494:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ced500 with x1830948734196608 ext(2039808->2097151) 00010000:00010000:3.0:1746129573.555503:0:21725:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800952f7800/0x40a459093b06a41e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2039808->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2145a expref: 36 pid: 22480 timeout: 928 lvb_type: 0 00010000:00010000:3.0:1746129573.555514:0:21725:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800952f7800/0x40a459093b06a41e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2039808->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2145a expref: 36 pid: 22480 timeout: 928 lvb_type: 0 00002000:00010000:3.0:1746129573.555520:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093ced500 00000100:00100000:1.0:1746129573.561617:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129573.561667:0:20578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734197120 00000100:00100000:2.0:1746129573.561677:0:20578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734197120 00010000:00010000:2.0:1746129573.561722:0:20578:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f444400/0x40a459093b06a44f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [3141632->3145727] (req 3141632->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2148b expref: 19 pid: 31503 timeout: 928 lvb_type: 0 00000100:00100000:2.0:1746129573.561773:0:20578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8394 00000100:00100000:2.0:1746129573.561781:0:20578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b550700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+19:1963:x1830948734197120:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129573.561799:0:20578:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129573.561825:0:20578:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f444400/0x40a459093b06a44f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [3141632->3145727] (req 3141632->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2148b expref: 19 pid: 31503 timeout: 928 lvb_type: 0 00010000:00010000:2.0:1746129573.561836:0:20578:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f444400/0x40a459093b06a44f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [3141632->3145727] (req 3141632->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2148b expref: 19 pid: 31503 timeout: 928 lvb_type: 0 00010000:00010000:2.0:1746129573.561860:0:20578:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f444400/0x40a459093b06a44f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [3141632->3145727] (req 3141632->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2148b expref: 19 pid: 31503 timeout: 928 lvb_type: 0 00010000:00010000:2.0:1746129573.561876:0:20578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129573.561878:0:20578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129573.561884:0:20578:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008fac1a00/0x40a459093b06a4fe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129573.561894:0:20578:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008fac1a00/0x40a459093b06a4fe lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129573.561931:0:20578:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746129573.561955:0:22481:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88008fac1a00/0x40a459093b06a4fe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129573.561966:0:22481:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008fac1a00/0x40a459093b06a4fe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 22481 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129573.561978:0:20578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b550700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+18:1963:x1830948734197120:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 197us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129573.561985:0:20578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8394 00010000:00010000:1.0:1746129573.561993:0:22481:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008fac1a00/0x40a459093b06a4fe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129573.562001:0:22481:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008fac1a00/0x40a459093b06a4fe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129573.562008:0:22481:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008fac1a00/0x40a459093b06a4fe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129573.562014:0:22481:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008fac1a00 already unused, calling callback (ffffffffa086ed70) 00010000:00010000:1.0:1746129573.562018:0:22481:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008fac1a00/0x40a459093b06a4fe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129573.562025:0:22481:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008fac1a00/0x40a459093b06a4fe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129573.562036:0:22481:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008fac1a00/0x40a459093b06a4fe lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129573.562042:0:22481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008fac1a00/0x40a459093b06a4fe lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 22481 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129573.562086:0:22481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:068dab75-d300-4ead-a742-d14572ad1e50+9:1960:x1830948734195200:12345-192.168.202.4@tcp:1:mirror_io.0 Request processed in 24278us (25536us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129573.562094:0:22481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16346 00000100:00100000:0.0:1746129573.563828:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129573.564708:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734197248 00000100:00100000:3.0:1746129573.564719:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734197248 00010000:00010000:3.0:1746129573.564762:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800952f7800/0x40a459093b06a41e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2039808->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2145a expref: 36 pid: 22480 timeout: 928 lvb_type: 0 00000100:00100000:3.0:1746129573.565606:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8395 00000100:00100000:3.0:1746129573.565618:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a44c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ada2ffba-8920-4ecb-8068-68caa9806978+36:1960:x1830948734197248:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129573.565634:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129573.565661:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800952f7800/0x40a459093b06a41e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2039808->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2145a expref: 36 pid: 22480 timeout: 928 lvb_type: 0 00010000:00010000:3.0:1746129573.565675:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800952f7800/0x40a459093b06a41e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2039808->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2145a expref: 36 pid: 22480 timeout: 928 lvb_type: 0 00010000:00010000:3.0:1746129573.565704:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800952f7800/0x40a459093b06a41e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2039808->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2145a expref: 36 pid: 22480 timeout: 928 lvb_type: 0 00010000:00010000:3.0:1746129573.565726:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129573.565728:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129573.565732:0:7085:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d94f000/0x40a459093b06a4f7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129573.565741:0:7085:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d94f000/0x40a459093b06a4f7 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129573.565767:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746129573.565921:0:7148:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012d94f000/0x40a459093b06a4f7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129573.565936:0:7148:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d94f000/0x40a459093b06a4f7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129573.565959:0:7148:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012d94f000/0x40a459093b06a4f7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129573.565966:0:7148:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012d94f000/0x40a459093b06a4f7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129573.565973:0:7148:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012d94f000/0x40a459093b06a4f7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129573.565979:0:7148:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d94f000 already unused, calling callback (ffffffffa086ed70) 00010000:00010000:0.0:1746129573.565982:0:7148:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012d94f000/0x40a459093b06a4f7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129573.565988:0:7148:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012d94f000/0x40a459093b06a4f7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129573.565998:0:7148:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012d94f000/0x40a459093b06a4f7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129573.566004:0:7148:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d94f000/0x40a459093b06a4f7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129573.567324:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a44c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ada2ffba-8920-4ecb-8068-68caa9806978+35:1960:x1830948734197248:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 1701us (3496us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129573.567336:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8395 00000100:00100000:0.0:1746129573.567412:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:068dab75-d300-4ead-a742-d14572ad1e50+8:1960:x1830948734195072:12345-192.168.202.4@tcp:1:mirror_io.0 Request processed in 30409us (30877us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129573.567422:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16345 00000100:00100000:2.0:1746129573.577768:0:31521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013145ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+26:1963:x1830948734196096:12345-192.168.202.4@tcp:4:cat.0 Request processed in 29180us (29478us total) trans 17179874128 rc 0/0 00000100:00100000:2.0:1746129573.577782:0:31521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2445 00002000:00100000:2.0:1746129573.577794:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f5:0x0] (2097152->3071999) req@ffff88013145ca80 x1830948734196096/t17179874128(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:314/0 lens 488/448 e 0 to 0 dl 1746129584 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129573.577804:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013145ca80 with x1830948734196096 ext(2097152->3071999) 00010000:00010000:2.0:1746129573.577814:0:31521:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800946f0e00/0x40a459093b06a472 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3071999) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f214ae expref: 26 pid: 4385 timeout: 928 lvb_type: 0 00010000:00010000:2.0:1746129573.577833:0:31521:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800946f0e00/0x40a459093b06a472 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3071999) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f214ae expref: 26 pid: 4385 timeout: 928 lvb_type: 0 00002000:00010000:2.0:1746129573.577840:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88013145ca80 00000100:00100000:2.0:1746129573.583766:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129573.584606:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734197376 00000100:00100000:3.0:1746129573.584616:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734197376 00010000:00010000:3.0:1746129573.584658:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800946f0e00/0x40a459093b06a472 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3071999) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f214ae expref: 26 pid: 4385 timeout: 928 lvb_type: 0 00000100:00100000:3.0:1746129573.584698:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8396 00000100:00100000:3.0:1746129573.584706:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a77b1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+26:1960:x1830948734197376:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129573.584722:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129573.584746:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800946f0e00/0x40a459093b06a472 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3071999) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f214ae expref: 26 pid: 4385 timeout: 928 lvb_type: 0 00010000:00010000:3.0:1746129573.584763:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800946f0e00/0x40a459093b06a472 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3071999) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f214ae expref: 26 pid: 4385 timeout: 928 lvb_type: 0 00010000:00010000:3.0:1746129573.584786:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800946f0e00/0x40a459093b06a472 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3071999) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f214ae expref: 26 pid: 4385 timeout: 928 lvb_type: 0 00010000:00010000:3.0:1746129573.584815:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129573.584818:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129573.584822:0:7085:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008fac0000/0x40a459093b06a505 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129573.584830:0:7085:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fac0000/0x40a459093b06a505 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129573.584863:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129573.584908:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a77b1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+25:1960:x1830948734197376:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 203us (1152us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129573.584916:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8396 00010000:00010000:1.0:1746129573.584999:0:20577:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008fac0000/0x40a459093b06a505 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129573.585008:0:20577:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008fac0000/0x40a459093b06a505 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129573.585029:0:20577:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008fac0000/0x40a459093b06a505 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129573.585036:0:20577:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008fac0000/0x40a459093b06a505 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129573.585044:0:20577:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008fac0000/0x40a459093b06a505 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129573.585051:0:20577:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008fac0000 already unused, calling callback (ffffffffa086ed70) 00010000:00010000:1.0:1746129573.585054:0:20577:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008fac0000/0x40a459093b06a505 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129573.585061:0:20577:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008fac0000/0x40a459093b06a505 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129573.585070:0:20577:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008fac0000/0x40a459093b06a505 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129573.585075:0:20577:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008fac0000/0x40a459093b06a505 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129573.585122:0:20577:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:068dab75-d300-4ead-a742-d14572ad1e50+8:1960:x1830948734195328:12345-192.168.202.4@tcp:1:mirror_io.0 Request processed in 47194us (48548us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129573.585131:0:20577:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16347 00000100:00100000:0.0:1746129573.586857:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129573.586933:0:16908:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734197632 00000100:00100000:3.0:1746129573.586940:0:16908:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734197632 00000100:00100000:3.0:1746129573.586977:0:16908:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11247 00000100:00100000:3.0:1746129573.586984:0:16908:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095624700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:068dab75-d300-4ead-a742-d14572ad1e50+14:32385:x1830948734197632:12345-192.168.202.4@tcp:36:mirror_io.0 00010000:00010000:3.0:1746129573.587036:0:16908:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129573.587062:0:16908:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c63ec00/0x40a459093b069f5c lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21135 expref: 14 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129573.587083:0:16908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:3.0:1746129573.587086:0:16908:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746129573.587116:0:16908:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7e1400/0x40a459093b06a50c lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129573.587126:0:16908:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ebb3600/0x40a459093b069f55 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2112e expref: 304 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129573.587133:0:16908:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c40a400/0x40a459093b069f63 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2113c expref: 24 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129573.587139:0:16908:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880090078000/0x40a459093b06a337 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2139d expref: 304 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129573.587144:0:16908:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee7fc00/0x40a459093b06a345 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f213a4 expref: 24 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129573.587151:0:16908:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95ed800/0x40a459093b06a162 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2129a expref: 304 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129573.587156:0:16908:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094fef000/0x40a459093b06a185 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f212a1 expref: 24 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129573.587161:0:16908:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7e1400/0x40a459093b06a50c lrc: 9/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129573.587189:0:16908:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094fef000/0x40a459093b06a185 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f212a1 expref: 24 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129573.587203:0:16908:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094fef000/0x40a459093b06a185 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f212a1 expref: 24 pid: 15096 timeout: 928 lvb_type: 0 00000100:00100000:3.0:1746129573.587216:0:16908:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bf480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16908:1830948737544320:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129573.590239:0:16908:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95ed800/0x40a459093b06a162 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2129a expref: 304 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129573.590258:0:16908:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95ed800/0x40a459093b06a162 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2129a expref: 304 pid: 16908 timeout: 928 lvb_type: 0 00000100:00100000:3.0:1746129573.590273:0:16908:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bea00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16908:1830948737544448:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129573.590894:0:16908:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee7fc00/0x40a459093b06a345 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f213a4 expref: 24 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129573.590904:0:16908:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee7fc00/0x40a459093b06a345 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f213a4 expref: 24 pid: 16908 timeout: 928 lvb_type: 0 00000100:00100000:3.0:1746129573.590913:0:16908:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947be680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16908:1830948737544576:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129573.590949:0:16908:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880090078000/0x40a459093b06a337 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2139d expref: 304 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129573.590955:0:16908:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880090078000/0x40a459093b06a337 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2139d expref: 304 pid: 14549 timeout: 928 lvb_type: 0 00000100:00100000:3.0:1746129573.590963:0:16908:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bed80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16908:1830948737544704:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129573.590987:0:16908:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009c40a400/0x40a459093b069f63 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2113c expref: 24 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129573.590993:0:16908:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c40a400/0x40a459093b069f63 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2113c expref: 24 pid: 15096 timeout: 928 lvb_type: 0 00000100:00100000:3.0:1746129573.590999:0:16908:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bc000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16908:1830948737544832:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129573.591016:0:16908:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008ebb3600/0x40a459093b069f55 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2112e expref: 304 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129573.591022:0:16908:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ebb3600/0x40a459093b069f55 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2112e expref: 304 pid: 16908 timeout: 928 lvb_type: 0 00000100:00100000:3.0:1746129573.591028:0:16908:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bca80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16908:1830948737544960:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129573.591040:0:16908:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e29fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129573.594146:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129573.594186:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129573.594208:0:20578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734197888 00000100:00100000:2.0:1746129573.594217:0:20578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734197888 00000100:00100000:0.0:1746129573.594226:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129573.594262:0:16680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734198400 00000100:00100000:1.0:1746129573.594266:0:16680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734198400 00000100:00100000:1.0:1746129573.594334:0:16680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4778 00000100:00100000:1.0:1746129573.594343:0:16680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f532850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+25:27693:x1830948734198400:12345-192.168.202.4@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1746129573.594346:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129573.594424:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734197760 00000100:00100000:3.0:1746129573.594428:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734197760 00010000:00010000:3.0:1746129573.594452:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094fef000/0x40a459093b06a185 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f212a1 expref: 26 pid: 15096 timeout: 928 lvb_type: 0 00000100:00100000:3.0:1746129573.594473:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8397 00000100:00100000:3.0:1746129573.594478:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+26:1960:x1830948734197760:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129573.594488:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129573.594494:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094fef000/0x40a459093b06a185 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f212a1 expref: 27 pid: 15096 timeout: 928 lvb_type: 0 00010000:00010000:3.0:1746129573.594504:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094fef000/0x40a459093b06a185 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f212a1 expref: 27 pid: 15096 timeout: 928 lvb_type: 0 00010000:00010000:3.0:1746129573.594529:0:7085:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:3.0:1746129573.594534:0:7085:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7e1400/0x40a459093b06a50c lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129573.594543:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129573.594566:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+27:1960:x1830948734197760:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 88us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129573.594573:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8397 00010000:00010000:3.0:1746129573.594613:0:16908:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094fef000/0x40a459093b06a185 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f212a1 expref: 26 pid: 15096 timeout: 928 lvb_type: 0 00000100:00100000:3.0:1746129573.594625:0:16908:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bf480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16908:1830948737544320:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129573.594635:0:16908:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bea00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16908:1830948737544448:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129573.594640:0:16908:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947be680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16908:1830948737544576:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129573.594646:0:16908:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bed80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16908:1830948737544704:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129573.594652:0:16908:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bc000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16908:1830948737544832:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129573.594658:0:16908:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bca80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16908:1830948737544960:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129573.594694:0:16908:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7e1400/0x40a459093b06a50c lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00000100:00100000:1.0:1746129573.594767:0:16680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f532850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+25:27693:x1830948734198400:12345-192.168.202.4@tcp:35:ldlm_bl.0 Request processed in 424us (538us total) trans 8589945349 rc 0/0 00000100:00100000:1.0:1746129573.594773:0:16680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4778 00000100:00100000:1.0:1746129573.594809:0:16680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734198144 00000100:00100000:1.0:1746129573.594812:0:16680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734198144 00010000:00010000:2.0:1746129573.594870:0:20578:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95ed800/0x40a459093b06a162 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2129a expref: 306 pid: 16908 timeout: 928 lvb_type: 0 00000100:00100000:1.0:1746129573.594897:0:16680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4779 00000100:00100000:2.0:1746129573.594898:0:20578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8398 00000100:00100000:2.0:1746129573.594903:0:20578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095626d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ada2ffba-8920-4ecb-8068-68caa9806978+306:1963:x1830948734197888:12345-192.168.202.4@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746129573.594903:0:16680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094efd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ada2ffba-8920-4ecb-8068-68caa9806978+306:23750:x1830948734198144:12345-192.168.202.4@tcp:35:ldlm_bl.0 00010000:00010000:2.0:1746129573.594910:0:20578:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129573.594914:0:20578:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95ed800/0x40a459093b06a162 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2129a expref: 306 pid: 16908 timeout: 928 lvb_type: 0 00010000:00010000:2.0:1746129573.594922:0:20578:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95ed800/0x40a459093b06a162 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2129a expref: 306 pid: 16908 timeout: 928 lvb_type: 0 00010000:00010000:2.0:1746129573.594933:0:20578:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95ed800/0x40a459093b06a162 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2129a expref: 306 pid: 16908 timeout: 928 lvb_type: 0 00010000:00010000:2.0:1746129573.594945:0:20578:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:2.0:1746129573.594948:0:20578:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7e1400/0x40a459093b06a50c lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129573.594954:0:20578:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129573.594973:0:16680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094efd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ada2ffba-8920-4ecb-8068-68caa9806978+306:23750:x1830948734198144:12345-192.168.202.4@tcp:35:ldlm_bl.0 Request processed in 70us (627us total) trans 8589945350 rc 0/0 00000100:00100000:2.0:1746129573.594978:0:20578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095626d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ada2ffba-8920-4ecb-8068-68caa9806978+306:1963:x1830948734197888:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 76us (844us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129573.594984:0:20578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8398 00000100:00100000:1.0:1746129573.595092:0:16680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4779 00000100:00100000:0.0:1746129573.596249:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129573.596342:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129573.596358:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734198528 00000100:00100000:0.0:1746129573.596363:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734198528 00010000:00010000:0.0:1746129573.596391:0:7087:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c40a400/0x40a459093b069f63 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2113c expref: 25 pid: 15096 timeout: 928 lvb_type: 0 00000100:00100000:0.0:1746129573.596419:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734198656 00000100:00100000:0.0:1746129573.596421:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734198656 00010000:00010000:0.0:1746129573.596428:0:7087:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ebb3600/0x40a459093b069f55 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2112e expref: 305 pid: 16908 timeout: 928 lvb_type: 0 00000100:00100000:0.0:1746129573.596441:0:7087:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8399 00000100:00100000:0.0:1746129573.596447:0:7087:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094efdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+25:1963:x1830948734198528:12345-192.168.202.4@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746129573.596454:0:20578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8400 00010000:00010000:0.0:1746129573.596458:0:7087:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746129573.596462:0:20578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094efce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ada2ffba-8920-4ecb-8068-68caa9806978+305:1962:x1830948734198656:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129573.596462:0:7087:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009c40a400/0x40a459093b069f63 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2113c expref: 25 pid: 15096 timeout: 928 lvb_type: 0 00010000:00010000:2.0:1746129573.596470:0:20578:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129573.596472:0:7087:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009c40a400/0x40a459093b069f63 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2113c expref: 25 pid: 15096 timeout: 928 lvb_type: 0 00010000:00010000:2.0:1746129573.596475:0:20578:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008ebb3600/0x40a459093b069f55 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2112e expref: 305 pid: 16908 timeout: 928 lvb_type: 0 00010000:00010000:0.0:1746129573.596488:0:7087:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c40a400/0x40a459093b069f63 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2113c expref: 25 pid: 15096 timeout: 928 lvb_type: 0 00010000:00010000:2.0:1746129573.596489:0:20578:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008ebb3600/0x40a459093b069f55 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2112e expref: 305 pid: 16908 timeout: 928 lvb_type: 0 00010000:00010000:2.0:1746129573.596501:0:20578:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ebb3600/0x40a459093b069f55 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2112e expref: 305 pid: 16908 timeout: 928 lvb_type: 0 00010000:00010000:0.0:1746129573.596503:0:7087:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:0.0:1746129573.596507:0:7087:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7e1400/0x40a459093b06a50c lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129573.596514:0:7087:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746129573.596673:0:20578:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:2.0:1746129573.596677:0:20578:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7e1400/0x40a459093b06a50c lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129573.596682:0:20578:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129573.597134:0:20578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094efce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ada2ffba-8920-4ecb-8068-68caa9806978+304:1962:x1830948734198656:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 671us (789us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129573.597134:0:7087:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094efdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+24:1963:x1830948734198528:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 686us (888us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129573.597140:0:7087:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8399 00000100:00100000:0.0:1746129573.598882:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129573.598930:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129573.598944:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734198784 00000100:00100000:1.0:1746129573.598952:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734198784 00010000:00010000:1.0:1746129573.598983:0:7087:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090078000/0x40a459093b06a337 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2139d expref: 305 pid: 14549 timeout: 928 lvb_type: 0 00000100:00100000:2.0:1746129573.599137:0:20578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8400 00000100:00100000:2.0:1746129573.599160:0:20578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734198912 00000100:00100000:2.0:1746129573.599163:0:20578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734198912 00010000:00010000:2.0:1746129573.599175:0:20578:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee7fc00/0x40a459093b06a345 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f213a4 expref: 24 pid: 16908 timeout: 928 lvb_type: 0 00000100:00100000:2.0:1746129573.599193:0:20578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8401 00000100:00100000:2.0:1746129573.599199:0:20578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a44850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+24:1962:x1830948734198912:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129573.599211:0:20578:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129573.599216:0:20578:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee7fc00/0x40a459093b06a345 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f213a4 expref: 24 pid: 16908 timeout: 928 lvb_type: 0 00010000:00010000:2.0:1746129573.599226:0:20578:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee7fc00/0x40a459093b06a345 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f213a4 expref: 24 pid: 16908 timeout: 928 lvb_type: 0 00010000:00010000:2.0:1746129573.599250:0:20578:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee7fc00/0x40a459093b06a345 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f213a4 expref: 24 pid: 16908 timeout: 928 lvb_type: 0 00010000:00010000:2.0:1746129573.599262:0:20578:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:2.0:1746129573.599266:0:20578:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7e1400/0x40a459093b06a50c lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129573.599272:0:20578:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129573.599336:0:20578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a44850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+23:1962:x1830948734198912:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 136us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129573.599442:0:7087:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8402 00000100:00100000:1.0:1746129573.599448:0:7087:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093edc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ada2ffba-8920-4ecb-8068-68caa9806978+304:1962:x1830948734198784:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129573.599455:0:7087:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129573.599459:0:7087:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880090078000/0x40a459093b06a337 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2139d expref: 304 pid: 14549 timeout: 928 lvb_type: 0 00010000:00010000:1.0:1746129573.599472:0:7087:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880090078000/0x40a459093b06a337 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2139d expref: 304 pid: 14549 timeout: 928 lvb_type: 0 00010000:00010000:1.0:1746129573.599483:0:7087:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090078000/0x40a459093b06a337 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2139d expref: 304 pid: 14549 timeout: 928 lvb_type: 0 00010000:00010000:1.0:1746129573.599495:0:7087:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:1.0:1746129573.599498:0:7087:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7e1400/0x40a459093b06a50c lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129573.599504:0:7087:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7e1400/0x40a459093b06a50c lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129573.599509:0:7087:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7e1400/0x40a459093b06a50c lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129573.599529:0:7087:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129573.599560:0:7087:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093edc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ada2ffba-8920-4ecb-8068-68caa9806978+303:1962:x1830948734198784:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 112us (685us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129573.599566:0:7087:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8402 00000100:00100000:2.0:1746129573.599647:0:20578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8401 00010000:00010000:3.0:1746129573.599778:0:16908:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7e1400/0x40a459093b06a50c lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129573.599785:0:16908:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7e1400/0x40a459093b06a50c lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00000040:00080000:3.0:1746129573.600425:0:16908:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3472, 88 off292264 00000004:00080000:3.0:1746129573.600434:0:16908:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 828917139772ns, next at 776349687452ns, rc = 0 00000040:00080000:3.0:1746129573.600485:0:16908:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3484, 88 off293232 00000004:00080000:3.0:1746129573.600490:0:16908:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 828917195932ns, next at 776375382381ns, rc = 0 00000040:00080000:3.0:1746129573.600511:0:16908:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3485, 88 off293320 00000004:00080000:3.0:1746129573.600514:0:16908:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 828917220195ns, next at 776375382381ns, rc = 0 00000040:00080000:3.0:1746129573.600521:0:16908:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3473, 88 off292352 00000004:00080000:3.0:1746129573.600523:0:16908:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 828917229110ns, next at 776349687452ns, rc = 0 00000040:00080000:3.0:1746129573.600529:0:16908:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3474, 88 off292440 00000004:00080000:3.0:1746129573.600531:0:16908:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 828917237142ns, next at 776349687452ns, rc = 0 00000040:00080000:3.0:1746129573.600536:0:16908:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3486, 88 off293408 00000004:00080000:3.0:1746129573.600539:0:16908:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 828917244865ns, next at 776375382381ns, rc = 0 00000040:00080000:3.0:1746129573.600544:0:16908:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3487, 88 off293496 00000004:00080000:3.0:1746129573.600546:0:16908:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 828917252547ns, next at 776375382381ns, rc = 0 00000040:00080000:3.0:1746129573.600551:0:16908:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3488, 88 off293584 00000004:00080000:3.0:1746129573.600554:0:16908:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 828917259803ns, next at 776375382381ns, rc = 0 00000040:00080000:3.0:1746129573.600559:0:16908:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3475, 88 off292528 00000004:00080000:3.0:1746129573.600561:0:16908:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 828917267252ns, next at 776349687452ns, rc = 0 00000040:00080000:3.0:1746129573.600566:0:16908:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3489, 88 off293672 00000004:00080000:3.0:1746129573.600571:0:16908:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 828917277180ns, next at 776375382381ns, rc = 0 00000040:00080000:3.0:1746129573.600577:0:16908:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3476, 88 off292616 00000004:00080000:3.0:1746129573.600579:0:16908:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 828917285340ns, next at 776349687452ns, rc = 0 00000040:00080000:3.0:1746129573.600584:0:16908:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3490, 88 off293760 00000004:00080000:3.0:1746129573.600587:0:16908:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 828917292815ns, next at 776375382381ns, rc = 0 00000040:00080000:3.0:1746129573.600592:0:16908:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3477, 88 off292704 00000004:00080000:3.0:1746129573.600594:0:16908:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 828917300625ns, next at 776349687452ns, rc = 0 00000040:00080000:3.0:1746129573.600601:0:16908:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3478, 88 off292792 00000004:00080000:3.0:1746129573.600603:0:16908:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 828917309300ns, next at 776349687452ns, rc = 0 00000040:00080000:3.0:1746129573.600608:0:16908:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3479, 88 off292880 00000004:00080000:3.0:1746129573.600610:0:16908:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 828917316722ns, next at 776349687452ns, rc = 0 00000040:00080000:3.0:1746129573.600616:0:16908:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3480, 88 off292968 00000004:00080000:3.0:1746129573.600618:0:16908:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 828917324022ns, next at 776349687452ns, rc = 0 00000040:00080000:3.0:1746129573.600623:0:16908:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3491, 88 off293848 00000004:00080000:3.0:1746129573.600625:0:16908:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 828917330900ns, next at 776375382381ns, rc = 0 00000001:00080000:1.0:1746129573.635052:0:14619:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945340 is committed 00000001:00080000:1.0:1746129573.635069:0:14619:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945329 is committed 00000004:00010000:2.0:1746129573.635078:0:16908:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880095624700 reply state ffff880094ccbc00 transno 8589945351 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7e1400/0x40a459093b06a50c lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00000001:00080000:1.0:1746129573.635081:0:14619:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945350 is committed 00000001:00080000:1.0:1746129573.635085:0:14619:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945349 is committed 00000100:00100000:2.0:1746129573.635090:0:16908:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1746129573.635097:0:14619:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945331 is committed 00000001:00080000:1.0:1746129573.635132:0:14619:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945333 is committed 00000001:00080000:1.0:1746129573.635155:0:14619:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945351 is committed 00000004:00080000:1.0:1746129573.635161:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2661 committed 00000004:00080000:1.0:1746129573.635179:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2650 committed 00000004:00080000:1.0:1746129573.635187:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2649 committed 00000004:00080000:1.0:1746129573.635189:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2648 committed 00000004:00080000:1.0:1746129573.635191:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2647 committed 00000004:00080000:1.0:1746129573.635193:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2660 committed 00000004:00080000:1.0:1746129573.635194:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2646 committed 00000004:00080000:1.0:1746129573.635196:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2659 committed 00000004:00080000:1.0:1746129573.635197:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2645 committed 00000004:00080000:1.0:1746129573.635199:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2658 committed 00000004:00080000:1.0:1746129573.635201:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2657 committed 00000004:00080000:1.0:1746129573.635202:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2656 committed 00000004:00080000:1.0:1746129573.635204:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2644 committed 00000004:00080000:1.0:1746129573.635205:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2643 committed 00000004:00080000:1.0:1746129573.635207:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2655 committed 00000004:00080000:1.0:1746129573.635208:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2654 committed 00000004:00080000:1.0:1746129573.635210:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2642 committed 00000100:00100000:1.0:1746129573.635391:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b553100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737545088:0@lo:2:osp-syn-0-0.0 00010000:00080000:2.0:1746129573.635483:0:16908:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1746129573.635500:0:16908:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095624700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:068dab75-d300-4ead-a742-d14572ad1e50+8:32385:x1830948734197632:12345-192.168.202.4@tcp:36:mirror_io.0 Request processed in 48509us (48647us total) trans 8589945351 rc 0/0 00000100:00100000:3.0:1746129573.635504:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b552d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737545216:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129573.635509:0:16908:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11247 00000100:00100000:1.0:1746129573.636145:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129573.636207:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737545600:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129573.636225:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129573.636244:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093eddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737546112:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129573.636260:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129573.636273:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093edc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737546624:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129573.636286:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1746129573.637008:0:3287:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7e1400/0x40a459093b06a50c lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129573.637019:0:3287:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7e1400/0x40a459093b06a50c lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129573.637026:0:3287:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7e1400/0x40a459093b06a50c lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129573.637031:0:3287:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f7e1400 already unused, calling callback (ffffffffa136e690) 00010000:00010000:3.0:1746129573.637035:0:3287:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7e1400/0x40a459093b06a50c lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129573.637042:0:3287:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7e1400/0x40a459093b06a50c lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129573.637058:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:3.0:1746129573.637061:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746129573.637065:0:3287:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7e1400/0x40a459093b06a50c lrc: 2/0,0 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129573.637070:0:3287:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7e1400/0x40a459093b06a50c lrc: 0/0,0 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16908 initiator: MDT0 00000100:00100000:1.0:1746129573.637466:0:3301:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:1.0:1746129573.637475:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b550700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737545472:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129573.637499:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129573.637512:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094065500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737545984:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129573.637525:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129573.637538:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093edd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737546496:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129573.637553:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129573.637564:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092fd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737547008:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129573.637577:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129573.637600:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b552680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1830948737545344:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129573.637615:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129573.637626:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1830948737545856:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129573.637639:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129573.637648:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093edce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1830948737546368:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129573.637660:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129573.637669:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092fd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1830948737546880:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129573.637702:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129573.637715:0:3303:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1746129573.638005:0:31503:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737545088 00000100:00100000:2.0:1746129573.638014:0:31503:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737545088 00000100:00100000:2.0:1746129573.638062:0:31503:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737545600 00000100:00100000:2.0:1746129573.638065:0:31503:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737545600 00000100:00100000:2.0:1746129573.638073:0:31503:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737546112 00000100:00100000:2.0:1746129573.638075:0:31503:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737546112 00000100:00100000:2.0:1746129573.638087:0:31503:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737546624 00000100:00100000:2.0:1746129573.638089:0:31503:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737546624 00000100:00100000:2.0:1746129573.638095:0:31503:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737545472 00000100:00100000:2.0:1746129573.638097:0:31503:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737545472 00000100:00100000:2.0:1746129573.638106:0:31503:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737545984 00000100:00100000:2.0:1746129573.638108:0:31503:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737545984 00000100:00100000:2.0:1746129573.638114:0:31503:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737546496 00000100:00100000:2.0:1746129573.638115:0:31503:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737546496 00000100:00100000:2.0:1746129573.638121:0:31503:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737547008 00000100:00100000:2.0:1746129573.638122:0:31503:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737547008 00000100:00100000:2.0:1746129573.638128:0:31503:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737545344 00000100:00100000:2.0:1746129573.638129:0:31503:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737545344 00000100:00100000:2.0:1746129573.638134:0:31503:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737545856 00000100:00100000:2.0:1746129573.638136:0:31503:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737545856 00000100:00100000:2.0:1746129573.638141:0:31503:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737546368 00000100:00100000:2.0:1746129573.638143:0:31503:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737546368 00000100:00100000:2.0:1746129573.638148:0:31503:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737546880 00000100:00100000:2.0:1746129573.638150:0:31503:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737546880 00000100:00100000:2.0:1746129573.638161:0:31503:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16348 00000100:00100000:2.0:1746129573.638168:0:31503:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094065c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+37:3301:x1830948737545088:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129573.638444:0:31503:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094065c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+38:3301:x1830948737545088:12345-0@lo:2:osp-syn-0-0.0 Request processed in 276us (2300us total) trans 21474841379 rc 0/0 00000100:00100000:2.0:1746129573.638450:0:31503:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16348 00000100:00100000:2.0:1746129573.638464:0:31503:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16349 00000100:00100000:2.0:1746129573.638469:0:31503:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094065180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+37:3301:x1830948737545600:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129573.638547:0:31503:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094065180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+38:3301:x1830948737545600:12345-0@lo:2:osp-syn-0-0.0 Request processed in 78us (2321us total) trans 21474841380 rc 0/0 00000100:00100000:2.0:1746129573.638552:0:31503:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16349 00000100:00100000:2.0:1746129573.638561:0:31503:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16350 00000100:00100000:2.0:1746129573.638565:0:31503:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094064380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+34:3301:x1830948737546112:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129573.638632:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16351 00000100:00100000:0.0:1746129573.638638:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094065880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+34:3301:x1830948737546624:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129573.638650:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16352 00000100:00100000:0.0:1746129573.638653:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094065f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+37:3301:x1830948737545472:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129573.638741:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094065f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+38:3301:x1830948737545472:12345-0@lo:2:osp-syn-0-0.0 Request processed in 87us (1242us total) trans 21474841381 rc 0/0 00000100:00100000:0.0:1746129573.638747:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16352 00000100:00100000:0.0:1746129573.638774:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16353 00000100:00100000:0.0:1746129573.638778:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094064700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+37:3301:x1830948737545984:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129573.638867:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094064700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+38:3301:x1830948737545984:12345-0@lo:2:osp-syn-0-0.0 Request processed in 89us (1341us total) trans 21474841382 rc 0/0 00000100:00100000:0.0:1746129573.638873:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16353 00000100:00100000:0.0:1746129573.638881:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16354 00000100:00100000:0.0:1746129573.638885:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094067800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+34:3301:x1830948737546496:12345-0@lo:2:osp-syn-1-0.0 00000100:00080000:0.0:1746129573.638900:0:7097:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1746129573.638903:0:7097:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1746129573.638970:0:8412:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16355 00000100:00100000:1.0:1746129573.638973:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093eded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1830948737546240:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129573.638977:0:8412:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094064000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+34:3301:x1830948737547008:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129573.638991:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16356 00000100:00100000:3.0:1746129573.638996:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094067100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+37:3303:x1830948737545344:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129573.639000:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129573.639021:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f44b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1830948737546752:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129573.639025:0:22481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737546240 00000100:00100000:0.0:1746129573.639028:0:22481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737546240 00000100:00100000:1.0:1746129573.639034:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129573.639043:0:22481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737546752 00000100:00100000:0.0:1746129573.639044:0:22481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737546752 00000100:00100000:0.0:1746129573.639053:0:22481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16357 00000100:00100000:0.0:1746129573.639057:0:22481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e389880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+37:3303:x1830948737545856:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129573.639110:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094067100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+38:3303:x1830948737545344:12345-0@lo:2:osp-syn-0-0.0 Request processed in 113us (1493us total) trans 21474841383 rc 0/0 00000100:00100000:3.0:1746129573.639116:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16356 00000100:00100000:1.0:1746129573.639120:0:20577:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16358 00000100:00100000:3.0:1746129573.639126:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16359 00000100:00100000:1.0:1746129573.639126:0:20577:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e388380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+36:3303:x1830948737546368:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746129573.639130:0:22481:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:3.0:1746129573.639131:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e389c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+36:3303:x1830948737546880:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746129573.639132:0:22481:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1746129573.639134:0:22481:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746129573.639136:0:22481:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746129573.639138:0:22481:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1746129573.639144:0:22480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16360 00000100:00100000:3.0:1746129573.639148:0:22480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e38bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+36:3303:x1830948737546240:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746129573.639156:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b552680/2, rc 0, transno 21474841383 00000100:00100000:0.0:1746129573.639156:0:22481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e389880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+38:3303:x1830948737545856:12345-0@lo:2:osp-syn-0-0.0 Request processed in 99us (1516us total) trans 21474841384 rc 0/0 00000100:00100000:0.0:1746129573.639161:0:22481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16357 00000100:00100000:3.0:1746129573.639164:0:8410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16361 00000100:00100000:1.0:1746129573.639165:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b552680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1830948737545344:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129573.639168:0:8410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e389f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+36:3303:x1830948737546752:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746129573.639173:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800900f4700/2, rc 0, transno 21474841384 00000100:00100000:1.0:1746129573.639176:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1830948737545856:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129573.639220:0:3300:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1746129573.639228:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e388e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737547136:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129573.639247:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129573.639261:0:8411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737547136 00000100:00100000:2.0:1746129573.639265:0:8411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737547136 00000100:00100000:2.0:1746129573.639279:0:8411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16362 00000100:00100000:2.0:1746129573.639283:0:8411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e38b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+38:3300:x1830948737547136:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129573.639378:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094065880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+37:3301:x1830948737546624:12345-0@lo:2:osp-syn-1-0.0 Request processed in 740us (3090us total) trans 17179874129 rc 0/0 00000100:00100000:3.0:1746129573.639383:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16351 00000100:00100000:2.0:1746129573.639404:0:8411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e38b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+39:3300:x1830948737547136:12345-0@lo:2:osp-syn-0-0.0 Request processed in 120us (156us total) trans 21474841385 rc 0/0 00000100:00100000:2.0:1746129573.639409:0:8411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16362 00002000:00010000:3.0:1746129573.639459:0:7149:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746129573.639461:0:7149:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb mtime from disk: 1746129523 -> 1746129523 00002000:00010000:3.0:1746129573.639464:0:7149:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb atime from disk: 1746129523 -> 1746129523 00002000:00010000:3.0:1746129573.639466:0:7149:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb ctime from disk: 1746129524 -> 1746129524 00002000:00010000:3.0:1746129573.639468:0:7149:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1746129573.639487:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094067800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+37:3301:x1830948737546496:12345-0@lo:2:osp-syn-1-0.0 Request processed in 601us (1933us total) trans 17179874130 rc 0/0 00000100:00100000:3.0:1746129573.639496:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16354 00000100:00100000:3.0:1746129573.639585:0:8412:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094064000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+37:3301:x1830948737547008:12345-0@lo:2:osp-syn-1-0.0 Request processed in 609us (2006us total) trans 17179874131 rc 0/0 00000100:00100000:3.0:1746129573.639590:0:8412:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16355 00000100:00100000:3.0:1746129573.639675:0:31503:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094064380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+37:3301:x1830948737546112:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1109us (3412us total) trans 17179874132 rc 0/0 00000100:00100000:3.0:1746129573.639680:0:31503:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16350 00000100:00100000:2.0:1746129573.640275:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129573.640383:0:20577:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e388380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+37:3303:x1830948737546368:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1257us (2720us total) trans 17179874133 rc 0/0 00000100:00100000:0.0:1746129573.640467:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129573.640497:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e389c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+38:3303:x1830948737546880:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1366us (2795us total) trans 17179874134 rc 0/0 00000004:00080000:0.0:1746129573.640499:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b550700/2, rc 0, transno 21474841381 00000100:00100000:0.0:1746129573.640502:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b550700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737545472:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129573.640503:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16359 00000004:00080000:0.0:1746129573.640510:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094065500/2, rc 0, transno 21474841382 00000100:00100000:0.0:1746129573.640512:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094065500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737545984:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129573.640517:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737545216 00000100:00100000:3.0:1746129573.640520:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737545216 00000004:00080000:0.0:1746129573.640521:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093edd500/2, rc 0, transno 17179874130 00000100:00100000:0.0:1746129573.640524:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093edd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737546496:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129573.640530:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092fd1180/2, rc 0, transno 17179874131 00000100:00100000:0.0:1746129573.640533:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092fd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737547008:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129573.640535:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16363 00000100:00100000:3.0:1746129573.640539:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a77b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+39:3302:x1830948737545216:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129573.640539:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093eddc00/2, rc 0, transno 17179874132 00000100:00100000:0.0:1746129573.640543:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093eddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737546112:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129573.640549:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093edc380/2, rc 0, transno 17179874129 00000100:00100000:0.0:1746129573.640552:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093edc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737546624:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129573.640559:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b553100/2, rc 0, transno 21474841379 00000100:00100000:0.0:1746129573.640561:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b553100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737545088:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129573.640568:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800900f5180/2, rc 0, transno 21474841380 00000100:00100000:0.0:1746129573.640570:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737545600:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129573.640759:0:20577:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16358 00000004:00080000:1.0:1746129573.640788:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e388e00/2, rc 0, transno 21474841385 00000100:00100000:1.0:1746129573.640791:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e388e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737547136:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746129573.640805:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093edce00/2, rc 0, transno 17179874133 00000100:00100000:1.0:1746129573.640808:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093edce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1830948737546368:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746129573.640814:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092fd2a00/2, rc 0, transno 17179874134 00000100:00100000:1.0:1746129573.640816:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092fd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1830948737546880:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129573.641071:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a77b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+40:3302:x1830948737545216:12345-0@lo:2:osp-syn-0-0.0 Request processed in 530us (795us total) trans 21474841386 rc 0/0 00000100:00100000:3.0:1746129573.641076:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16363 00000100:00100000:3.0:1746129573.641179:0:22480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e38bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+37:3303:x1830948737546240:12345-0@lo:2:osp-syn-1-0.0 Request processed in 2030us (2178us total) trans 17179874135 rc 0/0 00000100:00100000:3.0:1746129573.641184:0:22480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16360 00000004:00080000:2.0:1746129573.641196:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b552d80/2, rc 0, transno 21474841386 00000100:00100000:2.0:1746129573.641199:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b552d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737545216:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129573.641206:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737545728:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129573.641232:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1746129573.641252:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093eded80/2, rc 0, transno 17179874135 00000100:00100000:1.0:1746129573.641255:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093eded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1830948737546240:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129573.641256:0:16908:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734199040 00000100:00100000:2.0:1746129573.641259:0:16908:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734199040 00000100:00100000:1.0:1746129573.641318:0:15096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11248 00000100:00100000:1.0:1746129573.641331:0:15096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092fd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:068dab75-d300-4ead-a742-d14572ad1e50+7:32385:x1830948734199040:12345-192.168.202.4@tcp:101:mirror_io.0 00010000:00010000:1.0:1746129573.641348:0:15096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129573.641366:0:15096:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fac1600/0x40a459093b06a513 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f214ed expref: -99 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129573.641414:0:15096:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fac1600/0x40a459093b06a513 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f214ed expref: 8 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129573.641426:0:15096:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fac1600/0x40a459093b06a513 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f214ed expref: 8 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129573.641443:0:15096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:1.0:1746129573.641447:0:15096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746129573.641450:0:15096:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fac1600, rc 0) 00000100:00100000:1.0:1746129573.641482:0:15096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092fd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:068dab75-d300-4ead-a742-d14572ad1e50+8:32385:x1830948734199040:12345-192.168.202.4@tcp:101:mirror_io.0 Request processed in 158us (1018us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129573.641929:0:8410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e389f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+37:3303:x1830948737546752:12345-0@lo:2:osp-syn-1-0.0 Request processed in 2759us (2892us total) trans 17179874136 rc 0/0 00000100:00100000:0.0:1746129573.641935:0:8410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16361 00000100:00100000:0.0:1746129573.641946:0:8410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737545728 00000100:00100000:0.0:1746129573.641948:0:8410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737545728 00000100:00100000:0.0:1746129573.641975:0:8410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16364 00000100:00100000:0.0:1746129573.641979:0:8410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a77b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+40:3302:x1830948737545728:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129573.642063:0:8410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a77b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+41:3302:x1830948737545728:12345-0@lo:2:osp-syn-0-0.0 Request processed in 83us (829us total) trans 21474841387 rc 0/0 00000100:00100000:0.0:1746129573.642069:0:8410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16364 00000004:00080000:2.0:1746129573.642132:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800900f4380/2, rc 0, transno 21474841387 00000100:00100000:2.0:1746129573.642136:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737545728:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129573.642530:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f44b800/2, rc 0, transno 17179874136 00000100:00100000:0.0:1746129573.642534:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f44b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1830948737546752:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129573.642570:0:15096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11248 00000100:00100000:0.0:1746129573.648159:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129573.648227:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734199168 00000100:00100000:3.0:1746129573.648236:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734199168 00000100:00100000:3.0:1746129573.648348:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 794 00000100:00100000:3.0:1746129573.648357:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092fd3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:068dab75-d300-4ead-a742-d14572ad1e50+8:32385:x1830948734199168:12345-192.168.202.4@tcp:103:mirror_io.0 00010000:00010000:3.0:1746129573.648377:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129573.648404:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d94e000/0x40a459093b06a4d4 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f214e6 expref: 8 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129573.648421:0:7085:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:3.0:1746129573.648425:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129573.648468:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092fd3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:068dab75-d300-4ead-a742-d14572ad1e50+7:32385:x1830948734199168:12345-192.168.202.4@tcp:103:mirror_io.0 Request processed in 113us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129573.648474:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 794 00000100:00100000:0.0:1746129573.649558:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129573.649905:0:20861:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734199424 00000100:00100000:1.0:1746129573.649911:0:20861:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734199424 00000100:00100000:1.0:1746129573.650012:0:20861:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4780 00000100:00100000:1.0:1746129573.650020:0:20861:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092fd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:068dab75-d300-4ead-a742-d14572ad1e50+7:32385:x1830948734199424:12345-192.168.202.4@tcp:35:mirror_io.0 00000100:00100000:1.0:1746129573.650346:0:20861:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092fd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:068dab75-d300-4ead-a742-d14572ad1e50+8:32385:x1830948734199424:12345-192.168.202.4@tcp:35:mirror_io.0 Request processed in 326us (792us total) trans 8589945352 rc 0/0 00000100:00100000:1.0:1746129573.650353:0:20861:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4780 00000100:00100000:0.0:1746129573.653184:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129573.653322:0:20861:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734199680 00000100:00100000:1.0:1746129573.653331:0:20861:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734199680 00000100:00100000:1.0:1746129573.653942:0:20861:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4781 00000100:00100000:1.0:1746129573.653952:0:20861:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:068dab75-d300-4ead-a742-d14572ad1e50+8:32385:x1830948734199680:12345-192.168.202.4@tcp:35:mirror_io.0 00000100:00100000:1.0:1746129573.654184:0:20861:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:068dab75-d300-4ead-a742-d14572ad1e50+9:32385:x1830948734199680:12345-192.168.202.4@tcp:35:mirror_io.0 Request processed in 234us (1011us total) trans 8589945353 rc 0/0 00000100:00100000:1.0:1746129573.654191:0:20861:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4781 00000100:00100000:0.0:1746129573.675862:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129573.675999:0:15096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734199936 00000100:00100000:1.0:1746129573.676009:0:15096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734199936 00000100:00100000:1.0:1746129573.676071:0:15096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11249 00000100:00100000:1.0:1746129573.676079:0:15096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ada2ffba-8920-4ecb-8068-68caa9806978+288:32393:x1830948734199936:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129573.676105:0:15096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129573.676123:0:15096:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc8d800/0x40a459093b06a51a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f214f4 expref: -99 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129573.676252:0:15096:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fac1800/0x40a459093b06a521 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15096 initiator: MDT0 00010000:00010000:1.0:1746129573.676264:0:15096:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fac1800/0x40a459093b06a521 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15096 initiator: MDT0 00010000:00010000:1.0:1746129573.676274:0:15096:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fac1800/0x40a459093b06a521 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15096 initiator: MDT0 00010000:00010000:1.0:1746129573.676333:0:15096:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800953dc200/0x40a459093b06a528 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15096 initiator: MDT0 00010000:00010000:1.0:1746129573.676340:0:15096:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800953dc200/0x40a459093b06a528 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15096 initiator: MDT0 00010000:00010000:1.0:1746129573.676346:0:15096:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800953dc200/0x40a459093b06a528 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15096 initiator: MDT0 00010000:00010000:1.0:1746129573.676462:0:15096:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd4f000/0x40a459093b06a52f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15096 initiator: MDT0 00010000:00010000:1.0:1746129573.676468:0:15096:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd4f000/0x40a459093b06a52f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15096 initiator: MDT0 00010000:00010000:1.0:1746129573.676473:0:15096:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd4f000/0x40a459093b06a52f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15096 initiator: MDT0 00000004:00200000:1.0:1746129573.676482:0:15096:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:1.0:1746129573.676573:0:15096:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fac1800/0x40a459093b06a521 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15096 initiator: MDT0 00010000:00010000:1.0:1746129573.676581:0:15096:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fac1800/0x40a459093b06a521 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15096 initiator: MDT0 00010000:00010000:1.0:1746129573.676590:0:15096:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008fac1800/0x40a459093b06a521 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15096 initiator: MDT0 00010000:00010000:1.0:1746129573.676595:0:15096:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008fac1800 already unused, calling callback (ffffffffa136e690) 00010000:00010000:1.0:1746129573.676599:0:15096:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fac1800/0x40a459093b06a521 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15096 initiator: MDT0 00010000:00010000:1.0:1746129573.676606:0:15096:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fac1800/0x40a459093b06a521 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15096 initiator: MDT0 00010000:00010000:1.0:1746129573.676615:0:15096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880132ef8f00) 00010000:00010000:1.0:1746129573.676618:0:15096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129573.676622:0:15096:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008fac1800/0x40a459093b06a521 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15096 initiator: MDT0 00010000:00010000:1.0:1746129573.676627:0:15096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fac1800/0x40a459093b06a521 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15096 initiator: MDT0 00010000:00010000:1.0:1746129573.676649:0:15096:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800953dc200/0x40a459093b06a528 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15096 initiator: MDT0 00010000:00010000:1.0:1746129573.676654:0:15096:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800953dc200/0x40a459093b06a528 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15096 initiator: MDT0 00010000:00010000:1.0:1746129573.676658:0:15096:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800953dc200/0x40a459093b06a528 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15096 initiator: MDT0 00010000:00010000:1.0:1746129573.676662:0:15096:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800953dc200 already unused, calling callback (ffffffffa136e690) 00010000:00010000:1.0:1746129573.676664:0:15096:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800953dc200/0x40a459093b06a528 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15096 initiator: MDT0 00010000:00010000:1.0:1746129573.676668:0:15096:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800953dc200/0x40a459093b06a528 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15096 initiator: MDT0 00010000:00010000:1.0:1746129573.676678:0:15096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009cffef00) 00010000:00010000:1.0:1746129573.676679:0:15096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129573.676682:0:15096:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800953dc200/0x40a459093b06a528 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15096 initiator: MDT0 00010000:00010000:1.0:1746129573.676685:0:15096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800953dc200/0x40a459093b06a528 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15096 initiator: MDT0 00010000:00010000:1.0:1746129573.678509:0:15096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc8d800/0x40a459093b06a51a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f214f4 expref: 291 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129573.678532:0:15096:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd4f000/0x40a459093b06a52f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f214f4 expref: 290 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129573.678540:0:15096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:1.0:1746129573.678543:0:15096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746129573.678546:0:15096:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fd4f000, rc 0) 00000100:00100000:1.0:1746129573.678629:0:15096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ada2ffba-8920-4ecb-8068-68caa9806978+290:32393:x1830948734199936:12345-192.168.202.4@tcp:101:cat.0 Request processed in 2549us (2777us total) trans 8589945354 rc 0/0 00000100:00100000:1.0:1746129573.678638:0:15096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11249 00000100:00100000:2.0:1746129573.686737:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129573.686794:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129573.686822:0:8412:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734200576 00000100:00100000:2.0:1746129573.686831:0:8412:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734200576 00000100:00100000:2.0:1746129573.686869:0:8412:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734200704 00000100:00100000:2.0:1746129573.686871:0:8412:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734200704 00000100:00100000:2.0:1746129573.686886:0:8412:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16365 00000100:00100000:2.0:1746129573.686894:0:8412:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a77b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ada2ffba-8920-4ecb-8068-68caa9806978+35:1962:x1830948734200576:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129573.686914:0:8412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129573.686937:0:8412:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ce27400/0x40a459093b06a53d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21509 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746129573.686964:0:8412:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3ec:0x0] initial LVB size: 1048576, mtime: 0x6813d2a5, atime: 0x6813d2a3, ctime: 0x6813d2a5, blocks: 0x819 00010000:00010000:2.0:1746129573.686982:0:8412:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129573.686985:0:8412:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129573.686994:0:8412:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ce27400/0x40a459093b06a53d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21509 expref: 36 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129573.687010:0:8412:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ce27400/0x40a459093b06a53d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21509 expref: 36 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129573.687022:0:8412:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ce27400, rc 0) 00000100:00100000:2.0:1746129573.687066:0:8412:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a77b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ada2ffba-8920-4ecb-8068-68caa9806978+36:1962:x1830948734200576:12345-192.168.202.4@tcp:101:cat.0 Request processed in 173us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129573.687071:0:8412:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16365 00000100:00100000:2.0:1746129573.687086:0:8412:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16366 00000100:00100000:2.0:1746129573.687091:0:8412:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a77b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ada2ffba-8920-4ecb-8068-68caa9806978+33:1963:x1830948734200704:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129573.687098:0:8412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129573.687110:0:8412:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ce26800/0x40a459093b06a544 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21510 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746129573.687124:0:8412:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3f3:0x0] initial LVB size: 2097152, mtime: 0x6813d2a5, atime: 0x6813d2a3, ctime: 0x6813d2a4, blocks: 0x81f 00010000:00010000:2.0:1746129573.687132:0:8412:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129573.687133:0:8412:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129573.687136:0:8412:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ce26800/0x40a459093b06a544 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21510 expref: 34 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129573.687147:0:8412:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012ce26800/0x40a459093b06a544 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21510 expref: 34 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129573.687154:0:8412:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ce26800, rc 0) 00000100:00100000:2.0:1746129573.687169:0:8412:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a77b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ada2ffba-8920-4ecb-8068-68caa9806978+34:1963:x1830948734200704:12345-192.168.202.4@tcp:101:cat.0 Request processed in 78us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129573.687174:0:8412:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16366 00000100:00100000:2.0:1746129573.688427:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129573.689019:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129573.689141:0:15096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734200192 00000100:00100000:1.0:1746129573.689149:0:15096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734200192 00000100:00100000:1.0:1746129573.689189:0:15096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734200448 00000100:00100000:1.0:1746129573.689191:0:15096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734200448 00000100:00100000:1.0:1746129573.689214:0:15096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11250 00000100:00100000:1.0:1746129573.689220:0:15096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a77b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+6:32395:x1830948734200192:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129573.689239:0:15096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129573.689255:0:15096:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc8da00/0x40a459093b06a54b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f214fb expref: -99 pid: 15096 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129573.689484:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11251 00000100:00100000:0.0:1746129573.689491:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a77b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ada2ffba-8920-4ecb-8068-68caa9806978+290:32390:x1830948734200448:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:0.0:1746129573.689500:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129573.689507:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c22c200/0x40a459093b06a552 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21502 expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129573.689581:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c22d000/0x40a459093b06a559 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129573.689593:0:14549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd4f000/0x40a459093b06a52f lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f214f4 expref: 291 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129573.689599:0:14549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c22d000/0x40a459093b06a559 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129573.689629:0:14549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd4f000/0x40a459093b06a52f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f214f4 expref: 291 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129573.689640:0:14549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd4f000/0x40a459093b06a52f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f214f4 expref: 291 pid: 15096 timeout: 929 lvb_type: 0 00000100:00100000:0.0:1746129573.689652:0:14549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012baedc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830948737547264:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129573.689736:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129573.689754:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129573.689765:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129573.689781:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129573.689795:0:31503:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734200832 00000100:00100000:3.0:1746129573.689798:0:31503:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734200832 00000100:00100000:3.0:1746129573.689816:0:31503:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734201088 00000100:00100000:3.0:1746129573.689817:0:31503:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734201088 00000100:00100000:3.0:1746129573.689826:0:31503:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734200960 00000100:00100000:3.0:1746129573.689828:0:31503:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734200960 00000100:00100000:3.0:1746129573.689835:0:31503:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734201216 00000100:00100000:3.0:1746129573.689836:0:31503:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734201216 00000100:00100000:3.0:1746129573.689846:0:31503:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16367 00000100:00100000:3.0:1746129573.689851:0:31503:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ada2ffba-8920-4ecb-8068-68caa9806978+35:1962:x1830948734200832:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129573.689859:0:31503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129573.689871:0:31503:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f445200/0x40a459093b06a560 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21517 expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746129573.689890:0:31503:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3f4:0x0] initial LVB size: 2097152, mtime: 0x6813d2a3, atime: 0x6813d2a3, ctime: 0x6813d2a4, blocks: 0x821 00010000:00010000:3.0:1746129573.689902:0:31503:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129573.689904:0:31503:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129573.689911:0:31503:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f445200/0x40a459093b06a560 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21517 expref: 36 pid: 31503 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129573.689923:0:31503:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f445200/0x40a459093b06a560 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21517 expref: 36 pid: 31503 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129573.689932:0:31503:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f445200, rc 0) 00000100:00100000:3.0:1746129573.689970:0:31503:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ada2ffba-8920-4ecb-8068-68caa9806978+36:1962:x1830948734200832:12345-192.168.202.4@tcp:101:cat.0 Request processed in 118us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129573.689975:0:31503:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16367 00000100:00100000:3.0:1746129573.689988:0:31503:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16368 00000100:00100000:3.0:1746129573.689992:0:31503:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ada2ffba-8920-4ecb-8068-68caa9806978+37:1962:x1830948734201088:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129573.690000:0:31503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129573.690010:0:31503:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f445000/0x40a459093b06a567 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21525 expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746129573.690024:0:31503:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3ef:0x0] initial LVB size: 5146336, mtime: 0x6813d2a6, atime: 0x6813d2a5, ctime: 0x6813d2a6, blocks: 0x1791 00010000:00010000:3.0:1746129573.690033:0:31503:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129573.690034:0:31503:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129573.690038:0:31503:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f445000/0x40a459093b06a567 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21525 expref: 38 pid: 31503 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129573.690046:0:31503:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f445000/0x40a459093b06a567 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21525 expref: 38 pid: 31503 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129573.690053:0:31503:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f445000, rc 0) 00000100:00100000:3.0:1746129573.690066:0:31503:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ada2ffba-8920-4ecb-8068-68caa9806978+38:1962:x1830948734201088:12345-192.168.202.4@tcp:101:cat.0 Request processed in 74us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129573.690073:0:31503:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16368 00000100:00100000:3.0:1746129573.690081:0:31503:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16369 00000100:00100000:3.0:1746129573.690084:0:31503:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ada2ffba-8920-4ecb-8068-68caa9806978+37:1962:x1830948734200960:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129573.690089:0:31503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129573.690095:0:31503:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f445600/0x40a459093b06a56e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2151e expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746129573.690105:0:31503:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3ee:0x0] initial LVB size: 2097152, mtime: 0x6813d2a6, atime: 0x6813d2a6, ctime: 0x6813d2a6, blocks: 0x81d 00010000:00010000:3.0:1746129573.690110:0:31503:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129573.690112:0:31503:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129573.690114:0:31503:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f445600/0x40a459093b06a56e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2151e expref: 38 pid: 31503 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129573.690121:0:31503:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f445600/0x40a459093b06a56e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2151e expref: 38 pid: 31503 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129573.690126:0:31503:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f445600, rc 0) 00000100:00100000:3.0:1746129573.690137:0:31503:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ada2ffba-8920-4ecb-8068-68caa9806978+38:1962:x1830948734200960:12345-192.168.202.4@tcp:101:cat.0 Request processed in 53us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129573.690141:0:31503:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16369 00000100:00100000:3.0:1746129573.690147:0:31503:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16370 00000100:00100000:3.0:1746129573.690151:0:31503:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ada2ffba-8920-4ecb-8068-68caa9806978+35:1962:x1830948734201216:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129573.690155:0:31503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129573.690166:0:31503:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f444600/0x40a459093b06a575 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2152c expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746129573.690180:0:31503:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3f5:0x0] initial LVB size: 4194304, mtime: 0x6813d2a6, atime: 0x6813d2a6, ctime: 0x6813d2a6, blocks: 0x1029 00010000:00010000:3.0:1746129573.690185:0:31503:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129573.690186:0:31503:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129573.690189:0:31503:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f444600/0x40a459093b06a575 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2152c expref: 36 pid: 31503 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129573.690196:0:31503:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f444600/0x40a459093b06a575 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2152c expref: 36 pid: 31503 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129573.690202:0:31503:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f444600, rc 0) 00000100:00100000:3.0:1746129573.690213:0:31503:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ada2ffba-8920-4ecb-8068-68caa9806978+36:1962:x1830948734201216:12345-192.168.202.4@tcp:101:cat.0 Request processed in 62us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129573.690217:0:31503:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16370 00010000:00010000:1.0:1746129573.690482:0:15096:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090078000/0x40a459093b06a57c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15096 initiator: MDT0 00010000:00010000:1.0:1746129573.690491:0:15096:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090078000/0x40a459093b06a57c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15096 initiator: MDT0 00010000:00010000:1.0:1746129573.690501:0:15096:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090078000/0x40a459093b06a57c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15096 initiator: MDT0 00010000:00010000:1.0:1746129573.690511:0:15096:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090078800/0x40a459093b06a583 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15096 initiator: MDT0 00010000:00010000:1.0:1746129573.690516:0:15096:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090078800/0x40a459093b06a583 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15096 initiator: MDT0 00010000:00010000:1.0:1746129573.690521:0:15096:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090078800/0x40a459093b06a583 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15096 initiator: MDT0 00010000:00010000:1.0:1746129573.690606:0:15096:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090079800/0x40a459093b06a58a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15096 initiator: MDT0 00010000:00010000:1.0:1746129573.690613:0:15096:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090079800/0x40a459093b06a58a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15096 initiator: MDT0 00010000:00010000:1.0:1746129573.690618:0:15096:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090079800/0x40a459093b06a58a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15096 initiator: MDT0 00000004:00200000:1.0:1746129573.690626:0:15096:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:1.0:1746129573.690707:0:15096:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090078000/0x40a459093b06a57c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15096 initiator: MDT0 00010000:00010000:1.0:1746129573.690713:0:15096:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090078000/0x40a459093b06a57c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15096 initiator: MDT0 00010000:00010000:1.0:1746129573.690723:0:15096:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090078000/0x40a459093b06a57c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15096 initiator: MDT0 00010000:00010000:1.0:1746129573.690728:0:15096:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090078000 already unused, calling callback (ffffffffa136e690) 00010000:00010000:1.0:1746129573.690731:0:15096:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090078000/0x40a459093b06a57c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15096 initiator: MDT0 00010000:00010000:1.0:1746129573.690738:0:15096:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090078000/0x40a459093b06a57c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15096 initiator: MDT0 00010000:00010000:1.0:1746129573.690746:0:15096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880132ef8f00) 00010000:00010000:1.0:1746129573.690748:0:15096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129573.690751:0:15096:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090078000/0x40a459093b06a57c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15096 initiator: MDT0 00010000:00010000:1.0:1746129573.690756:0:15096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090078000/0x40a459093b06a57c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15096 initiator: MDT0 00010000:00010000:1.0:1746129573.690776:0:15096:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090078800/0x40a459093b06a583 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15096 initiator: MDT0 00010000:00010000:1.0:1746129573.690780:0:15096:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090078800/0x40a459093b06a583 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15096 initiator: MDT0 00010000:00010000:1.0:1746129573.690785:0:15096:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090078800/0x40a459093b06a583 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15096 initiator: MDT0 00010000:00010000:1.0:1746129573.690788:0:15096:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090078800 already unused, calling callback (ffffffffa136e690) 00010000:00010000:1.0:1746129573.690790:0:15096:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090078800/0x40a459093b06a583 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15096 initiator: MDT0 00010000:00010000:1.0:1746129573.690795:0:15096:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090078800/0x40a459093b06a583 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15096 initiator: MDT0 00010000:00010000:1.0:1746129573.690803:0:15096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009cffe100) 00010000:00010000:1.0:1746129573.690805:0:15096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129573.690807:0:15096:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090078800/0x40a459093b06a583 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15096 initiator: MDT0 00010000:00010000:1.0:1746129573.690811:0:15096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090078800/0x40a459093b06a583 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15096 initiator: MDT0 00010000:00010000:1.0:1746129573.690848:0:15096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc8da00/0x40a459093b06a54b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f214fb expref: 9 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129573.690857:0:15096:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090079800/0x40a459093b06a58a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f214fb expref: 8 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129573.690862:0:15096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:1.0:1746129573.690864:0:15096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746129573.690866:0:15096:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090079800, rc 0) 00000100:00100000:1.0:1746129573.690892:0:15096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a77b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+8:32395:x1830948734200192:12345-192.168.202.4@tcp:101:cat.0 Request processed in 1672us (2472us total) trans 8589945355 rc 0/0 00000100:00100000:1.0:1746129573.690897:0:15096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11250 00000100:00100000:0.0:1746129573.691035:0:14549:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a00f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746129573.697776:0:14549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012baedc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830948737547264:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129573.697811:0:14549:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012c22d000/0x40a459093b06a559 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000100:00100000:0.0:1746129573.698106:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129573.698144:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129573.698157:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129573.698167:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129573.698187:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129573.698198:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129573.698222:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129573.698246:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734201472 00000100:00100000:0.0:1746129573.698253:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734201472 00000100:00100000:0.0:1746129573.698320:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734201600 00000100:00100000:0.0:1746129573.698323:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734201600 00000100:00100000:0.0:1746129573.698336:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734201728 00000100:00100000:0.0:1746129573.698338:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734201728 00000100:00100000:0.0:1746129573.698347:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734201856 00000100:00100000:0.0:1746129573.698349:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734201856 00000100:00100000:0.0:1746129573.698357:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734201984 00000100:00100000:0.0:1746129573.698359:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734201984 00000100:00100000:0.0:1746129573.698367:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734202112 00000100:00100000:0.0:1746129573.698369:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734202112 00000100:00100000:0.0:1746129573.698381:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16371 00000100:00100000:0.0:1746129573.698388:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e957b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:1961:x1830948734201472:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129573.698408:0:4385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129573.698423:0:4385:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094fef000/0x40a459093b06a598 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21533 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129573.698444:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129573.698446:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129573.698454:0:4385:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094fef000/0x40a459093b06a598 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21533 expref: 21 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129573.698468:0:4385:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094fef000/0x40a459093b06a598 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21533 expref: 21 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129573.698479:0:4385:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094fef000, rc 0) 00000100:00100000:0.0:1746129573.698519:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e957b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:1961:x1830948734201472:12345-192.168.202.4@tcp:101:cat.0 Request processed in 131us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129573.698524:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16371 00000100:00100000:0.0:1746129573.698539:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16372 00000100:00100000:0.0:1746129573.698544:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+27:1960:x1830948734201600:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129573.698550:0:4385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129573.698559:0:4385:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008fac1800/0x40a459093b06a59f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2153a expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129573.698568:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129573.698569:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129573.698573:0:4385:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fac1800/0x40a459093b06a59f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2153a expref: 28 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129573.698581:0:4385:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008fac1800/0x40a459093b06a59f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2153a expref: 28 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129573.698587:0:4385:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fac1800, rc 0) 00000100:00100000:0.0:1746129573.698599:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+28:1960:x1830948734201600:12345-192.168.202.4@tcp:101:cat.0 Request processed in 55us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129573.698604:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16372 00000100:00100000:0.0:1746129573.698613:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16373 00000100:00100000:0.0:1746129573.698616:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+27:1961:x1830948734201728:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129573.698621:0:4385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129573.698628:0:4385:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800953dc200/0x40a459093b06a5a6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21541 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129573.698636:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129573.698638:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129573.698641:0:4385:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800953dc200/0x40a459093b06a5a6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21541 expref: 28 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129573.698653:0:4385:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800953dc200/0x40a459093b06a5a6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21541 expref: 28 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129573.698660:0:4385:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800953dc200, rc 0) 00000100:00100000:0.0:1746129573.698673:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+28:1961:x1830948734201728:12345-192.168.202.4@tcp:101:cat.0 Request processed in 56us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129573.698677:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16373 00000100:00100000:0.0:1746129573.698686:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16374 00000100:00100000:0.0:1746129573.698690:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:1960:x1830948734201856:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129573.698695:0:4385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129573.698701:0:4385:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c22ca00/0x40a459093b06a5ad lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21548 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129573.698708:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129573.698709:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129573.698713:0:4385:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c22ca00/0x40a459093b06a5ad lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21548 expref: 21 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129573.698720:0:4385:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c22ca00/0x40a459093b06a5ad lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21548 expref: 21 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129573.698726:0:4385:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c22ca00, rc 0) 00000100:00100000:0.0:1746129573.698739:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:1960:x1830948734201856:12345-192.168.202.4@tcp:101:cat.0 Request processed in 49us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129573.698743:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16374 00000100:00100000:0.0:1746129573.698752:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16375 00000100:00100000:0.0:1746129573.698756:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:1961:x1830948734201984:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129573.698760:0:4385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129573.698766:0:4385:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c22d600/0x40a459093b06a5b4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2154f expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129573.698774:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129573.698775:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129573.698778:0:4385:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c22d600/0x40a459093b06a5b4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2154f expref: 21 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129573.698785:0:4385:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c22d600/0x40a459093b06a5b4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2154f expref: 21 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129573.698791:0:4385:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c22d600, rc 0) 00000100:00100000:0.0:1746129573.698803:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:1961:x1830948734201984:12345-192.168.202.4@tcp:101:cat.0 Request processed in 47us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129573.698807:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16375 00000100:00100000:0.0:1746129573.698814:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16376 00000100:00100000:0.0:1746129573.698818:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+27:1960:x1830948734202112:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129573.698822:0:4385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129573.698828:0:4385:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c22d400/0x40a459093b06a5bb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21556 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129573.698836:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129573.698837:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129573.698840:0:4385:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c22d400/0x40a459093b06a5bb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21556 expref: 28 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129573.698848:0:4385:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c22d400/0x40a459093b06a5bb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21556 expref: 28 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129573.698854:0:4385:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c22d400, rc 0) 00000100:00100000:0.0:1746129573.698866:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+28:1960:x1830948734202112:12345-192.168.202.4@tcp:101:cat.0 Request processed in 48us (644us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129573.698870:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16376 00000100:00100000:3.0:1746129573.699395:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734201344 00000100:00100000:3.0:1746129573.699401:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734201344 00010000:00010000:3.0:1746129573.699422:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd4f000/0x40a459093b06a52f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f214f4 expref: 292 pid: 15096 timeout: 929 lvb_type: 0 00000100:00100000:3.0:1746129573.699454:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8403 00000100:00100000:3.0:1746129573.699459:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baedc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ada2ffba-8920-4ecb-8068-68caa9806978+292:1960:x1830948734201344:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129573.699468:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129573.699473:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd4f000/0x40a459093b06a52f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f214f4 expref: 292 pid: 15096 timeout: 929 lvb_type: 0 00010000:00010000:3.0:1746129573.699483:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd4f000/0x40a459093b06a52f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f214f4 expref: 292 pid: 15096 timeout: 929 lvb_type: 0 00010000:00010000:3.0:1746129573.699504:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd4f000/0x40a459093b06a52f lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f214f4 expref: 292 pid: 15096 timeout: 929 lvb_type: 0 00010000:00010000:3.0:1746129573.699530:0:7085:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:3.0:1746129573.699534:0:7085:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c22d000/0x40a459093b06a559 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129573.699542:0:7085:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c22d000/0x40a459093b06a559 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129573.699547:0:7085:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c22d000/0x40a459093b06a559 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129573.699563:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129573.699592:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baedc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ada2ffba-8920-4ecb-8068-68caa9806978+291:1960:x1830948734201344:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 134us (1488us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129573.699597:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8403 00010000:00010000:3.0:1746129573.699620:0:14549:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012c22d000/0x40a459093b06a559 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129573.699625:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c22d000/0x40a459093b06a559 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00200000:3.0:1746129573.699642:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:3.0:1746129573.699780:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c22c200/0x40a459093b06a552 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21502 expref: 292 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129573.699791:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c22d000/0x40a459093b06a559 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21502 expref: 291 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129573.699801:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:3.0:1746129573.699803:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746129573.699805:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c22d000, rc 0) 00000100:00100000:3.0:1746129573.699827:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a77b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ada2ffba-8920-4ecb-8068-68caa9806978+291:32390:x1830948734200448:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 10337us (10810us total) trans 8589945356 rc 0/0 00000100:00100000:3.0:1746129573.699832:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11251 00000100:00100000:0.0:1746129573.710420:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129573.710469:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129573.710515:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129573.710614:0:31521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734202368 00000100:00100000:2.0:1746129573.710625:0:31521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734202368 00002000:00100000:2.0:1746129573.710683:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3ec:0x0] (0->1048575) req@ffff88009fbadc00 x1830948734202368/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:314/0 lens 488/0 e 0 to 0 dl 1746129584 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129573.710693:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbadc00 with x1830948734202368 ext(0->1048575) 00002000:00010000:2.0:1746129573.710699:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fbadc00 00000100:00100000:2.0:1746129573.712657:0:31521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734202624 00000100:00100000:2.0:1746129573.712669:0:31521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734202624 00002000:00100000:2.0:1746129573.712716:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff88009fbad180 x1830948734202624/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:314/0 lens 488/0 e 0 to 0 dl 1746129584 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129573.712727:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbad180 with x1830948734202624 ext(1048576->2097151) 00002000:00010000:2.0:1746129573.712732:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fbad180 00000100:00100000:1.0:1746129573.712782:0:31520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734202880 00000100:00100000:1.0:1746129573.712786:0:31520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734202880 00002000:00100000:1.0:1746129573.712805:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3f4:0x0] (1048576->2097151) req@ffff88009fbac380 x1830948734202880/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:314/0 lens 488/0 e 0 to 0 dl 1746129584 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129573.712813:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbac380 with x1830948734202880 ext(1048576->2097151) 00002000:00010000:1.0:1746129573.712817:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fbac380 00000100:00100000:1.0:1746129573.712833:0:31520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7879 00000100:00100000:1.0:1746129573.712841:0:31520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ada2ffba-8920-4ecb-8068-68caa9806978+38:1963:x1830948734202368:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:3.0:1746129573.714867:0:21725:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7880 00000100:00100000:3.0:1746129573.714884:0:21725:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ada2ffba-8920-4ecb-8068-68caa9806978+37:1963:x1830948734202624:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:1.0:1746129573.715672:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7881 00000100:00100000:1.0:1746129573.715680:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+38:1963:x1830948734202880:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129573.716783:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129573.717765:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129573.718555:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129573.718576:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129573.718589:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129573.718610:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129573.718636:0:8416:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734203136 00000100:00100000:0.0:1746129573.718645:0:8416:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734203136 00002000:00100000:0.0:1746129573.718687:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3ee:0x0] (1048576->2097151) req@ffff88009f324000 x1830948734203136/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:314/0 lens 488/0 e 0 to 0 dl 1746129584 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129573.718697:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f324000 with x1830948734203136 ext(1048576->2097151) 00002000:00010000:0.0:1746129573.718703:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f324000 00000100:00100000:0.0:1746129573.718723:0:21463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734203392 00000100:00100000:0.0:1746129573.718726:0:21463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734203392 00002000:00100000:0.0:1746129573.718739:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3ec:0x0] (0->1048575) req@ffff88009f326a00 x1830948734203392/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:314/0 lens 488/0 e 0 to 0 dl 1746129584 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129573.718750:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f326a00 with x1830948734203392 ext(0->1048575) 00002000:00010000:0.0:1746129573.718753:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f326a00 00000100:00100000:0.0:1746129573.718762:0:21463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734203648 00000100:00100000:0.0:1746129573.718763:0:21463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734203648 00002000:00100000:0.0:1746129573.718773:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff8800959d6680 x1830948734203648/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:314/0 lens 488/0 e 0 to 0 dl 1746129584 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129573.718778:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800959d6680 with x1830948734203648 ext(1048576->2097151) 00002000:00010000:0.0:1746129573.718781:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800959d6680 00000100:00100000:0.0:1746129573.718787:0:21463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734203904 00000100:00100000:0.0:1746129573.718789:0:21463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734203904 00002000:00100000:0.0:1746129573.718797:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3f4:0x0] (1048576->2097151) req@ffff8800959d6d80 x1830948734203904/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:314/0 lens 488/0 e 0 to 0 dl 1746129584 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129573.718802:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800959d6d80 with x1830948734203904 ext(1048576->2097151) 00002000:00010000:0.0:1746129573.718805:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800959d6d80 00000100:00100000:0.0:1746129573.718811:0:21463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734204160 00000100:00100000:0.0:1746129573.718813:0:21463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734204160 00002000:00100000:0.0:1746129573.718821:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3ee:0x0] (1048576->2097151) req@ffff8800959d7b80 x1830948734204160/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:314/0 lens 488/0 e 0 to 0 dl 1746129584 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129573.718826:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800959d7b80 with x1830948734204160 ext(1048576->2097151) 00002000:00010000:0.0:1746129573.718830:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800959d7b80 00000100:00100000:0.0:1746129573.718836:0:21463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7882 00000100:00100000:0.0:1746129573.718842:0:21463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f324000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ada2ffba-8920-4ecb-8068-68caa9806978+40:1963:x1830948734203136:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:1.0:1746129573.719729:0:31522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7883 00000100:00100000:1.0:1746129573.719739:0:31522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f326a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+22:1960:x1830948734203392:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:3.0:1746129573.720087:0:31519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7884 00000100:00100000:3.0:1746129573.720096:0:31519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+29:1960:x1830948734203648:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:3.0:1746129573.721376:0:31518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7885 00000100:00100000:3.0:1746129573.721386:0:31518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+30:1960:x1830948734203904:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:3.0:1746129573.722382:0:31523:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7886 00000100:00100000:3.0:1746129573.722390:0:31523:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+23:1960:x1830948734204160:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:2.0:1746129573.723138:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734204416 00000100:00100000:2.0:1746129573.723147:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734204416 00000100:00100000:2.0:1746129573.723192:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11252 00000100:00100000:2.0:1746129573.723198:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f325f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+8:32397:x1830948734204416:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:2.0:1746129573.723214:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129573.723234:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc8da00/0x40a459093b06a5c9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2155d expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129573.724151:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9209c00/0x40a459093b06a5d0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129573.724168:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9209c00/0x40a459093b06a5d0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129573.724180:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9209c00/0x40a459093b06a5d0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129573.724194:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9209000/0x40a459093b06a5d7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129573.724199:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9209000/0x40a459093b06a5d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129573.724204:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9209000/0x40a459093b06a5d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129573.724341:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880132edd400/0x40a459093b06a5de lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129573.724349:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880132edd400/0x40a459093b06a5de lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129573.724355:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880132edd400/0x40a459093b06a5de lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00200000:2.0:1746129573.724364:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:2.0:1746129573.724674:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9209c00/0x40a459093b06a5d0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129573.724682:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9209c00/0x40a459093b06a5d0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129573.724691:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9209c00/0x40a459093b06a5d0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129573.724696:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a9209c00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746129573.724700:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9209c00/0x40a459093b06a5d0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129573.724707:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9209c00/0x40a459093b06a5d0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129573.724718:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880132ef8f00) 00010000:00010000:2.0:1746129573.724721:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129573.724725:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9209c00/0x40a459093b06a5d0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129573.724729:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9209c00/0x40a459093b06a5d0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129573.724762:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9209000/0x40a459093b06a5d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129573.724767:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9209000/0x40a459093b06a5d7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129573.724771:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9209000/0x40a459093b06a5d7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129573.724775:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a9209000 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746129573.724777:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9209000/0x40a459093b06a5d7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129573.724781:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9209000/0x40a459093b06a5d7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129573.724790:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012db42d00) 00010000:00010000:2.0:1746129573.724792:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129573.724794:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9209000/0x40a459093b06a5d7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129573.724798:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9209000/0x40a459093b06a5d7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129573.724840:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc8da00/0x40a459093b06a5c9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2155d expref: 11 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129573.724851:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880132edd400/0x40a459093b06a5de lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2155d expref: 10 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129573.724857:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:2.0:1746129573.724859:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746129573.724861:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132edd400, rc 0) 00000100:00100000:2.0:1746129573.727074:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f325f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+10:32397:x1830948734204416:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 3865us (9299us total) trans 8589945357 rc 0/0 00000100:00100000:2.0:1746129573.727084:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11252 00000100:00100000:0.0:1746129573.731847:0:31520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ada2ffba-8920-4ecb-8068-68caa9806978+40:1963:x1830948734202368:12345-192.168.202.4@tcp:3:cat.0 Request processed in 18993us (21425us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129573.731865:0:31520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7879 00002000:00100000:0.0:1746129573.731878:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3ec:0x0] (0->1048575) req@ffff88009fbadc00 x1830948734202368/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:314/0 lens 488/440 e 0 to 0 dl 1746129584 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129573.731888:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbadc00 with x1830948734202368 ext(0->1048575) 00002000:00010000:0.0:1746129573.731894:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fbadc00 00000100:00100000:3.0:1746129573.739314:0:21725:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ada2ffba-8920-4ecb-8068-68caa9806978+38:1963:x1830948734202624:12345-192.168.202.4@tcp:3:cat.0 Request processed in 24399us (28806us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129573.739329:0:21725:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7880 00002000:00100000:3.0:1746129573.739342:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff88009fbad180 x1830948734202624/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:314/0 lens 488/440 e 0 to 0 dl 1746129584 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129573.739352:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbad180 with x1830948734202624 ext(1048576->2097151) 00002000:00010000:3.0:1746129573.739359:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fbad180 00000100:00100000:0.0:1746129573.748656:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129573.749040:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+36:1963:x1830948734202880:12345-192.168.202.4@tcp:3:cat.0 Request processed in 33358us (38522us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129573.749051:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7881 00002000:00100000:1.0:1746129573.749063:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f4:0x0] (1048576->2097151) req@ffff88009fbac380 x1830948734202880/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:314/0 lens 488/440 e 0 to 0 dl 1746129584 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129573.749072:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbac380 with x1830948734202880 ext(1048576->2097151) 00002000:00010000:1.0:1746129573.749078:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fbac380 00000100:00100000:2.0:1746129573.749505:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734204544 00000100:00100000:2.0:1746129573.749513:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734204544 00000100:00100000:2.0:1746129573.749552:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11253 00000100:00100000:2.0:1746129573.749558:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ada2ffba-8920-4ecb-8068-68caa9806978+291:32393:x1830948734204544:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129573.749579:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129573.749596:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880132edd800/0x40a459093b06a5ec lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21564 expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129573.749655:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880132edd800/0x40a459093b06a5ec lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21564 expref: 292 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129573.749667:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880132edd800/0x40a459093b06a5ec lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21564 expref: 292 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129573.749681:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:2.0:1746129573.749684:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746129573.749687:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132edd800, rc 0) 00000100:00100000:2.0:1746129573.749706:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ada2ffba-8920-4ecb-8068-68caa9806978+292:32393:x1830948734204544:12345-192.168.202.4@tcp:101:cat.0 Request processed in 148us (1062us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129573.749710:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11253 00000100:00100000:2.0:1746129573.762766:0:31519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+30:1960:x1830948734203648:12345-192.168.202.4@tcp:3:cat.0 Request processed in 42658us (44174us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129573.762779:0:31519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7884 00002000:00100000:2.0:1746129573.762792:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff8800959d6680 x1830948734203648/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:314/0 lens 488/440 e 0 to 0 dl 1746129584 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129573.762801:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800959d6680 with x1830948734203648 ext(1048576->2097151) 00002000:00010000:2.0:1746129573.762807:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800959d6680 00000100:00100000:1.0:1746129573.766247:0:31522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f326a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+23:1960:x1830948734203392:12345-192.168.202.4@tcp:3:cat.0 Request processed in 46496us (47678us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129573.766260:0:31522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7883 00002000:00100000:1.0:1746129573.766272:0:31522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3ec:0x0] (0->1048575) req@ffff88009f326a00 x1830948734203392/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:314/0 lens 488/440 e 0 to 0 dl 1746129584 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129573.766281:0:31522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f326a00 with x1830948734203392 ext(0->1048575) 00002000:00010000:1.0:1746129573.766326:0:31522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f326a00 00000100:00100000:3.0:1746129573.772757:0:31518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+28:1960:x1830948734203904:12345-192.168.202.4@tcp:3:cat.0 Request processed in 51357us (54150us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129573.772772:0:31518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7885 00002000:00100000:3.0:1746129573.772789:0:31518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3f4:0x0] (1048576->2097151) req@ffff8800959d6d80 x1830948734203904/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:314/0 lens 488/440 e 0 to 0 dl 1746129584 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129573.772800:0:31518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800959d6d80 with x1830948734203904 ext(1048576->2097151) 00002000:00010000:3.0:1746129573.772806:0:31518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800959d6d80 00000100:00100000:0.0:1746129573.773398:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129573.774576:0:20578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734204672 00000100:00100000:2.0:1746129573.774588:0:20578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734204672 00000100:00100000:2.0:1746129573.774660:0:20578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 795 00000100:00100000:2.0:1746129573.774669:0:20578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959d5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+10:1960:x1830948734204672:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129573.774692:0:20578:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129573.774718:0:20578:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880132edd400/0x40a459093b06a5de lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2155d expref: 10 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129573.774756:0:20578:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:2.0:1746129573.774761:0:20578:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129573.774813:0:20578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959d5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+9:1960:x1830948734204672:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 146us (1416us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129573.774819:0:20578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 795 00000100:00100000:2.0:1746129573.776066:0:21463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f324000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ada2ffba-8920-4ecb-8068-68caa9806978+38:1963:x1830948734203136:12345-192.168.202.4@tcp:3:cat.0 Request processed in 57217us (59280us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129573.776076:0:21463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7882 00002000:00100000:2.0:1746129573.776086:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3ee:0x0] (1048576->2097151) req@ffff88009f324000 x1830948734203136/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:314/0 lens 488/440 e 0 to 0 dl 1746129584 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129573.776095:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f324000 with x1830948734203136 ext(1048576->2097151) 00002000:00010000:2.0:1746129573.776100:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f324000 00000100:00100000:3.0:1746129573.783418:0:31523:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:1960:x1830948734204160:12345-192.168.202.4@tcp:3:cat.0 Request processed in 61014us (64791us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129573.783430:0:31523:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7886 00002000:00100000:3.0:1746129573.783446:0:31523:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3ee:0x0] (1048576->2097151) req@ffff8800959d7b80 x1830948734204160/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:314/0 lens 488/440 e 0 to 0 dl 1746129584 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129573.783455:0:31523:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800959d7b80 with x1830948734204160 ext(1048576->2097151) 00002000:00010000:3.0:1746129573.783461:0:31523:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800959d7b80 00000100:00100000:0.0:1746129573.793817:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129573.793876:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129573.794111:0:2271:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734204800 00000100:00100000:2.0:1746129573.794122:0:2271:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734204800 00000100:00100000:2.0:1746129573.794182:0:2271:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734204928 00000100:00100000:2.0:1746129573.794185:0:2271:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734204928 00000100:00100000:2.0:1746129573.794206:0:2271:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11254 00000100:00100000:2.0:1746129573.794214:0:2271:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ada2ffba-8920-4ecb-8068-68caa9806978+292:32390:x1830948734204800:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:2.0:1746129573.794236:0:2271:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129573.794255:0:2271:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880132eddc00/0x40a459093b06a5f3 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2156b expref: -99 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129573.794362:0:2271:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880132eddc00/0x40a459093b06a5f3 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2156b expref: 293 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129573.794380:0:2271:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880132eddc00/0x40a459093b06a5f3 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2156b expref: 293 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129573.794398:0:2271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:2.0:1746129573.794401:0:2271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746129573.794404:0:2271:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132eddc00, rc 0) 00000100:00100000:2.0:1746129573.794453:0:2271:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ada2ffba-8920-4ecb-8068-68caa9806978+293:32390:x1830948734204800:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 241us (647us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129573.794460:0:2271:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11254 00000100:00100000:2.0:1746129573.794477:0:2271:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11255 00000100:00100000:2.0:1746129573.794482:0:2271:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:068dab75-d300-4ead-a742-d14572ad1e50+9:32398:x1830948734204928:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:2.0:1746129573.794493:0:2271:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129573.794500:0:2271:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880132edd000/0x40a459093b06a5fa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21572 expref: -99 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129573.794541:0:2271:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800957f9a00/0x40a459093b06a601 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129573.794549:0:2271:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800957f9a00/0x40a459093b06a601 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129573.794557:0:2271:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800957f9a00/0x40a459093b06a601 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129573.794569:0:2271:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc8da00/0x40a459093b06a608 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129573.794574:0:2271:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc8da00/0x40a459093b06a608 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129573.794578:0:2271:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc8da00/0x40a459093b06a608 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129573.795072:0:2271:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc8d800/0x40a459093b06a60f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129573.795081:0:2271:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c22d000/0x40a459093b06a559 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21502 expref: 292 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129573.795086:0:2271:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc8d800/0x40a459093b06a60f lrc: 4/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 7 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129573.795120:0:2271:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012c22d000/0x40a459093b06a559 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21502 expref: 292 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129573.795132:0:2271:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c22d000/0x40a459093b06a559 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21502 expref: 292 pid: 14549 timeout: 929 lvb_type: 0 00000100:00100000:2.0:1746129573.795144:0:2271:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095626d80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:2271:1830948737547392:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129573.795689:0:2271:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009af1e3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129573.807155:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129573.807188:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129573.807355:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734205312 00000100:00100000:3.0:1746129573.807364:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734205312 00010000:00010000:3.0:1746129573.807404:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c22d000/0x40a459093b06a559 lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21502 expref: 293 pid: 14549 timeout: 929 lvb_type: 0 00000100:00100000:3.0:1746129573.807435:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8404 00000100:00100000:3.0:1746129573.807443:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959d6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ada2ffba-8920-4ecb-8068-68caa9806978+293:1962:x1830948734205312:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129573.807457:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129573.807463:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012c22d000/0x40a459093b06a559 lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21502 expref: 293 pid: 14549 timeout: 929 lvb_type: 0 00010000:00010000:3.0:1746129573.807475:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012c22d000/0x40a459093b06a559 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21502 expref: 293 pid: 14549 timeout: 929 lvb_type: 0 00010000:00010000:3.0:1746129573.807499:0:7085:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:3.0:1746129573.807504:0:7085:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc8d800/0x40a459093b06a60f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129573.807505:0:2271:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c22d000/0x40a459093b06a559 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21502 expref: 293 pid: 14549 timeout: 929 lvb_type: 0 00010000:00010000:3.0:1746129573.807515:0:7085:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc8d800/0x40a459093b06a60f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 2271 initiator: MDT0 00000100:00100000:1.0:1746129573.807517:0:15096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734205184 00000100:00100000:1.0:1746129573.807521:0:15096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734205184 00010000:00010000:3.0:1746129573.807522:0:7085:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc8d800/0x40a459093b06a60f lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 2271 initiator: MDT0 00000100:00100000:2.0:1746129573.807534:0:2271:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095626d80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:2271:1830948737547392:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129573.807542:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129573.807574:0:15096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11256 00000100:00100000:1.0:1746129573.807580:0:15096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ada2ffba-8920-4ecb-8068-68caa9806978+293:32390:x1830948734205184:12345-192.168.202.4@tcp:101:multiop.0 00000100:00100000:3.0:1746129573.807584:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959d6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ada2ffba-8920-4ecb-8068-68caa9806978+293:1962:x1830948734205312:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 142us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129573.807591:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8404 00010000:00010000:1.0:1746129573.807598:0:15096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129573.807600:0:15096:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00000100:00100000:0.0:1746129573.807605:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00010000:00010000:1.0:1746129573.807612:0:15096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880132eddc00/0x40a459093b06a5f3 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2156b expref: 292 pid: 2271 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129573.807622:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734205440 00000100:00100000:3.0:1746129573.807625:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734205440 00010000:00010000:1.0:1746129573.807631:0:15096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880132edd800/0x40a459093b06a5ec lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21564 expref: 292 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129573.807638:0:15096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:1.0:1746129573.807641:0:15096:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129573.807646:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11257 00000100:00100000:3.0:1746129573.807651:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ada2ffba-8920-4ecb-8068-68caa9806978+291:32393:x1830948734205440:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129573.807655:0:15096:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f725400/0x40a459093b06a616 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21579 expref: -99 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129573.807658:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129573.807664:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f968000/0x40a459093b06a61d lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21580 expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129573.807669:0:2271:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc8d800/0x40a459093b06a60f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129573.807678:0:2271:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc8d800/0x40a459093b06a60f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129573.807687:0:2271:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc8d800/0x40a459093b06a60f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00010000:00010000:1.0:1746129573.807698:0:15096:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f725600/0x40a459093b06a624 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15096 initiator: MDT0 00010000:00010000:3.0:1746129573.807701:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f968000/0x40a459093b06a61d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21580 expref: 293 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129573.807711:0:15096:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fac1600/0x40a459093b06a513 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f214ed expref: 10 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129573.807717:0:15096:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f968000/0x40a459093b06a61d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21580 expref: 293 pid: 14549 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1746129573.807718:0:2271:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00000004:00200000:2.0:1746129573.807722:0:2271:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00010000:00010000:1.0:1746129573.807723:0:15096:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880090079800/0x40a459093b06a58a lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f214fb expref: 8 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129573.807728:0:15096:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc8d800/0x40a459093b06a60f lrc: 2/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00010000:00010000:1.0:1746129573.807733:0:15096:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f725600/0x40a459093b06a624 lrc: 7/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15096 initiator: MDT0 00000004:00010000:2.0:1746129573.807738:0:2271:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc8d800/0x40a459093b06a60f lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000020 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129573.807740:0:14549:0:(ldlm_lockd.c:1458:ldlm_handle_enqueue()) ### save blocking bits a in granted lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f968000/0x40a459093b06a61d lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21580 expref: 293 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129573.807749:0:14549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f968000/0x40a459093b06a61d lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21580 expref: 293 pid: 14549 timeout: 929 lvb_type: 0 00010000:00010000:3.0:1746129573.807757:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f968000/0x40a459093b06a61d lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21580 expref: 293 pid: 14549 timeout: 929 lvb_type: 0 00010000:00010000:1.0:1746129573.807760:0:15096:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc8d800/0x40a459093b06a60f lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129573.807772:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:3.0:1746129573.807775:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746129573.807777:0:14549:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f725600/0x40a459093b06a624 lrc: 5/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15096 initiator: MDT0 00010000:00010000:3.0:1746129573.807782:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f968000, rc 0) 00010000:00010000:1.0:1746129573.807796:0:15096:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880090079800/0x40a459093b06a58a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f214fb expref: 8 pid: 15096 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129573.807804:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ada2ffba-8920-4ecb-8068-68caa9806978+293:32393:x1830948734205440:12345-192.168.202.4@tcp:101:cat.0 Request processed in 153us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129573.807809:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11257 00010000:00010000:1.0:1746129573.809499:0:15096:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880090079800/0x40a459093b06a58a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f214fb expref: 8 pid: 15096 timeout: 929 lvb_type: 0 00000100:00100000:0.0:1746129573.809716:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129573.809810:0:20578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734205568 00000100:00100000:3.0:1746129573.809817:0:20578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734205568 00010000:00010000:3.0:1746129573.809845:0:20578:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f968000/0x40a459093b06a61d lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21580 expref: 293 pid: 14549 timeout: 929 lvb_type: 0 00000100:00100000:3.0:1746129573.809871:0:20578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8405 00000100:00100000:3.0:1746129573.809878:0:20578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f37d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ada2ffba-8920-4ecb-8068-68caa9806978+293:1961:x1830948734205568:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129573.809890:0:20578:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129573.809895:0:20578:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f968000/0x40a459093b06a61d lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21580 expref: 293 pid: 14549 timeout: 929 lvb_type: 0 00010000:00010000:3.0:1746129573.809905:0:20578:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f968000/0x40a459093b06a61d lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21580 expref: 293 pid: 14549 timeout: 929 lvb_type: 0 00010000:00010000:3.0:1746129573.809926:0:20578:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:3.0:1746129573.809931:0:20578:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f725600/0x40a459093b06a624 lrc: 5/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15096 initiator: MDT0 00010000:00010000:3.0:1746129573.809939:0:20578:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f725600/0x40a459093b06a624 lrc: 5/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15096 initiator: MDT0 00010000:00010000:3.0:1746129573.809944:0:20578:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129573.809982:0:20578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f37d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ada2ffba-8920-4ecb-8068-68caa9806978+293:1961:x1830948734205568:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 105us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129573.809987:0:20578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8405 00000100:00100000:1.0:1746129573.810072:0:15096:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135720000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15096:1830948737547520:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129573.810148:0:15096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f968000/0x40a459093b06a61d lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21580 expref: 292 pid: 14549 timeout: 929 lvb_type: 0 00010000:00010000:1.0:1746129573.810166:0:15096:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008fac1600/0x40a459093b06a513 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f214ed expref: 10 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129573.810175:0:15096:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fac1600/0x40a459093b06a513 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f214ed expref: 10 pid: 15096 timeout: 929 lvb_type: 0 00000100:00100000:1.0:1746129573.810182:0:15096:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135720380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15096:1830948737547776:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129573.810186:0:2271:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc8d800/0x40a459093b06a60f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129573.810199:0:2271:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800957f9a00/0x40a459093b06a601 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00000100:00100000:1.0:1746129573.810199:0:15096:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934d2240 going to sleep for 11 seconds 00010000:00010000:2.0:1746129573.810206:0:2271:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800957f9a00/0x40a459093b06a601 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129573.810212:0:2271:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800957f9a00/0x40a459093b06a601 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129573.810217:0:2271:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800957f9a00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746129573.810221:0:2271:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800957f9a00/0x40a459093b06a601 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129573.810228:0:2271:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800957f9a00/0x40a459093b06a601 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129573.810363:0:2271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880132ef8f00) 00010000:00010000:2.0:1746129573.810366:0:2271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129573.810378:0:2271:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800957f9a00/0x40a459093b06a601 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129573.810382:0:2271:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800957f9a00/0x40a459093b06a601 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129573.810395:0:2271:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc8da00/0x40a459093b06a608 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129573.810400:0:2271:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc8da00/0x40a459093b06a608 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129573.810405:0:2271:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc8da00/0x40a459093b06a608 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129573.810409:0:2271:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fc8da00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746129573.810411:0:2271:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc8da00/0x40a459093b06a608 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129573.810416:0:2271:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc8da00/0x40a459093b06a608 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129573.810421:0:2271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012db42d00) 00010000:00010000:2.0:1746129573.810423:0:2271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129573.810425:0:2271:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc8da00/0x40a459093b06a608 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129573.810429:0:2271:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc8da00/0x40a459093b06a608 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129573.810466:0:2271:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880132edd000/0x40a459093b06a5fa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21572 expref: 11 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129573.810478:0:2271:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc8d800/0x40a459093b06a60f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21572 expref: 10 pid: 2271 timeout: 929 lvb_type: 0 00010000:00010000:2.0:1746129573.810486:0:2271:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc8d800/0x40a459093b06a60f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21572 expref: 10 pid: 2271 timeout: 929 lvb_type: 0 00010000:00010000:2.0:1746129573.810497:0:2271:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fc8d800, rc 0) 00000100:00100000:2.0:1746129573.810524:0:2271:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:068dab75-d300-4ead-a742-d14572ad1e50+10:32398:x1830948734204928:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 16042us (16647us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129573.810531:0:2271:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11255 00000100:00100000:0.0:1746129573.811211:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129573.812535:0:15096:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135720000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15096:1830948737547520:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129573.812547:0:15096:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135720380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15096:1830948737547776:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129573.812569:0:15096:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009f725600/0x40a459093b06a624 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15096 initiator: MDT0 00000100:00100000:1.0:1746129573.814776:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129573.814820:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129573.814837:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129573.814870:0:2271:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734205696 00000100:00100000:2.0:1746129573.814880:0:2271:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734205696 00000100:00100000:0.0:1746129573.814885:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734205824 00000100:00100000:0.0:1746129573.814894:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734205824 00010000:00010000:0.0:1746129573.814923:0:7087:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090079800/0x40a459093b06a58a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f214fb expref: 9 pid: 15096 timeout: 929 lvb_type: 0 00000100:00100000:2.0:1746129573.814932:0:2271:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11258 00000100:00100000:2.0:1746129573.814939:0:2271:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f37d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ada2ffba-8920-4ecb-8068-68caa9806978+292:32393:x1830948734205696:12345-192.168.202.4@tcp:101:cat.0 00000100:00100000:1.0:1746129573.814943:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129573.814947:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734205952 00000100:00100000:0.0:1746129573.814949:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734205952 00010000:00010000:2.0:1746129573.814961:0:2271:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129573.814961:0:7087:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fac1600/0x40a459093b06a513 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f214ed expref: 10 pid: 15096 timeout: 929 lvb_type: 0 00000100:00100000:0.0:1746129573.814976:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734206080 00010000:00010000:2.0:1746129573.814978:0:2271:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090078000/0x40a459093b06a62b lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21587 expref: -99 pid: 2271 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129573.814978:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734206080 00010000:00010000:0.0:1746129573.814988:0:7087:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc8d800/0x40a459093b06a60f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21572 expref: 11 pid: 2271 timeout: 929 lvb_type: 0 00000100:00100000:0.0:1746129573.815015:0:7087:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8406 00000100:00100000:0.0:1746129573.815021:0:7087:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135720700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+9:1963:x1830948734205824:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129573.815033:0:7087:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129573.815039:0:7087:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880090079800/0x40a459093b06a58a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f214fb expref: 9 pid: 15096 timeout: 929 lvb_type: 0 00010000:00010000:2.0:1746129573.815043:0:2271:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f725600/0x40a459093b06a624 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129573.815051:0:2271:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090078000/0x40a459093b06a62b lrc: 4/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21587 expref: 293 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129573.815064:0:7087:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880090079800/0x40a459093b06a58a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f214fb expref: 9 pid: 15096 timeout: 929 lvb_type: 0 00010000:00010000:2.0:1746129573.815079:0:2271:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88009f725600/0x40a459093b06a624 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 15096 initiator: MDT0 00010000:00010000:0.0:1746129573.815093:0:7087:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090079800/0x40a459093b06a58a lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f214fb expref: 9 pid: 15096 timeout: 929 lvb_type: 0 00010000:00010000:2.0:1746129573.815094:0:2271:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090078000/0x40a459093b06a62b lrc: 3/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21587 expref: 293 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129573.815106:0:2271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:2.0:1746129573.815109:0:2271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746129573.815111:0:2271:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f725600/0x40a459093b06a624 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129573.815118:0:2271:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090078000, rc 0) 00010000:00010000:0.0:1746129573.815119:0:7087:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:0.0:1746129573.815123:0:7087:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f725600/0x40a459093b06a624 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 15096 initiator: MDT0 00010000:00010000:0.0:1746129573.815130:0:7087:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f725600/0x40a459093b06a624 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 15096 initiator: MDT0 00010000:00010000:0.0:1746129573.815134:0:7087:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129573.815142:0:7086:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8407 00000100:00100000:3.0:1746129573.815151:0:7086:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a44450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:068dab75-d300-4ead-a742-d14572ad1e50+11:1963:x1830948734205952:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129573.815162:0:7086:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746129573.815162:0:2271:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f37d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ada2ffba-8920-4ecb-8068-68caa9806978+293:32393:x1830948734205696:12345-192.168.202.4@tcp:101:cat.0 Request processed in 223us (3954us total) trans 0 rc 0/0 00010000:00010000:3.0:1746129573.815167:0:7086:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008fac1600/0x40a459093b06a513 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f214ed expref: 11 pid: 15096 timeout: 929 lvb_type: 0 00000100:00100000:2.0:1746129573.815169:0:2271:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11258 00000100:00100000:0.0:1746129573.815169:0:7087:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135720700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+8:1963:x1830948734205824:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 148us (403us total) trans 0 rc 0/0 00010000:00010000:3.0:1746129573.815177:0:7086:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008fac1600/0x40a459093b06a513 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f214ed expref: 11 pid: 15096 timeout: 929 lvb_type: 0 00000100:00100000:0.0:1746129573.815179:0:7087:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8406 00000100:00100000:2.0:1746129573.815182:0:2271:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734206208 00000100:00100000:2.0:1746129573.815185:0:2271:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734206208 00010000:00010000:3.0:1746129573.815193:0:7086:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fac1600/0x40a459093b06a513 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f214ed expref: 12 pid: 15096 timeout: 929 lvb_type: 0 00000100:00100000:0.0:1746129573.815195:0:7087:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8408 00000100:00100000:0.0:1746129573.815201:0:7087:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135720a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:068dab75-d300-4ead-a742-d14572ad1e50+11:1963:x1830948734206080:12345-192.168.202.4@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746129573.815204:0:14547:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11259 00010000:00010000:0.0:1746129573.815207:0:7087:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746129573.815208:0:14547:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135720e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:068dab75-d300-4ead-a742-d14572ad1e50+11:32398:x1830948734206208:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:3.0:1746129573.815209:0:7086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:0.0:1746129573.815212:0:7087:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc8d800/0x40a459093b06a60f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21572 expref: 11 pid: 2271 timeout: 929 lvb_type: 0 00010000:00010000:3.0:1746129573.815213:0:7086:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f725600/0x40a459093b06a624 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129573.815215:0:14547:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129573.815218:0:7086:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f725600/0x40a459093b06a624 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129573.815220:0:14547:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090078800/0x40a459093b06a632 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2158e expref: -99 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129573.815223:0:7086:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746129573.815227:0:7087:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc8d800/0x40a459093b06a60f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21572 expref: 11 pid: 2271 timeout: 929 lvb_type: 0 00010000:00010000:0.0:1746129573.815238:0:7087:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc8d800/0x40a459093b06a60f lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21572 expref: 12 pid: 2271 timeout: 929 lvb_type: 0 00000100:00100000:3.0:1746129573.815242:0:7086:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a44450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:068dab75-d300-4ead-a742-d14572ad1e50+12:1963:x1830948734205952:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 93us (422us total) trans 0 rc 0/0 00010000:00010000:0.0:1746129573.815247:0:7087:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00000100:00100000:3.0:1746129573.815249:0:7086:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8407 00010000:00010000:0.0:1746129573.815250:0:7087:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f725600/0x40a459093b06a624 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 15096 initiator: MDT0 00010000:00010000:0.0:1746129573.815257:0:7087:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f725600/0x40a459093b06a624 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290400000020 pid: 15096 initiator: MDT0 00010000:00010000:0.0:1746129573.815262:0:7087:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f725600/0x40a459093b06a624 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290400000020 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129573.815267:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090078c00/0x40a459093b06a639 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129573.815269:0:7087:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880090078000/0x40a459093b06a62b lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21587 expref: 292 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129573.815276:0:14547:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090078c00/0x40a459093b06a639 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746129573.815284:0:14547:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880090078c00/0x40a459093b06a639 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129573.815327:0:7087:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129573.815346:0:7087:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135720a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:068dab75-d300-4ead-a742-d14572ad1e50+10:1963:x1830948734206080:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 145us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129573.815356:0:7087:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8408 00010000:00010000:2.0:1746129573.815366:0:15096:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f725600/0x40a459093b06a624 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129573.815371:0:15096:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f725600/0x40a459093b06a624 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 15096 initiator: MDT0 00000040:00080000:2.0:1746129573.815984:0:15096:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3481, 88 off293056 00000004:00080000:2.0:1746129573.815993:0:15096:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 829132698000ns, next at 776349687452ns, rc = 0 00000040:00080000:2.0:1746129573.816056:0:15096:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3492, 88 off293936 00000004:00080000:2.0:1746129573.816060:0:15096:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 829132766160ns, next at 776375382381ns, rc = 0 00000040:00080000:2.0:1746129573.816228:0:15096:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3493, 88 off294024 00000004:00080000:2.0:1746129573.816233:0:15096:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 829132938642ns, next at 776375382381ns, rc = 0 00000040:00080000:2.0:1746129573.816241:0:15096:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3482, 88 off293144 00000004:00080000:2.0:1746129573.816244:0:15096:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 829132949967ns, next at 776349687452ns, rc = 0 00000040:00080000:2.0:1746129573.816265:0:15096:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3483, 88 off293232 00000004:00080000:2.0:1746129573.816268:0:15096:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 829132973822ns, next at 776349687452ns, rc = 0 00000040:00080000:2.0:1746129573.816278:0:15096:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3494, 88 off294112 00000004:00080000:2.0:1746129573.816281:0:15096:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 829132986734ns, next at 776375382381ns, rc = 0 00000040:00080000:2.0:1746129573.816319:0:15096:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3495, 88 off294200 00000004:00080000:2.0:1746129573.816322:0:15096:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 829133028383ns, next at 776375382381ns, rc = 0 00000040:00080000:2.0:1746129573.816330:0:15096:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3496, 88 off294288 00000004:00080000:2.0:1746129573.816333:0:15096:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 829133038967ns, next at 776375382381ns, rc = 0 00000040:00080000:2.0:1746129573.816340:0:15096:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3484, 88 off293320 00000004:00080000:2.0:1746129573.816343:0:15096:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 829133049299ns, next at 776349687452ns, rc = 0 00000040:00080000:2.0:1746129573.816363:0:15096:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3497, 88 off294376 00000004:00080000:2.0:1746129573.816367:0:15096:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 829133072517ns, next at 776375382381ns, rc = 0 00000040:00080000:2.0:1746129573.816373:0:15096:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3485, 88 off293408 00000004:00080000:2.0:1746129573.816376:0:15096:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 829133082264ns, next at 776349687452ns, rc = 0 00000040:00080000:2.0:1746129573.816384:0:15096:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3498, 88 off294464 00000004:00080000:2.0:1746129573.816387:0:15096:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 829133093062ns, next at 776375382381ns, rc = 0 00000040:00080000:2.0:1746129573.816393:0:15096:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3486, 88 off293496 00000004:00080000:2.0:1746129573.816395:0:15096:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 829133101489ns, next at 776349687452ns, rc = 0 00000040:00080000:2.0:1746129573.816508:0:15096:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3487, 88 off293584 00000004:00080000:2.0:1746129573.816513:0:15096:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 829133218820ns, next at 776349687452ns, rc = 0 00000040:00080000:2.0:1746129573.816521:0:15096:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3488, 88 off293672 00000004:00080000:2.0:1746129573.816524:0:15096:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 829133229910ns, next at 776349687452ns, rc = 0 00000040:00080000:2.0:1746129573.816530:0:15096:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3489, 88 off293760 00000004:00080000:2.0:1746129573.816533:0:15096:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 829133238777ns, next at 776349687452ns, rc = 0 00000040:00080000:2.0:1746129573.816539:0:15096:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3499, 88 off294552 00000004:00080000:2.0:1746129573.816542:0:15096:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 829133247795ns, next at 776375382381ns, rc = 0 00000100:00100000:3.0:1746129573.820824:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129573.820852:0:31523:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734206464 00000100:00100000:3.0:1746129573.820861:0:31523:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734206464 00002000:00100000:3.0:1746129573.820907:0:31523:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3ef:0x0] (2097152->3145727) req@ffff8800947bea00 x1830948734206464/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:314/0 lens 488/0 e 0 to 0 dl 1746129584 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129573.820917:0:31523:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800947bea00 with x1830948734206464 ext(2097152->3145727) 00002000:00010000:3.0:1746129573.820923:0:31523:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800947bea00 00000100:00100000:3.0:1746129573.820941:0:31523:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7887 00000100:00100000:3.0:1746129573.820948:0:31523:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:1962:x1830948734206464:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:3.0:1746129573.822232:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129573.822249:0:21463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734206720 00000100:00100000:3.0:1746129573.822254:0:21463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734206720 00002000:00100000:3.0:1746129573.822281:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->4194303) req@ffff8800947bf480 x1830948734206720/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:314/0 lens 488/0 e 0 to 0 dl 1746129584 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129573.822329:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800947bf480 with x1830948734206720 ext(3145728->4194303) 00002000:00010000:3.0:1746129573.822333:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800947bf480 00000100:00100000:3.0:1746129573.822349:0:21463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7888 00000100:00100000:3.0:1746129573.822355:0:21463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+23:1962:x1830948734206720:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:1.0:1746129573.822447:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129573.822476:0:31522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734206976 00000100:00100000:1.0:1746129573.822480:0:31522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734206976 00002000:00100000:1.0:1746129573.822499:0:31522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f5:0x0] (2097152->3145727) req@ffff880135721180 x1830948734206976/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:314/0 lens 488/0 e 0 to 0 dl 1746129584 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129573.822512:0:31522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135721180 with x1830948734206976 ext(2097152->3145727) 00002000:00010000:1.0:1746129573.822515:0:31522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135721180 00000100:00100000:1.0:1746129573.822527:0:31522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7889 00000100:00100000:1.0:1746129573.822532:0:31522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135721180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+28:1962:x1830948734206976:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:2.0:1746129573.824181:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129573.824230:0:31518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734207232 00000100:00100000:2.0:1746129573.824236:0:31518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734207232 00002000:00100000:2.0:1746129573.824274:0:31518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3f5:0x0] (3145728->4194303) req@ffff880095626d80 x1830948734207232/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:314/0 lens 488/0 e 0 to 0 dl 1746129584 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129573.824284:0:31518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095626d80 with x1830948734207232 ext(3145728->4194303) 00002000:00010000:2.0:1746129573.824324:0:31518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095626d80 00000100:00100000:2.0:1746129573.824345:0:31518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7890 00000100:00100000:2.0:1746129573.824353:0:31518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095626d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+30:1963:x1830948734207232:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:3.0:1746129573.845530:0:31523:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+23:1962:x1830948734206464:12345-192.168.202.4@tcp:3:cat.0 Request processed in 24568us (24701us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129573.845544:0:31523:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7887 00002000:00100000:3.0:1746129573.845560:0:31523:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3ef:0x0] (2097152->3145727) req@ffff8800947bea00 x1830948734206464/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:314/0 lens 488/440 e 0 to 0 dl 1746129584 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129573.845572:0:31523:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800947bea00 with x1830948734206464 ext(2097152->3145727) 00002000:00010000:3.0:1746129573.845579:0:31523:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800947bea00 00000100:00100000:3.0:1746129573.853611:0:21463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:1962:x1830948734206720:12345-192.168.202.4@tcp:3:cat.0 Request processed in 31243us (31371us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129573.853623:0:21463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7888 00002000:00100000:3.0:1746129573.853635:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->4194303) req@ffff8800947bf480 x1830948734206720/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:314/0 lens 488/440 e 0 to 0 dl 1746129584 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129573.853645:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800947bf480 with x1830948734206720 ext(3145728->4194303) 00002000:00010000:3.0:1746129573.853651:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800947bf480 00000100:00100000:2.0:1746129573.858978:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129573.859317:0:2271:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734207360 00000100:00100000:3.0:1746129573.859327:0:2271:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734207360 00000100:00100000:3.0:1746129573.859773:0:2271:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11260 00000100:00100000:3.0:1746129573.859785:0:2271:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094efdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+8:32395:x1830948734207360:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129573.859808:0:2271:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129573.859826:0:2271:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b637800/0x40a459093b06a640 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21595 expref: -99 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129573.859888:0:2271:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b637800/0x40a459093b06a640 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21595 expref: 9 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129573.859901:0:2271:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b637800/0x40a459093b06a640 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21595 expref: 9 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129573.859914:0:2271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:3.0:1746129573.859917:0:2271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746129573.859921:0:2271:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880090078000/0x40a459093b06a62b lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21587 expref: 293 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129573.859928:0:2271:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b637800, rc 0) 00000100:00100000:1.0:1746129573.861531:0:31522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135721180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+30:1962:x1830948734206976:12345-192.168.202.4@tcp:3:cat.0 Request processed in 38986us (39072us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129573.861544:0:31522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7889 00002000:00100000:1.0:1746129573.861557:0:31522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f5:0x0] (2097152->3145727) req@ffff880135721180 x1830948734206976/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:314/0 lens 488/440 e 0 to 0 dl 1746129584 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129573.861574:0:31522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135721180 with x1830948734206976 ext(2097152->3145727) 00002000:00010000:1.0:1746129573.861580:0:31522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135721180 00000100:00100000:3.0:1746129573.862432:0:2271:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094efdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+9:32395:x1830948734207360:12345-192.168.202.4@tcp:101:cat.0 Request processed in 2647us (3459us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129573.862441:0:2271:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11260 00000100:00100000:2.0:1746129573.864424:0:31518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095626d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+28:1963:x1830948734207232:12345-192.168.202.4@tcp:3:cat.0 Request processed in 40066us (40247us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129573.864435:0:31518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7890 00002000:00100000:2.0:1746129573.864447:0:31518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3f5:0x0] (3145728->4194303) req@ffff880095626d80 x1830948734207232/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:314/0 lens 488/440 e 0 to 0 dl 1746129584 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129573.864456:0:31518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095626d80 with x1830948734207232 ext(3145728->4194303) 00002000:00010000:2.0:1746129573.864462:0:31518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095626d80 00000100:00100000:2.0:1746129573.869835:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129573.870699:0:14543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734207488 00000100:00100000:0.0:1746129573.870711:0:14543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734207488 00000100:00100000:1.0:1746129573.871665:0:14545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 219 00000100:00100000:1.0:1746129573.871677:0:14545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098ece050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8b5f81a-2f18-4d7f-accf-308742f5a04f+15:1962:x1830948734207488:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:1.0:1746129573.871773:0:14545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098ece050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8b5f81a-2f18-4d7f-accf-308742f5a04f+15:1962:x1830948734207488:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 99us (1945us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129573.871780:0:14545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 219 00000001:00080000:1.0:1746129573.880155:0:14619:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945355 is committed 00000001:00080000:1.0:1746129573.880171:0:14619:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945354 is committed 00000001:00080000:1.0:1746129573.880175:0:14619:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945353 is committed 00000001:00080000:1.0:1746129573.880185:0:14619:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945358 is committed 00000004:00080000:1.0:1746129573.880188:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2669 committed 00000004:00080000:1.0:1746129573.880195:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2659 committed 00000004:00080000:1.0:1746129573.880203:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2658 committed 00000004:00080000:1.0:1746129573.880205:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2657 committed 00000004:00080000:1.0:1746129573.880207:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2656 committed 00000004:00080000:1.0:1746129573.880208:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2668 committed 00000004:00080000:1.0:1746129573.880210:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2655 committed 00000004:00080000:1.0:1746129573.880211:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2667 committed 00000004:00080000:1.0:1746129573.880213:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2654 committed 00010000:00010000:2.0:1746129573.880214:0:15096:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f725600/0x40a459093b06a624 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21579 expref: 292 pid: 15096 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1746129573.880214:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2666 committed 00000004:00080000:1.0:1746129573.880216:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2665 committed 00000004:00080000:1.0:1746129573.880218:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2664 committed 00000004:00080000:1.0:1746129573.880220:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2653 committed 00000004:00080000:1.0:1746129573.880221:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2652 committed 00000004:00080000:1.0:1746129573.880222:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2663 committed 00000004:00080000:1.0:1746129573.880223:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2662 committed 00000004:00080000:1.0:1746129573.880224:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2651 committed 00010000:00010000:2.0:1746129573.880227:0:15096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00000001:00080000:1.0:1746129573.880230:0:14619:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945357 is committed 00010000:00010000:2.0:1746129573.880231:0:15096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1746129573.880235:0:15096:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880090078c00/0x40a459093b06a639 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746129573.880244:0:15096:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880090078c00/0x40a459093b06a639 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746129573.880249:0:15096:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090078c00/0x40a459093b06a639 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746129573.880254:0:15096:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880090078000/0x40a459093b06a62b lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21587 expref: 291 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129573.880261:0:15096:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880090078000/0x40a459093b06a62b lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21587 expref: 291 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129573.880265:0:15096:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090078000/0x40a459093b06a62b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21587 expref: 291 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129573.880270:0:15096:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012b637800/0x40a459093b06a640 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21595 expref: 6 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129573.880275:0:15096:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b637800/0x40a459093b06a640 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21595 expref: 6 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129573.880280:0:15096:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b637800/0x40a459093b06a640 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21595 expref: 6 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129573.880333:0:15096:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012b637800/0x40a459093b06a640 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21595 expref: 6 pid: 2271 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129573.880348:0:15096:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094efce00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15096:1830948737548032:192.168.202.4@tcp:105: 00000100:00100000:1.0:1746129573.880414:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135721880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1830948737548160:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1746129573.880458:0:15096:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff880090078000/0x40a459093b06a62b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21587 expref: 291 pid: 2271 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129573.880458:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129573.880466:0:15096:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f95b800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15096:1830948737549056:192.168.202.4@tcp:105: 00000100:00100000:1.0:1746129573.880481:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135722680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1830948737548672:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129573.880487:0:15096:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1a12540 going to sleep for 11 seconds 00000100:00100000:1.0:1746129573.880493:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129573.880511:0:3303:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1746129573.880515:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135721500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1830948737547904:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129573.880532:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129573.880541:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135722300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1830948737548544:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129573.880554:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129573.880569:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135721c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737548288:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129573.880584:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129573.880596:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135722a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737548800:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1746129573.880608:0:14547:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880090078c00/0x40a459093b06a639 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00000100:00100000:1.0:1746129573.880610:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1746129573.880615:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090078c00/0x40a459093b06a639 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00000100:00100000:1.0:1746129573.880621:0:3300:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1746129573.880624:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135721f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737548416:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129573.880635:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129573.880644:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135722d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737548928:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129573.880655:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00200000:2.0:1746129573.880661:0:14547:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00000004:00200000:2.0:1746129573.880665:0:14547:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000100:00100000:1.0:1746129573.880675:0:20577:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737548160 00000004:00010000:2.0:1746129573.880682:0:14547:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880090078c00/0x40a459093b06a639 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00000100:00100000:1.0:1746129573.880683:0:20577:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737548160 00010000:00010000:2.0:1746129573.880714:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090078800/0x40a459093b06a632 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2158e expref: 8 pid: 14547 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129573.880714:0:20577:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737548672 00000100:00100000:1.0:1746129573.880716:0:20577:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737548672 00000100:00100000:1.0:1746129573.880724:0:20577:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737547904 00000100:00100000:1.0:1746129573.880725:0:20577:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737547904 00010000:00010000:2.0:1746129573.880731:0:14547:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090078c00/0x40a459093b06a639 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2158e expref: 7 pid: 14547 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129573.880734:0:20577:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737548544 00000100:00100000:1.0:1746129573.880736:0:20577:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737548544 00010000:00010000:2.0:1746129573.880738:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:2.0:1746129573.880740:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1746129573.880742:0:14547:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090078c00, rc 0) 00000100:00100000:1.0:1746129573.880744:0:20577:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737548288 00000100:00100000:1.0:1746129573.880745:0:20577:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737548288 00000100:00100000:1.0:1746129573.880751:0:20577:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737548800 00000100:00100000:1.0:1746129573.880752:0:20577:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737548800 00000100:00100000:1.0:1746129573.880757:0:20577:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737548416 00000100:00100000:1.0:1746129573.880758:0:20577:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737548416 00000100:00100000:1.0:1746129573.880766:0:20577:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737548928 00000100:00100000:1.0:1746129573.880768:0:20577:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737548928 00000100:00100000:2.0:1746129573.880769:0:14547:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135720e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:068dab75-d300-4ead-a742-d14572ad1e50+7:32398:x1830948734206208:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 65560us (65826us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129573.880777:0:14547:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11259 00000100:00100000:1.0:1746129573.880777:0:20577:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16377 00000100:00100000:1.0:1746129573.880783:0:20577:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135723100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+48:3303:x1830948737548160:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129573.880801:0:22480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16378 00000100:00100000:2.0:1746129573.880806:0:22480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135723480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+48:3303:x1830948737548672:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129573.880838:0:8412:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16379 00000100:00100000:1.0:1746129573.880842:0:8412:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bf78850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+48:3303:x1830948737547904:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129573.880935:0:31503:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16380 00000100:00100000:1.0:1746129573.880939:0:31503:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135723800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+50:3303:x1830948737548544:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129573.880966:0:22480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135723480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+50:3303:x1830948737548672:12345-0@lo:2:osp-syn-0-0.0 Request processed in 160us (471us total) trans 21474841388 rc 0/0 00000100:00100000:2.0:1746129573.880971:0:22480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16378 00000100:00100000:2.0:1746129573.880983:0:22480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16381 00000100:00100000:2.0:1746129573.880986:0:22480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135723b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+49:3300:x1830948737548288:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129573.881019:0:31503:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135723800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+51:3303:x1830948737548544:12345-0@lo:2:osp-syn-0-0.0 Request processed in 79us (463us total) trans 21474841390 rc 0/0 00000100:00100000:1.0:1746129573.881027:0:31503:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16380 00002000:00010000:2.0:1746129573.881036:0:20577:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb size from disk: 2097152 -> 2097152 00000100:00100000:1.0:1746129573.881037:0:31503:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16382 00002000:00010000:2.0:1746129573.881038:0:20577:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb mtime from disk: 1746129574 -> 1746129574 00002000:00010000:2.0:1746129573.881041:0:20577:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb atime from disk: 1746129574 -> 1746129574 00000100:00100000:1.0:1746129573.881041:0:31503:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135720700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+50:3300:x1830948737548800:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746129573.881043:0:20577:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb ctime from disk: 1746129574 -> 1746129574 00002000:00010000:2.0:1746129573.881045:0:20577:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb blocks from disk: 2077 -> 2077 00000100:00100000:2.0:1746129573.881060:0:20577:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135723100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+50:3303:x1830948737548160:12345-0@lo:2:osp-syn-0-0.0 Request processed in 278us (603us total) trans 21474841391 rc 0/0 00000100:00100000:2.0:1746129573.881065:0:20577:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16377 00000100:00100000:2.0:1746129573.881073:0:20577:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16383 00000100:00100000:2.0:1746129573.881076:0:20577:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135720380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+49:3300:x1830948737548416:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746129573.881100:0:31503:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746129573.881102:0:31503:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1746129573.881104:0:31503:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746129573.881106:0:31503:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1746129573.881107:0:31503:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1746129573.881127:0:31503:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135720700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+51:3300:x1830948737548800:12345-0@lo:2:osp-syn-0-0.0 Request processed in 86us (516us total) trans 21474841392 rc 0/0 00000100:00100000:1.0:1746129573.881132:0:31503:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16382 00000100:00100000:2.0:1746129573.881135:0:20577:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135720380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+51:3300:x1830948737548416:12345-0@lo:2:osp-syn-0-0.0 Request processed in 59us (499us total) trans 21474841393 rc 0/0 00000100:00100000:2.0:1746129573.881140:0:20577:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16383 00000100:00100000:1.0:1746129573.881142:0:31503:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16384 00000100:00100000:1.0:1746129573.881145:0:31503:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135720000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+49:3300:x1830948737548928:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746129573.881167:0:8412:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3ec:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:2.0:1746129573.881169:0:8412:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ec:0x0] updating lvb mtime from disk: 1746129573 -> 1746129573 00002000:00010000:2.0:1746129573.881170:0:8412:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3ec:0x0] updating lvb atime from disk: 1746129571 -> 1746129571 00002000:00010000:2.0:1746129573.881172:0:8412:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ec:0x0] updating lvb ctime from disk: 1746129573 -> 1746129573 00002000:00010000:2.0:1746129573.881173:0:8412:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3ec:0x0] updating lvb blocks from disk: 2073 -> 2073 00000004:00080000:1.0:1746129573.881180:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135721f80/2, rc 0, transno 21474841393 00000100:00100000:2.0:1746129573.881187:0:8412:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bf78850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+49:3303:x1830948737547904:12345-0@lo:2:osp-syn-0-0.0 Request processed in 344us (653us total) trans 21474841389 rc 0/0 00000100:00100000:1.0:1746129573.881187:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135721f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737548416:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746129573.881194:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135722a00/2, rc 0, transno 21474841392 00000100:00100000:2.0:1746129573.881195:0:8412:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16379 00000100:00100000:1.0:1746129573.881197:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135722a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737548800:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746129573.881207:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135721500/2, rc 0, transno 21474841389 00000100:00100000:1.0:1746129573.881209:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135721500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1830948737547904:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746129573.881214:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135722300/2, rc 0, transno 21474841390 00000100:00100000:1.0:1746129573.881216:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135722300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1830948737548544:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746129573.881221:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135721880/2, rc 0, transno 21474841391 00000100:00100000:1.0:1746129573.881223:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135721880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1830948737548160:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746129573.881230:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135722680/2, rc 0, transno 21474841388 00000100:00100000:1.0:1746129573.881232:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135722680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1830948737548672:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129573.881254:0:3303:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1746129573.881258:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135723480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1830948737549184:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129573.881273:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129573.881315:0:22481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737549184 00000100:00100000:1.0:1746129573.881318:0:22481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737549184 00000100:00100000:1.0:1746129573.881333:0:22481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16385 00000100:00100000:1.0:1746129573.881336:0:22481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135723100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+49:3303:x1830948737549184:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129573.881420:0:22481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135723100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+50:3303:x1830948737549184:12345-0@lo:2:osp-syn-0-0.0 Request processed in 82us (144us total) trans 21474841394 rc 0/0 00000100:00100000:1.0:1746129573.881424:0:22481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16385 00002000:00010000:2.0:1746129573.881442:0:22480:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb size from disk: 5146336 -> 5146336 00000004:00080000:1.0:1746129573.881442:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135723480/2, rc 0, transno 21474841394 00002000:00010000:2.0:1746129573.881445:0:22480:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb mtime from disk: 1746129574 -> 1746129574 00000100:00100000:1.0:1746129573.881445:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135723480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1830948737549184:0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746129573.881446:0:22480:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb atime from disk: 1746129573 -> 1746129573 00002000:00010000:2.0:1746129573.881448:0:22480:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb ctime from disk: 1746129574 -> 1746129574 00002000:00010000:2.0:1746129573.881450:0:22480:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb blocks from disk: 6033 -> 6033 00000100:00100000:2.0:1746129573.881469:0:22480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135723b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+50:3300:x1830948737548288:12345-0@lo:2:osp-syn-0-0.0 Request processed in 483us (884us total) trans 21474841395 rc 0/0 00000100:00100000:2.0:1746129573.881474:0:22480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16381 00000100:00100000:1.0:1746129573.881518:0:31503:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135720000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+50:3300:x1830948737548928:12345-0@lo:2:osp-syn-0-0.0 Request processed in 371us (860us total) trans 21474841396 rc 0/0 00000100:00100000:1.0:1746129573.881523:0:31503:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16384 00000004:00080000:1.0:1746129573.881539:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135722d80/2, rc 0, transno 21474841396 00000100:00100000:1.0:1746129573.881542:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135722d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737548928:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746129573.881547:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135721c00/2, rc 0, transno 21474841395 00000100:00100000:1.0:1746129573.881549:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135721c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737548288:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129573.881849:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a77b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737549568:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129573.881873:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129573.881885:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094f46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737550080:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129573.881897:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129573.881912:0:3301:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1746129573.881916:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f37d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737549440:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129573.881930:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129573.881939:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a77b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737549952:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129573.881950:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129573.881967:0:8411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737549568 00000100:00100000:0.0:1746129573.881976:0:8411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737549568 00000100:00100000:0.0:1746129573.881991:0:8411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737550080 00000100:00100000:0.0:1746129573.881993:0:8411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737550080 00000100:00100000:0.0:1746129573.882001:0:8411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737549440 00000100:00100000:0.0:1746129573.882003:0:8411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737549440 00000100:00100000:0.0:1746129573.882016:0:8411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737549952 00000100:00100000:0.0:1746129573.882018:0:8411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737549952 00000100:00100000:0.0:1746129573.882027:0:8411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16386 00000100:00100000:0.0:1746129573.882031:0:8411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+40:3301:x1830948737549568:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129573.882114:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a77b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737549696:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129573.882138:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129573.882147:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094f44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737550208:0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746129573.882147:0:8411:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3f5:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746129573.882150:0:8411:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f5:0x0] updating lvb mtime from disk: 1746129574 -> 1746129574 00002000:00010000:0.0:1746129573.882152:0:8411:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f5:0x0] updating lvb atime from disk: 1746129574 -> 1746129574 00002000:00010000:0.0:1746129573.882154:0:8411:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f5:0x0] updating lvb ctime from disk: 1746129574 -> 1746129574 00002000:00010000:0.0:1746129573.882155:0:8411:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f5:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:3.0:1746129573.882160:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129573.882167:0:3302:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1746129573.882171:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f37e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737549312:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129573.882179:0:8411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+41:3301:x1830948737549568:12345-0@lo:2:osp-syn-1-0.0 Request processed in 147us (304us total) trans 17179874137 rc 0/0 00000100:00100000:3.0:1746129573.882184:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129573.882184:0:8411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16386 00000100:00100000:3.0:1746129573.882190:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a77b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737549824:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129573.882192:0:8411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737549696 00000100:00100000:0.0:1746129573.882195:0:8411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737549696 00000100:00100000:3.0:1746129573.882200:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129573.882202:0:8411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737550208 00000100:00100000:0.0:1746129573.882204:0:8411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737550208 00000100:00100000:0.0:1746129573.882209:0:8411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737549312 00000100:00100000:0.0:1746129573.882211:0:8411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737549312 00000100:00100000:0.0:1746129573.882222:0:8411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737549824 00000100:00100000:0.0:1746129573.882224:0:8411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737549824 00000100:00100000:0.0:1746129573.882234:0:8411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16387 00000100:00100000:0.0:1746129573.882238:0:8411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+44:3301:x1830948737550080:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129573.882310:0:4699:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16388 00000100:00100000:1.0:1746129573.882317:0:4699:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e957b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+44:3301:x1830948737549440:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746129573.882397:0:4699:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746129573.882401:0:4699:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb mtime from disk: 1746129571 -> 1746129571 00002000:00010000:1.0:1746129573.882402:0:4699:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb atime from disk: 1746129571 -> 1746129571 00002000:00010000:1.0:1746129573.882404:0:4699:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb ctime from disk: 1746129572 -> 1746129572 00002000:00010000:1.0:1746129573.882406:0:4699:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746129573.882426:0:4699:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e957b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+45:3301:x1830948737549440:12345-0@lo:2:osp-syn-1-0.0 Request processed in 110us (495us total) trans 17179874138 rc 0/0 00000100:00100000:1.0:1746129573.882431:0:4699:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16388 00000100:00100000:1.0:1746129573.882441:0:4699:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16389 00000100:00100000:1.0:1746129573.882445:0:4699:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+44:3301:x1830948737549952:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129573.882568:0:4699:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+45:3301:x1830948737549952:12345-0@lo:2:osp-syn-1-0.0 Request processed in 122us (615us total) trans 17179874139 rc 0/0 00000100:00100000:1.0:1746129573.882573:0:4699:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16389 00000100:00100000:1.0:1746129573.882583:0:4699:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16390 00000100:00100000:1.0:1746129573.882587:0:4699:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+45:3302:x1830948737549696:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129573.882610:0:8411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+45:3301:x1830948737550080:12345-0@lo:2:osp-syn-1-0.0 Request processed in 371us (712us total) trans 17179874140 rc 0/0 00000100:00100000:0.0:1746129573.882615:0:8411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16387 00000100:00100000:0.0:1746129573.882624:0:8411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16391 00000100:00100000:0.0:1746129573.882628:0:8411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+44:3302:x1830948737550208:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129573.882640:0:8410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16392 00000100:00100000:0.0:1746129573.882644:0:8410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+45:3302:x1830948737549312:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746129573.882648:0:4699:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746129573.882650:0:4699:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb mtime from disk: 1746129523 -> 1746129523 00002000:00010000:1.0:1746129573.882652:0:4699:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb atime from disk: 1746129523 -> 1746129523 00002000:00010000:1.0:1746129573.882654:0:4699:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb ctime from disk: 1746129524 -> 1746129524 00002000:00010000:1.0:1746129573.882655:0:4699:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1746129573.883379:0:22480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16393 00000100:00100000:2.0:1746129573.883388:0:22480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+46:3302:x1830948737549824:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129573.883813:0:22480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+47:3302:x1830948737549824:12345-0@lo:2:osp-syn-1-0.0 Request processed in 426us (1610us total) trans 17179874143 rc 0/0 00000100:00100000:2.0:1746129573.883820:0:22480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16393 00000100:00100000:1.0:1746129573.884167:0:4699:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+46:3302:x1830948737549696:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1578us (2026us total) trans 17179874141 rc 0/0 00000100:00100000:1.0:1746129573.884174:0:4699:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16390 00000004:00080000:3.0:1746129573.884259:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a77b0380/2, rc 0, transno 17179874141 00000100:00100000:3.0:1746129573.884265:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a77b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737549696:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746129573.884275:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a77b1880/2, rc 0, transno 17179874143 00000100:00100000:3.0:1746129573.884278:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a77b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737549824:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746129573.884861:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f37d180/2, rc 0, transno 17179874138 00000100:00100000:2.0:1746129573.884866:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f37d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737549440:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746129573.884876:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a77b0700/2, rc 0, transno 17179874139 00000100:00100000:2.0:1746129573.884879:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a77b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737549952:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746129573.884888:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a77b1500/2, rc 0, transno 17179874137 00002000:00010000:0.0:1746129573.884888:0:8410:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb size from disk: 2097152 -> 2097152 00000100:00100000:2.0:1746129573.884891:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a77b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737549568:0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746129573.884892:0:8410:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb mtime from disk: 1746129573 -> 1746129573 00002000:00010000:0.0:1746129573.884894:0:8410:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb atime from disk: 1746129571 -> 1746129571 00002000:00010000:0.0:1746129573.884896:0:8410:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb ctime from disk: 1746129572 -> 1746129572 00000004:00080000:2.0:1746129573.884898:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094f46680/2, rc 0, transno 17179874140 00002000:00010000:0.0:1746129573.884898:0:8410:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:2.0:1746129573.884900:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094f46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737550080:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746129573.884991:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f37e680/2, rc 0, transno 17179874142 00000100:00100000:3.0:1746129573.884996:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f37e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737549312:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129573.885057:0:8410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+45:3302:x1830948737549312:12345-0@lo:2:osp-syn-1-0.0 Request processed in 2412us (2871us total) trans 17179874142 rc 0/0 00000100:00100000:2.0:1746129573.885103:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129573.885106:0:15096:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094efce00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15096:1830948737548032:192.168.202.4@tcp:105: 00000100:00100000:3.0:1746129573.885115:0:15096:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f95b800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15096:1830948737549056:192.168.202.4@tcp:105: 00000100:00100000:2.0:1746129573.885127:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129573.885144:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129573.885193:0:20861:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734207616 00000100:00100000:1.0:1746129573.885199:0:20861:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734207616 00000100:00100000:1.0:1746129573.885229:0:20861:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734207872 00000100:00100000:1.0:1746129573.885231:0:20861:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734207872 00000100:00100000:1.0:1746129573.885245:0:20861:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4782 00000100:00100000:2.0:1746129573.885250:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129573.885250:0:20861:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+7:32395:x1830948734207616:12345-192.168.202.4@tcp:49:cat.0 00000100:00100000:2.0:1746129573.885318:0:16680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4783 00000100:00100000:2.0:1746129573.885325:0:16680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f530c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ada2ffba-8920-4ecb-8068-68caa9806978+292:32393:x1830948734207872:12345-192.168.202.4@tcp:49:cat.0 00000100:00100000:2.0:1746129573.885378:0:16680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f530c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ada2ffba-8920-4ecb-8068-68caa9806978+292:32393:x1830948734207872:12345-192.168.202.4@tcp:49:cat.0 Request processed in 54us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129573.885390:0:16680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4783 00010000:00010000:3.0:1746129573.885403:0:15096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f725400/0x40a459093b06a616 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21579 expref: 291 pid: 15096 timeout: 0 lvb_type: 3 00000100:00100000:2.0:1746129573.885409:0:14547:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734207744 00000100:00100000:2.0:1746129573.885412:0:14547:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734207744 00010000:00010000:3.0:1746129573.885429:0:15096:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f725600/0x40a459093b06a624 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21579 expref: 290 pid: 15096 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129573.885431:0:14547:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734208000 00000100:00100000:2.0:1746129573.885433:0:14547:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734208000 00000100:00100000:2.0:1746129573.885447:0:14547:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11261 00010000:00010000:3.0:1746129573.885449:0:15096:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f725600, rc 0) 00000100:00100000:2.0:1746129573.885451:0:14547:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:068dab75-d300-4ead-a742-d14572ad1e50+7:32398:x1830948734207744:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:2.0:1746129573.885461:0:14547:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129573.885472:0:14547:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a05bb800/0x40a459093b06a647 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2159c expref: -99 pid: 14547 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129573.885500:0:8410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16392 00010000:00010000:2.0:1746129573.885520:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a05bb800/0x40a459093b06a647 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2159c expref: 8 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129573.885532:0:14547:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a05bb800/0x40a459093b06a647 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2159c expref: 8 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129573.885544:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:2.0:1746129573.885547:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746129573.885550:0:14547:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a05bb800, rc 0) 00000100:00100000:1.0:1746129573.886065:0:20861:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+8:32395:x1830948734207616:12345-192.168.202.4@tcp:49:cat.0 Request processed in 810us (961us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129573.886072:0:20861:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4782 00000100:00100000:3.0:1746129573.886202:0:15096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ada2ffba-8920-4ecb-8068-68caa9806978+290:32390:x1830948734205184:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 78621us (79056us total) trans 8589945358 rc 0/0 00000100:00100000:3.0:1746129573.886207:0:15096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11256 00000100:00100000:3.0:1746129573.886224:0:15096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11262 00000100:00100000:3.0:1746129573.886231:0:15096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094065c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+7:32397:x1830948734208000:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:3.0:1746129573.886238:0:15096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129573.886246:0:15096:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b637600/0x40a459093b06a64e lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f215a3 expref: -99 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129573.886272:0:15096:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b637600/0x40a459093b06a64e lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f215a3 expref: 8 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129573.886281:0:15096:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b637600/0x40a459093b06a64e lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f215a3 expref: 8 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129573.886323:0:15096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:3.0:1746129573.886326:0:15096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746129573.886328:0:15096:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b637600, rc 0) 00000100:00100000:2.0:1746129573.886328:0:14547:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:068dab75-d300-4ead-a742-d14572ad1e50+8:32398:x1830948734207744:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 875us (1199us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129573.886337:0:14547:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11261 00000100:00100000:3.0:1746129573.886348:0:15096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094065c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+8:32397:x1830948734208000:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 118us (1098us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129573.886356:0:15096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11262 00000100:00100000:2.0:1746129573.886691:0:8411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+45:3302:x1830948737550208:12345-0@lo:2:osp-syn-1-0.0 Request processed in 4062us (4530us total) trans 17179874144 rc 0/0 00000100:00100000:2.0:1746129573.886697:0:8411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16391 00000004:00080000:3.0:1746129573.886773:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094f44000/2, rc 0, transno 17179874144 00000100:00100000:3.0:1746129573.886778:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094f44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737550208:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129573.893258:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129573.893339:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129573.893389:0:11014:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734208128 00000100:00100000:1.0:1746129573.893400:0:11014:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734208128 00000100:00100000:0.0:1746129573.893414:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129573.893438:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734208256 00000100:00100000:1.0:1746129573.893441:0:11014:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734208384 00000100:00100000:1.0:1746129573.893443:0:11014:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734208384 00000100:00100000:0.0:1746129573.893444:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734208256 00000100:00100000:1.0:1746129573.893474:0:11014:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16394 00000100:00100000:0.0:1746129573.893486:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16395 00000100:00100000:0.0:1746129573.893492:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:068dab75-d300-4ead-a742-d14572ad1e50+9:1960:x1830948734208384:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:0.0:1746129573.893506:0:7149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129573.893520:0:7149:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800946f1a00/0x40a459093b06a655 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f215b8 expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129573.893539:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129573.893540:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129573.893548:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800946f1a00/0x40a459093b06a655 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f215b8 expref: 10 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129573.893560:0:7149:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800946f1a00/0x40a459093b06a655 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f215b8 expref: 10 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129573.893568:0:7149:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800946f1a00, rc 0) 00000100:00100000:0.0:1746129573.893600:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:068dab75-d300-4ead-a742-d14572ad1e50+10:1960:x1830948734208384:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 109us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129573.893605:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16395 00000100:00100000:0.0:1746129573.893617:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16396 00000100:00100000:0.0:1746129573.893621:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:068dab75-d300-4ead-a742-d14572ad1e50+9:1960:x1830948734208256:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:0.0:1746129573.893629:0:7149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129573.893635:0:7149:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800946f1400/0x40a459093b06a65c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f215b1 expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129573.893644:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129573.893646:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129573.893650:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800946f1400/0x40a459093b06a65c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f215b1 expref: 10 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129573.893658:0:7149:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800946f1400/0x40a459093b06a65c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f215b1 expref: 10 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129573.893664:0:7149:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800946f1400, rc 0) 00000100:00100000:0.0:1746129573.893678:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:068dab75-d300-4ead-a742-d14572ad1e50+10:1960:x1830948734208256:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 56us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129573.893682:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16396 00000100:00100000:1.0:1746129573.893898:0:11014:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:068dab75-d300-4ead-a742-d14572ad1e50+8:1960:x1830948734208128:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:1.0:1746129573.893914:0:11014:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129573.893930:0:11014:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a9209000/0x40a459093b06a663 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f215aa expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129573.893950:0:11014:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129573.893952:0:11014:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129573.893960:0:11014:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a9209000/0x40a459093b06a663 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f215aa expref: 9 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129573.893972:0:11014:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a9209000/0x40a459093b06a663 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f215aa expref: 9 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129573.893982:0:11014:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a9209000, rc 0) 00000100:00100000:1.0:1746129573.894033:0:11014:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:068dab75-d300-4ead-a742-d14572ad1e50+9:1960:x1830948734208128:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 553us (784us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129573.894039:0:11014:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16394 00000100:00100000:0.0:1746129573.894332:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129573.894390:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129573.894407:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129573.894431:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129573.894434:0:8411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734208512 00000100:00100000:3.0:1746129573.894439:0:8411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734208512 00000100:00100000:3.0:1746129573.894461:0:8411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734208640 00000100:00100000:3.0:1746129573.894463:0:8411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734208640 00000100:00100000:3.0:1746129573.894475:0:8411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734208768 00000100:00100000:3.0:1746129573.894483:0:8411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734208768 00000100:00100000:2.0:1746129573.894487:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16397 00000100:00100000:2.0:1746129573.894494:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:068dab75-d300-4ead-a742-d14572ad1e50+10:1960:x1830948734208512:12345-192.168.202.4@tcp:101:lfs.0 00000100:00100000:3.0:1746129573.894499:0:8411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16398 00000100:00100000:3.0:1746129573.894505:0:8411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094065180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:068dab75-d300-4ead-a742-d14572ad1e50+10:1960:x1830948734208640:12345-192.168.202.4@tcp:101:lfs.0 00000100:00100000:0.0:1746129573.894508:0:11014:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16399 00010000:00010000:3.0:1746129573.894512:0:8411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746129573.894515:0:11014:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094065f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:068dab75-d300-4ead-a742-d14572ad1e50+10:1960:x1830948734208768:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:3.0:1746129573.894522:0:8411:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b637400/0x40a459093b06a66a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f215c6 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129573.894523:0:11014:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129573.894530:0:11014:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f845e00/0x40a459093b06a671 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f215cd expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129573.894534:0:8411:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129573.894535:0:8411:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129573.894540:0:8411:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b637400/0x40a459093b06a66a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f215c6 expref: 11 pid: 8411 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129573.894540:0:11014:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129573.894541:0:11014:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129573.894546:0:11014:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f845e00/0x40a459093b06a671 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f215cd expref: 11 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129573.894550:0:8411:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b637400/0x40a459093b06a66a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f215c6 expref: 11 pid: 8411 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129573.894556:0:8411:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b637400, rc 0) 00010000:00010000:0.0:1746129573.894558:0:11014:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f845e00/0x40a459093b06a671 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f215cd expref: 11 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129573.894564:0:11014:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f845e00, rc 0) 00000100:00100000:3.0:1746129573.894582:0:8411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094065180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:068dab75-d300-4ead-a742-d14572ad1e50+11:1960:x1830948734208640:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 76us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129573.894582:0:11014:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094065f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:068dab75-d300-4ead-a742-d14572ad1e50+11:1960:x1830948734208768:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 68us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129573.894587:0:8411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16398 00000100:00100000:0.0:1746129573.894596:0:11014:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16399 00010000:00010000:2.0:1746129573.894706:0:4385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129573.894716:0:4385:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a05bbc00/0x40a459093b06a678 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f215bf expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129573.894728:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129573.894730:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129573.894735:0:4385:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a05bbc00/0x40a459093b06a678 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f215bf expref: 11 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129573.894744:0:4385:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a05bbc00/0x40a459093b06a678 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f215bf expref: 11 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129573.894751:0:4385:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a05bbc00, rc 0) 00000100:00100000:2.0:1746129573.894767:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:068dab75-d300-4ead-a742-d14572ad1e50+11:1960:x1830948734208512:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 274us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129573.894772:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16397 00000100:00100000:1.0:1746129573.894850:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734208896 00000100:00100000:1.0:1746129573.894856:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734208896 00000100:00100000:1.0:1746129573.894897:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 796 00000100:00100000:1.0:1746129573.894903:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094064700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+8:1960:x1830948734208896:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129573.894913:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129573.894932:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b637600/0x40a459093b06a64e lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f215a3 expref: 8 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129573.894949:0:9823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:1.0:1746129573.894953:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129573.894974:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094064700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+7:1960:x1830948734208896:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 72us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129573.894980:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 796 00000100:00100000:0.0:1746129573.902822:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129573.902876:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129573.902895:0:31503:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734209280 00000100:00100000:1.0:1746129573.902904:0:31503:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734209280 00000100:00100000:1.0:1746129573.902948:0:31503:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16400 00000100:00100000:1.0:1746129573.902967:0:31503:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ada2ffba-8920-4ecb-8068-68caa9806978+36:32390:x1830948734209280:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:1.0:1746129573.902993:0:31503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129573.903012:0:31503:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a9209e00/0x40a459093b06a67f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f215db expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129573.903043:0:31503:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f444600/0x40a459093b06a575 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2152c expref: 37 pid: 31503 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129573.903052:0:31503:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f845e00/0x40a459093b06a671 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f215cd expref: 10 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129573.903058:0:31503:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c22d400/0x40a459093b06a5bb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21556 expref: 27 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129573.903065:0:31503:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129573.903066:0:31503:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129573.903069:0:31503:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a9209e00/0x40a459093b06a67f lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [3379200->3964927] (req 3379200->3964927) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f215db expref: 37 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129573.903101:0:31503:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c22d400/0x40a459093b06a5bb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21556 expref: 27 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129573.903114:0:31503:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c22d400/0x40a459093b06a5bb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21556 expref: 27 pid: 4385 timeout: 929 lvb_type: 1 00000100:00100000:1.0:1746129573.903126:0:31503:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900f7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:31503:1830948737550336:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129573.903222:0:31503:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f845e00/0x40a459093b06a671 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f215cd expref: 10 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129573.903230:0:31503:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f845e00/0x40a459093b06a671 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f215cd expref: 10 pid: 11014 timeout: 929 lvb_type: 1 00000100:00100000:1.0:1746129573.903237:0:31503:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7db480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:31503:1830948737550464:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129573.903262:0:31503:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f444600/0x40a459093b06a575 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2152c expref: 37 pid: 31503 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129573.903268:0:31503:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f444600/0x40a459093b06a575 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2152c expref: 37 pid: 31503 timeout: 929 lvb_type: 1 00000100:00100000:1.0:1746129573.903280:0:31503:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7d9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:31503:1830948737550592:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129573.903349:0:31503:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934d2240 going to sleep for 11 seconds 00000100:00100000:3.0:1746129573.907784:0:16908:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734209152 00000100:00100000:3.0:1746129573.907797:0:16908:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734209152 00000100:00100000:3.0:1746129573.907869:0:16908:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11263 00000100:00100000:3.0:1746129573.907876:0:16908:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:068dab75-d300-4ead-a742-d14572ad1e50+8:32398:x1830948734209152:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:3.0:1746129573.907898:0:16908:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129573.907924:0:16908:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b637000/0x40a459093b06a686 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f215d4 expref: -99 pid: 16908 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129573.908022:0:31503:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900f7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:31503:1830948737550336:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129573.908034:0:31503:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7db480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:31503:1830948737550464:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129573.908042:0:31503:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7d9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:31503:1830948737550592:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129573.908047:0:16908:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b636e00/0x40a459093b06a68d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129573.908061:0:16908:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b636e00/0x40a459093b06a68d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129573.908071:0:16908:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b636e00/0x40a459093b06a68d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129573.908081:0:31503:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a9209e00/0x40a459093b06a67f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [3379200->3964927] (req 3379200->3964927) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f215db expref: 37 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129573.908084:0:16908:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b636c00/0x40a459093b06a694 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129573.908089:0:16908:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b636c00/0x40a459093b06a694 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129573.908095:0:16908:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b636c00/0x40a459093b06a694 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129573.908096:0:31503:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a9209e00, rc 0) 00000100:00100000:1.0:1746129573.908155:0:31503:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ada2ffba-8920-4ecb-8068-68caa9806978+37:32390:x1830948734209280:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 5199us (5343us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129573.908163:0:31503:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16400 00010000:00010000:3.0:1746129573.908205:0:16908:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b636a00/0x40a459093b06a69b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129573.908213:0:16908:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b636a00/0x40a459093b06a69b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129573.908219:0:16908:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b636a00/0x40a459093b06a69b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00000004:00200000:3.0:1746129573.908232:0:16908:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:0.0:1746129573.908448:0:16908:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b636e00/0x40a459093b06a68d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129573.908456:0:16908:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b636e00/0x40a459093b06a68d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129573.908462:0:16908:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b636e00/0x40a459093b06a68d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129573.908467:0:16908:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b636e00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:0.0:1746129573.908471:0:16908:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b636e00/0x40a459093b06a68d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129573.908477:0:16908:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b636e00/0x40a459093b06a68d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129573.908489:0:16908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880132ef8f00) 00010000:00010000:0.0:1746129573.908492:0:16908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129573.908496:0:16908:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b636e00/0x40a459093b06a68d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129573.908504:0:16908:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b636e00/0x40a459093b06a68d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129573.908528:0:16908:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b636c00/0x40a459093b06a694 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129573.908533:0:16908:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b636c00/0x40a459093b06a694 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129573.908537:0:16908:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b636c00/0x40a459093b06a694 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129573.908541:0:16908:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b636c00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:0.0:1746129573.908543:0:16908:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b636c00/0x40a459093b06a694 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129573.908547:0:16908:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b636c00/0x40a459093b06a694 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129573.908553:0:16908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009ce7d800) 00010000:00010000:0.0:1746129573.908555:0:16908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129573.908557:0:16908:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b636c00/0x40a459093b06a694 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129573.908560:0:16908:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b636c00/0x40a459093b06a694 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129573.908595:0:16908:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b637000/0x40a459093b06a686 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f215d4 expref: 11 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129573.908610:0:16908:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b636a00/0x40a459093b06a69b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f215d4 expref: 10 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129573.908620:0:16908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:0.0:1746129573.908622:0:16908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746129573.908624:0:16908:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b636a00, rc 0) 00000100:00100000:0.0:1746129573.908661:0:16908:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:068dab75-d300-4ead-a742-d14572ad1e50+10:32398:x1830948734209152:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 785us (5784us total) trans 8589945359 rc 0/0 00000100:00100000:0.0:1746129573.908667:0:16908:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11263 00000100:00100000:0.0:1746129573.909955:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129573.911562:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734209408 00000100:00100000:2.0:1746129573.911576:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734209408 00010000:00010000:2.0:1746129573.911619:0:7087:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f845e00/0x40a459093b06a671 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f215cd expref: 11 pid: 11014 timeout: 929 lvb_type: 1 00000100:00100000:2.0:1746129573.911649:0:7087:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8409 00000100:00100000:2.0:1746129573.911662:0:7087:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa26a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:068dab75-d300-4ead-a742-d14572ad1e50+11:1962:x1830948734209408:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129573.911676:0:7087:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129573.911701:0:7087:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f845e00/0x40a459093b06a671 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f215cd expref: 11 pid: 11014 timeout: 929 lvb_type: 1 00010000:00010000:2.0:1746129573.911712:0:7087:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f845e00/0x40a459093b06a671 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f215cd expref: 11 pid: 11014 timeout: 929 lvb_type: 1 00010000:00010000:2.0:1746129573.911731:0:7087:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f845e00/0x40a459093b06a671 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f215cd expref: 11 pid: 11014 timeout: 929 lvb_type: 1 00010000:00010000:2.0:1746129573.911904:0:7087:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129573.911952:0:7087:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa26a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:068dab75-d300-4ead-a742-d14572ad1e50+10:1962:x1830948734209408:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 295us (2003us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129573.911957:0:7087:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8409 00000100:00100000:0.0:1746129573.912459:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129573.912519:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129573.912647:0:31503:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734209664 00000100:00100000:1.0:1746129573.912651:0:31503:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734209664 00000100:00100000:1.0:1746129573.913094:0:31503:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16401 00000100:00100000:1.0:1746129573.913100:0:31503:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c07b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:068dab75-d300-4ead-a742-d14572ad1e50+10:1960:x1830948734209664:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:1.0:1746129573.913115:0:31503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129573.913128:0:31503:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800915dc400/0x40a459093b06a6a9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f215e2 expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129573.913144:0:31503:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129573.913152:0:31503:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800915dc400/0x40a459093b06a6a9 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f215e2 expref: 11 pid: 31503 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129573.913166:0:31503:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800915dc400/0x40a459093b06a6a9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f215e2 expref: 11 pid: 31503 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129573.913180:0:31503:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800915dc400, rc 0) 00000100:00100000:1.0:1746129573.913205:0:31503:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c07b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:068dab75-d300-4ead-a742-d14572ad1e50+10:1960:x1830948734209664:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 106us (748us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129573.913209:0:31503:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16401 00000100:00100000:2.0:1746129573.913271:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734209536 00000100:00100000:2.0:1746129573.913274:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734209536 00010000:00010000:2.0:1746129573.913658:0:9823:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c22d400/0x40a459093b06a5bb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21556 expref: 28 pid: 4385 timeout: 929 lvb_type: 1 00000100:00100000:2.0:1746129573.913683:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8410 00000100:00100000:2.0:1746129573.913689:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c079500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+28:1961:x1830948734209536:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129573.913700:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129573.913720:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c22d400/0x40a459093b06a5bb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21556 expref: 28 pid: 4385 timeout: 929 lvb_type: 1 00010000:00010000:2.0:1746129573.913729:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c22d400/0x40a459093b06a5bb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21556 expref: 28 pid: 4385 timeout: 929 lvb_type: 1 00010000:00010000:2.0:1746129573.913743:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c22d400/0x40a459093b06a5bb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21556 expref: 28 pid: 4385 timeout: 929 lvb_type: 1 00010000:00010000:2.0:1746129573.913753:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129573.914363:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c079500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+27:1961:x1830948734209536:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 672us (1841us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129573.914370:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8410 00000100:00100000:0.0:1746129573.914491:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129573.914722:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734209792 00000100:00100000:3.0:1746129573.914728:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734209792 00000100:00100000:3.0:1746129573.914774:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16402 00000100:00100000:3.0:1746129573.914780:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c078380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+27:32395:x1830948734209792:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129573.914791:0:4385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129573.914984:0:4385:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b637e00/0x40a459093b06a6b0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f215e9 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129573.915002:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129573.915004:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129573.915011:0:4385:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b637e00/0x40a459093b06a6b0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f215e9 expref: 28 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129573.915025:0:4385:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b637e00/0x40a459093b06a6b0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f215e9 expref: 28 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129573.915034:0:4385:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b637e00, rc 0) 00000100:00100000:3.0:1746129573.915068:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c078380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+28:32395:x1830948734209792:12345-192.168.202.4@tcp:101:cat.0 Request processed in 289us (578us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129573.915074:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16402 00000100:00100000:0.0:1746129573.915222:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129573.915325:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734209920 00000100:00100000:3.0:1746129573.915329:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734209920 00000100:00100000:3.0:1746129573.915345:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16403 00000100:00100000:3.0:1746129573.915350:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c079c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+28:32397:x1830948734209920:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:3.0:1746129573.915356:0:4385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129573.915368:0:4385:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b637000/0x40a459093b06a6b7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f215f0 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129573.915382:0:4385:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ce26800/0x40a459093b06a544 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21510 expref: 36 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129573.915390:0:4385:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800946f1400/0x40a459093b06a65c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f215b1 expref: 9 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129573.915396:0:4385:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008fac1800/0x40a459093b06a59f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2153a expref: 29 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129573.915401:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129573.915403:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129573.915405:0:4385:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b637000/0x40a459093b06a6b7 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [1892352->2097151] (req 1892352->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f215f0 expref: 29 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129573.915432:0:4385:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008fac1800/0x40a459093b06a59f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2153a expref: 29 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129573.915442:0:4385:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008fac1800/0x40a459093b06a59f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2153a expref: 29 pid: 4385 timeout: 929 lvb_type: 1 00000100:00100000:3.0:1746129573.915454:0:4385:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:4385:1830948737550720:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129573.915526:0:4385:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800946f1400/0x40a459093b06a65c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f215b1 expref: 9 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129573.915533:0:4385:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800946f1400/0x40a459093b06a65c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f215b1 expref: 9 pid: 7149 timeout: 929 lvb_type: 1 00000100:00100000:3.0:1746129573.915541:0:4385:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:4385:1830948737550848:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129573.915566:0:4385:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012ce26800/0x40a459093b06a544 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21510 expref: 36 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129573.915573:0:4385:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012ce26800/0x40a459093b06a544 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21510 expref: 36 pid: 8412 timeout: 929 lvb_type: 1 00000100:00100000:3.0:1746129573.915579:0:4385:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947be680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:4385:1830948737550976:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129573.915594:0:4385:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e29fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129573.917470:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129573.917760:0:4385:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:4385:1830948737550720:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129573.917771:0:4385:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:4385:1830948737550848:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129573.917778:0:4385:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947be680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:4385:1830948737550976:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129573.917808:0:4385:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b637000/0x40a459093b06a6b7 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [1892352->2097151] (req 1892352->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f215f0 expref: 29 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129573.917821:0:4385:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b637000, rc 0) 00000100:00100000:3.0:1746129573.917860:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c079c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+29:32397:x1830948734209920:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 2509us (2638us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129573.917868:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16403 00000100:00100000:0.0:1746129573.918071:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129573.918124:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129573.918142:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129573.918155:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129573.918167:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129573.918181:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129573.918198:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129573.918217:0:16908:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734211584 00000100:00100000:0.0:1746129573.918222:0:16908:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734211584 00000100:00100000:0.0:1746129573.918256:0:16908:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11264 00000100:00100000:0.0:1746129573.918262:0:16908:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c078700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:068dab75-d300-4ead-a742-d14572ad1e50+10:32398:x1830948734211584:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:0.0:1746129573.918280:0:16908:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129573.918329:0:16908:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f845200/0x40a459093b06a6be lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f215f7 expref: -99 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129573.918425:0:16908:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba8be00/0x40a459093b06a6c5 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129573.918437:0:16908:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba8be00/0x40a459093b06a6c5 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129573.918447:0:16908:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba8be00/0x40a459093b06a6c5 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129573.918460:0:16908:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba8be00/0x40a459093b06a6c5 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129573.918465:0:16908:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba8be00/0x40a459093b06a6c5 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129573.918470:0:16908:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba8be00/0x40a459093b06a6c5 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129573.918475:0:16908:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ba8be00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:0.0:1746129573.918479:0:16908:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba8be00/0x40a459093b06a6c5 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129573.918485:0:16908:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba8be00/0x40a459093b06a6c5 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129573.918495:0:16908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:0.0:1746129573.918498:0:16908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746129573.918502:0:16908:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba8be00/0x40a459093b06a6c5 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129573.918507:0:16908:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba8be00/0x40a459093b06a6c5 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129573.918539:0:16908:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f845200/0x40a459093b06a6be lrc: 1/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f215f7 expref: 11 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129573.918546:0:16908:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f845200/0x40a459093b06a6be lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f215f7 expref: 11 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129573.918553:0:16908:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f845200, rc 0) 00000100:00100000:0.0:1746129573.918573:0:16908:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c078700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:068dab75-d300-4ead-a742-d14572ad1e50+10:32398:x1830948734211584:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 311us (502us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129573.918583:0:16908:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11264 00000100:00100000:0.0:1746129573.918603:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734210816 00000100:00100000:0.0:1746129573.918605:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734210816 00000100:00100000:2.0:1746129573.918609:0:31518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734210432 00000100:00100000:2.0:1746129573.918613:0:31518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734210432 00010000:00010000:0.0:1746129573.918619:0:7087:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008fac1800/0x40a459093b06a59f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2153a expref: 29 pid: 4385 timeout: 929 lvb_type: 1 00000100:00100000:0.0:1746129573.918633:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734210688 00000100:00100000:0.0:1746129573.918635:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734210688 00002000:00100000:2.0:1746129573.918640:0:31518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3f5:0x0] (3145728->4194303) req@ffff88009c078a80 x1830948734210432/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:314/0 lens 488/0 e 0 to 0 dl 1746129584 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:0.0:1746129573.918642:0:7087:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800946f1400/0x40a459093b06a65c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f215b1 expref: 10 pid: 7149 timeout: 929 lvb_type: 1 00002000:00100000:2.0:1746129573.918649:0:31518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c078a80 with x1830948734210432 ext(3145728->4194303) 00000100:00100000:0.0:1746129573.918653:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734211072 00000100:00100000:0.0:1746129573.918654:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734211072 00010000:00010000:2.0:1746129573.918655:0:31518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008f444600/0x40a459093b06a575 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2152c expref: 37 pid: 31503 timeout: 929 lvb_type: 1 00010000:00010000:0.0:1746129573.918659:0:7087:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012ce26800/0x40a459093b06a544 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21510 expref: 38 pid: 8412 timeout: 929 lvb_type: 1 00010000:00010000:2.0:1746129573.918665:0:31518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008f444600/0x40a459093b06a575 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2152c expref: 38 pid: 31503 timeout: 929 lvb_type: 1 00002000:00010000:2.0:1746129573.918671:0:31518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c078a80 00000100:00100000:0.0:1746129573.918671:0:7087:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8411 00000100:00100000:0.0:1746129573.918675:0:7087:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c07b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+29:1961:x1830948734210816:12345-192.168.202.4@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746129573.918681:0:31518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734210304 00000100:00100000:2.0:1746129573.918683:0:31518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734210304 00010000:00010000:0.0:1746129573.918685:0:7087:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00100000:2.0:1746129573.918692:0:31518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3f5:0x0] (2097152->3145727) req@ffff88009c07ad80 x1830948734210304/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:314/0 lens 488/0 e 0 to 0 dl 1746129584 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129573.918697:0:31518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c07ad80 with x1830948734210304 ext(2097152->3145727) 00010000:00010000:2.0:1746129573.918701:0:31518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008f444600/0x40a459093b06a575 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2152c expref: 39 pid: 31503 timeout: 929 lvb_type: 1 00010000:00010000:0.0:1746129573.918702:0:7087:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008fac1800/0x40a459093b06a59f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2153a expref: 29 pid: 4385 timeout: 929 lvb_type: 1 00010000:00010000:2.0:1746129573.918707:0:31518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008f444600/0x40a459093b06a575 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2152c expref: 39 pid: 31503 timeout: 929 lvb_type: 1 00010000:00010000:0.0:1746129573.918710:0:7087:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008fac1800/0x40a459093b06a59f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2153a expref: 29 pid: 4385 timeout: 929 lvb_type: 1 00002000:00010000:2.0:1746129573.918713:0:31518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c07ad80 00000100:00100000:2.0:1746129573.918719:0:31518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734210944 00000100:00100000:2.0:1746129573.918721:0:31518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734210944 00010000:00010000:0.0:1746129573.918722:0:7087:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008fac1800/0x40a459093b06a59f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2153a expref: 29 pid: 4385 timeout: 929 lvb_type: 1 00002000:00100000:2.0:1746129573.918730:0:31518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3ef:0x0] (2097152->3145727) req@ffff88009c07aa00 x1830948734210944/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:314/0 lens 488/0 e 0 to 0 dl 1746129584 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:0.0:1746129573.918730:0:7087:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:2.0:1746129573.918736:0:31518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c07aa00 with x1830948734210944 ext(2097152->3145727) 00002000:00010000:2.0:1746129573.918739:0:31518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c07aa00 00000100:00100000:0.0:1746129573.918743:0:7087:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c07b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+28:1961:x1830948734210816:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 68us (619us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129573.918747:0:31518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734211200 00000100:00100000:0.0:1746129573.918748:0:7087:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8411 00000100:00100000:2.0:1746129573.918749:0:31518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734211200 00000100:00100000:0.0:1746129573.918757:0:7087:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8412 00002000:00100000:2.0:1746129573.918758:0:31518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->4194303) req@ffff88009c079880 x1830948734211200/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:314/0 lens 488/0 e 0 to 0 dl 1746129584 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746129573.918761:0:7087:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c079180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:068dab75-d300-4ead-a742-d14572ad1e50+10:1963:x1830948734210688:12345-192.168.202.4@tcp:103:ldlm_bl.0 00002000:00100000:2.0:1746129573.918764:0:31518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c079880 with x1830948734211200 ext(3145728->4194303) 00002000:00010000:2.0:1746129573.918766:0:31518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c079880 00010000:00010000:0.0:1746129573.918768:0:7087:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129573.918773:0:7087:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800946f1400/0x40a459093b06a65c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f215b1 expref: 10 pid: 7149 timeout: 929 lvb_type: 1 00000100:00100000:2.0:1746129573.918775:0:31518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2448 00000100:00100000:2.0:1746129573.918779:0:31518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c078a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ada2ffba-8920-4ecb-8068-68caa9806978+39:1963:x1830948734210432:12345-192.168.202.4@tcp:3:cat.0 00010000:00010000:0.0:1746129573.918781:0:7087:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800946f1400/0x40a459093b06a65c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f215b1 expref: 10 pid: 7149 timeout: 929 lvb_type: 1 00010000:00010000:0.0:1746129573.918790:0:7087:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800946f1400/0x40a459093b06a65c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f215b1 expref: 10 pid: 7149 timeout: 929 lvb_type: 1 00010000:00010000:0.0:1746129573.918801:0:7087:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129573.918812:0:7087:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c079180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:068dab75-d300-4ead-a742-d14572ad1e50+9:1963:x1830948734210688:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 51us (657us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129573.918816:0:7087:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8412 00000100:00100000:0.0:1746129573.918825:0:7087:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8413 00000100:00100000:0.0:1746129573.918828:0:7087:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a44050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ada2ffba-8920-4ecb-8068-68caa9806978+39:1963:x1830948734211072:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129573.918833:0:7087:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129573.918838:0:7087:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012ce26800/0x40a459093b06a544 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21510 expref: 39 pid: 8412 timeout: 929 lvb_type: 1 00010000:00010000:0.0:1746129573.918844:0:7087:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012ce26800/0x40a459093b06a544 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21510 expref: 39 pid: 8412 timeout: 929 lvb_type: 1 00010000:00010000:0.0:1746129573.918853:0:7087:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ce26800/0x40a459093b06a544 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21510 expref: 39 pid: 8412 timeout: 929 lvb_type: 1 00010000:00010000:0.0:1746129573.918862:0:7087:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129573.918864:0:7087:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129573.918869:0:7087:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b637000/0x40a459093b06a6b7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1892352->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f215f0 expref: 27 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129573.918875:0:7087:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b637000/0x40a459093b06a6b7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1892352->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f215f0 expref: 27 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129573.918897:0:7087:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012b637000/0x40a459093b06a6b7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1892352->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f215f0 expref: 27 pid: 4385 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129573.918907:0:7087:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c07a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7087:1830948737551104:192.168.202.4@tcp:105: 00000100:00100000:0.0:1746129573.918950:0:7087:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a00f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746129573.918969:0:31520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2449 00000100:00100000:0.0:1746129573.918973:0:31520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c07ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ada2ffba-8920-4ecb-8068-68caa9806978+38:1963:x1830948734210304:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:2.0:1746129573.920074:0:21725:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7891 00000100:00100000:2.0:1746129573.920083:0:21725:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c07aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ada2ffba-8920-4ecb-8068-68caa9806978+39:1962:x1830948734210944:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:1.0:1746129573.921684:0:31522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7892 00000100:00100000:1.0:1746129573.921698:0:31522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c079880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ada2ffba-8920-4ecb-8068-68caa9806978+39:1962:x1830948734211200:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:2.0:1746129573.928344:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129573.930998:0:31523:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734211840 00000100:00100000:3.0:1746129573.931014:0:31523:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734211840 00002000:00100000:3.0:1746129573.931071:0:31523:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f5:0x0] (2097152->3145727) req@ffff880094067100 x1830948734211840/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:314/0 lens 488/0 e 0 to 0 dl 1746129584 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129573.931087:0:31523:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094067100 with x1830948734211840 ext(2097152->3145727) 00002000:00010000:3.0:1746129573.931093:0:31523:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094067100 00000100:00100000:3.0:1746129573.931120:0:31523:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7893 00000100:00100000:3.0:1746129573.931127:0:31523:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094067100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+28:1963:x1830948734211840:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:1.0:1746129573.934969:0:7087:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c07a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7087:1830948737551104:192.168.202.4@tcp:105: 00010000:00010000:1.0:1746129573.934992:0:7087:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129573.935038:0:7087:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a44050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ada2ffba-8920-4ecb-8068-68caa9806978+40:1963:x1830948734211072:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 16207us (16854us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129573.935049:0:7087:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8413 00000100:00100000:2.0:1746129573.940097:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129573.940141:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129573.940565:0:31518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c078a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ada2ffba-8920-4ecb-8068-68caa9806978+38:1963:x1830948734210432:12345-192.168.202.4@tcp:3:cat.0 Request processed in 21783us (23099us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129573.940576:0:31518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2448 00002000:00100000:2.0:1746129573.940590:0:31518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3f5:0x0] (3145728->4194303) req@ffff88009c078a80 x1830948734210432/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:314/0 lens 488/440 e 0 to 0 dl 1746129584 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129573.940601:0:31518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c078a80 with x1830948734210432 ext(3145728->4194303) 00010000:00010000:2.0:1746129573.940613:0:31518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008f444600/0x40a459093b06a575 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2152c expref: 38 pid: 31503 timeout: 929 lvb_type: 1 00010000:00010000:2.0:1746129573.940628:0:31518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008f444600/0x40a459093b06a575 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2152c expref: 38 pid: 31503 timeout: 929 lvb_type: 1 00002000:00010000:2.0:1746129573.940635:0:31518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c078a80 00000100:00100000:2.0:1746129573.940662:0:31518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734212096 00000100:00100000:2.0:1746129573.940670:0:31518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734212096 00002000:00100000:2.0:1746129573.940706:0:31518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3f3:0x0] (1892352->1896447) req@ffff880094065880 x1830948734212096/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:314/0 lens 488/0 e 0 to 0 dl 1746129584 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129573.940713:0:31518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094065880 with x1830948734212096 ext(1892352->1896447) 00002000:00010000:2.0:1746129573.940716:0:31518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094065880 00000100:00100000:2.0:1746129573.940733:0:31518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7894 00000100:00100000:2.0:1746129573.940739:0:31518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094065880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+30:1962:x1830948734212096:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:2.0:1746129573.940869:0:31518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094065880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+30:1962:x1830948734212096:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 129us (781us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129573.940873:0:31518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7894 00002000:00100000:2.0:1746129573.940877:0:31518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3f3:0x0] (1892352->1896447) req@ffff880094065880 x1830948734212096/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:314/0 lens 488/4536 e 0 to 0 dl 1746129584 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129573.940882:0:31518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094065880 with x1830948734212096 ext(1892352->1896447) 00002000:00010000:2.0:1746129573.940885:0:31518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094065880 00000100:00100000:0.0:1746129573.941372:0:31520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c07ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ada2ffba-8920-4ecb-8068-68caa9806978+36:1963:x1830948734210304:12345-192.168.202.4@tcp:3:cat.0 Request processed in 22397us (23228us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129573.941380:0:31520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2449 00002000:00100000:0.0:1746129573.941386:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3f5:0x0] (2097152->3145727) req@ffff88009c07ad80 x1830948734210304/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:314/0 lens 488/440 e 0 to 0 dl 1746129584 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746129573.942585:0:14551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734212352 00000100:00100000:3.0:1746129573.942596:0:14551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734212352 00000100:00100000:3.0:1746129573.942650:0:14551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4784 00000100:00100000:3.0:1746129573.942656:0:14551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094067800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:068dab75-d300-4ead-a742-d14572ad1e50+10:32398:x1830948734212352:12345-192.168.202.4@tcp:35:lfs.0 00002000:00100000:0.0:1746129573.942757:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c07ad80 with x1830948734210304 ext(2097152->3145727) 00010000:00010000:0.0:1746129573.942767:0:31520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008f444600/0x40a459093b06a575 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2152c expref: 36 pid: 31503 timeout: 929 lvb_type: 1 00010000:00010000:0.0:1746129573.942780:0:31520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008f444600/0x40a459093b06a575 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2152c expref: 36 pid: 31503 timeout: 929 lvb_type: 1 00002000:00010000:0.0:1746129573.942786:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c07ad80 00000100:00100000:3.0:1746129573.942862:0:14551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094067800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:068dab75-d300-4ead-a742-d14572ad1e50+11:32398:x1830948734212352:12345-192.168.202.4@tcp:35:lfs.0 Request processed in 206us (2720us total) trans 8589945360 rc 0/0 00000100:00100000:3.0:1746129573.942868:0:14551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4784 00000100:00100000:2.0:1746129573.946377:0:21725:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c07aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ada2ffba-8920-4ecb-8068-68caa9806978+40:1962:x1830948734210944:12345-192.168.202.4@tcp:3:cat.0 Request processed in 26282us (28195us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129573.946389:0:21725:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7891 00002000:00100000:2.0:1746129573.946403:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ef:0x0] (2097152->3145727) req@ffff88009c07aa00 x1830948734210944/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:314/0 lens 488/440 e 0 to 0 dl 1746129584 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129573.946412:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c07aa00 with x1830948734210944 ext(2097152->3145727) 00002000:00010000:2.0:1746129573.946418:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c07aa00 00000100:00100000:0.0:1746129573.952444:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129573.953041:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129573.953126:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734212480 00000100:00100000:3.0:1746129573.953137:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734212480 00000100:00100000:1.0:1746129573.953247:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734212608 00000100:00100000:1.0:1746129573.953250:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734212608 00010000:00010000:1.0:1746129573.953277:0:7087:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f444600/0x40a459093b06a575 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2152c expref: 37 pid: 31503 timeout: 929 lvb_type: 1 00000100:00100000:1.0:1746129573.953362:0:7087:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8414 00000100:00100000:1.0:1746129573.953370:0:7087:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c07b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ada2ffba-8920-4ecb-8068-68caa9806978+37:1963:x1830948734212608:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129573.953384:0:7087:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129573.953407:0:7087:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f444600/0x40a459093b06a575 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2152c expref: 37 pid: 31503 timeout: 929 lvb_type: 1 00010000:00010000:1.0:1746129573.953420:0:7087:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f444600/0x40a459093b06a575 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2152c expref: 37 pid: 31503 timeout: 929 lvb_type: 1 00010000:00010000:1.0:1746129573.953443:0:7087:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f444600/0x40a459093b06a575 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2152c expref: 37 pid: 31503 timeout: 929 lvb_type: 1 00010000:00010000:1.0:1746129573.953464:0:7087:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129573.953466:0:7087:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129573.953473:0:7087:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a9209e00/0x40a459093b06a67f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [3379200->18446744073709551615] (req 3379200->3964927) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f215db expref: 36 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129573.953481:0:7087:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a9209e00/0x40a459093b06a67f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [3379200->18446744073709551615] (req 3379200->3964927) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f215db expref: 36 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129573.953515:0:7087:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a9209e00/0x40a459093b06a67f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [3379200->18446744073709551615] (req 3379200->3964927) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f215db expref: 36 pid: 31503 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129573.953528:0:7087:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7d9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7087:1830948737551232:192.168.202.4@tcp:105: 00000100:00100000:1.0:1746129573.953608:0:7087:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934d2a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746129573.953781:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16404 00000100:00100000:3.0:1746129573.953788:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c079500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ada2ffba-8920-4ecb-8068-68caa9806978+36:32393:x1830948734212480:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129573.953801:0:4385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129573.953811:0:4385:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f725400/0x40a459093b06a6cc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f215fe expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129573.953826:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129573.953827:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129573.953831:0:4385:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f725400/0x40a459093b06a6cc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f215fe expref: 37 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129573.953840:0:4385:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f725400/0x40a459093b06a6cc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f215fe expref: 37 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129573.953848:0:4385:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f725400, rc 0) 00000100:00100000:3.0:1746129573.953870:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c079500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ada2ffba-8920-4ecb-8068-68caa9806978+37:32393:x1830948734212480:12345-192.168.202.4@tcp:101:cat.0 Request processed in 83us (1439us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129573.953875:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16404 00000100:00100000:3.0:1746129573.955120:0:31523:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094067100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+28:1963:x1830948734211840:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 23988us (26781us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129573.955130:0:31523:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7893 00002000:00100000:3.0:1746129573.955140:0:31523:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f5:0x0] (2097152->3145727) req@ffff880094067100 x1830948734211840/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:314/0 lens 488/440 e 0 to 0 dl 1746129584 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129573.955149:0:31523:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094067100 with x1830948734211840 ext(2097152->3145727) 00002000:00010000:3.0:1746129573.955153:0:31523:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094067100 00000100:00100000:1.0:1746129573.955280:0:31522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c079880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ada2ffba-8920-4ecb-8068-68caa9806978+38:1962:x1830948734211200:12345-192.168.202.4@tcp:3:cat.0 Request processed in 33587us (37080us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129573.955312:0:31522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7892 00002000:00100000:1.0:1746129573.955317:0:31522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->4194303) req@ffff88009c079880 x1830948734211200/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:314/0 lens 488/440 e 0 to 0 dl 1746129584 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129573.955323:0:31522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c079880 with x1830948734211200 ext(3145728->4194303) 00002000:00010000:1.0:1746129573.955327:0:31522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c079880 00000100:00100000:0.0:1746129573.962891:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129573.962993:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129573.963275:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129573.963399:0:31523:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734212864 00000100:00100000:3.0:1746129573.963408:0:31523:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734212864 00002000:00100000:3.0:1746129573.963458:0:31523:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->4194303) req@ffff88009c079180 x1830948734212864/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:314/0 lens 488/0 e 0 to 0 dl 1746129584 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129573.963469:0:31523:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c079180 with x1830948734212864 ext(3145728->4194303) 00002000:00010000:3.0:1746129573.963475:0:31523:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c079180 00000100:00100000:3.0:1746129573.963492:0:31523:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734213120 00000100:00100000:3.0:1746129573.963494:0:31523:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734213120 00002000:00100000:3.0:1746129573.963506:0:31523:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f5:0x0] (2097152->3145727) req@ffff88009c07a300 x1830948734213120/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:314/0 lens 488/0 e 0 to 0 dl 1746129584 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129573.963513:0:31523:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c07a300 with x1830948734213120 ext(2097152->3145727) 00002000:00010000:3.0:1746129573.963515:0:31523:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c07a300 00000100:00100000:2.0:1746129573.963569:0:31522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7895 00000100:00100000:2.0:1746129573.963579:0:31522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c079180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:1961:x1830948734212864:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:3.0:1746129573.964882:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7896 00000100:00100000:3.0:1746129573.964891:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c07a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+37:1963:x1830948734213120:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:1.0:1746129573.966215:0:7087:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7d9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7087:1830948737551232:192.168.202.4@tcp:105: 00010000:00010000:1.0:1746129573.966239:0:7087:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129573.966268:0:7087:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c07b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ada2ffba-8920-4ecb-8068-68caa9806978+38:1963:x1830948734212608:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 12898us (13227us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129573.966279:0:7087:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8414 00000100:00100000:1.0:1746129573.966339:0:31503:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734213248 00000100:00100000:1.0:1746129573.966346:0:31503:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734213248 00000100:00100000:1.0:1746129573.966373:0:31503:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16405 00000100:00100000:1.0:1746129573.966378:0:31503:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132c24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+28:32397:x1830948734213248:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:1.0:1746129573.966390:0:31503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129573.966407:0:31503:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136b1d600/0x40a459093b06a6d3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21605 expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129573.966434:0:31503:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f445200/0x40a459093b06a560 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21517 expref: 37 pid: 31503 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129573.966444:0:31503:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800946f1a00/0x40a459093b06a655 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f215b8 expref: 8 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129573.966451:0:31503:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800953dc200/0x40a459093b06a5a6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21541 expref: 29 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129573.966457:0:31503:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129573.966459:0:31503:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129573.966463:0:31503:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136b1d600/0x40a459093b06a6d3 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [1048576->1490943] (req 1048576->1490943) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21605 expref: 29 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129573.966494:0:31503:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800953dc200/0x40a459093b06a5a6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21541 expref: 29 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129573.966506:0:31503:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800953dc200/0x40a459093b06a5a6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21541 expref: 29 pid: 4385 timeout: 929 lvb_type: 1 00000100:00100000:1.0:1746129573.966517:0:31503:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7d9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:31503:1830948737551360:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129573.966569:0:31503:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800946f1a00/0x40a459093b06a655 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f215b8 expref: 8 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129573.966576:0:31503:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800946f1a00/0x40a459093b06a655 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f215b8 expref: 8 pid: 7149 timeout: 929 lvb_type: 1 00000100:00100000:1.0:1746129573.966584:0:31503:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7db480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:31503:1830948737551488:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129573.966606:0:31503:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f445200/0x40a459093b06a560 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21517 expref: 37 pid: 31503 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129573.966613:0:31503:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f445200/0x40a459093b06a560 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21517 expref: 37 pid: 31503 timeout: 929 lvb_type: 1 00000100:00100000:1.0:1746129573.966620:0:31503:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7d8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:31503:1830948737551616:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129573.966637:0:31503:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934d2a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746129573.967103:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129573.968413:0:21725:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734213504 00000100:00100000:2.0:1746129573.968423:0:21725:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734213504 00002000:00100000:2.0:1746129573.968465:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f5:0x0] (3960832->3964927) req@ffff880132c25180 x1830948734213504/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:314/0 lens 488/0 e 0 to 0 dl 1746129584 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129573.968475:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880132c25180 with x1830948734213504 ext(3960832->3964927) 00002000:00010000:2.0:1746129573.968481:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880132c25180 00000100:00100000:2.0:1746129573.968503:0:21725:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7897 00000100:00100000:2.0:1746129573.968509:0:21725:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132c25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ada2ffba-8920-4ecb-8068-68caa9806978+38:1962:x1830948734213504:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:2.0:1746129573.968648:0:21725:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132c25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ada2ffba-8920-4ecb-8068-68caa9806978+38:1962:x1830948734213504:12345-192.168.202.4@tcp:3:cat.0 Request processed in 138us (1547us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129573.968654:0:21725:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7897 00002000:00100000:2.0:1746129573.968659:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f5:0x0] (3960832->3964927) req@ffff880132c25180 x1830948734213504/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:314/0 lens 488/4536 e 0 to 0 dl 1746129584 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129573.968665:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880132c25180 with x1830948734213504 ext(3960832->3964927) 00002000:00010000:2.0:1746129573.968668:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880132c25180 00000100:00100000:0.0:1746129573.979447:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129573.979574:0:31503:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7d9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:31503:1830948737551360:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129573.981905:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734213632 00000100:00100000:2.0:1746129573.981917:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734213632 00010000:00010000:2.0:1746129573.981963:0:7087:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800953dc200/0x40a459093b06a5a6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21541 expref: 30 pid: 4385 timeout: 929 lvb_type: 1 00000100:00100000:2.0:1746129573.982009:0:7087:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8415 00000100:00100000:2.0:1746129573.982017:0:7087:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132c26300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+30:1960:x1830948734213632:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129573.982031:0:7087:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129573.982055:0:7087:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800953dc200/0x40a459093b06a5a6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21541 expref: 30 pid: 4385 timeout: 929 lvb_type: 1 00010000:00010000:2.0:1746129573.982067:0:7087:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800953dc200/0x40a459093b06a5a6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21541 expref: 30 pid: 4385 timeout: 929 lvb_type: 1 00010000:00010000:2.0:1746129573.982093:0:7087:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800953dc200/0x40a459093b06a5a6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21541 expref: 30 pid: 4385 timeout: 929 lvb_type: 1 00010000:00010000:2.0:1746129573.982136:0:7087:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129573.982194:0:7087:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132c26300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+29:1960:x1830948734213632:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 178us (2760us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129573.982200:0:7087:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8415 00000100:00100000:2.0:1746129573.984980:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129573.985013:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129573.985124:0:31503:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7db480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:31503:1830948737551488:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129573.985137:0:31503:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7d8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:31503:1830948737551616:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129573.985176:0:31503:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880136b1d600/0x40a459093b06a6d3 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [1048576->1490943] (req 1048576->1490943) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21605 expref: 28 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129573.985194:0:31503:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136b1d600, rc 0) 00000100:00100000:1.0:1746129573.985241:0:31503:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132c24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+28:32397:x1830948734213248:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 18862us (21966us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129573.985251:0:31503:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16405 00000100:00100000:0.0:1746129573.985586:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734213888 00000100:00100000:0.0:1746129573.985593:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734213888 00010000:00010000:0.0:1746129573.985620:0:9823:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f445200/0x40a459093b06a560 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21517 expref: 38 pid: 31503 timeout: 929 lvb_type: 1 00000100:00100000:0.0:1746129573.985644:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734213760 00000100:00100000:0.0:1746129573.985647:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734213760 00010000:00010000:0.0:1746129573.985658:0:9823:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800946f1a00/0x40a459093b06a655 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f215b8 expref: 9 pid: 7149 timeout: 929 lvb_type: 1 00000100:00100000:0.0:1746129573.985796:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8416 00000100:00100000:0.0:1746129573.985803:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094064000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ada2ffba-8920-4ecb-8068-68caa9806978+38:1962:x1830948734213888:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129573.985816:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129573.985840:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f445200/0x40a459093b06a560 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21517 expref: 38 pid: 31503 timeout: 929 lvb_type: 1 00010000:00010000:0.0:1746129573.985850:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f445200/0x40a459093b06a560 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21517 expref: 38 pid: 31503 timeout: 929 lvb_type: 1 00010000:00010000:0.0:1746129573.985871:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f445200/0x40a459093b06a560 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21517 expref: 38 pid: 31503 timeout: 929 lvb_type: 1 00000100:00100000:2.0:1746129573.985904:0:20578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8417 00000100:00100000:2.0:1746129573.985911:0:20578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094064380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:068dab75-d300-4ead-a742-d14572ad1e50+9:1962:x1830948734213760:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129573.985917:0:20578:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129573.985927:0:20578:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800946f1a00/0x40a459093b06a655 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f215b8 expref: 9 pid: 7149 timeout: 929 lvb_type: 1 00010000:00010000:2.0:1746129573.985935:0:20578:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800946f1a00/0x40a459093b06a655 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f215b8 expref: 9 pid: 7149 timeout: 929 lvb_type: 1 00010000:00010000:2.0:1746129573.985945:0:20578:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800946f1a00/0x40a459093b06a655 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f215b8 expref: 9 pid: 7149 timeout: 929 lvb_type: 1 00010000:00010000:2.0:1746129573.985954:0:20578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129573.985956:0:20578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129573.985963:0:20578:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136b1d600/0x40a459093b06a6d3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1490943) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21605 expref: 27 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129573.985970:0:20578:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136b1d600/0x40a459093b06a6d3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1490943) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21605 expref: 27 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129573.986002:0:20578:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880136b1d600/0x40a459093b06a6d3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1490943) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21605 expref: 27 pid: 31503 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129573.986013:0:20578:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094064700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:20578:1830948737551744:192.168.202.4@tcp:105: 00010000:00010000:0.0:1746129573.986156:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129573.987129:0:20578:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1a12240 going to sleep for 11 seconds 00000100:00100000:0.0:1746129573.987696:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094064000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ada2ffba-8920-4ecb-8068-68caa9806978+37:1962:x1830948734213888:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 1888us (2724us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129573.987706:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8416 00000100:00100000:3.0:1746129573.989432:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c07a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+35:1963:x1830948734213120:12345-192.168.202.4@tcp:3:cat.0 Request processed in 24533us (26428us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129573.989445:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7896 00002000:00100000:3.0:1746129573.989458:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f5:0x0] (2097152->3145727) req@ffff88009c07a300 x1830948734213120/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:314/0 lens 488/440 e 0 to 0 dl 1746129584 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129573.989468:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c07a300 with x1830948734213120 ext(2097152->3145727) 00002000:00010000:3.0:1746129573.989474:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c07a300 00000100:00100000:2.0:1746129573.990428:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129573.990916:0:31522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c079180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:1961:x1830948734212864:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 27337us (28035us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129573.990925:0:31522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7895 00002000:00100000:3.0:1746129573.990934:0:31522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->4194303) req@ffff88009c079180 x1830948734212864/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:314/0 lens 488/440 e 0 to 0 dl 1746129584 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129573.990942:0:31522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c079180 with x1830948734212864 ext(3145728->4194303) 00002000:00010000:3.0:1746129573.990947:0:31522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c079180 00000100:00100000:1.0:1746129573.991486:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734214144 00000100:00100000:1.0:1746129573.991495:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734214144 00000100:00100000:1.0:1746129573.991532:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4785 00000100:00100000:1.0:1746129573.991538:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e389880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ada2ffba-8920-4ecb-8068-68caa9806978+290:32390:x1830948734214144:12345-192.168.202.4@tcp:35:multiop.0 00000100:00100000:1.0:1746129573.991731:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e389880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ada2ffba-8920-4ecb-8068-68caa9806978+291:32390:x1830948734214144:12345-192.168.202.4@tcp:35:multiop.0 Request processed in 193us (1307us total) trans 8589945361 rc 0/0 00000100:00100000:1.0:1746129573.991736:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4785 00000100:00100000:2.0:1746129573.994618:0:20578:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094064700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:20578:1830948737551744:192.168.202.4@tcp:105: 00010000:00010000:2.0:1746129573.994645:0:20578:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129573.994706:0:20578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094064380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:068dab75-d300-4ead-a742-d14572ad1e50+8:1962:x1830948734213760:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 8794us (9690us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129573.994716:0:20578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8417 00000100:00100000:0.0:1746129573.998531:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129573.998653:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129573.998867:0:31522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734214400 00000100:00100000:3.0:1746129573.998877:0:31522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734214400 00002000:00100000:3.0:1746129573.998927:0:31522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f4:0x0] (1486848->1490943) req@ffff880132c25c00 x1830948734214400/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:314/0 lens 488/0 e 0 to 0 dl 1746129584 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129573.998937:0:31522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880132c25c00 with x1830948734214400 ext(1486848->1490943) 00002000:00010000:3.0:1746129573.998943:0:31522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880132c25c00 00000100:00100000:1.0:1746129573.999774:0:31503:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734214528 00000100:00100000:1.0:1746129573.999781:0:31503:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734214528 00000100:00100000:3.0:1746129573.999955:0:31522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7898 00000100:00100000:3.0:1746129573.999964:0:31522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132c25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+29:1963:x1830948734214400:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:3.0:1746129574.000146:0:31522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132c25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+29:1963:x1830948734214400:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 184us (1628us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129574.000153:0:31522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7898 00002000:00100000:3.0:1746129574.000159:0:31522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f4:0x0] (1486848->1490943) req@ffff880132c25c00 x1830948734214400/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:314/0 lens 488/4536 e 0 to 0 dl 1746129584 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129574.000167:0:31522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880132c25c00 with x1830948734214400 ext(1486848->1490943) 00002000:00010000:3.0:1746129574.000170:0:31522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880132c25c00 00000100:00100000:1.0:1746129574.000271:0:31503:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16406 00000100:00100000:1.0:1746129574.000278:0:31503:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132c26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+28:32395:x1830948734214528:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129574.000309:0:31503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129574.000330:0:31503:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e0b5c00/0x40a459093b06a6da lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2160c expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129574.000357:0:31503:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a9209e00/0x40a459093b06a67f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [3379200->18446744073709551615] (req 3379200->3964927) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f215db expref: 34 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129574.000534:0:31503:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129574.000536:0:31503:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129574.000540:0:31503:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e0b5c00/0x40a459093b06a6da lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2160c expref: 29 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129574.000574:0:31503:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a9209e00/0x40a459093b06a67f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [3379200->18446744073709551615] (req 3379200->3964927) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f215db expref: 34 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129574.000585:0:31503:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a9209e00/0x40a459093b06a67f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [3379200->18446744073709551615] (req 3379200->3964927) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f215db expref: 34 pid: 31503 timeout: 929 lvb_type: 0 00000100:00100000:1.0:1746129574.000596:0:31503:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7d8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:31503:1830948737551872:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129574.000652:0:31503:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934d2a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746129574.001370:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129574.001485:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734214656 00000100:00100000:3.0:1746129574.001490:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734214656 00000100:00100000:3.0:1746129574.001530:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16407 00000100:00100000:3.0:1746129574.001536:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132c25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ada2ffba-8920-4ecb-8068-68caa9806978+35:32393:x1830948734214656:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129574.001550:0:4385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129574.001558:0:4385:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f725800/0x40a459093b06a6e1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21613 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129574.001577:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129574.001581:0:4385:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f725800/0x40a459093b06a6e1 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21613 expref: 36 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129574.001590:0:4385:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f725800/0x40a459093b06a6e1 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21613 expref: 36 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129574.001599:0:4385:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f725800, rc 0) 00000100:00100000:3.0:1746129574.001637:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132c25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ada2ffba-8920-4ecb-8068-68caa9806978+36:32393:x1830948734214656:12345-192.168.202.4@tcp:101:cat.0 Request processed in 101us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129574.001643:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16407 00000100:00100000:0.0:1746129574.003831:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129574.003882:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129574.004492:0:31503:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7d8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:31503:1830948737551872:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129574.004522:0:31503:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012e0b5c00/0x40a459093b06a6da lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2160c expref: 29 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129574.004543:0:31503:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e0b5c00, rc 0) 00000100:00100000:1.0:1746129574.004595:0:31503:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132c26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+29:32395:x1830948734214528:12345-192.168.202.4@tcp:101:cat.0 Request processed in 4317us (5940us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129574.004603:0:31503:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16406 00000100:00100000:3.0:1746129574.004695:0:14551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734215040 00000100:00100000:3.0:1746129574.004702:0:14551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734215040 00000100:00100000:3.0:1746129574.004745:0:14551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4786 00000100:00100000:3.0:1746129574.004751:0:14551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132c27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+7:32397:x1830948734215040:12345-192.168.202.4@tcp:35:multiop.0 00000100:00100000:3.0:1746129574.004938:0:14551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132c27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+8:32397:x1830948734215040:12345-192.168.202.4@tcp:35:multiop.0 Request processed in 187us (1117us total) trans 8589945362 rc 0/0 00000100:00100000:3.0:1746129574.004943:0:14551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4786 00000100:00100000:2.0:1746129574.005164:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734214912 00000100:00100000:2.0:1746129574.005168:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734214912 00002000:00100000:2.0:1746129574.005192:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f5:0x0] (3379200->3964927) req@ffff880136016680 x1830948734214912/t0(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:315/0 lens 488/0 e 0 to 0 dl 1746129585 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129574.005201:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136016680 with x1830948734214912 ext(3379200->3964927) 00010000:00010000:2.0:1746129574.005207:0:25745:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a9209e00/0x40a459093b06a67f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [3379200->18446744073709551615] (req 3379200->3964927) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f215db expref: 36 pid: 31503 timeout: 929 lvb_type: 0 00010000:00010000:2.0:1746129574.005218:0:25745:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a9209e00/0x40a459093b06a67f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [3379200->18446744073709551615] (req 3379200->3964927) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f215db expref: 36 pid: 31503 timeout: 929 lvb_type: 0 00002000:00010000:2.0:1746129574.005224:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880136016680 00000100:00100000:2.0:1746129574.005237:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2450 00000100:00100000:2.0:1746129574.005242:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136016680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+36:1960:x1830948734214912:12345-192.168.202.4@tcp:4:cat.0 00000100:00080000:1.0:1746129574.006145:0:7097:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746129574.016233:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136016680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+38:1960:x1830948734214912:12345-192.168.202.4@tcp:4:cat.0 Request processed in 10979us (12339us total) trans 17179874145 rc 0/0 00000100:00100000:2.0:1746129574.016246:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2450 00002000:00100000:2.0:1746129574.016257:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f5:0x0] (3379200->3964927) req@ffff880136016680 x1830948734214912/t17179874145(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:315/0 lens 488/448 e 0 to 0 dl 1746129585 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129574.016267:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136016680 with x1830948734214912 ext(3379200->3964927) 00010000:00010000:2.0:1746129574.016279:0:25745:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a9209e00/0x40a459093b06a67f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [3379200->18446744073709551615] (req 3379200->3964927) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f215db expref: 38 pid: 31503 timeout: 929 lvb_type: 0 00010000:00010000:2.0:1746129574.016322:0:25745:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a9209e00/0x40a459093b06a67f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [3379200->18446744073709551615] (req 3379200->3964927) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f215db expref: 38 pid: 31503 timeout: 929 lvb_type: 0 00002000:00010000:2.0:1746129574.016329:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880136016680 00000100:00100000:0.0:1746129574.018981:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129574.019871:0:20578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734215168 00000100:00100000:2.0:1746129574.019882:0:20578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734215168 00010000:00010000:2.0:1746129574.019923:0:20578:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a9209e00/0x40a459093b06a67f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [3379200->18446744073709551615] (req 3379200->3964927) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f215db expref: 38 pid: 31503 timeout: 929 lvb_type: 0 00000100:00100000:2.0:1746129574.020017:0:20578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8418 00000100:00100000:2.0:1746129574.020024:0:20578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136016300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ada2ffba-8920-4ecb-8068-68caa9806978+38:1961:x1830948734215168:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129574.020039:0:20578:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129574.020062:0:20578:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a9209e00/0x40a459093b06a67f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 7 type: EXT [3379200->18446744073709551615] (req 3379200->3964927) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f215db expref: 38 pid: 31503 timeout: 929 lvb_type: 0 00010000:00010000:2.0:1746129574.020079:0:20578:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a9209e00/0x40a459093b06a67f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 7 type: EXT [3379200->18446744073709551615] (req 3379200->3964927) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f215db expref: 38 pid: 31503 timeout: 929 lvb_type: 0 00010000:00010000:2.0:1746129574.020103:0:20578:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a9209e00/0x40a459093b06a67f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 7 type: EXT [3379200->18446744073709551615] (req 3379200->3964927) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f215db expref: 38 pid: 31503 timeout: 929 lvb_type: 0 00010000:00010000:2.0:1746129574.020336:0:20578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129574.020339:0:20578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129574.020348:0:20578:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e0b5c00/0x40a459093b06a6da lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2160c expref: 28 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129574.020358:0:20578:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e0b5c00/0x40a459093b06a6da lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2160c expref: 28 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129574.020367:0:20578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129574.020368:0:20578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129574.020371:0:20578:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f725800/0x40a459093b06a6e1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21613 expref: 37 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129574.020376:0:20578:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f725800/0x40a459093b06a6e1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21613 expref: 37 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129574.020408:0:20578:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f725800/0x40a459093b06a6e1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21613 expref: 37 pid: 4385 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129574.020420:0:20578:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e38b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:20578:1830948737552000:192.168.202.4@tcp:105: 00010000:00010000:2.0:1746129574.021428:0:20578:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012e0b5c00/0x40a459093b06a6da lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2160c expref: 28 pid: 31503 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129574.021439:0:20578:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e389c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:20578:1830948737552128:192.168.202.4@tcp:105: 00000100:00100000:2.0:1746129574.022001:0:20578:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1a12240 going to sleep for 11 seconds 00000100:00100000:0.0:1746129574.025726:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129574.025869:0:20578:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e38b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:20578:1830948737552000:192.168.202.4@tcp:105: 00000100:00100000:2.0:1746129574.025881:0:20578:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e389c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:20578:1830948737552128:192.168.202.4@tcp:105: 00010000:00010000:2.0:1746129574.025904:0:20578:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129574.025958:0:20578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136016300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ada2ffba-8920-4ecb-8068-68caa9806978+37:1961:x1830948734215168:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 5933us (6987us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129574.025969:0:20578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8418 00000100:00100000:3.0:1746129574.026092:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734215424 00000100:00100000:3.0:1746129574.026099:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734215424 00002000:00100000:3.0:1746129574.026151:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f5:0x0] (3145728->4194303) req@ffff880136014700 x1830948734215424/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:315/0 lens 488/0 e 0 to 0 dl 1746129585 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129574.026160:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136014700 with x1830948734215424 ext(3145728->4194303) 00002000:00010000:3.0:1746129574.026164:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136014700 00000100:00100000:3.0:1746129574.026186:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7899 00000100:00100000:3.0:1746129574.026192:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136014700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+29:1961:x1830948734215424:12345-192.168.202.4@tcp:3:multiop.0 00000100:00080000:1.0:1746129574.026195:0:7097:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746129574.029226:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129574.034083:0:31522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734215680 00000100:00100000:2.0:1746129574.034098:0:31522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734215680 00002000:00100000:2.0:1746129574.034155:0:31522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f5:0x0] (3145728->4194303) req@ffff88009507fb80 x1830948734215680/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:315/0 lens 488/0 e 0 to 0 dl 1746129585 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129574.034166:0:31522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009507fb80 with x1830948734215680 ext(3145728->4194303) 00002000:00010000:2.0:1746129574.034172:0:31522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009507fb80 00000100:00100000:2.0:1746129574.034214:0:31522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7900 00000100:00100000:2.0:1746129574.034222:0:31522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009507fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ada2ffba-8920-4ecb-8068-68caa9806978+37:1962:x1830948734215680:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:3.0:1746129574.042455:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136014700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+29:1961:x1830948734215424:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 16250us (16725us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129574.042467:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7899 00002000:00100000:3.0:1746129574.042481:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f5:0x0] (3145728->4194303) req@ffff880136014700 x1830948734215424/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:315/0 lens 488/440 e 0 to 0 dl 1746129585 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129574.042491:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136014700 with x1830948734215424 ext(3145728->4194303) 00002000:00010000:3.0:1746129574.042497:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136014700 00000100:00100000:2.0:1746129574.045104:0:31522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009507fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ada2ffba-8920-4ecb-8068-68caa9806978+37:1962:x1830948734215680:12345-192.168.202.4@tcp:3:cat.0 Request processed in 10867us (15871us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129574.045117:0:31522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7900 00002000:00100000:2.0:1746129574.045129:0:31522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f5:0x0] (3145728->4194303) req@ffff88009507fb80 x1830948734215680/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:315/0 lens 488/440 e 0 to 0 dl 1746129585 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129574.045145:0:31522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009507fb80 with x1830948734215680 ext(3145728->4194303) 00002000:00010000:2.0:1746129574.045151:0:31522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009507fb80 00000100:00100000:0.0:1746129574.049196:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129574.049400:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129574.049445:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129574.049453:0:31503:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734215808 00000100:00100000:0.0:1746129574.049461:0:8410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734216064 00000100:00100000:1.0:1746129574.049462:0:31503:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734215808 00000100:00100000:0.0:1746129574.049464:0:8410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734216064 00000100:00100000:1.0:1746129574.049527:0:31503:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16408 00000100:00100000:2.0:1746129574.049534:0:31522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734216192 00000100:00100000:1.0:1746129574.049535:0:31503:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009507e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ada2ffba-8920-4ecb-8068-68caa9806978+38:1960:x1830948734215808:12345-192.168.202.4@tcp:101:cat.0 00000100:00100000:2.0:1746129574.049537:0:31522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734216192 00010000:00010000:1.0:1746129574.049555:0:31503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00100000:2.0:1746129574.049566:0:31522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3ef:0x0] (4194304->5148671) req@ffff88009507ce00 x1830948734216192/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:315/0 lens 488/0 e 0 to 0 dl 1746129585 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:1.0:1746129574.049573:0:31503:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f444200/0x40a459093b06a6e8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2161a expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00002000:00100000:2.0:1746129574.049575:0:31522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009507ce00 with x1830948734216192 ext(4194304->5148671) 00002000:00010000:2.0:1746129574.049580:0:31522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009507ce00 00000100:00100000:2.0:1746129574.049591:0:31522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7901 00000100:00100000:2.0:1746129574.049595:0:31522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009507ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:1962:x1830948734216192:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:1.0:1746129574.049631:0:31503:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7d8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:31503:1830948737552256:192.168.202.4@tcp:106: 00000100:00100000:1.0:1746129574.049707:0:31503:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934d2a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746129574.050624:0:8410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16409 00000100:00100000:0.0:1746129574.050633:0:8410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009507d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ada2ffba-8920-4ecb-8068-68caa9806978+39:1960:x1830948734216064:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129574.050642:0:8410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129574.050651:0:8410:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0640c00/0x40a459093b06a6ef lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21621 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129574.050680:0:8410:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009507f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8410:1830948737552384:192.168.202.4@tcp:106: 00000100:00100000:0.0:1746129574.050720:0:8410:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a00180 going to sleep for 11 seconds 00002000:00010000:0.0:1746129574.054482:0:8410:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb mtime: 1746129571 -> 1746129574 00002000:00010000:0.0:1746129574.054493:0:8410:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb atime: 1746129571 -> 1746129574 00002000:00010000:0.0:1746129574.054495:0:8410:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb ctime: 1746129572 -> 1746129574 00000100:00100000:0.0:1746129574.054526:0:8410:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009507f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8410:1830948737552384:192.168.202.4@tcp:106: 00010000:00010000:0.0:1746129574.054562:0:8410:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0640c00/0x40a459093b06a6ef lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21621 expref: 40 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129574.054585:0:8410:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0640c00/0x40a459093b06a6ef lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21621 expref: 40 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129574.054611:0:8410:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0640c00, rc 0) 00000100:00100000:0.0:1746129574.054659:0:8410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009507d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ada2ffba-8920-4ecb-8068-68caa9806978+39:1960:x1830948734216064:12345-192.168.202.4@tcp:101:cat.0 Request processed in 4027us (5211us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129574.054668:0:8410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16409 00002000:00010000:2.0:1746129574.054972:0:31503:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb mtime: 1746129573 -> 1746129574 00002000:00010000:2.0:1746129574.054976:0:31503:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb atime: 1746129571 -> 1746129574 00002000:00010000:2.0:1746129574.054978:0:31503:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb ctime: 1746129572 -> 1746129574 00000100:00100000:2.0:1746129574.054988:0:31503:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7d8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:31503:1830948737552256:192.168.202.4@tcp:106: 00010000:00010000:2.0:1746129574.055006:0:31503:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f444200/0x40a459093b06a6e8 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2161a expref: 38 pid: 31503 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129574.055016:0:31503:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f444200/0x40a459093b06a6e8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2161a expref: 38 pid: 31503 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129574.055041:0:31503:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f444200, rc 0) 00000100:00100000:2.0:1746129574.055065:0:31503:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009507e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ada2ffba-8920-4ecb-8068-68caa9806978+37:1960:x1830948734215808:12345-192.168.202.4@tcp:101:cat.0 Request processed in 5531us (5665us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129574.055071:0:31503:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16408 00000100:00100000:0.0:1746129574.060899:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129574.060954:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734216448 00000100:00100000:3.0:1746129574.060964:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734216448 00002000:00100000:3.0:1746129574.061011:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ef:0x0] (4194304->5148671) req@ffff88009507f100 x1830948734216448/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:315/0 lens 488/0 e 0 to 0 dl 1746129585 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129574.061022:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009507f100 with x1830948734216448 ext(4194304->5148671) 00002000:00010000:3.0:1746129574.061028:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009507f100 00000100:00100000:3.0:1746129574.061051:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7902 00000100:00100000:3.0:1746129574.061059:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009507f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+38:1960:x1830948734216448:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:2.0:1746129574.061851:0:31522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009507ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:1962:x1830948734216192:12345-192.168.202.4@tcp:3:cat.0 Request processed in 12251us (12663us total) trans 0 rc 954368/954368 00000100:00100000:2.0:1746129574.061859:0:31522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7901 00002000:00100000:2.0:1746129574.061867:0:31522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3ef:0x0] (4194304->5148671) req@ffff88009507ce00 x1830948734216192/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:315/0 lens 488/440 e 0 to 0 dl 1746129585 ref 1 fl Complete:/200/0 rc 954368/954368 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129574.061875:0:31522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009507ce00 with x1830948734216192 ext(4194304->5148671) 00002000:00010000:2.0:1746129574.061879:0:31522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009507ce00 00000100:00100000:0.0:1746129574.069103:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129574.069154:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129574.069229:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129574.069679:0:8410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734216576 00000100:00100000:1.0:1746129574.069689:0:8410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734216576 00000100:00100000:1.0:1746129574.069733:0:8410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734216704 00000100:00100000:1.0:1746129574.069736:0:8410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734216704 00000100:00100000:1.0:1746129574.069746:0:8410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734216832 00000100:00100000:1.0:1746129574.069748:0:8410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734216832 00000100:00100000:1.0:1746129574.069759:0:8410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16410 00000100:00100000:1.0:1746129574.069773:0:8410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009507f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:068dab75-d300-4ead-a742-d14572ad1e50+10:1963:x1830948734216576:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:1.0:1746129574.069794:0:8410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746129574.069799:0:31503:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16411 00000100:00100000:2.0:1746129574.069808:0:31503:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009507ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:068dab75-d300-4ead-a742-d14572ad1e50+10:1962:x1830948734216704:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:1.0:1746129574.069815:0:8410:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800953dc200/0x40a459093b06a6f6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21628 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129574.069817:0:31503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129574.069826:0:31503:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a05ba200/0x40a459093b06a6fd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2162f expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129574.069869:0:31503:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e389c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:31503:1830948737552512:192.168.202.4@tcp:106: 00000100:00100000:1.0:1746129574.069869:0:8410:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7db480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8410:1830948737552640:192.168.202.4@tcp:106: 00000100:00100000:3.0:1746129574.069941:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16412 00000100:00100000:3.0:1746129574.069949:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009507dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:068dab75-d300-4ead-a742-d14572ad1e50+12:1963:x1830948734216832:12345-192.168.202.4@tcp:101:lfs.0 00000100:00100000:2.0:1746129574.069953:0:31503:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1a12240 going to sleep for 11 seconds 00010000:00010000:3.0:1746129574.069956:0:7149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129574.069964:0:7149:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f724c00/0x40a459093b06a704 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21636 expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129574.069974:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129574.069976:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129574.069984:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f724c00/0x40a459093b06a704 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21636 expref: 13 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129574.069999:0:7149:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f724c00/0x40a459093b06a704 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21636 expref: 13 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129574.070009:0:7149:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f724c00, rc 0) 00000100:00100000:3.0:1746129574.070035:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009507dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:068dab75-d300-4ead-a742-d14572ad1e50+13:1963:x1830948734216832:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 87us (806us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129574.070041:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16412 00000100:00100000:1.0:1746129574.070165:0:8410:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934d26c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129574.072522:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129574.072619:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734217088 00000100:00100000:1.0:1746129574.072629:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734217088 00000100:00100000:1.0:1746129574.073021:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4787 00000100:00100000:1.0:1746129574.073030:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009507df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+8:32395:x1830948734217088:12345-192.168.202.4@tcp:35:cat.0 00000100:00100000:1.0:1746129574.073259:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009507df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+9:32395:x1830948734217088:12345-192.168.202.4@tcp:35:cat.0 Request processed in 229us (743us total) trans 8589945363 rc 0/0 00000100:00100000:1.0:1746129574.073266:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4787 00000100:00100000:2.0:1746129574.074367:0:31503:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e389c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:31503:1830948737552512:192.168.202.4@tcp:106: 00010000:00010000:2.0:1746129574.074407:0:31503:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a05ba200/0x40a459093b06a6fd lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2162f expref: 12 pid: 31503 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129574.074421:0:31503:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a05ba200/0x40a459093b06a6fd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2162f expref: 12 pid: 31503 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129574.074445:0:31503:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a05ba200, rc 0) 00000100:00100000:2.0:1746129574.074476:0:31503:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009507ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:068dab75-d300-4ead-a742-d14572ad1e50+11:1962:x1830948734216704:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 4669us (5320us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129574.074486:0:31503:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16411 00000100:00100000:1.0:1746129574.074522:0:8410:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7db480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8410:1830948737552640:192.168.202.4@tcp:106: 00010000:00010000:1.0:1746129574.074541:0:8410:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800953dc200/0x40a459093b06a6f6 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21628 expref: 10 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129574.074551:0:8410:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800953dc200/0x40a459093b06a6f6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21628 expref: 10 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129574.074558:0:8410:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800953dc200, rc 0) 00000100:00100000:1.0:1746129574.074578:0:8410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009507f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:068dab75-d300-4ead-a742-d14572ad1e50+9:1963:x1830948734216576:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 4812us (5487us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129574.074584:0:8410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16410 00000100:00100000:3.0:1746129574.077856:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009507f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+38:1960:x1830948734216448:12345-192.168.202.4@tcp:3:cat.0 Request processed in 16785us (16956us total) trans 0 rc 954368/954368 00000100:00100000:3.0:1746129574.077868:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7902 00002000:00100000:3.0:1746129574.077881:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ef:0x0] (4194304->5148671) req@ffff88009507f100 x1830948734216448/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:315/0 lens 488/440 e 0 to 0 dl 1746129585 ref 1 fl Complete:/200/0 rc 954368/954368 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129574.077890:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009507f100 with x1830948734216448 ext(4194304->5148671) 00002000:00010000:3.0:1746129574.077897:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009507f100 00000100:00100000:0.0:1746129574.078383:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129574.079176:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734217344 00000100:00100000:2.0:1746129574.079185:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734217344 00000100:00100000:2.0:1746129574.079255:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11265 00000100:00100000:2.0:1746129574.079262:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009507ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:068dab75-d300-4ead-a742-d14572ad1e50+11:32402:x1830948734217344:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:2.0:1746129574.079335:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129574.079354:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a05bb000/0x40a459093b06a70b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2163d expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129574.079449:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a05ba000/0x40a459093b06a712 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129574.079464:0:14549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880090078c00/0x40a459093b06a639 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2158e expref: 12 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129574.079470:0:14549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b636a00/0x40a459093b06a69b lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f215d4 expref: 12 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129574.079476:0:14549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a05ba000/0x40a459093b06a712 lrc: 5/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129574.079506:0:14549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012b636a00/0x40a459093b06a69b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f215d4 expref: 12 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129574.079516:0:14549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b636a00/0x40a459093b06a69b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f215d4 expref: 12 pid: 16908 timeout: 929 lvb_type: 0 00000100:00100000:2.0:1746129574.079525:0:14549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e389c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830948737552768:192.168.202.4@tcp:104: 00000100:00080000:1.0:1746129574.079630:0:7097:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1746129574.080513:0:14549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880090078c00/0x40a459093b06a639 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2158e expref: 12 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129574.080523:0:14549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880090078c00/0x40a459093b06a639 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2158e expref: 12 pid: 14547 timeout: 929 lvb_type: 0 00000100:00100000:2.0:1746129574.080532:0:14549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e38b800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830948737552896:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129574.080582:0:14549:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1a12240 going to sleep for 11 seconds 00000100:00100000:0.0:1746129574.082423:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129574.083044:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129574.083277:0:31503:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734217600 00000100:00100000:3.0:1746129574.083279:0:14549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e389c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830948737552768:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129574.083310:0:31503:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734217600 00000100:00100000:2.0:1746129574.083653:0:31503:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734217472 00000100:00100000:2.0:1746129574.083656:0:31503:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734217472 00000100:00100000:2.0:1746129574.083687:0:31503:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16413 00000100:00100000:2.0:1746129574.083695:0:31503:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a07afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ada2ffba-8920-4ecb-8068-68caa9806978+38:1961:x1830948734217600:12345-192.168.202.4@tcp:101:cat.0 00000100:00100000:3.0:1746129574.083714:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16414 00010000:00010000:2.0:1746129574.083716:0:31503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746129574.083722:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a07af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ada2ffba-8920-4ecb-8068-68caa9806978+38:1961:x1830948734217472:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129574.083730:0:4385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129574.083736:0:31503:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a05bbe00/0x40a459093b06a719 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2164b expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129574.083739:0:4385:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f725200/0x40a459093b06a720 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21644 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129574.083789:0:4385:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947be680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:4385:1830948737553024:192.168.202.4@tcp:106: 00000100:00100000:2.0:1746129574.083789:0:31503:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e388380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:31503:1830948737553152:192.168.202.4@tcp:106: 00000100:00100000:2.0:1746129574.085871:0:31503:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1a12b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746129574.085881:0:4385:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5de8900 going to sleep for 11 seconds 00000100:00100000:1.0:1746129574.086329:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129574.086341:0:14549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e38b800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830948737552896:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129574.086368:0:14549:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a05ba000/0x40a459093b06a712 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000100:00100000:1.0:1746129574.086370:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129574.086425:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734217728 00000100:00100000:0.0:1746129574.086433:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734217728 00010000:00010000:0.0:1746129574.086465:0:9823:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b636a00/0x40a459093b06a69b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f215d4 expref: 13 pid: 16908 timeout: 929 lvb_type: 0 00000100:00100000:0.0:1746129574.086493:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734217856 00000100:00100000:0.0:1746129574.086496:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734217856 00010000:00010000:0.0:1746129574.086503:0:9823:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090078c00/0x40a459093b06a639 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2158e expref: 14 pid: 14547 timeout: 929 lvb_type: 0 00000100:00100000:0.0:1746129574.086518:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8419 00000100:00100000:0.0:1746129574.086524:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7db480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:068dab75-d300-4ead-a742-d14572ad1e50+14:1961:x1830948734217728:12345-192.168.202.4@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746129574.086528:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8420 00000100:00100000:3.0:1746129574.086534:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6fd3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:068dab75-d300-4ead-a742-d14572ad1e50+14:1963:x1830948734217856:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129574.086536:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129574.086541:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012b636a00/0x40a459093b06a69b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f215d4 expref: 14 pid: 16908 timeout: 929 lvb_type: 0 00010000:00010000:3.0:1746129574.086543:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129574.086548:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880090078c00/0x40a459093b06a639 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2158e expref: 14 pid: 14547 timeout: 929 lvb_type: 0 00010000:00010000:0.0:1746129574.086549:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012b636a00/0x40a459093b06a69b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f215d4 expref: 14 pid: 16908 timeout: 929 lvb_type: 0 00010000:00010000:3.0:1746129574.086559:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880090078c00/0x40a459093b06a639 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2158e expref: 14 pid: 14547 timeout: 929 lvb_type: 0 00010000:00010000:0.0:1746129574.086619:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b636a00/0x40a459093b06a69b lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f215d4 expref: 14 pid: 16908 timeout: 929 lvb_type: 0 00010000:00010000:3.0:1746129574.086624:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090078c00/0x40a459093b06a639 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2158e expref: 14 pid: 14547 timeout: 929 lvb_type: 0 00010000:00010000:0.0:1746129574.086635:0:9823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:0.0:1746129574.086640:0:9823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a05ba000/0x40a459093b06a712 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129574.086648:0:9823:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a05ba000/0x40a459093b06a712 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129574.086654:0:9823:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a05ba000/0x40a459093b06a712 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129574.086667:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129574.086688:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7db480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:068dab75-d300-4ead-a742-d14572ad1e50+12:1961:x1830948734217728:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 164us (363us total) trans 0 rc 0/0 00010000:00010000:3.0:1746129574.086689:0:7085:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:3.0:1746129574.086692:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129574.086694:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8419 00000100:00100000:3.0:1746129574.086711:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6fd3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:068dab75-d300-4ead-a742-d14572ad1e50+11:1963:x1830948734217856:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 178us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129574.086717:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8420 00010000:00010000:2.0:1746129574.086837:0:14549:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a05ba000/0x40a459093b06a712 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129574.086846:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a05ba000/0x40a459093b06a712 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00200000:2.0:1746129574.086866:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:2.0:1746129574.087003:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a05bb000/0x40a459093b06a70b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2163d expref: 12 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129574.087033:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a05ba000/0x40a459093b06a712 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2163d expref: 11 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129574.087038:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:2.0:1746129574.087041:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746129574.087043:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a05ba000, rc 0) 00000100:00100000:2.0:1746129574.087383:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009507ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:068dab75-d300-4ead-a742-d14572ad1e50+11:32402:x1830948734217344:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 8120us (9000us total) trans 8589945364 rc 0/0 00000100:00100000:2.0:1746129574.087389:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11265 00000100:00100000:3.0:1746129574.089785:0:4385:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947be680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:4385:1830948737553024:192.168.202.4@tcp:106: 00010000:00010000:3.0:1746129574.089822:0:4385:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f725200/0x40a459093b06a720 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21644 expref: 40 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129574.089838:0:4385:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f725200/0x40a459093b06a720 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21644 expref: 40 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129574.089850:0:4385:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f725200, rc 0) 00000100:00100000:3.0:1746129574.089900:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a07af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ada2ffba-8920-4ecb-8068-68caa9806978+39:1961:x1830948734217472:12345-192.168.202.4@tcp:101:cat.0 Request processed in 6178us (6854us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129574.089909:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16414 00000100:00100000:2.0:1746129574.090621:0:31503:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e388380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:31503:1830948737553152:192.168.202.4@tcp:106: 00010000:00010000:2.0:1746129574.090640:0:31503:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a05bbe00/0x40a459093b06a719 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2164b expref: 38 pid: 31503 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129574.090649:0:31503:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a05bbe00/0x40a459093b06a719 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2164b expref: 38 pid: 31503 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129574.090656:0:31503:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a05bbe00, rc 0) 00000100:00100000:2.0:1746129574.090683:0:31503:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a07afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ada2ffba-8920-4ecb-8068-68caa9806978+37:1961:x1830948734217600:12345-192.168.202.4@tcp:101:cat.0 Request processed in 6989us (8269us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129574.090689:0:31503:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16413 00000100:00100000:0.0:1746129574.096019:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129574.096045:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129574.096073:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129574.096604:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734218112 00000100:00100000:3.0:1746129574.096614:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734218112 00000100:00100000:3.0:1746129574.096662:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734217984 00000100:00100000:3.0:1746129574.096664:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734217984 00000100:00100000:3.0:1746129574.096686:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16415 00000100:00100000:3.0:1746129574.096694:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cda5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ada2ffba-8920-4ecb-8068-68caa9806978+38:1960:x1830948734218112:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129574.096718:0:4385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129574.096735:0:4385:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f725e00/0x40a459093b06a72e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21659 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129574.096762:0:8410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16416 00000100:00100000:1.0:1746129574.096770:0:8410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cda5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ada2ffba-8920-4ecb-8068-68caa9806978+39:1960:x1830948734217984:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129574.096777:0:8410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746129574.096785:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734218240 00010000:00010000:1.0:1746129574.096785:0:8410:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fd4fc00/0x40a459093b06a735 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21652 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129574.096789:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734218240 00000100:00100000:2.0:1746129574.096817:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11266 00000100:00100000:2.0:1746129574.096822:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cda7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:068dab75-d300-4ead-a742-d14572ad1e50+11:32402:x1830948734218240:12345-192.168.202.4@tcp:101:lfs.0 00000100:00100000:1.0:1746129574.096828:0:8410:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7d9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8410:1830948737553280:192.168.202.4@tcp:106: 00010000:00010000:2.0:1746129574.096834:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129574.096847:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f444600/0x40a459093b06a73c lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21660 expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129574.096902:0:8410:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4123d80 going to sleep for 11 seconds 00010000:00010000:2.0:1746129574.096921:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f445200/0x40a459093b06a743 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129574.096933:0:14549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a05ba000/0x40a459093b06a712 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2163d expref: 12 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129574.096940:0:14549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f445200/0x40a459093b06a743 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129574.096961:0:14549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a05ba000/0x40a459093b06a712 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2163d expref: 12 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129574.096971:0:14549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a05ba000/0x40a459093b06a712 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2163d expref: 12 pid: 14549 timeout: 929 lvb_type: 0 00000100:00100000:2.0:1746129574.096979:0:14549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e388380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830948737553408:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129574.097083:0:14549:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1a12b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746129574.097251:0:4385:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947be680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:4385:1830948737553536:192.168.202.4@tcp:106: 00000100:00100000:3.0:1746129574.097270:0:4385:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a6ce8240 going to sleep for 11 seconds 00000100:00100000:2.0:1746129574.099256:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129574.099279:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734218368 00000100:00100000:2.0:1746129574.099312:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734218368 00010000:00010000:2.0:1746129574.099343:0:7087:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a05ba000/0x40a459093b06a712 lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2163d expref: 13 pid: 14549 timeout: 929 lvb_type: 0 00000100:00100000:2.0:1746129574.099366:0:7087:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8421 00000100:00100000:2.0:1746129574.099372:0:7087:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e38bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:068dab75-d300-4ead-a742-d14572ad1e50+13:1963:x1830948734218368:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129574.099383:0:7087:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129574.099388:0:7087:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a05ba000/0x40a459093b06a712 lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2163d expref: 13 pid: 14549 timeout: 929 lvb_type: 0 00010000:00010000:2.0:1746129574.099399:0:7087:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a05ba000/0x40a459093b06a712 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2163d expref: 13 pid: 14549 timeout: 929 lvb_type: 0 00010000:00010000:2.0:1746129574.099420:0:7087:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:2.0:1746129574.099424:0:7087:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f445200/0x40a459093b06a743 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129574.099431:0:7087:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f445200/0x40a459093b06a743 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50290000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129574.099437:0:7087:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f445200/0x40a459093b06a743 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50290000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129574.099450:0:7087:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129574.099489:0:7087:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e38bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:068dab75-d300-4ead-a742-d14572ad1e50+13:1963:x1830948734218368:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 116us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129574.099494:0:7087:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8421 00000100:00100000:1.0:1746129574.099643:0:8410:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7d9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8410:1830948737553280:192.168.202.4@tcp:106: 00010000:00010000:1.0:1746129574.099672:0:8410:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fd4fc00/0x40a459093b06a735 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21652 expref: 40 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129574.099683:0:8410:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fd4fc00/0x40a459093b06a735 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21652 expref: 40 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129574.099697:0:8410:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fd4fc00, rc 0) 00000100:00100000:1.0:1746129574.099721:0:8410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cda5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ada2ffba-8920-4ecb-8068-68caa9806978+39:1960:x1830948734217984:12345-192.168.202.4@tcp:101:cat.0 Request processed in 2951us (3674us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129574.099726:0:8410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16416 00010000:00010000:3.0:1746129574.099986:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a05ba000/0x40a459093b06a712 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2163d expref: 12 pid: 14549 timeout: 929 lvb_type: 0 00000100:00100000:3.0:1746129574.099998:0:14549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e388380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830948737553408:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129574.100010:0:14549:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008f445200/0x40a459093b06a743 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129574.100017:0:14549:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008f445200/0x40a459093b06a743 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129574.100021:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f445200/0x40a459093b06a743 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00200000:3.0:1746129574.100063:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00000004:00200000:3.0:1746129574.100067:0:14549:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746129574.100082:0:14549:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008f445200/0x40a459093b06a743 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129574.100108:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f444600/0x40a459093b06a73c lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21660 expref: 12 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129574.100118:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f445200/0x40a459093b06a743 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21660 expref: 11 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129574.100128:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:3.0:1746129574.100131:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746129574.100132:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f445200, rc 0) 00000100:00100000:3.0:1746129574.100154:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cda7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:068dab75-d300-4ead-a742-d14572ad1e50+11:32402:x1830948734218240:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 3332us (4080us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129574.100161:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11266 00000100:00100000:3.0:1746129574.100197:0:4385:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947be680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:4385:1830948737553536:192.168.202.4@tcp:106: 00010000:00010000:3.0:1746129574.100213:0:4385:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f725e00/0x40a459093b06a72e lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21659 expref: 38 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129574.100221:0:4385:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f725e00/0x40a459093b06a72e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21659 expref: 38 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129574.100228:0:4385:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f725e00, rc 0) 00000100:00100000:3.0:1746129574.100246:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cda5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ada2ffba-8920-4ecb-8068-68caa9806978+37:1960:x1830948734218112:12345-192.168.202.4@tcp:101:cat.0 Request processed in 3554us (4240us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129574.100252:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16415 00000100:00100000:0.0:1746129574.104349:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129574.104401:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129574.104490:0:8410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734218624 00000100:00100000:1.0:1746129574.104502:0:8410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734218624 00000100:00100000:1.0:1746129574.104550:0:8410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734218496 00000100:00100000:1.0:1746129574.104553:0:8410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734218496 00000100:00100000:1.0:1746129574.104570:0:8410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16417 00000100:00100000:1.0:1746129574.104577:0:8410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cda6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:068dab75-d300-4ead-a742-d14572ad1e50+10:1960:x1830948734218624:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:1.0:1746129574.104597:0:8410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129574.104617:0:8410:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c663200/0x40a459093b06a74a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2166e expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129574.104682:0:8410:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7d9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8410:1830948737553664:192.168.202.4@tcp:106: 00000100:00100000:1.0:1746129574.104770:0:8410:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4123d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746129574.104825:0:11014:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16418 00000100:00100000:0.0:1746129574.104833:0:11014:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cda7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:068dab75-d300-4ead-a742-d14572ad1e50+11:1960:x1830948734218496:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:0.0:1746129574.104838:0:11014:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129574.104845:0:11014:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136b1d800/0x40a459093b06a751 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21667 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129574.104869:0:11014:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800903a0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11014:1830948737553792:192.168.202.4@tcp:106: 00000100:00100000:0.0:1746129574.104890:0:11014:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a00180 going to sleep for 11 seconds 00000100:00100000:0.0:1746129574.109945:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129574.109960:0:11014:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800903a0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11014:1830948737553792:192.168.202.4@tcp:106: 00010000:00010000:2.0:1746129574.110001:0:11014:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880136b1d800/0x40a459093b06a751 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21667 expref: 12 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129574.110016:0:11014:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136b1d800/0x40a459093b06a751 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21667 expref: 12 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129574.110032:0:11014:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136b1d800, rc 0) 00000100:00100000:2.0:1746129574.110079:0:11014:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cda7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:068dab75-d300-4ead-a742-d14572ad1e50+11:1960:x1830948734218496:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 5246us (5676us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129574.110091:0:11014:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16418 00000100:00100000:3.0:1746129574.110344:0:14551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734218880 00000100:00100000:3.0:1746129574.110351:0:14551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734218880 00000100:00100000:1.0:1746129574.110559:0:8410:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7d9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8410:1830948737553664:192.168.202.4@tcp:106: 00010000:00010000:1.0:1746129574.110578:0:8410:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c663200/0x40a459093b06a74a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2166e expref: 10 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129574.110592:0:8410:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c663200/0x40a459093b06a74a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2166e expref: 10 pid: 8410 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746129574.110602:0:14551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4788 00010000:00010000:1.0:1746129574.110602:0:8410:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c663200, rc 0) 00000100:00100000:3.0:1746129574.110609:0:14551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800903a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ada2ffba-8920-4ecb-8068-68caa9806978+291:32393:x1830948734218880:12345-192.168.202.4@tcp:35:cat.0 00000100:00100000:1.0:1746129574.110623:0:8410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cda6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:068dab75-d300-4ead-a742-d14572ad1e50+9:1960:x1830948734218624:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 6048us (6286us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129574.110628:0:8410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16417 00000100:00100000:3.0:1746129574.110808:0:14551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800903a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ada2ffba-8920-4ecb-8068-68caa9806978+292:32393:x1830948734218880:12345-192.168.202.4@tcp:35:cat.0 Request processed in 199us (872us total) trans 8589945365 rc 0/0 00000100:00100000:3.0:1746129574.110814:0:14551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4788 00000100:00100000:2.0:1746129574.114938:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129574.115073:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734219136 00000100:00100000:3.0:1746129574.115082:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734219136 00000100:00100000:3.0:1746129574.115140:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11267 00000100:00100000:3.0:1746129574.115149:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e389f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:068dab75-d300-4ead-a742-d14572ad1e50+11:32402:x1830948734219136:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:3.0:1746129574.115168:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129574.115186:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f725000/0x40a459093b06a758 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21675 expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129574.115316:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f724600/0x40a459093b06a75f lrc: 3/0,1 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129574.115329:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f724600/0x40a459093b06a75f lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129574.115341:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f724600/0x40a459093b06a75f lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00200000:3.0:1746129574.115353:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:3.0:1746129574.115483:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f725000/0x40a459093b06a758 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21675 expref: 14 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129574.115497:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f724600/0x40a459093b06a75f lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21675 expref: 13 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129574.115505:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:3.0:1746129574.115508:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746129574.115510:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f724600, rc 0) 00000100:00100000:3.0:1746129574.115577:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e389f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:068dab75-d300-4ead-a742-d14572ad1e50+13:32402:x1830948734219136:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 429us (650us total) trans 8589945366 rc 0/0 00000100:00100000:3.0:1746129574.115584:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11267 00000100:00100000:0.0:1746129574.117240:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129574.117451:0:16908:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734219392 00000100:00100000:2.0:1746129574.117460:0:16908:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734219392 00000100:00100000:2.0:1746129574.117516:0:16908:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11268 00000100:00100000:2.0:1746129574.117523:0:16908:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800903a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ada2ffba-8920-4ecb-8068-68caa9806978+292:32405:x1830948734219392:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:2.0:1746129574.117544:0:16908:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129574.117559:0:16908:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f444400/0x40a459093b06a76d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2167c expref: -99 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129574.117662:0:16908:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f444200/0x40a459093b06a774 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129574.117674:0:16908:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f444200/0x40a459093b06a774 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129574.117684:0:16908:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f444200/0x40a459093b06a774 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129574.117697:0:16908:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f445800/0x40a459093b06a77b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129574.117702:0:16908:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f445800/0x40a459093b06a77b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129574.117707:0:16908:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f445800/0x40a459093b06a77b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129574.117812:0:16908:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f444e00/0x40a459093b06a782 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129574.117822:0:16908:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f724600/0x40a459093b06a75f lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21675 expref: 12 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129574.117829:0:16908:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f444e00/0x40a459093b06a782 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129574.117861:0:16908:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f724600/0x40a459093b06a75f lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21675 expref: 12 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129574.117872:0:16908:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f724600/0x40a459093b06a75f lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21675 expref: 12 pid: 14549 timeout: 929 lvb_type: 0 00000100:00100000:2.0:1746129574.117884:0:16908:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e388380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16908:1830948737553920:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129574.117970:0:16908:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1a12540 going to sleep for 11 seconds 00000100:00100000:3.0:1746129574.118157:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129574.118188:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129574.118207:0:8410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734219520 00000100:00100000:1.0:1746129574.118211:0:8410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734219520 00000100:00100000:3.0:1746129574.118212:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129574.118225:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129574.118238:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129574.120461:0:8410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734219776 00000100:00100000:1.0:1746129574.120473:0:8410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734219776 00000100:00100000:1.0:1746129574.120511:0:8410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734220032 00000100:00100000:1.0:1746129574.120514:0:8410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734220032 00000100:00100000:1.0:1746129574.120527:0:8410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734219648 00000100:00100000:1.0:1746129574.120530:0:8410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734219648 00000100:00100000:1.0:1746129574.120540:0:8410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734219904 00000100:00100000:1.0:1746129574.120542:0:8410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734219904 00000100:00100000:1.0:1746129574.120565:0:8410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16419 00000100:00100000:1.0:1746129574.120573:0:8410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:068dab75-d300-4ead-a742-d14572ad1e50+13:1961:x1830948734219520:12345-192.168.202.4@tcp:1:lfs.0 00010000:00010000:1.0:1746129574.120617:0:8410:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009f845e00/0x40a459093b06a789 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129574.120635:0:8410:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ce27400/0x40a459093b06a53d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21509 expref: 37 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129574.120642:0:8410:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a9209000/0x40a459093b06a663 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f215aa expref: 13 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129574.120653:0:8410:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094fef000/0x40a459093b06a598 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21533 expref: 20 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129574.120660:0:8410:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129574.120662:0:8410:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129574.120664:0:8410:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f845e00/0x40a459093b06a789 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129574.120692:0:8410:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094fef000/0x40a459093b06a598 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21533 expref: 20 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129574.120703:0:8410:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094fef000/0x40a459093b06a598 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21533 expref: 20 pid: 4385 timeout: 929 lvb_type: 1 00000100:00100000:1.0:1746129574.120715:0:8410:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7d9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8410:1830948737554048:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129574.120787:0:8410:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a9209000/0x40a459093b06a663 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f215aa expref: 13 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129574.120795:0:8410:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a9209000/0x40a459093b06a663 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f215aa expref: 13 pid: 11014 timeout: 929 lvb_type: 1 00000100:00100000:1.0:1746129574.120802:0:8410:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7db100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8410:1830948737554176:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129574.120827:0:8410:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012ce27400/0x40a459093b06a53d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21509 expref: 37 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129574.120839:0:8410:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012ce27400/0x40a459093b06a53d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21509 expref: 37 pid: 8412 timeout: 929 lvb_type: 1 00000100:00100000:1.0:1746129574.120846:0:8410:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7d9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8410:1830948737554304:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129574.120847:0:8411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16420 00000100:00100000:3.0:1746129574.120854:0:8411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:068dab75-d300-4ead-a742-d14572ad1e50+10:1961:x1830948734219776:12345-192.168.202.4@tcp:1:lfs.0 00000100:00100000:1.0:1746129574.120863:0:8410:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4123d80 going to sleep for 11 seconds 00010000:00010000:3.0:1746129574.120873:0:8411:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009f724400/0x40a459093b06a790 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129574.120881:0:22481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16421 00010000:00010000:3.0:1746129574.120884:0:8411:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880136b1d600/0x40a459093b06a6d3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1490943) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21605 expref: 28 pid: 31503 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129574.120885:0:22481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bf78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:068dab75-d300-4ead-a742-d14572ad1e50+13:1961:x1830948734220032:12345-192.168.202.4@tcp:1:lfs.0 00010000:00010000:3.0:1746129574.120889:0:8411:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129574.120890:0:8411:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129574.120892:0:8411:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f724400/0x40a459093b06a790 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129574.120899:0:22481:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880132fc2600/0x40a459093b06a797 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129574.120907:0:8411:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880136b1d600/0x40a459093b06a6d3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1490943) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21605 expref: 28 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129574.120908:0:22481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f445000/0x40a459093b06a567 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21525 expref: 37 pid: 31503 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129574.120914:0:22481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b637400/0x40a459093b06a66a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f215c6 expref: 13 pid: 8411 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129574.120915:0:8411:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880136b1d600/0x40a459093b06a6d3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1490943) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21605 expref: 28 pid: 31503 timeout: 929 lvb_type: 0 00010000:00010000:1.0:1746129574.120921:0:22481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c22d600/0x40a459093b06a5b4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2154f expref: 20 pid: 4385 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746129574.120923:0:8411:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8411:1830948737554432:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129574.120925:0:22481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129574.120926:0:22481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129574.120928:0:22481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880132fc2600/0x40a459093b06a797 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129574.120941:0:22481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c22d600/0x40a459093b06a5b4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2154f expref: 20 pid: 4385 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746129574.120942:0:8411:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a6ce8240 going to sleep for 11 seconds 00010000:00010000:1.0:1746129574.120948:0:22481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c22d600/0x40a459093b06a5b4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2154f expref: 20 pid: 4385 timeout: 929 lvb_type: 1 00000100:00100000:1.0:1746129574.120955:0:22481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7d9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:22481:1830948737554560:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129574.120956:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16422 00000100:00100000:3.0:1746129574.120961:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:068dab75-d300-4ead-a742-d14572ad1e50+10:1961:x1830948734219648:12345-192.168.202.4@tcp:1:lfs.0 00010000:00010000:3.0:1746129574.120976:0:4385:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009f724000/0x40a459093b06a79e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129574.120976:0:22481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012b637400/0x40a459093b06a66a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f215c6 expref: 13 pid: 8411 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129574.120982:0:22481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012b637400/0x40a459093b06a66a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f215c6 expref: 13 pid: 8411 timeout: 929 lvb_type: 1 00010000:00010000:3.0:1746129574.120984:0:4385:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b637000/0x40a459093b06a6b7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1892352->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f215f0 expref: 28 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129574.120989:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129574.120990:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00000100:00100000:1.0:1746129574.120990:0:22481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7d8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:22481:1830948737554688:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129574.120993:0:4385:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f724000/0x40a459093b06a79e lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129574.121005:0:4385:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b637000/0x40a459093b06a6b7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1892352->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f215f0 expref: 28 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129574.121007:0:22481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f445000/0x40a459093b06a567 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21525 expref: 37 pid: 31503 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129574.121012:0:4385:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b637000/0x40a459093b06a6b7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1892352->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f215f0 expref: 28 pid: 4385 timeout: 929 lvb_type: 0 00010000:00010000:1.0:1746129574.121013:0:22481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f445000/0x40a459093b06a567 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21525 expref: 37 pid: 31503 timeout: 929 lvb_type: 1 00000100:00100000:3.0:1746129574.121019:0:4385:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:4385:1830948737554816:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129574.121020:0:22481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7db480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:22481:1830948737554944:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129574.121031:0:22481:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4123a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746129574.121035:0:4385:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a6ce8900 going to sleep for 11 seconds 00000100:00100000:1.0:1746129574.121046:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16423 00000100:00100000:1.0:1746129574.121050:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:068dab75-d300-4ead-a742-d14572ad1e50+13:1961:x1830948734219904:12345-192.168.202.4@tcp:1:lfs.0 00010000:00010000:1.0:1746129574.121063:0:7148:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a0640a00/0x40a459093b06a7a5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129574.121075:0:7148:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f445600/0x40a459093b06a56e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2151e expref: 37 pid: 31503 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129574.121081:0:7148:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a05bbc00/0x40a459093b06a678 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f215bf expref: 13 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129574.121087:0:7148:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c22ca00/0x40a459093b06a5ad lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21548 expref: 20 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129574.121092:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746129574.121093:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00010000:00010000:1.0:1746129574.121093:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129574.121095:0:7148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0640a00/0x40a459093b06a7a5 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129574.121108:0:7148:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c22ca00/0x40a459093b06a5ad lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21548 expref: 20 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129574.121114:0:7148:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c22ca00/0x40a459093b06a5ad lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21548 expref: 20 pid: 4385 timeout: 929 lvb_type: 1 00000100:00100000:1.0:1746129574.121121:0:7148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7d8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7148:1830948737555072:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129574.121144:0:7148:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a05bbc00/0x40a459093b06a678 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f215bf expref: 13 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129574.121151:0:7148:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a05bbc00/0x40a459093b06a678 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f215bf expref: 13 pid: 4385 timeout: 929 lvb_type: 1 00000100:00100000:1.0:1746129574.121163:0:7148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135720a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7148:1830948737555200:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129574.121181:0:7148:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f445600/0x40a459093b06a56e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2151e expref: 37 pid: 31503 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129574.121188:0:7148:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f445600/0x40a459093b06a56e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2151e expref: 37 pid: 31503 timeout: 929 lvb_type: 1 00000100:00100000:1.0:1746129574.121194:0:7148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fa26a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7148:1830948737555328:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129574.121205:0:7148:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934d2780 going to sleep for 11 seconds 00000100:00100000:1.0:1746129574.121217:0:4699:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734220160 00000100:00100000:1.0:1746129574.121221:0:4699:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734220160 00000100:00100000:1.0:1746129574.121239:0:4699:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16424 00000100:00100000:1.0:1746129574.121243:0:4699:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:068dab75-d300-4ead-a742-d14572ad1e50+11:1961:x1830948734220160:12345-192.168.202.4@tcp:1:lfs.0 00010000:00010000:1.0:1746129574.121256:0:4699:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009f7e1800/0x40a459093b06a7ac lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129574.121266:0:4699:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b637e00/0x40a459093b06a6b0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 7 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f215e9 expref: 28 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129574.121272:0:4699:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e0b5c00/0x40a459093b06a6da lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2160c expref: 28 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129574.121279:0:4699:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f724c00/0x40a459093b06a704 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21636 expref: 11 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129574.121315:0:4699:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f725800/0x40a459093b06a6e1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21613 expref: 36 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129574.121321:0:4699:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f725400/0x40a459093b06a6cc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f215fe expref: 36 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129574.121327:0:4699:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746129574.121328:0:4699:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746129574.121329:0:4699:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f7e1800/0x40a459093b06a7ac lrc: 8/0,1 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129574.121344:0:4699:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f725400/0x40a459093b06a6cc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f215fe expref: 36 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129574.121351:0:4699:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f725400/0x40a459093b06a6cc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f215fe expref: 36 pid: 4385 timeout: 929 lvb_type: 0 00000100:00100000:1.0:1746129574.121358:0:4699:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900f7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4699:1830948737555456:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129574.121399:0:4699:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f725800/0x40a459093b06a6e1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21613 expref: 36 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129574.121405:0:4699:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f725800/0x40a459093b06a6e1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21613 expref: 36 pid: 4385 timeout: 929 lvb_type: 0 00000100:00100000:1.0:1746129574.121412:0:4699:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135727b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4699:1830948737555584:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129574.121431:0:4699:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f724c00/0x40a459093b06a704 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21636 expref: 11 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129574.121438:0:4699:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f724c00/0x40a459093b06a704 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21636 expref: 11 pid: 7149 timeout: 929 lvb_type: 1 00000100:00100000:1.0:1746129574.121443:0:4699:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135726a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4699:1830948737555712:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129574.121457:0:4699:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012e0b5c00/0x40a459093b06a6da lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2160c expref: 28 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129574.121462:0:4699:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012e0b5c00/0x40a459093b06a6da lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2160c expref: 28 pid: 31503 timeout: 929 lvb_type: 0 00000100:00100000:1.0:1746129574.121468:0:4699:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135724700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4699:1830948737555840:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129574.121481:0:4699:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b637e00/0x40a459093b06a6b0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 7 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f215e9 expref: 28 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129574.121486:0:4699:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b637e00/0x40a459093b06a6b0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 7 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f215e9 expref: 28 pid: 4385 timeout: 929 lvb_type: 0 00000100:00100000:1.0:1746129574.121491:0:4699:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135725c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4699:1830948737555968:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129574.121501:0:4699:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934d26c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129574.123695:0:16908:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e388380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16908:1830948737553920:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129574.123720:0:16908:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008f444e00/0x40a459093b06a782 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00000100:00100000:0.0:1746129574.135925:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129574.136054:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129574.136065:0:8410:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7d9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8410:1830948737554048:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129574.136065:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129574.136076:0:8410:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7db100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8410:1830948737554176:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129574.136084:0:8410:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7d9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8410:1830948737554304:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129574.136088:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734220288 00000100:00100000:0.0:1746129574.136094:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734220288 00010000:00010000:1.0:1746129574.136114:0:8410:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009f845e00/0x40a459093b06a789 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129574.136126:0:9823:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f724600/0x40a459093b06a75f lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21675 expref: 13 pid: 14549 timeout: 929 lvb_type: 0 00000100:00100000:0.0:1746129574.136149:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734220416 00000100:00100000:0.0:1746129574.136151:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734220416 00010000:00010000:0.0:1746129574.136161:0:9823:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094fef000/0x40a459093b06a598 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21533 expref: 21 pid: 4385 timeout: 929 lvb_type: 1 00000100:00100000:0.0:1746129574.136173:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734220672 00000100:00100000:0.0:1746129574.136175:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734220672 00010000:00010000:0.0:1746129574.136184:0:9823:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012ce27400/0x40a459093b06a53d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21509 expref: 38 pid: 8412 timeout: 929 lvb_type: 1 00000100:00100000:0.0:1746129574.136198:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8422 00000100:00100000:0.0:1746129574.136204:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800903a1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:068dab75-d300-4ead-a742-d14572ad1e50+13:1962:x1830948734220288:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129574.136217:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129574.136223:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f724600/0x40a459093b06a75f lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21675 expref: 13 pid: 14549 timeout: 929 lvb_type: 0 00010000:00010000:0.0:1746129574.136232:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f724600/0x40a459093b06a75f lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21675 expref: 13 pid: 14549 timeout: 929 lvb_type: 0 00010000:00010000:0.0:1746129574.136254:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f724600/0x40a459093b06a75f lrc: 0/0,0 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21675 expref: 13 pid: 14549 timeout: 929 lvb_type: 0 00010000:00010000:0.0:1746129574.136271:0:9823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:0.0:1746129574.136276:0:9823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f444e00/0x40a459093b06a782 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129574.136313:0:9823:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f444e00/0x40a459093b06a782 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129574.136321:0:9823:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f444e00/0x40a459093b06a782 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129574.136339:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129574.136378:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800903a1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:068dab75-d300-4ead-a742-d14572ad1e50+12:1962:x1830948734220288:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 174us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129574.136384:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8422 00000100:00100000:0.0:1746129574.136401:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8423 00000100:00100000:0.0:1746129574.136405:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800903a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:1961:x1830948734220416:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129574.136412:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129574.136435:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094fef000/0x40a459093b06a598 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21533 expref: 21 pid: 4385 timeout: 929 lvb_type: 1 00010000:00010000:0.0:1746129574.136443:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094fef000/0x40a459093b06a598 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21533 expref: 21 pid: 4385 timeout: 929 lvb_type: 1 00010000:00010000:0.0:1746129574.136456:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094fef000/0x40a459093b06a598 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21533 expref: 21 pid: 4385 timeout: 929 lvb_type: 1 00010000:00010000:0.0:1746129574.136468:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129574.136481:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800903a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:1961:x1830948734220416:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 75us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129574.136486:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8423 00000100:00100000:0.0:1746129574.136494:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8424 00000100:00100000:0.0:1746129574.136498:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800903a0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ada2ffba-8920-4ecb-8068-68caa9806978+38:1961:x1830948734220672:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129574.136503:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129574.136509:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012ce27400/0x40a459093b06a53d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21509 expref: 38 pid: 8412 timeout: 929 lvb_type: 1 00010000:00010000:0.0:1746129574.136516:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012ce27400/0x40a459093b06a53d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21509 expref: 38 pid: 8412 timeout: 929 lvb_type: 1 00010000:00010000:0.0:1746129574.136526:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ce27400/0x40a459093b06a53d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21509 expref: 38 pid: 8412 timeout: 929 lvb_type: 1 00010000:00010000:0.0:1746129574.136538:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129574.136550:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800903a0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ada2ffba-8920-4ecb-8068-68caa9806978+37:1961:x1830948734220672:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 52us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129574.136554:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8424 00010000:00010000:0.0:1746129574.136569:0:16908:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008f444e00/0x40a459093b06a782 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129574.136575:0:16908:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f444e00/0x40a459093b06a782 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00000004:00200000:0.0:1746129574.136591:0:16908:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00000100:00100000:1.0:1746129574.136757:0:22481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7d9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:22481:1830948737554560:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129574.136794:0:22481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7d8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:22481:1830948737554688:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129574.136801:0:22481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7db480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:22481:1830948737554944:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129574.136816:0:22481:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880132fc2600/0x40a459093b06a797 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 22481 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129574.136835:0:4385:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:4385:1830948737554816:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129574.136854:0:4385:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009f724000/0x40a459093b06a79e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129574.136891:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129574.136901:0:20578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734220544 00000100:00100000:3.0:1746129574.136905:0:20578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734220544 00010000:00010000:3.0:1746129574.136918:0:20578:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a9209000/0x40a459093b06a663 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f215aa expref: 14 pid: 11014 timeout: 929 lvb_type: 1 00000100:00100000:3.0:1746129574.136932:0:20578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8425 00000100:00100000:3.0:1746129574.136937:0:20578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947bd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:068dab75-d300-4ead-a742-d14572ad1e50+14:1963:x1830948734220544:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129574.136943:0:20578:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129574.136950:0:20578:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a9209000/0x40a459093b06a663 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f215aa expref: 14 pid: 11014 timeout: 929 lvb_type: 1 00010000:00010000:3.0:1746129574.136958:0:20578:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a9209000/0x40a459093b06a663 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f215aa expref: 14 pid: 11014 timeout: 929 lvb_type: 1 00010000:00010000:3.0:1746129574.136968:0:20578:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a9209000/0x40a459093b06a663 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f215aa expref: 14 pid: 11014 timeout: 929 lvb_type: 1 00010000:00010000:3.0:1746129574.136981:0:20578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129574.136983:0:20578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129574.136986:0:20578:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f845e00/0x40a459093b06a789 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129574.136994:0:20578:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f845e00/0x40a459093b06a789 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129574.137006:0:20578:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129574.137023:0:20578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947bd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:068dab75-d300-4ead-a742-d14572ad1e50+13:1963:x1830948734220544:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 86us (132us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129574.137028:0:20578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8425 00000100:00100000:3.0:1746129574.137055:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129574.137091:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129574.137101:0:15749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734220928 00000100:00100000:3.0:1746129574.137103:0:15749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734220928 00010000:00010000:3.0:1746129574.137112:0:15749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012b637400/0x40a459093b06a66a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f215c6 expref: 13 pid: 8411 timeout: 929 lvb_type: 1 00000100:00100000:3.0:1746129574.137124:0:15749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8426 00000100:00100000:3.0:1746129574.137128:0:15749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:068dab75-d300-4ead-a742-d14572ad1e50+13:1963:x1830948734220928:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129574.137133:0:15749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129574.137141:0:15749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012b637400/0x40a459093b06a66a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f215c6 expref: 13 pid: 8411 timeout: 929 lvb_type: 1 00010000:00010000:3.0:1746129574.137148:0:15749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012b637400/0x40a459093b06a66a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f215c6 expref: 13 pid: 8411 timeout: 929 lvb_type: 1 00010000:00010000:3.0:1746129574.137158:0:15749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b637400/0x40a459093b06a66a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f215c6 expref: 13 pid: 8411 timeout: 929 lvb_type: 1 00010000:00010000:3.0:1746129574.137167:0:15749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129574.137179:0:15749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:068dab75-d300-4ead-a742-d14572ad1e50+12:1963:x1830948734220928:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 50us (87us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129574.137184:0:15749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8426 00000100:00100000:3.0:1746129574.137199:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734220800 00000100:00100000:3.0:1746129574.137202:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734220800 00002000:00100000:3.0:1746129574.137227:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f4:0x0] (1048576->1490943) req@ffff8800947be300 x1830948734220800/t0(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:315/0 lens 488/0 e 0 to 0 dl 1746129585 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129574.137241:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800947be300 with x1830948734220800 ext(1048576->1490943) 00010000:00010000:3.0:1746129574.137247:0:25745:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880136b1d600/0x40a459093b06a6d3 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1490943) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21605 expref: 29 pid: 31503 timeout: 929 lvb_type: 0 00010000:00010000:3.0:1746129574.137256:0:25745:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880136b1d600/0x40a459093b06a6d3 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1490943) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21605 expref: 29 pid: 31503 timeout: 929 lvb_type: 0 00002000:00010000:3.0:1746129574.137262:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800947be300 00000100:00100000:3.0:1746129574.137273:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2451 00000100:00100000:3.0:1746129574.137278:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+29:1963:x1830948734220800:12345-192.168.202.4@tcp:4:cat.0 00000100:00100000:1.0:1746129574.137669:0:7148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7d8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7148:1830948737555072:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129574.137683:0:8410:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009f845e00/0x40a459093b06a789 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129574.137691:0:8410:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f845e00/0x40a459093b06a789 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129574.137711:0:8410:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009f845e00/0x40a459093b06a789 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129574.137714:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00010000:00010000:1.0:1746129574.137718:0:8410:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009f845e00/0x40a459093b06a789 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129574.137725:0:8410:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009f845e00/0x40a459093b06a789 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129574.137735:0:8410:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f845e00 already unused, calling callback (ffffffffa086ed70) 00010000:00010000:1.0:1746129574.137739:0:8410:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f845e00/0x40a459093b06a789 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129574.137746:0:8410:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f845e00/0x40a459093b06a789 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129574.137756:0:8410:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009f845e00/0x40a459093b06a789 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129574.137762:0:8410:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f845e00/0x40a459093b06a789 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129574.137795:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129574.137807:0:20578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734221056 00000100:00100000:3.0:1746129574.137809:0:20578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734221056 00000100:00100000:1.0:1746129574.137809:0:8410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:068dab75-d300-4ead-a742-d14572ad1e50+11:1961:x1830948734219520:12345-192.168.202.4@tcp:1:lfs.0 Request processed in 17237us (19652us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129574.137816:0:8410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16419 00010000:00010000:3.0:1746129574.137822:0:20578:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c22ca00/0x40a459093b06a5ad lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21548 expref: 20 pid: 4385 timeout: 929 lvb_type: 1 00000100:00100000:3.0:1746129574.137836:0:20578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8427 00000100:00100000:3.0:1746129574.137840:0:20578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6fd3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:1961:x1830948734221056:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129574.137846:0:20578:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746129574.137850:0:4699:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900f7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4699:1830948737555456:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129574.137856:0:20578:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c22ca00/0x40a459093b06a5ad lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21548 expref: 20 pid: 4385 timeout: 929 lvb_type: 1 00000100:00100000:1.0:1746129574.137858:0:4699:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135727b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4699:1830948737555584:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129574.137864:0:20578:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c22ca00/0x40a459093b06a5ad lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21548 expref: 20 pid: 4385 timeout: 929 lvb_type: 1 00000100:00100000:1.0:1746129574.137871:0:7148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135720a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7148:1830948737555200:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129574.137878:0:7148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fa26a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7148:1830948737555328:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129574.137879:0:20578:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c22ca00/0x40a459093b06a5ad lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21548 expref: 20 pid: 4385 timeout: 929 lvb_type: 1 00010000:00010000:3.0:1746129574.137887:0:20578:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746129574.137898:0:7148:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800a0640a00/0x40a459093b06a7a5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129574.137900:0:20578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6fd3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+19:1961:x1830948734221056:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 59us (105us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129574.137905:0:20578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8427 00010000:00010000:0.0:1746129574.138209:0:16908:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f444e00/0x40a459093b06a782 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129574.138216:0:16908:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f444e00/0x40a459093b06a782 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129574.138221:0:16908:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f444e00/0x40a459093b06a782 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129574.138225:0:16908:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f444e00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:0.0:1746129574.138228:0:16908:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f444e00/0x40a459093b06a782 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129574.138233:0:16908:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f444e00/0x40a459093b06a782 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129574.138243:0:16908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:0.0:1746129574.138246:0:16908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746129574.138248:0:16908:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f444e00/0x40a459093b06a782 lrc: 2/0,0 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129574.138256:0:16908:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f444e00/0x40a459093b06a782 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129574.138270:0:16908:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f444200/0x40a459093b06a774 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129574.138274:0:16908:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f444200/0x40a459093b06a774 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129574.138277:0:16908:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f444200/0x40a459093b06a774 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129574.138281:0:16908:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f444200 already unused, calling callback (ffffffffa136e690) 00010000:00010000:0.0:1746129574.138283:0:16908:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f444200/0x40a459093b06a774 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129574.138313:0:16908:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f444200/0x40a459093b06a774 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129574.138319:0:16908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880132ef8f00) 00010000:00010000:0.0:1746129574.138321:0:16908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129574.138323:0:16908:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f444200/0x40a459093b06a774 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129574.138328:0:16908:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f444200/0x40a459093b06a774 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129574.138337:0:16908:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f445800/0x40a459093b06a77b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129574.138341:0:16908:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f445800/0x40a459093b06a77b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129574.138345:0:16908:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f445800/0x40a459093b06a77b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129574.138350:0:16908:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f445800 already unused, calling callback (ffffffffa136e690) 00010000:00010000:0.0:1746129574.138351:0:16908:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f445800/0x40a459093b06a77b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129574.138355:0:16908:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f445800/0x40a459093b06a77b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129574.138360:0:16908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012db42400) 00010000:00010000:0.0:1746129574.138361:0:16908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129574.138363:0:16908:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f445800/0x40a459093b06a77b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129574.138366:0:16908:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f445800/0x40a459093b06a77b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129574.138411:0:16908:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f444400/0x40a459093b06a76d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2167c expref: 294 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129574.138418:0:16908:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f444400/0x40a459093b06a76d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2167c expref: 294 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129574.138424:0:16908:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f444400, rc 0) 00000100:00100000:0.0:1746129574.138444:0:16908:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800903a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ada2ffba-8920-4ecb-8068-68caa9806978+293:32405:x1830948734219392:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 20922us (21211us total) trans 8589945367 rc 301/301 00000100:00100000:0.0:1746129574.138450:0:16908:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11268 00000100:00100000:0.0:1746129574.138492:0:31523:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734221184 00000100:00100000:0.0:1746129574.138496:0:31523:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734221184 00002000:00100000:0.0:1746129574.138513:0:31523:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f3:0x0] (1892352->2097151) req@ffff88009c07b800 x1830948734221184/t0(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:315/0 lens 488/0 e 0 to 0 dl 1746129585 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129574.138525:0:31523:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c07b800 with x1830948734221184 ext(1892352->2097151) 00010000:00010000:0.0:1746129574.138530:0:31523:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012b637000/0x40a459093b06a6b7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1892352->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f215f0 expref: 31 pid: 4385 timeout: 929 lvb_type: 0 00010000:00010000:0.0:1746129574.138538:0:31523:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012b637000/0x40a459093b06a6b7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1892352->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f215f0 expref: 31 pid: 4385 timeout: 929 lvb_type: 0 00002000:00010000:0.0:1746129574.138542:0:31523:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c07b800 00000100:00100000:0.0:1746129574.138555:0:31523:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2452 00000100:00100000:0.0:1746129574.138560:0:31523:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c07b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+31:1963:x1830948734221184:12345-192.168.202.4@tcp:4:cat.0 00000100:00100000:0.0:1746129574.138754:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129574.138785:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129574.138866:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129574.138879:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734221440 00000100:00100000:0.0:1746129574.138881:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734221440 00010000:00010000:0.0:1746129574.138894:0:9823:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f445600/0x40a459093b06a56e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2151e expref: 37 pid: 31503 timeout: 929 lvb_type: 1 00000100:00100000:0.0:1746129574.138903:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734221696 00000100:00100000:0.0:1746129574.138904:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734221696 00010000:00010000:0.0:1746129574.138911:0:9823:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c22d600/0x40a459093b06a5b4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2154f expref: 19 pid: 4385 timeout: 929 lvb_type: 1 00000100:00100000:1.0:1746129574.138915:0:7086:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734221312 00000100:00100000:0.0:1746129574.138918:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8428 00000100:00100000:1.0:1746129574.138920:0:7086:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734221312 00000100:00100000:0.0:1746129574.138922:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800903a1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ada2ffba-8920-4ecb-8068-68caa9806978+37:1961:x1830948734221440:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129574.138930:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129574.138934:0:7086:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a05bbc00/0x40a459093b06a678 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f215bf expref: 11 pid: 4385 timeout: 929 lvb_type: 1 00010000:00010000:0.0:1746129574.138938:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f445600/0x40a459093b06a56e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2151e expref: 37 pid: 31503 timeout: 929 lvb_type: 1 00010000:00010000:0.0:1746129574.138945:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f445600/0x40a459093b06a56e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2151e expref: 37 pid: 31503 timeout: 929 lvb_type: 1 00000100:00100000:1.0:1746129574.138948:0:7086:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8429 00000100:00100000:1.0:1746129574.138953:0:7086:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800903a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+19:1961:x1830948734221696:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129574.138956:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f445600/0x40a459093b06a56e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2151e expref: 37 pid: 31503 timeout: 929 lvb_type: 1 00010000:00010000:1.0:1746129574.138961:0:7086:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129574.138964:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746129574.138971:0:7086:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c22d600/0x40a459093b06a5b4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2154f expref: 19 pid: 4385 timeout: 929 lvb_type: 1 00000100:00100000:0.0:1746129574.138977:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800903a1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ada2ffba-8920-4ecb-8068-68caa9806978+36:1961:x1830948734221440:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 54us (223us total) trans 0 rc 0/0 00010000:00010000:1.0:1746129574.138978:0:7086:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c22d600/0x40a459093b06a5b4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2154f expref: 19 pid: 4385 timeout: 929 lvb_type: 1 00000100:00100000:0.0:1746129574.138982:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8428 00010000:00010000:1.0:1746129574.138989:0:7086:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c22d600/0x40a459093b06a5b4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2154f expref: 19 pid: 4385 timeout: 929 lvb_type: 1 00000100:00100000:0.0:1746129574.138994:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8430 00010000:00010000:1.0:1746129574.138997:0:7086:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129574.138998:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800903a2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:068dab75-d300-4ead-a742-d14572ad1e50+11:1961:x1830948734221312:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129574.139003:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129574.139009:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a05bbc00/0x40a459093b06a678 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f215bf expref: 11 pid: 4385 timeout: 929 lvb_type: 1 00000100:00100000:1.0:1746129574.139012:0:7086:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800903a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+18:1961:x1830948734221696:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 59us (226us total) trans 0 rc 0/0 00010000:00010000:0.0:1746129574.139015:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a05bbc00/0x40a459093b06a678 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f215bf expref: 11 pid: 4385 timeout: 929 lvb_type: 1 00000100:00100000:1.0:1746129574.139018:0:7086:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8429 00010000:00010000:0.0:1746129574.139025:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a05bbc00/0x40a459093b06a678 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f215bf expref: 11 pid: 4385 timeout: 929 lvb_type: 1 00000100:00100000:2.0:1746129574.139108:0:8411:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8411:1830948737554432:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129574.139124:0:8411:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009f724400/0x40a459093b06a790 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129574.140179:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129574.141444:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129574.141509:0:4699:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135726a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4699:1830948737555712:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129574.141520:0:4699:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135724700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4699:1830948737555840:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129574.141528:0:4699:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135725c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4699:1830948737555968:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129574.141587:0:4699:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009f7e1800/0x40a459093b06a7ac lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129574.142281:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734221568 00000100:00100000:2.0:1746129574.142311:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734221568 00010000:00010000:2.0:1746129574.142347:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f725400/0x40a459093b06a6cc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f215fe expref: 37 pid: 4385 timeout: 929 lvb_type: 0 00000100:00100000:2.0:1746129574.142370:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734221824 00000100:00100000:2.0:1746129574.142372:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734221824 00010000:00010000:2.0:1746129574.142382:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f724c00/0x40a459093b06a704 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21636 expref: 12 pid: 7149 timeout: 929 lvb_type: 1 00000100:00100000:2.0:1746129574.142395:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8431 00000100:00100000:2.0:1746129574.142400:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ada2ffba-8920-4ecb-8068-68caa9806978+37:1961:x1830948734221568:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129574.142414:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129574.142437:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f725400/0x40a459093b06a6cc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f215fe expref: 37 pid: 4385 timeout: 929 lvb_type: 0 00010000:00010000:2.0:1746129574.142446:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f725400/0x40a459093b06a6cc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f215fe expref: 37 pid: 4385 timeout: 929 lvb_type: 0 00010000:00010000:2.0:1746129574.142468:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f725400/0x40a459093b06a6cc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f215fe expref: 37 pid: 4385 timeout: 929 lvb_type: 0 00010000:00010000:2.0:1746129574.142484:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129574.142517:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ada2ffba-8920-4ecb-8068-68caa9806978+36:1961:x1830948734221568:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 117us (2341us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129574.142523:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8431 00000100:00100000:2.0:1746129574.142536:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8432 00000100:00100000:2.0:1746129574.142539:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947bd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:068dab75-d300-4ead-a742-d14572ad1e50+12:1963:x1830948734221824:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129574.142544:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129574.142549:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f724c00/0x40a459093b06a704 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21636 expref: 12 pid: 7149 timeout: 929 lvb_type: 1 00010000:00010000:2.0:1746129574.142555:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f724c00/0x40a459093b06a704 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21636 expref: 12 pid: 7149 timeout: 929 lvb_type: 1 00010000:00010000:2.0:1746129574.142564:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f724c00/0x40a459093b06a704 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21636 expref: 12 pid: 7149 timeout: 929 lvb_type: 1 00010000:00010000:2.0:1746129574.142575:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129574.142585:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947bd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:068dab75-d300-4ead-a742-d14572ad1e50+11:1963:x1830948734221824:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 46us (1147us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129574.142589:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8432 00010000:00010000:0.0:1746129574.143776:0:9823:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129574.143783:0:9823:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129574.143789:0:9823:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0640a00/0x40a459093b06a7a5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129574.143800:0:9823:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0640a00/0x40a459093b06a7a5 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129574.143833:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129574.143871:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800903a2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:068dab75-d300-4ead-a742-d14572ad1e50+10:1961:x1830948734221312:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 4870us (5002us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129574.143878:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8430 00010000:00010000:1.0:1746129574.143938:0:7148:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a0640a00/0x40a459093b06a7a5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129574.143946:0:7148:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0640a00/0x40a459093b06a7a5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129574.143974:0:7148:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a0640a00/0x40a459093b06a7a5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129574.143982:0:7148:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0640a00/0x40a459093b06a7a5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129574.143989:0:7148:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a0640a00/0x40a459093b06a7a5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129574.143996:0:7148:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0640a00 already unused, calling callback (ffffffffa086ed70) 00010000:00010000:1.0:1746129574.143999:0:7148:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a0640a00/0x40a459093b06a7a5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129574.144007:0:7148:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a0640a00/0x40a459093b06a7a5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129574.144017:0:7148:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a0640a00/0x40a459093b06a7a5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129574.144022:0:7148:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0640a00/0x40a459093b06a7a5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129574.144062:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:068dab75-d300-4ead-a742-d14572ad1e50+9:1961:x1830948734219904:12345-192.168.202.4@tcp:1:lfs.0 Request processed in 23012us (25823us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129574.144070:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16423 00000100:00100000:3.0:1746129574.144144:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129574.144165:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129574.144189:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129574.144219:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129574.144242:0:20578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734222080 00000100:00100000:3.0:1746129574.144246:0:20578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734222080 00010000:00010000:3.0:1746129574.144264:0:20578:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012e0b5c00/0x40a459093b06a6da lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2160c expref: 33 pid: 31503 timeout: 929 lvb_type: 0 00000100:00100000:3.0:1746129574.144279:0:20578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734221952 00000100:00100000:3.0:1746129574.144280:0:20578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734221952 00010000:00010000:3.0:1746129574.144312:0:20578:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f725800/0x40a459093b06a6e1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21613 expref: 36 pid: 4385 timeout: 929 lvb_type: 0 00000100:00100000:3.0:1746129574.144322:0:20578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734222208 00000100:00100000:3.0:1746129574.144323:0:20578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734222208 00010000:00010000:3.0:1746129574.144330:0:20578:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b637e00/0x40a459093b06a6b0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f215e9 expref: 34 pid: 4385 timeout: 929 lvb_type: 0 00000100:00100000:3.0:1746129574.144341:0:20578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734222336 00000100:00100000:3.0:1746129574.144343:0:20578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734222336 00010000:00010000:3.0:1746129574.144350:0:20578:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f445000/0x40a459093b06a567 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21525 expref: 36 pid: 31503 timeout: 929 lvb_type: 1 00000100:00100000:3.0:1746129574.144357:0:20578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8433 00000100:00100000:3.0:1746129574.144361:0:20578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+34:1963:x1830948734222080:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129574.144372:0:20578:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129574.144383:0:20578:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012e0b5c00/0x40a459093b06a6da lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2160c expref: 34 pid: 31503 timeout: 929 lvb_type: 0 00010000:00010000:3.0:1746129574.144391:0:20578:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012e0b5c00/0x40a459093b06a6da lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2160c expref: 34 pid: 31503 timeout: 929 lvb_type: 0 00010000:00010000:3.0:1746129574.144404:0:20578:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e0b5c00/0x40a459093b06a6da lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2160c expref: 34 pid: 31503 timeout: 929 lvb_type: 0 00010000:00010000:3.0:1746129574.144411:0:20578:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129574.144421:0:20578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+33:1963:x1830948734222080:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 60us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129574.144426:0:20578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8433 00000100:00100000:3.0:1746129574.144434:0:20578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8434 00000100:00100000:3.0:1746129574.144438:0:20578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6fd3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ada2ffba-8920-4ecb-8068-68caa9806978+36:1960:x1830948734221952:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129574.144443:0:20578:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129574.144447:0:20578:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f725800/0x40a459093b06a6e1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21613 expref: 36 pid: 4385 timeout: 929 lvb_type: 0 00010000:00010000:3.0:1746129574.144454:0:20578:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f725800/0x40a459093b06a6e1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21613 expref: 36 pid: 4385 timeout: 929 lvb_type: 0 00010000:00010000:3.0:1746129574.144462:0:20578:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f725800/0x40a459093b06a6e1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21613 expref: 36 pid: 4385 timeout: 929 lvb_type: 0 00010000:00010000:3.0:1746129574.144468:0:20578:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129574.144473:0:20578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6fd3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ada2ffba-8920-4ecb-8068-68caa9806978+35:1960:x1830948734221952:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 36us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129574.144478:0:20578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8434 00000100:00100000:3.0:1746129574.144502:0:20578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8435 00000100:00100000:3.0:1746129574.144506:0:20578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132c26300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+32:1960:x1830948734222208:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129574.144512:0:20578:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129574.144518:0:20578:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b637e00/0x40a459093b06a6b0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f215e9 expref: 32 pid: 4385 timeout: 929 lvb_type: 0 00010000:00010000:3.0:1746129574.144526:0:20578:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b637e00/0x40a459093b06a6b0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f215e9 expref: 32 pid: 4385 timeout: 929 lvb_type: 0 00010000:00010000:3.0:1746129574.144534:0:20578:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b637e00/0x40a459093b06a6b0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f215e9 expref: 32 pid: 4385 timeout: 929 lvb_type: 0 00010000:00010000:3.0:1746129574.144542:0:20578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129574.144543:0:20578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129574.144547:0:20578:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f7e1800/0x40a459093b06a7ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129574.144553:0:20578:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f7e1800/0x40a459093b06a7ac lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129574.144567:0:20578:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129574.144576:0:20578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132c26300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+31:1960:x1830948734222208:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 70us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129574.144581:0:20578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8435 00000100:00100000:3.0:1746129574.144590:0:20578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8436 00000100:00100000:3.0:1746129574.144594:0:20578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136016300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ada2ffba-8920-4ecb-8068-68caa9806978+36:1963:x1830948734222336:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129574.144600:0:20578:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129574.144608:0:20578:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f445000/0x40a459093b06a567 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21525 expref: 36 pid: 31503 timeout: 929 lvb_type: 1 00010000:00010000:3.0:1746129574.144615:0:20578:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f445000/0x40a459093b06a567 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21525 expref: 36 pid: 31503 timeout: 929 lvb_type: 1 00010000:00010000:3.0:1746129574.144625:0:20578:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f445000/0x40a459093b06a567 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21525 expref: 36 pid: 31503 timeout: 929 lvb_type: 1 00010000:00010000:3.0:1746129574.144633:0:20578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129574.144635:0:20578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129574.144637:0:20578:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880132fc2600/0x40a459093b06a797 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129574.144643:0:20578:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880132fc2600/0x40a459093b06a797 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129574.144655:0:20578:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129574.144665:0:20578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136016300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ada2ffba-8920-4ecb-8068-68caa9806978+35:1963:x1830948734222336:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 70us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129574.144669:0:20578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8436 00010000:00010000:3.0:1746129574.144684:0:22481:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880132fc2600/0x40a459093b06a797 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129574.144690:0:22481:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880132fc2600/0x40a459093b06a797 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129574.144702:0:22481:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880132fc2600/0x40a459093b06a797 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129574.144707:0:22481:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880132fc2600/0x40a459093b06a797 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129574.144712:0:22481:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880132fc2600/0x40a459093b06a797 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129574.144717:0:22481:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880132fc2600 already unused, calling callback (ffffffffa086ed70) 00010000:00010000:3.0:1746129574.144720:0:22481:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880132fc2600/0x40a459093b06a797 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129574.144726:0:22481:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880132fc2600/0x40a459093b06a797 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129574.144738:0:22481:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880132fc2600/0x40a459093b06a797 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129574.144743:0:22481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880132fc2600/0x40a459093b06a797 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 22481 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129574.144790:0:22481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bf78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:068dab75-d300-4ead-a742-d14572ad1e50+8:1961:x1830948734220032:12345-192.168.202.4@tcp:1:lfs.0 Request processed in 23904us (26577us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129574.144795:0:22481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16421 00010000:00010000:1.0:1746129574.145325:0:4699:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009f7e1800/0x40a459093b06a7ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129574.145333:0:4699:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f7e1800/0x40a459093b06a7ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129574.145347:0:4699:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009f7e1800/0x40a459093b06a7ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129574.145353:0:4699:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009f7e1800/0x40a459093b06a7ac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129574.145358:0:4699:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009f7e1800/0x40a459093b06a7ac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129574.145361:0:4699:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f7e1800 already unused, calling callback (ffffffffa086ed70) 00010000:00010000:1.0:1746129574.145364:0:4699:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f7e1800/0x40a459093b06a7ac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129574.145369:0:4699:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f7e1800/0x40a459093b06a7ac lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129574.145377:0:4699:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009f7e1800/0x40a459093b06a7ac lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129574.145383:0:4699:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f7e1800/0x40a459093b06a7ac lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129574.145422:0:4699:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:068dab75-d300-4ead-a742-d14572ad1e50+10:1961:x1830948734220160:12345-192.168.202.4@tcp:1:lfs.0 Request processed in 24177us (24328us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129574.145427:0:4699:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16424 00000100:00100000:3.0:1746129574.199474:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+31:1963:x1830948734220800:12345-192.168.202.4@tcp:4:cat.0 Request processed in 62182us (62404us total) trans 17179874146 rc 0/0 00000100:00100000:3.0:1746129574.199488:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2451 00002000:00100000:3.0:1746129574.199500:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f4:0x0] (1048576->1490943) req@ffff8800947be300 x1830948734220800/t17179874146(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:315/0 lens 488/448 e 0 to 0 dl 1746129585 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129574.199509:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800947be300 with x1830948734220800 ext(1048576->1490943) 00010000:00010000:3.0:1746129574.199520:0:25745:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880136b1d600/0x40a459093b06a6d3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1490943) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21605 expref: 31 pid: 31503 timeout: 929 lvb_type: 0 00010000:00010000:3.0:1746129574.199533:0:25745:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880136b1d600/0x40a459093b06a6d3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1490943) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21605 expref: 31 pid: 31503 timeout: 929 lvb_type: 0 00002000:00010000:3.0:1746129574.199540:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800947be300 00000100:00100000:0.0:1746129574.209590:0:31523:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c07b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+31:1963:x1830948734221184:12345-192.168.202.4@tcp:4:cat.0 Request processed in 71019us (71866us total) trans 17179874147 rc 0/0 00000100:00100000:0.0:1746129574.209602:0:31523:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2452 00002000:00100000:0.0:1746129574.209616:0:31523:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f3:0x0] (1892352->2097151) req@ffff88009c07b800 x1830948734221184/t17179874147(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:315/0 lens 488/448 e 0 to 0 dl 1746129585 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129574.209626:0:31523:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c07b800 with x1830948734221184 ext(1892352->2097151) 00010000:00010000:0.0:1746129574.209637:0:31523:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012b637000/0x40a459093b06a6b7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1892352->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f215f0 expref: 31 pid: 4385 timeout: 929 lvb_type: 0 00010000:00010000:0.0:1746129574.209651:0:31523:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012b637000/0x40a459093b06a6b7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1892352->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f215f0 expref: 31 pid: 4385 timeout: 929 lvb_type: 0 00002000:00010000:0.0:1746129574.209658:0:31523:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c07b800 00000100:00100000:3.0:1746129574.209835:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129574.209917:0:4699:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734222464 00000100:00100000:1.0:1746129574.209926:0:4699:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734222464 00000100:00100000:1.0:1746129574.209957:0:4699:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16425 00000100:00100000:1.0:1746129574.209964:0:4699:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ada2ffba-8920-4ecb-8068-68caa9806978+35:32405:x1830948734222464:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:1.0:1746129574.209979:0:4699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129574.209996:0:4699:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095b5ee00/0x40a459093b06a7ba lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21683 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746129574.210018:0:4699:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3ee:0x0] initial LVB size: 2097152, mtime: 0x6813d2a6, atime: 0x6813d2a6, ctime: 0x6813d2a6, blocks: 0x81d 00010000:00010000:1.0:1746129574.210038:0:4699:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129574.210040:0:4699:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129574.210047:0:4699:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095b5ee00/0x40a459093b06a7ba lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1253376->1757183) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21683 expref: 36 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129574.210061:0:4699:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095b5ee00/0x40a459093b06a7ba lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1253376->1757183) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21683 expref: 36 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129574.210072:0:4699:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095b5ee00, rc 0) 00000100:00100000:1.0:1746129574.210090:0:4699:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ada2ffba-8920-4ecb-8068-68caa9806978+36:32405:x1830948734222464:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 127us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129574.210096:0:4699:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16425 00000100:00100000:2.0:1746129574.219864:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129574.220319:0:31523:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734222720 00000100:00100000:1.0:1746129574.220331:0:31523:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734222720 00002000:00100000:1.0:1746129574.220385:0:31523:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3ee:0x0] (1253376->1257471) req@ffff88012e38b800 x1830948734222720/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:315/0 lens 488/0 e 0 to 0 dl 1746129585 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129574.220396:0:31523:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e38b800 with x1830948734222720 ext(1253376->1257471) 00002000:00010000:1.0:1746129574.220403:0:31523:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e38b800 00000100:00100000:1.0:1746129574.220433:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7903 00000100:00100000:1.0:1746129574.220441:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e38b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+36:1962:x1830948734222720:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:1.0:1746129574.220625:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e38b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+36:1962:x1830948734222720:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 184us (773us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746129574.220632:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7903 00002000:00100000:1.0:1746129574.220638:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ee:0x0] (1253376->1257471) req@ffff88012e38b800 x1830948734222720/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:315/0 lens 488/4536 e 0 to 0 dl 1746129585 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129574.220646:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e38b800 with x1830948734222720 ext(1253376->1257471) 00002000:00010000:1.0:1746129574.220649:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e38b800 00000100:00100000:2.0:1746129574.226138:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129574.226171:0:15749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734222848 00000100:00100000:2.0:1746129574.226180:0:15749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734222848 00010000:00010000:2.0:1746129574.226218:0:15749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880136b1d600/0x40a459093b06a6d3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1490943) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21605 expref: 31 pid: 31503 timeout: 929 lvb_type: 0 00000100:00100000:2.0:1746129574.226247:0:15749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8437 00000100:00100000:2.0:1746129574.226254:0:15749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e389c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+31:1963:x1830948734222848:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129574.226269:0:15749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129574.226317:0:15749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880136b1d600/0x40a459093b06a6d3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1490943) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21605 expref: 31 pid: 31503 timeout: 929 lvb_type: 0 00010000:00010000:2.0:1746129574.226329:0:15749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880136b1d600/0x40a459093b06a6d3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1490943) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21605 expref: 31 pid: 31503 timeout: 929 lvb_type: 0 00010000:00010000:2.0:1746129574.226354:0:15749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136b1d600/0x40a459093b06a6d3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1490943) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21605 expref: 31 pid: 31503 timeout: 929 lvb_type: 0 00010000:00010000:2.0:1746129574.226371:0:15749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129574.226373:0:15749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129574.226378:0:15749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f724400/0x40a459093b06a790 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129574.226386:0:15749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f724400/0x40a459093b06a790 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129574.226410:0:15749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129574.226451:0:15749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e389c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+30:1963:x1830948734222848:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 197us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129574.226458:0:15749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8437 00010000:00010000:2.0:1746129574.226491:0:8411:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009f724400/0x40a459093b06a790 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129574.226499:0:8411:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f724400/0x40a459093b06a790 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129574.226519:0:8411:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009f724400/0x40a459093b06a790 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129574.226526:0:8411:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009f724400/0x40a459093b06a790 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129574.226532:0:8411:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009f724400/0x40a459093b06a790 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129574.226539:0:8411:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f724400 already unused, calling callback (ffffffffa086ed70) 00010000:00010000:2.0:1746129574.226542:0:8411:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f724400/0x40a459093b06a790 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129574.226554:0:8411:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f724400/0x40a459093b06a790 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129574.226563:0:8411:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009f724400/0x40a459093b06a790 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129574.226568:0:8411:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f724400/0x40a459093b06a790 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129574.226612:0:8411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:068dab75-d300-4ead-a742-d14572ad1e50+9:1961:x1830948734219776:12345-192.168.202.4@tcp:1:lfs.0 Request processed in 105759us (108423us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129574.226620:0:8411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16420 00000100:00100000:2.0:1746129574.226931:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129574.226948:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734222976 00000100:00100000:2.0:1746129574.226951:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734222976 00010000:00010000:2.0:1746129574.226962:0:9823:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b637000/0x40a459093b06a6b7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1892352->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f215f0 expref: 30 pid: 4385 timeout: 929 lvb_type: 0 00000100:00100000:2.0:1746129574.226976:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8438 00000100:00100000:2.0:1746129574.226981:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e38bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+30:1962:x1830948734222976:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129574.226988:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746129574.226995:0:9823:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb blocks from disk: 2079 -> 2081 00010000:00010000:2.0:1746129574.226999:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b637000/0x40a459093b06a6b7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1892352->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f215f0 expref: 30 pid: 4385 timeout: 929 lvb_type: 0 00010000:00010000:2.0:1746129574.227011:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b637000/0x40a459093b06a6b7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1892352->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f215f0 expref: 30 pid: 4385 timeout: 929 lvb_type: 0 00010000:00010000:2.0:1746129574.227022:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b637000/0x40a459093b06a6b7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1892352->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f215f0 expref: 30 pid: 4385 timeout: 929 lvb_type: 0 00010000:00010000:2.0:1746129574.227030:0:9823:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129574.227031:0:9823:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129574.227034:0:9823:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f724000/0x40a459093b06a79e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129574.227040:0:9823:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f724000/0x40a459093b06a79e lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129574.227054:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129574.227067:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e38bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+29:1962:x1830948734222976:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 85us (136us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129574.227072:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8438 00010000:00010000:2.0:1746129574.227085:0:4385:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009f724000/0x40a459093b06a79e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129574.227092:0:4385:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f724000/0x40a459093b06a79e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129574.227104:0:4385:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009f724000/0x40a459093b06a79e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129574.227114:0:4385:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009f724000/0x40a459093b06a79e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129574.227120:0:4385:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009f724000/0x40a459093b06a79e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129574.227125:0:4385:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f724000 already unused, calling callback (ffffffffa086ed70) 00010000:00010000:2.0:1746129574.227128:0:4385:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f724000/0x40a459093b06a79e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129574.227133:0:4385:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f724000/0x40a459093b06a79e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129574.227141:0:4385:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009f724000/0x40a459093b06a79e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129574.227147:0:4385:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f724000/0x40a459093b06a79e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129574.227174:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:068dab75-d300-4ead-a742-d14572ad1e50+8:1961:x1830948734219648:12345-192.168.202.4@tcp:1:lfs.0 Request processed in 106212us (108948us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129574.227180:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16422 00000100:00100000:1.0:1746129574.230477:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129574.230510:0:31523:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734223232 00000100:00100000:1.0:1746129574.230518:0:31523:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734223232 00002000:00100000:1.0:1746129574.231076:0:31523:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3ee:0x0] (1753088->1757183) req@ffff880135725c00 x1830948734223232/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:315/0 lens 488/0 e 0 to 0 dl 1746129585 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129574.231086:0:31523:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135725c00 with x1830948734223232 ext(1753088->1757183) 00002000:00010000:1.0:1746129574.231091:0:31523:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135725c00 00000100:00100000:1.0:1746129574.231122:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7904 00000100:00100000:1.0:1746129574.231131:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135725c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+36:1962:x1830948734223232:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:1.0:1746129574.234596:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135725c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+36:1962:x1830948734223232:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 3455us (4115us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746129574.234609:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7904 00002000:00100000:1.0:1746129574.234619:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ee:0x0] (1753088->1757183) req@ffff880135725c00 x1830948734223232/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:315/0 lens 488/4536 e 0 to 0 dl 1746129585 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129574.234628:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135725c00 with x1830948734223232 ext(1753088->1757183) 00002000:00010000:1.0:1746129574.234635:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135725c00 00000100:00100000:1.0:1746129574.234813:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129574.234839:0:16908:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734223488 00000100:00100000:1.0:1746129574.234846:0:16908:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734223488 00000100:00100000:1.0:1746129574.234883:0:16908:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11269 00000100:00100000:1.0:1746129574.234890:0:16908:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135724700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:068dab75-d300-4ead-a742-d14572ad1e50+12:32402:x1830948734223488:12345-192.168.202.4@tcp:36:lfs.0 00010000:00010000:1.0:1746129574.234938:0:16908:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1746129574.234966:0:16908:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f445200/0x40a459093b06a743 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21660 expref: 12 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129574.235002:0:16908:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a05bb800/0x40a459093b06a647 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2159c expref: 11 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129574.235013:0:16908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:1.0:1746129574.235018:0:16908:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129574.235050:0:16908:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135724700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:068dab75-d300-4ead-a742-d14572ad1e50+10:32402:x1830948734223488:12345-192.168.202.4@tcp:36:lfs.0 Request processed in 161us (238us total) trans 0 rc -116/-116 00000100:00100000:1.0:1746129574.235055:0:16908:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11269 00000100:00100000:2.0:1746129574.240487:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129574.240527:0:14551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734223744 00000100:00100000:3.0:1746129574.240538:0:14551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734223744 00000100:00100000:3.0:1746129574.240591:0:14551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4789 00000100:00100000:3.0:1746129574.240599:0:14551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f533c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:068dab75-d300-4ead-a742-d14572ad1e50+10:32402:x1830948734223744:12345-192.168.202.4@tcp:35:lfs.0 00000100:00100000:3.0:1746129574.240820:0:14551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f533c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:068dab75-d300-4ead-a742-d14572ad1e50+11:32402:x1830948734223744:12345-192.168.202.4@tcp:35:lfs.0 Request processed in 221us (343us total) trans 8589945368 rc 0/0 00000100:00100000:3.0:1746129574.240826:0:14551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4789 00000100:00100000:3.0:1746129574.240949:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129574.240966:0:14551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734224000 00000100:00100000:3.0:1746129574.240969:0:14551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734224000 00000100:00100000:3.0:1746129574.240985:0:14551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4790 00000100:00100000:3.0:1746129574.240989:0:14551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ada2ffba-8920-4ecb-8068-68caa9806978+293:32405:x1830948734224000:12345-192.168.202.4@tcp:35:multiop.0 00000100:00100000:3.0:1746129574.241059:0:14551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ada2ffba-8920-4ecb-8068-68caa9806978+294:32405:x1830948734224000:12345-192.168.202.4@tcp:35:multiop.0 Request processed in 69us (109us total) trans 8589945369 rc 0/0 00000100:00100000:3.0:1746129574.241065:0:14551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4790 00000100:00100000:3.0:1746129574.241135:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129574.241728:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734224256 00000100:00100000:1.0:1746129574.241734:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734224256 00000100:00100000:1.0:1746129574.241762:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11270 00000100:00100000:1.0:1746129574.241768:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a64d5850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+9:32408:x1830948734224256:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:1.0:1746129574.241783:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129574.241800:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f845200/0x40a459093b06a7c1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2168a expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129574.241883:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cdfc200/0x40a459093b06a7c8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129574.241896:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cdfc200/0x40a459093b06a7c8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129574.241907:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cdfc200/0x40a459093b06a7c8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129574.241921:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4f8fc00/0x40a459093b06a7cf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129574.241927:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4f8fc00/0x40a459093b06a7cf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129574.241932:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4f8fc00/0x40a459093b06a7cf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129574.242024:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4f8f600/0x40a459093b06a7d6 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129574.242031:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4f8f600/0x40a459093b06a7d6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129574.242037:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4f8f600/0x40a459093b06a7d6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00200000:1.0:1746129574.242050:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:1.0:1746129574.242102:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cdfc200/0x40a459093b06a7c8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129574.242109:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cdfc200/0x40a459093b06a7c8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129574.242114:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009cdfc200/0x40a459093b06a7c8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129574.242119:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009cdfc200 already unused, calling callback (ffffffffa136e690) 00010000:00010000:1.0:1746129574.242123:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cdfc200/0x40a459093b06a7c8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129574.242129:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cdfc200/0x40a459093b06a7c8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129574.242139:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880132ef8f00) 00010000:00010000:1.0:1746129574.242141:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129574.242145:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009cdfc200/0x40a459093b06a7c8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129574.242150:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cdfc200/0x40a459093b06a7c8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129574.242162:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4f8fc00/0x40a459093b06a7cf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129574.242167:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4f8fc00/0x40a459093b06a7cf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129574.242171:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4f8fc00/0x40a459093b06a7cf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129574.242179:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b4f8fc00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:1.0:1746129574.242181:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4f8fc00/0x40a459093b06a7cf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129574.242186:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4f8fc00/0x40a459093b06a7cf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129574.242192:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009cffed00) 00010000:00010000:1.0:1746129574.242194:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129574.242196:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4f8fc00/0x40a459093b06a7cf lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129574.242200:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4f8fc00/0x40a459093b06a7cf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129574.242229:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f845200/0x40a459093b06a7c1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2168a expref: 12 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129574.242238:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4f8f600/0x40a459093b06a7d6 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2168a expref: 11 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129574.242244:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:1.0:1746129574.242246:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746129574.242248:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4f8f600, rc 0) 00000100:00100000:1.0:1746129574.242281:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a64d5850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+11:32408:x1830948734224256:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 513us (1145us total) trans 8589945370 rc 0/0 00000100:00100000:1.0:1746129574.242317:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11270 00000100:00100000:0.0:1746129574.246674:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129574.248320:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734224512 00000100:00100000:1.0:1746129574.248330:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734224512 00000100:00100000:1.0:1746129574.248374:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4791 00000100:00100000:1.0:1746129574.248381:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800903a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:068dab75-d300-4ead-a742-d14572ad1e50+11:32402:x1830948734224512:12345-192.168.202.4@tcp:35:lfs.0 00000100:00100000:1.0:1746129574.248584:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800903a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:068dab75-d300-4ead-a742-d14572ad1e50+12:32402:x1830948734224512:12345-192.168.202.4@tcp:35:lfs.0 Request processed in 204us (1921us total) trans 8589945371 rc 0/0 00000100:00100000:1.0:1746129574.248591:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4791 00000100:00100000:2.0:1746129574.255789:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129574.255822:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734224640 00000100:00100000:2.0:1746129574.255830:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734224640 00000100:00100000:2.0:1746129574.255876:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16426 00000100:00100000:2.0:1746129574.255883:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e388380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+29:32408:x1830948734224640:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:2.0:1746129574.255903:0:4385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129574.255922:0:4385:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a6de8000/0x40a459093b06a7e4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21691 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746129574.255949:0:4385:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3f4:0x0] initial LVB size: 2097152, mtime: 0x6813d2a6, atime: 0x6813d2a3, ctime: 0x6813d2a6, blocks: 0x81f 00010000:00010000:2.0:1746129574.255970:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129574.255972:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129574.255978:0:4385:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6de8000/0x40a459093b06a7e4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1748992->1892351) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21691 expref: 30 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129574.255992:0:4385:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a6de8000/0x40a459093b06a7e4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1748992->1892351) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21691 expref: 30 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129574.256001:0:4385:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6de8000, rc 0) 00000100:00100000:2.0:1746129574.256058:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e388380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+30:32408:x1830948734224640:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 174us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129574.256064:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16426 00000100:00100000:0.0:1746129574.261639:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129574.261926:0:31523:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734224896 00000100:00100000:1.0:1746129574.261937:0:31523:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734224896 00002000:00100000:1.0:1746129574.261985:0:31523:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f4:0x0] (1748992->1753087) req@ffff8800903a0a80 x1830948734224896/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:315/0 lens 488/0 e 0 to 0 dl 1746129585 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129574.261996:0:31523:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800903a0a80 with x1830948734224896 ext(1748992->1753087) 00002000:00010000:1.0:1746129574.262002:0:31523:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800903a0a80 00000100:00100000:1.0:1746129574.262023:0:31523:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7905 00000100:00100000:1.0:1746129574.262031:0:31523:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800903a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+30:1961:x1830948734224896:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:1.0:1746129574.262868:0:31523:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800903a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+30:1961:x1830948734224896:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 170us (572us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746129574.262878:0:31523:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7905 00002000:00100000:1.0:1746129574.262885:0:31523:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f4:0x0] (1748992->1753087) req@ffff8800903a0a80 x1830948734224896/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:315/0 lens 488/4536 e 0 to 0 dl 1746129585 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129574.262893:0:31523:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800903a0a80 with x1830948734224896 ext(1748992->1753087) 00002000:00010000:1.0:1746129574.262896:0:31523:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800903a0a80 00000100:00100000:2.0:1746129574.280069:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129574.280342:0:31523:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734225152 00000100:00100000:1.0:1746129574.280352:0:31523:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734225152 00002000:00100000:1.0:1746129574.280401:0:31523:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f4:0x0] (1888256->1892351) req@ffff88012e389f80 x1830948734225152/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:315/0 lens 488/0 e 0 to 0 dl 1746129585 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129574.280417:0:31523:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e389f80 with x1830948734225152 ext(1888256->1892351) 00002000:00010000:1.0:1746129574.280423:0:31523:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e389f80 00000100:00100000:1.0:1746129574.280450:0:31523:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7906 00000100:00100000:1.0:1746129574.280458:0:31523:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e389f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+30:1962:x1830948734225152:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:1.0:1746129574.280657:0:31523:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e389f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+30:1962:x1830948734225152:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 199us (595us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746129574.280664:0:31523:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7906 00002000:00100000:1.0:1746129574.280670:0:31523:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f4:0x0] (1888256->1892351) req@ffff88012e389f80 x1830948734225152/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:315/0 lens 488/4536 e 0 to 0 dl 1746129585 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129574.280677:0:31523:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e389f80 with x1830948734225152 ext(1888256->1892351) 00002000:00010000:1.0:1746129574.280680:0:31523:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e389f80 00000100:00100000:1.0:1746129574.285280:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129574.285377:0:20861:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734225408 00000100:00100000:0.0:1746129574.285388:0:20861:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734225408 00000100:00100000:0.0:1746129574.285440:0:20861:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4792 00000100:00100000:0.0:1746129574.285451:0:20861:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135724e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+11:32408:x1830948734225408:12345-192.168.202.4@tcp:35:multiop.0 00000100:00100000:0.0:1746129574.285930:0:20861:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135724e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+12:32408:x1830948734225408:12345-192.168.202.4@tcp:35:multiop.0 Request processed in 478us (656us total) trans 8589945372 rc 0/0 00000100:00100000:0.0:1746129574.285938:0:20861:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4792 00000001:00080000:2.0:1746129574.304565:0:2276:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874142 is committed 00000001:00080000:2.0:1746129574.304589:0:2276:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874126 is committed 00000001:00080000:2.0:1746129574.304652:0:2276:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874093 is committed 00000001:00080000:2.0:1746129574.304671:0:2276:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874145 is committed 00000001:00080000:2.0:1746129574.304677:0:2276:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874144 is committed 00000001:00080000:2.0:1746129574.304684:0:2276:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874128 is committed 00000001:00080000:2.0:1746129574.304701:0:2276:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874121 is committed 00000100:00100000:0.0:1746129574.310598:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129574.310726:0:16908:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734225664 00000100:00100000:1.0:1746129574.310735:0:16908:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734225664 00000100:00100000:1.0:1746129574.310798:0:16908:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11271 00000100:00100000:1.0:1746129574.310807:0:16908:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800903a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+12:32414:x1830948734225664:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129574.310832:0:16908:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129574.310853:0:16908:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3a4200/0x40a459093b06a7eb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21698 expref: -99 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129574.310953:0:16908:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3a4a00/0x40a459093b06a7f2 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129574.310967:0:16908:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3a4a00/0x40a459093b06a7f2 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129574.310982:0:16908:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3a4a00/0x40a459093b06a7f2 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00000004:00200000:1.0:1746129574.310993:0:16908:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:1.0:1746129574.311113:0:16908:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3a4200/0x40a459093b06a7eb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21698 expref: 15 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129574.311130:0:16908:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3a4a00/0x40a459093b06a7f2 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21698 expref: 14 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129574.311139:0:16908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:1.0:1746129574.311141:0:16908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1746129574.311144:0:16908:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e3a4a00, rc 0) 00000100:00100000:1.0:1746129574.311204:0:16908:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800903a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+14:32414:x1830948734225664:12345-192.168.202.4@tcp:101:cat.0 Request processed in 398us (617us total) trans 8589945373 rc 0/0 00000100:00100000:1.0:1746129574.311210:0:16908:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11271 00000100:00100000:0.0:1746129574.315184:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129574.315249:0:8411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734225792 00000100:00100000:2.0:1746129574.315259:0:8411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734225792 00000100:00100000:2.0:1746129574.315349:0:8411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16427 00000100:00100000:2.0:1746129574.315358:0:8411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800903a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+18:1963:x1830948734225792:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129574.315378:0:8411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129574.315399:0:8411:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a6de9600/0x40a459093b06a800 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2169f expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746129574.315424:0:8411:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3ec:0x0] initial LVB size: 1048576, mtime: 0x6813d2a5, atime: 0x6813d2a3, ctime: 0x6813d2a5, blocks: 0x819 00010000:00010000:2.0:1746129574.315443:0:8411:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129574.315445:0:8411:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129574.315454:0:8411:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6de9600/0x40a459093b06a800 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2169f expref: 19 pid: 8411 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129574.315468:0:8411:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a6de9600/0x40a459093b06a800 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2169f expref: 19 pid: 8411 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129574.315478:0:8411:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6de9600, rc 0) 00000100:00100000:2.0:1746129574.315529:0:8411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800903a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+19:1963:x1830948734225792:12345-192.168.202.4@tcp:101:cat.0 Request processed in 171us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129574.315534:0:8411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16427 00000100:00100000:0.0:1746129574.317624:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129574.317658:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129574.317684:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129574.317709:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129574.317786:0:22481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734226048 00000100:00100000:1.0:1746129574.317795:0:22481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734226048 00000100:00100000:1.0:1746129574.317832:0:22481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734226304 00000100:00100000:1.0:1746129574.317835:0:22481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734226304 00000100:00100000:1.0:1746129574.317846:0:22481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734225920 00000100:00100000:1.0:1746129574.317847:0:22481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734225920 00000100:00100000:0.0:1746129574.319070:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734226176 00000100:00100000:0.0:1746129574.319081:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734226176 00000100:00100000:1.0:1746129574.319095:0:22481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16428 00000100:00100000:2.0:1746129574.319102:0:8411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16429 00000100:00100000:1.0:1746129574.319106:0:22481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800903a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:1962:x1830948734226048:12345-192.168.202.4@tcp:101:cat.0 00000100:00100000:2.0:1746129574.319111:0:8411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800903a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+11:1962:x1830948734226304:12345-192.168.202.4@tcp:101:cat.0 00000100:00100000:0.0:1746129574.319121:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16430 00010000:00010000:2.0:1746129574.319124:0:8411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129574.319124:0:22481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746129574.319128:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800903a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+11:1962:x1830948734225920:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129574.319136:0:7148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129574.319142:0:8411:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a6de9800/0x40a459093b06a80e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f216bb expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129574.319142:0:22481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e3a4000/0x40a459093b06a807 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f216ad expref: -99 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129574.319145:0:7148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fab5000/0x40a459093b06a815 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f216a6 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746129574.319167:0:8411:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3f5:0x0] initial LVB size: 4194304, mtime: 0x6813d2a6, atime: 0x6813d2a6, ctime: 0x6813d2a6, blocks: 0x1029 00002000:00010000:0.0:1746129574.319167:0:7148:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3f3:0x0] initial LVB size: 2097152, mtime: 0x6813d2a6, atime: 0x6813d2a3, ctime: 0x6813d2a6, blocks: 0x821 00010000:00010000:2.0:1746129574.319176:0:8411:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129574.319178:0:8411:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129574.319178:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129574.319179:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129574.319186:0:8411:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6de9800/0x40a459093b06a80e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f216bb expref: 13 pid: 8411 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129574.319186:0:7148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fab5000/0x40a459093b06a815 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f216a6 expref: 13 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129574.319198:0:8411:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a6de9800/0x40a459093b06a80e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f216bb expref: 13 pid: 8411 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129574.319199:0:7148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fab5000/0x40a459093b06a815 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f216a6 expref: 13 pid: 7148 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746129574.319202:0:22481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135725f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:22481:1830948737556096:192.168.202.4@tcp:106: 00010000:00010000:2.0:1746129574.319207:0:8411:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6de9800, rc 0) 00010000:00010000:0.0:1746129574.319207:0:7148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fab5000, rc 0) 00000100:00100000:0.0:1746129574.319260:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800903a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+13:1962:x1830948734225920:12345-192.168.202.4@tcp:101:cat.0 Request processed in 132us (1575us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129574.319267:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16430 00000100:00100000:0.0:1746129574.319320:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16431 00000100:00100000:0.0:1746129574.319326:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800903a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:1962:x1830948734226176:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129574.319337:0:7148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129574.319345:0:7148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fab4400/0x40a459093b06a81c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f216b4 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746129574.319361:0:7148:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3ef:0x0] initial LVB size: 5146336, mtime: 0x6813d2a6, atime: 0x6813d2a5, ctime: 0x6813d2a6, blocks: 0x1791 00010000:00010000:0.0:1746129574.319369:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129574.319370:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129574.319374:0:7148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fab4400/0x40a459093b06a81c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f216b4 expref: 22 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129574.319383:0:7148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fab4400/0x40a459093b06a81c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f216b4 expref: 22 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129574.319390:0:7148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fab4400, rc 0) 00000100:00100000:2.0:1746129574.319486:0:8411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800903a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+12:1962:x1830948734226304:12345-192.168.202.4@tcp:101:cat.0 Request processed in 376us (1825us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129574.319492:0:8411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16429 00000100:00100000:1.0:1746129574.320053:0:22481:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4123d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746129574.320054:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800903a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+22:1962:x1830948734226176:12345-192.168.202.4@tcp:101:cat.0 Request processed in 724us (2340us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129574.320065:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16431 00000100:00100000:1.0:1746129574.327264:0:22481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135725f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:22481:1830948737556096:192.168.202.4@tcp:106: 00010000:00010000:1.0:1746129574.327346:0:22481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012e3a4000/0x40a459093b06a807 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f216ad expref: 21 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129574.327362:0:22481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e3a4000/0x40a459093b06a807 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f216ad expref: 21 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129574.327381:0:22481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e3a4000, rc 0) 00000100:00100000:1.0:1746129574.327444:0:22481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800903a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:1962:x1830948734226048:12345-192.168.202.4@tcp:101:cat.0 Request processed in 8339us (9828us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129574.327453:0:22481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16428 00000100:00100000:0.0:1746129574.344440:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129574.344555:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734226560 00000100:00100000:2.0:1746129574.344565:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734226560 00000100:00100000:2.0:1746129574.344622:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11272 00000100:00100000:2.0:1746129574.344630:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800903a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ada2ffba-8920-4ecb-8068-68caa9806978+294:32418:x1830948734226560:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129574.344655:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129574.344673:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6de8400/0x40a459093b06a823 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f216c2 expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129574.344789:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6de9a00/0x40a459093b06a82a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129574.344803:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6de9a00/0x40a459093b06a82a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129574.344814:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6de9a00/0x40a459093b06a82a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129574.344826:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6de9e00/0x40a459093b06a831 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129574.344832:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6de9e00/0x40a459093b06a831 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129574.344837:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6de9e00/0x40a459093b06a831 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129574.344932:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6de9000/0x40a459093b06a838 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129574.344939:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6de9000/0x40a459093b06a838 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129574.344943:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6de9000/0x40a459093b06a838 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00200000:2.0:1746129574.344951:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:2.0:1746129574.345025:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6de9a00/0x40a459093b06a82a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129574.345030:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6de9a00/0x40a459093b06a82a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129574.345036:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6de9a00/0x40a459093b06a82a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129574.345040:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a6de9a00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746129574.345043:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6de9a00/0x40a459093b06a82a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129574.345048:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6de9a00/0x40a459093b06a82a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129574.345059:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880132ef8f00) 00010000:00010000:2.0:1746129574.345062:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129574.345066:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6de9a00/0x40a459093b06a82a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129574.345070:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6de9a00/0x40a459093b06a82a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129574.345085:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6de9e00/0x40a459093b06a831 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129574.345088:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6de9e00/0x40a459093b06a831 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129574.345092:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6de9e00/0x40a459093b06a831 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129574.345096:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a6de9e00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746129574.345099:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6de9e00/0x40a459093b06a831 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129574.345102:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6de9e00/0x40a459093b06a831 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129574.345106:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f0e7400) 00010000:00010000:2.0:1746129574.345108:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129574.345109:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6de9e00/0x40a459093b06a831 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129574.345113:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6de9e00/0x40a459093b06a831 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129574.345146:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6de8400/0x40a459093b06a823 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f216c2 expref: 297 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129574.345159:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6de9000/0x40a459093b06a838 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f216c2 expref: 296 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129574.345164:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:2.0:1746129574.345165:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746129574.345167:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6de9000, rc 0) 00000100:00100000:2.0:1746129574.345212:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800903a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ada2ffba-8920-4ecb-8068-68caa9806978+296:32418:x1830948734226560:12345-192.168.202.4@tcp:101:cat.0 Request processed in 584us (784us total) trans 8589945374 rc 0/0 00000100:00100000:2.0:1746129574.345217:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11272 00000100:00100000:0.0:1746129574.348004:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129574.348249:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129574.348337:0:31523:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734227072 00000100:00100000:1.0:1746129574.348346:0:31523:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734227072 00002000:00100000:1.0:1746129574.348390:0:31523:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f4:0x0] (1048576->2097151) req@ffff8800903a2680 x1830948734227072/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:315/0 lens 504/0 e 0 to 0 dl 1746129585 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129574.348400:0:31523:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800903a2680 with x1830948734227072 ext(1048576->2097151) 00002000:00010000:1.0:1746129574.348405:0:31523:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800903a2680 00000100:00100000:1.0:1746129574.348433:0:31523:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734226944 00000100:00100000:1.0:1746129574.348434:0:31523:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734226944 00002000:00100000:1.0:1746129574.348442:0:31523:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff8800903a1500 x1830948734226944/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:315/0 lens 488/0 e 0 to 0 dl 1746129585 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129574.348448:0:31523:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800903a1500 with x1830948734226944 ext(1048576->2097151) 00002000:00010000:1.0:1746129574.348453:0:31523:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800903a1500 00000100:00100000:3.0:1746129574.349569:0:31522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7907 00000100:00100000:3.0:1746129574.349584:0:31522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800903a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+13:1963:x1830948734227072:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:1.0:1746129574.349614:0:31523:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7908 00000100:00100000:1.0:1746129574.349623:0:31523:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800903a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+13:1963:x1830948734226944:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129574.353422:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129574.353478:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734227328 00000100:00100000:2.0:1746129574.353487:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734227328 00002000:00100000:2.0:1746129574.353533:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ec:0x0] (0->1048575) req@ffff8800903a3480 x1830948734227328/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:315/0 lens 488/0 e 0 to 0 dl 1746129585 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129574.353543:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800903a3480 with x1830948734227328 ext(0->1048575) 00002000:00010000:2.0:1746129574.353548:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800903a3480 00000100:00100000:2.0:1746129574.353572:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7909 00000100:00100000:2.0:1746129574.353580:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800903a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:1960:x1830948734227328:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129574.358729:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129574.358768:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129574.358805:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129574.358822:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129574.358843:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129574.358885:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734227456 00000100:00100000:0.0:1746129574.358894:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734227456 00000100:00100000:0.0:1746129574.358952:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734227712 00000100:00100000:0.0:1746129574.358954:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734227712 00000100:00100000:0.0:1746129574.358968:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734227968 00000100:00100000:0.0:1746129574.358970:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734227968 00000100:00100000:0.0:1746129574.358978:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734227584 00000100:00100000:0.0:1746129574.358980:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734227584 00000100:00100000:0.0:1746129574.358989:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734227840 00000100:00100000:0.0:1746129574.358991:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734227840 00000100:00100000:0.0:1746129574.359008:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16432 00000100:00100000:0.0:1746129574.359016:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800903a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ada2ffba-8920-4ecb-8068-68caa9806978+37:1963:x1830948734227456:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129574.359036:0:7148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129574.359056:0:7148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800946f0600/0x40a459093b06a846 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f216c9 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129574.359080:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129574.359082:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129574.359091:0:7148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800946f0600/0x40a459093b06a846 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f216c9 expref: 38 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129574.359107:0:7148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800946f0600/0x40a459093b06a846 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f216c9 expref: 38 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129574.359118:0:7148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800946f0600, rc 0) 00000100:00100000:0.0:1746129574.359163:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800903a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ada2ffba-8920-4ecb-8068-68caa9806978+38:1963:x1830948734227456:12345-192.168.202.4@tcp:101:cat.0 Request processed in 147us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129574.359169:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16432 00000100:00100000:0.0:1746129574.359187:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16433 00000100:00100000:0.0:1746129574.359192:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800903a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ada2ffba-8920-4ecb-8068-68caa9806978+21:1963:x1830948734227712:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129574.359200:0:7148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129574.359210:0:7148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800946f1800/0x40a459093b06a84d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f216d7 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129574.359227:0:20577:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16434 00000100:00100000:0.0:1746129574.359251:0:7148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013575c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:7148:1830948737556224:192.168.202.4@tcp:106: 00000100:00100000:0.0:1746129574.359344:0:7148:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a00c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746129574.359370:0:11014:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16435 00000100:00100000:0.0:1746129574.359375:0:11014:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136014e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ada2ffba-8920-4ecb-8068-68caa9806978+22:1963:x1830948734227584:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129574.359381:0:11014:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129574.359388:0:11014:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800946f0200/0x40a459093b06a854 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f216d0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129574.359398:0:11014:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129574.359399:0:11014:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129574.359403:0:11014:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800946f0200/0x40a459093b06a854 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f216d0 expref: 23 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129574.359417:0:11014:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800946f0200/0x40a459093b06a854 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f216d0 expref: 23 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129574.359424:0:11014:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800946f0200, rc 0) 00000100:00100000:0.0:1746129574.359440:0:11014:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136014e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ada2ffba-8920-4ecb-8068-68caa9806978+23:1963:x1830948734227584:12345-192.168.202.4@tcp:101:cat.0 Request processed in 65us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129574.359449:0:11014:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16435 00000100:00100000:2.0:1746129574.359459:0:20577:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136015880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ada2ffba-8920-4ecb-8068-68caa9806978+22:1963:x1830948734227968:12345-192.168.202.4@tcp:101:cat.0 00000100:00100000:0.0:1746129574.359460:0:11014:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16436 00000100:00100000:0.0:1746129574.359464:0:11014:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136015180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ada2ffba-8920-4ecb-8068-68caa9806978+37:1963:x1830948734227840:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129574.359466:0:20577:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129574.359470:0:11014:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129574.359474:0:20577:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a6de9400/0x40a459093b06a85b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f216e5 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129574.359476:0:11014:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800946f1000/0x40a459093b06a862 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f216de expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129574.359485:0:11014:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129574.359486:0:20577:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129574.359487:0:11014:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129574.359488:0:20577:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129574.359490:0:11014:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800946f1000/0x40a459093b06a862 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f216de expref: 38 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129574.359493:0:20577:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6de9400/0x40a459093b06a85b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f216e5 expref: 23 pid: 20577 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129574.359498:0:11014:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800946f1000/0x40a459093b06a862 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f216de expref: 38 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129574.359502:0:20577:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a6de9400/0x40a459093b06a85b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f216e5 expref: 23 pid: 20577 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129574.359504:0:11014:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800946f1000, rc 0) 00010000:00010000:2.0:1746129574.359510:0:20577:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6de9400, rc 0) 00000100:00100000:0.0:1746129574.359519:0:11014:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136015180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ada2ffba-8920-4ecb-8068-68caa9806978+38:1963:x1830948734227840:12345-192.168.202.4@tcp:101:cat.0 Request processed in 55us (676us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129574.359524:0:11014:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16436 00000100:00100000:2.0:1746129574.359528:0:20577:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136015880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ada2ffba-8920-4ecb-8068-68caa9806978+23:1963:x1830948734227968:12345-192.168.202.4@tcp:101:cat.0 Request processed in 76us (723us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129574.359534:0:20577:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16434 00000100:00100000:3.0:1746129574.364442:0:31522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800903a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+14:1963:x1830948734227072:12345-192.168.202.4@tcp:3:cat.0 Request processed in 14851us (16437us total) trans 0 rc 905216/905216 00000100:00100000:3.0:1746129574.364456:0:31522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7907 00002000:00100000:3.0:1746129574.364469:0:31522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f4:0x0] (1048576->2097151) req@ffff8800903a2680 x1830948734227072/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:315/0 lens 504/440 e 0 to 0 dl 1746129585 ref 1 fl Complete:/200/0 rc 905216/905216 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129574.364479:0:31522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800903a2680 with x1830948734227072 ext(1048576->2097151) 00002000:00010000:3.0:1746129574.364485:0:31522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800903a2680 00002000:00010000:1.0:1746129574.367242:0:7148:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb mtime: 1746129574 -> 1746129575 00002000:00010000:1.0:1746129574.367249:0:7148:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb atime: 1746129571 -> 1746129575 00002000:00010000:1.0:1746129574.367251:0:7148:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb ctime: 1746129574 -> 1746129575 00000100:00100000:1.0:1746129574.367278:0:7148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013575c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:7148:1830948737556224:192.168.202.4@tcp:106: 00010000:00010000:1.0:1746129574.367336:0:7148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800946f1800/0x40a459093b06a84d lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f216d7 expref: 22 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129574.367351:0:7148:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800946f1800/0x40a459093b06a84d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f216d7 expref: 22 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129574.367376:0:7148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800946f1800, rc 0) 00000100:00100000:1.0:1746129574.367442:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800903a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ada2ffba-8920-4ecb-8068-68caa9806978+21:1963:x1830948734227712:12345-192.168.202.4@tcp:101:cat.0 Request processed in 8247us (8671us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129574.367452:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16433 00000100:00100000:0.0:1746129574.374280:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129574.375002:0:16908:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734228224 00000100:00100000:1.0:1746129574.375013:0:16908:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734228224 00000100:00100000:1.0:1746129574.375067:0:16908:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11273 00000100:00100000:1.0:1746129574.375075:0:16908:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013575e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ada2ffba-8920-4ecb-8068-68caa9806978+296:32420:x1830948734228224:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:1.0:1746129574.375534:0:16908:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129574.375554:0:16908:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3a5000/0x40a459093b06a869 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f216ec expref: -99 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129574.376006:0:16908:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3a5c00/0x40a459093b06a870 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129574.376026:0:16908:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4f8f600/0x40a459093b06a7d6 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2168a expref: 13 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129574.376033:0:16908:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6de9000/0x40a459093b06a838 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f216c2 expref: 297 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129574.376040:0:16908:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3a5c00/0x40a459093b06a870 lrc: 5/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129574.376083:0:16908:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6de9000/0x40a459093b06a838 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f216c2 expref: 297 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129574.376097:0:16908:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6de9000/0x40a459093b06a838 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f216c2 expref: 297 pid: 14549 timeout: 929 lvb_type: 0 00000100:00100000:1.0:1746129574.376111:0:16908:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135725f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16908:1830948737556352:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129574.378265:0:16908:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4f8f600/0x40a459093b06a7d6 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2168a expref: 13 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129574.378280:0:16908:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4f8f600/0x40a459093b06a7d6 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2168a expref: 13 pid: 14549 timeout: 929 lvb_type: 0 00000100:00100000:1.0:1746129574.378322:0:16908:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135724a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16908:1830948737556480:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129574.379376:0:16908:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4123d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746129574.380413:0:31523:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800903a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+12:1963:x1830948734226944:12345-192.168.202.4@tcp:3:cat.0 Request processed in 30784us (32156us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129574.380425:0:31523:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7908 00002000:00100000:1.0:1746129574.380438:0:31523:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff8800903a1500 x1830948734226944/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:315/0 lens 488/440 e 0 to 0 dl 1746129585 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129574.380447:0:31523:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800903a1500 with x1830948734226944 ext(1048576->2097151) 00002000:00010000:1.0:1746129574.380452:0:31523:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800903a1500 00000100:00100000:0.0:1746129574.384083:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129574.384119:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800903a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:1960:x1830948734227328:12345-192.168.202.4@tcp:3:cat.0 Request processed in 30537us (30706us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129574.384132:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7909 00002000:00100000:2.0:1746129574.384144:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ec:0x0] (0->1048575) req@ffff8800903a3480 x1830948734227328/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:315/0 lens 488/440 e 0 to 0 dl 1746129585 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129574.384153:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800903a3480 with x1830948734227328 ext(0->1048575) 00000100:00100000:3.0:1746129574.384157:0:15749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734228736 00002000:00010000:2.0:1746129574.384159:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800903a3480 00000100:00100000:3.0:1746129574.384164:0:15749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734228736 00010000:00010000:3.0:1746129574.384194:0:15749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4f8f600/0x40a459093b06a7d6 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2168a expref: 14 pid: 14549 timeout: 929 lvb_type: 0 00000100:00100000:3.0:1746129574.384227:0:15749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8439 00000100:00100000:3.0:1746129574.384233:0:15749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013575ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+14:1961:x1830948734228736:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129574.384246:0:15749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129574.384252:0:15749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4f8f600/0x40a459093b06a7d6 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2168a expref: 14 pid: 14549 timeout: 929 lvb_type: 0 00000100:00100000:1.0:1746129574.384257:0:16908:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135725f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16908:1830948737556352:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129574.384261:0:15749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4f8f600/0x40a459093b06a7d6 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2168a expref: 14 pid: 14549 timeout: 929 lvb_type: 0 00000100:00100000:1.0:1746129574.384265:0:16908:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135724a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16908:1830948737556480:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129574.384319:0:15749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4f8f600/0x40a459093b06a7d6 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2168a expref: 14 pid: 14549 timeout: 929 lvb_type: 0 00010000:00010000:1.0:1746129574.384322:0:16908:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3a5c00/0x40a459093b06a870 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129574.384336:0:15749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:3.0:1746129574.384340:0:15749:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3a5c00/0x40a459093b06a870 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129574.384348:0:15749:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3a5c00/0x40a459093b06a870 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129574.384354:0:15749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129574.384468:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129574.384578:0:7086:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734228608 00000100:00100000:1.0:1746129574.384582:0:7086:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734228608 00010000:00010000:1.0:1746129574.384595:0:7086:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6de9000/0x40a459093b06a838 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f216c2 expref: 298 pid: 14549 timeout: 929 lvb_type: 0 00000100:00100000:3.0:1746129574.384627:0:15749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013575ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+13:1961:x1830948734228736:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 393us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129574.384627:0:7086:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8440 00000100:00100000:1.0:1746129574.384632:0:7086:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013575d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ada2ffba-8920-4ecb-8068-68caa9806978+298:1961:x1830948734228608:12345-192.168.202.4@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746129574.384633:0:15749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8439 00010000:00010000:1.0:1746129574.384639:0:7086:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129574.384643:0:7086:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6de9000/0x40a459093b06a838 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f216c2 expref: 298 pid: 14549 timeout: 929 lvb_type: 0 00010000:00010000:1.0:1746129574.384651:0:7086:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6de9000/0x40a459093b06a838 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f216c2 expref: 298 pid: 14549 timeout: 929 lvb_type: 0 00010000:00010000:1.0:1746129574.384663:0:7086:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6de9000/0x40a459093b06a838 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f216c2 expref: 298 pid: 14549 timeout: 929 lvb_type: 0 00010000:00010000:1.0:1746129574.384674:0:7086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:1.0:1746129574.384678:0:7086:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3a5c00/0x40a459093b06a870 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129574.384684:0:7086:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3a5c00/0x40a459093b06a870 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129574.384690:0:7086:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3a5c00/0x40a459093b06a870 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129574.384703:0:7086:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129574.384819:0:7086:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013575d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ada2ffba-8920-4ecb-8068-68caa9806978+297:1961:x1830948734228608:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 186us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129574.384824:0:7086:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8440 00010000:00010000:1.0:1746129574.384839:0:16908:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3a5c00/0x40a459093b06a870 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129574.384845:0:16908:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3a5c00/0x40a459093b06a870 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00000004:00200000:1.0:1746129574.384862:0:16908:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:1.0:1746129574.385003:0:16908:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3a5000/0x40a459093b06a869 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f216ec expref: 298 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129574.385015:0:16908:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3a5c00/0x40a459093b06a870 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f216ec expref: 297 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129574.385021:0:16908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:1.0:1746129574.385023:0:16908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746129574.385025:0:16908:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e3a5c00, rc 0) 00000100:00100000:1.0:1746129574.385064:0:16908:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013575e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ada2ffba-8920-4ecb-8068-68caa9806978+297:32420:x1830948734228224:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 9990us (10796us total) trans 8589945375 rc 0/0 00000100:00100000:1.0:1746129574.385074:0:16908:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11273 00000100:00100000:2.0:1746129574.387807:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129574.387903:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129574.387957:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734228864 00000100:00100000:0.0:1746129574.387968:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734228864 00002000:00100000:0.0:1746129574.388016:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff88012e389880 x1830948734228864/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:315/0 lens 488/0 e 0 to 0 dl 1746129585 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129574.388026:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e389880 with x1830948734228864 ext(1048576->2097151) 00002000:00010000:0.0:1746129574.388030:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e389880 00000100:00100000:0.0:1746129574.388053:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734228992 00000100:00100000:0.0:1746129574.388055:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734228992 00002000:00100000:0.0:1746129574.388065:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ec:0x0] (0->1048575) req@ffff88012e954700 x1830948734228992/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:315/0 lens 488/0 e 0 to 0 dl 1746129585 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129574.388072:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e954700 with x1830948734228992 ext(0->1048575) 00002000:00010000:0.0:1746129574.388074:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e954700 00000100:00100000:0.0:1746129574.388091:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7910 00000100:00100000:0.0:1746129574.388097:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e389880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+21:1963:x1830948734228864:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:3.0:1746129574.388169:0:31522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7911 00000100:00100000:3.0:1746129574.388176:0:31522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e954700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ada2ffba-8920-4ecb-8068-68caa9806978+38:1963:x1830948734228992:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129574.405943:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129574.412310:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734229120 00000100:00100000:1.0:1746129574.412326:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734229120 00000100:00100000:1.0:1746129574.412377:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16437 00000100:00100000:1.0:1746129574.412385:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013575d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:32414:x1830948734229120:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129574.412405:0:7148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129574.412424:0:7148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e3a4c00/0x40a459093b06a87e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f216f3 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129574.412460:0:7148:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095b5ee00/0x40a459093b06a7ba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1253376->1757183) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21683 expref: 39 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129574.412467:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129574.412468:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129574.412472:0:7148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e3a4c00/0x40a459093b06a87e lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f216f3 expref: 21 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129574.412506:0:7148:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095b5ee00/0x40a459093b06a7ba lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1253376->1757183) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21683 expref: 39 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129574.412517:0:7148:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095b5ee00/0x40a459093b06a7ba lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1253376->1757183) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21683 expref: 39 pid: 4699 timeout: 929 lvb_type: 0 00000100:00100000:1.0:1746129574.412529:0:7148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135724a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7148:1830948737556608:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129574.412621:0:7148:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4123d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746129574.412745:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e389880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+21:1963:x1830948734228864:12345-192.168.202.4@tcp:3:cat.0 Request processed in 24646us (24946us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129574.412755:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7910 00002000:00100000:2.0:1746129574.412765:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff88012e389880 x1830948734228864/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:315/0 lens 488/440 e 0 to 0 dl 1746129585 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129574.412775:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e389880 with x1830948734228864 ext(1048576->2097151) 00002000:00010000:2.0:1746129574.413052:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e389880 00000100:00100000:3.0:1746129574.421627:0:31522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e954700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ada2ffba-8920-4ecb-8068-68caa9806978+38:1963:x1830948734228992:12345-192.168.202.4@tcp:3:cat.0 Request processed in 33439us (33710us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129574.421639:0:31522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7911 00002000:00100000:3.0:1746129574.421667:0:31522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3ec:0x0] (0->1048575) req@ffff88012e954700 x1830948734228992/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:315/0 lens 488/440 e 0 to 0 dl 1746129585 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129574.421676:0:31522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e954700 with x1830948734228992 ext(0->1048575) 00002000:00010000:3.0:1746129574.421683:0:31522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e954700 00000100:00100000:0.0:1746129574.423968:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129574.424113:0:31522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734229248 00000100:00100000:3.0:1746129574.424123:0:31522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734229248 00002000:00100000:3.0:1746129574.424465:0:31522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3ee:0x0] (1253376->1757183) req@ffff88013575c700 x1830948734229248/t0(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:315/0 lens 488/0 e 0 to 0 dl 1746129585 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129574.424475:0:31522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013575c700 with x1830948734229248 ext(1253376->1757183) 00010000:00010000:3.0:1746129574.424484:0:31522:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880095b5ee00/0x40a459093b06a7ba lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1253376->1757183) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21683 expref: 38 pid: 4699 timeout: 929 lvb_type: 0 00010000:00010000:3.0:1746129574.424497:0:31522:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880095b5ee00/0x40a459093b06a7ba lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1253376->1757183) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21683 expref: 38 pid: 4699 timeout: 929 lvb_type: 0 00002000:00010000:3.0:1746129574.424504:0:31522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88013575c700 00000100:00100000:3.0:1746129574.424532:0:31522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2453 00000100:00100000:3.0:1746129574.424539:0:31522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013575c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ada2ffba-8920-4ecb-8068-68caa9806978+38:1963:x1830948734229248:12345-192.168.202.4@tcp:4:cat.0 00000100:00100000:1.0:1746129574.424664:0:7148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135724a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7148:1830948737556608:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129574.424697:0:7148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012e3a4c00/0x40a459093b06a87e lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f216f3 expref: 21 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129574.424714:0:7148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e3a4c00, rc 0) 00000100:00100000:1.0:1746129574.424767:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013575d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:32414:x1830948734229120:12345-192.168.202.4@tcp:101:cat.0 Request processed in 12382us (18833us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129574.424775:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16437 00000100:00100000:0.0:1746129574.425703:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129574.430593:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734229376 00000100:00100000:1.0:1746129574.430609:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734229376 00000100:00100000:1.0:1746129574.430676:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16438 00000100:00100000:1.0:1746129574.430685:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093edc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ada2ffba-8920-4ecb-8068-68caa9806978+21:32420:x1830948734229376:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:1.0:1746129574.430706:0:7148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129574.430725:0:7148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e3a5200/0x40a459093b06a885 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f216fa expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129574.430754:0:7148:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a6de8000/0x40a459093b06a7e4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1748992->1892351) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21691 expref: 11 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129574.430762:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129574.430764:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129574.430767:0:7148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e3a5200/0x40a459093b06a885 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1806336->2097151] (req 1806336->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f216fa expref: 22 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129574.430799:0:7148:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a6de8000/0x40a459093b06a7e4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1748992->1892351) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21691 expref: 11 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129574.430810:0:7148:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a6de8000/0x40a459093b06a7e4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1748992->1892351) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21691 expref: 11 pid: 4385 timeout: 929 lvb_type: 0 00000100:00100000:1.0:1746129574.430823:0:7148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135724a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:7148:1830948737556736:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129574.430916:0:7148:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4123d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746129574.442433:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129574.442468:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734229504 00000100:00100000:2.0:1746129574.442476:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734229504 00002000:00100000:2.0:1746129574.442522:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f4:0x0] (1748992->1892351) req@ffff88012e955c00 x1830948734229504/t0(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:315/0 lens 488/0 e 0 to 0 dl 1746129585 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129574.442531:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e955c00 with x1830948734229504 ext(1748992->1892351) 00010000:00010000:2.0:1746129574.442541:0:25745:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a6de8000/0x40a459093b06a7e4 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1748992->1892351) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21691 expref: 12 pid: 4385 timeout: 929 lvb_type: 0 00010000:00010000:2.0:1746129574.442552:0:25745:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a6de8000/0x40a459093b06a7e4 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1748992->1892351) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21691 expref: 12 pid: 4385 timeout: 929 lvb_type: 0 00002000:00010000:2.0:1746129574.442559:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012e955c00 00000100:00100000:2.0:1746129574.442582:0:21463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2454 00000100:00100000:2.0:1746129574.442589:0:21463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e955c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+12:1961:x1830948734229504:12345-192.168.202.4@tcp:4:cat.0 00000100:00100000:1.0:1746129574.442932:0:7148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135724a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:7148:1830948737556736:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129574.442958:0:7148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012e3a5200/0x40a459093b06a885 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1806336->2097151] (req 1806336->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f216fa expref: 22 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129574.442970:0:7148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e3a5200, rc 0) 00000100:00100000:1.0:1746129574.443007:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093edc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ada2ffba-8920-4ecb-8068-68caa9806978+22:32420:x1830948734229376:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 12323us (17307us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129574.443013:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16438 00000100:00100000:0.0:1746129574.449437:0:21463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e955c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+14:1961:x1830948734229504:12345-192.168.202.4@tcp:4:cat.0 Request processed in 6836us (7002us total) trans 17179874148 rc 0/0 00000100:00100000:0.0:1746129574.449450:0:21463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2454 00002000:00100000:0.0:1746129574.449462:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3f4:0x0] (1748992->1892351) req@ffff88012e955c00 x1830948734229504/t17179874148(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:315/0 lens 488/448 e 0 to 0 dl 1746129585 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129574.449471:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e955c00 with x1830948734229504 ext(1748992->1892351) 00010000:00010000:0.0:1746129574.449483:0:21463:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a6de8000/0x40a459093b06a7e4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1748992->1892351) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21691 expref: 14 pid: 4385 timeout: 929 lvb_type: 0 00010000:00010000:0.0:1746129574.449495:0:21463:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a6de8000/0x40a459093b06a7e4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1748992->1892351) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21691 expref: 14 pid: 4385 timeout: 929 lvb_type: 0 00002000:00010000:0.0:1746129574.449502:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012e955c00 00000100:00100000:3.0:1746129574.451607:0:31522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013575c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ada2ffba-8920-4ecb-8068-68caa9806978+40:1963:x1830948734229248:12345-192.168.202.4@tcp:4:cat.0 Request processed in 27057us (27640us total) trans 21474841397 rc 0/0 00000100:00100000:3.0:1746129574.451619:0:31522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2453 00002000:00100000:3.0:1746129574.451631:0:31522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3ee:0x0] (1253376->1757183) req@ffff88013575c700 x1830948734229248/t21474841397(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:315/0 lens 488/448 e 0 to 0 dl 1746129585 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129574.451639:0:31522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013575c700 with x1830948734229248 ext(1253376->1757183) 00010000:00010000:3.0:1746129574.451649:0:31522:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880095b5ee00/0x40a459093b06a7ba lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1253376->1757183) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21683 expref: 40 pid: 4699 timeout: 929 lvb_type: 0 00010000:00010000:3.0:1746129574.451665:0:31522:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880095b5ee00/0x40a459093b06a7ba lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1253376->1757183) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21683 expref: 40 pid: 4699 timeout: 929 lvb_type: 0 00002000:00010000:3.0:1746129574.451671:0:31522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88013575c700 00000100:00100000:2.0:1746129574.456053:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129574.456159:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129574.456227:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734229632 00000100:00100000:1.0:1746129574.456236:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734229632 00000100:00100000:1.0:1746129574.456309:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16439 00000100:00100000:1.0:1746129574.456317:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e954000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ada2ffba-8920-4ecb-8068-68caa9806978+22:32418:x1830948734229632:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129574.456336:0:7148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129574.456353:0:7148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e3a4e00/0x40a459093b06a88c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21701 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129574.456379:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129574.456384:0:7148:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e3a5200/0x40a459093b06a885 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [1806336->2097151] (req 1806336->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f216fa expref: 23 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129574.456390:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746129574.456392:0:7148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e3a4e00/0x40a459093b06a88c lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21701 expref: 23 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129574.456432:0:7148:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012e3a5200/0x40a459093b06a885 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [1806336->2097151] (req 1806336->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f216fa expref: 23 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129574.456443:0:7148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012e3a4e00/0x40a459093b06a88c lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21701 expref: 23 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129574.456451:0:7148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e3a4e00, rc 0) 00000100:00100000:1.0:1746129574.456490:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e954000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ada2ffba-8920-4ecb-8068-68caa9806978+23:32418:x1830948734229632:12345-192.168.202.4@tcp:101:cat.0 Request processed in 175us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129574.456495:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16439 00000100:00100000:0.0:1746129574.456732:0:7086:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734229760 00000100:00100000:0.0:1746129574.456737:0:7086:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734229760 00010000:00010000:0.0:1746129574.456757:0:7086:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6de8000/0x40a459093b06a7e4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1748992->1892351) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21691 expref: 14 pid: 4385 timeout: 929 lvb_type: 0 00000100:00100000:0.0:1746129574.456786:0:7086:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8441 00000100:00100000:0.0:1746129574.456792:0:7086:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6fd3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+14:1960:x1830948734229760:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129574.456804:0:7086:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129574.456826:0:7086:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a6de8000/0x40a459093b06a7e4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1748992->1892351) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21691 expref: 14 pid: 4385 timeout: 929 lvb_type: 0 00010000:00010000:0.0:1746129574.456836:0:7086:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a6de8000/0x40a459093b06a7e4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1748992->1892351) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21691 expref: 14 pid: 4385 timeout: 929 lvb_type: 0 00010000:00010000:0.0:1746129574.456853:0:7086:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a6de8000/0x40a459093b06a7e4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1748992->1892351) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21691 expref: 14 pid: 4385 timeout: 929 lvb_type: 0 00010000:00010000:0.0:1746129574.456874:0:7086:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129574.456875:0:7086:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129574.456880:0:7086:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e3a5200/0x40a459093b06a885 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1806336->2097151) gid 0 flags: 0x60080000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f216fa expref: 22 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129574.456890:0:7086:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e3a5200/0x40a459093b06a885 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1806336->2097151) gid 0 flags: 0x60080000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f216fa expref: 22 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129574.456910:0:7086:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012e3a5200/0x40a459093b06a885 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1806336->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f216fa expref: 22 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129574.456921:0:7086:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012e3a5200/0x40a459093b06a885 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1806336->2097151) gid 0 flags: 0x70000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f216fa expref: 22 pid: 7148 timeout: 929 lvb_type: 0 00000100:00100000:0.0:1746129574.456932:0:7086:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093eddf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7086:1830948737556992:192.168.202.4@tcp:105: 00000100:00100000:0.0:1746129574.457001:0:7086:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a00e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746129574.460094:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129574.462395:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734229888 00000100:00100000:2.0:1746129574.462409:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734229888 00010000:00010000:2.0:1746129574.462456:0:9823:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095b5ee00/0x40a459093b06a7ba lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1253376->1757183) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21683 expref: 40 pid: 4699 timeout: 929 lvb_type: 0 00000100:00100000:2.0:1746129574.462488:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8442 00000100:00100000:2.0:1746129574.462496:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093edfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ada2ffba-8920-4ecb-8068-68caa9806978+40:1962:x1830948734229888:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129574.462510:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746129574.462532:0:9823:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb mtime from disk: 1746129574 -> 1746129575 00010000:00010000:2.0:1746129574.462538:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095b5ee00/0x40a459093b06a7ba lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1253376->1757183) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21683 expref: 40 pid: 4699 timeout: 929 lvb_type: 0 00010000:00010000:2.0:1746129574.462550:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095b5ee00/0x40a459093b06a7ba lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1253376->1757183) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21683 expref: 40 pid: 4699 timeout: 929 lvb_type: 0 00010000:00010000:2.0:1746129574.462572:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095b5ee00/0x40a459093b06a7ba lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1253376->1757183) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21683 expref: 40 pid: 4699 timeout: 929 lvb_type: 0 00010000:00010000:2.0:1746129574.462591:0:9823:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129574.462593:0:9823:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129574.462600:0:9823:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012e3a4c00/0x40a459093b06a87e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f216f3 expref: 20 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129574.462608:0:9823:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e3a4c00/0x40a459093b06a87e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f216f3 expref: 20 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129574.462641:0:9823:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012e3a4c00/0x40a459093b06a87e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f216f3 expref: 20 pid: 7148 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129574.462653:0:9823:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e957b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9823:1830948737557120:192.168.202.4@tcp:105: 00000100:00100000:2.0:1746129574.465251:0:9823:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009cdf3600 going to sleep for 11 seconds 00000100:00100000:0.0:1746129574.466099:0:7086:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093eddf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7086:1830948737556992:192.168.202.4@tcp:105: 00010000:00010000:0.0:1746129574.466119:0:7086:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129574.466160:0:7086:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6fd3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+13:1960:x1830948734229760:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 9367us (9999us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129574.466172:0:7086:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8441 00000100:00100000:2.0:1746129574.466313:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129574.466377:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129574.466431:0:16908:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734230016 00000100:00100000:3.0:1746129574.466438:0:16908:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734230016 00000100:00100000:3.0:1746129574.466479:0:16908:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11274 00000100:00100000:3.0:1746129574.466485:0:16908:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:068dab75-d300-4ead-a742-d14572ad1e50+12:32421:x1830948734230016:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:3.0:1746129574.466506:0:16908:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129574.466523:0:16908:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a05bae00/0x40a459093b06a893 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21708 expref: -99 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129574.466582:0:16908:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a05bb200/0x40a459093b06a89a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129574.466594:0:16908:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a05bb200/0x40a459093b06a89a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129574.466605:0:16908:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a05bb200/0x40a459093b06a89a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129574.466615:0:16908:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a05bba00/0x40a459093b06a8a1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129574.466624:0:16908:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a05bba00/0x40a459093b06a8a1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129574.466629:0:16908:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a05bba00/0x40a459093b06a8a1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129574.466746:0:16908:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a05bb600/0x40a459093b06a8a8 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129574.466755:0:16908:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3a5c00/0x40a459093b06a870 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f216ec expref: 296 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129574.466761:0:16908:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a05bb600/0x40a459093b06a8a8 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129574.466789:0:16908:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3a5c00/0x40a459093b06a870 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f216ec expref: 296 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129574.466799:0:16908:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3a5c00/0x40a459093b06a870 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f216ec expref: 296 pid: 16908 timeout: 929 lvb_type: 0 00000100:00100000:3.0:1746129574.466810:0:16908:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bfb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16908:1830948737557248:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129574.466866:0:16908:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa381a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746129574.466880:0:31522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734230272 00000100:00100000:3.0:1746129574.466883:0:31522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734230272 00002000:00100000:3.0:1746129574.466909:0:31522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f4:0x0] (1806336->1810431) req@ffff88009fbac700 x1830948734230272/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:315/0 lens 488/0 e 0 to 0 dl 1746129585 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129574.466919:0:31522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbac700 with x1830948734230272 ext(1806336->1810431) 00010000:00010000:3.0:1746129574.466925:0:31522:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012e3a5200/0x40a459093b06a885 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1806336->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f216fa expref: 23 pid: 7148 timeout: 929 lvb_type: 0 00010000:00010000:3.0:1746129574.466935:0:31522:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012e3a5200/0x40a459093b06a885 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1806336->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f216fa expref: 23 pid: 7148 timeout: 929 lvb_type: 0 00002000:00010000:3.0:1746129574.466940:0:31522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fbac700 00000100:00100000:3.0:1746129574.466953:0:31522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2455 00000100:00100000:3.0:1746129574.466957:0:31522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ada2ffba-8920-4ecb-8068-68caa9806978+23:1962:x1830948734230272:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:3.0:1746129574.467080:0:31522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ada2ffba-8920-4ecb-8068-68caa9806978+23:1962:x1830948734230272:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 122us (702us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129574.467085:0:31522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2455 00002000:00100000:3.0:1746129574.467090:0:31522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f4:0x0] (1806336->1810431) req@ffff88009fbac700 x1830948734230272/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:315/0 lens 488/4536 e 0 to 0 dl 1746129585 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129574.467097:0:31522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbac700 with x1830948734230272 ext(1806336->1810431) 00010000:00010000:3.0:1746129574.467101:0:31522:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012e3a5200/0x40a459093b06a885 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1806336->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f216fa expref: 23 pid: 7148 timeout: 929 lvb_type: 0 00010000:00010000:3.0:1746129574.467108:0:31522:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012e3a5200/0x40a459093b06a885 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1806336->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f216fa expref: 23 pid: 7148 timeout: 929 lvb_type: 0 00002000:00010000:3.0:1746129574.467113:0:31522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fbac700 00000100:00100000:3.0:1746129574.468725:0:9823:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e957b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9823:1830948737557120:192.168.202.4@tcp:105: 00010000:00010000:3.0:1746129574.468746:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129574.469801:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093edfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ada2ffba-8920-4ecb-8068-68caa9806978+39:1962:x1830948734229888:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 7299us (9709us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129574.469814:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8442 00000100:00100000:0.0:1746129574.471504:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129574.472078:0:16908:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bfb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16908:1830948737557248:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129574.472107:0:16908:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a05bb600/0x40a459093b06a8a8 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00000100:00100000:2.0:1746129574.472255:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734230400 00000100:00100000:2.0:1746129574.472262:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734230400 00010000:00010000:2.0:1746129574.472330:0:9823:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3a5c00/0x40a459093b06a870 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f216ec expref: 297 pid: 16908 timeout: 929 lvb_type: 0 00000100:00100000:2.0:1746129574.472357:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8443 00000100:00100000:2.0:1746129574.472364:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093eddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ada2ffba-8920-4ecb-8068-68caa9806978+297:1961:x1830948734230400:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129574.472378:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129574.472383:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3a5c00/0x40a459093b06a870 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f216ec expref: 297 pid: 16908 timeout: 929 lvb_type: 0 00010000:00010000:2.0:1746129574.472392:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3a5c00/0x40a459093b06a870 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f216ec expref: 297 pid: 16908 timeout: 929 lvb_type: 0 00010000:00010000:2.0:1746129574.472412:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3a5c00/0x40a459093b06a870 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f216ec expref: 297 pid: 16908 timeout: 929 lvb_type: 0 00010000:00010000:2.0:1746129574.472441:0:9823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:2.0:1746129574.472446:0:9823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a05bb600/0x40a459093b06a8a8 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129574.472455:0:9823:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a05bb600/0x40a459093b06a8a8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129574.472461:0:9823:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a05bb600/0x40a459093b06a8a8 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129574.472478:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129574.472519:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093eddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ada2ffba-8920-4ecb-8068-68caa9806978+296:1961:x1830948734230400:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 155us (1023us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129574.472524:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8443 00010000:00010000:3.0:1746129574.473602:0:16908:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a05bb600/0x40a459093b06a8a8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129574.473614:0:16908:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a05bb600/0x40a459093b06a8a8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00000004:00200000:3.0:1746129574.473661:0:16908:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00000004:00200000:3.0:1746129574.473665:0:16908:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746129574.473683:0:16908:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a05bb600/0x40a459093b06a8a8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129574.473694:0:16908:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a05bb600/0x40a459093b06a8a8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129574.473703:0:16908:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a05bb200/0x40a459093b06a89a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129574.473709:0:16908:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a05bb200/0x40a459093b06a89a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129574.473715:0:16908:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a05bb200/0x40a459093b06a89a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129574.473721:0:16908:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a05bb200 already unused, calling callback (ffffffffa136e690) 00010000:00010000:3.0:1746129574.473724:0:16908:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a05bb200/0x40a459093b06a89a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129574.473730:0:16908:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a05bb200/0x40a459093b06a89a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129574.473743:0:16908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880132ef8f00) 00010000:00010000:3.0:1746129574.473746:0:16908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129574.473750:0:16908:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a05bb200/0x40a459093b06a89a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129574.473754:0:16908:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a05bb200/0x40a459093b06a89a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129574.473908:0:16908:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a05bba00/0x40a459093b06a8a1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129574.473913:0:16908:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a05bba00/0x40a459093b06a8a1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129574.473918:0:16908:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a05bba00/0x40a459093b06a8a1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129574.473922:0:16908:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a05bba00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:3.0:1746129574.473924:0:16908:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a05bba00/0x40a459093b06a8a1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129574.473928:0:16908:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a05bba00/0x40a459093b06a8a1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129574.473935:0:16908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880136997500) 00010000:00010000:3.0:1746129574.473937:0:16908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129574.473939:0:16908:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a05bba00/0x40a459093b06a8a1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129574.473943:0:16908:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a05bba00/0x40a459093b06a8a1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129574.475801:0:16908:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a05bae00/0x40a459093b06a893 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21708 expref: 14 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129574.475825:0:16908:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a05bb600/0x40a459093b06a8a8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21708 expref: 13 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129574.475832:0:16908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:3.0:1746129574.475835:0:16908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746129574.475839:0:16908:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a05bb600, rc 0) 00000100:00100000:3.0:1746129574.476696:0:16908:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:068dab75-d300-4ead-a742-d14572ad1e50+13:32421:x1830948734230016:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 10205us (10396us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129574.476705:0:16908:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11274 00010000:00010000:2.0:1746129574.479588:0:26224:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1746129574.481169:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129574.481477:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129574.481520:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129574.481637:0:22481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734230912 00000100:00100000:3.0:1746129574.481647:0:22481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734230912 00000100:00100000:3.0:1746129574.481759:0:22481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16440 00000100:00100000:3.0:1746129574.481768:0:22481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135725f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ada2ffba-8920-4ecb-8068-68caa9806978+39:32420:x1830948734230912:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:3.0:1746129574.481788:0:22481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129574.481806:0:22481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b3be000/0x40a459093b06a8af lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2170f expref: -99 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129574.481837:0:22481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012e3a4c00/0x40a459093b06a87e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f216f3 expref: 20 pid: 7148 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129574.481838:0:21463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734230656 00000100:00100000:2.0:1746129574.481842:0:21463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734230656 00010000:00010000:3.0:1746129574.481844:0:22481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129574.481846:0:22481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129574.481849:0:22481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b3be000/0x40a459093b06a8af lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->1134591] (req 1048576->1134591) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2170f expref: 40 pid: 22481 timeout: 0 lvb_type: 0 00002000:00100000:2.0:1746129574.481873:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3ee:0x0] (1048576->2097151) req@ffff880135724a80 x1830948734230656/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:315/0 lens 488/0 e 0 to 0 dl 1746129585 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129574.481882:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135724a80 with x1830948734230656 ext(1048576->2097151) 00010000:00010000:3.0:1746129574.481884:0:22481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012e3a4c00/0x40a459093b06a87e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f216f3 expref: 21 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129574.481887:0:21463:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012e3a4c00/0x40a459093b06a87e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f216f3 expref: 21 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129574.481895:0:22481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012e3a4c00/0x40a459093b06a87e lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f216f3 expref: 21 pid: 7148 timeout: 929 lvb_type: 0 00010000:00010000:2.0:1746129574.481896:0:21463:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012e3a4c00/0x40a459093b06a87e lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f216f3 expref: 21 pid: 7148 timeout: 929 lvb_type: 0 00002000:00010000:2.0:1746129574.481902:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135724a80 00000100:00100000:3.0:1746129574.481907:0:22481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:22481:1830948737557376:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129574.481914:0:21463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734231040 00000100:00100000:2.0:1746129574.481916:0:21463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734231040 00002000:00100000:2.0:1746129574.481929:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3f4:0x0] (1806336->2097151) req@ffff880135724000 x1830948734231040/t0(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:315/0 lens 488/0 e 0 to 0 dl 1746129585 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129574.481935:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135724000 with x1830948734231040 ext(1806336->2097151) 00010000:00010000:2.0:1746129574.481940:0:21463:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012e3a5200/0x40a459093b06a885 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1806336->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f216fa expref: 23 pid: 7148 timeout: 929 lvb_type: 0 00010000:00010000:2.0:1746129574.481947:0:21463:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012e3a5200/0x40a459093b06a885 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1806336->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f216fa expref: 23 pid: 7148 timeout: 929 lvb_type: 0 00002000:00010000:2.0:1746129574.481951:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880135724000 00000100:00100000:2.0:1746129574.481976:0:21463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2456 00000100:00100000:2.0:1746129574.481981:0:21463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135724a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:1963:x1830948734230656:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:3.0:1746129574.482374:0:22481:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa381a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746129574.482473:0:31523:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2457 00000100:00100000:0.0:1746129574.482481:0:31523:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135724000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ada2ffba-8920-4ecb-8068-68caa9806978+23:1962:x1830948734231040:12345-192.168.202.4@tcp:4:multiop.0 00000100:00100000:1.0:1746129574.487249:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129574.488527:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129574.489274:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129574.489523:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129574.489541:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129574.489565:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129574.489712:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734231168 00000100:00100000:0.0:1746129574.489723:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734231168 00000100:00100000:0.0:1746129574.489739:0:8410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734231424 00000100:00100000:0.0:1746129574.489742:0:8410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734231424 00000100:00100000:0.0:1746129574.490325:0:8410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734231680 00000100:00100000:0.0:1746129574.490329:0:8410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734231680 00000100:00100000:0.0:1746129574.490342:0:8410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734231296 00000100:00100000:0.0:1746129574.490344:0:8410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734231296 00000100:00100000:0.0:1746129574.490353:0:8410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734231552 00000100:00100000:0.0:1746129574.490355:0:8410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734231552 00000100:00100000:0.0:1746129574.490363:0:8410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734231808 00000100:00100000:0.0:1746129574.490365:0:8410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734231808 00000100:00100000:0.0:1746129574.490379:0:8410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16441 00000100:00100000:0.0:1746129574.490386:0:8410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135724700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:068dab75-d300-4ead-a742-d14572ad1e50+7:1962:x1830948734231424:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:0.0:1746129574.490407:0:8410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129574.490427:0:8410:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b4e12e00/0x40a459093b06a8b6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21724 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129574.490484:0:8410:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136016300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8410:1830948737557504:192.168.202.4@tcp:106: 00000100:00100000:0.0:1746129574.490572:0:8410:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a00c00 going to sleep for 11 seconds 00000100:00100000:3.0:1746129574.490837:0:31503:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16442 00000100:00100000:3.0:1746129574.490845:0:31503:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135726a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:068dab75-d300-4ead-a742-d14572ad1e50+10:1962:x1830948734231680:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:3.0:1746129574.490854:0:31503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129574.490865:0:31503:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b3bfe00/0x40a459093b06a8bd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21732 expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129574.490880:0:31503:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129574.490882:0:31503:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129574.490891:0:31503:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b3bfe00/0x40a459093b06a8bd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21732 expref: 11 pid: 31503 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129574.490906:0:31503:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b3bfe00/0x40a459093b06a8bd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21732 expref: 11 pid: 31503 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129574.490917:0:31503:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b3bfe00, rc 0) 00000100:00100000:3.0:1746129574.490941:0:31503:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135726a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:068dab75-d300-4ead-a742-d14572ad1e50+11:1962:x1830948734231680:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 97us (1669us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129574.490947:0:31503:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16442 00000100:00100000:3.0:1746129574.490964:0:31503:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16443 00000100:00100000:3.0:1746129574.490968:0:31503:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135727b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:068dab75-d300-4ead-a742-d14572ad1e50+8:1962:x1830948734231296:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:3.0:1746129574.490974:0:31503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129574.490981:0:31503:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b3be800/0x40a459093b06a8c4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2171d expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129574.490990:0:31503:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129574.490991:0:31503:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129574.490995:0:31503:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b3be800/0x40a459093b06a8c4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2171d expref: 9 pid: 31503 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129574.491004:0:31503:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b3be800/0x40a459093b06a8c4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2171d expref: 9 pid: 31503 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129574.491011:0:31503:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b3be800, rc 0) 00000100:00100000:3.0:1746129574.491024:0:31503:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135727b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:068dab75-d300-4ead-a742-d14572ad1e50+9:1962:x1830948734231296:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 55us (1501us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129574.491028:0:31503:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16443 00000100:00100000:3.0:1746129574.491037:0:31503:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16444 00000100:00100000:3.0:1746129574.491041:0:31503:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135725500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:068dab75-d300-4ead-a742-d14572ad1e50+10:1962:x1830948734231552:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:3.0:1746129574.491046:0:31503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129574.491052:0:31503:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b3bf600/0x40a459093b06a8cb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2172b expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129574.491061:0:31503:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129574.491069:0:31503:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b3bf600/0x40a459093b06a8cb lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2172b expref: 11 pid: 31503 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129574.491077:0:31503:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b3bf600/0x40a459093b06a8cb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2172b expref: 11 pid: 31503 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129574.491090:0:31503:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b3bf600, rc 0) 00000100:00100000:3.0:1746129574.491102:0:31503:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135725500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:068dab75-d300-4ead-a742-d14572ad1e50+10:1962:x1830948734231552:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 61us (1560us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129574.491107:0:31503:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16444 00000100:00100000:3.0:1746129574.491116:0:31503:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16445 00000100:00100000:3.0:1746129574.491120:0:31503:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013577e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:068dab75-d300-4ead-a742-d14572ad1e50+8:1962:x1830948734231808:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:3.0:1746129574.491124:0:31503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129574.491130:0:31503:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095ff0000/0x40a459093b06a8d2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21739 expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129574.491138:0:31503:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129574.491139:0:31503:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129574.491144:0:31503:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095ff0000/0x40a459093b06a8d2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21739 expref: 9 pid: 31503 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129574.491151:0:31503:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095ff0000/0x40a459093b06a8d2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21739 expref: 9 pid: 31503 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129574.491158:0:31503:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095ff0000, rc 0) 00000100:00100000:3.0:1746129574.491171:0:31503:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013577e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:068dab75-d300-4ead-a742-d14572ad1e50+9:1962:x1830948734231808:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 51us (1606us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129574.491175:0:31503:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16445 00000100:00100000:2.0:1746129574.492677:0:22481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:22481:1830948737557376:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129574.492708:0:22481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b3be000/0x40a459093b06a8af lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->1134591] (req 1048576->1134591) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2170f expref: 40 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129574.492720:0:22481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b3be000, rc 0) 00000100:00100000:2.0:1746129574.492751:0:22481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135725f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ada2ffba-8920-4ecb-8068-68caa9806978+40:32420:x1830948734230912:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 10984us (11279us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129574.492758:0:22481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16440 00000100:00100000:0.0:1746129574.494808:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16446 00000100:00100000:0.0:1746129574.494817:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135727800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:068dab75-d300-4ead-a742-d14572ad1e50+9:1963:x1830948734231168:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:0.0:1746129574.494834:0:7148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129574.494852:0:7148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e3a5400/0x40a459093b06a8d9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21716 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129574.495399:0:21463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135724a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:1963:x1830948734230656:12345-192.168.202.4@tcp:3:cat.0 Request processed in 13415us (14238us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129574.495408:0:21463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2456 00002000:00100000:3.0:1746129574.495418:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3ee:0x0] (1048576->2097151) req@ffff880135724a80 x1830948734230656/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:315/0 lens 488/440 e 0 to 0 dl 1746129585 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129574.495427:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135724a80 with x1830948734230656 ext(1048576->2097151) 00010000:00010000:3.0:1746129574.495435:0:21463:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012e3a4c00/0x40a459093b06a87e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f216f3 expref: 21 pid: 7148 timeout: 929 lvb_type: 0 00010000:00010000:3.0:1746129574.495445:0:21463:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012e3a4c00/0x40a459093b06a87e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f216f3 expref: 21 pid: 7148 timeout: 929 lvb_type: 0 00002000:00010000:3.0:1746129574.495452:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135724a80 00010000:00010000:3.0:1746129574.496478:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129574.496481:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129574.496492:0:7148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e3a5400/0x40a459093b06a8d9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21716 expref: 10 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129574.496509:0:7148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012e3a5400/0x40a459093b06a8d9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21716 expref: 10 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129574.496523:0:7148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e3a5400, rc 0) 00000100:00100000:3.0:1746129574.496896:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135727800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:068dab75-d300-4ead-a742-d14572ad1e50+10:1963:x1830948734231168:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 2078us (9657us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129574.496905:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16446 00000100:00100000:0.0:1746129574.497258:0:8410:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136016300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8410:1830948737557504:192.168.202.4@tcp:106: 00010000:00010000:0.0:1746129574.497320:0:8410:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b4e12e00/0x40a459093b06a8b6 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21724 expref: 8 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129574.497332:0:8410:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b4e12e00/0x40a459093b06a8b6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21724 expref: 8 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129574.497357:0:8410:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4e12e00, rc 0) 00000100:00100000:0.0:1746129574.498265:0:8410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135724700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:068dab75-d300-4ead-a742-d14572ad1e50+7:1962:x1830948734231424:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 7875us (9739us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129574.498273:0:8410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16441 00000100:00100000:3.0:1746129574.502192:0:31523:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135724000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ada2ffba-8920-4ecb-8068-68caa9806978+25:1962:x1830948734231040:12345-192.168.202.4@tcp:4:multiop.0 Request processed in 19698us (20657us total) trans 17179874149 rc 0/0 00000100:00100000:3.0:1746129574.502206:0:31523:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2457 00002000:00100000:3.0:1746129574.502218:0:31523:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f4:0x0] (1806336->2097151) req@ffff880135724000 x1830948734231040/t17179874149(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:315/0 lens 488/448 e 0 to 0 dl 1746129585 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129574.502253:0:31523:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135724000 with x1830948734231040 ext(1806336->2097151) 00010000:00010000:3.0:1746129574.502265:0:31523:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012e3a5200/0x40a459093b06a885 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1806336->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f216fa expref: 25 pid: 7148 timeout: 929 lvb_type: 0 00010000:00010000:3.0:1746129574.502277:0:31523:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012e3a5200/0x40a459093b06a885 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1806336->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f216fa expref: 25 pid: 7148 timeout: 929 lvb_type: 0 00002000:00010000:3.0:1746129574.502306:0:31523:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880135724000 00000100:00100000:1.0:1746129574.505059:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129574.505100:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129574.505168:0:16908:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734232192 00000100:00100000:3.0:1746129574.505178:0:16908:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734232192 00000100:00100000:3.0:1746129574.505227:0:16908:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11275 00000100:00100000:3.0:1746129574.505235:0:16908:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136016300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:068dab75-d300-4ead-a742-d14572ad1e50+13:32421:x1830948734232192:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:3.0:1746129574.505255:0:16908:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746129574.505260:0:7086:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734231936 00000100:00100000:2.0:1746129574.505265:0:7086:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734231936 00010000:00010000:3.0:1746129574.505273:0:16908:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095ff0c00/0x40a459093b06a8e0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21740 expref: -99 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129574.505313:0:7086:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012e3a4c00/0x40a459093b06a87e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f216f3 expref: 21 pid: 7148 timeout: 929 lvb_type: 0 00000100:00100000:2.0:1746129574.505332:0:7086:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8444 00000100:00100000:2.0:1746129574.505337:0:7086:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013577ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:1961:x1830948734231936:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129574.505346:0:7086:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129574.505368:0:7086:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012e3a4c00/0x40a459093b06a87e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f216f3 expref: 21 pid: 7148 timeout: 929 lvb_type: 0 00010000:00010000:2.0:1746129574.505378:0:7086:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012e3a4c00/0x40a459093b06a87e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f216f3 expref: 21 pid: 7148 timeout: 929 lvb_type: 0 00010000:00010000:3.0:1746129574.505395:0:16908:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6de9a00/0x40a459093b06a8e7 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129574.505397:0:7086:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e3a4c00/0x40a459093b06a87e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f216f3 expref: 21 pid: 7148 timeout: 929 lvb_type: 0 00010000:00010000:3.0:1746129574.505408:0:16908:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a05bb600/0x40a459093b06a8a8 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21708 expref: 14 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129574.505415:0:16908:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6de9a00/0x40a459093b06a8e7 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129574.505421:0:7086:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129574.505423:0:7086:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129574.505430:0:7086:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b3be000/0x40a459093b06a8af lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1134591) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2170f expref: 39 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129574.505436:0:7086:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b3be000/0x40a459093b06a8af lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1134591) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2170f expref: 39 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129574.505443:0:16908:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a05bb600/0x40a459093b06a8a8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21708 expref: 14 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129574.505456:0:16908:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a05bb600/0x40a459093b06a8a8 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21708 expref: 14 pid: 16908 timeout: 929 lvb_type: 0 00010000:00010000:2.0:1746129574.505456:0:7086:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012b3be000/0x40a459093b06a8af lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1134591) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2170f expref: 39 pid: 22481 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129574.505467:0:16908:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bfb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16908:1830948737557632:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129574.505467:0:7086:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094f47100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7086:1830948737557760:192.168.202.4@tcp:105: 00000100:00100000:2.0:1746129574.506629:0:7086:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009cdf3b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746129574.506736:0:16908:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa381a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746129574.508917:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129574.508956:0:7086:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094f47100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7086:1830948737557760:192.168.202.4@tcp:105: 00010000:00010000:2.0:1746129574.508978:0:7086:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129574.509030:0:7086:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013577ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:1961:x1830948734231936:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 3691us (3983us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129574.509040:0:7086:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8444 00000100:00100000:2.0:1746129574.509860:0:7086:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734232320 00000100:00100000:2.0:1746129574.509868:0:7086:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734232320 00000100:00100000:1.0:1746129574.509891:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00010000:00010000:2.0:1746129574.509897:0:7086:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012e3a5200/0x40a459093b06a885 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1806336->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f216fa expref: 25 pid: 7148 timeout: 929 lvb_type: 0 00000100:00100000:2.0:1746129574.509918:0:7086:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8445 00000100:00100000:2.0:1746129574.509925:0:7086:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e389c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ada2ffba-8920-4ecb-8068-68caa9806978+25:1962:x1830948734232320:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129574.509936:0:7086:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746129574.509952:0:16908:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bfb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16908:1830948737557632:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129574.509957:0:7086:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012e3a5200/0x40a459093b06a885 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1806336->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f216fa expref: 25 pid: 7148 timeout: 929 lvb_type: 0 00010000:00010000:3.0:1746129574.509968:0:16908:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6de9a00/0x40a459093b06a8e7 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129574.509972:0:7086:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012e3a5200/0x40a459093b06a885 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1806336->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f216fa expref: 25 pid: 7148 timeout: 929 lvb_type: 0 00000100:00100000:3.0:1746129574.509992:0:31523:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734232576 00000100:00100000:3.0:1746129574.509995:0:31523:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734232576 00002000:00100000:3.0:1746129574.510024:0:31523:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3ee:0x0] (1130496->1134591) req@ffff88012b550380 x1830948734232576/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:315/0 lens 488/0 e 0 to 0 dl 1746129585 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129574.510032:0:31523:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b550380 with x1830948734232576 ext(1130496->1134591) 00002000:00010000:3.0:1746129574.510036:0:31523:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b550380 00000100:00100000:3.0:1746129574.510049:0:31523:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7912 00000100:00100000:3.0:1746129574.510053:0:31523:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b550380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ada2ffba-8920-4ecb-8068-68caa9806978+40:1961:x1830948734232576:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:3.0:1746129574.510200:0:31523:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b550380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ada2ffba-8920-4ecb-8068-68caa9806978+40:1961:x1830948734232576:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 145us (308us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129574.510205:0:31523:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7912 00002000:00100000:3.0:1746129574.510210:0:31523:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3ee:0x0] (1130496->1134591) req@ffff88012b550380 x1830948734232576/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:315/0 lens 488/4536 e 0 to 0 dl 1746129585 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129574.510216:0:31523:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b550380 with x1830948734232576 ext(1130496->1134591) 00002000:00010000:3.0:1746129574.510219:0:31523:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b550380 00010000:00010000:2.0:1746129574.510533:0:7086:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e3a5200/0x40a459093b06a885 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1806336->2097151) gid 0 flags: 0x44801000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f216fa expref: 25 pid: 7148 timeout: 929 lvb_type: 0 00010000:00010000:2.0:1746129574.510547:0:7086:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129574.510549:0:7086:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129574.510555:0:7086:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e3a4e00/0x40a459093b06a88c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21701 expref: 24 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129574.510562:0:7086:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e3a4e00/0x40a459093b06a88c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21701 expref: 24 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129574.510589:0:7086:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012e3a4e00/0x40a459093b06a88c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21701 expref: 24 pid: 7148 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129574.510598:0:7086:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094f47100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7086:1830948737557888:192.168.202.4@tcp:105: 00000100:00100000:2.0:1746129574.510655:0:7086:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009cdf3b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746129574.512189:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129574.512241:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734232704 00000100:00100000:2.0:1746129574.512249:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734232704 00010000:00010000:2.0:1746129574.512279:0:7087:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a05bb600/0x40a459093b06a8a8 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21708 expref: 15 pid: 16908 timeout: 929 lvb_type: 0 00000100:00100000:2.0:1746129574.512354:0:7087:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8446 00000100:00100000:2.0:1746129574.512361:0:7087:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e38bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:068dab75-d300-4ead-a742-d14572ad1e50+15:1962:x1830948734232704:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129574.512374:0:7087:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129574.512380:0:7087:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a05bb600/0x40a459093b06a8a8 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21708 expref: 15 pid: 16908 timeout: 929 lvb_type: 0 00010000:00010000:2.0:1746129574.512390:0:7087:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a05bb600/0x40a459093b06a8a8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21708 expref: 15 pid: 16908 timeout: 929 lvb_type: 0 00010000:00010000:2.0:1746129574.512407:0:7087:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a05bb600/0x40a459093b06a8a8 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21708 expref: 15 pid: 16908 timeout: 929 lvb_type: 0 00010000:00010000:2.0:1746129574.512420:0:7087:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:2.0:1746129574.512425:0:7087:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6de9a00/0x40a459093b06a8e7 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129574.512433:0:7087:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6de9a00/0x40a459093b06a8e7 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129574.512439:0:7087:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6de9a00/0x40a459093b06a8e7 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129574.512462:0:7087:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129574.512501:0:7087:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e38bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:068dab75-d300-4ead-a742-d14572ad1e50+14:1962:x1830948734232704:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 141us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129574.512507:0:7087:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8446 00010000:00010000:0.0:1746129574.513346:0:16908:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6de9a00/0x40a459093b06a8e7 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129574.513355:0:16908:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6de9a00/0x40a459093b06a8e7 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00000004:00200000:0.0:1746129574.513376:0:16908:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00000100:00100000:1.0:1746129574.513378:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129574.513453:0:20861:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734233088 00000100:00100000:2.0:1746129574.513457:0:20861:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734233088 00000100:00100000:2.0:1746129574.513484:0:20861:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4793 00000100:00100000:2.0:1746129574.513489:0:20861:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b553480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:ada2ffba-8920-4ecb-8068-68caa9806978+296:32420:x1830948734233088:12345-192.168.202.4@tcp:35:multiop.0 00000100:00100000:2.0:1746129574.513684:0:20861:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b553480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:ada2ffba-8920-4ecb-8068-68caa9806978+297:32420:x1830948734233088:12345-192.168.202.4@tcp:35:multiop.0 Request processed in 195us (305us total) trans 8589945376 rc 0/0 00000100:00100000:2.0:1746129574.513690:0:20861:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4793 00010000:00010000:0.0:1746129574.515209:0:16908:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095ff0c00/0x40a459093b06a8e0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21740 expref: 15 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129574.515244:0:16908:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6de9a00/0x40a459093b06a8e7 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21740 expref: 14 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129574.515253:0:16908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:0.0:1746129574.515256:0:16908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746129574.515259:0:16908:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6de9a00, rc 0) 00000100:00100000:0.0:1746129574.515862:0:16908:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136016300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:068dab75-d300-4ead-a742-d14572ad1e50+14:32421:x1830948734232192:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 10626us (10759us total) trans 8589945377 rc 0/0 00000100:00100000:0.0:1746129574.515872:0:16908:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11275 00000100:00100000:2.0:1746129574.516842:0:7086:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094f47100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7086:1830948737557888:192.168.202.4@tcp:105: 00010000:00010000:2.0:1746129574.516866:0:7086:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129574.516897:0:7086:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e389c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ada2ffba-8920-4ecb-8068-68caa9806978+24:1962:x1830948734232320:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 6972us (7989us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129574.516905:0:7086:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8445 00000100:00100000:0.0:1746129574.518745:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129574.518780:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129574.518804:0:21463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734233344 00000100:00100000:0.0:1746129574.518806:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129574.518813:0:21463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734233344 00000100:00100000:0.0:1746129574.518831:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00002000:00100000:3.0:1746129574.518863:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3ef:0x0] (2097152->3145727) req@ffff88013575ce00 x1830948734233344/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:315/0 lens 488/0 e 0 to 0 dl 1746129585 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129574.518874:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013575ce00 with x1830948734233344 ext(2097152->3145727) 00002000:00010000:3.0:1746129574.518880:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013575ce00 00000100:00100000:3.0:1746129574.519233:0:21463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734233600 00000100:00100000:3.0:1746129574.519237:0:21463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734233600 00002000:00100000:3.0:1746129574.519249:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->4194303) req@ffff88013575d500 x1830948734233600/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:315/0 lens 488/0 e 0 to 0 dl 1746129585 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129574.519256:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013575d500 with x1830948734233600 ext(3145728->4194303) 00002000:00010000:3.0:1746129574.519258:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013575d500 00000100:00100000:2.0:1746129574.519277:0:31523:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734233856 00000100:00100000:2.0:1746129574.519287:0:31523:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734233856 00002000:00100000:2.0:1746129574.519321:0:31523:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f5:0x0] (2097152->3145727) req@ffff88009016bb80 x1830948734233856/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:315/0 lens 488/0 e 0 to 0 dl 1746129585 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129574.519328:0:31523:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009016bb80 with x1830948734233856 ext(2097152->3145727) 00002000:00010000:2.0:1746129574.519331:0:31523:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009016bb80 00000100:00100000:2.0:1746129574.519351:0:31523:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734234112 00000100:00100000:2.0:1746129574.519352:0:31523:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734234112 00002000:00100000:2.0:1746129574.519361:0:31523:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f5:0x0] (3145728->4194303) req@ffff880090168e00 x1830948734234112/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:315/0 lens 488/0 e 0 to 0 dl 1746129585 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129574.519367:0:31523:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090168e00 with x1830948734234112 ext(3145728->4194303) 00002000:00010000:2.0:1746129574.519369:0:31523:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090168e00 00000100:00100000:1.0:1746129574.519533:0:31520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7913 00000100:00100000:1.0:1746129574.519544:0:31520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013575ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:1962:x1830948734233344:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129574.519640:0:21725:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7914 00000100:00100000:0.0:1746129574.519646:0:21725:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013575d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:1962:x1830948734233600:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:3.0:1746129574.521190:0:21463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7915 00000100:00100000:3.0:1746129574.521200:0:21463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009016bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+14:1962:x1830948734233856:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:1.0:1746129574.525436:0:31519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7916 00000100:00100000:1.0:1746129574.525455:0:31519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090168e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+14:1962:x1830948734234112:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129574.528692:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129574.528731:0:16908:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734234240 00000100:00100000:0.0:1746129574.528739:0:16908:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734234240 00000100:00100000:0.0:1746129574.528784:0:16908:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11276 00000100:00100000:0.0:1746129574.528792:0:16908:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009016a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:068dab75-d300-4ead-a742-d14572ad1e50+14:32421:x1830948734234240:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:0.0:1746129574.528815:0:16908:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129574.528835:0:16908:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3a4200/0x40a459093b06a8f5 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21747 expref: -99 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129574.528922:0:16908:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3a4000/0x40a459093b06a8fc lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129574.528936:0:16908:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6de9a00/0x40a459093b06a8e7 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21740 expref: 15 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129574.528942:0:16908:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3a4000/0x40a459093b06a8fc lrc: 4/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129574.528971:0:16908:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6de9a00/0x40a459093b06a8e7 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21740 expref: 15 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129574.528982:0:16908:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6de9a00/0x40a459093b06a8e7 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21740 expref: 15 pid: 16908 timeout: 929 lvb_type: 0 00000100:00100000:0.0:1746129574.528999:0:16908:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009016a300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16908:1830948737558016:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129574.529059:0:16908:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a00c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746129574.529094:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129574.529160:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129574.539685:0:31518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734234624 00000100:00100000:2.0:1746129574.539704:0:31518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734234624 00002000:00100000:2.0:1746129574.539760:0:31518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3f4:0x0] (1048576->2097151) req@ffff88009402b800 x1830948734234624/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:315/0 lens 488/0 e 0 to 0 dl 1746129585 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129574.539770:0:31518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009402b800 with x1830948734234624 ext(1048576->2097151) 00002000:00010000:2.0:1746129574.539775:0:31518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009402b800 00000100:00100000:2.0:1746129574.539804:0:31518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734234752 00000100:00100000:2.0:1746129574.539808:0:31518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734234752 00002000:00100000:2.0:1746129574.539823:0:31518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3ee:0x0] (1134592->2097151) req@ffff88009402aa00 x1830948734234752/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:315/0 lens 488/0 e 0 to 0 dl 1746129585 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129574.539830:0:31518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009402aa00 with x1830948734234752 ext(1134592->2097151) 00002000:00010000:2.0:1746129574.539833:0:31518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009402aa00 00000100:00100000:2.0:1746129574.539847:0:31518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7917 00000100:00100000:2.0:1746129574.539854:0:31518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009402b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ada2ffba-8920-4ecb-8068-68caa9806978+24:1962:x1830948734234624:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:2.0:1746129574.541268:0:31523:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7918 00000100:00100000:2.0:1746129574.541279:0:31523:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009402aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ada2ffba-8920-4ecb-8068-68caa9806978+40:1962:x1830948734234752:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:2.0:1746129574.543513:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129574.543597:0:7086:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734234880 00000100:00100000:3.0:1746129574.543606:0:7086:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734234880 00010000:00010000:3.0:1746129574.543649:0:7086:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6de9a00/0x40a459093b06a8e7 lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21740 expref: 16 pid: 16908 timeout: 929 lvb_type: 0 00000100:00100000:3.0:1746129574.543680:0:7086:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8447 00000100:00100000:3.0:1746129574.543688:0:7086:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f47100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:068dab75-d300-4ead-a742-d14572ad1e50+16:1962:x1830948734234880:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129574.543703:0:7086:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129574.543709:0:7086:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6de9a00/0x40a459093b06a8e7 lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21740 expref: 16 pid: 16908 timeout: 929 lvb_type: 0 00010000:00010000:3.0:1746129574.543722:0:7086:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6de9a00/0x40a459093b06a8e7 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21740 expref: 16 pid: 16908 timeout: 929 lvb_type: 0 00010000:00010000:3.0:1746129574.543747:0:7086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:3.0:1746129574.543753:0:7086:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3a4000/0x40a459093b06a8fc lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129574.543762:0:7086:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3a4000/0x40a459093b06a8fc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50290000000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129574.543769:0:7086:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3a4000/0x40a459093b06a8fc lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50290000000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129574.543787:0:7086:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746129574.550639:0:16908:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6de9a00/0x40a459093b06a8e7 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21740 expref: 16 pid: 16908 timeout: 929 lvb_type: 0 00000100:00100000:0.0:1746129574.550667:0:16908:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009016a300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16908:1830948737558016:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129574.550688:0:16908:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3a4000/0x40a459093b06a8fc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129574.550697:0:16908:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3a4000/0x40a459093b06a8fc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129574.550701:0:16908:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3a4000/0x40a459093b06a8fc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00000004:00200000:0.0:1746129574.550752:0:16908:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00000004:00200000:0.0:1746129574.550756:0:16908:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746129574.550772:0:16908:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3a4000/0x40a459093b06a8fc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129574.550806:0:16908:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3a4200/0x40a459093b06a8f5 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21747 expref: 16 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129574.550819:0:16908:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3a4000/0x40a459093b06a8fc lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21747 expref: 15 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129574.550827:0:16908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:0.0:1746129574.550830:0:16908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746129574.550833:0:16908:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e3a4000, rc 0) 00000100:00100000:0.0:1746129574.550885:0:16908:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009016a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:068dab75-d300-4ead-a742-d14572ad1e50+15:32421:x1830948734234240:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 22093us (22202us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129574.550894:0:16908:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11276 00000100:00100000:0.0:1746129574.553261:0:31520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013575ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+22:1962:x1830948734233344:12345-192.168.202.4@tcp:3:cat.0 Request processed in 33706us (34513us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129574.553273:0:31520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7913 00002000:00100000:0.0:1746129574.553320:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3ef:0x0] (2097152->3145727) req@ffff88013575ce00 x1830948734233344/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:315/0 lens 488/440 e 0 to 0 dl 1746129585 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129574.553330:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013575ce00 with x1830948734233344 ext(2097152->3145727) 00002000:00010000:0.0:1746129574.553336:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013575ce00 00000100:00100000:3.0:1746129574.553447:0:7086:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f47100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:068dab75-d300-4ead-a742-d14572ad1e50+14:1962:x1830948734234880:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 9758us (9942us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129574.553456:0:7086:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8447 00000100:00100000:0.0:1746129574.557321:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129574.559311:0:16908:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734235136 00000100:00100000:2.0:1746129574.559323:0:16908:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734235136 00000100:00100000:3.0:1746129574.559505:0:21463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009016bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+15:1962:x1830948734233856:12345-192.168.202.4@tcp:3:cat.0 Request processed in 38300us (40691us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129574.559516:0:21463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7915 00000100:00100000:2.0:1746129574.560841:0:16908:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11277 00000100:00100000:2.0:1746129574.560858:0:16908:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094028e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+13:32424:x1830948734235136:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:2.0:1746129574.560883:0:16908:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129574.560905:0:16908:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094fef200/0x40a459093b06a903 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2174e expref: -99 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129574.561023:0:16908:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094feee00/0x40a459093b06a90a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129574.561036:0:16908:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094feee00/0x40a459093b06a90a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129574.561046:0:16908:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094feee00/0x40a459093b06a90a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129574.561058:0:16908:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094fee400/0x40a459093b06a911 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129574.561063:0:16908:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094fee400/0x40a459093b06a911 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129574.561068:0:16908:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094fee400/0x40a459093b06a911 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129574.561246:0:16908:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094fee600/0x40a459093b06a918 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129574.561255:0:16908:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094fee600/0x40a459093b06a918 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129574.561262:0:16908:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094fee600/0x40a459093b06a918 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00000004:00200000:2.0:1746129574.561271:0:16908:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:2.0:1746129574.561387:0:16908:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094feee00/0x40a459093b06a90a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129574.561393:0:16908:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094feee00/0x40a459093b06a90a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129574.561398:0:16908:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094feee00/0x40a459093b06a90a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129574.561403:0:16908:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094feee00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746129574.561407:0:16908:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094feee00/0x40a459093b06a90a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129574.561412:0:16908:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094feee00/0x40a459093b06a90a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129574.561422:0:16908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880132ef8f00) 00010000:00010000:2.0:1746129574.561425:0:16908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129574.561429:0:16908:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094feee00/0x40a459093b06a90a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129574.561433:0:16908:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094feee00/0x40a459093b06a90a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16908 initiator: MDT0 00002000:00100000:3.0:1746129574.561973:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3f5:0x0] (2097152->3145727) req@ffff88009016bb80 x1830948734233856/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:315/0 lens 488/440 e 0 to 0 dl 1746129585 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129574.561986:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009016bb80 with x1830948734233856 ext(2097152->3145727) 00002000:00010000:3.0:1746129574.561991:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009016bb80 00010000:00010000:2.0:1746129574.563615:0:16908:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094fee400/0x40a459093b06a911 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129574.563628:0:16908:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094fee400/0x40a459093b06a911 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129574.563634:0:16908:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094fee400/0x40a459093b06a911 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129574.563640:0:16908:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094fee400 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746129574.563644:0:16908:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094fee400/0x40a459093b06a911 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129574.563650:0:16908:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094fee400/0x40a459093b06a911 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129574.563663:0:16908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012db42d00) 00010000:00010000:2.0:1746129574.563665:0:16908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129574.563668:0:16908:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094fee400/0x40a459093b06a911 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129574.563673:0:16908:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094fee400/0x40a459093b06a911 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129574.563739:0:16908:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094fef200/0x40a459093b06a903 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2174e expref: 16 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129574.563760:0:16908:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094fee600/0x40a459093b06a918 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2174e expref: 15 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129574.563766:0:16908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:2.0:1746129574.563768:0:16908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746129574.563771:0:16908:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094fee600, rc 0) 00000100:00100000:2.0:1746129574.564100:0:16908:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094028e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+15:32424:x1830948734235136:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 3247us (6806us total) trans 8589945378 rc 0/0 00000100:00100000:2.0:1746129574.564110:0:16908:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11277 00000100:00100000:1.0:1746129574.567647:0:31519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090168e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+13:1962:x1830948734234112:12345-192.168.202.4@tcp:3:cat.0 Request processed in 42188us (48802us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129574.567659:0:31519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7916 00002000:00100000:1.0:1746129574.567672:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f5:0x0] (3145728->4194303) req@ffff880090168e00 x1830948734234112/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:315/0 lens 488/440 e 0 to 0 dl 1746129585 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129574.567682:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090168e00 with x1830948734234112 ext(3145728->4194303) 00002000:00010000:1.0:1746129574.567688:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090168e00 00000100:00100000:2.0:1746129574.573243:0:21725:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013575d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:1962:x1830948734233600:12345-192.168.202.4@tcp:3:cat.0 Request processed in 53583us (54447us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129574.573257:0:21725:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7914 00002000:00100000:2.0:1746129574.573270:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->4194303) req@ffff88013575d500 x1830948734233600/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:315/0 lens 488/440 e 0 to 0 dl 1746129585 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129574.573321:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013575d500 with x1830948734233600 ext(3145728->4194303) 00002000:00010000:2.0:1746129574.573328:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013575d500 00000100:00100000:2.0:1746129574.588670:0:31518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009402b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ada2ffba-8920-4ecb-8068-68caa9806978+24:1962:x1830948734234624:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 48801us (59561us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129574.588684:0:31518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7917 00002000:00100000:2.0:1746129574.588697:0:31518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3f4:0x0] (1048576->2097151) req@ffff88009402b800 x1830948734234624/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:315/0 lens 488/440 e 0 to 0 dl 1746129585 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129574.588707:0:31518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009402b800 with x1830948734234624 ext(1048576->2097151) 00002000:00010000:2.0:1746129574.588714:0:31518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009402b800 00000100:00100000:0.0:1746129574.594893:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129574.594940:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129574.594984:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129574.595057:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129574.595102:0:11014:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734235392 00000100:00100000:0.0:1746129574.595111:0:11014:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734235392 00000100:00100000:0.0:1746129574.595164:0:11014:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734235264 00000100:00100000:0.0:1746129574.595167:0:11014:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734235264 00000100:00100000:0.0:1746129574.595180:0:11014:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734235520 00000100:00100000:0.0:1746129574.595182:0:11014:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734235520 00000100:00100000:0.0:1746129574.595191:0:11014:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734235648 00000100:00100000:0.0:1746129574.595193:0:11014:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734235648 00000100:00100000:0.0:1746129574.595206:0:11014:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16447 00000100:00100000:0.0:1746129574.595212:0:11014:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009016a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:1962:x1830948734235392:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129574.595232:0:11014:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129574.595250:0:11014:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f891a00/0x40a459093b06a926 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2175c expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129574.595348:0:11014:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a77b2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11014:1830948737558144:192.168.202.4@tcp:106: 00000100:00100000:0.0:1746129574.595430:0:11014:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a00c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746129574.595771:0:31523:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009402aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ada2ffba-8920-4ecb-8068-68caa9806978+40:1962:x1830948734234752:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 54493us (66607us total) trans 0 rc 962560/962560 00000100:00100000:0.0:1746129574.595781:0:31523:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7918 00002000:00100000:0.0:1746129574.595793:0:31523:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3ee:0x0] (1134592->2097151) req@ffff88009402aa00 x1830948734234752/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:315/0 lens 488/440 e 0 to 0 dl 1746129585 ref 1 fl Complete:/200/0 rc 962560/962560 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129574.595802:0:31523:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009402aa00 with x1830948734234752 ext(1134592->2097151) 00002000:00010000:0.0:1746129574.595806:0:31523:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009402aa00 00000100:00100000:0.0:1746129574.595939:0:22480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16448 00000100:00100000:0.0:1746129574.595945:0:22480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a77b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+13:1963:x1830948734235264:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129574.595952:0:22480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129574.595963:0:22480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f890400/0x40a459093b06a92d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21755 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129574.595976:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129574.595978:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129574.595987:0:22480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f890400/0x40a459093b06a92d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21755 expref: 14 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129574.596003:0:22480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f890400/0x40a459093b06a92d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21755 expref: 14 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129574.596018:0:22480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f890400, rc 0) 00000100:00100000:0.0:1746129574.596039:0:22480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a77b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+14:1963:x1830948734235264:12345-192.168.202.4@tcp:101:cat.0 Request processed in 95us (1099us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129574.596045:0:22480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16448 00000100:00100000:0.0:1746129574.596058:0:22480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16449 00000100:00100000:0.0:1746129574.596064:0:22480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a77b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:068dab75-d300-4ead-a742-d14572ad1e50+7:1963:x1830948734235520:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:0.0:1746129574.596070:0:22480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129574.596075:0:22480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f891e00/0x40a459093b06a934 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21763 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129574.596085:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129574.596086:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129574.596090:0:22480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f891e00/0x40a459093b06a934 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21763 expref: 8 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129574.596098:0:22480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f891e00/0x40a459093b06a934 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21763 expref: 8 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129574.596104:0:22480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f891e00, rc 0) 00000100:00100000:0.0:1746129574.596117:0:22480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a77b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:068dab75-d300-4ead-a742-d14572ad1e50+8:1963:x1830948734235520:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 55us (1133us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129574.596122:0:22480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16449 00000100:00100000:0.0:1746129574.596132:0:22480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16450 00000100:00100000:0.0:1746129574.596136:0:22480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a77b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:068dab75-d300-4ead-a742-d14572ad1e50+10:1963:x1830948734235648:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:0.0:1746129574.596144:0:22480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129574.596150:0:22480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f891000/0x40a459093b06a93b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2176a expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129574.596171:0:22480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a77b0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22480:1830948737558272:192.168.202.4@tcp:106: 00000100:00100000:0.0:1746129574.596191:0:22480:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a00f00 going to sleep for 11 seconds 00002000:00010000:2.0:1746129574.607909:0:11014:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb atime: 1746129574 -> 1746129575 00002000:00010000:2.0:1746129574.607919:0:11014:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb ctime: 1746129574 -> 1746129575 00000100:00100000:2.0:1746129574.607950:0:11014:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a77b2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11014:1830948737558144:192.168.202.4@tcp:106: 00010000:00010000:2.0:1746129574.607991:0:11014:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f891a00/0x40a459093b06a926 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2175c expref: 21 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129574.608008:0:11014:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f891a00/0x40a459093b06a926 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2175c expref: 21 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129574.609468:0:11014:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f891a00, rc 0) 00000100:00100000:2.0:1746129574.609539:0:11014:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009016a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:1962:x1830948734235392:12345-192.168.202.4@tcp:101:cat.0 Request processed in 14322us (14653us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129574.609549:0:11014:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16447 00000100:00100000:0.0:1746129574.611089:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129574.611245:0:31523:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734235904 00000100:00100000:1.0:1746129574.611254:0:31523:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734235904 00002000:00100000:1.0:1746129574.611323:0:31523:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3ef:0x0] (2097152->3145727) req@ffff8800a77b3800 x1830948734235904/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:315/0 lens 488/0 e 0 to 0 dl 1746129585 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129574.611333:0:31523:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a77b3800 with x1830948734235904 ext(2097152->3145727) 00002000:00010000:1.0:1746129574.611338:0:31523:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a77b3800 00000100:00100000:1.0:1746129574.611367:0:31523:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7919 00000100:00100000:1.0:1746129574.611374:0:31523:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a77b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ada2ffba-8920-4ecb-8068-68caa9806978+40:1961:x1830948734235904:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:2.0:1746129574.613664:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129574.614248:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129574.614337:0:31518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734236160 00000100:00100000:3.0:1746129574.614346:0:31518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734236160 00002000:00100000:3.0:1746129574.614385:0:31518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->4194303) req@ffff880094f44e00 x1830948734236160/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:315/0 lens 488/0 e 0 to 0 dl 1746129585 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129574.614394:0:31518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094f44e00 with x1830948734236160 ext(3145728->4194303) 00002000:00010000:3.0:1746129574.614399:0:31518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094f44e00 00000100:00100000:3.0:1746129574.614425:0:31518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734236416 00000100:00100000:3.0:1746129574.614427:0:31518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734236416 00002000:00100000:3.0:1746129574.614439:0:31518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3f5:0x0] (2097152->3145727) req@ffff880094f47480 x1830948734236416/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:315/0 lens 488/0 e 0 to 0 dl 1746129585 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129574.614445:0:31518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094f47480 with x1830948734236416 ext(2097152->3145727) 00002000:00010000:3.0:1746129574.614448:0:31518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094f47480 00000100:00100000:3.0:1746129574.614459:0:31518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7920 00000100:00100000:3.0:1746129574.614465:0:31518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ada2ffba-8920-4ecb-8068-68caa9806978+42:1961:x1830948734236160:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129574.615626:0:31519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7921 00000100:00100000:0.0:1746129574.615639:0:31519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ada2ffba-8920-4ecb-8068-68caa9806978+24:1961:x1830948734236416:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:1.0:1746129574.616529:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129574.617455:0:31520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734236672 00000100:00100000:0.0:1746129574.617465:0:31520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734236672 00002000:00100000:0.0:1746129574.617506:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3f5:0x0] (3145728->4194303) req@ffff88012b553b80 x1830948734236672/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:315/0 lens 488/0 e 0 to 0 dl 1746129585 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129574.617516:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b553b80 with x1830948734236672 ext(3145728->4194303) 00002000:00010000:0.0:1746129574.617523:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b553b80 00000100:00100000:0.0:1746129574.617544:0:31520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7922 00000100:00100000:0.0:1746129574.617551:0:31520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b553b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ada2ffba-8920-4ecb-8068-68caa9806978+26:1961:x1830948734236672:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:1.0:1746129574.618248:0:22480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a77b0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22480:1830948737558272:192.168.202.4@tcp:106: 00010000:00010000:1.0:1746129574.618311:0:22480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f891000/0x40a459093b06a93b lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2176a expref: 11 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129574.618325:0:22480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f891000/0x40a459093b06a93b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2176a expref: 11 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129574.618347:0:22480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f891000, rc 0) 00000100:00100000:1.0:1746129574.618374:0:22480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a77b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:068dab75-d300-4ead-a742-d14572ad1e50+10:1963:x1830948734235648:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 22236us (23316us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129574.618382:0:22480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16450 00000100:00100000:0.0:1746129574.633172:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129574.633176:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129574.633261:0:16908:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734237184 00000100:00100000:0.0:1746129574.633270:0:16908:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734237184 00000100:00100000:0.0:1746129574.633337:0:16908:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11278 00000100:00100000:0.0:1746129574.633344:0:16908:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:068dab75-d300-4ead-a742-d14572ad1e50+14:32421:x1830948734237184:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:0.0:1746129574.633364:0:16908:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129574.633383:0:16908:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f891000/0x40a459093b06a942 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21771 expref: -99 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129574.633479:0:16908:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f891600/0x40a459093b06a949 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129574.633491:0:16908:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f891600/0x40a459093b06a949 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129574.633501:0:16908:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f891600/0x40a459093b06a949 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129574.633511:0:16908:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f891600/0x40a459093b06a949 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129574.633516:0:16908:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f891600/0x40a459093b06a949 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129574.633521:0:16908:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012f891600/0x40a459093b06a949 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129574.633526:0:16908:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f891600 already unused, calling callback (ffffffffa136e690) 00010000:00010000:0.0:1746129574.633529:0:16908:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f891600/0x40a459093b06a949 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129574.633535:0:16908:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f891600/0x40a459093b06a949 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129574.633545:0:16908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:0.0:1746129574.633547:0:16908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00000100:00100000:2.0:1746129574.633550:0:31523:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a77b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ada2ffba-8920-4ecb-8068-68caa9806978+42:1961:x1830948734235904:12345-192.168.202.4@tcp:3:cat.0 Request processed in 22177us (22465us total) trans 0 rc 1048576/1048576 00010000:00010000:0.0:1746129574.633551:0:16908:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012f891600/0x40a459093b06a949 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129574.633556:0:16908:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f891600/0x40a459093b06a949 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 16908 initiator: MDT0 00000100:00100000:2.0:1746129574.633558:0:31523:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7919 00002000:00100000:2.0:1746129574.633567:0:31523:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3ef:0x0] (2097152->3145727) req@ffff8800a77b3800 x1830948734235904/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:315/0 lens 488/440 e 0 to 0 dl 1746129585 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129574.633576:0:31523:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a77b3800 with x1830948734235904 ext(2097152->3145727) 00002000:00010000:2.0:1746129574.633581:0:31523:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a77b3800 00010000:00010000:0.0:1746129574.633587:0:16908:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f891000/0x40a459093b06a942 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21771 expref: 15 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129574.633593:0:16908:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f891000/0x40a459093b06a942 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21771 expref: 15 pid: 16908 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129574.633596:0:31523:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734236928 00000100:00100000:2.0:1746129574.633598:0:31523:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734236928 00010000:00010000:0.0:1746129574.633600:0:16908:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f891000, rc 0) 00002000:00100000:2.0:1746129574.633617:0:31523:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3ef:0x0] (4194304->5148671) req@ffff8800a77b0e00 x1830948734236928/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:315/0 lens 488/0 e 0 to 0 dl 1746129585 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129574.633624:0:31523:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a77b0e00 with x1830948734236928 ext(4194304->5148671) 00000100:00100000:0.0:1746129574.633627:0:16908:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:068dab75-d300-4ead-a742-d14572ad1e50+14:32421:x1830948734237184:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 284us (451us total) trans 0 rc 301/301 00002000:00010000:2.0:1746129574.633628:0:31523:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a77b0e00 00000100:00100000:0.0:1746129574.633632:0:16908:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11278 00000100:00100000:2.0:1746129574.633637:0:31523:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7923 00000100:00100000:2.0:1746129574.633642:0:31523:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a77b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:1963:x1830948734236928:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129574.648467:0:31519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ada2ffba-8920-4ecb-8068-68caa9806978+26:1961:x1830948734236416:12345-192.168.202.4@tcp:3:cat.0 Request processed in 32817us (34203us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129574.648481:0:31519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7921 00002000:00100000:0.0:1746129574.648495:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f5:0x0] (2097152->3145727) req@ffff880094f47480 x1830948734236416/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:315/0 lens 488/440 e 0 to 0 dl 1746129585 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129574.648504:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094f47480 with x1830948734236416 ext(2097152->3145727) 00002000:00010000:0.0:1746129574.648510:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094f47480 00000100:00100000:1.0:1746129574.648655:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129574.648765:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734237440 00000100:00100000:0.0:1746129574.648776:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734237440 00000100:00100000:0.0:1746129574.648832:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4794 00000100:00100000:0.0:1746129574.648839:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b550e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:068dab75-d300-4ead-a742-d14572ad1e50+14:32421:x1830948734237440:12345-192.168.202.4@tcp:35:lfs.0 00000100:00100000:0.0:1746129574.649101:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b550e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:068dab75-d300-4ead-a742-d14572ad1e50+15:32421:x1830948734237440:12345-192.168.202.4@tcp:35:lfs.0 Request processed in 261us (446us total) trans 8589945379 rc 0/0 00000100:00100000:0.0:1746129574.649107:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4794 00000100:00100000:2.0:1746129574.656537:0:31520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b553b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ada2ffba-8920-4ecb-8068-68caa9806978+24:1961:x1830948734236672:12345-192.168.202.4@tcp:3:cat.0 Request processed in 38972us (39996us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129574.656552:0:31520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7922 00002000:00100000:2.0:1746129574.656564:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3f5:0x0] (3145728->4194303) req@ffff88012b553b80 x1830948734236672/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:315/0 lens 488/440 e 0 to 0 dl 1746129585 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129574.656575:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b553b80 with x1830948734236672 ext(3145728->4194303) 00002000:00010000:2.0:1746129574.656582:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b553b80 00000100:00100000:3.0:1746129574.659500:0:31518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ada2ffba-8920-4ecb-8068-68caa9806978+40:1961:x1830948734236160:12345-192.168.202.4@tcp:3:cat.0 Request processed in 45023us (45831us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129574.659512:0:31518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7920 00002000:00100000:3.0:1746129574.659524:0:31518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->4194303) req@ffff880094f44e00 x1830948734236160/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:315/0 lens 488/440 e 0 to 0 dl 1746129585 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129574.659533:0:31518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094f44e00 with x1830948734236160 ext(3145728->4194303) 00002000:00010000:3.0:1746129574.659538:0:31518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094f44e00 00000100:00100000:0.0:1746129574.665088:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129574.665200:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734237696 00000100:00100000:1.0:1746129574.665215:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734237696 00000100:00100000:1.0:1746129574.665273:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11279 00000100:00100000:1.0:1746129574.665291:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a77b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ada2ffba-8920-4ecb-8068-68caa9806978+297:32426:x1830948734237696:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:1.0:1746129574.665355:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129574.665380:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095c15800/0x40a459093b06a950 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21778 expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129574.665525:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095c14a00/0x40a459093b06a957 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129574.665542:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095c14a00/0x40a459093b06a957 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129574.665556:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095c14a00/0x40a459093b06a957 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129574.665571:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095c15c00/0x40a459093b06a95e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129574.665577:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095c15c00/0x40a459093b06a95e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129574.665582:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095c15c00/0x40a459093b06a95e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129574.665726:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f13200/0x40a459093b06a965 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129574.665735:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095f13200/0x40a459093b06a965 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129574.665741:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f13200/0x40a459093b06a965 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00200000:1.0:1746129574.665753:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:1.0:1746129574.665851:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095c14a00/0x40a459093b06a957 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129574.665858:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095c14a00/0x40a459093b06a957 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129574.665865:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095c14a00/0x40a459093b06a957 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129574.665870:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095c14a00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:1.0:1746129574.665873:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095c14a00/0x40a459093b06a957 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129574.665880:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095c14a00/0x40a459093b06a957 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129574.665891:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880132ef8f00) 00010000:00010000:1.0:1746129574.665894:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129574.665898:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095c14a00/0x40a459093b06a957 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129574.665903:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095c14a00/0x40a459093b06a957 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129574.665927:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095c15c00/0x40a459093b06a95e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129574.665932:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095c15c00/0x40a459093b06a95e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129574.665936:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095c15c00/0x40a459093b06a95e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129574.665941:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095c15c00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:1.0:1746129574.665943:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095c15c00/0x40a459093b06a95e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129574.665948:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095c15c00/0x40a459093b06a95e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129574.665952:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009cffec00) 00010000:00010000:1.0:1746129574.665954:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129574.665956:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095c15c00/0x40a459093b06a95e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129574.665960:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095c15c00/0x40a459093b06a95e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129574.665998:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095c15800/0x40a459093b06a950 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21778 expref: 300 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129574.666010:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f13200/0x40a459093b06a965 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21778 expref: 299 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129574.666017:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:1.0:1746129574.666020:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746129574.666022:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f13200, rc 0) 00000100:00100000:1.0:1746129574.666084:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a77b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ada2ffba-8920-4ecb-8068-68caa9806978+299:32426:x1830948734237696:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 804us (1009us total) trans 8589945380 rc 0/0 00000100:00100000:1.0:1746129574.666091:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11279 00000100:00100000:3.0:1746129574.667637:0:31523:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a77b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:1963:x1830948734236928:12345-192.168.202.4@tcp:3:cat.0 Request processed in 33985us (34467us total) trans 0 rc 954368/954368 00000100:00100000:3.0:1746129574.667648:0:31523:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7923 00002000:00100000:3.0:1746129574.667662:0:31523:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3ef:0x0] (4194304->5148671) req@ffff8800a77b0e00 x1830948734236928/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:315/0 lens 488/440 e 0 to 0 dl 1746129585 ref 1 fl Complete:/200/0 rc 954368/954368 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129574.667672:0:31523:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a77b0e00 with x1830948734236928 ext(4194304->5148671) 00002000:00010000:3.0:1746129574.667678:0:31523:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a77b0e00 00000100:00100000:0.0:1746129574.672622:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129574.672716:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129574.672856:0:22480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734237824 00000100:00100000:1.0:1746129574.672869:0:22480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734237824 00000100:00100000:1.0:1746129574.672948:0:22480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16451 00000100:00100000:1.0:1746129574.672956:0:22480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f327b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:1963:x1830948734237824:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129574.672977:0:22480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129574.673000:0:22480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095c15800/0x40a459093b06a973 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2177f expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129574.673069:0:22480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b551180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22480:1830948737558400:192.168.202.4@tcp:106: 00000100:00100000:1.0:1746129574.673188:0:22480:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4123a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746129574.673244:0:31523:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734238080 00000100:00100000:3.0:1746129574.673247:0:31523:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734238080 00002000:00100000:3.0:1746129574.673324:0:31523:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3ef:0x0] (4194304->5148671) req@ffff88009f325f80 x1830948734238080/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:315/0 lens 488/0 e 0 to 0 dl 1746129585 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129574.673334:0:31523:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f325f80 with x1830948734238080 ext(4194304->5148671) 00002000:00010000:3.0:1746129574.673340:0:31523:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f325f80 00000100:00100000:3.0:1746129574.673375:0:31523:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7924 00000100:00100000:3.0:1746129574.673381:0:31523:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f325f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ada2ffba-8920-4ecb-8068-68caa9806978+40:1960:x1830948734238080:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:1.0:1746129574.686616:0:22480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b551180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22480:1830948737558400:192.168.202.4@tcp:106: 00010000:00010000:1.0:1746129574.686665:0:22480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095c15800/0x40a459093b06a973 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2177f expref: 21 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129574.686683:0:22480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095c15800/0x40a459093b06a973 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2177f expref: 21 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129574.686728:0:22480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095c15800, rc 0) 00000100:00100000:1.0:1746129574.686791:0:22480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f327b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:1963:x1830948734237824:12345-192.168.202.4@tcp:101:cat.0 Request processed in 13834us (14181us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129574.686800:0:22480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16451 00000100:00100000:3.0:1746129574.688091:0:31523:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f325f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ada2ffba-8920-4ecb-8068-68caa9806978+40:1960:x1830948734238080:12345-192.168.202.4@tcp:3:cat.0 Request processed in 14702us (15369us total) trans 0 rc 954368/954368 00000100:00100000:3.0:1746129574.688102:0:31523:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7924 00002000:00100000:3.0:1746129574.688115:0:31523:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3ef:0x0] (4194304->5148671) req@ffff88009f325f80 x1830948734238080/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:315/0 lens 488/440 e 0 to 0 dl 1746129585 ref 1 fl Complete:/200/0 rc 954368/954368 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129574.688124:0:31523:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f325f80 with x1830948734238080 ext(4194304->5148671) 00002000:00010000:3.0:1746129574.688131:0:31523:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f325f80 00000100:00100000:0.0:1746129574.693458:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129574.694066:0:22480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734238208 00000100:00100000:1.0:1746129574.694077:0:22480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734238208 00000100:00100000:2.0:1746129574.699627:0:11014:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16452 00000100:00100000:2.0:1746129574.699656:0:11014:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f37f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:1962:x1830948734238208:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129574.699684:0:11014:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129574.699709:0:11014:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a6ca1e00/0x40a459093b06a97a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21786 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129574.699780:0:11014:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094f44a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11014:1830948737558528:192.168.202.4@tcp:106: 00000100:00100000:2.0:1746129574.701157:0:11014:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009cdf3b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746129574.738798:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129574.743624:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734238464 00000100:00100000:1.0:1746129574.743643:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734238464 00000100:00100000:1.0:1746129574.743703:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4795 00000100:00100000:1.0:1746129574.743715:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f533450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ada2ffba-8920-4ecb-8068-68caa9806978+299:32418:x1830948734238464:12345-192.168.202.4@tcp:35:cat.0 00000100:00100000:1.0:1746129574.743983:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f533450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ada2ffba-8920-4ecb-8068-68caa9806978+300:32418:x1830948734238464:12345-192.168.202.4@tcp:35:cat.0 Request processed in 268us (5196us total) trans 8589945381 rc 0/0 00000100:00100000:1.0:1746129574.743992:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4795 00000100:00100000:0.0:1746129574.747407:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129574.747671:0:11014:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094f44a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11014:1830948737558528:192.168.202.4@tcp:106: 00010000:00010000:2.0:1746129574.747709:0:11014:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a6ca1e00/0x40a459093b06a97a lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21786 expref: 21 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129574.747729:0:11014:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a6ca1e00/0x40a459093b06a97a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21786 expref: 21 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129574.747744:0:11014:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6ca1e00, rc 0) 00000100:00100000:2.0:1746129574.747790:0:11014:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f37f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:1962:x1830948734238208:12345-192.168.202.4@tcp:101:cat.0 Request processed in 48149us (54345us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129574.747798:0:11014:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16452 00000100:00100000:2.0:1746129574.747830:0:11014:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734238592 00000100:00100000:2.0:1746129574.747836:0:11014:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734238592 00000100:00100000:2.0:1746129574.747866:0:11014:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16453 00000100:00100000:2.0:1746129574.747872:0:11014:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f37d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:32424:x1830948734238592:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:2.0:1746129574.747886:0:11014:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129574.747900:0:11014:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a6ca1a00/0x40a459093b06a981 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2178d expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129574.747921:0:11014:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a6de9600/0x40a459093b06a800 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2169f expref: 21 pid: 8411 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129574.747929:0:11014:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012e3a5400/0x40a459093b06a8d9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21716 expref: 9 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129574.747936:0:11014:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800946f0600/0x40a459093b06a846 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f216c9 expref: 39 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129574.747942:0:11014:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129574.747944:0:11014:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129574.747947:0:11014:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6ca1a00/0x40a459093b06a981 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [757760->1048575] (req 757760->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2178d expref: 21 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129574.747972:0:11014:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800946f0600/0x40a459093b06a846 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f216c9 expref: 39 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129574.747984:0:11014:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800946f0600/0x40a459093b06a846 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f216c9 expref: 39 pid: 7148 timeout: 930 lvb_type: 1 00000100:00100000:2.0:1746129574.747995:0:11014:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094f44a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11014:1830948737558656:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129574.748057:0:11014:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012e3a5400/0x40a459093b06a8d9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21716 expref: 9 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129574.748065:0:11014:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012e3a5400/0x40a459093b06a8d9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21716 expref: 9 pid: 7148 timeout: 930 lvb_type: 1 00000100:00100000:2.0:1746129574.748073:0:11014:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094f45f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11014:1830948737558784:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129574.748095:0:11014:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a6de9600/0x40a459093b06a800 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2169f expref: 21 pid: 8411 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129574.748102:0:11014:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a6de9600/0x40a459093b06a800 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2169f expref: 21 pid: 8411 timeout: 930 lvb_type: 1 00000100:00100000:2.0:1746129574.748109:0:11014:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c078e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11014:1830948737558912:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129574.748122:0:11014:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009cdf3b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746129574.752700:0:11014:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094f44a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11014:1830948737558656:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129574.764317:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129574.764343:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129574.764429:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129574.764477:0:11014:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094f45f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11014:1830948737558784:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129574.764488:0:11014:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c078e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11014:1830948737558912:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129574.764528:0:11014:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a6ca1a00/0x40a459093b06a981 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [757760->1048575] (req 757760->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2178d expref: 21 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129574.764545:0:11014:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6ca1a00, rc 0) 00000100:00100000:0.0:1746129574.764588:0:11014:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f37d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:32424:x1830948734238592:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 16716us (17190us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129574.764597:0:11014:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16453 00000100:00100000:0.0:1746129574.764634:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734238720 00000100:00100000:0.0:1746129574.764639:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734238720 00010000:00010000:0.0:1746129574.764665:0:9823:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800946f0600/0x40a459093b06a846 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f216c9 expref: 40 pid: 7148 timeout: 930 lvb_type: 1 00000100:00100000:0.0:1746129574.764684:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734238848 00000100:00100000:0.0:1746129574.764686:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734238848 00010000:00010000:0.0:1746129574.764693:0:9823:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6de9600/0x40a459093b06a800 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2169f expref: 21 pid: 8411 timeout: 930 lvb_type: 1 00000100:00100000:0.0:1746129574.764707:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734238976 00000100:00100000:0.0:1746129574.764709:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734238976 00010000:00010000:0.0:1746129574.764717:0:9823:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012e3a5400/0x40a459093b06a8d9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21716 expref: 10 pid: 7148 timeout: 930 lvb_type: 1 00000100:00100000:0.0:1746129574.764728:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8448 00000100:00100000:0.0:1746129574.764734:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6fd2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ada2ffba-8920-4ecb-8068-68caa9806978+40:1960:x1830948734238720:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129574.764747:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129574.764768:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800946f0600/0x40a459093b06a846 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f216c9 expref: 40 pid: 7148 timeout: 930 lvb_type: 1 00010000:00010000:0.0:1746129574.764776:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800946f0600/0x40a459093b06a846 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f216c9 expref: 40 pid: 7148 timeout: 930 lvb_type: 1 00010000:00010000:0.0:1746129574.764798:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800946f0600/0x40a459093b06a846 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f216c9 expref: 40 pid: 7148 timeout: 930 lvb_type: 1 00010000:00010000:0.0:1746129574.764809:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129574.764824:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6fd2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ada2ffba-8920-4ecb-8068-68caa9806978+39:1960:x1830948734238720:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 90us (545us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129574.764829:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8448 00000100:00100000:0.0:1746129574.764865:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8449 00000100:00100000:0.0:1746129574.764870:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:1960:x1830948734238848:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129574.764875:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129574.764881:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a6de9600/0x40a459093b06a800 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2169f expref: 21 pid: 8411 timeout: 930 lvb_type: 1 00010000:00010000:0.0:1746129574.764888:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a6de9600/0x40a459093b06a800 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2169f expref: 21 pid: 8411 timeout: 930 lvb_type: 1 00010000:00010000:0.0:1746129574.764898:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a6de9600/0x40a459093b06a800 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2169f expref: 21 pid: 8411 timeout: 930 lvb_type: 1 00010000:00010000:0.0:1746129574.764905:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129574.764917:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:1960:x1830948734238848:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 47us (573us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129574.764921:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8449 00000100:00100000:0.0:1746129574.764930:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8450 00000100:00100000:0.0:1746129574.764934:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:068dab75-d300-4ead-a742-d14572ad1e50+10:1963:x1830948734238976:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129574.764938:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129574.764944:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012e3a5400/0x40a459093b06a8d9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21716 expref: 10 pid: 7148 timeout: 930 lvb_type: 1 00010000:00010000:0.0:1746129574.764953:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012e3a5400/0x40a459093b06a8d9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21716 expref: 10 pid: 7148 timeout: 930 lvb_type: 1 00010000:00010000:0.0:1746129574.764964:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e3a5400/0x40a459093b06a8d9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21716 expref: 10 pid: 7148 timeout: 930 lvb_type: 1 00010000:00010000:0.0:1746129574.764971:0:9823:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129574.764973:0:9823:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129574.764979:0:9823:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a6ca1a00/0x40a459093b06a981 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 757760->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2178d expref: 19 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129574.764991:0:9823:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6ca1a00/0x40a459093b06a981 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 757760->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2178d expref: 19 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129574.765019:0:9823:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a6ca1a00/0x40a459093b06a981 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 757760->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2178d expref: 19 pid: 11014 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129574.765030:0:9823:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900f4a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9823:1830948737559040:192.168.202.4@tcp:105: 00000100:00100000:0.0:1746129574.765082:0:9823:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a00c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746129574.785907:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129574.785948:0:31523:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734239232 00000100:00100000:1.0:1746129574.785959:0:31523:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734239232 00002000:00100000:1.0:1746129574.786017:0:31523:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3ec:0x0] (757760->761855) req@ffff88012b553480 x1830948734239232/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:315/0 lens 488/0 e 0 to 0 dl 1746129585 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129574.786028:0:31523:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b553480 with x1830948734239232 ext(757760->761855) 00002000:00010000:1.0:1746129574.786034:0:31523:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b553480 00000100:00100000:1.0:1746129574.786064:0:31523:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7925 00000100:00100000:1.0:1746129574.786074:0:31523:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b553480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:1963:x1830948734239232:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:1.0:1746129574.786314:0:31523:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b553480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:1963:x1830948734239232:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 241us (418us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746129574.786320:0:31523:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7925 00002000:00100000:1.0:1746129574.786325:0:31523:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3ec:0x0] (757760->761855) req@ffff88012b553480 x1830948734239232/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:315/0 lens 488/4536 e 0 to 0 dl 1746129585 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129574.786332:0:31523:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b553480 with x1830948734239232 ext(757760->761855) 00002000:00010000:1.0:1746129574.786336:0:31523:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b553480 00000100:00100000:0.0:1746129574.786464:0:9823:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900f4a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9823:1830948737559040:192.168.202.4@tcp:105: 00010000:00010000:0.0:1746129574.786482:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129574.786504:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:068dab75-d300-4ead-a742-d14572ad1e50+9:1963:x1830948734238976:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 21570us (22075us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129574.786511:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8450 00000100:00100000:1.0:1746129574.810275:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129574.810406:0:11014:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734239360 00000100:00100000:3.0:1746129574.810415:0:11014:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734239360 00000100:00100000:3.0:1746129574.810457:0:11014:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16454 00000100:00100000:3.0:1746129574.810465:0:11014:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b550e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+14:32424:x1830948734239360:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:3.0:1746129574.810484:0:11014:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129574.810502:0:11014:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a05baa00/0x40a459093b06a988 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21794 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129574.810533:0:11014:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fab5000/0x40a459093b06a815 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f216a6 expref: 15 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129574.810542:0:11014:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b3be800/0x40a459093b06a8c4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2171d expref: 7 pid: 31503 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129574.810551:0:11014:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800946f0200/0x40a459093b06a854 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f216d0 expref: 23 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129574.810558:0:11014:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129574.810560:0:11014:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129574.810563:0:11014:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a05baa00/0x40a459093b06a988 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [1048576->1462271] (req 1048576->1462271) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21794 expref: 15 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129574.810592:0:11014:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800946f0200/0x40a459093b06a854 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f216d0 expref: 23 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129574.810602:0:11014:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800946f0200/0x40a459093b06a854 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f216d0 expref: 23 pid: 11014 timeout: 930 lvb_type: 1 00000100:00100000:3.0:1746129574.810614:0:11014:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11014:1830948737559168:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129574.820952:0:11014:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b3be800/0x40a459093b06a8c4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2171d expref: 7 pid: 31503 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129574.820976:0:11014:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b3be800/0x40a459093b06a8c4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2171d expref: 7 pid: 31503 timeout: 930 lvb_type: 1 00000100:00100000:3.0:1746129574.820993:0:11014:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11014:1830948737559296:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129574.821118:0:11014:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fab5000/0x40a459093b06a815 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f216a6 expref: 15 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129574.821134:0:11014:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fab5000/0x40a459093b06a815 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f216a6 expref: 15 pid: 7148 timeout: 930 lvb_type: 1 00000100:00100000:3.0:1746129574.821143:0:11014:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11014:1830948737559424:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129574.821173:0:11014:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa381600 going to sleep for 11 seconds 00000100:00100000:1.0:1746129574.833527:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129574.833545:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129574.833579:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129574.833710:0:11014:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11014:1830948737559168:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129574.833720:0:11014:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11014:1830948737559296:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129574.833727:0:11014:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11014:1830948737559424:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129574.833759:0:11014:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a05baa00/0x40a459093b06a988 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [1048576->1462271] (req 1048576->1462271) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21794 expref: 15 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129574.833777:0:11014:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a05baa00, rc 0) 00000100:00100000:3.0:1746129574.833821:0:11014:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b550e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+15:32424:x1830948734239360:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 23357us (23558us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129574.833830:0:11014:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16454 00000100:00100000:3.0:1746129574.833866:0:20578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734239616 00000100:00100000:3.0:1746129574.833872:0:20578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734239616 00010000:00010000:3.0:1746129574.833895:0:20578:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fab5000/0x40a459093b06a815 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f216a6 expref: 15 pid: 7148 timeout: 930 lvb_type: 1 00000100:00100000:3.0:1746129574.833914:0:20578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734239488 00000100:00100000:3.0:1746129574.833916:0:20578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734239488 00010000:00010000:3.0:1746129574.833927:0:20578:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b3be800/0x40a459093b06a8c4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2171d expref: 8 pid: 31503 timeout: 930 lvb_type: 1 00000100:00100000:3.0:1746129574.833944:0:20578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734239744 00000100:00100000:3.0:1746129574.833946:0:20578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734239744 00010000:00010000:3.0:1746129574.833955:0:20578:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800946f0200/0x40a459093b06a854 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f216d0 expref: 24 pid: 11014 timeout: 930 lvb_type: 1 00000100:00100000:3.0:1746129574.833968:0:20578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8451 00000100:00100000:3.0:1746129574.833974:0:20578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b551180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+15:1961:x1830948734239616:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129574.833986:0:20578:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129574.834006:0:20578:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fab5000/0x40a459093b06a815 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f216a6 expref: 15 pid: 7148 timeout: 930 lvb_type: 1 00010000:00010000:3.0:1746129574.834015:0:20578:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fab5000/0x40a459093b06a815 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f216a6 expref: 15 pid: 7148 timeout: 930 lvb_type: 1 00010000:00010000:3.0:1746129574.834039:0:20578:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fab5000/0x40a459093b06a815 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f216a6 expref: 15 pid: 7148 timeout: 930 lvb_type: 1 00010000:00010000:3.0:1746129574.834048:0:20578:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129574.834069:0:20578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b551180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+14:1961:x1830948734239616:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 96us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129574.834074:0:20578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8451 00000100:00100000:3.0:1746129574.834084:0:20578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8452 00000100:00100000:3.0:1746129574.834088:0:20578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b551c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:068dab75-d300-4ead-a742-d14572ad1e50+8:1961:x1830948734239488:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129574.834094:0:20578:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129574.834101:0:20578:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b3be800/0x40a459093b06a8c4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2171d expref: 8 pid: 31503 timeout: 930 lvb_type: 1 00010000:00010000:3.0:1746129574.834107:0:20578:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b3be800/0x40a459093b06a8c4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2171d expref: 8 pid: 31503 timeout: 930 lvb_type: 1 00010000:00010000:3.0:1746129574.834117:0:20578:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b3be800/0x40a459093b06a8c4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2171d expref: 8 pid: 31503 timeout: 930 lvb_type: 1 00010000:00010000:3.0:1746129574.834126:0:20578:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129574.834138:0:20578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b551c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:068dab75-d300-4ead-a742-d14572ad1e50+7:1961:x1830948734239488:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 51us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129574.834143:0:20578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8452 00000100:00100000:3.0:1746129574.834151:0:20578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8453 00000100:00100000:3.0:1746129574.834155:0:20578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800903a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ada2ffba-8920-4ecb-8068-68caa9806978+24:1962:x1830948734239744:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129574.834163:0:20578:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129574.834168:0:20578:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800946f0200/0x40a459093b06a854 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f216d0 expref: 24 pid: 11014 timeout: 930 lvb_type: 1 00010000:00010000:3.0:1746129574.834176:0:20578:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800946f0200/0x40a459093b06a854 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f216d0 expref: 24 pid: 11014 timeout: 930 lvb_type: 1 00010000:00010000:3.0:1746129574.834187:0:20578:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800946f0200/0x40a459093b06a854 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f216d0 expref: 24 pid: 11014 timeout: 930 lvb_type: 1 00010000:00010000:3.0:1746129574.834195:0:20578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129574.834197:0:20578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129574.834203:0:20578:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a05baa00/0x40a459093b06a988 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1462271) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21794 expref: 13 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129574.834210:0:20578:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a05baa00/0x40a459093b06a988 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1462271) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21794 expref: 13 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129574.834235:0:20578:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a05baa00/0x40a459093b06a988 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1462271) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21794 expref: 13 pid: 11014 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129574.834246:0:20578:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:20578:1830948737559552:192.168.202.4@tcp:105: 00000100:00100000:3.0:1746129574.834324:0:20578:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa381600 going to sleep for 11 seconds 00000100:00100000:3.0:1746129574.839542:0:20578:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:20578:1830948737559552:192.168.202.4@tcp:105: 00010000:00010000:3.0:1746129574.839567:0:20578:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129574.839613:0:20578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800903a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ada2ffba-8920-4ecb-8068-68caa9806978+23:1962:x1830948734239744:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 5456us (6031us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129574.839624:0:20578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8453 00000100:00100000:1.0:1746129574.867571:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129574.867615:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129574.867641:0:31518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734240000 00000100:00100000:1.0:1746129574.867649:0:31518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734240000 00002000:00100000:1.0:1746129574.867691:0:31518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3f3:0x0] (1458176->1462271) req@ffff880095626680 x1830948734240000/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:315/0 lens 488/0 e 0 to 0 dl 1746129585 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129574.867702:0:31518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095626680 with x1830948734240000 ext(1458176->1462271) 00002000:00010000:1.0:1746129574.867707:0:31518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095626680 00000100:00100000:1.0:1746129574.867725:0:31518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7926 00000100:00100000:1.0:1746129574.867732:0:31518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095626680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+14:1963:x1830948734240000:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:1.0:1746129574.867890:0:31518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095626680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+14:1963:x1830948734240000:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 158us (273us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746129574.867897:0:31518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7926 00002000:00100000:1.0:1746129574.867901:0:31518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3f3:0x0] (1458176->1462271) req@ffff880095626680 x1830948734240000/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:315/0 lens 488/4536 e 0 to 0 dl 1746129585 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129574.867908:0:31518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095626680 with x1830948734240000 ext(1458176->1462271) 00002000:00010000:1.0:1746129574.867911:0:31518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095626680 00000100:00100000:0.0:1746129574.869019:0:16908:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734240256 00000100:00100000:0.0:1746129574.869026:0:16908:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734240256 00000100:00100000:0.0:1746129574.869061:0:16908:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11280 00000100:00100000:0.0:1746129574.869066:0:16908:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135724e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ada2ffba-8920-4ecb-8068-68caa9806978+300:32432:x1830948734240256:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129574.869083:0:16908:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129574.869102:0:16908:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f890200/0x40a459093b06a98f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2179b expref: -99 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129574.869197:0:16908:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f891000/0x40a459093b06a996 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129574.869212:0:16908:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f891000/0x40a459093b06a996 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129574.869227:0:16908:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f891000/0x40a459093b06a996 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00000004:00200000:0.0:1746129574.869237:0:16908:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:0.0:1746129574.869396:0:16908:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f890200/0x40a459093b06a98f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2179b expref: 303 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129574.869413:0:16908:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f891000/0x40a459093b06a996 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2179b expref: 302 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129574.869420:0:16908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:0.0:1746129574.869423:0:16908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1746129574.869427:0:16908:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f891000, rc 0) 00000100:00100000:0.0:1746129574.869464:0:16908:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135724e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ada2ffba-8920-4ecb-8068-68caa9806978+302:32432:x1830948734240256:12345-192.168.202.4@tcp:101:cat.0 Request processed in 398us (1905us total) trans 8589945382 rc 0/0 00000100:00100000:0.0:1746129574.869470:0:16908:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11280 00000100:00100000:1.0:1746129574.876535:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129574.876638:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129574.876666:0:22480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734240384 00000100:00100000:1.0:1746129574.876675:0:22480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734240384 00000100:00100000:1.0:1746129574.876714:0:22480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734240512 00000100:00100000:1.0:1746129574.876715:0:22480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734240512 00000100:00100000:1.0:1746129574.876732:0:22480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16455 00000100:00100000:1.0:1746129574.876739:0:22480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095625c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ada2ffba-8920-4ecb-8068-68caa9806978+39:1962:x1830948734240384:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129574.876757:0:22480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129574.876774:0:22480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e0b4e00/0x40a459093b06a9a4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f217a2 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129574.876829:0:22480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095627100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22480:1830948737559680:192.168.202.4@tcp:106: 00000100:00100000:1.0:1746129574.876904:0:22480:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a6dc8240 going to sleep for 11 seconds 00000100:00100000:1.0:1746129574.876923:0:8410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16456 00000100:00100000:1.0:1746129574.876927:0:8410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095627800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ada2ffba-8920-4ecb-8068-68caa9806978+23:1962:x1830948734240512:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129574.876934:0:8410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129574.876945:0:8410:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e0b5e00/0x40a459093b06a9ab lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f217a9 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129574.876969:0:8410:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095624700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8410:1830948737559808:192.168.202.4@tcp:106: 00000100:00100000:1.0:1746129574.876987:0:8410:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a6dc8a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746129574.883021:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129574.883346:0:20861:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734240768 00000100:00100000:2.0:1746129574.883356:0:20861:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734240768 00000100:00100000:2.0:1746129574.883403:0:20861:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4796 00000100:00100000:2.0:1746129574.883410:0:20861:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+15:32424:x1830948734240768:12345-192.168.202.4@tcp:35:multiop.0 00000100:00100000:2.0:1746129574.883640:0:20861:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+16:32424:x1830948734240768:12345-192.168.202.4@tcp:35:multiop.0 Request processed in 230us (629us total) trans 8589945383 rc 0/0 00000100:00100000:2.0:1746129574.883648:0:20861:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4796 00002000:00010000:1.0:1746129574.884290:0:22480:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3ec:0x0] updating lvb mtime: 1746129573 -> 1746129575 00002000:00010000:1.0:1746129574.884308:0:22480:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3ec:0x0] updating lvb atime: 1746129571 -> 1746129575 00002000:00010000:1.0:1746129574.884310:0:22480:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3ec:0x0] updating lvb ctime: 1746129573 -> 1746129575 00000100:00100000:1.0:1746129574.884330:0:22480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095627100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22480:1830948737559680:192.168.202.4@tcp:106: 00010000:00010000:1.0:1746129574.884365:0:22480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012e0b4e00/0x40a459093b06a9a4 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f217a2 expref: 40 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129574.884383:0:22480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e0b4e00/0x40a459093b06a9a4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f217a2 expref: 40 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129574.884392:0:22480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e0b4e00, rc 0) 00000100:00100000:1.0:1746129574.884418:0:22480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095625c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ada2ffba-8920-4ecb-8068-68caa9806978+39:1962:x1830948734240384:12345-192.168.202.4@tcp:101:cat.0 Request processed in 7680us (7894us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129574.884425:0:22480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16455 00002000:00010000:1.0:1746129574.884456:0:8410:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb mtime: 1746129574 -> 1746129575 00002000:00010000:1.0:1746129574.884458:0:8410:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb atime: 1746129571 -> 1746129575 00002000:00010000:1.0:1746129574.884460:0:8410:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb ctime: 1746129574 -> 1746129575 00000100:00100000:1.0:1746129574.884472:0:8410:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095624700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8410:1830948737559808:192.168.202.4@tcp:106: 00010000:00010000:1.0:1746129574.884486:0:8410:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012e0b5e00/0x40a459093b06a9ab lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f217a9 expref: 24 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129574.884495:0:8410:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e0b5e00/0x40a459093b06a9ab lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f217a9 expref: 24 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129574.884502:0:8410:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e0b5e00, rc 0) 00000100:00100000:1.0:1746129574.884514:0:8410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095627800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ada2ffba-8920-4ecb-8068-68caa9806978+23:1962:x1830948734240512:12345-192.168.202.4@tcp:101:cat.0 Request processed in 7587us (7876us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129574.884520:0:8410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16456 00000100:00100000:1.0:1746129574.900733:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129574.901638:0:8410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734240896 00000100:00100000:0.0:1746129574.901648:0:8410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734240896 00000100:00100000:0.0:1746129574.901696:0:8410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16457 00000100:00100000:0.0:1746129574.901704:0:8410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ada2ffba-8920-4ecb-8068-68caa9806978+39:32432:x1830948734240896:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129574.901723:0:8410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129574.901741:0:8410:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f890e00/0x40a459093b06a9b2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f217b0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129574.901773:0:8410:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a6ca1a00/0x40a459093b06a981 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 757760->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2178d expref: 19 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129574.901785:0:8410:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129574.901787:0:8410:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129574.901790:0:8410:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f890e00/0x40a459093b06a9b2 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f217b0 expref: 40 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129574.901819:0:8410:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a6ca1a00/0x40a459093b06a981 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 757760->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2178d expref: 19 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129574.901831:0:8410:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a6ca1a00/0x40a459093b06a981 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 757760->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2178d expref: 19 pid: 11014 timeout: 930 lvb_type: 0 00000100:00100000:0.0:1746129574.901843:0:8410:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900f4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8410:1830948737559936:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129574.901916:0:8410:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a00c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746129574.907713:0:8410:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900f4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8410:1830948737559936:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129574.907748:0:8410:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f890e00/0x40a459093b06a9b2 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f217b0 expref: 40 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129574.907767:0:8410:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f890e00, rc 0) 00000100:00100000:1.0:1746129574.907818:0:8410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ada2ffba-8920-4ecb-8068-68caa9806978+40:32432:x1830948734240896:12345-192.168.202.4@tcp:101:cat.0 Request processed in 6113us (7095us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129574.907827:0:8410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16457 00000100:00100000:3.0:1746129574.908869:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129574.909228:0:31523:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734241024 00000100:00100000:2.0:1746129574.909237:0:31523:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734241024 00002000:00100000:2.0:1746129574.909310:0:31523:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3ec:0x0] (757760->1048575) req@ffff8800947bca80 x1830948734241024/t0(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:315/0 lens 488/0 e 0 to 0 dl 1746129585 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129574.909321:0:31523:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800947bca80 with x1830948734241024 ext(757760->1048575) 00010000:00010000:2.0:1746129574.909329:0:31523:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a6ca1a00/0x40a459093b06a981 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 757760->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2178d expref: 20 pid: 11014 timeout: 930 lvb_type: 0 00010000:00010000:2.0:1746129574.909342:0:31523:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a6ca1a00/0x40a459093b06a981 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 757760->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2178d expref: 20 pid: 11014 timeout: 930 lvb_type: 0 00002000:00010000:2.0:1746129574.909348:0:31523:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800947bca80 00000100:00100000:2.0:1746129574.909368:0:31523:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2458 00000100:00100000:2.0:1746129574.909376:0:31523:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:1963:x1830948734241024:12345-192.168.202.4@tcp:4:multiop.0 00000100:00100000:0.0:1746129574.918956:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129574.920638:0:8410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734241152 00000100:00100000:1.0:1746129574.920650:0:8410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734241152 00000100:00100000:1.0:1746129574.920714:0:8410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16458 00000100:00100000:1.0:1746129574.920722:0:8410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ada2ffba-8920-4ecb-8068-68caa9806978+23:32426:x1830948734241152:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:1.0:1746129574.920741:0:8410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129574.920761:0:8410:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e0b4a00/0x40a459093b06a9b9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f217b7 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129574.920791:0:8410:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e3a4e00/0x40a459093b06a88c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21701 expref: 24 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129574.920800:0:8410:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f891e00/0x40a459093b06a934 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21763 expref: 6 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129574.920807:0:8410:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f890400/0x40a459093b06a92d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21755 expref: 13 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129574.920813:0:8410:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129574.920815:0:8410:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129574.920818:0:8410:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e0b4a00/0x40a459093b06a9b9 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [1683456->2097151] (req 1683456->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f217b7 expref: 24 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129574.920853:0:8410:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012f890400/0x40a459093b06a92d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21755 expref: 13 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129574.920863:0:8410:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012f890400/0x40a459093b06a92d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21755 expref: 13 pid: 22480 timeout: 930 lvb_type: 1 00000100:00100000:1.0:1746129574.920875:0:8410:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fa27480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8410:1830948737560064:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129574.920971:0:8410:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012f891e00/0x40a459093b06a934 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21763 expref: 6 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129574.920979:0:8410:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012f891e00/0x40a459093b06a934 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21763 expref: 6 pid: 22480 timeout: 930 lvb_type: 1 00000100:00100000:1.0:1746129574.920987:0:8410:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fa26d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8410:1830948737560192:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129574.921012:0:8410:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012e3a4e00/0x40a459093b06a88c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21701 expref: 24 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129574.921019:0:8410:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012e3a4e00/0x40a459093b06a88c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21701 expref: 24 pid: 7148 timeout: 930 lvb_type: 0 00000100:00100000:1.0:1746129574.921026:0:8410:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fa25880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8410:1830948737560320:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129574.921041:0:8410:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a6dc8240 going to sleep for 11 seconds 00000100:00100000:2.0:1746129574.931015:0:31523:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+22:1963:x1830948734241024:12345-192.168.202.4@tcp:4:multiop.0 Request processed in 21626us (22136us total) trans 21474841398 rc 0/0 00000100:00100000:2.0:1746129574.931029:0:31523:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2458 00002000:00100000:2.0:1746129574.931042:0:31523:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3ec:0x0] (757760->1048575) req@ffff8800947bca80 x1830948734241024/t21474841398(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:315/0 lens 488/448 e 0 to 0 dl 1746129585 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129574.931057:0:31523:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800947bca80 with x1830948734241024 ext(757760->1048575) 00010000:00010000:2.0:1746129574.931067:0:31523:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a6ca1a00/0x40a459093b06a981 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 757760->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2178d expref: 22 pid: 11014 timeout: 930 lvb_type: 0 00010000:00010000:2.0:1746129574.931082:0:31523:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a6ca1a00/0x40a459093b06a981 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 757760->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2178d expref: 22 pid: 11014 timeout: 930 lvb_type: 0 00002000:00010000:2.0:1746129574.931089:0:31523:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800947bca80 00000100:00100000:0.0:1746129574.931562:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129574.931585:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129574.931616:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129574.931639:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734241408 00000100:00100000:0.0:1746129574.931645:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734241408 00010000:00010000:0.0:1746129574.931676:0:9823:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012f891e00/0x40a459093b06a934 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21763 expref: 7 pid: 22480 timeout: 930 lvb_type: 1 00000100:00100000:0.0:1746129574.931697:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734241280 00000100:00100000:0.0:1746129574.931700:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734241280 00010000:00010000:0.0:1746129574.931708:0:9823:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012f890400/0x40a459093b06a92d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21755 expref: 14 pid: 22480 timeout: 930 lvb_type: 1 00000100:00100000:0.0:1746129574.931726:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734241536 00000100:00100000:0.0:1746129574.931728:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734241536 00010000:00010000:0.0:1746129574.931737:0:9823:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012e3a4e00/0x40a459093b06a88c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21701 expref: 25 pid: 7148 timeout: 930 lvb_type: 0 00000100:00100000:0.0:1746129574.931750:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8454 00000100:00100000:0.0:1746129574.931756:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:068dab75-d300-4ead-a742-d14572ad1e50+7:1963:x1830948734241408:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129574.931771:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129574.931792:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012f891e00/0x40a459093b06a934 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21763 expref: 7 pid: 22480 timeout: 930 lvb_type: 1 00010000:00010000:0.0:1746129574.931802:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012f891e00/0x40a459093b06a934 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21763 expref: 7 pid: 22480 timeout: 930 lvb_type: 1 00010000:00010000:0.0:1746129574.931828:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129574.931859:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:068dab75-d300-4ead-a742-d14572ad1e50+7:1963:x1830948734241408:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 103us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129574.931865:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8454 00000100:00100000:0.0:1746129574.931878:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8455 00000100:00100000:0.0:1746129574.931882:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6fd2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+14:1963:x1830948734241280:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129574.931889:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129574.931897:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012f890400/0x40a459093b06a92d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21755 expref: 14 pid: 22480 timeout: 930 lvb_type: 1 00010000:00010000:0.0:1746129574.931904:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012f890400/0x40a459093b06a92d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21755 expref: 14 pid: 22480 timeout: 930 lvb_type: 1 00010000:00010000:0.0:1746129574.931914:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129574.931927:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6fd2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+14:1963:x1830948734241280:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 45us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129574.931931:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8455 00000100:00100000:0.0:1746129574.931970:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8456 00000100:00100000:0.0:1746129574.931975:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ada2ffba-8920-4ecb-8068-68caa9806978+25:1963:x1830948734241536:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129574.931980:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129574.931986:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012e3a4e00/0x40a459093b06a88c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21701 expref: 25 pid: 7148 timeout: 930 lvb_type: 0 00010000:00010000:0.0:1746129574.931993:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012e3a4e00/0x40a459093b06a88c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21701 expref: 25 pid: 7148 timeout: 930 lvb_type: 0 00010000:00010000:0.0:1746129574.932002:0:9823:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129574.932004:0:9823:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129574.932012:0:9823:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e0b4a00/0x40a459093b06a9b9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1683456->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f217b7 expref: 25 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129574.932020:0:9823:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e0b4a00/0x40a459093b06a9b9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1683456->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f217b7 expref: 25 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129574.932051:0:9823:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012e0b4a00/0x40a459093b06a9b9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1683456->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f217b7 expref: 25 pid: 8410 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129574.932062:0:9823:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900f6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9823:1830948737560448:192.168.202.4@tcp:105: 00000100:00100000:0.0:1746129574.932102:0:9823:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934d2780 going to sleep for 11 seconds 00010000:00010000:1.0:1746129574.936875:0:8410:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f890400/0x40a459093b06a92d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21755 expref: 13 pid: 22480 timeout: 930 lvb_type: 1 00000100:00100000:1.0:1746129574.936898:0:8410:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fa27480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8410:1830948737560064:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129574.936911:0:8410:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f891e00/0x40a459093b06a934 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21763 expref: 6 pid: 22480 timeout: 930 lvb_type: 1 00000100:00100000:1.0:1746129574.936918:0:8410:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fa26d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8410:1830948737560192:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129574.936927:0:8410:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e3a4e00/0x40a459093b06a88c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21701 expref: 25 pid: 7148 timeout: 930 lvb_type: 0 00000100:00100000:1.0:1746129574.936935:0:8410:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fa25880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8410:1830948737560320:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129574.936965:0:8410:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012e0b4a00/0x40a459093b06a9b9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1683456->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f217b7 expref: 24 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129574.936979:0:8410:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e0b4a00, rc 0) 00000100:00100000:1.0:1746129574.937034:0:8410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ada2ffba-8920-4ecb-8068-68caa9806978+24:32426:x1830948734241152:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 16312us (18085us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129574.937044:0:8410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16458 00000100:00100000:1.0:1746129574.940521:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129574.940553:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734241664 00000100:00100000:2.0:1746129574.940563:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734241664 00010000:00010000:2.0:1746129574.940599:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6ca1a00/0x40a459093b06a981 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 757760->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2178d expref: 22 pid: 11014 timeout: 930 lvb_type: 0 00000100:00100000:2.0:1746129574.940638:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8457 00000100:00100000:2.0:1746129574.940647:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa25880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+22:1962:x1830948734241664:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129574.940661:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129574.940683:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a6ca1a00/0x40a459093b06a981 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 757760->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2178d expref: 22 pid: 11014 timeout: 930 lvb_type: 0 00010000:00010000:2.0:1746129574.940695:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a6ca1a00/0x40a459093b06a981 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 757760->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2178d expref: 22 pid: 11014 timeout: 930 lvb_type: 0 00010000:00010000:2.0:1746129574.940717:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a6ca1a00/0x40a459093b06a981 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 757760->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2178d expref: 22 pid: 11014 timeout: 930 lvb_type: 0 00010000:00010000:2.0:1746129574.940732:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129574.940735:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129574.940742:0:7085:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f890e00/0x40a459093b06a9b2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f217b0 expref: 39 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129574.940749:0:7085:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f890e00/0x40a459093b06a9b2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f217b0 expref: 39 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129574.940781:0:7085:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012f890e00/0x40a459093b06a9b2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f217b0 expref: 39 pid: 8410 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129574.940798:0:7085:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c079f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7085:1830948737560576:192.168.202.4@tcp:105: 00000100:00100000:2.0:1746129574.940878:0:7085:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009cdf39c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746129574.947501:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129574.947615:0:31523:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734241920 00000100:00100000:1.0:1746129574.947623:0:31523:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734241920 00000100:00100000:3.0:1746129574.947643:0:7085:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c079f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7085:1830948737560576:192.168.202.4@tcp:105: 00010000:00010000:3.0:1746129574.947665:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:1.0:1746129574.947666:0:31523:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f4:0x0] (1683456->1687551) req@ffff88009fa26d80 x1830948734241920/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:315/0 lens 488/0 e 0 to 0 dl 1746129585 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129574.947675:0:31523:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fa26d80 with x1830948734241920 ext(1683456->1687551) 00002000:00010000:1.0:1746129574.947680:0:31523:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fa26d80 00000100:00100000:1.0:1746129574.947700:0:31523:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7927 00000100:00100000:1.0:1746129574.947708:0:31523:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ada2ffba-8920-4ecb-8068-68caa9806978+24:1962:x1830948734241920:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:3.0:1746129574.947709:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa25880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:1962:x1830948734241664:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 7064us (7195us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129574.947717:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8457 00000100:00100000:1.0:1746129574.947888:0:31523:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ada2ffba-8920-4ecb-8068-68caa9806978+24:1962:x1830948734241920:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 180us (395us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746129574.947893:0:31523:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7927 00002000:00100000:1.0:1746129574.947898:0:31523:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f4:0x0] (1683456->1687551) req@ffff88009fa26d80 x1830948734241920/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:315/0 lens 488/4536 e 0 to 0 dl 1746129585 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129574.947904:0:31523:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fa26d80 with x1830948734241920 ext(1683456->1687551) 00002000:00010000:1.0:1746129574.947907:0:31523:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fa26d80 00000100:00100000:0.0:1746129574.948446:0:9823:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900f6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9823:1830948737560448:192.168.202.4@tcp:105: 00010000:00010000:0.0:1746129574.948457:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129574.948481:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ada2ffba-8920-4ecb-8068-68caa9806978+23:1963:x1830948734241536:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 16505us (16864us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129574.948487:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8456 00000100:00100000:0.0:1746129574.954181:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129574.954255:0:31523:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734242176 00000100:00100000:1.0:1746129574.954266:0:31523:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734242176 00002000:00100000:1.0:1746129574.954337:0:31523:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3ec:0x0] (0->1048575) req@ffff8800900f6a00 x1830948734242176/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:315/0 lens 488/0 e 0 to 0 dl 1746129585 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129574.954347:0:31523:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800900f6a00 with x1830948734242176 ext(0->1048575) 00002000:00010000:1.0:1746129574.954352:0:31523:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800900f6a00 00000100:00100000:1.0:1746129574.954384:0:31523:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7928 00000100:00100000:1.0:1746129574.954392:0:31523:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ada2ffba-8920-4ecb-8068-68caa9806978+40:1963:x1830948734242176:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:1.0:1746129574.980312:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129574.980777:0:31523:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ada2ffba-8920-4ecb-8068-68caa9806978+40:1963:x1830948734242176:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 26382us (26603us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129574.980789:0:31523:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7928 00002000:00100000:0.0:1746129574.980802:0:31523:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3ec:0x0] (0->1048575) req@ffff8800900f6a00 x1830948734242176/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:315/0 lens 488/440 e 0 to 0 dl 1746129585 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129574.980811:0:31523:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800900f6a00 with x1830948734242176 ext(0->1048575) 00002000:00010000:0.0:1746129574.980817:0:31523:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800900f6a00 00000100:00100000:3.0:1746129574.982447:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734242432 00000100:00100000:3.0:1746129574.982459:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734242432 00000100:00100000:3.0:1746129574.982515:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4797 00000100:00100000:3.0:1746129574.982522:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ada2ffba-8920-4ecb-8068-68caa9806978+302:32426:x1830948734242432:12345-192.168.202.4@tcp:35:multiop.0 00000100:00100000:3.0:1746129574.982741:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ada2ffba-8920-4ecb-8068-68caa9806978+303:32426:x1830948734242432:12345-192.168.202.4@tcp:35:multiop.0 Request processed in 218us (2452us total) trans 8589945384 rc 0/0 00000100:00100000:3.0:1746129574.982748:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4797 00000100:00100000:1.0:1746129575.013335:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129575.013364:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129575.013439:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129575.013466:0:8410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734242560 00000100:00100000:1.0:1746129575.013476:0:8410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734242560 00000100:00100000:1.0:1746129575.013522:0:8410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734242688 00000100:00100000:1.0:1746129575.013525:0:8410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734242688 00000100:00100000:1.0:1746129575.013551:0:8410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734242816 00000100:00100000:1.0:1746129575.013554:0:8410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734242816 00000100:00100000:1.0:1746129575.013571:0:8410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16459 00000100:00100000:1.0:1746129575.013579:0:8410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:1960:x1830948734242560:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129575.013598:0:8410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129575.013617:0:8410:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a60b2e00/0x40a459093b06a9c0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f217be expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129575.013639:0:8410:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129575.013642:0:8410:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129575.013651:0:8410:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a60b2e00/0x40a459093b06a9c0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f217be expref: 22 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129575.013668:0:8410:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a60b2e00/0x40a459093b06a9c0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f217be expref: 22 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129575.013679:0:8410:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a60b2e00, rc 0) 00000100:00100000:1.0:1746129575.013727:0:8410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+22:1960:x1830948734242560:12345-192.168.202.4@tcp:101:cat.0 Request processed in 149us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129575.013733:0:8410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16459 00000100:00100000:1.0:1746129575.013749:0:8410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16460 00000100:00100000:1.0:1746129575.013754:0:8410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ada2ffba-8920-4ecb-8068-68caa9806978+23:32432:x1830948734242688:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129575.013761:0:8410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129575.013771:0:8410:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a60b2000/0x40a459093b06a9c7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f217c5 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129575.013789:0:8410:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a05baa00/0x40a459093b06a988 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1462271) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21794 expref: 13 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129575.013796:0:8410:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129575.013797:0:8410:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129575.013799:0:8410:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a60b2000/0x40a459093b06a9c7 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f217c5 expref: 24 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129575.013827:0:8410:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a05baa00/0x40a459093b06a988 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1462271) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21794 expref: 13 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129575.013840:0:8410:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a05baa00/0x40a459093b06a988 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1462271) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21794 expref: 13 pid: 11014 timeout: 930 lvb_type: 0 00000100:00100000:1.0:1746129575.013853:0:8410:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095627100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8410:1830948737560704:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129575.013912:0:8410:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a6dc8240 going to sleep for 11 seconds 00000100:00080000:1.0:1746129575.013928:0:7097:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1746129575.013932:0:7097:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746129575.013944:0:4699:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16461 00000100:00100000:1.0:1746129575.013950:0:4699:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095624700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+13:1961:x1830948734242816:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129575.013956:0:4699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129575.013963:0:4699:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a60b2c00/0x40a459093b06a9ce lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f217cc expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129575.013992:0:4699:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135720e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4699:1830948737560832:192.168.202.4@tcp:106: 00000100:00100000:1.0:1746129575.014013:0:4699:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a6dc8300 going to sleep for 11 seconds 00000100:00100000:1.0:1746129575.015839:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129575.017856:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734242944 00000100:00100000:0.0:1746129575.017867:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734242944 00000100:00100000:0.0:1746129575.017915:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16462 00000100:00100000:0.0:1746129575.017922:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135723800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+22:1961:x1830948734242944:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129575.017940:0:7149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129575.017956:0:7149:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ee7ee00/0x40a459093b06a9d5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f217d3 expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129575.018054:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900f5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7149:1830948737560960:192.168.202.4@tcp:106: 00000100:00100000:0.0:1746129575.018143:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4123a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746129575.019030:0:4699:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135720e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4699:1830948737560832:192.168.202.4@tcp:106: 00010000:00010000:1.0:1746129575.019061:0:4699:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a60b2c00/0x40a459093b06a9ce lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f217cc expref: 14 pid: 4699 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129575.019072:0:4699:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a60b2c00/0x40a459093b06a9ce lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f217cc expref: 14 pid: 4699 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129575.019080:0:4699:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a60b2c00, rc 0) 00000100:00100000:1.0:1746129575.019119:0:4699:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095624700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+13:1961:x1830948734242816:12345-192.168.202.4@tcp:101:cat.0 Request processed in 5169us (5679us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129575.019127:0:4699:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16461 00000100:00100000:0.0:1746129575.019437:0:8410:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095627100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8410:1830948737560704:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129575.019454:0:8410:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a60b2000/0x40a459093b06a9c7 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f217c5 expref: 24 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129575.019465:0:8410:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a60b2000, rc 0) 00000100:00100000:0.0:1746129575.019484:0:8410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ada2ffba-8920-4ecb-8068-68caa9806978+24:32432:x1830948734242688:12345-192.168.202.4@tcp:101:cat.0 Request processed in 5730us (6119us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129575.019490:0:8410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16460 00000100:00100000:2.0:1746129575.019777:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129575.019839:0:31523:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734243072 00000100:00100000:2.0:1746129575.019844:0:31523:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734243072 00002000:00100000:2.0:1746129575.019878:0:31523:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->1462271) req@ffff88009c07bb80 x1830948734243072/t0(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:316/0 lens 488/0 e 0 to 0 dl 1746129586 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129575.019887:0:31523:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c07bb80 with x1830948734243072 ext(1048576->1462271) 00010000:00010000:2.0:1746129575.019894:0:31523:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a05baa00/0x40a459093b06a988 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1462271) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21794 expref: 13 pid: 11014 timeout: 930 lvb_type: 0 00010000:00010000:2.0:1746129575.019907:0:31523:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a05baa00/0x40a459093b06a988 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1462271) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21794 expref: 13 pid: 11014 timeout: 930 lvb_type: 0 00002000:00010000:2.0:1746129575.019913:0:31523:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c07bb80 00002000:00010000:0.0:1746129575.020214:0:7149:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb blocks from disk: 2077 -> 2079 00000100:00100000:0.0:1746129575.020220:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900f5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7149:1830948737560960:192.168.202.4@tcp:106: 00010000:00010000:0.0:1746129575.020236:0:7149:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ee7ee00/0x40a459093b06a9d5 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f217d3 expref: 23 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129575.020245:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ee7ee00/0x40a459093b06a9d5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f217d3 expref: 23 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129575.020253:0:7149:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ee7ee00, rc 0) 00000100:00100000:0.0:1746129575.020275:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135723800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+22:1961:x1830948734242944:12345-192.168.202.4@tcp:101:cat.0 Request processed in 2353us (4443us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129575.020318:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16462 00000100:00100000:2.0:1746129575.021390:0:31523:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2459 00000100:00100000:2.0:1746129575.021402:0:31523:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c07bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+13:1960:x1830948734243072:12345-192.168.202.4@tcp:4:multiop.0 00000001:00080000:2.0:1746129575.025336:0:564:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841387 is committed 00000001:00080000:2.0:1746129575.025376:0:564:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841396 is committed 00000001:00080000:2.0:1746129575.025388:0:564:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841376 is committed 00000001:00080000:2.0:1746129575.025406:0:564:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841372 is committed 00000001:00080000:2.0:1746129575.025417:0:564:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841367 is committed 00000001:00080000:2.0:1746129575.025466:0:564:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841368 is committed 00000001:00080000:2.0:1746129575.025487:0:564:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841397 is committed 00000001:00080000:2.0:1746129575.025511:0:564:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841377 is committed 00000001:00080000:2.0:1746129575.025527:0:564:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841369 is committed 00000100:00100000:3.0:1746129575.036170:0:31523:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c07bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+15:1960:x1830948734243072:12345-192.168.202.4@tcp:4:multiop.0 Request processed in 14762us (16384us total) trans 17179874150 rc 0/0 00000100:00100000:3.0:1746129575.036184:0:31523:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2459 00002000:00100000:3.0:1746129575.036196:0:31523:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->1462271) req@ffff88009c07bb80 x1830948734243072/t17179874150(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:316/0 lens 488/448 e 0 to 0 dl 1746129586 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129575.036205:0:31523:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c07bb80 with x1830948734243072 ext(1048576->1462271) 00010000:00010000:3.0:1746129575.036216:0:31523:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a05baa00/0x40a459093b06a988 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1462271) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21794 expref: 15 pid: 11014 timeout: 930 lvb_type: 0 00010000:00010000:3.0:1746129575.036233:0:31523:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a05baa00/0x40a459093b06a988 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1462271) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21794 expref: 15 pid: 11014 timeout: 930 lvb_type: 0 00002000:00010000:3.0:1746129575.036241:0:31523:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c07bb80 00000100:00100000:0.0:1746129575.036923:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129575.036977:0:31523:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734243328 00000100:00100000:3.0:1746129575.036986:0:31523:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734243328 00002000:00100000:3.0:1746129575.037024:0:31523:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3ec:0x0] (0->1048575) req@ffff8800900f5c00 x1830948734243328/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:316/0 lens 488/0 e 0 to 0 dl 1746129586 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129575.037038:0:31523:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800900f5c00 with x1830948734243328 ext(0->1048575) 00002000:00010000:3.0:1746129575.037042:0:31523:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800900f5c00 00000100:00100000:3.0:1746129575.037059:0:31523:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7929 00000100:00100000:3.0:1746129575.037067:0:31523:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+10:1960:x1830948734243328:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129575.038785:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129575.038859:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734243456 00000100:00100000:1.0:1746129575.038867:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734243456 00010000:00010000:1.0:1746129575.038900:0:9823:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a05baa00/0x40a459093b06a988 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1462271) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21794 expref: 15 pid: 11014 timeout: 930 lvb_type: 0 00000100:00100000:1.0:1746129575.038934:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8458 00000100:00100000:1.0:1746129575.038940:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+15:1962:x1830948734243456:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129575.038952:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129575.038972:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a05baa00/0x40a459093b06a988 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1462271) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21794 expref: 15 pid: 11014 timeout: 930 lvb_type: 0 00010000:00010000:1.0:1746129575.038984:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a05baa00/0x40a459093b06a988 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1462271) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21794 expref: 15 pid: 11014 timeout: 930 lvb_type: 0 00010000:00010000:1.0:1746129575.039007:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a05baa00/0x40a459093b06a988 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1462271) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21794 expref: 15 pid: 11014 timeout: 930 lvb_type: 0 00010000:00010000:1.0:1746129575.039027:0:9823:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129575.039029:0:9823:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129575.039036:0:9823:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a60b2000/0x40a459093b06a9c7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f217c5 expref: 23 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129575.039044:0:9823:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a60b2000/0x40a459093b06a9c7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f217c5 expref: 23 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129575.039075:0:9823:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a60b2000/0x40a459093b06a9c7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f217c5 expref: 23 pid: 8410 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129575.039087:0:9823:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135720e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9823:1830948737561088:192.168.202.4@tcp:105: 00000100:00100000:1.0:1746129575.039172:0:9823:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a00c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746129575.043153:0:9823:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135720e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9823:1830948737561088:192.168.202.4@tcp:105: 00010000:00010000:0.0:1746129575.043173:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129575.043225:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+14:1962:x1830948734243456:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 4284us (4443us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129575.043237:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8458 00000100:00100000:0.0:1746129575.049411:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129575.049450:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129575.049550:0:31518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734243712 00000100:00100000:1.0:1746129575.049563:0:31518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734243712 00002000:00100000:1.0:1746129575.049609:0:31518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff880095627100 x1830948734243712/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:316/0 lens 488/0 e 0 to 0 dl 1746129586 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129575.049619:0:31518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095627100 with x1830948734243712 ext(1048576->2097151) 00002000:00010000:1.0:1746129575.049625:0:31518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095627100 00000100:00100000:1.0:1746129575.049641:0:31518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734243968 00000100:00100000:1.0:1746129575.049643:0:31518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734243968 00002000:00100000:1.0:1746129575.049650:0:31518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3f4:0x0] (1048576->1683455) req@ffff88012b551180 x1830948734243968/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:316/0 lens 488/0 e 0 to 0 dl 1746129586 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129575.049656:0:31518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b551180 with x1830948734243968 ext(1048576->1683455) 00002000:00010000:1.0:1746129575.049659:0:31518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b551180 00000100:00100000:1.0:1746129575.049670:0:31518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7930 00000100:00100000:1.0:1746129575.049676:0:31518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095627100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ada2ffba-8920-4ecb-8068-68caa9806978+25:1962:x1830948734243712:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:2.0:1746129575.049844:0:31519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7931 00000100:00100000:2.0:1746129575.049850:0:31519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b551180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ada2ffba-8920-4ecb-8068-68caa9806978+25:1962:x1830948734243968:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:3.0:1746129575.054491:0:31523:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+10:1960:x1830948734243328:12345-192.168.202.4@tcp:3:cat.0 Request processed in 17413us (17564us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129575.054502:0:31523:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7929 00002000:00100000:3.0:1746129575.054513:0:31523:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3ec:0x0] (0->1048575) req@ffff8800900f5c00 x1830948734243328/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:316/0 lens 488/440 e 0 to 0 dl 1746129586 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129575.054523:0:31523:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800900f5c00 with x1830948734243328 ext(0->1048575) 00002000:00010000:3.0:1746129575.054529:0:31523:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800900f5c00 00000100:00100000:3.0:1746129575.067864:0:31519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b551180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ada2ffba-8920-4ecb-8068-68caa9806978+26:1962:x1830948734243968:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 18000us (18400us total) trans 0 rc 634880/634880 00000100:00100000:3.0:1746129575.067876:0:31519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7931 00002000:00100000:3.0:1746129575.067887:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f4:0x0] (1048576->1683455) req@ffff88012b551180 x1830948734243968/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:316/0 lens 488/440 e 0 to 0 dl 1746129586 ref 1 fl Complete:/200/0 rc 634880/634880 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129575.067897:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b551180 with x1830948734243968 ext(1048576->1683455) 00002000:00010000:3.0:1746129575.067904:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b551180 00000100:00100000:0.0:1746129575.076287:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129575.076833:0:31518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095627100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ada2ffba-8920-4ecb-8068-68caa9806978+24:1962:x1830948734243712:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 27149us (27426us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129575.076845:0:31518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7930 00002000:00100000:1.0:1746129575.076857:0:31518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff880095627100 x1830948734243712/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:316/0 lens 488/440 e 0 to 0 dl 1746129586 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129575.076865:0:31518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095627100 with x1830948734243712 ext(1048576->2097151) 00002000:00010000:1.0:1746129575.076872:0:31518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095627100 00000100:00100000:2.0:1746129575.077243:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734244096 00000100:00100000:2.0:1746129575.077252:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734244096 00000100:00100000:0.0:1746129575.078606:0:8410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16463 00000100:00100000:0.0:1746129575.078623:0:8410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b551c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+14:32436:x1830948734244096:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129575.078644:0:8410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129575.078664:0:8410:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a95e6400/0x40a459093b06a9dc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f217da expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129575.078691:0:8410:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129575.078693:0:8410:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129575.078700:0:8410:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a95e6400/0x40a459093b06a9dc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f217da expref: 15 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129575.078715:0:8410:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a95e6400/0x40a459093b06a9dc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f217da expref: 15 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129575.078726:0:8410:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a95e6400, rc 0) 00000100:00100000:0.0:1746129575.078794:0:8410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b551c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+15:32436:x1830948734244096:12345-192.168.202.4@tcp:101:cat.0 Request processed in 178us (2522us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129575.078801:0:8410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16463 00000100:00100000:0.0:1746129575.095038:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129575.095128:0:31518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734244352 00000100:00100000:1.0:1746129575.095142:0:31518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734244352 00002000:00100000:1.0:1746129575.095198:0:31518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff8800903a1c00 x1830948734244352/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:316/0 lens 488/0 e 0 to 0 dl 1746129586 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129575.095209:0:31518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800903a1c00 with x1830948734244352 ext(1048576->2097151) 00002000:00010000:1.0:1746129575.095216:0:31518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800903a1c00 00000100:00100000:1.0:1746129575.095259:0:31518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7932 00000100:00100000:1.0:1746129575.095267:0:31518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800903a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+15:1962:x1830948734244352:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:1.0:1746129575.108748:0:31518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800903a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+15:1962:x1830948734244352:12345-192.168.202.4@tcp:3:cat.0 Request processed in 13470us (13706us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129575.108761:0:31518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7932 00002000:00100000:1.0:1746129575.108773:0:31518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff8800903a1c00 x1830948734244352/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:316/0 lens 488/440 e 0 to 0 dl 1746129586 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129575.108783:0:31518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800903a1c00 with x1830948734244352 ext(1048576->2097151) 00002000:00010000:1.0:1746129575.108790:0:31518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800903a1c00 00000100:00100000:3.0:1746129575.114519:0:3302:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1746129575.114547:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093edfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737561216:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1746129575.114620:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129575.114768:0:8414:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737561216 00000100:00100000:2.0:1746129575.114778:0:8414:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737561216 00000100:00100000:2.0:1746129575.114830:0:8414:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:2.0:1746129575.114837:0:8414:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1830948737561216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1746129575.114863:0:8414:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 1703936 granted 611254272 pending 1703936 free 3852468224 avail 3830448128 00000100:00100000:2.0:1746129575.114902:0:8414:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1830948737561216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 66us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129575.114908:0:8414:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:3.0:1746129575.114992:0:3302:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474841396 gen 2 00000004:00080000:3.0:1746129575.114998:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013577fb80, transno 21474841338 00000004:00080000:3.0:1746129575.115005:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800900f5500, transno 21474841339 00000004:00080000:3.0:1746129575.115008:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013577ce00, transno 21474841340 00000004:00080000:3.0:1746129575.115010:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800900f5f80, transno 21474841341 00000004:00080000:3.0:1746129575.115013:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013577d880, transno 21474841342 00000004:00080000:3.0:1746129575.115015:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800900f7800, transno 21474841343 00000004:00080000:3.0:1746129575.115018:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013577dc00, transno 21474841344 00000004:00080000:3.0:1746129575.115021:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800900f5880, transno 21474841345 00000004:00080000:3.0:1746129575.115024:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800900f6680, transno 21474841346 00000004:00080000:3.0:1746129575.115026:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f44b480, transno 21474841347 00000004:00080000:3.0:1746129575.115028:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f449180, transno 21474841348 00000004:00080000:3.0:1746129575.115034:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f448380, transno 21474841349 00000004:00080000:3.0:1746129575.115036:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f448700, transno 21474841350 00000004:00080000:3.0:1746129575.115038:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f449880, transno 21474841351 00000004:00080000:3.0:1746129575.115040:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f44aa00, transno 21474841352 00000004:00080000:3.0:1746129575.115043:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f44ad80, transno 21474841353 00000004:00080000:3.0:1746129575.115045:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c07a680, transno 21474841354 00000004:00080000:3.0:1746129575.115048:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f44bb80, transno 21474841355 00000004:00080000:3.0:1746129575.115050:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094028700, transno 21474841356 00000004:00080000:3.0:1746129575.115053:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009402a680, transno 21474841357 00000004:00080000:3.0:1746129575.115055:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094028a80, transno 21474841358 00000004:00080000:3.0:1746129575.115057:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094029f80, transno 21474841359 00000004:00080000:3.0:1746129575.115059:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009402ad80, transno 21474841360 00000004:00080000:3.0:1746129575.115061:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094029880, transno 21474841361 00000004:00080000:3.0:1746129575.115063:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094029500, transno 21474841362 00000004:00080000:3.0:1746129575.115066:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009402bb80, transno 21474841363 00000004:00080000:3.0:1746129575.115068:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f95b480, transno 21474841364 00000004:00080000:3.0:1746129575.115070:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b553100, transno 21474841379 00000004:00080000:3.0:1746129575.115073:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800900f5180, transno 21474841380 00000004:00080000:3.0:1746129575.115077:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b550700, transno 21474841381 00000004:00080000:3.0:1746129575.115080:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094065500, transno 21474841382 00000004:00080000:3.0:1746129575.115082:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b552680, transno 21474841383 00000004:00080000:3.0:1746129575.115084:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800900f4700, transno 21474841384 00000004:00080000:3.0:1746129575.115086:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e388e00, transno 21474841385 00000004:00080000:3.0:1746129575.115089:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b552d80, transno 21474841386 00000004:00080000:3.0:1746129575.115091:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800900f4380, transno 21474841387 00000004:00080000:3.0:1746129575.115093:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135722680, transno 21474841388 00000004:00080000:3.0:1746129575.115096:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135721500, transno 21474841389 00000004:00080000:3.0:1746129575.115098:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135722300, transno 21474841390 00000004:00080000:3.0:1746129575.115101:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135721880, transno 21474841391 00000004:00080000:3.0:1746129575.115102:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135722a00, transno 21474841392 00000004:00080000:3.0:1746129575.115104:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135721f80, transno 21474841393 00000004:00080000:3.0:1746129575.115106:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135723480, transno 21474841394 00000004:00080000:3.0:1746129575.115108:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135721c00, transno 21474841395 00000004:00080000:3.0:1746129575.115109:0:3302:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135722d80, transno 21474841396 00000100:00100000:3.0:1746129575.115119:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093edfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737561216:0@lo:13:osp-pre-0-0.0 00000004:00080000:3.0:1746129575.115568:0:14586:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 45 done 00000100:00080000:0.0:1746129575.115641:0:7097:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746129575.127376:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129575.127467:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734244480 00000100:00100000:2.0:1746129575.127474:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734244480 00000100:00100000:2.0:1746129575.127510:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16464 00000100:00100000:2.0:1746129575.127516:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093eddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+15:32436:x1830948734244480:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129575.127529:0:7149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129575.127544:0:7149:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008fbb7000/0x40a459093b06a9e3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f217e1 expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129575.127568:0:7149:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e0b4a00/0x40a459093b06a9b9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1683456->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f217b7 expref: 23 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129575.127575:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129575.127576:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129575.127580:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fbb7000/0x40a459093b06a9e3 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f217e1 expref: 16 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129575.127602:0:7149:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012e0b4a00/0x40a459093b06a9b9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1683456->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f217b7 expref: 23 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129575.127611:0:7149:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012e0b4a00/0x40a459093b06a9b9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1683456->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f217b7 expref: 23 pid: 8410 timeout: 930 lvb_type: 0 00000100:00100000:2.0:1746129575.127620:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c078700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7149:1830948737561344:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129575.127693:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b5354840 going to sleep for 11 seconds 00000100:00100000:2.0:1746129575.137258:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c078700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7149:1830948737561344:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129575.137328:0:7149:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008fbb7000/0x40a459093b06a9e3 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f217e1 expref: 16 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129575.137345:0:7149:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fbb7000, rc 0) 00000100:00100000:2.0:1746129575.137383:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093eddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+16:32436:x1830948734244480:12345-192.168.202.4@tcp:101:cat.0 Request processed in 9866us (10014us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129575.137390:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16464 00000100:00100000:3.0:1746129575.148111:0:3301:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1746129575.148133:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135720700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737561472:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1746129575.148202:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129575.148324:0:12977:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737561472 00000100:00100000:0.0:1746129575.148334:0:12977:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737561472 00000100:00100000:0.0:1746129575.148384:0:12977:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:0.0:1746129575.148392:0:12977:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1830948737561472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1746129575.148417:0:12977:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 1703936 granted 611123200 pending 8519680 free 3853516800 avail 3851419648 00000100:00100000:0.0:1746129575.148457:0:12977:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1830948737561472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129575.148462:0:12977:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00080000:1.0:1746129575.148534:0:7097:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746129575.148597:0:3301:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179874144 gen 2 00000004:00080000:3.0:1746129575.148603:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013577d500, transno 17179874095 00000004:00080000:3.0:1746129575.148609:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013577f100, transno 17179874096 00000004:00080000:3.0:1746129575.148611:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013577f480, transno 17179874097 00000004:00080000:3.0:1746129575.148614:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013577e680, transno 17179874098 00000004:00080000:3.0:1746129575.148616:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013577c380, transno 17179874099 00000004:00080000:3.0:1746129575.148619:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013577ed80, transno 17179874100 00000004:00080000:3.0:1746129575.148621:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013577c700, transno 17179874101 00000004:00080000:3.0:1746129575.148623:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013577d180, transno 17179874102 00000004:00080000:3.0:1746129575.148625:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013145ce00, transno 17179874103 00000004:00080000:3.0:1746129575.148628:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013145d180, transno 17179874104 00000004:00080000:3.0:1746129575.148630:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013145d880, transno 17179874105 00000004:00080000:3.0:1746129575.148632:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013145e300, transno 17179874106 00000004:00080000:3.0:1746129575.148634:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f449f80, transno 17179874107 00000004:00080000:3.0:1746129575.148636:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f449500, transno 17179874108 00000004:00080000:3.0:1746129575.148639:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f44b100, transno 17179874109 00000004:00080000:3.0:1746129575.148642:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f448a80, transno 17179874110 00000004:00080000:3.0:1746129575.148644:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e38b100, transno 17179874111 00000004:00080000:3.0:1746129575.148647:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e38a680, transno 17179874112 00000004:00080000:3.0:1746129575.148649:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e38aa00, transno 17179874113 00000004:00080000:3.0:1746129575.148650:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e389500, transno 17179874114 00000004:00080000:3.0:1746129575.148652:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e389180, transno 17179874115 00000004:00080000:3.0:1746129575.148654:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e38b480, transno 17179874116 00000004:00080000:3.0:1746129575.148656:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e388a80, transno 17179874117 00000004:00080000:3.0:1746129575.148658:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e388000, transno 17179874118 00000004:00080000:3.0:1746129575.148661:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093edc380, transno 17179874129 00000004:00080000:3.0:1746129575.148663:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093edd500, transno 17179874130 00000004:00080000:3.0:1746129575.148665:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092fd1180, transno 17179874131 00000004:00080000:3.0:1746129575.148668:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093eddc00, transno 17179874132 00000004:00080000:3.0:1746129575.148670:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093edce00, transno 17179874133 00000004:00080000:3.0:1746129575.148672:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092fd2a00, transno 17179874134 00000004:00080000:3.0:1746129575.148674:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093eded80, transno 17179874135 00000004:00080000:3.0:1746129575.148676:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f44b800, transno 17179874136 00000004:00080000:3.0:1746129575.148679:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a77b1500, transno 17179874137 00000004:00080000:3.0:1746129575.148681:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f37d180, transno 17179874138 00000004:00080000:3.0:1746129575.148684:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a77b0700, transno 17179874139 00000004:00080000:3.0:1746129575.148686:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094f46680, transno 17179874140 00000004:00080000:3.0:1746129575.148688:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a77b0380, transno 17179874141 00000004:00080000:3.0:1746129575.148691:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f37e680, transno 17179874142 00000004:00080000:3.0:1746129575.148693:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a77b1880, transno 17179874143 00000004:00080000:3.0:1746129575.148695:0:3301:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094f44000, transno 17179874144 00000100:00100000:3.0:1746129575.148705:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135720700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737561472:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1746129575.148726:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c078700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f03f6bde-e986-4df5-86c3-48805e205677:3301:1830948737561600:0@lo:400:kworker.0 00000100:00100000:3.0:1746129575.148759:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129575.148842:0:14543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737561600 00000100:00100000:1.0:1746129575.148845:0:14543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737561600 00000100:00100000:1.0:1746129575.148869:0:14543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1746129575.148874:0:14543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098ecd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f03f6bde-e986-4df5-86c3-48805e205677+18:3301:x1830948737561600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746129575.148904:0:14543:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098ecd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f03f6bde-e986-4df5-86c3-48805e205677+18:3301:x1830948737561600:12345-0@lo:400:kworker.0 Request processed in 30us (144us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129575.148909:0:14543:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1746129575.148921:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c079c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1830948737561984:0@lo:400:kworker.0 00000100:00100000:1.0:1746129575.148937:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c078380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1830948737561856:0@lo:400:kworker.0 00000100:00100000:1.0:1746129575.148961:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129575.148977:0:3303:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1746129575.148982:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c07b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1830948737561728:0@lo:400:kworker.0 00000100:00100000:1.0:1746129575.149004:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737561856 00000100:00100000:1.0:1746129575.149007:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737561856 00000100:00100000:2.0:1746129575.149008:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129575.149034:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737561984 00000100:00100000:1.0:1746129575.149035:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737561984 00000100:00100000:1.0:1746129575.149049:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1746129575.149053:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135720380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1830948737561856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746129575.149064:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129575.149102:0:15096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737561728 00000100:00100000:3.0:1746129575.149105:0:15096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737561728 00000100:00100000:3.0:1746129575.149124:0:15096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1746129575.149127:0:15096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c079500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1830948737561984:12345-0@lo:400:kworker.0 00000004:00080000:0.0:1746129575.149757:0:14589:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 40 done 00000100:00100000:0.0:1746129575.149774:0:16908:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1746129575.149780:0:16908:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c07a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1830948737561728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746129575.149832:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135720380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1830948737561856:12345-0@lo:400:kworker.0 Request processed in 778us (870us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129575.149837:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00080000:1.0:1746129575.149852:0:7097:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746129575.149888:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c078700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f03f6bde-e986-4df5-86c3-48805e205677:3301:1830948737561600:0@lo:400:kworker.0 00000100:00100000:3.0:1746129575.150196:0:15096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c079500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1830948737561984:12345-0@lo:400:kworker.0 Request processed in 1067us (1200us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129575.150201:0:15096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1746129575.150202:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c078380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1830948737561856:0@lo:400:kworker.0 00000100:00100000:3.0:1746129575.150230:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c079c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1830948737561984:0@lo:400:kworker.0 00000100:00100000:1.0:1746129575.150500:0:16908:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c07a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1830948737561728:12345-0@lo:400:kworker.0 Request processed in 720us (1435us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129575.150506:0:16908:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1746129575.152146:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c07b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1830948737561728:0@lo:400:kworker.0 00000100:00100000:2.0:1746129575.152354:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129575.152417:0:31518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734244608 00000100:00100000:1.0:1746129575.152431:0:31518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734244608 00002000:00100000:1.0:1746129575.152476:0:31518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3f4:0x0] (1683456->2097151) req@ffff88009c07b480 x1830948734244608/t0(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:316/0 lens 488/0 e 0 to 0 dl 1746129586 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129575.152486:0:31518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c07b480 with x1830948734244608 ext(1683456->2097151) 00010000:00010000:1.0:1746129575.152495:0:31518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012e0b4a00/0x40a459093b06a9b9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1683456->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f217b7 expref: 24 pid: 8410 timeout: 930 lvb_type: 0 00010000:00010000:1.0:1746129575.152509:0:31518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012e0b4a00/0x40a459093b06a9b9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1683456->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f217b7 expref: 24 pid: 8410 timeout: 930 lvb_type: 0 00002000:00010000:1.0:1746129575.152517:0:31518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c07b480 00000100:00100000:1.0:1746129575.153240:0:31518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2460 00000100:00100000:1.0:1746129575.153250:0:31518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c07b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ada2ffba-8920-4ecb-8068-68caa9806978+24:1962:x1830948734244608:12345-192.168.202.4@tcp:4:cat.0 00000100:00100000:0.0:1746129575.155729:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129575.155903:0:16908:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734244864 00000100:00100000:2.0:1746129575.155977:0:16908:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734244864 00000100:00100000:2.0:1746129575.156081:0:16908:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11281 00000100:00100000:2.0:1746129575.156089:0:16908:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093edc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+16:32440:x1830948734244864:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:2.0:1746129575.156108:0:16908:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129575.156123:0:16908:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fbb6000/0x40a459093b06a9ea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f217e8 expref: -99 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129575.156198:0:16908:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fbb7400/0x40a459093b06a9f1 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129575.156212:0:16908:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3a4000/0x40a459093b06a8fc lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21747 expref: 14 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129575.156218:0:16908:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094fee600/0x40a459093b06a918 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2174e expref: 17 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129575.156225:0:16908:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f13200/0x40a459093b06a965 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21778 expref: 302 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129575.156231:0:16908:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fbb7400/0x40a459093b06a9f1 lrc: 6/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129575.156261:0:16908:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880095f13200/0x40a459093b06a965 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21778 expref: 302 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129575.156270:0:16908:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f13200/0x40a459093b06a965 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21778 expref: 302 pid: 14549 timeout: 930 lvb_type: 0 00000100:00100000:2.0:1746129575.156290:0:16908:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c078380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16908:1830948737562112:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129575.156413:0:16908:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094fee600/0x40a459093b06a918 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2174e expref: 17 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129575.156420:0:16908:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094fee600/0x40a459093b06a918 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2174e expref: 17 pid: 16908 timeout: 930 lvb_type: 0 00000100:00100000:2.0:1746129575.156427:0:16908:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c079f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16908:1830948737562240:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129575.156451:0:16908:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3a4000/0x40a459093b06a8fc lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21747 expref: 14 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129575.156458:0:16908:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3a4000/0x40a459093b06a8fc lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21747 expref: 14 pid: 16908 timeout: 930 lvb_type: 0 00000100:00100000:2.0:1746129575.156465:0:16908:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c078e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16908:1830948737562368:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129575.156484:0:16908:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b5354840 going to sleep for 11 seconds 00000100:00100000:3.0:1746129575.161014:0:16908:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c078380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16908:1830948737562112:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129575.161957:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129575.161983:0:16908:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c079f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16908:1830948737562240:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129575.162048:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129575.162049:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734245120 00000100:00100000:0.0:1746129575.162057:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734245120 00000100:00080000:2.0:1746129575.162089:0:7097:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1746129575.162102:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095f13200/0x40a459093b06a965 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21778 expref: 303 pid: 14549 timeout: 930 lvb_type: 0 00000100:00100000:2.0:1746129575.162111:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734244992 00000100:00100000:2.0:1746129575.162118:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734244992 00010000:00010000:2.0:1746129575.162147:0:9823:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094fee600/0x40a459093b06a918 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2174e expref: 18 pid: 16908 timeout: 930 lvb_type: 0 00000100:00100000:0.0:1746129575.163084:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8459 00000100:00100000:0.0:1746129575.163094:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c079c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ada2ffba-8920-4ecb-8068-68caa9806978+303:1963:x1830948734245120:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129575.163108:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129575.163115:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880095f13200/0x40a459093b06a965 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21778 expref: 303 pid: 14549 timeout: 930 lvb_type: 0 00010000:00010000:0.0:1746129575.163127:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880095f13200/0x40a459093b06a965 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21778 expref: 303 pid: 14549 timeout: 930 lvb_type: 0 00010000:00010000:0.0:1746129575.163148:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f13200/0x40a459093b06a965 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21778 expref: 303 pid: 14549 timeout: 930 lvb_type: 0 00000100:00100000:3.0:1746129575.163797:0:15749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8460 00000100:00100000:3.0:1746129575.163805:0:15749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c078700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+18:1963:x1830948734244992:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129575.163813:0:15749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129575.163818:0:15749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094fee600/0x40a459093b06a918 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2174e expref: 18 pid: 16908 timeout: 930 lvb_type: 0 00010000:00010000:3.0:1746129575.163825:0:15749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094fee600/0x40a459093b06a918 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2174e expref: 18 pid: 16908 timeout: 930 lvb_type: 0 00010000:00010000:3.0:1746129575.163837:0:15749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094fee600/0x40a459093b06a918 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2174e expref: 18 pid: 16908 timeout: 930 lvb_type: 0 00010000:00010000:3.0:1746129575.163864:0:15749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:3.0:1746129575.163870:0:15749:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008fbb7400/0x40a459093b06a9f1 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129575.163879:0:15749:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88008fbb7400/0x40a459093b06a9f1 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129575.163884:0:15749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746129575.163895:0:7085:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:0.0:1746129575.163904:0:7085:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008fbb7400/0x40a459093b06a9f1 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129575.163914:0:7085:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88008fbb7400/0x40a459093b06a9f1 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129575.163919:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129575.163933:0:15749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c078700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+17:1963:x1830948734244992:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 129us (1885us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129575.163940:0:15749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8460 00000100:00100000:0.0:1746129575.163964:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c079c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ada2ffba-8920-4ecb-8068-68caa9806978+302:1963:x1830948734245120:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 871us (2012us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129575.163972:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8459 00000100:00100000:1.0:1746129575.166980:0:31518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c07b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ada2ffba-8920-4ecb-8068-68caa9806978+26:1962:x1830948734244608:12345-192.168.202.4@tcp:4:cat.0 Request processed in 13720us (14699us total) trans 17179874151 rc 0/0 00000100:00100000:1.0:1746129575.166993:0:31518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2460 00002000:00100000:1.0:1746129575.167005:0:31518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3f4:0x0] (1683456->2097151) req@ffff88009c07b480 x1830948734244608/t17179874151(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:316/0 lens 488/448 e 0 to 0 dl 1746129586 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129575.167014:0:31518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c07b480 with x1830948734244608 ext(1683456->2097151) 00010000:00010000:1.0:1746129575.167025:0:31518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012e0b4a00/0x40a459093b06a9b9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1683456->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f217b7 expref: 26 pid: 8410 timeout: 930 lvb_type: 0 00010000:00010000:1.0:1746129575.167038:0:31518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012e0b4a00/0x40a459093b06a9b9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1683456->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f217b7 expref: 26 pid: 8410 timeout: 930 lvb_type: 0 00002000:00010000:1.0:1746129575.167050:0:31518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c07b480 00000100:00100000:0.0:1746129575.167564:0:16908:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c078e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16908:1830948737562368:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129575.167602:0:16908:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008fbb7400/0x40a459093b06a9f1 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00000100:00100000:0.0:1746129575.168140:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129575.169514:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734245248 00000100:00100000:1.0:1746129575.169529:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734245248 00010000:00010000:1.0:1746129575.169567:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3a4000/0x40a459093b06a8fc lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21747 expref: 15 pid: 16908 timeout: 930 lvb_type: 0 00000100:00100000:1.0:1746129575.170219:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8461 00000100:00100000:1.0:1746129575.170228:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093edd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:068dab75-d300-4ead-a742-d14572ad1e50+15:1962:x1830948734245248:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129575.170246:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129575.170252:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3a4000/0x40a459093b06a8fc lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21747 expref: 15 pid: 16908 timeout: 930 lvb_type: 0 00010000:00010000:1.0:1746129575.170263:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3a4000/0x40a459093b06a8fc lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21747 expref: 15 pid: 16908 timeout: 930 lvb_type: 0 00010000:00010000:1.0:1746129575.170310:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3a4000/0x40a459093b06a8fc lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21747 expref: 15 pid: 16908 timeout: 930 lvb_type: 0 00010000:00010000:1.0:1746129575.170335:0:7085:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:1.0:1746129575.170340:0:7085:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008fbb7400/0x40a459093b06a9f1 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129575.170349:0:7085:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fbb7400/0x40a459093b06a9f1 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129575.170356:0:7085:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fbb7400/0x40a459093b06a9f1 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129575.170380:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129575.170423:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093edd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:068dab75-d300-4ead-a742-d14572ad1e50+14:1962:x1830948734245248:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 197us (2284us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129575.170429:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8461 00010000:00010000:0.0:1746129575.170476:0:16908:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008fbb7400/0x40a459093b06a9f1 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129575.170483:0:16908:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fbb7400/0x40a459093b06a9f1 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00000004:00200000:0.0:1746129575.170503:0:16908:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:0.0:1746129575.170639:0:16908:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fbb6000/0x40a459093b06a9ea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f217e8 expref: 18 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129575.170650:0:16908:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fbb7400/0x40a459093b06a9f1 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f217e8 expref: 17 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129575.170662:0:16908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:0.0:1746129575.170664:0:16908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746129575.170666:0:16908:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fbb7400, rc 0) 00000100:00100000:0.0:1746129575.170689:0:16908:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093edc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+17:32440:x1830948734244864:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 14602us (14969us total) trans 8589945385 rc 0/0 00000100:00100000:0.0:1746129575.170694:0:16908:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11281 00000100:00100000:0.0:1746129575.175443:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129575.175548:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734245376 00000100:00100000:1.0:1746129575.175560:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734245376 00010000:00010000:1.0:1746129575.175605:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012e0b4a00/0x40a459093b06a9b9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1683456->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f217b7 expref: 26 pid: 8410 timeout: 930 lvb_type: 0 00000100:00100000:1.0:1746129575.176477:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8462 00000100:00100000:1.0:1746129575.176488:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6fd2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ada2ffba-8920-4ecb-8068-68caa9806978+26:1960:x1830948734245376:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129575.176508:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129575.176535:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012e0b4a00/0x40a459093b06a9b9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1683456->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f217b7 expref: 26 pid: 8410 timeout: 930 lvb_type: 0 00010000:00010000:1.0:1746129575.176548:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012e0b4a00/0x40a459093b06a9b9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1683456->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f217b7 expref: 26 pid: 8410 timeout: 930 lvb_type: 0 00010000:00010000:1.0:1746129575.176571:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e0b4a00/0x40a459093b06a9b9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1683456->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f217b7 expref: 26 pid: 8410 timeout: 930 lvb_type: 0 00010000:00010000:1.0:1746129575.176589:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129575.176591:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129575.176597:0:7085:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008fbb7000/0x40a459093b06a9e3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f217e1 expref: 15 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129575.176605:0:7085:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fbb7000/0x40a459093b06a9e3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f217e1 expref: 15 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129575.176641:0:7085:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008fbb7000/0x40a459093b06a9e3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f217e1 expref: 15 pid: 7149 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129575.176653:0:7085:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135723100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7085:1830948737562496:192.168.202.4@tcp:105: 00000100:00100000:1.0:1746129575.176736:0:7085:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0ac480 going to sleep for 11 seconds 00000100:00100000:1.0:1746129575.181566:0:7085:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135723100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7085:1830948737562496:192.168.202.4@tcp:105: 00010000:00010000:1.0:1746129575.182202:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129575.182253:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6fd2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ada2ffba-8920-4ecb-8068-68caa9806978+25:1960:x1830948734245376:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 5765us (6815us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129575.182263:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8462 00000100:00100000:0.0:1746129575.190178:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129575.190268:0:31518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734245632 00000100:00100000:1.0:1746129575.190291:0:31518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734245632 00002000:00100000:1.0:1746129575.190347:0:31518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3f4:0x0] (1048576->2097151) req@ffff880093eddc00 x1830948734245632/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:316/0 lens 488/0 e 0 to 0 dl 1746129586 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129575.190355:0:31518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093eddc00 with x1830948734245632 ext(1048576->2097151) 00002000:00010000:1.0:1746129575.190360:0:31518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093eddc00 00000100:00100000:1.0:1746129575.190387:0:31518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7933 00000100:00100000:1.0:1746129575.190393:0:31518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093eddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+16:1963:x1830948734245632:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:2.0:1746129575.209315:0:31518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093eddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+16:1963:x1830948734245632:12345-192.168.202.4@tcp:3:cat.0 Request processed in 18894us (19115us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129575.209329:0:31518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7933 00002000:00100000:2.0:1746129575.209344:0:31518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3f4:0x0] (1048576->2097151) req@ffff880093eddc00 x1830948734245632/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:316/0 lens 488/440 e 0 to 0 dl 1746129586 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129575.209354:0:31518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093eddc00 with x1830948734245632 ext(1048576->2097151) 00002000:00010000:2.0:1746129575.209361:0:31518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093eddc00 00000100:00100000:0.0:1746129575.225440:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129575.225515:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734245760 00000100:00100000:2.0:1746129575.225525:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734245760 00000100:00100000:2.0:1746129575.225590:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16465 00000100:00100000:2.0:1746129575.225599:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093edce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+10:32436:x1830948734245760:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129575.225618:0:7149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129575.225636:0:7149:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091b63c00/0x40a459093b06a9ff lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f217ef expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129575.225668:0:7149:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b3be000/0x40a459093b06a8af lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1134591) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2170f expref: 13 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129575.225676:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129575.225677:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129575.225680:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091b63c00/0x40a459093b06a9ff lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f217ef expref: 11 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129575.225712:0:7149:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012b3be000/0x40a459093b06a8af lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1134591) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2170f expref: 13 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129575.225726:0:7149:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012b3be000/0x40a459093b06a8af lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1134591) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2170f expref: 13 pid: 22481 timeout: 930 lvb_type: 0 00000100:00100000:2.0:1746129575.225813:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c078700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7149:1830948737562624:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129575.226467:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b53549c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746129575.228678:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c078700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7149:1830948737562624:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129575.228715:0:7149:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091b63c00/0x40a459093b06a9ff lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f217ef expref: 11 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129575.228733:0:7149:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091b63c00, rc 0) 00000100:00100000:2.0:1746129575.228794:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093edce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+11:32436:x1830948734245760:12345-192.168.202.4@tcp:101:cat.0 Request processed in 3194us (3362us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129575.228803:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16465 00000100:00100000:0.0:1746129575.230219:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129575.230368:0:31518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734245888 00000100:00100000:2.0:1746129575.230378:0:31518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734245888 00002000:00100000:2.0:1746129575.230457:0:31518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3ee:0x0] (1048576->1495039) req@ffff880093eded80 x1830948734245888/t0(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:316/0 lens 488/0 e 0 to 0 dl 1746129586 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129575.230466:0:31518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093eded80 with x1830948734245888 ext(1048576->1495039) 00010000:00010000:2.0:1746129575.230475:0:31518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012b3be000/0x40a459093b06a8af lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1134591) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2170f expref: 14 pid: 22481 timeout: 930 lvb_type: 0 00010000:00010000:2.0:1746129575.230490:0:31518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012b3be000/0x40a459093b06a8af lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1134591) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2170f expref: 14 pid: 22481 timeout: 930 lvb_type: 0 00002000:00010000:2.0:1746129575.230502:0:31518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093eded80 00000100:00080000:0.0:1746129575.230681:0:7097:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746129575.231089:0:31518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2461 00000100:00100000:2.0:1746129575.231100:0:31518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093eded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ada2ffba-8920-4ecb-8068-68caa9806978+14:1963:x1830948734245888:12345-192.168.202.4@tcp:4:cat.0 00000100:00100000:0.0:1746129575.239823:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129575.240173:0:16908:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734246144 00000100:00100000:1.0:1746129575.240183:0:16908:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734246144 00000100:00100000:1.0:1746129575.240255:0:16908:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11282 00000100:00100000:1.0:1746129575.240263:0:16908:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093edd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ada2ffba-8920-4ecb-8068-68caa9806978+302:32442:x1830948734246144:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:1.0:1746129575.240318:0:16908:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129575.240337:0:16908:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f93e000/0x40a459093b06aa06 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f217f6 expref: -99 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129575.240459:0:16908:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f93e800/0x40a459093b06aa0d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129575.240473:0:16908:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f93e800/0x40a459093b06aa0d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129575.240483:0:16908:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f93e800/0x40a459093b06aa0d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129575.240495:0:16908:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f93e600/0x40a459093b06aa14 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129575.240499:0:16908:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f93e600/0x40a459093b06aa14 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129575.240504:0:16908:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f93e600/0x40a459093b06aa14 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129575.240605:0:16908:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f93ee00/0x40a459093b06aa1b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129575.240612:0:16908:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f93ee00/0x40a459093b06aa1b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129575.240616:0:16908:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f93ee00/0x40a459093b06aa1b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00000004:00200000:1.0:1746129575.240625:0:16908:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:1.0:1746129575.240692:0:16908:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f93e800/0x40a459093b06aa0d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129575.240698:0:16908:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f93e800/0x40a459093b06aa0d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129575.240704:0:16908:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f93e800/0x40a459093b06aa0d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129575.240708:0:16908:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f93e800 already unused, calling callback (ffffffffa136e690) 00010000:00010000:1.0:1746129575.240712:0:16908:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f93e800/0x40a459093b06aa0d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129575.240719:0:16908:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f93e800/0x40a459093b06aa0d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129575.240728:0:16908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880132ef8f00) 00010000:00010000:1.0:1746129575.240730:0:16908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129575.240734:0:16908:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f93e800/0x40a459093b06aa0d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129575.240738:0:16908:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f93e800/0x40a459093b06aa0d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129575.240750:0:16908:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f93e600/0x40a459093b06aa14 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129575.240754:0:16908:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f93e600/0x40a459093b06aa14 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129575.240758:0:16908:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f93e600/0x40a459093b06aa14 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129575.240761:0:16908:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f93e600 already unused, calling callback (ffffffffa136e690) 00010000:00010000:1.0:1746129575.240762:0:16908:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f93e600/0x40a459093b06aa14 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129575.240767:0:16908:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f93e600/0x40a459093b06aa14 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129575.240775:0:16908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009cffe300) 00010000:00010000:1.0:1746129575.240777:0:16908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129575.240779:0:16908:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f93e600/0x40a459093b06aa14 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129575.240783:0:16908:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f93e600/0x40a459093b06aa14 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129575.240814:0:16908:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f93e000/0x40a459093b06aa06 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f217f6 expref: 305 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129575.240826:0:16908:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f93ee00/0x40a459093b06aa1b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f217f6 expref: 304 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129575.240832:0:16908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:1.0:1746129575.240834:0:16908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746129575.240836:0:16908:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f93ee00, rc 0) 00000100:00100000:1.0:1746129575.240887:0:16908:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093edd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ada2ffba-8920-4ecb-8068-68caa9806978+304:32442:x1830948734246144:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 625us (1077us total) trans 8589945386 rc 0/0 00000100:00100000:1.0:1746129575.240893:0:16908:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11282 00000100:00100000:3.0:1746129575.246547:0:31518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093eded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ada2ffba-8920-4ecb-8068-68caa9806978+16:1963:x1830948734245888:12345-192.168.202.4@tcp:4:cat.0 Request processed in 15439us (16323us total) trans 21474841399 rc 0/0 00000100:00100000:3.0:1746129575.246560:0:31518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2461 00002000:00100000:3.0:1746129575.246572:0:31518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3ee:0x0] (1048576->1495039) req@ffff880093eded80 x1830948734245888/t21474841399(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:316/0 lens 488/448 e 0 to 0 dl 1746129586 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129575.246581:0:31518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093eded80 with x1830948734245888 ext(1048576->1495039) 00010000:00010000:3.0:1746129575.246592:0:31518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012b3be000/0x40a459093b06a8af lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1134591) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2170f expref: 16 pid: 22481 timeout: 930 lvb_type: 0 00010000:00010000:3.0:1746129575.246607:0:31518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012b3be000/0x40a459093b06a8af lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1134591) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2170f expref: 16 pid: 22481 timeout: 930 lvb_type: 0 00002000:00010000:3.0:1746129575.246613:0:31518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093eded80 00000100:00100000:0.0:1746129575.247688:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129575.247917:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734246272 00000100:00100000:2.0:1746129575.247928:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734246272 00000100:00100000:2.0:1746129575.247969:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16466 00000100:00100000:2.0:1746129575.247976:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093edfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+11:32440:x1830948734246272:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:2.0:1746129575.247994:0:7149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129575.248011:0:7149:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095ab1600/0x40a459093b06aa29 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f217fd expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129575.248039:0:7149:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fab4400/0x40a459093b06a81c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f216b4 expref: 12 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129575.248047:0:7149:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b3bfe00/0x40a459093b06a8bd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21732 expref: 5 pid: 31503 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129575.248053:0:7149:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800946f1000/0x40a459093b06a862 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f216de expref: 15 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129575.248059:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129575.248061:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129575.248065:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095ab1600/0x40a459093b06aa29 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [3178496->3772415] (req 3178496->3772415) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f217fd expref: 12 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129575.248099:0:7149:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800946f1000/0x40a459093b06a862 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f216de expref: 15 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129575.248109:0:7149:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800946f1000/0x40a459093b06a862 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f216de expref: 15 pid: 11014 timeout: 930 lvb_type: 1 00000100:00100000:2.0:1746129575.248121:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c078700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7149:1830948737562752:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129575.248562:0:7149:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012b3bfe00/0x40a459093b06a8bd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21732 expref: 5 pid: 31503 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129575.248570:0:7149:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012b3bfe00/0x40a459093b06a8bd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21732 expref: 5 pid: 31503 timeout: 930 lvb_type: 1 00000100:00100000:2.0:1746129575.248578:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c079c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7149:1830948737562880:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129575.248603:0:7149:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fab4400/0x40a459093b06a81c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f216b4 expref: 12 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129575.248610:0:7149:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fab4400/0x40a459093b06a81c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f216b4 expref: 12 pid: 7148 timeout: 930 lvb_type: 1 00000100:00100000:2.0:1746129575.248615:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c078e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7149:1830948737563008:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129575.248627:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b5354cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746129575.250048:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c078700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7149:1830948737562752:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129575.250062:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c079c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7149:1830948737562880:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129575.252633:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c078e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7149:1830948737563008:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129575.252683:0:7149:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095ab1600/0x40a459093b06aa29 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [3178496->3772415] (req 3178496->3772415) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f217fd expref: 12 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129575.252702:0:7149:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095ab1600, rc 0) 00000100:00100000:2.0:1746129575.252752:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093edfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+12:32440:x1830948734246272:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 4775us (5068us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129575.252763:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16466 00000100:00100000:0.0:1746129575.253612:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129575.253676:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734246400 00000100:00100000:1.0:1746129575.253684:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734246400 00010000:00010000:1.0:1746129575.253714:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800946f1000/0x40a459093b06a862 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f216de expref: 16 pid: 11014 timeout: 930 lvb_type: 1 00000100:00100000:1.0:1746129575.253751:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8463 00000100:00100000:1.0:1746129575.253758:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f37d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ada2ffba-8920-4ecb-8068-68caa9806978+16:1962:x1830948734246400:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129575.253775:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129575.253800:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800946f1000/0x40a459093b06a862 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f216de expref: 16 pid: 11014 timeout: 930 lvb_type: 1 00010000:00010000:1.0:1746129575.253811:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800946f1000/0x40a459093b06a862 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f216de expref: 16 pid: 11014 timeout: 930 lvb_type: 1 00010000:00010000:1.0:1746129575.253836:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800946f1000/0x40a459093b06a862 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f216de expref: 16 pid: 11014 timeout: 930 lvb_type: 1 00010000:00010000:1.0:1746129575.253865:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129575.253889:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f37d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ada2ffba-8920-4ecb-8068-68caa9806978+15:1962:x1830948734246400:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 131us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129575.253894:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8463 00000100:00100000:0.0:1746129575.256438:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129575.256559:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734246656 00000100:00100000:2.0:1746129575.256568:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734246656 00000100:00100000:2.0:1746129575.258162:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16467 00000100:00100000:2.0:1746129575.258178:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bf78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ada2ffba-8920-4ecb-8068-68caa9806978+15:32442:x1830948734246656:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:2.0:1746129575.258200:0:7149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129575.258219:0:7149:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a77f7a00/0x40a459093b06aa30 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21804 expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129575.258253:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129575.258255:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129575.258260:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a77f7a00/0x40a459093b06aa30 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [3792896->4026367] (req 3792896->4026367) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21804 expref: 16 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129575.258271:0:7149:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a77f7a00/0x40a459093b06aa30 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [3792896->4026367] (req 3792896->4026367) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21804 expref: 16 pid: 7149 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129575.258288:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00010000:00010000:2.0:1746129575.258304:0:7149:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a77f7a00, rc 0) 00000100:00100000:3.0:1746129575.258355:0:15749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734246784 00000100:00100000:3.0:1746129575.258361:0:15749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734246784 00010000:00010000:3.0:1746129575.258386:0:15749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012b3be000/0x40a459093b06a8af lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1134591) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2170f expref: 17 pid: 22481 timeout: 930 lvb_type: 0 00000100:00100000:0.0:1746129575.258421:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129575.258965:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bf78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ada2ffba-8920-4ecb-8068-68caa9806978+17:32442:x1830948734246656:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 792us (2535us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129575.258972:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16467 00000100:00100000:0.0:1746129575.259403:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129575.259498:0:15749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734246528 00000100:00100000:3.0:1746129575.259503:0:15749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734246528 00010000:00010000:3.0:1746129575.259530:0:15749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012b3bfe00/0x40a459093b06a8bd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21732 expref: 6 pid: 31503 timeout: 930 lvb_type: 1 00000100:00100000:3.0:1746129575.259547:0:15749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8464 00000100:00100000:3.0:1746129575.259551:0:15749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f37e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ada2ffba-8920-4ecb-8068-68caa9806978+16:1962:x1830948734246784:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129575.259560:0:15749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129575.259582:0:15749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012b3be000/0x40a459093b06a8af lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1134591) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2170f expref: 16 pid: 22481 timeout: 930 lvb_type: 0 00010000:00010000:3.0:1746129575.259591:0:15749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012b3be000/0x40a459093b06a8af lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1134591) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2170f expref: 16 pid: 22481 timeout: 930 lvb_type: 0 00010000:00010000:3.0:1746129575.259609:0:15749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b3be000/0x40a459093b06a8af lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1134591) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2170f expref: 16 pid: 22481 timeout: 930 lvb_type: 0 00010000:00010000:3.0:1746129575.259624:0:15749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129575.259626:0:15749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129575.259632:0:15749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091b63c00/0x40a459093b06a9ff lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f217ef expref: 11 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129575.259638:0:15749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091b63c00/0x40a459093b06a9ff lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f217ef expref: 11 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129575.259667:0:15749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091b63c00/0x40a459093b06a9ff lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f217ef expref: 11 pid: 7149 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129575.259679:0:15749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bc700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15749:1830948737563136:192.168.202.4@tcp:105: 00000100:00100000:3.0:1746129575.259728:0:15749:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa381c00 going to sleep for 11 seconds 00000100:00080000:3.0:1746129575.259743:0:7097:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1746129575.259770:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8465 00000100:00100000:3.0:1746129575.259775:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a77b1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:068dab75-d300-4ead-a742-d14572ad1e50+6:1963:x1830948734246528:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129575.259782:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129575.259792:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012b3bfe00/0x40a459093b06a8bd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21732 expref: 6 pid: 31503 timeout: 930 lvb_type: 1 00010000:00010000:3.0:1746129575.259800:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012b3bfe00/0x40a459093b06a8bd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21732 expref: 6 pid: 31503 timeout: 930 lvb_type: 1 00010000:00010000:3.0:1746129575.259811:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b3bfe00/0x40a459093b06a8bd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21732 expref: 6 pid: 31503 timeout: 930 lvb_type: 1 00010000:00010000:3.0:1746129575.259819:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129575.259834:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a77b1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:068dab75-d300-4ead-a742-d14572ad1e50+5:1963:x1830948734246528:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 59us (1413us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129575.259839:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8465 00000100:00100000:2.0:1746129575.260254:0:20578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734246912 00000100:00100000:2.0:1746129575.260259:0:20578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734246912 00010000:00010000:2.0:1746129575.260287:0:20578:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fab4400/0x40a459093b06a81c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f216b4 expref: 12 pid: 7148 timeout: 930 lvb_type: 1 00000100:00100000:2.0:1746129575.260703:0:20578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8466 00000100:00100000:2.0:1746129575.260711:0:20578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a77b0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+12:1962:x1830948734246912:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129575.260719:0:20578:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129575.260729:0:20578:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fab4400/0x40a459093b06a81c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f216b4 expref: 12 pid: 7148 timeout: 930 lvb_type: 1 00010000:00010000:2.0:1746129575.260739:0:20578:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fab4400/0x40a459093b06a81c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f216b4 expref: 12 pid: 7148 timeout: 930 lvb_type: 1 00010000:00010000:2.0:1746129575.260751:0:20578:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fab4400/0x40a459093b06a81c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f216b4 expref: 12 pid: 7148 timeout: 930 lvb_type: 1 00010000:00010000:2.0:1746129575.260777:0:20578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129575.260779:0:20578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129575.260784:0:20578:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880095ab1600/0x40a459093b06aa29 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->3792895] (req 3178496->3772415) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f217fd expref: 11 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129575.260790:0:20578:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095ab1600/0x40a459093b06aa29 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->3792895] (req 3178496->3772415) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f217fd expref: 11 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129575.260801:0:20578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129575.260802:0:20578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129575.260806:0:20578:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a77f7a00/0x40a459093b06aa30 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [3792896->18446744073709551615] (req 3792896->4026367) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21804 expref: 15 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129575.260812:0:20578:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a77f7a00/0x40a459093b06aa30 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [3792896->18446744073709551615] (req 3792896->4026367) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21804 expref: 15 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129575.260834:0:20578:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a77f7a00/0x40a459093b06aa30 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [3792896->18446744073709551615] (req 3792896->4026367) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21804 expref: 15 pid: 7149 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129575.260841:0:20578:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c078e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:20578:1830948737563264:192.168.202.4@tcp:105: 00010000:00010000:2.0:1746129575.260895:0:20578:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880095ab1600/0x40a459093b06aa29 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->3792895] (req 3178496->3772415) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f217fd expref: 11 pid: 7149 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129575.260902:0:20578:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c079c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:20578:1830948737563392:192.168.202.4@tcp:105: 00000100:00100000:2.0:1746129575.260920:0:20578:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b5354cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746129575.265165:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129575.265759:0:15749:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bc700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15749:1830948737563136:192.168.202.4@tcp:105: 00010000:00010000:2.0:1746129575.265781:0:15749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129575.265830:0:15749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f37e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ada2ffba-8920-4ecb-8068-68caa9806978+15:1962:x1830948734246784:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 6277us (7553us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129575.265840:0:15749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8464 00000100:00100000:1.0:1746129575.266454:0:16908:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734247168 00000100:00100000:1.0:1746129575.266463:0:16908:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734247168 00000100:00100000:2.0:1746129575.266469:0:20578:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c078e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:20578:1830948737563264:192.168.202.4@tcp:105: 00000100:00100000:2.0:1746129575.266479:0:20578:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c079c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:20578:1830948737563392:192.168.202.4@tcp:105: 00010000:00010000:2.0:1746129575.266500:0:20578:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129575.266509:0:16908:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11283 00000100:00100000:1.0:1746129575.266517:0:16908:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135723100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ada2ffba-8920-4ecb-8068-68caa9806978+304:32445:x1830948734247168:12345-192.168.202.4@tcp:101:cat.0 00000100:00100000:2.0:1746129575.266518:0:20578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a77b0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+11:1962:x1830948734246912:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 5808us (7116us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129575.266525:0:20578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8466 00010000:00010000:1.0:1746129575.266541:0:16908:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129575.266560:0:16908:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f93e000/0x40a459093b06aa37 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2180b expref: -99 pid: 16908 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129575.266586:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129575.266659:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129575.266675:0:31518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734247424 00010000:00010000:1.0:1746129575.266675:0:16908:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f93e600/0x40a459093b06aa3e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16908 initiator: MDT0 00000100:00100000:2.0:1746129575.266680:0:31518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734247424 00000100:00100000:3.0:1746129575.266683:0:31519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734247680 00010000:00010000:1.0:1746129575.266689:0:16908:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f93e600/0x40a459093b06aa3e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00000100:00100000:3.0:1746129575.266690:0:31519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734247680 00010000:00010000:1.0:1746129575.266700:0:16908:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f93e600/0x40a459093b06aa3e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00002000:00100000:2.0:1746129575.266707:0:31518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3ef:0x0] (3178496->3182591) req@ffff8800947bc380 x1830948734247424/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:316/0 lens 488/0 e 0 to 0 dl 1746129586 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129575.266708:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3ef:0x0] (3792896->3796991) req@ffff8800947bf800 x1830948734247680/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:316/0 lens 488/0 e 0 to 0 dl 1746129586 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00010000:00010000:1.0:1746129575.266713:0:16908:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f93e800/0x40a459093b06aa45 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16908 initiator: MDT0 00002000:00100000:2.0:1746129575.266716:0:31518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800947bc380 with x1830948734247424 ext(3178496->3182591) 00002000:00100000:3.0:1746129575.266717:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800947bf800 with x1830948734247680 ext(3792896->3796991) 00010000:00010000:1.0:1746129575.266718:0:16908:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f93e800/0x40a459093b06aa45 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00002000:00010000:2.0:1746129575.266721:0:31518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800947bc380 00010000:00010000:1.0:1746129575.266722:0:16908:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f93e800/0x40a459093b06aa45 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00002000:00010000:3.0:1746129575.266725:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800947bf800 00000100:00100000:3.0:1746129575.266740:0:31519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7934 00000100:00100000:3.0:1746129575.266745:0:31519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+11:1961:x1830948734247424:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:2.0:1746129575.266745:0:31523:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7935 00000100:00100000:2.0:1746129575.266750:0:31523:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ada2ffba-8920-4ecb-8068-68caa9806978+15:1963:x1830948734247680:12345-192.168.202.4@tcp:3:multiop.0 00010000:00010000:1.0:1746129575.266916:0:16908:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f93f200/0x40a459093b06aa4c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129575.266925:0:16908:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f93f200/0x40a459093b06aa4c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129575.266931:0:16908:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f93f200/0x40a459093b06aa4c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00000004:00200000:1.0:1746129575.266938:0:16908:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:1.0:1746129575.267179:0:16908:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f93e600/0x40a459093b06aa3e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129575.267187:0:16908:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f93e600/0x40a459093b06aa3e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129575.267193:0:16908:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f93e600/0x40a459093b06aa3e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129575.267198:0:16908:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f93e600 already unused, calling callback (ffffffffa136e690) 00010000:00010000:1.0:1746129575.267201:0:16908:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f93e600/0x40a459093b06aa3e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129575.267207:0:16908:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f93e600/0x40a459093b06aa3e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129575.267217:0:16908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880132ef8f00) 00010000:00010000:1.0:1746129575.267220:0:16908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129575.267224:0:16908:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f93e600/0x40a459093b06aa3e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129575.267229:0:16908:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f93e600/0x40a459093b06aa3e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129575.267242:0:16908:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f93e800/0x40a459093b06aa45 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129575.267247:0:16908:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f93e800/0x40a459093b06aa45 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129575.267252:0:16908:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f93e800/0x40a459093b06aa45 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129575.267255:0:16908:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f93e800 already unused, calling callback (ffffffffa136e690) 00010000:00010000:1.0:1746129575.267257:0:16908:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f93e800/0x40a459093b06aa45 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129575.267262:0:16908:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f93e800/0x40a459093b06aa45 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129575.267268:0:16908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009cffee00) 00010000:00010000:1.0:1746129575.267269:0:16908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129575.267272:0:16908:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f93e800/0x40a459093b06aa45 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129575.267289:0:16908:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f93e800/0x40a459093b06aa45 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129575.267417:0:16908:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f93e000/0x40a459093b06aa37 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2180b expref: 307 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129575.267429:0:16908:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f93f200/0x40a459093b06aa4c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2180b expref: 306 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129575.267436:0:16908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:1.0:1746129575.267438:0:16908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746129575.267440:0:16908:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f93f200, rc 0) 00000100:00100000:1.0:1746129575.267492:0:16908:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135723100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ada2ffba-8920-4ecb-8068-68caa9806978+306:32445:x1830948734247168:12345-192.168.202.4@tcp:101:cat.0 Request processed in 977us (2356us total) trans 8589945387 rc 0/0 00000100:00100000:1.0:1746129575.267498:0:16908:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11283 00000100:00100000:2.0:1746129575.267530:0:31523:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ada2ffba-8920-4ecb-8068-68caa9806978+15:1963:x1830948734247680:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 778us (869us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129575.267537:0:31523:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7935 00002000:00100000:2.0:1746129575.267542:0:31523:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3ef:0x0] (3792896->3796991) req@ffff8800947bf800 x1830948734247680/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:316/0 lens 488/4536 e 0 to 0 dl 1746129586 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129575.267550:0:31523:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800947bf800 with x1830948734247680 ext(3792896->3796991) 00002000:00010000:2.0:1746129575.267553:0:31523:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800947bf800 00000100:00100000:3.0:1746129575.267633:0:31519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+11:1961:x1830948734247424:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 887us (1047us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129575.267640:0:31519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7934 00002000:00100000:3.0:1746129575.267645:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3ef:0x0] (3178496->3182591) req@ffff8800947bc380 x1830948734247424/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:316/0 lens 488/4536 e 0 to 0 dl 1746129586 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129575.267652:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800947bc380 with x1830948734247424 ext(3178496->3182591) 00002000:00010000:3.0:1746129575.267655:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800947bc380 00000100:00100000:3.0:1746129575.267697:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129575.267712:0:21725:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734247936 00000100:00100000:3.0:1746129575.267715:0:21725:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734247936 00002000:00100000:3.0:1746129575.267731:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ee:0x0] (1048576->2097151) req@ffff8800947be680 x1830948734247936/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:316/0 lens 488/0 e 0 to 0 dl 1746129586 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129575.267738:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800947be680 with x1830948734247936 ext(1048576->2097151) 00002000:00010000:3.0:1746129575.267741:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800947be680 00000100:00100000:3.0:1746129575.267751:0:21725:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7936 00000100:00100000:3.0:1746129575.267755:0:21725:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+11:1960:x1830948734247936:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:0.0:1746129575.276013:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129575.276743:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129575.276930:0:20861:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734248320 00000100:00100000:3.0:1746129575.276940:0:20861:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734248320 00000100:00100000:2.0:1746129575.277282:0:20578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734248064 00000100:00100000:2.0:1746129575.277286:0:20578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734248064 00000100:00100000:2.0:1746129575.277336:0:20578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 797 00000100:00100000:2.0:1746129575.277342:0:20578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a77b0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ada2ffba-8920-4ecb-8068-68caa9806978+307:1962:x1830948734248064:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129575.277359:0:20578:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129575.277390:0:20578:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f93f200/0x40a459093b06aa4c lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2180b expref: 307 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129575.277413:0:20578:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:2.0:1746129575.277418:0:20578:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129575.277475:0:20578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a77b0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ada2ffba-8920-4ecb-8068-68caa9806978+306:1962:x1830948734248064:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 133us (1476us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129575.277481:0:20578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 797 00000100:00100000:3.0:1746129575.277562:0:20861:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4798 00000100:00100000:3.0:1746129575.277569:0:20861:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a77b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:ada2ffba-8920-4ecb-8068-68caa9806978+305:32445:x1830948734248320:12345-192.168.202.4@tcp:35:cat.0 00000100:00100000:3.0:1746129575.278097:0:20861:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a77b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:ada2ffba-8920-4ecb-8068-68caa9806978+306:32445:x1830948734248320:12345-192.168.202.4@tcp:35:cat.0 Request processed in 528us (1354us total) trans 8589945388 rc 0/0 00000100:00100000:3.0:1746129575.278107:0:20861:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4798 00000100:00100000:2.0:1746129575.280685:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129575.280912:0:31519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734248576 00000100:00100000:3.0:1746129575.280922:0:31519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734248576 00002000:00100000:3.0:1746129575.280970:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3ef:0x0] (3768320->3772415) req@ffff88009c079c00 x1830948734248576/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:316/0 lens 488/0 e 0 to 0 dl 1746129586 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129575.280980:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c079c00 with x1830948734248576 ext(3768320->3772415) 00002000:00010000:3.0:1746129575.280985:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c079c00 00000100:00100000:3.0:1746129575.281020:0:31519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7937 00000100:00100000:3.0:1746129575.281028:0:31519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c079c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+13:1960:x1830948734248576:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:3.0:1746129575.281534:0:31519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c079c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+13:1960:x1830948734248576:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 505us (858us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129575.281540:0:31519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7937 00002000:00100000:3.0:1746129575.281546:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3ef:0x0] (3768320->3772415) req@ffff88009c079c00 x1830948734248576/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:316/0 lens 488/4536 e 0 to 0 dl 1746129586 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129575.281553:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c079c00 with x1830948734248576 ext(3768320->3772415) 00002000:00010000:3.0:1746129575.281556:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c079c00 00000100:00100000:0.0:1746129575.283031:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129575.283072:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129575.283379:0:20861:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734248832 00000100:00100000:3.0:1746129575.283386:0:20861:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734248832 00000100:00100000:3.0:1746129575.283437:0:20861:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4799 00000100:00100000:3.0:1746129575.283444:0:20861:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a77b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:ada2ffba-8920-4ecb-8068-68caa9806978+306:32442:x1830948734248832:12345-192.168.202.4@tcp:35:multiop.0 00000100:00100000:0.0:1746129575.283568:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129575.283643:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129575.283702:0:4699:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734248960 00000100:00100000:1.0:1746129575.283706:0:4699:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734248960 00000100:00100000:1.0:1746129575.283803:0:4699:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734249088 00000100:00100000:1.0:1746129575.283806:0:4699:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734249088 00000001:00080000:3.0:1746129575.284111:0:20861:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589945389 00000100:00100000:3.0:1746129575.284186:0:20861:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a77b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:ada2ffba-8920-4ecb-8068-68caa9806978+308:32442:x1830948734248832:12345-192.168.202.4@tcp:35:multiop.0 Request processed in 742us (1161us total) trans 8589945390 rc 0/0 00000100:00100000:3.0:1746129575.284192:0:20861:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4799 00000020:00080000:3.0:1746129575.284197:0:20861:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1746129575.284571:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734249216 00000100:00100000:2.0:1746129575.284575:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734249216 00000100:00100000:2.0:1746129575.284599:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16468 00000100:00100000:2.0:1746129575.284604:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a77b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ada2ffba-8920-4ecb-8068-68caa9806978+25:1962:x1830948734248960:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129575.284615:0:7149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129575.284630:0:7149:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a77f6a00/0x40a459093b06aa5a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21812 expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129575.284648:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129575.284650:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129575.284658:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a77f6a00/0x40a459093b06aa5a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21812 expref: 26 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129575.284673:0:7149:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a77f6a00/0x40a459093b06aa5a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21812 expref: 26 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129575.284682:0:7149:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a77f6a00, rc 0) 00000100:00100000:2.0:1746129575.284699:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a77b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ada2ffba-8920-4ecb-8068-68caa9806978+26:1962:x1830948734248960:12345-192.168.202.4@tcp:101:cat.0 Request processed in 95us (1627us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129575.284707:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16468 00000100:00100000:2.0:1746129575.284716:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16469 00000100:00100000:2.0:1746129575.284719:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a77b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ada2ffba-8920-4ecb-8068-68caa9806978+16:1962:x1830948734249088:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129575.284724:0:7149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129575.284732:0:7149:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a77f6e00/0x40a459093b06aa61 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21819 expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129575.284742:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129575.284743:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129575.284747:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a77f6e00/0x40a459093b06aa61 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21819 expref: 17 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129575.284755:0:7149:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a77f6e00/0x40a459093b06aa61 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21819 expref: 17 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129575.284761:0:7149:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a77f6e00, rc 0) 00000100:00100000:2.0:1746129575.284770:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a77b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ada2ffba-8920-4ecb-8068-68caa9806978+17:1962:x1830948734249088:12345-192.168.202.4@tcp:101:cat.0 Request processed in 51us (1203us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129575.284775:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16469 00000100:00100000:2.0:1746129575.284781:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16470 00000100:00100000:2.0:1746129575.284784:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013577e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ada2ffba-8920-4ecb-8068-68caa9806978+16:1962:x1830948734249216:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129575.284788:0:7149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129575.284793:0:7149:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a77f7200/0x40a459093b06aa68 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21820 expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129575.284829:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c078e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7149:1830948737563520:192.168.202.4@tcp:106: 00000100:00100000:2.0:1746129575.284871:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b5354cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129575.285612:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129575.286347:0:21725:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+11:1960:x1830948734247936:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 18588us (18646us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129575.286358:0:21725:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7936 00002000:00100000:3.0:1746129575.286370:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ee:0x0] (1048576->2097151) req@ffff8800947be680 x1830948734247936/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:316/0 lens 488/440 e 0 to 0 dl 1746129586 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129575.286379:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800947be680 with x1830948734247936 ext(1048576->2097151) 00002000:00010000:3.0:1746129575.286384:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800947be680 00000100:00100000:1.0:1746129575.286671:0:16908:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734249344 00000100:00100000:1.0:1746129575.286678:0:16908:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734249344 00000100:00100000:1.0:1746129575.286731:0:16908:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11284 00000100:00100000:1.0:1746129575.286737:0:16908:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013577d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:068dab75-d300-4ead-a742-d14572ad1e50+14:32446:x1830948734249344:12345-192.168.202.4@tcp:101:mirror_io.0 00010000:00010000:1.0:1746129575.286755:0:16908:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129575.286771:0:16908:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f93e800/0x40a459093b06aa6f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21827 expref: -99 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129575.286834:0:16908:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f93e000/0x40a459093b06aa76 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129575.286846:0:16908:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f93e000/0x40a459093b06aa76 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129575.286857:0:16908:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f93e000/0x40a459093b06aa76 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129575.286869:0:16908:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f93f200/0x40a459093b06aa7d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129575.286874:0:16908:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f93f200/0x40a459093b06aa7d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129575.286878:0:16908:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f93f200/0x40a459093b06aa7d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129575.286983:0:16908:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f93e400/0x40a459093b06aa84 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129575.286994:0:16908:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fbb7400/0x40a459093b06a9f1 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f217e8 expref: 16 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129575.287001:0:16908:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f93e400/0x40a459093b06aa84 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129575.287031:0:16908:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008fbb7400/0x40a459093b06a9f1 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f217e8 expref: 16 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129575.287042:0:16908:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fbb7400/0x40a459093b06a9f1 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f217e8 expref: 16 pid: 16908 timeout: 930 lvb_type: 0 00000100:00100000:1.0:1746129575.287052:0:16908:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135723b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16908:1830948737563648:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129575.287120:0:16908:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0acb40 going to sleep for 11 seconds 00000100:00100000:1.0:1746129575.288481:0:16908:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135723b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16908:1830948737563648:192.168.202.4@tcp:104: 00002000:00010000:2.0:1746129575.288483:0:7149:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb mtime: 1746129574 -> 1746129576 00002000:00010000:2.0:1746129575.288486:0:7149:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb atime: 1746129573 -> 1746129575 00002000:00010000:2.0:1746129575.288488:0:7149:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb ctime: 1746129574 -> 1746129576 00010000:00010000:1.0:1746129575.288503:0:16908:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008f93e400/0x40a459093b06aa84 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00000100:00100000:2.0:1746129575.288504:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c078e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7149:1830948737563520:192.168.202.4@tcp:106: 00010000:00010000:2.0:1746129575.288531:0:7149:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a77f7200/0x40a459093b06aa68 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21820 expref: 17 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129575.288542:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a77f7200/0x40a459093b06aa68 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21820 expref: 17 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129575.288587:0:7149:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a77f7200, rc 0) 00000100:00100000:2.0:1746129575.288620:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013577e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ada2ffba-8920-4ecb-8068-68caa9806978+16:1962:x1830948734249216:12345-192.168.202.4@tcp:101:cat.0 Request processed in 3834us (4976us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129575.288628:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16470 00000100:00100000:0.0:1746129575.301224:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129575.301284:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129575.301427:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129575.301470:0:31519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734249984 00000100:00100000:0.0:1746129575.301479:0:31519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734249984 00002000:00100000:0.0:1746129575.301529:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->3792895) req@ffff88013577f480 x1830948734249984/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:316/0 lens 504/0 e 0 to 0 dl 1746129586 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129575.301540:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013577f480 with x1830948734249984 ext(3145728->3792895) 00002000:00010000:0.0:1746129575.301545:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013577f480 00000100:00100000:0.0:1746129575.301562:0:31519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734249856 00000100:00100000:0.0:1746129575.301564:0:31519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734249856 00002000:00100000:0.0:1746129575.301574:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3ef:0x0] (2097152->3145727) req@ffff88013577e680 x1830948734249856/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:316/0 lens 488/0 e 0 to 0 dl 1746129586 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129575.301581:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013577e680 with x1830948734249856 ext(2097152->3145727) 00002000:00010000:0.0:1746129575.301583:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013577e680 00000100:00100000:0.0:1746129575.301593:0:31519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7938 00000100:00100000:0.0:1746129575.301600:0:31519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013577f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+12:1961:x1830948734249984:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129575.301890:0:31518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7939 00000100:00100000:0.0:1746129575.301895:0:31518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013577e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+13:1960:x1830948734249856:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:3.0:1746129575.303462:0:20861:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734249600 00000100:00100000:3.0:1746129575.303475:0:20861:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734249600 00000100:00100000:3.0:1746129575.303519:0:20861:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4800 00000100:00100000:3.0:1746129575.303526:0:20861:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013577f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+17:27693:x1830948734249600:12345-192.168.202.4@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1746129575.303741:0:20861:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013577f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+18:27693:x1830948734249600:12345-192.168.202.4@tcp:35:ldlm_bl.0 Request processed in 215us (2528us total) trans 8589945391 rc 0/0 00000100:00100000:3.0:1746129575.303748:0:20861:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4800 00000100:00100000:3.0:1746129575.317244:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129575.317342:0:15749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734250240 00000100:00100000:2.0:1746129575.317352:0:15749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734250240 00010000:00010000:2.0:1746129575.317390:0:15749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fbb7400/0x40a459093b06a9f1 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f217e8 expref: 18 pid: 16908 timeout: 930 lvb_type: 0 00000100:00100000:2.0:1746129575.317419:0:15749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8467 00000100:00100000:2.0:1746129575.317427:0:15749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947bed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+18:1962:x1830948734250240:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129575.317443:0:15749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129575.317448:0:15749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008fbb7400/0x40a459093b06a9f1 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f217e8 expref: 18 pid: 16908 timeout: 930 lvb_type: 0 00010000:00010000:2.0:1746129575.317466:0:15749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008fbb7400/0x40a459093b06a9f1 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f217e8 expref: 18 pid: 16908 timeout: 930 lvb_type: 0 00010000:00010000:2.0:1746129575.317487:0:15749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fbb7400/0x40a459093b06a9f1 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f217e8 expref: 18 pid: 16908 timeout: 930 lvb_type: 0 00010000:00010000:2.0:1746129575.317515:0:15749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:2.0:1746129575.317520:0:15749:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f93e400/0x40a459093b06aa84 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129575.317529:0:15749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f93e400/0x40a459093b06aa84 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129575.317536:0:15749:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f93e400/0x40a459093b06aa84 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129575.317558:0:15749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746129575.317568:0:16908:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008f93e400/0x40a459093b06aa84 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129575.317577:0:16908:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f93e400/0x40a459093b06aa84 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00000004:00200000:0.0:1746129575.317639:0:16908:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00000004:00200000:0.0:1746129575.317643:0:16908:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746129575.317662:0:16908:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008f93e400/0x40a459093b06aa84 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129575.317672:0:16908:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f93e400/0x40a459093b06aa84 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129575.317680:0:16908:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f93e000/0x40a459093b06aa76 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129575.317686:0:16908:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f93e000/0x40a459093b06aa76 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129575.317692:0:16908:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f93e000/0x40a459093b06aa76 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129575.317697:0:16908:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f93e000 already unused, calling callback (ffffffffa136e690) 00010000:00010000:0.0:1746129575.317700:0:16908:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f93e000/0x40a459093b06aa76 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129575.317707:0:16908:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f93e000/0x40a459093b06aa76 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129575.317715:0:16908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880132ef8f00) 00010000:00010000:0.0:1746129575.317717:0:16908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129575.317721:0:16908:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f93e000/0x40a459093b06aa76 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129575.317725:0:16908:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f93e000/0x40a459093b06aa76 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16908 initiator: MDT0 00000100:00100000:2.0:1746129575.318968:0:15749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947bed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+17:1962:x1830948734250240:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 1533us (1725us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129575.318978:0:15749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8467 00010000:00010000:0.0:1746129575.319111:0:16908:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f93f200/0x40a459093b06aa7d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129575.319119:0:16908:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f93f200/0x40a459093b06aa7d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129575.319125:0:16908:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f93f200/0x40a459093b06aa7d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129575.319131:0:16908:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f93f200 already unused, calling callback (ffffffffa136e690) 00010000:00010000:0.0:1746129575.319134:0:16908:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f93f200/0x40a459093b06aa7d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129575.319139:0:16908:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f93f200/0x40a459093b06aa7d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129575.319149:0:16908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009cffea00) 00010000:00010000:0.0:1746129575.319152:0:16908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129575.319155:0:16908:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f93f200/0x40a459093b06aa7d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129575.319159:0:16908:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f93f200/0x40a459093b06aa7d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129575.319202:0:16908:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f93e800/0x40a459093b06aa6f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21827 expref: 16 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129575.319213:0:16908:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f93e400/0x40a459093b06aa84 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21827 expref: 15 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129575.319218:0:16908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:0.0:1746129575.319220:0:16908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746129575.319223:0:16908:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f93e400, rc 0) 00000100:00100000:1.0:1746129575.319560:0:31519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013577f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+13:1961:x1830948734249984:12345-192.168.202.4@tcp:3:cat.0 Request processed in 17958us (18282us total) trans 0 rc 53248/53248 00000100:00100000:1.0:1746129575.319568:0:31519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7938 00002000:00100000:1.0:1746129575.319577:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->3792895) req@ffff88013577f480 x1830948734249984/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:316/0 lens 504/440 e 0 to 0 dl 1746129586 ref 1 fl Complete:/200/0 rc 53248/53248 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129575.319586:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013577f480 with x1830948734249984 ext(3145728->3792895) 00002000:00010000:1.0:1746129575.319591:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013577f480 00000100:00100000:0.0:1746129575.322836:0:16908:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013577d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:068dab75-d300-4ead-a742-d14572ad1e50+15:32446:x1830948734249344:12345-192.168.202.4@tcp:101:mirror_io.0 Request processed in 36084us (37210us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129575.322849:0:16908:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11284 00000100:00100000:2.0:1746129575.323610:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129575.323659:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129575.323831:0:21725:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734250496 00000100:00100000:3.0:1746129575.323841:0:21725:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734250496 00002000:00100000:3.0:1746129575.323883:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f4:0x0] (1048576->2097151) req@ffff88009c078e00 x1830948734250496/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:316/0 lens 488/0 e 0 to 0 dl 1746129586 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129575.323897:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c078e00 with x1830948734250496 ext(1048576->2097151) 00002000:00010000:3.0:1746129575.323903:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c078e00 00000100:00100000:3.0:1746129575.323925:0:21725:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734250752 00000100:00100000:3.0:1746129575.323927:0:21725:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734250752 00002000:00100000:3.0:1746129575.323939:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ee:0x0] (1048576->2097151) req@ffff88009c078700 x1830948734250752/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:316/0 lens 488/0 e 0 to 0 dl 1746129586 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129575.323952:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c078700 with x1830948734250752 ext(1048576->2097151) 00002000:00010000:3.0:1746129575.323956:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c078700 00000100:00100000:3.0:1746129575.323966:0:21725:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7940 00000100:00100000:3.0:1746129575.323972:0:21725:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c078e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ada2ffba-8920-4ecb-8068-68caa9806978+26:1963:x1830948734250496:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:2.0:1746129575.324224:0:31523:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7941 00000100:00100000:2.0:1746129575.324233:0:31523:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c078700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ada2ffba-8920-4ecb-8068-68caa9806978+16:1963:x1830948734250752:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:1.0:1746129575.325425:0:31518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013577e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+11:1960:x1830948734249856:12345-192.168.202.4@tcp:3:cat.0 Request processed in 23523us (23990us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129575.325434:0:31518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7939 00002000:00100000:1.0:1746129575.325443:0:31518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3ef:0x0] (2097152->3145727) req@ffff88013577e680 x1830948734249856/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:316/0 lens 488/440 e 0 to 0 dl 1746129586 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129575.325451:0:31518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013577e680 with x1830948734249856 ext(2097152->3145727) 00002000:00010000:1.0:1746129575.325456:0:31518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013577e680 00000100:00100000:2.0:1746129575.329020:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129575.329108:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734250880 00000100:00100000:3.0:1746129575.329118:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734250880 00000100:00100000:3.0:1746129575.330171:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16471 00000100:00100000:3.0:1746129575.330181:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c079f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:068dab75-d300-4ead-a742-d14572ad1e50+5:1963:x1830948734250880:12345-192.168.202.4@tcp:101:mirror_io.0 00010000:00010000:3.0:1746129575.330202:0:7149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129575.330224:0:7149:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012cd7ec00/0x40a459093b06aa8b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2182e expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129575.330249:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129575.330251:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129575.330260:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012cd7ec00/0x40a459093b06aa8b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2182e expref: 6 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129575.330285:0:7149:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012cd7ec00/0x40a459093b06aa8b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2182e expref: 6 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129575.330311:0:7149:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cd7ec00, rc 0) 00000100:00100000:3.0:1746129575.330376:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c079f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:068dab75-d300-4ead-a742-d14572ad1e50+6:1963:x1830948734250880:12345-192.168.202.4@tcp:101:mirror_io.0 Request processed in 197us (1367us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129575.330382:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16471 00000100:00100000:0.0:1746129575.335542:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129575.335881:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734251136 00000100:00100000:3.0:1746129575.335892:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734251136 00000100:00100000:3.0:1746129575.335963:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16472 00000100:00100000:3.0:1746129575.335971:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013577c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:068dab75-d300-4ead-a742-d14572ad1e50+6:1963:x1830948734251136:12345-192.168.202.4@tcp:101:mirror_io.0 00010000:00010000:3.0:1746129575.335991:0:7149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129575.336009:0:7149:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012cd7e200/0x40a459093b06aa92 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2183c expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129575.336034:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129575.336036:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129575.336045:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012cd7e200/0x40a459093b06aa92 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2183c expref: 7 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129575.336061:0:7149:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012cd7e200/0x40a459093b06aa92 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2183c expref: 7 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129575.336072:0:7149:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cd7e200, rc 0) 00000100:00100000:3.0:1746129575.336124:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013577c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:068dab75-d300-4ead-a742-d14572ad1e50+7:1963:x1830948734251136:12345-192.168.202.4@tcp:101:mirror_io.0 Request processed in 153us (592us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129575.336130:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16472 00000100:00080000:0.0:1746129575.336767:0:7097:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746129575.336843:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129575.336939:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129575.336956:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129575.336981:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129575.337003:0:8410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734251392 00000100:00100000:1.0:1746129575.337008:0:8410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734251392 00000100:00100000:1.0:1746129575.337031:0:8410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734251008 00000100:00100000:1.0:1746129575.337033:0:8410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734251008 00000100:00100000:1.0:1746129575.337044:0:8410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734251264 00000100:00100000:1.0:1746129575.337046:0:8410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734251264 00000100:00100000:1.0:1746129575.337056:0:8410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734251520 00000100:00100000:1.0:1746129575.337058:0:8410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734251520 00000100:00100000:1.0:1746129575.337071:0:8410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16473 00000100:00100000:1.0:1746129575.337076:0:8410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135723b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:068dab75-d300-4ead-a742-d14572ad1e50+7:1963:x1830948734251392:12345-192.168.202.4@tcp:101:mirror_io.0 00010000:00010000:1.0:1746129575.337087:0:8410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129575.337100:0:8410:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f385c00/0x40a459093b06aa99 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2184a expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129575.337144:0:8410:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135720700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8410:1830948737563776:192.168.202.4@tcp:106: 00000100:00100000:1.0:1746129575.337209:0:8410:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0ac240 going to sleep for 11 seconds 00000100:00100000:1.0:1746129575.337231:0:22481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16474 00000100:00100000:1.0:1746129575.337235:0:22481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135720000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:068dab75-d300-4ead-a742-d14572ad1e50+8:1963:x1830948734251008:12345-192.168.202.4@tcp:101:mirror_io.0 00010000:00010000:1.0:1746129575.337242:0:22481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129575.337250:0:22481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f384600/0x40a459093b06aaa0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21835 expref: -99 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129575.337260:0:22481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129575.337262:0:22481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129575.337268:0:22481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f384600/0x40a459093b06aaa0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21835 expref: 9 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129575.337314:0:22481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f384600/0x40a459093b06aaa0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21835 expref: 9 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129575.337322:0:22481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f384600, rc 0) 00000100:00100000:1.0:1746129575.337340:0:22481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135720000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:068dab75-d300-4ead-a742-d14572ad1e50+9:1963:x1830948734251008:12345-192.168.202.4@tcp:101:mirror_io.0 Request processed in 105us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129575.337346:0:22481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16474 00000100:00100000:1.0:1746129575.337361:0:22481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16475 00000100:00100000:1.0:1746129575.337365:0:22481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135720a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:068dab75-d300-4ead-a742-d14572ad1e50+8:1963:x1830948734251264:12345-192.168.202.4@tcp:101:mirror_io.0 00010000:00010000:1.0:1746129575.337370:0:22481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129575.337377:0:22481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f385000/0x40a459093b06aaa7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21843 expref: -99 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129575.337386:0:22481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129575.337388:0:22481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129575.337392:0:22481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f385000/0x40a459093b06aaa7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21843 expref: 9 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129575.337401:0:22481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f385000/0x40a459093b06aaa7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21843 expref: 9 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129575.337408:0:22481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f385000, rc 0) 00000100:00100000:1.0:1746129575.337420:0:22481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135720a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:068dab75-d300-4ead-a742-d14572ad1e50+9:1963:x1830948734251264:12345-192.168.202.4@tcp:101:mirror_io.0 Request processed in 55us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129575.337424:0:22481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16475 00000100:00100000:1.0:1746129575.337433:0:22481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16476 00000100:00100000:1.0:1746129575.337437:0:22481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135723800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+11:32436:x1830948734251520:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129575.337442:0:22481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129575.337447:0:22481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f384200/0x40a459093b06aaae lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21851 expref: -99 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129575.337462:0:22481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095ab1600/0x40a459093b06aa29 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->3792895] (req 3178496->3772415) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f217fd expref: 12 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129575.337474:0:22481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a77f7a00/0x40a459093b06aa30 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [3792896->18446744073709551615] (req 3792896->4026367) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21804 expref: 17 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129575.337480:0:22481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746129575.337481:0:22481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746129575.337484:0:22481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f384200/0x40a459093b06aaae lrc: 5/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21851 expref: 12 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129575.337500:0:22481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a77f7a00/0x40a459093b06aa30 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [3792896->18446744073709551615] (req 3792896->4026367) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21804 expref: 17 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129575.337511:0:22481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a77f7a00/0x40a459093b06aa30 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [3792896->18446744073709551615] (req 3792896->4026367) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21804 expref: 17 pid: 7149 timeout: 930 lvb_type: 0 00000100:00100000:1.0:1746129575.337519:0:22481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135722680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:22481:1830948737563904:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129575.337548:0:22481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095ab1600/0x40a459093b06aa29 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->3792895] (req 3178496->3772415) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f217fd expref: 12 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129575.337555:0:22481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095ab1600/0x40a459093b06aa29 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->3792895] (req 3178496->3772415) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f217fd expref: 12 pid: 7149 timeout: 930 lvb_type: 0 00000100:00100000:1.0:1746129575.337564:0:22481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135721500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:22481:1830948737564032:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129575.337580:0:22481:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0ac840 going to sleep for 11 seconds 00002000:00010000:1.0:1746129575.340889:0:8410:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb atime: 1746129575 -> 1746129576 00000100:00100000:1.0:1746129575.340925:0:8410:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135720700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8410:1830948737563776:192.168.202.4@tcp:106: 00010000:00010000:1.0:1746129575.340965:0:8410:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f385c00/0x40a459093b06aa99 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2184a expref: 8 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129575.340980:0:8410:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f385c00/0x40a459093b06aa99 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2184a expref: 8 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129575.341004:0:8410:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f385c00, rc 0) 00000100:00100000:1.0:1746129575.341056:0:8410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135723b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:068dab75-d300-4ead-a742-d14572ad1e50+7:1963:x1830948734251392:12345-192.168.202.4@tcp:101:mirror_io.0 Request processed in 3977us (4212us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129575.341070:0:8410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16473 00000100:00100000:1.0:1746129575.341117:0:22481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135722680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:22481:1830948737563904:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129575.341467:0:21725:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c078e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ada2ffba-8920-4ecb-8068-68caa9806978+26:1963:x1830948734250496:12345-192.168.202.4@tcp:3:cat.0 Request processed in 17494us (17859us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129575.341474:0:21725:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7940 00002000:00100000:3.0:1746129575.341485:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f4:0x0] (1048576->2097151) req@ffff88009c078e00 x1830948734250496/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:316/0 lens 488/440 e 0 to 0 dl 1746129586 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129575.341493:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c078e00 with x1830948734250496 ext(1048576->2097151) 00002000:00010000:3.0:1746129575.341498:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c078e00 00000100:00100000:1.0:1746129575.341582:0:22481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135721500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:22481:1830948737564032:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129575.341600:0:22481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f384200/0x40a459093b06aaae lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21851 expref: 12 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129575.341612:0:22481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f384200, rc 0) 00000100:00100000:1.0:1746129575.341626:0:22481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135723800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+12:32436:x1830948734251520:12345-192.168.202.4@tcp:101:cat.0 Request processed in 4190us (4645us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129575.341631:0:22481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16476 00000100:00100000:2.0:1746129575.341835:0:31523:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c078700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ada2ffba-8920-4ecb-8068-68caa9806978+16:1963:x1830948734250752:12345-192.168.202.4@tcp:3:cat.0 Request processed in 17602us (18174us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129575.341850:0:31523:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7941 00002000:00100000:2.0:1746129575.341855:0:31523:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3ee:0x0] (1048576->2097151) req@ffff88009c078700 x1830948734250752/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:316/0 lens 488/440 e 0 to 0 dl 1746129586 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129575.341861:0:31523:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c078700 with x1830948734250752 ext(1048576->2097151) 00002000:00010000:2.0:1746129575.341864:0:31523:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c078700 00000100:00100000:0.0:1746129575.342160:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129575.342191:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129575.342244:0:21725:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734251648 00000100:00100000:3.0:1746129575.342251:0:21725:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734251648 00002000:00100000:3.0:1746129575.342288:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ef:0x0] (3792896->4026367) req@ffff88013577ed80 x1830948734251648/t0(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:316/0 lens 488/0 e 0 to 0 dl 1746129586 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129575.342312:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013577ed80 with x1830948734251648 ext(3792896->4026367) 00010000:00010000:3.0:1746129575.342317:0:21725:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a77f7a00/0x40a459093b06aa30 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [3792896->18446744073709551615] (req 3792896->4026367) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21804 expref: 16 pid: 7149 timeout: 930 lvb_type: 0 00010000:00010000:3.0:1746129575.342327:0:21725:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a77f7a00/0x40a459093b06aa30 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [3792896->18446744073709551615] (req 3792896->4026367) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21804 expref: 16 pid: 7149 timeout: 930 lvb_type: 0 00002000:00010000:3.0:1746129575.342332:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88013577ed80 00000100:00100000:3.0:1746129575.342397:0:21725:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734251776 00000100:00100000:3.0:1746129575.342400:0:21725:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734251776 00002000:00100000:3.0:1746129575.342411:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ef:0x0] (3178496->3772415) req@ffff88013577c700 x1830948734251776/t0(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:316/0 lens 488/0 e 0 to 0 dl 1746129586 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129575.342418:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013577c700 with x1830948734251776 ext(3178496->3772415) 00010000:00010000:3.0:1746129575.342422:0:21725:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880095ab1600/0x40a459093b06aa29 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->3792895] (req 3178496->3772415) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f217fd expref: 12 pid: 7149 timeout: 930 lvb_type: 0 00010000:00010000:3.0:1746129575.342429:0:21725:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880095ab1600/0x40a459093b06aa29 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->3792895] (req 3178496->3772415) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f217fd expref: 12 pid: 7149 timeout: 930 lvb_type: 0 00002000:00010000:3.0:1746129575.342434:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88013577c700 00000100:00100000:3.0:1746129575.342449:0:31520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2462 00000100:00100000:3.0:1746129575.342454:0:31520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013577ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ada2ffba-8920-4ecb-8068-68caa9806978+16:1962:x1830948734251648:12345-192.168.202.4@tcp:4:cat.0 00000100:00100000:3.0:1746129575.342692:0:21725:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2463 00000100:00100000:3.0:1746129575.342697:0:21725:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013577c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+12:1960:x1830948734251776:12345-192.168.202.4@tcp:4:cat.0 00000100:00100000:0.0:1746129575.347035:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129575.347403:0:16908:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734252032 00000100:00100000:2.0:1746129575.347413:0:16908:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734252032 00000100:00100000:2.0:1746129575.347469:0:16908:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11285 00000100:00100000:2.0:1746129575.347476:0:16908:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013577d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:068dab75-d300-4ead-a742-d14572ad1e50+15:32446:x1830948734252032:12345-192.168.202.4@tcp:101:mirror_io.0 00010000:00010000:2.0:1746129575.347497:0:16908:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129575.347516:0:16908:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa3800/0x40a459093b06aab5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21858 expref: -99 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129575.347620:0:16908:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa3000/0x40a459093b06aabc lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129575.347634:0:16908:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f93e400/0x40a459093b06aa84 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21827 expref: 16 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129575.347640:0:16908:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa3000/0x40a459093b06aabc lrc: 4/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129575.347672:0:16908:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008f93e400/0x40a459093b06aa84 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21827 expref: 16 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129575.347682:0:16908:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f93e400/0x40a459093b06aa84 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21827 expref: 16 pid: 16908 timeout: 930 lvb_type: 0 00000100:00100000:2.0:1746129575.347699:0:16908:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c078380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16908:1830948737564160:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129575.347780:0:16908:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b5354cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746129575.349946:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129575.349988:0:22481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734252160 00000100:00100000:1.0:1746129575.349998:0:22481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734252160 00000100:00100000:1.0:1746129575.350048:0:22481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16477 00000100:00100000:1.0:1746129575.350057:0:22481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135721500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ada2ffba-8920-4ecb-8068-68caa9806978+18:32445:x1830948734252160:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129575.350082:0:22481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129575.350105:0:22481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f384000/0x40a459093b06aac3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2185f expref: -99 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129575.350141:0:22481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129575.350145:0:22481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129575.350150:0:22481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f384000/0x40a459093b06aac3 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2185f expref: 19 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129575.350163:0:22481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f384000/0x40a459093b06aac3 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2185f expref: 19 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129575.350175:0:22481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f384000, rc 0) 00000100:00100000:1.0:1746129575.350229:0:22481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135721500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ada2ffba-8920-4ecb-8068-68caa9806978+19:32445:x1830948734252160:12345-192.168.202.4@tcp:101:cat.0 Request processed in 173us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129575.350235:0:22481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16477 00000100:00100000:3.0:1746129575.351260:0:31520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013577ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ada2ffba-8920-4ecb-8068-68caa9806978+19:1962:x1830948734251648:12345-192.168.202.4@tcp:4:cat.0 Request processed in 8795us (9090us total) trans 21474841400 rc 0/0 00000100:00100000:3.0:1746129575.351284:0:31520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2462 00002000:00100000:3.0:1746129575.351339:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3ef:0x0] (3792896->4026367) req@ffff88013577ed80 x1830948734251648/t21474841400(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:316/0 lens 488/448 e 0 to 0 dl 1746129586 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129575.351350:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013577ed80 with x1830948734251648 ext(3792896->4026367) 00010000:00010000:3.0:1746129575.351362:0:31520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a77f7a00/0x40a459093b06aa30 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [3792896->18446744073709551615] (req 3792896->4026367) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21804 expref: 19 pid: 7149 timeout: 930 lvb_type: 0 00010000:00010000:3.0:1746129575.351374:0:31520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a77f7a00/0x40a459093b06aa30 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [3792896->18446744073709551615] (req 3792896->4026367) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21804 expref: 19 pid: 7149 timeout: 930 lvb_type: 0 00002000:00010000:3.0:1746129575.351382:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88013577ed80 00000100:00100000:3.0:1746129575.353048:0:16908:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c078380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16908:1830948737564160:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129575.353085:0:16908:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa3000/0x40a459093b06aabc lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00000100:00100000:2.0:1746129575.353263:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129575.353567:0:15749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734252288 00000100:00100000:3.0:1746129575.353575:0:15749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734252288 00010000:00010000:3.0:1746129575.353628:0:15749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f93e400/0x40a459093b06aa84 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21827 expref: 17 pid: 16908 timeout: 930 lvb_type: 0 00000100:00100000:3.0:1746129575.353665:0:15749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8468 00000100:00100000:3.0:1746129575.353673:0:15749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6fd2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:068dab75-d300-4ead-a742-d14572ad1e50+17:1962:x1830948734252288:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129575.353690:0:15749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129575.353698:0:15749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008f93e400/0x40a459093b06aa84 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21827 expref: 17 pid: 16908 timeout: 930 lvb_type: 0 00010000:00010000:3.0:1746129575.353709:0:15749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008f93e400/0x40a459093b06aa84 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21827 expref: 17 pid: 16908 timeout: 930 lvb_type: 0 00010000:00010000:3.0:1746129575.353737:0:15749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f93e400/0x40a459093b06aa84 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21827 expref: 17 pid: 16908 timeout: 930 lvb_type: 0 00010000:00010000:3.0:1746129575.354224:0:15749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:3.0:1746129575.354231:0:15749:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa3000/0x40a459093b06aabc lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129575.354243:0:15749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa3000/0x40a459093b06aabc lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129575.354251:0:15749:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa3000/0x40a459093b06aabc lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129575.354284:0:15749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746129575.354380:0:16908:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa3000/0x40a459093b06aabc lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129575.354386:0:16908:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa3000/0x40a459093b06aabc lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00000004:00200000:0.0:1746129575.354407:0:16908:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00000100:00100000:3.0:1746129575.354523:0:15749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6fd2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:068dab75-d300-4ead-a742-d14572ad1e50+16:1962:x1830948734252288:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 850us (1260us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129575.354531:0:15749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8468 00000100:00100000:1.0:1746129575.354611:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129575.354796:0:15749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734252416 00000100:00100000:3.0:1746129575.354800:0:15749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734252416 00010000:00010000:3.0:1746129575.354818:0:15749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a77f7a00/0x40a459093b06aa30 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [3792896->18446744073709551615] (req 3792896->4026367) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21804 expref: 19 pid: 7149 timeout: 930 lvb_type: 0 00000100:00100000:3.0:1746129575.354847:0:15749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8469 00000100:00100000:3.0:1746129575.354853:0:15749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135722680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ada2ffba-8920-4ecb-8068-68caa9806978+19:1960:x1830948734252416:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129575.354864:0:15749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129575.355058:0:16908:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa3800/0x40a459093b06aab5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21858 expref: 17 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129575.355122:0:15749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a77f7a00/0x40a459093b06aa30 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [3792896->18446744073709551615] (req 3792896->4026367) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21804 expref: 19 pid: 7149 timeout: 930 lvb_type: 0 00010000:00010000:3.0:1746129575.355137:0:15749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a77f7a00/0x40a459093b06aa30 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [3792896->18446744073709551615] (req 3792896->4026367) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21804 expref: 19 pid: 7149 timeout: 930 lvb_type: 0 00010000:00010000:3.0:1746129575.355154:0:15749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a77f7a00/0x40a459093b06aa30 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [3792896->18446744073709551615] (req 3792896->4026367) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21804 expref: 19 pid: 7149 timeout: 930 lvb_type: 0 00010000:00010000:3.0:1746129575.355168:0:15749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746129575.355389:0:16908:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa3000/0x40a459093b06aabc lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21858 expref: 16 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129575.355397:0:16908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:0.0:1746129575.355400:0:16908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746129575.355402:0:16908:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009faa3000, rc 0) 00000100:00100000:3.0:1746129575.355545:0:15749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135722680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ada2ffba-8920-4ecb-8068-68caa9806978+18:1960:x1830948734252416:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 692us (935us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129575.355552:0:15749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8469 00000100:00100000:0.0:1746129575.355750:0:16908:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013577d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:068dab75-d300-4ead-a742-d14572ad1e50+16:32446:x1830948734252032:12345-192.168.202.4@tcp:101:mirror_io.0 Request processed in 8274us (8726us total) trans 8589945392 rc 0/0 00000100:00100000:0.0:1746129575.355756:0:16908:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11285 00000100:00100000:0.0:1746129575.358138:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129575.358312:0:16908:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734252672 00000100:00100000:1.0:1746129575.358322:0:16908:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734252672 00000100:00100000:1.0:1746129575.358376:0:16908:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11286 00000100:00100000:1.0:1746129575.358384:0:16908:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013577fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:068dab75-d300-4ead-a742-d14572ad1e50+16:32446:x1830948734252672:12345-192.168.202.4@tcp:101:mirror_io.0 00010000:00010000:1.0:1746129575.358413:0:16908:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129575.358416:0:16908:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1746129575.358757:0:16908:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa3000/0x40a459093b06aabc lrc: 0/0,0 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21858 expref: 16 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129575.358778:0:16908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:1.0:1746129575.358782:0:16908:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746129575.358793:0:16908:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f384800/0x40a459093b06aad1 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21866 expref: -99 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129575.359718:0:16908:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f384c00/0x40a459093b06aad8 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129575.359735:0:16908:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f384c00/0x40a459093b06aad8 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129575.359745:0:16908:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f384c00/0x40a459093b06aad8 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00000004:00200000:1.0:1746129575.359757:0:16908:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:1.0:1746129575.359886:0:16908:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f384800/0x40a459093b06aad1 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21866 expref: 18 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129575.359901:0:16908:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f384c00/0x40a459093b06aad8 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21866 expref: 17 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129575.359906:0:16908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:1.0:1746129575.359909:0:16908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746129575.359911:0:16908:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f384c00, rc 0) 00000100:00100000:1.0:1746129575.360009:0:16908:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013577fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:068dab75-d300-4ead-a742-d14572ad1e50+17:32446:x1830948734252672:12345-192.168.202.4@tcp:101:mirror_io.0 Request processed in 1624us (1879us total) trans 8589945393 rc 0/0 00000100:00100000:1.0:1746129575.360016:0:16908:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11286 00000100:00100000:0.0:1746129575.362820:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129575.363323:0:16908:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734252800 00000100:00100000:1.0:1746129575.363333:0:16908:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734252800 00000100:00100000:1.0:1746129575.363389:0:16908:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11287 00000100:00100000:1.0:1746129575.363396:0:16908:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013577ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:068dab75-d300-4ead-a742-d14572ad1e50+17:32446:x1830948734252800:12345-192.168.202.4@tcp:101:mirror_io.0 00010000:00010000:1.0:1746129575.363418:0:16908:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129575.363436:0:16908:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f384400/0x40a459093b06aae6 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2186d expref: -99 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129575.363499:0:16908:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f384400/0x40a459093b06aae6 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2186d expref: 18 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129575.363514:0:16908:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f384400/0x40a459093b06aae6 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2186d expref: 18 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129575.363530:0:16908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:1.0:1746129575.363534:0:16908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746129575.363537:0:16908:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f384400, rc 0) 00000100:00100000:1.0:1746129575.363584:0:16908:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013577ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:068dab75-d300-4ead-a742-d14572ad1e50+18:32446:x1830948734252800:12345-192.168.202.4@tcp:101:mirror_io.0 Request processed in 188us (774us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129575.363589:0:16908:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11287 00000100:00100000:2.0:1746129575.365099:0:21725:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013577c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+14:1960:x1830948734251776:12345-192.168.202.4@tcp:4:cat.0 Request processed in 22391us (22896us total) trans 21474841401 rc 0/0 00000100:00100000:2.0:1746129575.365110:0:21725:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2463 00002000:00100000:2.0:1746129575.365122:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ef:0x0] (3178496->3772415) req@ffff88013577c700 x1830948734251776/t21474841401(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:316/0 lens 488/448 e 0 to 0 dl 1746129586 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129575.365132:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013577c700 with x1830948734251776 ext(3178496->3772415) 00010000:00010000:2.0:1746129575.365141:0:21725:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880095ab1600/0x40a459093b06aa29 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->3792895] (req 3178496->3772415) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f217fd expref: 14 pid: 7149 timeout: 930 lvb_type: 0 00010000:00010000:2.0:1746129575.365156:0:21725:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880095ab1600/0x40a459093b06aa29 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->3792895] (req 3178496->3772415) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f217fd expref: 14 pid: 7149 timeout: 930 lvb_type: 0 00002000:00010000:2.0:1746129575.365752:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88013577c700 00000100:00100000:0.0:1746129575.365896:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129575.365933:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129575.365947:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129575.365963:0:4699:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734252928 00000100:00100000:0.0:1746129575.365970:0:4699:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734252928 00000100:00100000:0.0:1746129575.366007:0:4699:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734253056 00000100:00100000:0.0:1746129575.366011:0:4699:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734253056 00000100:00100000:1.0:1746129575.366015:0:22481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734253184 00000100:00100000:1.0:1746129575.366018:0:22481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734253184 00000100:00100000:0.0:1746129575.366025:0:4699:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16478 00000100:00100000:0.0:1746129575.366032:0:4699:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013577d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:068dab75-d300-4ead-a742-d14572ad1e50+7:1963:x1830948734252928:12345-192.168.202.4@tcp:1:mirror_io.0 00000100:00100000:1.0:1746129575.366133:0:22481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16479 00000100:00100000:2.0:1746129575.366137:0:8410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16480 00000100:00100000:1.0:1746129575.366138:0:22481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013577dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:068dab75-d300-4ead-a742-d14572ad1e50+9:1963:x1830948734253056:12345-192.168.202.4@tcp:1:mirror_io.0 00000100:00100000:2.0:1746129575.366144:0:8410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013577ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:068dab75-d300-4ead-a742-d14572ad1e50+9:1963:x1830948734253184:12345-192.168.202.4@tcp:1:mirror_io.0 00010000:00010000:2.0:1746129575.366159:0:8410:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880094cde200/0x40a459093b06aaf4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129575.366159:0:22481:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009f384a00/0x40a459093b06aaed lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129575.366175:0:8410:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008fbb7000/0x40a459093b06a9e3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f217e1 expref: 15 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129575.366175:0:22481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a60b2000/0x40a459093b06a9c7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f217c5 expref: 25 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129575.366183:0:22481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f384600/0x40a459093b06aaa0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21835 expref: 9 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129575.366188:0:8410:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012cd7e200/0x40a459093b06aa92 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2183c expref: 9 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129575.366189:0:22481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a95e6400/0x40a459093b06a9dc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f217da expref: 15 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129575.366194:0:8410:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a77f6a00/0x40a459093b06aa5a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21812 expref: 25 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129575.366196:0:22481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129575.366198:0:8410:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129575.366198:0:22481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129575.366199:0:8410:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129575.366201:0:8410:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094cde200/0x40a459093b06aaf4 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129575.366201:0:22481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f384a00/0x40a459093b06aaed lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129575.366229:0:8410:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a77f6a00/0x40a459093b06aa5a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21812 expref: 25 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129575.366229:0:22481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a95e6400/0x40a459093b06a9dc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f217da expref: 15 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129575.366239:0:8410:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a77f6a00/0x40a459093b06aa5a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21812 expref: 25 pid: 7149 timeout: 930 lvb_type: 1 00010000:00010000:1.0:1746129575.366239:0:22481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a95e6400/0x40a459093b06a9dc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f217da expref: 15 pid: 8410 timeout: 930 lvb_type: 0 00000100:00100000:2.0:1746129575.366251:0:8410:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c078380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8410:1830948737564416:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129575.366251:0:22481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135720700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:22481:1830948737564288:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129575.366345:0:4699:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009cfd6200/0x40a459093b06aafb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129575.366355:0:4699:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f890e00/0x40a459093b06a9b2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f217b0 expref: 17 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129575.366362:0:4699:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012cd7ec00/0x40a459093b06aa8b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2182e expref: 7 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129575.366368:0:4699:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a60b2e00/0x40a459093b06a9c0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f217be expref: 13 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129575.366374:0:4699:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129575.366375:0:4699:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129575.366377:0:4699:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cfd6200/0x40a459093b06aafb lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129575.366394:0:4699:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a60b2e00/0x40a459093b06a9c0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f217be expref: 13 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129575.366401:0:4699:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a60b2e00/0x40a459093b06a9c0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f217be expref: 13 pid: 8410 timeout: 930 lvb_type: 1 00000100:00100000:0.0:1746129575.366411:0:4699:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e388380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4699:1830948737564544:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129575.366450:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00010000:00010000:1.0:1746129575.366499:0:22481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f384600/0x40a459093b06aaa0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21835 expref: 9 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129575.366507:0:4699:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012cd7ec00/0x40a459093b06aa8b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2182e expref: 7 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129575.366508:0:22481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f384600/0x40a459093b06aaa0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21835 expref: 9 pid: 22481 timeout: 930 lvb_type: 1 00010000:00010000:2.0:1746129575.366514:0:4699:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012cd7ec00/0x40a459093b06aa8b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2182e expref: 7 pid: 7149 timeout: 930 lvb_type: 1 00000100:00100000:1.0:1746129575.366516:0:22481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135722300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:22481:1830948737564672:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129575.366522:0:4699:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136014e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4699:1830948737564800:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129575.366540:0:22481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a60b2000/0x40a459093b06a9c7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f217c5 expref: 25 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129575.366542:0:4699:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f890e00/0x40a459093b06a9b2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f217b0 expref: 17 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129575.366547:0:22481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a60b2000/0x40a459093b06a9c7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f217c5 expref: 25 pid: 8410 timeout: 930 lvb_type: 0 00010000:00010000:2.0:1746129575.366550:0:4699:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f890e00/0x40a459093b06a9b2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f217b0 expref: 17 pid: 8410 timeout: 930 lvb_type: 0 00000100:00100000:2.0:1746129575.366557:0:4699:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136015180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4699:1830948737565056:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129575.366559:0:22481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135721880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:22481:1830948737564928:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129575.366571:0:4699:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4123a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746129575.366571:0:22481:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0ac840 going to sleep for 11 seconds 00000100:00100000:0.0:1746129575.366602:0:22480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734253312 00000100:00100000:0.0:1746129575.366605:0:22480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734253312 00000100:00100000:0.0:1746129575.366623:0:22480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16481 00010000:00010000:3.0:1746129575.366624:0:8410:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012cd7e200/0x40a459093b06aa92 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2183c expref: 9 pid: 7149 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746129575.366627:0:22480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e38b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:068dab75-d300-4ead-a742-d14572ad1e50+8:1963:x1830948734253312:12345-192.168.202.4@tcp:1:mirror_io.0 00010000:00010000:3.0:1746129575.366634:0:8410:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012cd7e200/0x40a459093b06aa92 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2183c expref: 9 pid: 7149 timeout: 930 lvb_type: 1 00000100:00100000:3.0:1746129575.366641:0:8410:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8410:1830948737565184:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129575.366641:0:22480:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009cfd7a00/0x40a459093b06ab02 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129575.366650:0:22480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091b63c00/0x40a459093b06a9ff lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f217ef expref: 13 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129575.366656:0:22480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f385000/0x40a459093b06aaa7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21843 expref: 8 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129575.366663:0:8410:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008fbb7000/0x40a459093b06a9e3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f217e1 expref: 15 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129575.366663:0:22480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a77f6e00/0x40a459093b06aa61 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21819 expref: 17 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129575.366668:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129575.366670:0:8410:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008fbb7000/0x40a459093b06a9e3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f217e1 expref: 15 pid: 7149 timeout: 930 lvb_type: 0 00010000:00010000:0.0:1746129575.366670:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129575.366672:0:22480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cfd7a00/0x40a459093b06ab02 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129575.366682:0:8410:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8410:1830948737565312:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129575.366684:0:22480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a77f6e00/0x40a459093b06aa61 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21819 expref: 17 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129575.366690:0:22480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a77f6e00/0x40a459093b06aa61 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21819 expref: 17 pid: 7149 timeout: 930 lvb_type: 1 00000100:00100000:3.0:1746129575.366694:0:8410:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b5354cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129575.366697:0:22480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e38a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22480:1830948737565440:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129575.366717:0:22480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f385000/0x40a459093b06aaa7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21843 expref: 8 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129575.366723:0:22480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f385000/0x40a459093b06aaa7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21843 expref: 8 pid: 22481 timeout: 930 lvb_type: 1 00000100:00100000:0.0:1746129575.366729:0:22480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e38aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22480:1830948737565568:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129575.366743:0:22480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091b63c00/0x40a459093b06a9ff lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f217ef expref: 13 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129575.366749:0:22480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091b63c00/0x40a459093b06a9ff lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f217ef expref: 13 pid: 7149 timeout: 930 lvb_type: 0 00000100:00100000:0.0:1746129575.366755:0:22480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e389500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22480:1830948737565696:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129575.366767:0:22480:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4123d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746129575.366779:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129575.366803:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129575.366844:0:11014:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734253568 00000100:00100000:2.0:1746129575.366844:0:8411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734253440 00000100:00100000:3.0:1746129575.366847:0:11014:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734253568 00000100:00100000:2.0:1746129575.366847:0:8411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734253440 00000100:00100000:2.0:1746129575.366868:0:8411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16482 00000100:00100000:3.0:1746129575.366872:0:11014:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16483 00000100:00100000:2.0:1746129575.366873:0:8411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135722a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:068dab75-d300-4ead-a742-d14572ad1e50+9:1963:x1830948734253440:12345-192.168.202.4@tcp:1:mirror_io.0 00000100:00100000:3.0:1746129575.366876:0:11014:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135721f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:068dab75-d300-4ead-a742-d14572ad1e50+10:1963:x1830948734253568:12345-192.168.202.4@tcp:1:mirror_io.0 00010000:00010000:2.0:1746129575.366887:0:8411:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009487ec00/0x40a459093b06ab09 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129575.366888:0:11014:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009cdfcc00/0x40a459093b06ab10 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129575.366894:0:8411:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129575.366896:0:11014:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a6de9800/0x40a459093b06a80e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f216bb expref: 15 pid: 8411 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129575.366898:0:8411:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f384200/0x40a459093b06aaae lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21851 expref: 13 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129575.366903:0:11014:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095ff0000/0x40a459093b06a8d2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21739 expref: 10 pid: 31503 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129575.366904:0:8411:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f384000/0x40a459093b06aac3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2185f expref: 17 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129575.366909:0:8411:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 3 00010000:00010000:3.0:1746129575.366910:0:11014:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a6de9400/0x40a459093b06a85b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f216e5 expref: 25 pid: 20577 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129575.366911:0:8411:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009487ec00/0x40a459093b06ab09 lrc: 5/0,1 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129575.366915:0:11014:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129575.366916:0:11014:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129575.366917:0:11014:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cdfcc00/0x40a459093b06ab10 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129575.366928:0:11014:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a6de9400/0x40a459093b06a85b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f216e5 expref: 25 pid: 20577 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129575.366928:0:8411:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f384000/0x40a459093b06aac3 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2185f expref: 17 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129575.366938:0:8411:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f384200/0x40a459093b06aaae lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21851 expref: 13 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129575.366939:0:11014:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a6de9400/0x40a459093b06a85b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f216e5 expref: 25 pid: 20577 timeout: 930 lvb_type: 1 00000100:00100000:3.0:1746129575.366946:0:11014:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11014:1830948737565952:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129575.366949:0:8411:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009487ec00/0x40a459093b06ab09 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129575.366967:0:11014:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095ff0000/0x40a459093b06a8d2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21739 expref: 10 pid: 31503 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129575.366975:0:11014:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095ff0000/0x40a459093b06a8d2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21739 expref: 10 pid: 31503 timeout: 930 lvb_type: 1 00000100:00100000:3.0:1746129575.367006:0:11014:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11014:1830948737566208:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129575.367027:0:11014:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a6de9800/0x40a459093b06a80e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f216bb expref: 15 pid: 8411 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129575.367035:0:11014:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a6de9800/0x40a459093b06a80e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f216bb expref: 15 pid: 8411 timeout: 930 lvb_type: 1 00000100:00100000:3.0:1746129575.367042:0:11014:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11014:1830948737566336:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129575.367059:0:11014:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa381600 going to sleep for 11 seconds 00000100:00100000:1.0:1746129575.379851:0:22481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135720700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:22481:1830948737564288:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129575.379858:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129575.379864:0:22481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135722300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:22481:1830948737564672:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129575.379873:0:22481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135721880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:22481:1830948737564928:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129575.379885:0:20578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734253824 00000100:00100000:0.0:1746129575.379891:0:20578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734253824 00010000:00010000:1.0:1746129575.379907:0:22481:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009f384a00/0x40a459093b06aaed lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129575.379924:0:20578:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a95e6400/0x40a459093b06a9dc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f217da expref: 16 pid: 8410 timeout: 930 lvb_type: 0 00000100:00100000:3.0:1746129575.379997:0:8410:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c078380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8410:1830948737564416:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129575.380018:0:15749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8470 00000100:00100000:3.0:1746129575.380026:0:15749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e389180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+16:1960:x1830948734253824:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129575.380041:0:15749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129575.380066:0:15749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a95e6400/0x40a459093b06a9dc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f217da expref: 16 pid: 8410 timeout: 930 lvb_type: 0 00010000:00010000:3.0:1746129575.380075:0:15749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a95e6400/0x40a459093b06a9dc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f217da expref: 16 pid: 8410 timeout: 930 lvb_type: 0 00010000:00010000:3.0:1746129575.380098:0:15749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a95e6400/0x40a459093b06a9dc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f217da expref: 16 pid: 8410 timeout: 930 lvb_type: 0 00000100:00100000:2.0:1746129575.380098:0:4699:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e388380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4699:1830948737564544:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129575.380107:0:4699:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136014e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4699:1830948737564800:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129575.380114:0:4699:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136015180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4699:1830948737565056:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129575.380121:0:15749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746129575.380130:0:4699:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009cfd6200/0x40a459093b06aafb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129575.380156:0:15749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e389180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+15:1960:x1830948734253824:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 132us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129575.380163:0:15749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8470 00000100:00100000:1.0:1746129575.380244:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129575.380357:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129575.380372:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734254080 00000100:00100000:1.0:1746129575.380375:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734254080 00010000:00010000:1.0:1746129575.380389:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f384600/0x40a459093b06aaa0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21835 expref: 11 pid: 22481 timeout: 930 lvb_type: 1 00000100:00100000:1.0:1746129575.380415:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734254336 00000100:00100000:1.0:1746129575.380418:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734254336 00010000:00010000:1.0:1746129575.380428:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f890e00/0x40a459093b06a9b2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f217b0 expref: 18 pid: 8410 timeout: 930 lvb_type: 0 00000100:00100000:1.0:1746129575.380441:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8471 00000100:00100000:1.0:1746129575.380446:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135721880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:068dab75-d300-4ead-a742-d14572ad1e50+11:1960:x1830948734254080:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129575.380455:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129575.380464:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f384600/0x40a459093b06aaa0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21835 expref: 11 pid: 22481 timeout: 930 lvb_type: 1 00010000:00010000:1.0:1746129575.380470:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f384600/0x40a459093b06aaa0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21835 expref: 11 pid: 22481 timeout: 930 lvb_type: 1 00010000:00010000:1.0:1746129575.380481:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f384600/0x40a459093b06aaa0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21835 expref: 11 pid: 22481 timeout: 930 lvb_type: 1 00010000:00010000:1.0:1746129575.380494:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129575.380518:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135721880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:068dab75-d300-4ead-a742-d14572ad1e50+10:1960:x1830948734254080:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 72us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129575.380523:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8471 00000100:00100000:2.0:1746129575.380528:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8472 00000100:00100000:2.0:1746129575.380535:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135722300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ada2ffba-8920-4ecb-8068-68caa9806978+18:1960:x1830948734254336:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129575.380543:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746129575.380550:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00010000:00010000:2.0:1746129575.380558:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f890e00/0x40a459093b06a9b2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f217b0 expref: 18 pid: 8410 timeout: 930 lvb_type: 0 00000100:00100000:1.0:1746129575.380560:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734253696 00000100:00100000:1.0:1746129575.380563:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734253696 00010000:00010000:2.0:1746129575.380566:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f890e00/0x40a459093b06a9b2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f217b0 expref: 18 pid: 8410 timeout: 930 lvb_type: 0 00010000:00010000:1.0:1746129575.380572:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095ab1600/0x40a459093b06aa29 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->3792895] (req 3178496->3772415) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f217fd expref: 14 pid: 7149 timeout: 930 lvb_type: 0 00010000:00010000:2.0:1746129575.380578:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f890e00/0x40a459093b06a9b2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f217b0 expref: 18 pid: 8410 timeout: 930 lvb_type: 0 00000100:00100000:1.0:1746129575.380584:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8473 00000100:00100000:1.0:1746129575.380588:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135720700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+14:1960:x1830948734253696:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129575.380593:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129575.380596:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746129575.380603:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095ab1600/0x40a459093b06aa29 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->3792895] (req 3178496->3772415) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f217fd expref: 14 pid: 7149 timeout: 930 lvb_type: 0 00000100:00100000:2.0:1746129575.380610:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135722300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ada2ffba-8920-4ecb-8068-68caa9806978+17:1960:x1830948734254336:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 77us (254us total) trans 0 rc 0/0 00010000:00010000:1.0:1746129575.380610:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095ab1600/0x40a459093b06aa29 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->3792895] (req 3178496->3772415) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f217fd expref: 14 pid: 7149 timeout: 930 lvb_type: 0 00000100:00100000:2.0:1746129575.380615:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8472 00010000:00010000:1.0:1746129575.380622:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095ab1600/0x40a459093b06aa29 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->3792895] (req 3178496->3772415) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f217fd expref: 14 pid: 7149 timeout: 930 lvb_type: 0 00010000:00010000:1.0:1746129575.380631:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129575.380633:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129575.380640:0:7085:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f384200/0x40a459093b06aaae lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60080000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21851 expref: 13 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129575.380649:0:7085:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f384200/0x40a459093b06aaae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60080000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21851 expref: 13 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129575.380657:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129575.380658:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129575.380661:0:7085:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f384000/0x40a459093b06aac3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2185f expref: 16 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129575.380667:0:7085:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f384000/0x40a459093b06aac3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2185f expref: 16 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129575.380696:0:7085:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f384000/0x40a459093b06aac3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2185f expref: 16 pid: 22481 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129575.380699:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00010000:00010000:1.0:1746129575.380706:0:7085:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f384000/0x40a459093b06aac3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2185f expref: 16 pid: 22481 timeout: 930 lvb_type: 0 00000100:00100000:0.0:1746129575.380708:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734253952 00000100:00100000:0.0:1746129575.380711:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734253952 00000100:00100000:1.0:1746129575.380717:0:7085:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135723480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7085:1830948737566464:192.168.202.4@tcp:105: 00010000:00010000:0.0:1746129575.380721:0:7087:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a60b2e00/0x40a459093b06a9c0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f217be expref: 14 pid: 8410 timeout: 930 lvb_type: 1 00000100:00100000:0.0:1746129575.380737:0:7087:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8474 00000100:00100000:0.0:1746129575.380741:0:7087:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e38b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+14:1960:x1830948734253952:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129575.380746:0:7087:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129575.380754:0:7087:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a60b2e00/0x40a459093b06a9c0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f217be expref: 14 pid: 8410 timeout: 930 lvb_type: 1 00010000:00010000:0.0:1746129575.380761:0:7087:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a60b2e00/0x40a459093b06a9c0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f217be expref: 14 pid: 8410 timeout: 930 lvb_type: 1 00010000:00010000:1.0:1746129575.380767:0:7085:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f384200/0x40a459093b06aaae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21851 expref: 14 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129575.380770:0:7087:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a60b2e00/0x40a459093b06a9c0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f217be expref: 14 pid: 8410 timeout: 930 lvb_type: 1 00010000:00010000:1.0:1746129575.380774:0:7085:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f384200/0x40a459093b06aaae lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21851 expref: 14 pid: 22481 timeout: 930 lvb_type: 0 00000100:00100000:1.0:1746129575.380782:0:7085:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135721c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7085:1830948737566592:192.168.202.4@tcp:105: 00010000:00010000:0.0:1746129575.380782:0:7087:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129575.380794:0:7087:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e38b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+13:1960:x1830948734253952:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 52us (95us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129575.380795:0:7085:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0ac840 going to sleep for 11 seconds 00000100:00100000:0.0:1746129575.380799:0:7087:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8474 00000100:00100000:0.0:1746129575.382650:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129575.382695:0:15749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734254208 00000100:00100000:3.0:1746129575.382701:0:15749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734254208 00010000:00010000:3.0:1746129575.382730:0:15749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012cd7ec00/0x40a459093b06aa8b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2182e expref: 10 pid: 7149 timeout: 930 lvb_type: 1 00000100:00100000:3.0:1746129575.382751:0:15749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8475 00000100:00100000:3.0:1746129575.382756:0:15749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6fd1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:068dab75-d300-4ead-a742-d14572ad1e50+10:1960:x1830948734254208:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129575.382768:0:15749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129575.382781:0:15749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012cd7ec00/0x40a459093b06aa8b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2182e expref: 10 pid: 7149 timeout: 930 lvb_type: 1 00010000:00010000:3.0:1746129575.382790:0:15749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012cd7ec00/0x40a459093b06aa8b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2182e expref: 10 pid: 7149 timeout: 930 lvb_type: 1 00010000:00010000:3.0:1746129575.382806:0:15749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012cd7ec00/0x40a459093b06aa8b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2182e expref: 10 pid: 7149 timeout: 930 lvb_type: 1 00010000:00010000:3.0:1746129575.382817:0:15749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129575.382819:0:15749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129575.382823:0:15749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cfd6200/0x40a459093b06aafb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129575.382830:0:15749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cfd6200/0x40a459093b06aafb lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129575.382898:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129575.382910:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00010000:00010000:3.0:1746129575.383465:0:15749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129575.383507:0:15749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6fd1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:068dab75-d300-4ead-a742-d14572ad1e50+9:1960:x1830948734254208:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 748us (1237us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129575.383514:0:15749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8475 00000100:00100000:1.0:1746129575.383754:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129575.384003:0:11014:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11014:1830948737565952:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129575.384013:0:11014:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11014:1830948737566208:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129575.384032:0:8410:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8410:1830948737565184:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129575.384040:0:8410:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8410:1830948737565312:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129575.384071:0:8410:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880094cde200/0x40a459093b06aaf4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129575.384098:0:15749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734254464 00000100:00100000:3.0:1746129575.384103:0:15749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734254464 00010000:00010000:3.0:1746129575.384118:0:15749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012cd7e200/0x40a459093b06aa92 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2183c expref: 10 pid: 7149 timeout: 930 lvb_type: 1 00000100:00100000:3.0:1746129575.384138:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734254592 00000100:00100000:3.0:1746129575.384141:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734254592 00010000:00010000:3.0:1746129575.384152:0:9823:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a60b2000/0x40a459093b06a9c7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f217c5 expref: 26 pid: 8410 timeout: 930 lvb_type: 0 00000100:00100000:3.0:1746129575.384162:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8476 00000100:00100000:3.0:1746129575.384167:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135722d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:068dab75-d300-4ead-a742-d14572ad1e50+10:1961:x1830948734254464:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129575.384177:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129575.384193:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012cd7e200/0x40a459093b06aa92 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2183c expref: 10 pid: 7149 timeout: 930 lvb_type: 1 00010000:00010000:3.0:1746129575.384201:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012cd7e200/0x40a459093b06aa92 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2183c expref: 10 pid: 7149 timeout: 930 lvb_type: 1 00010000:00010000:3.0:1746129575.384217:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012cd7e200/0x40a459093b06aa92 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2183c expref: 10 pid: 7149 timeout: 930 lvb_type: 1 00010000:00010000:3.0:1746129575.384226:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129575.384246:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135722d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:068dab75-d300-4ead-a742-d14572ad1e50+9:1961:x1830948734254464:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 79us (1348us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129575.384250:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8476 00000100:00100000:3.0:1746129575.384259:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8477 00000100:00100000:3.0:1746129575.384263:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135720e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ada2ffba-8920-4ecb-8068-68caa9806978+26:1962:x1830948734254592:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129575.384269:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129575.384289:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a60b2000/0x40a459093b06a9c7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f217c5 expref: 26 pid: 8410 timeout: 930 lvb_type: 0 00010000:00010000:3.0:1746129575.384317:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a60b2000/0x40a459093b06a9c7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f217c5 expref: 26 pid: 8410 timeout: 930 lvb_type: 0 00010000:00010000:3.0:1746129575.384329:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a60b2000/0x40a459093b06a9c7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f217c5 expref: 26 pid: 8410 timeout: 930 lvb_type: 0 00010000:00010000:3.0:1746129575.384338:0:9823:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129575.384340:0:9823:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129575.384343:0:9823:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f384a00/0x40a459093b06aaed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129575.384350:0:9823:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f384a00/0x40a459093b06aaed lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129575.384371:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129575.384385:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135720e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ada2ffba-8920-4ecb-8068-68caa9806978+25:1962:x1830948734254592:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 121us (1474us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129575.384390:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8477 00010000:00010000:3.0:1746129575.384419:0:4699:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009cfd6200/0x40a459093b06aafb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129575.384426:0:4699:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cfd6200/0x40a459093b06aafb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129575.384450:0:4699:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009cfd6200/0x40a459093b06aafb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129575.384461:0:4699:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009cfd6200/0x40a459093b06aafb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129575.384468:0:4699:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009cfd6200/0x40a459093b06aafb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129575.384475:0:4699:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009cfd6200 already unused, calling callback (ffffffffa086ed70) 00010000:00010000:3.0:1746129575.384479:0:4699:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009cfd6200/0x40a459093b06aafb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129575.384486:0:4699:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009cfd6200/0x40a459093b06aafb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129575.384496:0:4699:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009cfd6200/0x40a459093b06aafb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129575.384502:0:4699:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cfd6200/0x40a459093b06aafb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129575.384542:0:4699:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013577d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:068dab75-d300-4ead-a742-d14572ad1e50+8:1963:x1830948734252928:12345-192.168.202.4@tcp:1:mirror_io.0 Request processed in 18511us (18648us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129575.384550:0:4699:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16478 00010000:00010000:1.0:1746129575.384737:0:22481:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009f384a00/0x40a459093b06aaed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129575.384744:0:22481:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f384a00/0x40a459093b06aaed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129575.384759:0:22481:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009f384a00/0x40a459093b06aaed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129575.384765:0:22481:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009f384a00/0x40a459093b06aaed lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129575.384771:0:22481:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009f384a00/0x40a459093b06aaed lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129575.384776:0:22481:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f384a00 already unused, calling callback (ffffffffa086ed70) 00010000:00010000:1.0:1746129575.384779:0:22481:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f384a00/0x40a459093b06aaed lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129575.384785:0:22481:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f384a00/0x40a459093b06aaed lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129575.384792:0:22481:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009f384a00/0x40a459093b06aaed lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129575.384797:0:22481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f384a00/0x40a459093b06aaed lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 22481 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129575.384833:0:22481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013577dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:068dab75-d300-4ead-a742-d14572ad1e50+8:1963:x1830948734253056:12345-192.168.202.4@tcp:1:mirror_io.0 Request processed in 18695us (18899us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129575.384839:0:22481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16479 00000100:00100000:1.0:1746129575.384876:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129575.384894:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129575.384905:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129575.384926:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129575.384938:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129575.384947:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129575.384987:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129575.385102:0:7086:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734255232 00000100:00100000:2.0:1746129575.385107:0:7086:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734255232 00010000:00010000:2.0:1746129575.385124:0:7086:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a77f6a00/0x40a459093b06aa5a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21812 expref: 25 pid: 7149 timeout: 930 lvb_type: 1 00000100:00100000:2.0:1746129575.385134:0:7086:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734254848 00000100:00100000:2.0:1746129575.385136:0:7086:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734254848 00010000:00010000:2.0:1746129575.385143:0:7086:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008fbb7000/0x40a459093b06a9e3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f217e1 expref: 15 pid: 7149 timeout: 930 lvb_type: 0 00000100:00100000:2.0:1746129575.385150:0:7086:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734255104 00000100:00100000:2.0:1746129575.385152:0:7086:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734255104 00010000:00010000:2.0:1746129575.385160:0:7086:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095ff0000/0x40a459093b06a8d2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21739 expref: 8 pid: 31503 timeout: 930 lvb_type: 1 00000100:00100000:2.0:1746129575.385166:0:7086:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734254720 00000100:00100000:2.0:1746129575.385168:0:7086:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734254720 00010000:00010000:2.0:1746129575.385175:0:7086:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f385000/0x40a459093b06aaa7 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21843 expref: 8 pid: 22481 timeout: 930 lvb_type: 1 00000100:00100000:2.0:1746129575.385182:0:7086:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734254976 00000100:00100000:2.0:1746129575.385183:0:7086:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734254976 00010000:00010000:2.0:1746129575.385189:0:7086:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6de9400/0x40a459093b06a85b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f216e5 expref: 26 pid: 20577 timeout: 930 lvb_type: 1 00000100:00100000:2.0:1746129575.385201:0:7086:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734255360 00000100:00100000:2.0:1746129575.385203:0:7086:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734255360 00010000:00010000:2.0:1746129575.385210:0:7086:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091b63c00/0x40a459093b06a9ff lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f217ef expref: 13 pid: 7149 timeout: 930 lvb_type: 0 00000100:00100000:2.0:1746129575.385217:0:7086:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734255488 00000100:00100000:2.0:1746129575.385219:0:7086:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734255488 00010000:00010000:2.0:1746129575.385225:0:7086:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a77f6e00/0x40a459093b06aa61 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21819 expref: 17 pid: 7149 timeout: 930 lvb_type: 1 00000100:00100000:2.0:1746129575.385232:0:7086:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734255616 00000100:00100000:2.0:1746129575.385233:0:7086:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734255616 00010000:00010000:2.0:1746129575.385240:0:7086:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6de9800/0x40a459093b06a80e lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f216bb expref: 16 pid: 8411 timeout: 930 lvb_type: 1 00000100:00100000:2.0:1746129575.385249:0:7086:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8478 00000100:00100000:2.0:1746129575.385253:0:7086:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa24000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ada2ffba-8920-4ecb-8068-68caa9806978+26:1961:x1830948734255232:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129575.385260:0:7086:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129575.385269:0:7086:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a77f6a00/0x40a459093b06aa5a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21812 expref: 26 pid: 7149 timeout: 930 lvb_type: 1 00010000:00010000:2.0:1746129575.385288:0:7086:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a77f6a00/0x40a459093b06aa5a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21812 expref: 26 pid: 7149 timeout: 930 lvb_type: 1 00010000:00010000:2.0:1746129575.385313:0:7086:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a77f6a00/0x40a459093b06aa5a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21812 expref: 26 pid: 7149 timeout: 930 lvb_type: 1 00010000:00010000:2.0:1746129575.385329:0:7086:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129575.385352:0:7086:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa24000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ada2ffba-8920-4ecb-8068-68caa9806978+25:1961:x1830948734255232:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 98us (1598us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129575.385357:0:7086:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8478 00000100:00100000:2.0:1746129575.385369:0:7086:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8479 00000100:00100000:2.0:1746129575.385374:0:7086:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa27800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+16:1962:x1830948734254848:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129575.385382:0:7086:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129575.385389:0:7086:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008fbb7000/0x40a459093b06a9e3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f217e1 expref: 16 pid: 7149 timeout: 930 lvb_type: 0 00010000:00010000:2.0:1746129575.385397:0:7086:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008fbb7000/0x40a459093b06a9e3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f217e1 expref: 16 pid: 7149 timeout: 930 lvb_type: 0 00010000:00010000:2.0:1746129575.385408:0:7086:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008fbb7000/0x40a459093b06a9e3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f217e1 expref: 16 pid: 7149 timeout: 930 lvb_type: 0 00010000:00010000:2.0:1746129575.385416:0:7086:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129575.385418:0:7086:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129575.385421:0:7086:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094cde200/0x40a459093b06aaf4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129575.385426:0:7086:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094cde200/0x40a459093b06aaf4 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129575.385440:0:7086:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129575.385456:0:7086:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa27800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+15:1962:x1830948734254848:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 83us (580us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129575.385462:0:7086:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8479 00000100:00100000:2.0:1746129575.385472:0:7086:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8480 00000100:00100000:2.0:1746129575.385476:0:7086:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa26a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:068dab75-d300-4ead-a742-d14572ad1e50+8:1962:x1830948734255104:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129575.385482:0:7086:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129575.385491:0:7086:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095ff0000/0x40a459093b06a8d2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21739 expref: 8 pid: 31503 timeout: 930 lvb_type: 1 00010000:00010000:2.0:1746129575.385498:0:7086:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095ff0000/0x40a459093b06a8d2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21739 expref: 8 pid: 31503 timeout: 930 lvb_type: 1 00010000:00010000:2.0:1746129575.385508:0:7086:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095ff0000/0x40a459093b06a8d2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21739 expref: 8 pid: 31503 timeout: 930 lvb_type: 1 00010000:00010000:2.0:1746129575.385515:0:7086:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129575.385528:0:7086:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa26a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:068dab75-d300-4ead-a742-d14572ad1e50+7:1962:x1830948734255104:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 52us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129575.385533:0:7086:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8480 00000100:00100000:2.0:1746129575.385540:0:7086:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8481 00000100:00100000:2.0:1746129575.385545:0:7086:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa25880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:068dab75-d300-4ead-a742-d14572ad1e50+8:1962:x1830948734254720:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129575.385552:0:7086:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129575.385561:0:7086:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f385000/0x40a459093b06aaa7 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21843 expref: 8 pid: 22481 timeout: 930 lvb_type: 1 00010000:00010000:2.0:1746129575.385568:0:7086:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f385000/0x40a459093b06aaa7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21843 expref: 8 pid: 22481 timeout: 930 lvb_type: 1 00010000:00010000:2.0:1746129575.385579:0:7086:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129575.385590:0:7086:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa25880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:068dab75-d300-4ead-a742-d14572ad1e50+8:1962:x1830948734254720:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 46us (685us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129575.385594:0:7086:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8481 00000100:00100000:2.0:1746129575.385601:0:7086:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8482 00000100:00100000:2.0:1746129575.385605:0:7086:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6fd1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ada2ffba-8920-4ecb-8068-68caa9806978+24:1962:x1830948734254976:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129575.385611:0:7086:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129575.385616:0:7086:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a6de9400/0x40a459093b06a85b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f216e5 expref: 24 pid: 20577 timeout: 930 lvb_type: 1 00010000:00010000:2.0:1746129575.385622:0:7086:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a6de9400/0x40a459093b06a85b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f216e5 expref: 24 pid: 20577 timeout: 930 lvb_type: 1 00010000:00010000:2.0:1746129575.385630:0:7086:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a6de9400/0x40a459093b06a85b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f216e5 expref: 24 pid: 20577 timeout: 930 lvb_type: 1 00010000:00010000:2.0:1746129575.385637:0:7086:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129575.385648:0:7086:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6fd1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ada2ffba-8920-4ecb-8068-68caa9806978+23:1962:x1830948734254976:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 43us (722us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129575.385653:0:7086:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8482 00000100:00100000:2.0:1746129575.385684:0:7086:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8483 00000100:00100000:2.0:1746129575.385688:0:7086:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7dad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+13:1962:x1830948734255360:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129575.385693:0:7086:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129575.385699:0:7086:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091b63c00/0x40a459093b06a9ff lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f217ef expref: 13 pid: 7149 timeout: 930 lvb_type: 0 00010000:00010000:2.0:1746129575.385707:0:7086:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091b63c00/0x40a459093b06a9ff lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f217ef expref: 13 pid: 7149 timeout: 930 lvb_type: 0 00010000:00010000:2.0:1746129575.385716:0:7086:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129575.385727:0:7086:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7dad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+13:1962:x1830948734255360:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 39us (788us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129575.385731:0:7086:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8483 00000100:00100000:2.0:1746129575.385739:0:7086:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8484 00000100:00100000:2.0:1746129575.385743:0:7086:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ada2ffba-8920-4ecb-8068-68caa9806978+17:1961:x1830948734255488:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129575.385749:0:7086:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129575.385754:0:7086:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a77f6e00/0x40a459093b06aa61 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21819 expref: 17 pid: 7149 timeout: 930 lvb_type: 1 00010000:00010000:2.0:1746129575.385761:0:7086:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a77f6e00/0x40a459093b06aa61 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21819 expref: 17 pid: 7149 timeout: 930 lvb_type: 1 00010000:00010000:2.0:1746129575.385770:0:7086:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129575.385771:0:7086:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129575.385773:0:7086:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cfd7a00/0x40a459093b06ab02 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129575.385779:0:7086:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cfd7a00/0x40a459093b06ab02 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129575.385788:0:7086:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129575.385799:0:7086:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ada2ffba-8920-4ecb-8068-68caa9806978+17:1961:x1830948734255488:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 56us (851us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129575.385804:0:7086:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8484 00000100:00100000:2.0:1746129575.385811:0:7086:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8485 00000100:00100000:2.0:1746129575.385815:0:7086:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7da300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+14:1962:x1830948734255616:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129575.385821:0:7086:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129575.385826:0:7086:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a6de9800/0x40a459093b06a80e lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f216bb expref: 14 pid: 8411 timeout: 930 lvb_type: 1 00010000:00010000:2.0:1746129575.385833:0:7086:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a6de9800/0x40a459093b06a80e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f216bb expref: 14 pid: 8411 timeout: 930 lvb_type: 1 00010000:00010000:2.0:1746129575.385841:0:7086:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129575.385842:0:7086:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129575.385845:0:7086:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009cdfcc00/0x40a459093b06ab10 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129575.385851:0:7086:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cdfcc00/0x40a459093b06ab10 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129575.385858:0:7086:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129575.385868:0:7086:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7da300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+14:1962:x1830948734255616:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 53us (881us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129575.385872:0:7086:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8485 00010000:00010000:2.0:1746129575.385888:0:8410:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880094cde200/0x40a459093b06aaf4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129575.385895:0:8410:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094cde200/0x40a459093b06aaf4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129575.385909:0:8410:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880094cde200/0x40a459093b06aaf4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129575.385915:0:8410:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880094cde200/0x40a459093b06aaf4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129575.385921:0:8410:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880094cde200/0x40a459093b06aaf4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129575.385925:0:8410:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094cde200 already unused, calling callback (ffffffffa086ed70) 00010000:00010000:2.0:1746129575.385927:0:8410:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880094cde200/0x40a459093b06aaf4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129575.385933:0:8410:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880094cde200/0x40a459093b06aaf4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129575.385939:0:8410:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880094cde200/0x40a459093b06aaf4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129575.385944:0:8410:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094cde200/0x40a459093b06aaf4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129575.385970:0:8410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013577ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:068dab75-d300-4ead-a742-d14572ad1e50+6:1963:x1830948734253184:12345-192.168.202.4@tcp:1:mirror_io.0 Request processed in 19828us (20022us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129575.385975:0:8410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16480 00010000:00010000:0.0:1746129575.386418:0:22480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a77f6e00/0x40a459093b06aa61 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21819 expref: 16 pid: 7149 timeout: 930 lvb_type: 1 00000100:00100000:0.0:1746129575.386430:0:22480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e38a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22480:1830948737565440:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129575.386441:0:22480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f385000/0x40a459093b06aaa7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21843 expref: 7 pid: 22481 timeout: 930 lvb_type: 1 00000100:00100000:0.0:1746129575.386453:0:22480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e38aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22480:1830948737565568:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129575.386463:0:22480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091b63c00/0x40a459093b06a9ff lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f217ef expref: 12 pid: 7149 timeout: 930 lvb_type: 0 00000100:00100000:0.0:1746129575.386470:0:22480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e389500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22480:1830948737565696:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129575.386490:0:22480:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009cfd7a00/0x40a459093b06ab02 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129575.386497:0:22480:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009cfd7a00/0x40a459093b06ab02 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129575.386502:0:22480:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cfd7a00/0x40a459093b06ab02 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129575.386515:0:22480:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009cfd7a00/0x40a459093b06ab02 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129575.386520:0:22480:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009cfd7a00/0x40a459093b06ab02 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129575.386525:0:22480:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009cfd7a00/0x40a459093b06ab02 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129575.386531:0:22480:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009cfd7a00 already unused, calling callback (ffffffffa086ed70) 00010000:00010000:0.0:1746129575.386532:0:22480:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009cfd7a00/0x40a459093b06ab02 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129575.386538:0:22480:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009cfd7a00/0x40a459093b06ab02 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129575.386546:0:22480:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009cfd7a00/0x40a459093b06ab02 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129575.386550:0:22480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cfd7a00/0x40a459093b06ab02 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129575.386578:0:22480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e38b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:068dab75-d300-4ead-a742-d14572ad1e50+6:1963:x1830948734253312:12345-192.168.202.4@tcp:1:mirror_io.0 Request processed in 19950us (20128us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129575.386583:0:22480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16481 00000100:00100000:0.0:1746129575.386745:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00010000:00010000:3.0:1746129575.387092:0:11014:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a6de9800/0x40a459093b06a80e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f216bb expref: 13 pid: 8411 timeout: 930 lvb_type: 1 00000100:00100000:3.0:1746129575.387103:0:11014:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11014:1830948737566336:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129575.387128:0:11014:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009cdfcc00/0x40a459093b06ab10 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129575.387135:0:11014:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009cdfcc00/0x40a459093b06ab10 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129575.387141:0:11014:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cdfcc00/0x40a459093b06ab10 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129575.387157:0:11014:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009cdfcc00/0x40a459093b06ab10 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129575.387162:0:11014:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009cdfcc00/0x40a459093b06ab10 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129575.387168:0:11014:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009cdfcc00/0x40a459093b06ab10 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129575.387173:0:11014:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009cdfcc00 already unused, calling callback (ffffffffa086ed70) 00010000:00010000:3.0:1746129575.387175:0:11014:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009cdfcc00/0x40a459093b06ab10 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129575.387181:0:11014:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009cdfcc00/0x40a459093b06ab10 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129575.387190:0:11014:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009cdfcc00/0x40a459093b06ab10 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129575.387327:0:7085:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135723480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7085:1830948737566464:192.168.202.4@tcp:105: 00000100:00100000:1.0:1746129575.387336:0:7085:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135721c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7085:1830948737566592:192.168.202.4@tcp:105: 00010000:00010000:1.0:1746129575.387349:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129575.387370:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135720700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+11:1960:x1830948734253696:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 6781us (6819us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129575.387379:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8473 00010000:00010000:3.0:1746129575.387627:0:11014:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cdfcc00/0x40a459093b06ab10 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129575.387670:0:11014:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135721f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:068dab75-d300-4ead-a742-d14572ad1e50+5:1963:x1830948734253568:12345-192.168.202.4@tcp:1:mirror_io.0 Request processed in 20792us (20866us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129575.387676:0:11014:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16483 00000100:00100000:0.0:1746129575.387981:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129575.388073:0:21725:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734255872 00000100:00100000:2.0:1746129575.388081:0:21725:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734255872 00002000:00100000:2.0:1746129575.388120:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ef:0x0] (2097152->3145727) req@ffff88012e389500 x1830948734255872/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:316/0 lens 488/0 e 0 to 0 dl 1746129586 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129575.388129:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e389500 with x1830948734255872 ext(2097152->3145727) 00010000:00010000:2.0:1746129575.388136:0:21725:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f384000/0x40a459093b06aac3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2185f expref: 16 pid: 22481 timeout: 930 lvb_type: 0 00010000:00010000:2.0:1746129575.388147:0:21725:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f384000/0x40a459093b06aac3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2185f expref: 16 pid: 22481 timeout: 930 lvb_type: 0 00002000:00010000:2.0:1746129575.388154:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012e389500 00000100:00100000:2.0:1746129575.388177:0:21725:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734256128 00000100:00100000:2.0:1746129575.388180:0:21725:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734256128 00002000:00100000:2.0:1746129575.388193:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->4194303) req@ffff88012e38aa00 x1830948734256128/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:316/0 lens 488/0 e 0 to 0 dl 1746129586 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129575.388199:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e38aa00 with x1830948734256128 ext(3145728->4194303) 00010000:00010000:2.0:1746129575.388203:0:21725:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f384200/0x40a459093b06aaae lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21851 expref: 11 pid: 22481 timeout: 930 lvb_type: 0 00010000:00010000:2.0:1746129575.388210:0:21725:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f384200/0x40a459093b06aaae lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21851 expref: 11 pid: 22481 timeout: 930 lvb_type: 0 00002000:00010000:2.0:1746129575.388215:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012e38aa00 00000100:00100000:3.0:1746129575.388237:0:31520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2464 00000100:00100000:3.0:1746129575.388242:0:31520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e389500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ada2ffba-8920-4ecb-8068-68caa9806978+16:1963:x1830948734255872:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:1.0:1746129575.388520:0:31518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2465 00000100:00100000:1.0:1746129575.388527:0:31518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e38aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+11:1962:x1830948734256128:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:1.0:1746129575.398816:0:31518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e38aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+11:1962:x1830948734256128:12345-192.168.202.4@tcp:3:cat.0 Request processed in 10276us (10821us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129575.398829:0:31518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2465 00002000:00100000:1.0:1746129575.398842:0:31518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->4194303) req@ffff88012e38aa00 x1830948734256128/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:316/0 lens 488/440 e 0 to 0 dl 1746129586 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129575.398852:0:31518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e38aa00 with x1830948734256128 ext(3145728->4194303) 00010000:00010000:1.0:1746129575.398862:0:31518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f384200/0x40a459093b06aaae lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21851 expref: 11 pid: 22481 timeout: 930 lvb_type: 0 00010000:00010000:1.0:1746129575.398875:0:31518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f384200/0x40a459093b06aaae lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21851 expref: 11 pid: 22481 timeout: 930 lvb_type: 0 00002000:00010000:1.0:1746129575.398882:0:31518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012e38aa00 00000100:00100000:3.0:1746129575.405474:0:31520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e389500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ada2ffba-8920-4ecb-8068-68caa9806978+16:1963:x1830948734255872:12345-192.168.202.4@tcp:3:cat.0 Request processed in 17217us (18715us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129575.405487:0:31520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2464 00002000:00100000:3.0:1746129575.405501:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3ef:0x0] (2097152->3145727) req@ffff88012e389500 x1830948734255872/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:316/0 lens 488/440 e 0 to 0 dl 1746129586 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129575.405511:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e389500 with x1830948734255872 ext(2097152->3145727) 00010000:00010000:3.0:1746129575.405521:0:31520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f384000/0x40a459093b06aac3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2185f expref: 16 pid: 22481 timeout: 930 lvb_type: 0 00010000:00010000:3.0:1746129575.405533:0:31520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f384000/0x40a459093b06aac3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2185f expref: 16 pid: 22481 timeout: 930 lvb_type: 0 00002000:00010000:3.0:1746129575.405541:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012e389500 00000100:00100000:0.0:1746129575.405630:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129575.406446:0:11014:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734256256 00000100:00100000:3.0:1746129575.406455:0:11014:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734256256 00000100:00100000:3.0:1746129575.406495:0:11014:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16484 00000100:00100000:3.0:1746129575.406502:0:11014:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e38a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+13:32436:x1830948734256256:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129575.406518:0:11014:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129575.406536:0:11014:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880132f99400/0x40a459093b06ab17 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21874 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746129575.406560:0:11014:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3f5:0x0] initial LVB size: 4194304, mtime: 0x6813d2a6, atime: 0x6813d2a6, ctime: 0x6813d2a6, blocks: 0x1029 00010000:00010000:3.0:1746129575.406580:0:11014:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129575.406582:0:11014:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129575.406591:0:11014:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880132f99400/0x40a459093b06ab17 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21874 expref: 14 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129575.406605:0:11014:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880132f99400/0x40a459093b06ab17 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21874 expref: 14 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129575.406615:0:11014:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132f99400, rc 0) 00000100:00100000:3.0:1746129575.406894:0:11014:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e38a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+14:32436:x1830948734256256:12345-192.168.202.4@tcp:101:cat.0 Request processed in 391us (1264us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129575.406900:0:11014:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16484 00000100:00100000:1.0:1746129575.408147:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129575.409127:0:15749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734256384 00000100:00100000:3.0:1746129575.409139:0:15749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734256384 00010000:00010000:3.0:1746129575.409177:0:15749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f384200/0x40a459093b06aaae lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21851 expref: 11 pid: 22481 timeout: 930 lvb_type: 0 00000100:00100000:3.0:1746129575.409205:0:15749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8486 00000100:00100000:3.0:1746129575.409212:0:15749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7db800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+11:1962:x1830948734256384:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129575.409226:0:15749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129575.409249:0:15749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f384200/0x40a459093b06aaae lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21851 expref: 11 pid: 22481 timeout: 930 lvb_type: 0 00010000:00010000:3.0:1746129575.409262:0:15749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f384200/0x40a459093b06aaae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21851 expref: 11 pid: 22481 timeout: 930 lvb_type: 0 00010000:00010000:3.0:1746129575.409321:0:15749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f384200/0x40a459093b06aaae lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21851 expref: 11 pid: 22481 timeout: 930 lvb_type: 0 00010000:00010000:3.0:1746129575.409595:0:15749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129575.410264:0:15749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7db800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+10:1962:x1830948734256384:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 1049us (2120us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129575.410282:0:15749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8486 00000100:00100000:0.0:1746129575.411548:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129575.411641:0:22480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734256512 00000100:00100000:2.0:1746129575.411650:0:22480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734256512 00000100:00100000:2.0:1746129575.411706:0:22480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16485 00000100:00100000:2.0:1746129575.411714:0:22480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e388a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ada2ffba-8920-4ecb-8068-68caa9806978+23:32445:x1830948734256512:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129575.412397:0:22480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129575.412419:0:22480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009487e800/0x40a459093b06ab1e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2187b expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129575.412447:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129575.412449:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129575.412457:0:22480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009487e800/0x40a459093b06ab1e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2187b expref: 24 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129575.412473:0:22480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009487e800/0x40a459093b06ab1e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2187b expref: 24 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129575.412484:0:22480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009487e800, rc 0) 00000100:00100000:2.0:1746129575.412541:0:22480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e388a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ada2ffba-8920-4ecb-8068-68caa9806978+24:32445:x1830948734256512:12345-192.168.202.4@tcp:101:cat.0 Request processed in 827us (1000us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129575.412548:0:22480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16485 00000100:00100000:1.0:1746129575.419257:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129575.420406:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129575.420433:0:15096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734257152 00000100:00100000:0.0:1746129575.420442:0:15096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734257152 00000100:00100000:0.0:1746129575.420501:0:15096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11288 00000100:00100000:0.0:1746129575.420509:0:15096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e388000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ada2ffba-8920-4ecb-8068-68caa9806978+308:32450:x1830948734257152:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:0.0:1746129575.420533:0:15096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129575.420553:0:15096:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f93e600/0x40a459093b06ab25 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21882 expref: -99 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129575.420672:0:15096:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f93e400/0x40a459093b06ab2c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15096 initiator: MDT0 00010000:00010000:0.0:1746129575.420687:0:15096:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f93e400/0x40a459093b06ab2c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15096 initiator: MDT0 00010000:00010000:0.0:1746129575.420697:0:15096:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f93e400/0x40a459093b06ab2c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15096 initiator: MDT0 00010000:00010000:0.0:1746129575.420709:0:15096:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f93e800/0x40a459093b06ab33 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15096 initiator: MDT0 00010000:00010000:0.0:1746129575.420714:0:15096:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f93e800/0x40a459093b06ab33 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15096 initiator: MDT0 00010000:00010000:0.0:1746129575.420718:0:15096:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f93e800/0x40a459093b06ab33 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15096 initiator: MDT0 00000100:00100000:3.0:1746129575.420731:0:31520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734256768 00000100:00100000:3.0:1746129575.420735:0:31520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734256768 00002000:00100000:3.0:1746129575.420765:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3f5:0x0] (3145728->4194303) req@ffff88009c7d8000 x1830948734256768/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:316/0 lens 488/0 e 0 to 0 dl 1746129586 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129575.420775:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7d8000 with x1830948734256768 ext(3145728->4194303) 00002000:00010000:3.0:1746129575.420779:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c7d8000 00000100:00100000:3.0:1746129575.420807:0:31520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7942 00000100:00100000:3.0:1746129575.420813:0:31520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+14:1961:x1830948734256768:12345-192.168.202.4@tcp:3:cat.0 00010000:00010000:0.0:1746129575.420828:0:15096:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f93f200/0x40a459093b06ab3a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 15096 initiator: MDT0 00010000:00010000:0.0:1746129575.420839:0:15096:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f384c00/0x40a459093b06aad8 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21866 expref: 17 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129575.420845:0:15096:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f93f200/0x40a459093b06ab3a lrc: 4/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 15096 initiator: MDT0 00010000:00010000:0.0:1746129575.420877:0:15096:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f384c00/0x40a459093b06aad8 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21866 expref: 17 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129575.420887:0:15096:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f384c00/0x40a459093b06aad8 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21866 expref: 17 pid: 16908 timeout: 930 lvb_type: 0 00000100:00100000:0.0:1746129575.420898:0:15096:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e388e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15096:1830948737566720:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129575.420970:0:15096:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4123d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746129575.421086:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129575.422632:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129575.422751:0:31518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734257408 00000100:00100000:2.0:1746129575.422758:0:31518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734257408 00002000:00100000:2.0:1746129575.422799:0:31518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3f5:0x0] (2097152->3145727) req@ffff88012e38bb80 x1830948734257408/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:316/0 lens 488/0 e 0 to 0 dl 1746129586 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129575.422808:0:31518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e38bb80 with x1830948734257408 ext(2097152->3145727) 00002000:00010000:2.0:1746129575.422813:0:31518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e38bb80 00000100:00100000:2.0:1746129575.422844:0:31518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7943 00000100:00100000:2.0:1746129575.422850:0:31518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e38bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ada2ffba-8920-4ecb-8068-68caa9806978+24:1960:x1830948734257408:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:3.0:1746129575.423034:0:15749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734256896 00000100:00100000:3.0:1746129575.423039:0:15749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734256896 00010000:00010000:3.0:1746129575.423059:0:15749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f384000/0x40a459093b06aac3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2185f expref: 16 pid: 22481 timeout: 930 lvb_type: 0 00000100:00100000:3.0:1746129575.423079:0:15749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8487 00000100:00100000:3.0:1746129575.423084:0:15749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7d8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ada2ffba-8920-4ecb-8068-68caa9806978+16:1963:x1830948734256896:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129575.423094:0:15749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129575.423114:0:15749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f384000/0x40a459093b06aac3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2185f expref: 16 pid: 22481 timeout: 930 lvb_type: 0 00010000:00010000:3.0:1746129575.423126:0:15749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f384000/0x40a459093b06aac3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2185f expref: 16 pid: 22481 timeout: 930 lvb_type: 0 00010000:00010000:3.0:1746129575.423147:0:15749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f384000/0x40a459093b06aac3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2185f expref: 16 pid: 22481 timeout: 930 lvb_type: 0 00010000:00010000:3.0:1746129575.423166:0:15749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129575.423168:0:15749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129575.423172:0:15749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009487ec00/0x40a459093b06ab09 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129575.423180:0:15749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009487ec00/0x40a459093b06ab09 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129575.423206:0:15749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129575.423231:0:15749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7d8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ada2ffba-8920-4ecb-8068-68caa9806978+15:1963:x1830948734256896:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 146us (2144us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129575.423237:0:15749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8487 00010000:00010000:2.0:1746129575.423845:0:8411:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009487ec00/0x40a459093b06ab09 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129575.423859:0:8411:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009487ec00/0x40a459093b06ab09 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129575.423881:0:8411:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009487ec00/0x40a459093b06ab09 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129575.423889:0:8411:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009487ec00/0x40a459093b06ab09 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129575.423895:0:8411:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009487ec00/0x40a459093b06ab09 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129575.423901:0:8411:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009487ec00 already unused, calling callback (ffffffffa086ed70) 00010000:00010000:2.0:1746129575.423905:0:8411:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009487ec00/0x40a459093b06ab09 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129575.423913:0:8411:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009487ec00/0x40a459093b06ab09 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129575.423924:0:8411:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009487ec00/0x40a459093b06ab09 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129575.423930:0:8411:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009487ec00/0x40a459093b06ab09 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129575.424157:0:8411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135722a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:068dab75-d300-4ead-a742-d14572ad1e50+5:1963:x1830948734253440:12345-192.168.202.4@tcp:1:mirror_io.0 Request processed in 57281us (57375us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129575.424165:0:8411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16482 00000100:00100000:0.0:1746129575.425976:0:15096:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e388e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15096:1830948737566720:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129575.426001:0:15096:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008f93f200/0x40a459093b06ab3a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 15096 initiator: MDT0 00000100:00100000:0.0:1746129575.426057:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129575.428085:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734257536 00000100:00100000:1.0:1746129575.428097:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734257536 00010000:00010000:1.0:1746129575.428132:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f384c00/0x40a459093b06aad8 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21866 expref: 18 pid: 16908 timeout: 930 lvb_type: 0 00000100:00100000:1.0:1746129575.428175:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8488 00000100:00100000:1.0:1746129575.428183:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e388e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:068dab75-d300-4ead-a742-d14572ad1e50+18:1962:x1830948734257536:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129575.428196:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129575.428201:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f384c00/0x40a459093b06aad8 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21866 expref: 18 pid: 16908 timeout: 930 lvb_type: 0 00010000:00010000:1.0:1746129575.428212:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f384c00/0x40a459093b06aad8 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21866 expref: 18 pid: 16908 timeout: 930 lvb_type: 0 00010000:00010000:1.0:1746129575.428233:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f384c00/0x40a459093b06aad8 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21866 expref: 18 pid: 16908 timeout: 930 lvb_type: 0 00010000:00010000:1.0:1746129575.428249:0:7085:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:1.0:1746129575.428254:0:7085:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f93f200/0x40a459093b06ab3a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 15096 initiator: MDT0 00010000:00010000:1.0:1746129575.428263:0:7085:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f93f200/0x40a459093b06ab3a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 15096 initiator: MDT0 00010000:00010000:1.0:1746129575.428269:0:7085:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f93f200/0x40a459093b06ab3a lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 15096 initiator: MDT0 00010000:00010000:1.0:1746129575.428315:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129575.428369:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e388e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:068dab75-d300-4ead-a742-d14572ad1e50+17:1962:x1830948734257536:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 186us (2312us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129575.428375:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8488 00010000:00010000:0.0:1746129575.428545:0:15096:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008f93f200/0x40a459093b06ab3a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15096 initiator: MDT0 00010000:00010000:0.0:1746129575.428553:0:15096:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f93f200/0x40a459093b06ab3a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15096 initiator: MDT0 00000004:00200000:0.0:1746129575.428570:0:15096:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:0.0:1746129575.428677:0:15096:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f93f200/0x40a459093b06ab3a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 15096 initiator: MDT0 00010000:00010000:0.0:1746129575.428684:0:15096:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f93f200/0x40a459093b06ab3a lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 15096 initiator: MDT0 00010000:00010000:0.0:1746129575.428689:0:15096:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f93f200/0x40a459093b06ab3a lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 15096 initiator: MDT0 00010000:00010000:0.0:1746129575.428695:0:15096:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f93f200 already unused, calling callback (ffffffffa136e690) 00010000:00010000:0.0:1746129575.428698:0:15096:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f93f200/0x40a459093b06ab3a lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 15096 initiator: MDT0 00010000:00010000:0.0:1746129575.428704:0:15096:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f93f200/0x40a459093b06ab3a lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 15096 initiator: MDT0 00010000:00010000:0.0:1746129575.428711:0:15096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:0.0:1746129575.428714:0:15096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746129575.428717:0:15096:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f93f200/0x40a459093b06ab3a lrc: 2/0,0 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 15096 initiator: MDT0 00010000:00010000:0.0:1746129575.428725:0:15096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f93f200/0x40a459093b06ab3a lrc: 0/0,0 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 15096 initiator: MDT0 00010000:00010000:0.0:1746129575.428744:0:15096:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f93e400/0x40a459093b06ab2c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15096 initiator: MDT0 00010000:00010000:0.0:1746129575.428748:0:15096:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f93e400/0x40a459093b06ab2c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15096 initiator: MDT0 00010000:00010000:0.0:1746129575.428752:0:15096:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f93e400/0x40a459093b06ab2c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15096 initiator: MDT0 00010000:00010000:0.0:1746129575.428755:0:15096:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f93e400 already unused, calling callback (ffffffffa136e690) 00010000:00010000:0.0:1746129575.428757:0:15096:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f93e400/0x40a459093b06ab2c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15096 initiator: MDT0 00010000:00010000:0.0:1746129575.428761:0:15096:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f93e400/0x40a459093b06ab2c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15096 initiator: MDT0 00010000:00010000:0.0:1746129575.428767:0:15096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880132ef8f00) 00010000:00010000:0.0:1746129575.428769:0:15096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129575.428771:0:15096:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f93e400/0x40a459093b06ab2c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15096 initiator: MDT0 00010000:00010000:0.0:1746129575.428775:0:15096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f93e400/0x40a459093b06ab2c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15096 initiator: MDT0 00010000:00010000:0.0:1746129575.428782:0:15096:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f93e800/0x40a459093b06ab33 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15096 initiator: MDT0 00010000:00010000:0.0:1746129575.428786:0:15096:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f93e800/0x40a459093b06ab33 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15096 initiator: MDT0 00010000:00010000:0.0:1746129575.428790:0:15096:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f93e800/0x40a459093b06ab33 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15096 initiator: MDT0 00010000:00010000:0.0:1746129575.428795:0:15096:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f93e800 already unused, calling callback (ffffffffa136e690) 00010000:00010000:0.0:1746129575.428797:0:15096:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f93e800/0x40a459093b06ab33 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15096 initiator: MDT0 00010000:00010000:0.0:1746129575.428802:0:15096:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f93e800/0x40a459093b06ab33 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15096 initiator: MDT0 00010000:00010000:0.0:1746129575.428807:0:15096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f469100) 00010000:00010000:0.0:1746129575.428809:0:15096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129575.428812:0:15096:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f93e800/0x40a459093b06ab33 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15096 initiator: MDT0 00010000:00010000:0.0:1746129575.428817:0:15096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f93e800/0x40a459093b06ab33 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15096 initiator: MDT0 00010000:00010000:0.0:1746129575.428862:0:15096:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f93e600/0x40a459093b06ab25 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21882 expref: 310 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129575.428870:0:15096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f93e600/0x40a459093b06ab25 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21882 expref: 310 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129575.428877:0:15096:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f93e600, rc 0) 00000100:00100000:0.0:1746129575.428898:0:15096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e388000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ada2ffba-8920-4ecb-8068-68caa9806978+309:32450:x1830948734257152:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 8390us (8495us total) trans 8589945394 rc 301/301 00000100:00100000:0.0:1746129575.428904:0:15096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11288 00000100:00100000:1.0:1746129575.430591:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129575.430656:0:15096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734257792 00000100:00100000:0.0:1746129575.430663:0:15096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734257792 00000100:00100000:0.0:1746129575.430695:0:15096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11289 00000100:00100000:0.0:1746129575.430701:0:15096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:068dab75-d300-4ead-a742-d14572ad1e50+17:32446:x1830948734257792:12345-192.168.202.4@tcp:36:mirror_io.0 00010000:00010000:0.0:1746129575.430743:0:15096:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129575.430763:0:15096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f384400/0x40a459093b06aae6 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2186d expref: 17 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129575.430776:0:15096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:0.0:1746129575.430779:0:15096:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129575.430823:0:15096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:068dab75-d300-4ead-a742-d14572ad1e50+16:32446:x1830948734257792:12345-192.168.202.4@tcp:36:mirror_io.0 Request processed in 121us (239us total) trans 0 rc -116/-116 00000100:00100000:0.0:1746129575.430828:0:15096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11289 00000100:00100000:2.0:1746129575.435349:0:31520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+14:1961:x1830948734256768:12345-192.168.202.4@tcp:3:cat.0 Request processed in 14521us (16091us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129575.435365:0:31520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7942 00002000:00100000:2.0:1746129575.435380:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3f5:0x0] (3145728->4194303) req@ffff88009c7d8000 x1830948734256768/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:316/0 lens 488/440 e 0 to 0 dl 1746129586 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129575.435391:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7d8000 with x1830948734256768 ext(3145728->4194303) 00002000:00010000:2.0:1746129575.435397:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c7d8000 00000100:00100000:0.0:1746129575.435848:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129575.436643:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734258048 00000100:00100000:2.0:1746129575.436653:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734258048 00000100:00100000:2.0:1746129575.436705:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4801 00000100:00100000:2.0:1746129575.436711:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f532050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:068dab75-d300-4ead-a742-d14572ad1e50+16:32446:x1830948734258048:12345-192.168.202.4@tcp:35:mirror_io.0 00000100:00100000:2.0:1746129575.436927:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f532050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:068dab75-d300-4ead-a742-d14572ad1e50+17:32446:x1830948734258048:12345-192.168.202.4@tcp:35:mirror_io.0 Request processed in 215us (1079us total) trans 8589945395 rc 0/0 00000100:00100000:2.0:1746129575.436934:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4801 00000100:00100000:0.0:1746129575.443681:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129575.443760:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129575.443779:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129575.443859:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129575.444086:0:8411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734258176 00000100:00100000:2.0:1746129575.444096:0:8411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734258176 00000100:00100000:2.0:1746129575.444140:0:8411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734258560 00000100:00100000:2.0:1746129575.444142:0:8411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734258560 00000100:00100000:2.0:1746129575.444166:0:8411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734258688 00000100:00100000:2.0:1746129575.444169:0:8411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734258688 00000100:00100000:2.0:1746129575.444182:0:8411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16486 00000100:00100000:2.0:1746129575.444190:0:8411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e389c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+10:1960:x1830948734258176:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129575.444212:0:8411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129575.444235:0:8411:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009487e600/0x40a459093b06ab48 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21889 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746129575.444264:0:8411:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3ec:0x0] initial LVB size: 1048576, mtime: 0x6813d2a7, atime: 0x6813d2a3, ctime: 0x6813d2a7, blocks: 0x819 00010000:00010000:2.0:1746129575.444314:0:8411:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129575.444317:0:8411:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129575.444327:0:8411:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009487e600/0x40a459093b06ab48 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21889 expref: 11 pid: 8411 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129575.444342:0:8411:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009487e600/0x40a459093b06ab48 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21889 expref: 11 pid: 8411 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129575.444354:0:8411:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009487e600, rc 0) 00000100:00100000:2.0:1746129575.444407:0:8411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e389c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+11:1960:x1830948734258176:12345-192.168.202.4@tcp:101:cat.0 Request processed in 217us (738us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129575.444413:0:8411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16486 00000100:00100000:2.0:1746129575.444428:0:8411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16487 00000100:00100000:2.0:1746129575.444433:0:8411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e38b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+15:1961:x1830948734258560:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129575.444440:0:8411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129575.444451:0:8411:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009487ec00/0x40a459093b06ab4f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21890 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746129575.444465:0:8411:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3f3:0x0] initial LVB size: 2097152, mtime: 0x6813d2a7, atime: 0x6813d2a3, ctime: 0x6813d2a7, blocks: 0x821 00010000:00010000:2.0:1746129575.444473:0:8411:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129575.444474:0:8411:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129575.444478:0:8411:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009487ec00/0x40a459093b06ab4f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21890 expref: 16 pid: 8411 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129575.444487:0:8411:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009487ec00/0x40a459093b06ab4f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21890 expref: 16 pid: 8411 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129575.444494:0:8411:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009487ec00, rc 0) 00000100:00100000:2.0:1746129575.444509:0:8411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e38b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+16:1961:x1830948734258560:12345-192.168.202.4@tcp:101:cat.0 Request processed in 76us (729us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129575.444514:0:8411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16487 00000100:00100000:2.0:1746129575.444523:0:8411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16488 00000100:00100000:2.0:1746129575.444528:0:8411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e388380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+15:1961:x1830948734258688:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129575.444533:0:8411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129575.444541:0:8411:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009487e200/0x40a459093b06ab56 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21897 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746129575.444550:0:8411:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3f4:0x0] initial LVB size: 2097152, mtime: 0x6813d2a7, atime: 0x6813d2a7, ctime: 0x6813d2a7, blocks: 0x81f 00010000:00010000:2.0:1746129575.444558:0:8411:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129575.444559:0:8411:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129575.444563:0:8411:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009487e200/0x40a459093b06ab56 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21897 expref: 16 pid: 8411 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129575.444571:0:8411:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009487e200/0x40a459093b06ab56 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21897 expref: 16 pid: 8411 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129575.444577:0:8411:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009487e200, rc 0) 00000100:00100000:2.0:1746129575.444593:0:8411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e388380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+16:1961:x1830948734258688:12345-192.168.202.4@tcp:101:cat.0 Request processed in 65us (734us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129575.444598:0:8411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16488 00000100:00100000:3.0:1746129575.444674:0:20861:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734258432 00000100:00100000:3.0:1746129575.444678:0:20861:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734258432 00000100:00100000:3.0:1746129575.444702:0:20861:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4802 00000100:00100000:3.0:1746129575.444707:0:20861:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e389180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:068dab75-d300-4ead-a742-d14572ad1e50+17:32446:x1830948734258432:12345-192.168.202.4@tcp:35:mirror_io.0 00000100:00100000:3.0:1746129575.444885:0:20861:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e389180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:068dab75-d300-4ead-a742-d14572ad1e50+18:32446:x1830948734258432:12345-192.168.202.4@tcp:35:mirror_io.0 Request processed in 177us (1124us total) trans 8589945396 rc 0/0 00000100:00100000:3.0:1746129575.444891:0:20861:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4802 00000100:00100000:3.0:1746129575.445481:0:31518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e38bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ada2ffba-8920-4ecb-8068-68caa9806978+24:1960:x1830948734257408:12345-192.168.202.4@tcp:3:cat.0 Request processed in 22630us (22853us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129575.445488:0:31518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7943 00002000:00100000:3.0:1746129575.445497:0:31518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3f5:0x0] (2097152->3145727) req@ffff88012e38bb80 x1830948734257408/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:316/0 lens 488/440 e 0 to 0 dl 1746129586 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129575.445504:0:31518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e38bb80 with x1830948734257408 ext(2097152->3145727) 00002000:00010000:3.0:1746129575.445509:0:31518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e38bb80 00000100:00100000:1.0:1746129575.447613:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129575.447653:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129575.447779:0:11014:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734258816 00000100:00100000:3.0:1746129575.447788:0:11014:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734258816 00000100:00100000:3.0:1746129575.448285:0:11014:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734258944 00000100:00100000:3.0:1746129575.448288:0:11014:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734258944 00000100:00100000:0.0:1746129575.448444:0:22481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16489 00000100:00100000:0.0:1746129575.448455:0:22481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+12:1960:x1830948734258816:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129575.448474:0:22481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129575.448497:0:22481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a6caee00/0x40a459093b06ab5d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2189e expref: -99 pid: 22481 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746129575.448525:0:22481:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3ee:0x0] initial LVB size: 2097152, mtime: 0x6813d2a7, atime: 0x6813d2a7, ctime: 0x6813d2a7, blocks: 0x81f 00010000:00010000:0.0:1746129575.448547:0:22481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129575.448549:0:22481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129575.448559:0:22481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6caee00/0x40a459093b06ab5d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2189e expref: 13 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129575.448574:0:22481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a6caee00/0x40a459093b06ab5d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2189e expref: 13 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129575.448587:0:22481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6caee00, rc 0) 00000100:00100000:0.0:1746129575.448642:0:22481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+13:1960:x1830948734258816:12345-192.168.202.4@tcp:101:cat.0 Request processed in 189us (1035us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129575.448648:0:22481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16489 00000100:00100000:0.0:1746129575.448667:0:22481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16490 00000100:00100000:0.0:1746129575.448671:0:22481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+12:1960:x1830948734258944:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129575.448678:0:22481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129575.448686:0:22481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a6caec00/0x40a459093b06ab64 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f218a5 expref: -99 pid: 22481 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746129575.448698:0:22481:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3ef:0x0] initial LVB size: 5146336, mtime: 0x6813d2a8, atime: 0x6813d2a8, ctime: 0x6813d2a8, blocks: 0x1791 00010000:00010000:0.0:1746129575.448707:0:22481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129575.448708:0:22481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129575.448712:0:22481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6caec00/0x40a459093b06ab64 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f218a5 expref: 13 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129575.448721:0:22481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a6caec00/0x40a459093b06ab64 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f218a5 expref: 13 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129575.448728:0:22481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6caec00, rc 0) 00000100:00100000:0.0:1746129575.448743:0:22481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+13:1960:x1830948734258944:12345-192.168.202.4@tcp:101:cat.0 Request processed in 72us (1090us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129575.448749:0:22481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16490 00000100:00100000:0.0:1746129575.451552:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129575.451734:0:22481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734259072 00000100:00100000:1.0:1746129575.451743:0:22481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734259072 00000100:00100000:1.0:1746129575.451789:0:22481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16491 00000100:00100000:1.0:1746129575.451797:0:22481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ada2ffba-8920-4ecb-8068-68caa9806978+15:32445:x1830948734259072:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129575.451818:0:22481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129575.451837:0:22481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f384600/0x40a459093b06ab6b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f218ac expref: -99 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129575.451863:0:22481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129575.451865:0:22481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129575.451872:0:22481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f384600/0x40a459093b06ab6b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f218ac expref: 16 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129575.451886:0:22481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f384600/0x40a459093b06ab6b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f218ac expref: 16 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129575.451896:0:22481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f384600, rc 0) 00000100:00100000:1.0:1746129575.452088:0:22481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ada2ffba-8920-4ecb-8068-68caa9806978+16:32445:x1830948734259072:12345-192.168.202.4@tcp:101:cat.0 Request processed in 291us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129575.452095:0:22481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16491 00000100:00100000:0.0:1746129575.466230:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129575.468470:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129575.468632:0:31520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734259328 00000100:00100000:2.0:1746129575.468644:0:31520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734259328 00002000:00100000:2.0:1746129575.468708:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->4194303) req@ffff880094f44000 x1830948734259328/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:316/0 lens 488/0 e 0 to 0 dl 1746129586 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129575.468718:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094f44000 with x1830948734259328 ext(3145728->4194303) 00002000:00010000:2.0:1746129575.468724:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094f44000 00000100:00100000:2.0:1746129575.468748:0:31520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734259584 00000100:00100000:2.0:1746129575.468752:0:31520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734259584 00002000:00100000:2.0:1746129575.468772:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3f5:0x0] (3145728->4194303) req@ffff880094f47100 x1830948734259584/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:316/0 lens 488/0 e 0 to 0 dl 1746129586 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129575.468780:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094f47100 with x1830948734259584 ext(3145728->4194303) 00002000:00010000:2.0:1746129575.468783:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094f47100 00000100:00100000:2.0:1746129575.468814:0:31523:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7944 00000100:00100000:2.0:1746129575.468825:0:31523:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ada2ffba-8920-4ecb-8068-68caa9806978+16:1960:x1830948734259328:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:2.0:1746129575.470432:0:31520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7945 00000100:00100000:2.0:1746129575.470446:0:31520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ada2ffba-8920-4ecb-8068-68caa9806978+24:1960:x1830948734259584:12345-192.168.202.4@tcp:3:cat.0 00010000:00010000:2.0:1746129575.489427:0:9822:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1746129575.491469:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129575.491982:0:31523:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ada2ffba-8920-4ecb-8068-68caa9806978+16:1960:x1830948734259328:12345-192.168.202.4@tcp:3:cat.0 Request processed in 23157us (25764us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129575.491995:0:31523:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7944 00002000:00100000:2.0:1746129575.492008:0:31523:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->4194303) req@ffff880094f44000 x1830948734259328/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:316/0 lens 488/440 e 0 to 0 dl 1746129586 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129575.492017:0:31523:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094f44000 with x1830948734259328 ext(3145728->4194303) 00002000:00010000:2.0:1746129575.492023:0:31523:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094f44000 00000100:00100000:2.0:1746129575.492047:0:31523:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734259840 00000100:00100000:2.0:1746129575.492054:0:31523:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734259840 00002000:00100000:2.0:1746129575.492085:0:31523:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3ef:0x0] (4194304->5148671) req@ffff8800947bdf80 x1830948734259840/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:316/0 lens 488/0 e 0 to 0 dl 1746129586 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129575.492091:0:31523:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800947bdf80 with x1830948734259840 ext(4194304->5148671) 00002000:00010000:2.0:1746129575.492095:0:31523:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800947bdf80 00000100:00100000:2.0:1746129575.492109:0:31523:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7946 00000100:00100000:2.0:1746129575.492115:0:31523:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+13:1960:x1830948734259840:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:1.0:1746129575.513419:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129575.513453:0:16908:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734260096 00000100:00100000:0.0:1746129575.513463:0:16908:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734260096 00000100:00100000:0.0:1746129575.513508:0:16908:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11290 00000100:00100000:0.0:1746129575.513515:0:16908:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+17:32453:x1830948734260096:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:0.0:1746129575.513537:0:16908:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129575.513555:0:16908:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6cae400/0x40a459093b06ab72 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f218b3 expref: -99 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129575.513653:0:16908:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6cafe00/0x40a459093b06ab79 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129575.513665:0:16908:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6cafe00/0x40a459093b06ab79 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129575.513675:0:16908:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6cafe00/0x40a459093b06ab79 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129575.513687:0:16908:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6cae600/0x40a459093b06ab80 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129575.513692:0:16908:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6cae600/0x40a459093b06ab80 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129575.513696:0:16908:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6cae600/0x40a459093b06ab80 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129575.513797:0:16908:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6caf800/0x40a459093b06ab87 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129575.513803:0:16908:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6caf800/0x40a459093b06ab87 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129575.513808:0:16908:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6caf800/0x40a459093b06ab87 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00000004:00200000:0.0:1746129575.513816:0:16908:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:0.0:1746129575.513898:0:16908:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6cafe00/0x40a459093b06ab79 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129575.513904:0:16908:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6cafe00/0x40a459093b06ab79 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129575.513909:0:16908:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6cafe00/0x40a459093b06ab79 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129575.513913:0:16908:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a6cafe00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:0.0:1746129575.513917:0:16908:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6cafe00/0x40a459093b06ab79 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129575.513923:0:16908:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6cafe00/0x40a459093b06ab79 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129575.513932:0:16908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880132ef8f00) 00010000:00010000:0.0:1746129575.513934:0:16908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129575.513937:0:16908:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6cafe00/0x40a459093b06ab79 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129575.513940:0:16908:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6cafe00/0x40a459093b06ab79 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129575.513955:0:16908:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6cae600/0x40a459093b06ab80 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129575.513959:0:16908:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6cae600/0x40a459093b06ab80 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129575.513963:0:16908:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6cae600/0x40a459093b06ab80 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129575.513970:0:16908:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a6cae600 already unused, calling callback (ffffffffa136e690) 00010000:00010000:0.0:1746129575.513972:0:16908:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6cae600/0x40a459093b06ab80 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129575.513976:0:16908:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6cae600/0x40a459093b06ab80 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129575.513980:0:16908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f469d00) 00010000:00010000:0.0:1746129575.513981:0:16908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129575.513983:0:16908:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6cae600/0x40a459093b06ab80 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129575.513986:0:16908:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6cae600/0x40a459093b06ab80 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129575.514016:0:16908:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6cae400/0x40a459093b06ab72 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f218b3 expref: 20 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129575.514026:0:16908:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6caf800/0x40a459093b06ab87 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f218b3 expref: 19 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129575.514031:0:16908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:0.0:1746129575.514032:0:16908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746129575.514035:0:16908:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6caf800, rc 0) 00000100:00100000:3.0:1746129575.515008:0:31520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ada2ffba-8920-4ecb-8068-68caa9806978+24:1960:x1830948734259584:12345-192.168.202.4@tcp:3:cat.0 Request processed in 43626us (45609us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129575.515021:0:31520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7945 00002000:00100000:3.0:1746129575.515036:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3f5:0x0] (3145728->4194303) req@ffff880094f47100 x1830948734259584/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:316/0 lens 488/440 e 0 to 0 dl 1746129586 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129575.515045:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094f47100 with x1830948734259584 ext(3145728->4194303) 00002000:00010000:3.0:1746129575.515051:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094f47100 00000100:00100000:0.0:1746129575.515204:0:16908:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+19:32453:x1830948734260096:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 1685us (1792us total) trans 8589945397 rc 0/0 00000100:00100000:0.0:1746129575.515211:0:16908:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11290 00000100:00100000:2.0:1746129575.520354:0:31523:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+13:1960:x1830948734259840:12345-192.168.202.4@tcp:3:cat.0 Request processed in 28221us (28879us total) trans 0 rc 954368/954368 00000100:00100000:2.0:1746129575.520368:0:31523:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7946 00002000:00100000:2.0:1746129575.520384:0:31523:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3ef:0x0] (4194304->5148671) req@ffff8800947bdf80 x1830948734259840/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:316/0 lens 488/440 e 0 to 0 dl 1746129586 ref 1 fl Complete:/200/0 rc 954368/954368 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129575.520394:0:31523:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800947bdf80 with x1830948734259840 ext(4194304->5148671) 00002000:00010000:2.0:1746129575.520401:0:31523:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800947bdf80 00000100:00100000:0.0:1746129575.527431:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129575.527486:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129575.527661:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129575.528479:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129575.528515:0:22481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734260224 00000100:00100000:1.0:1746129575.528524:0:22481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734260224 00000100:00100000:1.0:1746129575.528571:0:22481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734260480 00000100:00100000:1.0:1746129575.528574:0:22481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734260480 00000100:00100000:1.0:1746129575.528587:0:22481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734260352 00000100:00100000:1.0:1746129575.528589:0:22481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734260352 00000100:00100000:1.0:1746129575.528601:0:22481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16492 00000100:00100000:1.0:1746129575.528608:0:22481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ada2ffba-8920-4ecb-8068-68caa9806978+16:1961:x1830948734260224:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129575.528628:0:22481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129575.528647:0:22481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f590600/0x40a459093b06ab95 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f218ba expref: -99 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129575.528673:0:22481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129575.528674:0:22481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129575.528682:0:22481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f590600/0x40a459093b06ab95 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f218ba expref: 17 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129575.528696:0:22481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f590600/0x40a459093b06ab95 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f218ba expref: 17 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129575.528708:0:22481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f590600, rc 0) 00000100:00100000:1.0:1746129575.528752:0:22481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ada2ffba-8920-4ecb-8068-68caa9806978+17:1961:x1830948734260224:12345-192.168.202.4@tcp:101:cat.0 Request processed in 144us (1336us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129575.528758:0:22481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16492 00000100:00100000:1.0:1746129575.528773:0:22481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16493 00000100:00100000:1.0:1746129575.528778:0:22481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ada2ffba-8920-4ecb-8068-68caa9806978+25:1961:x1830948734260480:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129575.528785:0:22481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129575.528795:0:22481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f590a00/0x40a459093b06ab9c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f218c8 expref: -99 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129575.528807:0:22481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129575.528808:0:22481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129575.528811:0:22481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f590a00/0x40a459093b06ab9c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f218c8 expref: 26 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129575.528820:0:22481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f590a00/0x40a459093b06ab9c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f218c8 expref: 26 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129575.528831:0:22481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f590a00, rc 0) 00000100:00100000:1.0:1746129575.528845:0:22481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ada2ffba-8920-4ecb-8068-68caa9806978+26:1961:x1830948734260480:12345-192.168.202.4@tcp:101:cat.0 Request processed in 67us (1360us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129575.528849:0:22481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16493 00000100:00100000:1.0:1746129575.528858:0:22481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16494 00000100:00100000:1.0:1746129575.528861:0:22481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f449f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ada2ffba-8920-4ecb-8068-68caa9806978+25:1961:x1830948734260352:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129575.528866:0:22481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129575.528871:0:22481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f591000/0x40a459093b06aba3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f218c1 expref: -99 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129575.528880:0:22481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129575.528881:0:22481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129575.528884:0:22481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f591000/0x40a459093b06aba3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f218c1 expref: 26 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129575.528892:0:22481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f591000/0x40a459093b06aba3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f218c1 expref: 26 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129575.528899:0:22481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f591000, rc 0) 00000100:00100000:1.0:1746129575.528910:0:22481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f449f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ada2ffba-8920-4ecb-8068-68caa9806978+26:1961:x1830948734260352:12345-192.168.202.4@tcp:101:cat.0 Request processed in 49us (1252us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129575.528915:0:22481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16494 00000100:00100000:3.0:1746129575.528983:0:11014:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734260608 00000100:00100000:3.0:1746129575.528987:0:11014:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734260608 00000100:00100000:3.0:1746129575.529006:0:11014:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16495 00000100:00100000:3.0:1746129575.529010:0:11014:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f449500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ada2ffba-8920-4ecb-8068-68caa9806978+17:1961:x1830948734260608:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129575.529015:0:11014:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129575.529022:0:11014:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cdfd000/0x40a459093b06abaa lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f218cf expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129575.529033:0:11014:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129575.529034:0:11014:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129575.529038:0:11014:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cdfd000/0x40a459093b06abaa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f218cf expref: 18 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129575.529046:0:11014:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009cdfd000/0x40a459093b06abaa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f218cf expref: 18 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129575.529052:0:11014:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cdfd000, rc 0) 00000100:00100000:3.0:1746129575.529066:0:11014:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f449500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ada2ffba-8920-4ecb-8068-68caa9806978+18:1961:x1830948734260608:12345-192.168.202.4@tcp:101:cat.0 Request processed in 56us (591us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129575.529071:0:11014:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16495 00000100:00100000:0.0:1746129575.533808:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129575.534772:0:4699:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734260736 00000100:00100000:2.0:1746129575.534784:0:4699:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734260736 00000100:00100000:2.0:1746129575.534863:0:4699:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16496 00000100:00100000:2.0:1746129575.534874:0:4699:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f44b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+16:32453:x1830948734260736:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:2.0:1746129575.534897:0:4699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129575.534917:0:4699:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009487fe00/0x40a459093b06abb1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f218d6 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129575.534953:0:4699:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880132f99400/0x40a459093b06ab17 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21874 expref: 17 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129575.534962:0:4699:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009487e800/0x40a459093b06ab1e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2187b expref: 25 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129575.534970:0:4699:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129575.534973:0:4699:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129575.534976:0:4699:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009487fe00/0x40a459093b06abb1 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [3612672->3788799] (req 3612672->3788799) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f218d6 expref: 17 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129575.535013:0:4699:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009487e800/0x40a459093b06ab1e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2187b expref: 25 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129575.535027:0:4699:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009487e800/0x40a459093b06ab1e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2187b expref: 25 pid: 22480 timeout: 930 lvb_type: 0 00000100:00100000:2.0:1746129575.535040:0:4699:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136015180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4699:1830948737566848:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129575.535175:0:4699:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880132f99400/0x40a459093b06ab17 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21874 expref: 17 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129575.535183:0:4699:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880132f99400/0x40a459093b06ab17 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21874 expref: 17 pid: 11014 timeout: 930 lvb_type: 0 00000100:00100000:2.0:1746129575.535190:0:4699:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136014e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4699:1830948737566976:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129575.535211:0:4699:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132f36840 going to sleep for 11 seconds 00000100:00100000:0.0:1746129575.542011:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129575.542131:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129575.542194:0:15749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734261120 00000100:00100000:0.0:1746129575.542203:0:15749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734261120 00010000:00010000:0.0:1746129575.542251:0:15749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880132f99400/0x40a459093b06ab17 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21874 expref: 18 pid: 11014 timeout: 930 lvb_type: 0 00000100:00100000:0.0:1746129575.542321:0:15749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8489 00000100:00100000:0.0:1746129575.542330:0:15749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6fd1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+18:1961:x1830948734261120:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129575.542346:0:15749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129575.542372:0:15749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880132f99400/0x40a459093b06ab17 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21874 expref: 18 pid: 11014 timeout: 930 lvb_type: 0 00010000:00010000:0.0:1746129575.542382:0:15749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880132f99400/0x40a459093b06ab17 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21874 expref: 18 pid: 11014 timeout: 930 lvb_type: 0 00010000:00010000:0.0:1746129575.542409:0:15749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129575.542459:0:15749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6fd1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+18:1961:x1830948734261120:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 130us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129575.542465:0:15749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8489 00000100:00100000:2.0:1746129575.542524:0:4699:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136015180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4699:1830948737566848:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129575.542536:0:4699:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880132f99400/0x40a459093b06ab17 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21874 expref: 17 pid: 11014 timeout: 930 lvb_type: 0 00000100:00100000:2.0:1746129575.542554:0:4699:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136014e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4699:1830948737566976:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129575.542582:0:4699:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009487fe00/0x40a459093b06abb1 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [3612672->3788799] (req 3612672->3788799) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f218d6 expref: 16 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129575.542592:0:4699:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009487fe00, rc 0) 00000100:00100000:2.0:1746129575.542615:0:4699:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f44b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+16:32453:x1830948734260736:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 7744us (8820us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129575.542621:0:4699:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16496 00000100:00100000:3.0:1746129575.542702:0:31523:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734260992 00000100:00100000:3.0:1746129575.542706:0:31523:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734260992 00002000:00100000:3.0:1746129575.542738:0:31523:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3ef:0x0] (4194304->5148671) req@ffff88008f448a80 x1830948734260992/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:316/0 lens 488/0 e 0 to 0 dl 1746129586 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129575.542747:0:31523:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f448a80 with x1830948734260992 ext(4194304->5148671) 00002000:00010000:3.0:1746129575.542751:0:31523:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f448a80 00000100:00100000:3.0:1746129575.542766:0:31523:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7947 00000100:00100000:3.0:1746129575.542771:0:31523:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f448a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ada2ffba-8920-4ecb-8068-68caa9806978+18:1961:x1830948734260992:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129575.550890:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129575.553680:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734261248 00000100:00100000:1.0:1746129575.553694:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734261248 00010000:00010000:1.0:1746129575.553743:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009487e800/0x40a459093b06ab1e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2187b expref: 26 pid: 22480 timeout: 930 lvb_type: 0 00000100:00100000:1.0:1746129575.553783:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8490 00000100:00100000:1.0:1746129575.553790:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f44b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ada2ffba-8920-4ecb-8068-68caa9806978+26:1962:x1830948734261248:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129575.553804:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129575.553827:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009487e800/0x40a459093b06ab1e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2187b expref: 26 pid: 22480 timeout: 930 lvb_type: 0 00010000:00010000:1.0:1746129575.553838:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009487e800/0x40a459093b06ab1e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2187b expref: 26 pid: 22480 timeout: 930 lvb_type: 0 00010000:00010000:1.0:1746129575.553933:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009487e800/0x40a459093b06ab1e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2187b expref: 26 pid: 22480 timeout: 930 lvb_type: 0 00010000:00010000:1.0:1746129575.553947:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129575.553949:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129575.553957:0:7085:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009487fe00/0x40a459093b06abb1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3612672->3788799) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f218d6 expref: 15 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129575.553964:0:7085:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009487fe00/0x40a459093b06abb1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3612672->3788799) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f218d6 expref: 15 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129575.553996:0:7085:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009487fe00/0x40a459093b06abb1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3612672->3788799) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f218d6 expref: 15 pid: 4699 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129575.554006:0:7085:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7db100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7085:1830948737567104:192.168.202.4@tcp:105: 00000100:00100000:1.0:1746129575.556576:0:7085:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0ac3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129575.559648:0:31523:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f448a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ada2ffba-8920-4ecb-8068-68caa9806978+18:1961:x1830948734260992:12345-192.168.202.4@tcp:3:cat.0 Request processed in 16863us (17636us total) trans 0 rc 954368/954368 00000100:00100000:0.0:1746129575.559661:0:31523:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7947 00002000:00100000:0.0:1746129575.559674:0:31523:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3ef:0x0] (4194304->5148671) req@ffff88008f448a80 x1830948734260992/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:316/0 lens 488/440 e 0 to 0 dl 1746129586 ref 1 fl Complete:/200/0 rc 954368/954368 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129575.559684:0:31523:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f448a80 with x1830948734260992 ext(4194304->5148671) 00002000:00010000:0.0:1746129575.559691:0:31523:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f448a80 00000100:00100000:1.0:1746129575.563724:0:7085:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7db100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7085:1830948737567104:192.168.202.4@tcp:105: 00010000:00010000:1.0:1746129575.563753:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129575.563827:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f44b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ada2ffba-8920-4ecb-8068-68caa9806978+25:1962:x1830948734261248:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 10034us (12950us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129575.563838:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8490 00000100:00100000:0.0:1746129575.564826:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129575.565596:0:31523:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734261504 00000100:00100000:2.0:1746129575.565606:0:31523:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734261504 00002000:00100000:2.0:1746129575.565654:0:31523:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f5:0x0] (3784704->3788799) req@ffff88008f44b480 x1830948734261504/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:316/0 lens 488/0 e 0 to 0 dl 1746129586 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129575.565664:0:31523:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f44b480 with x1830948734261504 ext(3784704->3788799) 00002000:00010000:2.0:1746129575.565670:0:31523:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f44b480 00000100:00100000:2.0:1746129575.565690:0:31523:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7948 00000100:00100000:2.0:1746129575.565698:0:31523:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f44b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+16:1963:x1830948734261504:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:2.0:1746129575.565899:0:31523:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f44b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+16:1963:x1830948734261504:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 201us (1076us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129575.565905:0:31523:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7948 00002000:00100000:2.0:1746129575.565910:0:31523:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f5:0x0] (3784704->3788799) req@ffff88008f44b480 x1830948734261504/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:316/0 lens 488/4536 e 0 to 0 dl 1746129586 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129575.565917:0:31523:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f44b480 with x1830948734261504 ext(3784704->3788799) 00002000:00010000:2.0:1746129575.565919:0:31523:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f44b480 00000100:00100000:2.0:1746129575.565970:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129575.566071:0:4699:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734261632 00000100:00100000:2.0:1746129575.566075:0:4699:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734261632 00000100:00100000:2.0:1746129575.566109:0:4699:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16497 00000100:00100000:2.0:1746129575.566115:0:4699:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136014e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ada2ffba-8920-4ecb-8068-68caa9806978+25:1961:x1830948734261632:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129575.566125:0:4699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129575.566140:0:4699:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cfd6a00/0x40a459093b06abb8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f218dd expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129575.566189:0:4699:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136015180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4699:1830948737567232:192.168.202.4@tcp:106: 00000100:00100000:2.0:1746129575.566641:0:4699:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132f36840 going to sleep for 11 seconds 00000100:00100000:0.0:1746129575.568423:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129575.568518:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734261888 00000100:00100000:2.0:1746129575.568525:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734261888 00000100:00100000:2.0:1746129575.569111:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4803 00000100:00100000:2.0:1746129575.569124:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f449180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+19:32453:x1830948734261888:12345-192.168.202.4@tcp:35:multiop.0 00000100:00100000:2.0:1746129575.570530:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f449180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:32453:x1830948734261888:12345-192.168.202.4@tcp:35:multiop.0 Request processed in 1402us (2105us total) trans 8589945398 rc 0/0 00000100:00100000:2.0:1746129575.570540:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4803 00002000:00010000:2.0:1746129575.571463:0:4699:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3f5:0x0] updating lvb mtime: 1746129574 -> 1746129576 00002000:00010000:2.0:1746129575.571467:0:4699:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3f5:0x0] updating lvb atime: 1746129574 -> 1746129576 00002000:00010000:2.0:1746129575.571468:0:4699:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3f5:0x0] updating lvb ctime: 1746129574 -> 1746129576 00000100:00100000:2.0:1746129575.571489:0:4699:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136015180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4699:1830948737567232:192.168.202.4@tcp:106: 00010000:00010000:2.0:1746129575.571521:0:4699:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009cfd6a00/0x40a459093b06abb8 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f218dd expref: 26 pid: 4699 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129575.571536:0:4699:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cfd6a00/0x40a459093b06abb8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f218dd expref: 26 pid: 4699 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129575.571550:0:4699:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cfd6a00, rc 0) 00000100:00100000:2.0:1746129575.572231:0:4699:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136014e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ada2ffba-8920-4ecb-8068-68caa9806978+25:1961:x1830948734261632:12345-192.168.202.4@tcp:101:cat.0 Request processed in 6112us (6256us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129575.572239:0:4699:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16497 00000100:00100000:0.0:1746129575.576180:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129575.576257:0:4699:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734262016 00000100:00100000:2.0:1746129575.576267:0:4699:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734262016 00000100:00100000:2.0:1746129575.576350:0:4699:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16498 00000100:00100000:2.0:1746129575.576358:0:4699:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f448380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ada2ffba-8920-4ecb-8068-68caa9806978+25:1961:x1830948734262016:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129575.576379:0:4699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129575.576399:0:4699:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cfd7e00/0x40a459093b06abbf lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f218e4 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129575.576461:0:4699:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136015180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4699:1830948737567360:192.168.202.4@tcp:106: 00000100:00100000:2.0:1746129575.580085:0:4699:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132f36840 going to sleep for 11 seconds 00000100:00100000:3.0:1746129575.585007:0:4699:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136015180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4699:1830948737567360:192.168.202.4@tcp:106: 00010000:00010000:3.0:1746129575.585046:0:4699:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009cfd7e00/0x40a459093b06abbf lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f218e4 expref: 26 pid: 4699 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129575.585067:0:4699:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cfd7e00/0x40a459093b06abbf lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f218e4 expref: 26 pid: 4699 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129575.585091:0:4699:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cfd7e00, rc 0) 00000100:00100000:3.0:1746129575.585618:0:4699:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f448380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ada2ffba-8920-4ecb-8068-68caa9806978+25:1961:x1830948734262016:12345-192.168.202.4@tcp:101:cat.0 Request processed in 9258us (9447us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129575.585627:0:4699:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16498 00000100:00100000:0.0:1746129575.642831:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129575.642943:0:4699:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734262144 00000100:00100000:3.0:1746129575.642953:0:4699:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734262144 00000100:00100000:3.0:1746129575.643013:0:4699:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16499 00000100:00100000:3.0:1746129575.643022:0:4699:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f448700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ada2ffba-8920-4ecb-8068-68caa9806978+18:32450:x1830948734262144:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:3.0:1746129575.643042:0:4699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129575.643061:0:4699:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cdfd400/0x40a459093b06abc6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f218eb expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129575.643095:0:4699:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009487e600/0x40a459093b06ab48 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21889 expref: 12 pid: 8411 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129575.643104:0:4699:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f590600/0x40a459093b06ab95 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f218ba expref: 19 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129575.643110:0:4699:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129575.643112:0:4699:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129575.643115:0:4699:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cdfd400/0x40a459093b06abc6 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [94208->1048575] (req 94208->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f218eb expref: 19 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129575.643151:0:4699:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f590600/0x40a459093b06ab95 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f218ba expref: 19 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129575.643163:0:4699:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f590600/0x40a459093b06ab95 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f218ba expref: 19 pid: 22481 timeout: 930 lvb_type: 1 00000100:00100000:3.0:1746129575.643175:0:4699:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4699:1830948737567488:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129575.644255:0:4699:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009487e600/0x40a459093b06ab48 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21889 expref: 12 pid: 8411 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129575.644267:0:4699:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009487e600/0x40a459093b06ab48 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21889 expref: 12 pid: 8411 timeout: 930 lvb_type: 1 00000100:00100000:3.0:1746129575.644290:0:4699:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4699:1830948737567616:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129575.644356:0:4699:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa381f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746129575.646117:0:4699:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4699:1830948737567488:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129575.646826:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129575.646918:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734262272 00000100:00100000:1.0:1746129575.646924:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734262272 00010000:00010000:1.0:1746129575.646959:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f590600/0x40a459093b06ab95 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f218ba expref: 20 pid: 22481 timeout: 930 lvb_type: 1 00000100:00100000:1.0:1746129575.646993:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8491 00000100:00100000:1.0:1746129575.646999:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f449880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ada2ffba-8920-4ecb-8068-68caa9806978+20:1963:x1830948734262272:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129575.647012:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129575.647034:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f590600/0x40a459093b06ab95 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f218ba expref: 20 pid: 22481 timeout: 930 lvb_type: 1 00010000:00010000:1.0:1746129575.647044:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f590600/0x40a459093b06ab95 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f218ba expref: 20 pid: 22481 timeout: 930 lvb_type: 1 00010000:00010000:1.0:1746129575.647065:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f590600/0x40a459093b06ab95 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f218ba expref: 20 pid: 22481 timeout: 930 lvb_type: 1 00010000:00010000:1.0:1746129575.647081:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129575.647115:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f449880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ada2ffba-8920-4ecb-8068-68caa9806978+19:1963:x1830948734262272:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 115us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129575.647121:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8491 00000100:00100000:3.0:1746129575.647371:0:4699:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4699:1830948737567616:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129575.647399:0:4699:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009cdfd400/0x40a459093b06abc6 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [94208->1048575] (req 94208->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f218eb expref: 18 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129575.647410:0:4699:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cdfd400, rc 0) 00000100:00100000:3.0:1746129575.647437:0:4699:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f448700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ada2ffba-8920-4ecb-8068-68caa9806978+18:32450:x1830948734262144:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 4416us (4618us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129575.647447:0:4699:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16499 00000100:00100000:2.0:1746129575.647682:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129575.647859:0:15749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734262400 00000100:00100000:3.0:1746129575.647863:0:15749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734262400 00010000:00010000:3.0:1746129575.647878:0:15749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009487e600/0x40a459093b06ab48 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21889 expref: 13 pid: 8411 timeout: 930 lvb_type: 1 00000100:00100000:3.0:1746129575.647903:0:15749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8492 00000100:00100000:3.0:1746129575.647908:0:15749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136015880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+13:1961:x1830948734262400:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129575.647916:0:15749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129575.647926:0:15749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009487e600/0x40a459093b06ab48 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21889 expref: 13 pid: 8411 timeout: 930 lvb_type: 1 00010000:00010000:3.0:1746129575.647934:0:15749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009487e600/0x40a459093b06ab48 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21889 expref: 13 pid: 8411 timeout: 930 lvb_type: 1 00010000:00010000:3.0:1746129575.647947:0:15749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009487e600/0x40a459093b06ab48 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21889 expref: 13 pid: 8411 timeout: 930 lvb_type: 1 00010000:00010000:3.0:1746129575.647960:0:15749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129575.647962:0:15749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129575.647969:0:15749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cdfd400/0x40a459093b06abc6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 94208->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f218eb expref: 17 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129575.647976:0:15749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cdfd400/0x40a459093b06abc6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 94208->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f218eb expref: 17 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129575.648003:0:15749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009cdfd400/0x40a459093b06abc6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 94208->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f218eb expref: 17 pid: 4699 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129575.648014:0:15749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bdc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15749:1830948737567744:192.168.202.4@tcp:105: 00000100:00100000:3.0:1746129575.648066:0:15749:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa381f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746129575.651127:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129575.651220:0:15749:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bdc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15749:1830948737567744:192.168.202.4@tcp:105: 00010000:00010000:0.0:1746129575.651244:0:15749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129575.651332:0:15749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136015880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+12:1961:x1830948734262400:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 3421us (3647us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129575.651344:0:15749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8492 00000100:00100000:2.0:1746129575.651419:0:31520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734262656 00000100:00100000:2.0:1746129575.651426:0:31520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734262656 00002000:00100000:2.0:1746129575.651468:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3ec:0x0] (94208->98303) req@ffff8800947bce00 x1830948734262656/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:316/0 lens 488/0 e 0 to 0 dl 1746129586 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129575.651478:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800947bce00 with x1830948734262656 ext(94208->98303) 00002000:00010000:2.0:1746129575.651483:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800947bce00 00000100:00100000:2.0:1746129575.651501:0:31520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7949 00000100:00100000:2.0:1746129575.651507:0:31520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ada2ffba-8920-4ecb-8068-68caa9806978+18:1963:x1830948734262656:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:2.0:1746129575.651669:0:31520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ada2ffba-8920-4ecb-8068-68caa9806978+18:1963:x1830948734262656:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 162us (553us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129575.651676:0:31520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7949 00002000:00100000:2.0:1746129575.651681:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3ec:0x0] (94208->98303) req@ffff8800947bce00 x1830948734262656/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:316/0 lens 488/4536 e 0 to 0 dl 1746129586 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129575.651688:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800947bce00 with x1830948734262656 ext(94208->98303) 00002000:00010000:2.0:1746129575.651690:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800947bce00 00000100:00100000:0.0:1746129575.659660:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129575.659772:0:4699:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734262784 00000100:00100000:2.0:1746129575.659782:0:4699:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734262784 00000100:00100000:2.0:1746129575.660159:0:4699:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16500 00000100:00100000:2.0:1746129575.660168:0:4699:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f44aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ada2ffba-8920-4ecb-8068-68caa9806978+25:32450:x1830948734262784:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:2.0:1746129575.660189:0:4699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129575.660206:0:4699:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cfd6e00/0x40a459093b06abcd lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f218f2 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129575.660237:0:4699:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009487ec00/0x40a459093b06ab4f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21890 expref: 15 pid: 8411 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129575.660245:0:4699:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f591000/0x40a459093b06aba3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f218c1 expref: 26 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129575.660252:0:4699:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129575.660254:0:4699:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129575.660257:0:4699:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cfd6e00/0x40a459093b06abcd lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [1048576->1060863] (req 1048576->1060863) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f218f2 expref: 26 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129575.660320:0:4699:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f591000/0x40a459093b06aba3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f218c1 expref: 26 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129575.660337:0:4699:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f591000/0x40a459093b06aba3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f218c1 expref: 26 pid: 22481 timeout: 930 lvb_type: 1 00000100:00100000:2.0:1746129575.660348:0:4699:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136015180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4699:1830948737567872:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129575.662219:0:4699:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009487ec00/0x40a459093b06ab4f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21890 expref: 15 pid: 8411 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129575.662235:0:4699:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009487ec00/0x40a459093b06ab4f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21890 expref: 15 pid: 8411 timeout: 930 lvb_type: 1 00000100:00100000:2.0:1746129575.662246:0:4699:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013577f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4699:1830948737568000:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129575.663110:0:4699:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132f36180 going to sleep for 11 seconds 00000100:00100000:2.0:1746129575.667345:0:4699:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136015180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4699:1830948737567872:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129575.668150:0:4699:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013577f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4699:1830948737568000:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129575.668185:0:4699:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009cfd6e00/0x40a459093b06abcd lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [1048576->1060863] (req 1048576->1060863) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f218f2 expref: 26 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129575.668201:0:4699:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cfd6e00, rc 0) 00000100:00100000:2.0:1746129575.671585:0:4699:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f44aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ada2ffba-8920-4ecb-8068-68caa9806978+26:32450:x1830948734262784:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 11404us (11924us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129575.671597:0:4699:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16500 00000100:00100000:0.0:1746129575.673056:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129575.673114:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129575.673650:0:15749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734262912 00000100:00100000:2.0:1746129575.673660:0:15749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734262912 00010000:00010000:2.0:1746129575.673702:0:15749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f591000/0x40a459093b06aba3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f218c1 expref: 26 pid: 22481 timeout: 930 lvb_type: 1 00000100:00100000:2.0:1746129575.673973:0:15749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734263040 00000100:00100000:2.0:1746129575.673976:0:15749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734263040 00010000:00010000:2.0:1746129575.673989:0:15749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009487ec00/0x40a459093b06ab4f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21890 expref: 16 pid: 8411 timeout: 930 lvb_type: 1 00000100:00100000:1.0:1746129575.674068:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8493 00000100:00100000:1.0:1746129575.674079:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f44ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ada2ffba-8920-4ecb-8068-68caa9806978+26:1962:x1830948734262912:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129575.674094:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129575.674117:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f591000/0x40a459093b06aba3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f218c1 expref: 26 pid: 22481 timeout: 930 lvb_type: 1 00010000:00010000:1.0:1746129575.674128:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f591000/0x40a459093b06aba3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f218c1 expref: 26 pid: 22481 timeout: 930 lvb_type: 1 00010000:00010000:1.0:1746129575.674151:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f591000/0x40a459093b06aba3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f218c1 expref: 26 pid: 22481 timeout: 930 lvb_type: 1 00010000:00010000:1.0:1746129575.674172:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129575.674217:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f44ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ada2ffba-8920-4ecb-8068-68caa9806978+25:1962:x1830948734262912:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 141us (1166us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129575.674224:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8493 00000100:00100000:1.0:1746129575.674240:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8494 00000100:00100000:1.0:1746129575.674245:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f44bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+16:1962:x1830948734263040:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129575.674251:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129575.674257:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009487ec00/0x40a459093b06ab4f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21890 expref: 16 pid: 8411 timeout: 930 lvb_type: 1 00010000:00010000:1.0:1746129575.674266:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009487ec00/0x40a459093b06ab4f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21890 expref: 16 pid: 8411 timeout: 930 lvb_type: 1 00010000:00010000:1.0:1746129575.674289:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009487ec00/0x40a459093b06ab4f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21890 expref: 16 pid: 8411 timeout: 930 lvb_type: 1 00010000:00010000:1.0:1746129575.674320:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129575.674322:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129575.674329:0:7085:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009cfd6e00/0x40a459093b06abcd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1060863) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f218f2 expref: 24 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129575.674336:0:7085:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cfd6e00/0x40a459093b06abcd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1060863) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f218f2 expref: 24 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129575.674370:0:7085:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009cfd6e00/0x40a459093b06abcd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1060863) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f218f2 expref: 24 pid: 4699 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129575.674382:0:7085:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7db100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7085:1830948737568128:192.168.202.4@tcp:105: 00000100:00100000:1.0:1746129575.674431:0:7085:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0ac3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129575.680911:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129575.681092:0:7085:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7db100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7085:1830948737568128:192.168.202.4@tcp:105: 00010000:00010000:1.0:1746129575.681114:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129575.681174:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f44bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+15:1962:x1830948734263040:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 6927us (8058us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129575.681186:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8494 00000100:00100000:3.0:1746129575.681541:0:31523:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734263296 00000100:00100000:3.0:1746129575.681549:0:31523:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734263296 00002000:00100000:3.0:1746129575.681591:0:31523:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f3:0x0] (1056768->1060863) req@ffff88012e388e00 x1830948734263296/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:316/0 lens 488/0 e 0 to 0 dl 1746129586 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129575.681601:0:31523:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e388e00 with x1830948734263296 ext(1056768->1060863) 00002000:00010000:3.0:1746129575.681606:0:31523:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e388e00 00000100:00100000:3.0:1746129575.681636:0:31523:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7950 00000100:00100000:3.0:1746129575.681643:0:31523:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e388e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ada2ffba-8920-4ecb-8068-68caa9806978+25:1961:x1830948734263296:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:3.0:1746129575.681812:0:31523:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e388e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ada2ffba-8920-4ecb-8068-68caa9806978+25:1961:x1830948734263296:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 169us (912us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129575.681818:0:31523:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7950 00002000:00100000:3.0:1746129575.681823:0:31523:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f3:0x0] (1056768->1060863) req@ffff88012e388e00 x1830948734263296/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:316/0 lens 488/4536 e 0 to 0 dl 1746129586 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129575.681830:0:31523:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e388e00 with x1830948734263296 ext(1056768->1060863) 00002000:00010000:3.0:1746129575.681833:0:31523:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e388e00 00000100:00100000:0.0:1746129575.683652:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129575.683804:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734263552 00000100:00100000:2.0:1746129575.683812:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734263552 00000100:00100000:2.0:1746129575.683850:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4804 00000100:00100000:2.0:1746129575.683856:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094028700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ada2ffba-8920-4ecb-8068-68caa9806978+309:32450:x1830948734263552:12345-192.168.202.4@tcp:35:multiop.0 00000100:00100000:2.0:1746129575.684810:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094028700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ada2ffba-8920-4ecb-8068-68caa9806978+310:32450:x1830948734263552:12345-192.168.202.4@tcp:35:multiop.0 Request processed in 950us (1162us total) trans 8589945399 rc 0/0 00000100:00100000:2.0:1746129575.684818:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4804 00000100:00100000:0.0:1746129575.708142:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129575.718510:0:16908:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734263808 00000100:00100000:3.0:1746129575.718524:0:16908:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734263808 00000100:00100000:3.0:1746129575.718591:0:16908:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11291 00000100:00100000:3.0:1746129575.718598:0:16908:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009402a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:32459:x1830948734263808:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:3.0:1746129575.718623:0:16908:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129575.718644:0:16908:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cdfcc00/0x40a459093b06abd4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f218f9 expref: -99 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129575.718748:0:16908:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cdfdc00/0x40a459093b06abdb lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129575.718764:0:16908:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6caf800/0x40a459093b06ab87 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f218b3 expref: 21 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129575.718771:0:16908:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cdfdc00/0x40a459093b06abdb lrc: 4/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129575.718805:0:16908:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6caf800/0x40a459093b06ab87 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f218b3 expref: 21 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129575.718816:0:16908:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6caf800/0x40a459093b06ab87 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f218b3 expref: 21 pid: 16908 timeout: 931 lvb_type: 0 00000100:00100000:3.0:1746129575.718828:0:16908:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bc700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16908:1830948737568256:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129575.722505:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129575.722553:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734263936 00000100:00100000:0.0:1746129575.722561:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734263936 00010000:00010000:0.0:1746129575.722600:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6caf800/0x40a459093b06ab87 lrc: 6/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f218b3 expref: 22 pid: 16908 timeout: 931 lvb_type: 0 00000100:00100000:0.0:1746129575.722635:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8495 00000100:00100000:0.0:1746129575.722644:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094028a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+22:1963:x1830948734263936:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129575.722662:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129575.722668:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6caf800/0x40a459093b06ab87 lrc: 6/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f218b3 expref: 22 pid: 16908 timeout: 931 lvb_type: 0 00010000:00010000:0.0:1746129575.722680:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6caf800/0x40a459093b06ab87 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f218b3 expref: 22 pid: 16908 timeout: 931 lvb_type: 0 00010000:00010000:0.0:1746129575.722704:0:7085:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:0.0:1746129575.722710:0:7085:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009cdfdc00/0x40a459093b06abdb lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129575.722720:0:7085:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cdfdc00/0x40a459093b06abdb lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129575.722728:0:7085:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cdfdc00/0x40a459093b06abdb lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129575.722746:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129575.722789:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094028a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+22:1963:x1830948734263936:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 145us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129575.722796:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8495 00000100:00100000:3.0:1746129575.725571:0:16908:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa3813c0 going to sleep for 11 seconds 00010000:00010000:3.0:1746129575.726133:0:16908:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6caf800/0x40a459093b06ab87 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f218b3 expref: 21 pid: 16908 timeout: 931 lvb_type: 0 00000100:00100000:3.0:1746129575.726742:0:16908:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bc700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16908:1830948737568256:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129575.726768:0:16908:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009cdfdc00/0x40a459093b06abdb lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129575.726778:0:16908:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009cdfdc00/0x40a459093b06abdb lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129575.726783:0:16908:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cdfdc00/0x40a459093b06abdb lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00000004:00200000:3.0:1746129575.726806:0:16908:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:3.0:1746129575.726961:0:16908:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cdfcc00/0x40a459093b06abd4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f218f9 expref: 22 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129575.726976:0:16908:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cdfdc00/0x40a459093b06abdb lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f218f9 expref: 21 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129575.726984:0:16908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:3.0:1746129575.726987:0:16908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746129575.726990:0:16908:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cdfdc00, rc 0) 00000100:00100000:3.0:1746129575.728708:0:16908:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009402a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:32459:x1830948734263808:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 10099us (20565us total) trans 8589945400 rc 0/0 00000100:00100000:3.0:1746129575.728720:0:16908:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11291 00000100:00100000:0.0:1746129575.746070:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129575.746887:0:4699:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734264064 00000100:00100000:2.0:1746129575.746896:0:4699:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734264064 00000100:00100000:2.0:1746129575.746948:0:4699:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16501 00000100:00100000:2.0:1746129575.746955:0:4699:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094029f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+15:32459:x1830948734264064:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:2.0:1746129575.746974:0:4699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129575.746990:0:4699:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cfd7000/0x40a459093b06abe9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21900 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129575.747018:0:4699:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009cfd6e00/0x40a459093b06abcd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1060863) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f218f2 expref: 24 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129575.747025:0:4699:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129575.747028:0:4699:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129575.747031:0:4699:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cfd7000/0x40a459093b06abe9 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1200128->1462271] (req 1200128->1462271) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21900 expref: 16 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129575.747059:0:4699:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009cfd6e00/0x40a459093b06abcd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1060863) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f218f2 expref: 24 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129575.747070:0:4699:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009cfd6e00/0x40a459093b06abcd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1060863) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f218f2 expref: 24 pid: 4699 timeout: 931 lvb_type: 0 00000100:00100000:2.0:1746129575.747081:0:4699:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013577f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4699:1830948737568384:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129575.747677:0:4699:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132f36180 going to sleep for 11 seconds 00000100:00100000:1.0:1746129575.750828:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129575.750923:0:31520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734264192 00000100:00100000:3.0:1746129575.750934:0:31520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734264192 00002000:00100000:3.0:1746129575.750983:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->1060863) req@ffff88009c7db100 x1830948734264192/t0(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:316/0 lens 12776/0 e 0 to 0 dl 1746129586 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129575.750993:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7db100 with x1830948734264192 ext(1048576->1060863) 00010000:00010000:3.0:1746129575.751003:0:31520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009cfd6e00/0x40a459093b06abcd lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1060863) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f218f2 expref: 25 pid: 4699 timeout: 931 lvb_type: 0 00010000:00010000:3.0:1746129575.751018:0:31520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009cfd6e00/0x40a459093b06abcd lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1060863) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f218f2 expref: 25 pid: 4699 timeout: 931 lvb_type: 0 00002000:00010000:3.0:1746129575.751025:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c7db100 00000100:00100000:3.0:1746129575.751046:0:31520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2466 00000100:00100000:3.0:1746129575.751054:0:31520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ada2ffba-8920-4ecb-8068-68caa9806978+25:1963:x1830948734264192:12345-192.168.202.4@tcp:4:multiop.0 00000100:00100000:3.0:1746129575.751494:0:31520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ada2ffba-8920-4ecb-8068-68caa9806978+27:1963:x1830948734264192:12345-192.168.202.4@tcp:4:multiop.0 Request processed in 440us (678us total) trans 17179874152 rc 0/0 00000100:00100000:3.0:1746129575.751501:0:31520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2466 00002000:00100000:3.0:1746129575.751506:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->1060863) req@ffff88009c7db100 x1830948734264192/t17179874152(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:316/0 lens 12776/448 e 0 to 0 dl 1746129586 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129575.751514:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7db100 with x1830948734264192 ext(1048576->1060863) 00010000:00010000:3.0:1746129575.751518:0:31520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009cfd6e00/0x40a459093b06abcd lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1060863) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f218f2 expref: 27 pid: 4699 timeout: 931 lvb_type: 0 00010000:00010000:3.0:1746129575.751527:0:31520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009cfd6e00/0x40a459093b06abcd lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1060863) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f218f2 expref: 27 pid: 4699 timeout: 931 lvb_type: 0 00002000:00010000:3.0:1746129575.751532:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c7db100 00000100:00100000:2.0:1746129575.752356:0:4699:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013577f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4699:1830948737568384:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129575.752388:0:4699:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009cfd7000/0x40a459093b06abe9 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1200128->1462271] (req 1200128->1462271) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21900 expref: 16 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129575.752403:0:4699:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cfd7000, rc 0) 00000100:00100000:2.0:1746129575.752437:0:4699:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094029f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+16:32459:x1830948734264064:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 5483us (6379us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129575.752445:0:4699:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16501 00000100:00100000:0.0:1746129575.753525:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129575.753607:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734264320 00000100:00100000:2.0:1746129575.753616:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734264320 00010000:00010000:2.0:1746129575.753649:0:9823:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009cfd6e00/0x40a459093b06abcd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1060863) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f218f2 expref: 27 pid: 4699 timeout: 931 lvb_type: 0 00000100:00100000:2.0:1746129575.753674:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8496 00000100:00100000:2.0:1746129575.753680:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6fd1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ada2ffba-8920-4ecb-8068-68caa9806978+27:1963:x1830948734264320:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129575.753698:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746129575.753719:0:9823:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb mtime from disk: 1746129575 -> 1746129576 00002000:00010000:2.0:1746129575.753722:0:9823:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb ctime from disk: 1746129575 -> 1746129576 00010000:00010000:2.0:1746129575.753727:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009cfd6e00/0x40a459093b06abcd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1060863) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f218f2 expref: 27 pid: 4699 timeout: 931 lvb_type: 0 00010000:00010000:2.0:1746129575.753738:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009cfd6e00/0x40a459093b06abcd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1060863) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f218f2 expref: 27 pid: 4699 timeout: 931 lvb_type: 0 00010000:00010000:2.0:1746129575.753762:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cfd6e00/0x40a459093b06abcd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1060863) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f218f2 expref: 27 pid: 4699 timeout: 931 lvb_type: 0 00010000:00010000:2.0:1746129575.753825:0:9823:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129575.753827:0:9823:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129575.753834:0:9823:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009cfd7000/0x40a459093b06abe9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1200128->1462271) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21900 expref: 15 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129575.753842:0:9823:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cfd7000/0x40a459093b06abe9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1200128->1462271) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21900 expref: 15 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129575.753875:0:9823:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009cfd7000/0x40a459093b06abe9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1200128->1462271) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21900 expref: 15 pid: 4699 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129575.753887:0:9823:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013577f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9823:1830948737568512:192.168.202.4@tcp:105: 00000100:00100000:2.0:1746129575.754396:0:9823:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132f36180 going to sleep for 11 seconds 00000100:00100000:2.0:1746129575.756548:0:9823:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013577f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9823:1830948737568512:192.168.202.4@tcp:105: 00010000:00010000:2.0:1746129575.756581:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129575.756627:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6fd1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ada2ffba-8920-4ecb-8068-68caa9806978+26:1963:x1830948734264320:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 2945us (3106us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129575.756638:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8496 00000100:00100000:0.0:1746129575.762706:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129575.764469:0:31523:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734264576 00000100:00100000:2.0:1746129575.764483:0:31523:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734264576 00002000:00100000:2.0:1746129575.764546:0:31523:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f3:0x0] (1200128->1204223) req@ffff88009402ad80 x1830948734264576/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:316/0 lens 488/0 e 0 to 0 dl 1746129586 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129575.764556:0:31523:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009402ad80 with x1830948734264576 ext(1200128->1204223) 00002000:00010000:2.0:1746129575.764562:0:31523:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009402ad80 00000100:00100000:2.0:1746129575.764643:0:31523:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7951 00000100:00100000:2.0:1746129575.764652:0:31523:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009402ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+16:1962:x1830948734264576:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:2.0:1746129575.765137:0:31523:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009402ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+16:1962:x1830948734264576:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 483us (2439us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129575.765145:0:31523:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7951 00002000:00100000:2.0:1746129575.765151:0:31523:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f3:0x0] (1200128->1204223) req@ffff88009402ad80 x1830948734264576/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:316/0 lens 488/4536 e 0 to 0 dl 1746129586 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129575.765159:0:31523:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009402ad80 with x1830948734264576 ext(1200128->1204223) 00002000:00010000:2.0:1746129575.765162:0:31523:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009402ad80 00000100:00100000:0.0:1746129575.769974:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129575.770092:0:31523:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734264832 00000100:00100000:2.0:1746129575.770104:0:31523:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734264832 00002000:00100000:2.0:1746129575.770155:0:31523:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f3:0x0] (1458176->1462271) req@ffff880094029880 x1830948734264832/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:316/0 lens 488/0 e 0 to 0 dl 1746129586 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129575.770165:0:31523:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094029880 with x1830948734264832 ext(1458176->1462271) 00002000:00010000:2.0:1746129575.770171:0:31523:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094029880 00000100:00100000:3.0:1746129575.771677:0:31520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7952 00000100:00100000:3.0:1746129575.771696:0:31520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094029880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+16:1963:x1830948734264832:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:3.0:1746129575.771940:0:31520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094029880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+16:1963:x1830948734264832:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 252us (1977us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129575.771948:0:31520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7952 00002000:00100000:3.0:1746129575.771955:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3f3:0x0] (1458176->1462271) req@ffff880094029880 x1830948734264832/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:316/0 lens 488/4536 e 0 to 0 dl 1746129586 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129575.771964:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094029880 with x1830948734264832 ext(1458176->1462271) 00002000:00010000:3.0:1746129575.771969:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094029880 00000100:00100000:0.0:1746129575.772593:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129575.772738:0:16908:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734265088 00000100:00100000:3.0:1746129575.772745:0:16908:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734265088 00000100:00100000:3.0:1746129575.772789:0:16908:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11292 00000100:00100000:3.0:1746129575.772795:0:16908:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094029500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:32463:x1830948734265088:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129575.772813:0:16908:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129575.772831:0:16908:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cdfc400/0x40a459093b06abf0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21907 expref: -99 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129575.772938:0:16908:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cdfca00/0x40a459093b06abf7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129575.772953:0:16908:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cdfca00/0x40a459093b06abf7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129575.772964:0:16908:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cdfca00/0x40a459093b06abf7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129575.772976:0:16908:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cdfc200/0x40a459093b06abfe lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129575.772982:0:16908:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cdfc200/0x40a459093b06abfe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129575.772987:0:16908:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cdfc200/0x40a459093b06abfe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129575.773093:0:16908:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cdfc000/0x40a459093b06ac05 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129575.773101:0:16908:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cdfc000/0x40a459093b06ac05 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129575.773107:0:16908:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cdfc000/0x40a459093b06ac05 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00000004:00200000:3.0:1746129575.773118:0:16908:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:3.0:1746129575.773203:0:16908:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cdfca00/0x40a459093b06abf7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129575.773209:0:16908:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cdfca00/0x40a459093b06abf7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129575.773215:0:16908:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009cdfca00/0x40a459093b06abf7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129575.773221:0:16908:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009cdfca00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:3.0:1746129575.773225:0:16908:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cdfca00/0x40a459093b06abf7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129575.773230:0:16908:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cdfca00/0x40a459093b06abf7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129575.773240:0:16908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880132ef8f00) 00010000:00010000:3.0:1746129575.773243:0:16908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129575.773246:0:16908:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009cdfca00/0x40a459093b06abf7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129575.773251:0:16908:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cdfca00/0x40a459093b06abf7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129575.773283:0:16908:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cdfc200/0x40a459093b06abfe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129575.773289:0:16908:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cdfc200/0x40a459093b06abfe lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129575.773323:0:16908:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009cdfc200/0x40a459093b06abfe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129575.773331:0:16908:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009cdfc200 already unused, calling callback (ffffffffa136e690) 00010000:00010000:3.0:1746129575.773333:0:16908:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cdfc200/0x40a459093b06abfe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129575.773338:0:16908:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cdfc200/0x40a459093b06abfe lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129575.773344:0:16908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880136997100) 00010000:00010000:3.0:1746129575.773346:0:16908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129575.773348:0:16908:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009cdfc200/0x40a459093b06abfe lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129575.773352:0:16908:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cdfc200/0x40a459093b06abfe lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129575.773386:0:16908:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cdfc400/0x40a459093b06abf0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21907 expref: 24 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129575.773397:0:16908:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cdfc000/0x40a459093b06ac05 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21907 expref: 23 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129575.773402:0:16908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:3.0:1746129575.773405:0:16908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746129575.773407:0:16908:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cdfc000, rc 0) 00000100:00100000:3.0:1746129575.773456:0:16908:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094029500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+23:32463:x1830948734265088:12345-192.168.202.4@tcp:101:cat.0 Request processed in 660us (865us total) trans 8589945401 rc 0/0 00000100:00100000:3.0:1746129575.773463:0:16908:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11292 00000100:00100000:0.0:1746129575.776143:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129575.776284:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734265344 00000100:00100000:2.0:1746129575.776333:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734265344 00000100:00100000:2.0:1746129575.776390:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4805 00000100:00100000:2.0:1746129575.776399:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009402bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+23:32463:x1830948734265344:12345-192.168.202.4@tcp:35:cat.0 00000100:00100000:2.0:1746129575.777563:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009402bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+24:32463:x1830948734265344:12345-192.168.202.4@tcp:35:cat.0 Request processed in 1159us (1423us total) trans 8589945402 rc 0/0 00000100:00100000:2.0:1746129575.777573:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4805 00000100:00100000:0.0:1746129575.781034:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129575.782405:0:4699:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734265472 00000100:00100000:3.0:1746129575.782418:0:4699:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734265472 00000100:00100000:3.0:1746129575.782473:0:4699:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16502 00000100:00100000:3.0:1746129575.782481:0:4699:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094028a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+12:1962:x1830948734265472:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129575.782502:0:4699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129575.782520:0:4699:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cdfcc00/0x40a459093b06ac13 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2190e expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129575.782580:0:4699:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4699:1830948737568640:192.168.202.4@tcp:106: 00000100:00100000:3.0:1746129575.782669:0:4699:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa381480 going to sleep for 11 seconds 00002000:00010000:3.0:1746129575.786623:0:4699:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3ec:0x0] updating lvb mtime: 1746129575 -> 1746129576 00002000:00010000:3.0:1746129575.786631:0:4699:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3ec:0x0] updating lvb atime: 1746129571 -> 1746129576 00002000:00010000:3.0:1746129575.786633:0:4699:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3ec:0x0] updating lvb ctime: 1746129575 -> 1746129576 00000100:00100000:3.0:1746129575.786659:0:4699:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4699:1830948737568640:192.168.202.4@tcp:106: 00010000:00010000:3.0:1746129575.786694:0:4699:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009cdfcc00/0x40a459093b06ac13 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2190e expref: 13 pid: 4699 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129575.786708:0:4699:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cdfcc00/0x40a459093b06ac13 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2190e expref: 13 pid: 4699 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129575.786895:0:4699:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cdfcc00, rc 0) 00000100:00100000:3.0:1746129575.787106:0:4699:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094028a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+12:1962:x1830948734265472:12345-192.168.202.4@tcp:101:cat.0 Request processed in 4624us (6081us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129575.787116:0:4699:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16502 00000100:00100000:0.0:1746129575.789343:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129575.789608:0:4699:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734265600 00000100:00100000:3.0:1746129575.789618:0:4699:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734265600 00000100:00100000:3.0:1746129575.789659:0:4699:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16503 00000100:00100000:3.0:1746129575.789666:0:4699:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b550e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+12:32463:x1830948734265600:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129575.789686:0:4699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129575.789703:0:4699:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cdfc400/0x40a459093b06ac1a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21915 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129575.789731:0:4699:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cdfd400/0x40a459093b06abc6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 94208->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f218eb expref: 17 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129575.789737:0:4699:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129575.789739:0:4699:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129575.789742:0:4699:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cdfc400/0x40a459093b06ac1a lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21915 expref: 13 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129575.789770:0:4699:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009cdfd400/0x40a459093b06abc6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 94208->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f218eb expref: 17 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129575.789779:0:4699:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009cdfd400/0x40a459093b06abc6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 94208->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f218eb expref: 17 pid: 4699 timeout: 931 lvb_type: 0 00000100:00100000:3.0:1746129575.789790:0:4699:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4699:1830948737568768:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129575.790618:0:4699:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa381480 going to sleep for 11 seconds 00000100:00100000:0.0:1746129575.795119:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129575.795226:0:4699:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4699:1830948737568768:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129575.795257:0:4699:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009cdfc400/0x40a459093b06ac1a lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21915 expref: 13 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129575.795290:0:4699:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cdfc400, rc 0) 00000100:00100000:3.0:1746129575.795354:0:4699:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b550e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+13:32463:x1830948734265600:12345-192.168.202.4@tcp:101:cat.0 Request processed in 5687us (6019us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129575.795366:0:4699:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16503 00000100:00100000:2.0:1746129575.795444:0:31523:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734265728 00000100:00100000:2.0:1746129575.795451:0:31523:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734265728 00002000:00100000:2.0:1746129575.795492:0:31523:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3ec:0x0] (94208->1048575) req@ffff88012b551c00 x1830948734265728/t0(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:316/0 lens 488/0 e 0 to 0 dl 1746129586 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129575.795500:0:31523:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b551c00 with x1830948734265728 ext(94208->1048575) 00010000:00010000:2.0:1746129575.795507:0:31523:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009cdfd400/0x40a459093b06abc6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 94208->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f218eb expref: 18 pid: 4699 timeout: 931 lvb_type: 0 00010000:00010000:2.0:1746129575.795518:0:31523:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009cdfd400/0x40a459093b06abc6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 94208->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f218eb expref: 18 pid: 4699 timeout: 931 lvb_type: 0 00002000:00010000:2.0:1746129575.795524:0:31523:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b551c00 00000100:00100000:2.0:1746129575.795540:0:31523:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2467 00000100:00100000:2.0:1746129575.795547:0:31523:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b551c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ada2ffba-8920-4ecb-8068-68caa9806978+18:1963:x1830948734265728:12345-192.168.202.4@tcp:4:multiop.0 00000100:00100000:3.0:1746129575.813854:0:31523:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b551c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ada2ffba-8920-4ecb-8068-68caa9806978+20:1963:x1830948734265728:12345-192.168.202.4@tcp:4:multiop.0 Request processed in 18293us (18734us total) trans 21474841402 rc 0/0 00000100:00100000:3.0:1746129575.813868:0:31523:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2467 00002000:00100000:3.0:1746129575.813883:0:31523:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3ec:0x0] (94208->1048575) req@ffff88012b551c00 x1830948734265728/t21474841402(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:316/0 lens 488/448 e 0 to 0 dl 1746129586 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129575.813893:0:31523:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b551c00 with x1830948734265728 ext(94208->1048575) 00010000:00010000:3.0:1746129575.813904:0:31523:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009cdfd400/0x40a459093b06abc6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 94208->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f218eb expref: 20 pid: 4699 timeout: 931 lvb_type: 0 00010000:00010000:3.0:1746129575.813921:0:31523:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009cdfd400/0x40a459093b06abc6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 94208->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f218eb expref: 20 pid: 4699 timeout: 931 lvb_type: 0 00002000:00010000:3.0:1746129575.813929:0:31523:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b551c00 00000100:00100000:0.0:1746129575.820768:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129575.820895:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734265856 00000100:00100000:2.0:1746129575.820905:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734265856 00010000:00010000:2.0:1746129575.820951:0:9823:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009cdfd400/0x40a459093b06abc6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 94208->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f218eb expref: 20 pid: 4699 timeout: 931 lvb_type: 0 00000100:00100000:2.0:1746129575.820988:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8497 00000100:00100000:2.0:1746129575.820995:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b553100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ada2ffba-8920-4ecb-8068-68caa9806978+20:1962:x1830948734265856:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129575.821010:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129575.821034:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009cdfd400/0x40a459093b06abc6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 94208->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f218eb expref: 20 pid: 4699 timeout: 931 lvb_type: 0 00010000:00010000:2.0:1746129575.821047:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009cdfd400/0x40a459093b06abc6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 94208->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f218eb expref: 20 pid: 4699 timeout: 931 lvb_type: 0 00010000:00010000:2.0:1746129575.821073:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cdfd400/0x40a459093b06abc6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 94208->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f218eb expref: 20 pid: 4699 timeout: 931 lvb_type: 0 00010000:00010000:2.0:1746129575.824923:0:9823:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129575.824929:0:9823:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129575.824948:0:9823:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cdfc400/0x40a459093b06ac1a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21915 expref: 12 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129575.824960:0:9823:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cdfc400/0x40a459093b06ac1a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21915 expref: 12 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129575.825016:0:9823:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009cdfc400/0x40a459093b06ac1a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21915 expref: 12 pid: 4699 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129575.825032:0:9823:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013577f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9823:1830948737568896:192.168.202.4@tcp:105: 00000100:00100000:2.0:1746129575.825628:0:9823:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132f36480 going to sleep for 11 seconds 00000100:00100000:0.0:1746129575.834478:0:9823:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013577f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9823:1830948737568896:192.168.202.4@tcp:105: 00010000:00010000:0.0:1746129575.834508:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129575.834591:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b553100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ada2ffba-8920-4ecb-8068-68caa9806978+19:1962:x1830948734265856:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 13593us (13833us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129575.834602:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8497 00000100:00100000:0.0:1746129575.842794:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129575.842853:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129575.843119:0:31523:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734266112 00000100:00100000:3.0:1746129575.843129:0:31523:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734266112 00000100:00100000:2.0:1746129575.843290:0:31520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734266368 00000100:00100000:2.0:1746129575.843322:0:31520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734266368 00002000:00100000:2.0:1746129575.843344:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff88012b552680 x1830948734266368/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:316/0 lens 504/0 e 0 to 0 dl 1746129586 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129575.843355:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b552680 with x1830948734266368 ext(1048576->2097151) 00002000:00010000:2.0:1746129575.843360:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b552680 00000100:00100000:2.0:1746129575.843379:0:31520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7953 00000100:00100000:2.0:1746129575.843386:0:31520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b552680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+16:1963:x1830948734266368:12345-192.168.202.4@tcp:3:cat.0 00002000:00100000:3.0:1746129575.843981:0:31523:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3ec:0x0] (0->1048575) req@ffff88012b550700 x1830948734266112/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:316/0 lens 488/0 e 0 to 0 dl 1746129586 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129575.843989:0:31523:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b550700 with x1830948734266112 ext(0->1048575) 00002000:00010000:3.0:1746129575.843993:0:31523:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b550700 00000100:00100000:3.0:1746129575.844394:0:31523:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7954 00000100:00100000:3.0:1746129575.844402:0:31523:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b550700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+13:1963:x1830948734266112:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129575.846092:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129575.846115:0:31518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734266880 00000100:00100000:0.0:1746129575.846121:0:31518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734266880 00002000:00100000:0.0:1746129575.846155:0:31518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3ee:0x0] (1048576->2097151) req@ffff88012b552d80 x1830948734266880/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:316/0 lens 488/0 e 0 to 0 dl 1746129586 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129575.846165:0:31518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b552d80 with x1830948734266880 ext(1048576->2097151) 00002000:00010000:0.0:1746129575.846169:0:31518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b552d80 00000100:00100000:0.0:1746129575.846186:0:31518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7955 00000100:00100000:0.0:1746129575.846192:0:31518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b552d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+15:1963:x1830948734266880:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129575.847602:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129575.847647:0:31519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734266752 00000100:00100000:0.0:1746129575.847653:0:31519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734266752 00002000:00100000:0.0:1746129575.847682:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f4:0x0] (1048576->2097151) req@ffff8800900f6300 x1830948734266752/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:316/0 lens 488/0 e 0 to 0 dl 1746129586 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129575.847690:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800900f6300 with x1830948734266752 ext(1048576->2097151) 00002000:00010000:0.0:1746129575.847695:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800900f6300 00000100:00100000:0.0:1746129575.847712:0:31519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7956 00000100:00100000:0.0:1746129575.847720:0:31519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+17:1962:x1830948734266752:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129575.859719:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129575.859837:0:15096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734267136 00000100:00100000:2.0:1746129575.859848:0:15096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734267136 00000100:00100000:2.0:1746129575.859919:0:15096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11293 00000100:00100000:2.0:1746129575.859929:0:15096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ada2ffba-8920-4ecb-8068-68caa9806978+310:32467:x1830948734267136:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129575.859956:0:15096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129575.859974:0:15096:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95ece00/0x40a459093b06ac21 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2191c expref: -99 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129575.860092:0:15096:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95ed600/0x40a459093b06ac28 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129575.860107:0:15096:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95ed600/0x40a459093b06ac28 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129575.860117:0:15096:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95ed600/0x40a459093b06ac28 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129575.860133:0:15096:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b3bfe00/0x40a459093b06ac2f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129575.860138:0:15096:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b3bfe00/0x40a459093b06ac2f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129575.860147:0:15096:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b3bfe00/0x40a459093b06ac2f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129575.860249:0:15096:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b3be000/0x40a459093b06ac36 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129575.860258:0:15096:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b3be000/0x40a459093b06ac36 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129575.860264:0:15096:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b3be000/0x40a459093b06ac36 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 15096 initiator: MDT0 00000004:00200000:2.0:1746129575.860288:0:15096:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:2.0:1746129575.860392:0:15096:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95ed600/0x40a459093b06ac28 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129575.860399:0:15096:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95ed600/0x40a459093b06ac28 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129575.860405:0:15096:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95ed600/0x40a459093b06ac28 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129575.860411:0:15096:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a95ed600 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746129575.860415:0:15096:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95ed600/0x40a459093b06ac28 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129575.860421:0:15096:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95ed600/0x40a459093b06ac28 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129575.860431:0:15096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880132ef8f00) 00010000:00010000:2.0:1746129575.860433:0:15096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129575.860437:0:15096:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95ed600/0x40a459093b06ac28 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129575.860446:0:15096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95ed600/0x40a459093b06ac28 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129575.867757:0:15096:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b3bfe00/0x40a459093b06ac2f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129575.867774:0:15096:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b3bfe00/0x40a459093b06ac2f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129575.867781:0:15096:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b3bfe00/0x40a459093b06ac2f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129575.867787:0:15096:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b3bfe00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746129575.867792:0:15096:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b3bfe00/0x40a459093b06ac2f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129575.867799:0:15096:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b3bfe00/0x40a459093b06ac2f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129575.867817:0:15096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009ce7a300) 00010000:00010000:2.0:1746129575.867820:0:15096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129575.867823:0:15096:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b3bfe00/0x40a459093b06ac2f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129575.867827:0:15096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b3bfe00/0x40a459093b06ac2f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129575.867912:0:15096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95ece00/0x40a459093b06ac21 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2191c expref: 313 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129575.867926:0:15096:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b3be000/0x40a459093b06ac36 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2191c expref: 312 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129575.867938:0:15096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:2.0:1746129575.867940:0:15096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746129575.867943:0:15096:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b3be000, rc 0) 00000100:00100000:2.0:1746129575.868016:0:15096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ada2ffba-8920-4ecb-8068-68caa9806978+312:32467:x1830948734267136:12345-192.168.202.4@tcp:101:cat.0 Request processed in 8087us (8307us total) trans 8589945403 rc 0/0 00000100:00100000:2.0:1746129575.868025:0:15096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11293 00000100:00100000:0.0:1746129575.874929:0:31523:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b550700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+15:1963:x1830948734266112:12345-192.168.202.4@tcp:3:cat.0 Request processed in 30512us (32130us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129575.874944:0:31523:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7954 00002000:00100000:0.0:1746129575.874961:0:31523:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3ec:0x0] (0->1048575) req@ffff88012b550700 x1830948734266112/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:316/0 lens 488/440 e 0 to 0 dl 1746129586 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129575.874971:0:31523:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b550700 with x1830948734266112 ext(0->1048575) 00002000:00010000:0.0:1746129575.874978:0:31523:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b550700 00000100:00100000:2.0:1746129575.882659:0:31518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b552d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+13:1963:x1830948734266880:12345-192.168.202.4@tcp:3:cat.0 Request processed in 36449us (36556us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129575.882676:0:31518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7955 00002000:00100000:2.0:1746129575.882692:0:31518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3ee:0x0] (1048576->2097151) req@ffff88012b552d80 x1830948734266880/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:316/0 lens 488/440 e 0 to 0 dl 1746129586 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129575.882702:0:31518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b552d80 with x1830948734266880 ext(1048576->2097151) 00002000:00010000:2.0:1746129575.882708:0:31518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b552d80 00000100:00100000:2.0:1746129575.885775:0:31520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b552680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+18:1963:x1830948734266368:12345-192.168.202.4@tcp:3:cat.0 Request processed in 42375us (42907us total) trans 0 rc 786432/786432 00000100:00100000:2.0:1746129575.885787:0:31520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7953 00002000:00100000:2.0:1746129575.885799:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff88012b552680 x1830948734266368/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:316/0 lens 504/440 e 0 to 0 dl 1746129586 ref 1 fl Complete:/200/0 rc 786432/786432 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129575.885809:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b552680 with x1830948734266368 ext(1048576->2097151) 00002000:00010000:2.0:1746129575.885816:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b552680 00000100:00100000:1.0:1746129575.896222:0:31519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+16:1962:x1830948734266752:12345-192.168.202.4@tcp:3:cat.0 Request processed in 48489us (48612us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129575.896236:0:31519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7956 00002000:00100000:1.0:1746129575.896248:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f4:0x0] (1048576->2097151) req@ffff8800900f6300 x1830948734266752/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:316/0 lens 488/440 e 0 to 0 dl 1746129586 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129575.896264:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800900f6300 with x1830948734266752 ext(1048576->2097151) 00002000:00010000:1.0:1746129575.896282:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800900f6300 00000100:00100000:0.0:1746129575.897144:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129575.897953:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129575.898042:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734267392 00000100:00100000:2.0:1746129575.898053:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734267392 00000100:00100000:2.0:1746129575.898099:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4806 00000100:00100000:2.0:1746129575.898106:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ada2ffba-8920-4ecb-8068-68caa9806978+312:32467:x1830948734267392:12345-192.168.202.4@tcp:35:cat.0 00000100:00100000:2.0:1746129575.898343:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ada2ffba-8920-4ecb-8068-68caa9806978+313:32467:x1830948734267392:12345-192.168.202.4@tcp:35:cat.0 Request processed in 237us (1201us total) trans 8589945404 rc 0/0 00000100:00100000:2.0:1746129575.898349:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4806 00000100:00100000:1.0:1746129575.898688:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734267520 00000100:00100000:1.0:1746129575.898693:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734267520 00000100:00100000:1.0:1746129575.898724:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 798 00000100:00100000:1.0:1746129575.898729:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ada2ffba-8920-4ecb-8068-68caa9806978+313:1960:x1830948734267520:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129575.898739:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129575.898765:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b3be000/0x40a459093b06ac36 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2191c expref: 313 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129575.900403:0:9823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:1.0:1746129575.900412:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129575.900490:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ada2ffba-8920-4ecb-8068-68caa9806978+312:1960:x1830948734267520:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 1755us (2534us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129575.900500:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 798 00000100:00100000:0.0:1746129575.904977:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129575.908693:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129575.908743:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129575.908767:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129575.909422:0:15096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734268160 00000100:00100000:2.0:1746129575.909433:0:15096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734268160 00000100:00100000:2.0:1746129575.911359:0:15096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11294 00000100:00100000:2.0:1746129575.911374:0:15096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+24:32469:x1830948734268160:12345-192.168.202.4@tcp:101:multiop.0 00000100:00100000:3.0:1746129575.911383:0:4699:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734267776 00000100:00100000:3.0:1746129575.911389:0:4699:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734267776 00010000:00010000:2.0:1746129575.911403:0:15096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746129575.911421:0:4699:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734267648 00010000:00010000:2.0:1746129575.911422:0:15096:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b3bfe00/0x40a459093b06ac44 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21938 expref: -99 pid: 15096 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129575.911423:0:4699:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734267648 00000100:00100000:3.0:1746129575.911434:0:4699:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734267904 00000100:00100000:3.0:1746129575.911436:0:4699:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734267904 00000100:00100000:1.0:1746129575.911447:0:22480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16504 00000100:00100000:1.0:1746129575.911455:0:22480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ada2ffba-8920-4ecb-8068-68caa9806978+27:1963:x1830948734267776:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129575.911463:0:22480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129575.911474:0:22480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f590e00/0x40a459093b06ac4b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2192a expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129575.911521:0:22480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7da300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22480:1830948737569024:192.168.202.4@tcp:106: 00010000:00010000:2.0:1746129575.911544:0:15096:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b3be800/0x40a459093b06ac52 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129575.911556:0:15096:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b3be800/0x40a459093b06ac52 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129575.911566:0:15096:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b3be800/0x40a459093b06ac52 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129575.911578:0:15096:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b3be000/0x40a459093b06ac59 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129575.911583:0:15096:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b3be000/0x40a459093b06ac59 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129575.911587:0:15096:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b3be000/0x40a459093b06ac59 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15096 initiator: MDT0 00000100:00100000:1.0:1746129575.911601:0:22480:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0ac3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746129575.911649:0:4699:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16505 00000100:00100000:3.0:1746129575.911657:0:4699:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ada2ffba-8920-4ecb-8068-68caa9806978+19:1962:x1830948734267648:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129575.911666:0:4699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129575.911677:0:4699:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012eac2200/0x40a459093b06ac60 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21923 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129575.911690:0:4699:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129575.911691:0:4699:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129575.911692:0:15096:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95ec000/0x40a459093b06ac67 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 15096 initiator: MDT0 00010000:00010000:3.0:1746129575.911699:0:4699:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012eac2200/0x40a459093b06ac60 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21923 expref: 20 pid: 4699 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129575.911704:0:15096:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95ec000/0x40a459093b06ac67 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129575.911710:0:15096:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95ec000/0x40a459093b06ac67 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 15096 initiator: MDT0 00010000:00010000:3.0:1746129575.911711:0:4699:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012eac2200/0x40a459093b06ac60 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21923 expref: 20 pid: 4699 timeout: 0 lvb_type: 1 00000004:00200000:2.0:1746129575.911719:0:15096:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:3.0:1746129575.911721:0:4699:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012eac2200, rc 0) 00000100:00100000:3.0:1746129575.911745:0:4699:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ada2ffba-8920-4ecb-8068-68caa9806978+20:1962:x1830948734267648:12345-192.168.202.4@tcp:101:cat.0 Request processed in 90us (3065us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129575.911751:0:4699:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16505 00000100:00100000:3.0:1746129575.911766:0:4699:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16506 00000100:00100000:3.0:1746129575.911771:0:4699:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ada2ffba-8920-4ecb-8068-68caa9806978+28:1962:x1830948734267904:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129575.911777:0:4699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129575.911783:0:4699:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012eac3400/0x40a459093b06ac75 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21931 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129575.911809:0:15096:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b3be800/0x40a459093b06ac52 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15096 initiator: MDT0 00000100:00100000:3.0:1746129575.911810:0:4699:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4699:1830948737569152:192.168.202.4@tcp:106: 00010000:00010000:2.0:1746129575.911815:0:15096:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b3be800/0x40a459093b06ac52 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129575.911820:0:15096:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b3be800/0x40a459093b06ac52 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129575.911825:0:15096:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b3be800 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746129575.911828:0:15096:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b3be800/0x40a459093b06ac52 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15096 initiator: MDT0 00000100:00100000:3.0:1746129575.911831:0:4699:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa381480 going to sleep for 11 seconds 00010000:00010000:2.0:1746129575.911835:0:15096:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b3be800/0x40a459093b06ac52 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129575.911843:0:15096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880132ef8f00) 00010000:00010000:2.0:1746129575.911846:0:15096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129575.911849:0:15096:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b3be800/0x40a459093b06ac52 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129575.911854:0:15096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b3be800/0x40a459093b06ac52 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129575.911866:0:15096:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b3be000/0x40a459093b06ac59 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129575.911879:0:15096:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b3be000/0x40a459093b06ac59 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129575.911883:0:15096:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b3be000/0x40a459093b06ac59 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129575.911886:0:15096:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b3be000 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746129575.911888:0:15096:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b3be000/0x40a459093b06ac59 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129575.911892:0:15096:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b3be000/0x40a459093b06ac59 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129575.911896:0:15096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009ce7a000) 00010000:00010000:2.0:1746129575.911898:0:15096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129575.911900:0:15096:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b3be000/0x40a459093b06ac59 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129575.911905:0:15096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b3be000/0x40a459093b06ac59 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129575.911942:0:15096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b3bfe00/0x40a459093b06ac44 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21938 expref: 27 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129575.911951:0:15096:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95ec000/0x40a459093b06ac67 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21938 expref: 26 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129575.911957:0:15096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:2.0:1746129575.911963:0:15096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746129575.911965:0:15096:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a95ec000, rc 0) 00000100:00100000:2.0:1746129575.911985:0:15096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+26:32469:x1830948734268160:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 617us (3241us total) trans 8589945405 rc 0/0 00000100:00100000:2.0:1746129575.911991:0:15096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11294 00000100:00100000:0.0:1746129575.920933:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129575.921017:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129575.921046:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129575.921066:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129575.921099:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129575.921108:0:20861:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734268800 00000100:00100000:3.0:1746129575.921115:0:4699:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4699:1830948737569152:192.168.202.4@tcp:106: 00000100:00100000:2.0:1746129575.921115:0:20861:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734268800 00010000:00010000:3.0:1746129575.921152:0:4699:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012eac3400/0x40a459093b06ac75 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21931 expref: 29 pid: 4699 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746129575.921154:0:31519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734268416 00000100:00100000:1.0:1746129575.921159:0:31519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734268416 00000100:00100000:2.0:1746129575.921160:0:20861:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4807 00010000:00010000:3.0:1746129575.921167:0:4699:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012eac3400/0x40a459093b06ac75 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21931 expref: 29 pid: 4699 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746129575.921167:0:20861:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094cca850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+26:32469:x1830948734268800:12345-192.168.202.4@tcp:35:multiop.0 00010000:00010000:3.0:1746129575.921188:0:4699:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012eac3400, rc 0) 00002000:00100000:1.0:1746129575.921189:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3ef:0x0] (2097152->3145727) req@ffff8800900f7800 x1830948734268416/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:316/0 lens 488/0 e 0 to 0 dl 1746129586 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129575.921197:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800900f7800 with x1830948734268416 ext(2097152->3145727) 00002000:00010000:1.0:1746129575.921202:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800900f7800 00000100:00100000:1.0:1746129575.921213:0:31519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734269056 00000100:00100000:1.0:1746129575.921215:0:31519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734269056 00002000:00100000:1.0:1746129575.921223:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->4194303) req@ffff8800900f5880 x1830948734269056/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:316/0 lens 488/0 e 0 to 0 dl 1746129586 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129575.921228:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800900f5880 with x1830948734269056 ext(3145728->4194303) 00002000:00010000:1.0:1746129575.921230:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800900f5880 00000100:00100000:1.0:1746129575.921236:0:31519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734269312 00000100:00100000:1.0:1746129575.921238:0:31519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734269312 00000100:00100000:3.0:1746129575.921248:0:4699:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ada2ffba-8920-4ecb-8068-68caa9806978+28:1962:x1830948734267904:12345-192.168.202.4@tcp:101:cat.0 Request processed in 9476us (12479us total) trans 0 rc 301/301 00002000:00100000:1.0:1746129575.921248:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f5:0x0] (2097152->3145727) req@ffff8800900f5180 x1830948734269312/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:316/0 lens 488/0 e 0 to 0 dl 1746129586 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129575.921253:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800900f5180 with x1830948734269312 ext(2097152->3145727) 00000100:00100000:3.0:1746129575.921255:0:4699:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16506 00002000:00010000:1.0:1746129575.921255:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800900f5180 00000100:00100000:1.0:1746129575.921264:0:31519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7957 00000100:00100000:1.0:1746129575.921279:0:31519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+14:1960:x1830948734268416:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:2.0:1746129575.921377:0:20861:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094cca850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+27:32469:x1830948734268800:12345-192.168.202.4@tcp:35:multiop.0 Request processed in 209us (358us total) trans 8589945406 rc 0/0 00000100:00100000:2.0:1746129575.921382:0:20861:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4807 00000100:00100000:3.0:1746129575.921389:0:31518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7958 00000100:00100000:3.0:1746129575.921395:0:31518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+14:1960:x1830948734269056:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:2.0:1746129575.921435:0:31520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7959 00000100:00100000:2.0:1746129575.921439:0:31520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+16:1960:x1830948734269312:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:1.0:1746129575.921499:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734268928 00000100:00100000:1.0:1746129575.921502:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734268928 00000100:00100000:1.0:1746129575.921525:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 799 00000100:00100000:1.0:1746129575.921529:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+27:1962:x1830948734268928:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129575.921541:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129575.921561:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95ec000/0x40a459093b06ac67 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21938 expref: 27 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129575.921577:0:9823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:1.0:1746129575.921581:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129575.921596:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+26:1962:x1830948734268928:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 66us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129575.921601:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 799 00000100:00100000:1.0:1746129575.941462:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129575.941517:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129575.941617:0:15096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734269824 00002000:00010000:1.0:1746129575.941618:0:22480:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb atime: 1746129571 -> 1746129576 00000100:00100000:2.0:1746129575.941625:0:15096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734269824 00000100:00100000:1.0:1746129575.941642:0:22480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7da300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22480:1830948737569024:192.168.202.4@tcp:106: 00010000:00010000:1.0:1746129575.941673:0:22480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f590e00/0x40a459093b06ac4b lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2192a expref: 27 pid: 22480 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746129575.941674:0:15096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11295 00000100:00100000:2.0:1746129575.941681:0:15096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ada2ffba-8920-4ecb-8068-68caa9806978+312:32471:x1830948734269824:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:1.0:1746129575.941687:0:22480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f590e00/0x40a459093b06ac4b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2192a expref: 27 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129575.941700:0:22480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f590e00, rc 0) 00010000:00010000:2.0:1746129575.941701:0:15096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129575.941716:0:15096:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95ed600/0x40a459093b06ac7c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2193f expref: -99 pid: 15096 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129575.941741:0:22480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ada2ffba-8920-4ecb-8068-68caa9806978+26:1963:x1830948734267776:12345-192.168.202.4@tcp:101:cat.0 Request processed in 30287us (36775us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129575.941748:0:22480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16504 00010000:00010000:2.0:1746129575.941819:0:15096:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95ede00/0x40a459093b06ac83 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129575.941831:0:15096:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95ede00/0x40a459093b06ac83 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129575.941841:0:15096:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95ede00/0x40a459093b06ac83 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129575.941858:0:15096:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95ec000/0x40a459093b06ac8a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129575.941863:0:15096:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95ec000/0x40a459093b06ac8a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129575.941868:0:15096:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95ec000/0x40a459093b06ac8a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15096 initiator: MDT0 00000100:00100000:0.0:1746129575.941893:0:31523:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734269568 00000100:00100000:0.0:1746129575.941898:0:31523:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734269568 00002000:00100000:0.0:1746129575.941923:0:31523:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f5:0x0] (3145728->4194303) req@ffff88009c7db800 x1830948734269568/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:316/0 lens 504/0 e 0 to 0 dl 1746129586 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129575.941931:0:31523:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7db800 with x1830948734269568 ext(3145728->4194303) 00002000:00010000:0.0:1746129575.941936:0:31523:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c7db800 00000100:00100000:0.0:1746129575.941948:0:31523:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7960 00000100:00100000:0.0:1746129575.941953:0:31523:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+18:1960:x1830948734269568:12345-192.168.202.4@tcp:3:cat.0 00010000:00010000:2.0:1746129575.941977:0:15096:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b3bfe00/0x40a459093b06ac91 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129575.941985:0:15096:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b3bfe00/0x40a459093b06ac91 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129575.941991:0:15096:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b3bfe00/0x40a459093b06ac91 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 15096 initiator: MDT0 00000004:00200000:2.0:1746129575.941999:0:15096:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:2.0:1746129575.942073:0:15096:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95ede00/0x40a459093b06ac83 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129575.942078:0:15096:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95ede00/0x40a459093b06ac83 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129575.942083:0:15096:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95ede00/0x40a459093b06ac83 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129575.942088:0:15096:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a95ede00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746129575.942092:0:15096:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95ede00/0x40a459093b06ac83 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129575.942097:0:15096:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95ede00/0x40a459093b06ac83 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129575.942107:0:15096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880132ef8f00) 00010000:00010000:2.0:1746129575.942109:0:15096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129575.942113:0:15096:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95ede00/0x40a459093b06ac83 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129575.942117:0:15096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95ede00/0x40a459093b06ac83 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129575.942136:0:15096:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95ec000/0x40a459093b06ac8a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129575.942141:0:15096:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95ec000/0x40a459093b06ac8a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129575.942145:0:15096:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95ec000/0x40a459093b06ac8a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129575.942149:0:15096:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a95ec000 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746129575.942151:0:15096:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95ec000/0x40a459093b06ac8a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129575.942155:0:15096:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95ec000/0x40a459093b06ac8a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129575.942160:0:15096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009ce7a000) 00010000:00010000:2.0:1746129575.942162:0:15096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129575.942164:0:15096:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95ec000/0x40a459093b06ac8a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129575.942168:0:15096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95ec000/0x40a459093b06ac8a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129575.942203:0:15096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95ed600/0x40a459093b06ac7c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2193f expref: 315 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129575.942213:0:15096:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b3bfe00/0x40a459093b06ac91 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2193f expref: 314 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129575.942218:0:15096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:2.0:1746129575.942220:0:15096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746129575.942223:0:15096:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b3bfe00, rc 0) 00000100:00100000:2.0:1746129575.942243:0:15096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ada2ffba-8920-4ecb-8068-68caa9806978+314:32471:x1830948734269824:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 563us (727us total) trans 8589945407 rc 0/0 00000100:00100000:2.0:1746129575.942248:0:15096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11295 00000100:00100000:0.0:1746129575.954246:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129575.955068:0:21725:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734270080 00000100:00100000:1.0:1746129575.955081:0:21725:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734270080 00002000:00100000:1.0:1746129575.955140:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ec:0x0] (0->1048575) req@ffff8800900f4700 x1830948734270080/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:316/0 lens 488/0 e 0 to 0 dl 1746129586 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129575.955153:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800900f4700 with x1830948734270080 ext(0->1048575) 00002000:00010000:1.0:1746129575.955160:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800900f4700 00000100:00100000:1.0:1746129575.955192:0:21725:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7961 00000100:00100000:1.0:1746129575.955201:0:21725:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ada2ffba-8920-4ecb-8068-68caa9806978+20:1963:x1830948734270080:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:2.0:1746129575.957121:0:31519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+15:1960:x1830948734268416:12345-192.168.202.4@tcp:3:cat.0 Request processed in 35839us (36187us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129575.957132:0:31519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7957 00002000:00100000:2.0:1746129575.957145:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3ef:0x0] (2097152->3145727) req@ffff8800900f7800 x1830948734268416/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:316/0 lens 488/440 e 0 to 0 dl 1746129586 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129575.957153:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800900f7800 with x1830948734268416 ext(2097152->3145727) 00002000:00010000:2.0:1746129575.957159:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800900f7800 00000100:00100000:3.0:1746129575.964925:0:31518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+13:1960:x1830948734269056:12345-192.168.202.4@tcp:3:cat.0 Request processed in 43516us (43864us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129575.964938:0:31518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7958 00002000:00100000:3.0:1746129575.964950:0:31518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->4194303) req@ffff8800900f5880 x1830948734269056/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:316/0 lens 488/440 e 0 to 0 dl 1746129586 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129575.964960:0:31518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800900f5880 with x1830948734269056 ext(3145728->4194303) 00002000:00010000:3.0:1746129575.964966:0:31518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800900f5880 00000100:00100000:3.0:1746129575.970158:0:31520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+18:1960:x1830948734269312:12345-192.168.202.4@tcp:3:cat.0 Request processed in 48703us (49044us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129575.970172:0:31520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7959 00002000:00100000:3.0:1746129575.970184:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3f5:0x0] (2097152->3145727) req@ffff8800900f5180 x1830948734269312/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:316/0 lens 488/440 e 0 to 0 dl 1746129586 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129575.970193:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800900f5180 with x1830948734269312 ext(2097152->3145727) 00002000:00010000:3.0:1746129575.970199:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800900f5180 00000100:00100000:0.0:1746129575.975820:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129575.976709:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734270208 00000100:00100000:1.0:1746129575.976719:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734270208 00000100:00100000:1.0:1746129575.976782:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 800 00000100:00100000:1.0:1746129575.976790:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ada2ffba-8920-4ecb-8068-68caa9806978+314:1960:x1830948734270208:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129575.976804:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129575.976829:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b3bfe00/0x40a459093b06ac91 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2193f expref: 314 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129575.976849:0:7085:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:1.0:1746129575.976854:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129575.976893:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ada2ffba-8920-4ecb-8068-68caa9806978+313:1960:x1830948734270208:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 104us (1086us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129575.976900:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 800 00000100:00100000:2.0:1746129575.979060:0:31523:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+16:1960:x1830948734269568:12345-192.168.202.4@tcp:3:cat.0 Request processed in 37092us (37597us total) trans 0 rc 872448/872448 00000100:00100000:2.0:1746129575.979073:0:31523:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7960 00002000:00100000:2.0:1746129575.979088:0:31523:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f5:0x0] (3145728->4194303) req@ffff88009c7db800 x1830948734269568/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:316/0 lens 504/440 e 0 to 0 dl 1746129586 ref 1 fl Complete:/200/0 rc 872448/872448 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129575.979098:0:31523:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7db800 with x1830948734269568 ext(3145728->4194303) 00002000:00010000:2.0:1746129575.979104:0:31523:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c7db800 00000100:00100000:1.0:1746129575.991992:0:21725:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ada2ffba-8920-4ecb-8068-68caa9806978+20:1963:x1830948734270080:12345-192.168.202.4@tcp:3:cat.0 Request processed in 36780us (37746us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129575.992004:0:21725:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7961 00002000:00100000:1.0:1746129575.992017:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ec:0x0] (0->1048575) req@ffff8800900f4700 x1830948734270080/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:316/0 lens 488/440 e 0 to 0 dl 1746129586 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129575.992026:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800900f4700 with x1830948734270080 ext(0->1048575) 00002000:00010000:1.0:1746129575.992033:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800900f4700 00000100:00100000:0.0:1746129576.006763:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129576.006848:0:22480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734270336 00000100:00100000:1.0:1746129576.006858:0:22480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734270336 00000100:00100000:1.0:1746129576.006917:0:22480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16507 00000100:00100000:1.0:1746129576.006925:0:22480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ada2ffba-8920-4ecb-8068-68caa9806978+26:32467:x1830948734270336:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129576.006946:0:22480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129576.006965:0:22480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ff44e00/0x40a459093b06ac9f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21946 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129576.006997:0:22480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009cfd7000/0x40a459093b06abe9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1200128->1462271) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21900 expref: 15 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129576.007005:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129576.007007:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129576.007010:0:22480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ff44e00/0x40a459093b06ac9f lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21946 expref: 27 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129576.007045:0:22480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009cfd7000/0x40a459093b06abe9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1200128->1462271) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21900 expref: 15 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129576.007058:0:22480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009cfd7000/0x40a459093b06abe9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1200128->1462271) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21900 expref: 15 pid: 4699 timeout: 931 lvb_type: 0 00000100:00100000:1.0:1746129576.007070:0:22480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7da300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22480:1830948737569280:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129576.007173:0:22480:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0ac3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746129576.015195:0:22480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7da300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22480:1830948737569280:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129576.015232:0:22480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012ff44e00/0x40a459093b06ac9f lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21946 expref: 27 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129576.015257:0:22480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ff44e00, rc 0) 00000100:00100000:1.0:1746129576.015339:0:22480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ada2ffba-8920-4ecb-8068-68caa9806978+27:32467:x1830948734270336:12345-192.168.202.4@tcp:101:cat.0 Request processed in 8412us (8585us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129576.015350:0:22480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16507 00000100:00100000:2.0:1746129576.015588:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129576.025410:0:21725:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734270464 00000100:00100000:1.0:1746129576.025427:0:21725:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734270464 00002000:00100000:1.0:1746129576.025512:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f3:0x0] (1200128->1462271) req@ffff88013577f100 x1830948734270464/t0(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:317/0 lens 488/0 e 0 to 0 dl 1746129587 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129576.025523:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013577f100 with x1830948734270464 ext(1200128->1462271) 00010000:00010000:1.0:1746129576.025533:0:21725:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009cfd7000/0x40a459093b06abe9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1200128->1462271) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21900 expref: 16 pid: 4699 timeout: 931 lvb_type: 0 00010000:00010000:1.0:1746129576.025548:0:21725:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009cfd7000/0x40a459093b06abe9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1200128->1462271) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21900 expref: 16 pid: 4699 timeout: 931 lvb_type: 0 00002000:00010000:1.0:1746129576.025556:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88013577f100 00000100:00100000:1.0:1746129576.025581:0:21725:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2468 00000100:00100000:1.0:1746129576.025589:0:21725:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013577f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+16:1962:x1830948734270464:12345-192.168.202.4@tcp:4:cat.0 00000100:00080000:0.0:1746129576.026348:0:7097:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746129576.034146:0:21725:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013577f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+18:1962:x1830948734270464:12345-192.168.202.4@tcp:4:cat.0 Request processed in 8544us (18547us total) trans 17179874153 rc 0/0 00000100:00100000:1.0:1746129576.034159:0:21725:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2468 00002000:00100000:1.0:1746129576.034171:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f3:0x0] (1200128->1462271) req@ffff88013577f100 x1830948734270464/t17179874153(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:317/0 lens 488/448 e 0 to 0 dl 1746129587 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129576.034188:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013577f100 with x1830948734270464 ext(1200128->1462271) 00010000:00010000:1.0:1746129576.034198:0:21725:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009cfd7000/0x40a459093b06abe9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1200128->1462271) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21900 expref: 18 pid: 4699 timeout: 931 lvb_type: 0 00010000:00010000:1.0:1746129576.034212:0:21725:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009cfd7000/0x40a459093b06abe9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1200128->1462271) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21900 expref: 18 pid: 4699 timeout: 931 lvb_type: 0 00002000:00010000:1.0:1746129576.034219:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88013577f100 00000100:00100000:0.0:1746129576.036438:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129576.036522:0:22480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734270592 00000100:00100000:1.0:1746129576.036531:0:22480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734270592 00000100:00100000:1.0:1746129576.038308:0:22480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16508 00000100:00100000:1.0:1746129576.038326:0:22480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e954000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ada2ffba-8920-4ecb-8068-68caa9806978+27:32471:x1830948734270592:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:1.0:1746129576.038348:0:22480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129576.038369:0:22480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ff45c00/0x40a459093b06aca6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2194d expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129576.038401:0:22480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009487fe00/0x40a459093b06abb1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3612672->3788799) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f218d6 expref: 17 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129576.038408:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129576.038410:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129576.038413:0:22480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ff45c00/0x40a459093b06aca6 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [3641344->4075519] (req 3641344->4075519) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2194d expref: 28 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129576.038444:0:22480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009487fe00/0x40a459093b06abb1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3612672->3788799) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f218d6 expref: 17 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129576.038461:0:22480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009487fe00/0x40a459093b06abb1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3612672->3788799) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f218d6 expref: 17 pid: 4699 timeout: 931 lvb_type: 0 00000100:00100000:1.0:1746129576.038472:0:22480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7da300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22480:1830948737569408:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129576.038571:0:22480:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0ac3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129576.040533:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129576.040577:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734270720 00000100:00100000:2.0:1746129576.040586:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734270720 00010000:00010000:2.0:1746129576.040624:0:9823:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009cfd7000/0x40a459093b06abe9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1200128->1462271) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21900 expref: 18 pid: 4699 timeout: 931 lvb_type: 0 00000100:00100000:2.0:1746129576.040656:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8498 00000100:00100000:2.0:1746129576.040663:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e957b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+18:1961:x1830948734270720:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129576.040677:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129576.040700:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009cfd7000/0x40a459093b06abe9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1200128->1462271) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21900 expref: 18 pid: 4699 timeout: 931 lvb_type: 0 00010000:00010000:2.0:1746129576.040711:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009cfd7000/0x40a459093b06abe9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1200128->1462271) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21900 expref: 18 pid: 4699 timeout: 931 lvb_type: 0 00010000:00010000:2.0:1746129576.040733:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cfd7000/0x40a459093b06abe9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1200128->1462271) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21900 expref: 18 pid: 4699 timeout: 931 lvb_type: 0 00010000:00010000:2.0:1746129576.040762:0:9823:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129576.040764:0:9823:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129576.040772:0:9823:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ff44e00/0x40a459093b06ac9f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21946 expref: 28 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129576.040779:0:9823:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ff44e00/0x40a459093b06ac9f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21946 expref: 28 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129576.040810:0:9823:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012ff44e00/0x40a459093b06ac9f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21946 expref: 28 pid: 22480 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129576.040825:0:9823:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e389180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9823:1830948737569536:192.168.202.4@tcp:105: 00000100:00100000:2.0:1746129576.040882:0:9823:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132f360c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746129576.041128:0:22480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7da300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22480:1830948737569408:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129576.041148:0:22480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012ff45c00/0x40a459093b06aca6 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [3641344->4075519] (req 3641344->4075519) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2194d expref: 28 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129576.041159:0:22480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ff45c00, rc 0) 00000100:00100000:1.0:1746129576.041197:0:22480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e954000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ada2ffba-8920-4ecb-8068-68caa9806978+28:32471:x1830948734270592:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 2877us (4768us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129576.041204:0:22480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16508 00000100:00100000:0.0:1746129576.054191:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129576.054241:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129576.054403:0:9823:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e389180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9823:1830948737569536:192.168.202.4@tcp:105: 00010000:00010000:2.0:1746129576.054432:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129576.054487:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e957b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+17:1961:x1830948734270720:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 13822us (13958us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129576.054500:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8498 00000100:00100000:3.0:1746129576.055192:0:31523:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734270976 00000100:00100000:3.0:1746129576.055201:0:31523:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734270976 00002000:00100000:3.0:1746129576.055248:0:31523:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff88009f95b480 x1830948734270976/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:317/0 lens 488/0 e 0 to 0 dl 1746129587 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129576.055257:0:31523:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f95b480 with x1830948734270976 ext(1048576->2097151) 00002000:00010000:3.0:1746129576.055263:0:31523:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f95b480 00000100:00100000:3.0:1746129576.055307:0:31523:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734271360 00000100:00100000:3.0:1746129576.055311:0:31523:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734271360 00002000:00100000:3.0:1746129576.055326:0:31523:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f4:0x0] (1048576->2097151) req@ffff88009f958700 x1830948734271360/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:317/0 lens 488/0 e 0 to 0 dl 1746129587 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129576.055333:0:31523:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f958700 with x1830948734271360 ext(1048576->2097151) 00002000:00010000:3.0:1746129576.055337:0:31523:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f958700 00000100:00100000:3.0:1746129576.055351:0:31523:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7962 00000100:00100000:3.0:1746129576.055360:0:31523:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f95b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ada2ffba-8920-4ecb-8068-68caa9806978+29:1960:x1830948734270976:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:0.0:1746129576.060436:0:31520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7963 00000100:00100000:0.0:1746129576.060459:0:31520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f958700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ada2ffba-8920-4ecb-8068-68caa9806978+30:1960:x1830948734271360:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:2.0:1746129576.069819:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129576.070864:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129576.071583:0:21725:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734271488 00000100:00100000:2.0:1746129576.071593:0:21725:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734271488 00002000:00100000:2.0:1746129576.071638:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ee:0x0] (1048576->2097151) req@ffff88012e389180 x1830948734271488/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:317/0 lens 488/0 e 0 to 0 dl 1746129587 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129576.071649:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e389180 with x1830948734271488 ext(1048576->2097151) 00002000:00010000:2.0:1746129576.071655:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e389180 00000100:00100000:2.0:1746129576.071670:0:21725:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734271616 00000100:00100000:2.0:1746129576.071672:0:21725:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734271616 00002000:00100000:2.0:1746129576.071681:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f5:0x0] (3612672->3788799) req@ffff880094028700 x1830948734271616/t0(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:317/0 lens 488/0 e 0 to 0 dl 1746129587 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129576.071688:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094028700 with x1830948734271616 ext(3612672->3788799) 00010000:00010000:2.0:1746129576.071696:0:21725:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009487fe00/0x40a459093b06abb1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3612672->3788799) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f218d6 expref: 17 pid: 4699 timeout: 931 lvb_type: 0 00010000:00010000:2.0:1746129576.071710:0:21725:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009487fe00/0x40a459093b06abb1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3612672->3788799) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f218d6 expref: 17 pid: 4699 timeout: 931 lvb_type: 0 00002000:00010000:2.0:1746129576.071718:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094028700 00000100:00100000:2.0:1746129576.071745:0:21725:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2469 00000100:00100000:2.0:1746129576.071753:0:21725:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094028700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+17:1963:x1830948734271616:12345-192.168.202.4@tcp:4:cat.0 00000100:00100000:2.0:1746129576.072018:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7964 00000100:00100000:2.0:1746129576.072023:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e389180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+20:1960:x1830948734271488:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:2.0:1746129576.088902:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129576.089721:0:22480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734271744 00000100:00100000:0.0:1746129576.089731:0:22480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734271744 00000100:00100000:0.0:1746129576.090056:0:22480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16509 00000100:00100000:0.0:1746129576.090066:0:22480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009402bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+19:32469:x1830948734271744:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:0.0:1746129576.090086:0:22480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129576.090105:0:22480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a6ca1e00/0x40a459093b06acad lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21954 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129576.090744:0:22480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ff44e00/0x40a459093b06ac9f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21946 expref: 31 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129576.090754:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129576.090756:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129576.090760:0:22480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6ca1e00/0x40a459093b06acad lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1679360->2097151] (req 1679360->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21954 expref: 21 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129576.090795:0:22480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012ff44e00/0x40a459093b06ac9f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21946 expref: 31 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129576.090809:0:22480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012ff44e00/0x40a459093b06ac9f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21946 expref: 31 pid: 22480 timeout: 931 lvb_type: 0 00000100:00100000:2.0:1746129576.090813:0:21725:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094028700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:1963:x1830948734271616:12345-192.168.202.4@tcp:4:cat.0 Request processed in 19056us (19951us total) trans 17179874154 rc 0/0 00000100:00100000:0.0:1746129576.090821:0:22480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f959c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22480:1830948737569664:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129576.090825:0:21725:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2469 00002000:00100000:2.0:1746129576.090835:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f5:0x0] (3612672->3788799) req@ffff880094028700 x1830948734271616/t17179874154(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:317/0 lens 488/448 e 0 to 0 dl 1746129587 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129576.090844:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094028700 with x1830948734271616 ext(3612672->3788799) 00010000:00010000:2.0:1746129576.090853:0:21725:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009487fe00/0x40a459093b06abb1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3612672->3788799) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f218d6 expref: 21 pid: 4699 timeout: 931 lvb_type: 0 00010000:00010000:2.0:1746129576.090864:0:21725:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009487fe00/0x40a459093b06abb1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3612672->3788799) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f218d6 expref: 21 pid: 4699 timeout: 931 lvb_type: 0 00002000:00010000:2.0:1746129576.090871:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094028700 00000100:00100000:0.0:1746129576.090898:0:22480:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a6dc8300 going to sleep for 11 seconds 00000100:00100000:2.0:1746129576.095730:0:31520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f958700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ada2ffba-8920-4ecb-8068-68caa9806978+30:1960:x1830948734271360:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 35268us (41476us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129576.095743:0:31520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7963 00002000:00100000:2.0:1746129576.095754:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3f4:0x0] (1048576->2097151) req@ffff88009f958700 x1830948734271360/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:317/0 lens 488/440 e 0 to 0 dl 1746129587 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129576.095765:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f958700 with x1830948734271360 ext(1048576->2097151) 00002000:00010000:2.0:1746129576.095772:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f958700 00000100:00100000:2.0:1746129576.098326:0:22480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f959c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22480:1830948737569664:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129576.098361:0:22480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a6ca1e00/0x40a459093b06acad lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1679360->2097151] (req 1679360->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21954 expref: 20 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129576.098380:0:22480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6ca1e00, rc 0) 00000100:00100000:2.0:1746129576.098426:0:22480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009402bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:32469:x1830948734271744:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 8361us (9535us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129576.098435:0:22480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16509 00000100:00100000:3.0:1746129576.099401:0:31523:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f95b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ada2ffba-8920-4ecb-8068-68caa9806978+28:1960:x1830948734270976:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 44037us (45218us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129576.099413:0:31523:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7962 00002000:00100000:3.0:1746129576.099430:0:31523:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff88009f95b480 x1830948734270976/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:317/0 lens 488/440 e 0 to 0 dl 1746129587 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129576.099447:0:31523:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f95b480 with x1830948734270976 ext(1048576->2097151) 00010000:00010000:3.0:1746129576.099457:0:31523:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012ff44e00/0x40a459093b06ac9f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21946 expref: 28 pid: 22480 timeout: 931 lvb_type: 0 00010000:00010000:3.0:1746129576.099470:0:31523:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012ff44e00/0x40a459093b06ac9f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21946 expref: 28 pid: 22480 timeout: 931 lvb_type: 0 00002000:00010000:3.0:1746129576.099478:0:31523:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f95b480 00000100:00100000:0.0:1746129576.100054:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129576.100340:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734271872 00000100:00100000:2.0:1746129576.100348:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734271872 00010000:00010000:2.0:1746129576.100380:0:9823:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009487fe00/0x40a459093b06abb1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3612672->3788799) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f218d6 expref: 20 pid: 4699 timeout: 931 lvb_type: 0 00000100:00100000:2.0:1746129576.100416:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8499 00000100:00100000:2.0:1746129576.100423:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f95bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:1962:x1830948734271872:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129576.100436:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129576.100457:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009487fe00/0x40a459093b06abb1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3612672->3788799) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f218d6 expref: 20 pid: 4699 timeout: 931 lvb_type: 0 00010000:00010000:2.0:1746129576.100469:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009487fe00/0x40a459093b06abb1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3612672->3788799) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f218d6 expref: 20 pid: 4699 timeout: 931 lvb_type: 0 00010000:00010000:2.0:1746129576.100494:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009487fe00/0x40a459093b06abb1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3612672->3788799) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f218d6 expref: 20 pid: 4699 timeout: 931 lvb_type: 0 00010000:00010000:2.0:1746129576.100514:0:9823:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129576.100516:0:9823:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129576.100523:0:9823:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ff45c00/0x40a459093b06aca6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3641344->4075519) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2194d expref: 27 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129576.100533:0:9823:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ff45c00/0x40a459093b06aca6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3641344->4075519) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2194d expref: 27 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129576.100569:0:9823:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012ff45c00/0x40a459093b06aca6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3641344->4075519) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2194d expref: 27 pid: 22480 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129576.100582:0:9823:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f449180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9823:1830948737569792:192.168.202.4@tcp:105: 00000100:00100000:2.0:1746129576.100657:0:9823:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132f360c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746129576.101421:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e389180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+20:1960:x1830948734271488:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 29395us (31610us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129576.101431:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7964 00002000:00100000:3.0:1746129576.101440:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ee:0x0] (1048576->2097151) req@ffff88012e389180 x1830948734271488/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:317/0 lens 488/440 e 0 to 0 dl 1746129587 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129576.101450:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e389180 with x1830948734271488 ext(1048576->2097151) 00002000:00010000:3.0:1746129576.101454:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e389180 00000100:00100000:3.0:1746129576.102356:0:9823:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f449180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9823:1830948737569792:192.168.202.4@tcp:105: 00010000:00010000:3.0:1746129576.102383:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129576.102467:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f95bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+19:1962:x1830948734271872:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 2043us (2413us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129576.102476:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8499 00000100:00100000:0.0:1746129576.105027:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129576.105086:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129576.105163:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734272256 00000100:00100000:2.0:1746129576.105172:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734272256 00002000:00100000:2.0:1746129576.105224:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f5:0x0] (3641344->3645439) req@ffff88009f95ad80 x1830948734272256/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:317/0 lens 488/0 e 0 to 0 dl 1746129587 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129576.105236:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f95ad80 with x1830948734272256 ext(3641344->3645439) 00002000:00010000:2.0:1746129576.105242:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f95ad80 00000100:00100000:2.0:1746129576.105286:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7965 00000100:00100000:2.0:1746129576.105310:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f95ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+28:1962:x1830948734272256:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:2.0:1746129576.105508:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f95ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+28:1962:x1830948734272256:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 214us (421us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129576.105514:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7965 00000100:00100000:3.0:1746129576.105515:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734272000 00000100:00100000:3.0:1746129576.105520:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734272000 00002000:00100000:2.0:1746129576.105521:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f5:0x0] (3641344->3645439) req@ffff88009f95ad80 x1830948734272256/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:317/0 lens 488/4536 e 0 to 0 dl 1746129587 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129576.105528:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f95ad80 with x1830948734272256 ext(3641344->3645439) 00002000:00010000:2.0:1746129576.105531:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f95ad80 00010000:00010000:3.0:1746129576.105542:0:9823:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012ff44e00/0x40a459093b06ac9f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21946 expref: 28 pid: 22480 timeout: 931 lvb_type: 0 00000100:00100000:3.0:1746129576.105578:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8500 00000100:00100000:3.0:1746129576.105584:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6fd0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ada2ffba-8920-4ecb-8068-68caa9806978+28:1962:x1830948734272000:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129576.105594:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129576.105611:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012ff44e00/0x40a459093b06ac9f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21946 expref: 28 pid: 22480 timeout: 931 lvb_type: 0 00010000:00010000:3.0:1746129576.105622:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012ff44e00/0x40a459093b06ac9f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21946 expref: 28 pid: 22480 timeout: 931 lvb_type: 0 00010000:00010000:3.0:1746129576.105643:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ff44e00/0x40a459093b06ac9f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21946 expref: 28 pid: 22480 timeout: 931 lvb_type: 0 00010000:00010000:3.0:1746129576.105671:0:9823:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129576.105673:0:9823:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129576.105681:0:9823:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a6ca1e00/0x40a459093b06acad lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1679360->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21954 expref: 18 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129576.105689:0:9823:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6ca1e00/0x40a459093b06acad lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1679360->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21954 expref: 18 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129576.105720:0:9823:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a6ca1e00/0x40a459093b06acad lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1679360->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21954 expref: 18 pid: 22480 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129576.105732:0:9823:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bc700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9823:1830948737569920:192.168.202.4@tcp:105: 00000100:00100000:3.0:1746129576.106362:0:9823:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa381480 going to sleep for 11 seconds 00000100:00100000:0.0:1746129576.110327:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129576.110824:0:31523:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734272512 00000100:00100000:2.0:1746129576.110834:0:31523:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734272512 00002000:00100000:2.0:1746129576.110883:0:31523:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f5:0x0] (4071424->4075519) req@ffff88009f95b800 x1830948734272512/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:317/0 lens 488/0 e 0 to 0 dl 1746129587 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129576.110893:0:31523:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f95b800 with x1830948734272512 ext(4071424->4075519) 00002000:00010000:2.0:1746129576.110899:0:31523:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f95b800 00000100:00100000:2.0:1746129576.110929:0:31523:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7966 00000100:00100000:2.0:1746129576.110937:0:31523:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f95b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ada2ffba-8920-4ecb-8068-68caa9806978+28:1962:x1830948734272512:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:2.0:1746129576.113012:0:31523:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f95b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ada2ffba-8920-4ecb-8068-68caa9806978+28:1962:x1830948734272512:12345-192.168.202.4@tcp:3:cat.0 Request processed in 2064us (2683us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129576.113024:0:31523:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7966 00002000:00100000:2.0:1746129576.113033:0:31523:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f5:0x0] (4071424->4075519) req@ffff88009f95b800 x1830948734272512/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:317/0 lens 488/4536 e 0 to 0 dl 1746129587 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129576.113042:0:31523:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f95b800 with x1830948734272512 ext(4071424->4075519) 00002000:00010000:2.0:1746129576.113047:0:31523:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f95b800 00000100:00100000:1.0:1746129576.113342:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129576.113395:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129576.113414:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129576.113447:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129576.113463:0:21725:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734272768 00000100:00100000:1.0:1746129576.113470:0:21725:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734272768 00002000:00100000:1.0:1746129576.113503:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ef:0x0] (2097152->3145727) req@ffff88009c7da300 x1830948734272768/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:317/0 lens 488/0 e 0 to 0 dl 1746129587 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129576.113509:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7da300 with x1830948734272768 ext(2097152->3145727) 00002000:00010000:1.0:1746129576.113514:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c7da300 00000100:00100000:1.0:1746129576.113524:0:21725:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734273024 00000100:00100000:1.0:1746129576.113526:0:21725:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734273024 00002000:00100000:1.0:1746129576.113535:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f5:0x0] (2097152->3145727) req@ffff880094efea00 x1830948734273024/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:317/0 lens 488/0 e 0 to 0 dl 1746129587 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129576.113541:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094efea00 with x1830948734273024 ext(2097152->3145727) 00002000:00010000:1.0:1746129576.113543:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094efea00 00000100:00100000:1.0:1746129576.113549:0:21725:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734273280 00000100:00100000:1.0:1746129576.113551:0:21725:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734273280 00002000:00100000:1.0:1746129576.113557:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f5:0x0] (3145728->3641343) req@ffff880094efe300 x1830948734273280/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:317/0 lens 488/0 e 0 to 0 dl 1746129587 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129576.113563:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094efe300 with x1830948734273280 ext(3145728->3641343) 00002000:00010000:1.0:1746129576.113565:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094efe300 00000100:00100000:1.0:1746129576.113572:0:21725:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734273536 00000100:00100000:1.0:1746129576.113574:0:21725:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734273536 00002000:00100000:1.0:1746129576.113584:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f3:0x0] (1679360->1683455) req@ffff880094efed80 x1830948734273536/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:317/0 lens 488/0 e 0 to 0 dl 1746129587 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129576.113589:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094efed80 with x1830948734273536 ext(1679360->1683455) 00002000:00010000:1.0:1746129576.113592:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094efed80 00000100:00100000:1.0:1746129576.113600:0:21725:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7967 00000100:00100000:1.0:1746129576.113605:0:21725:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ada2ffba-8920-4ecb-8068-68caa9806978+20:1962:x1830948734272768:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:3.0:1746129576.113906:0:31519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7968 00000100:00100000:3.0:1746129576.113914:0:31519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094efea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ada2ffba-8920-4ecb-8068-68caa9806978+29:1962:x1830948734273024:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129576.114091:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7969 00000100:00100000:0.0:1746129576.114098:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094efe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+29:1962:x1830948734273280:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:2.0:1746129576.114171:0:31520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7970 00000100:00100000:2.0:1746129576.114179:0:31520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094efed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+19:1962:x1830948734273536:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:3.0:1746129576.114563:0:9823:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bc700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9823:1830948737569920:192.168.202.4@tcp:105: 00010000:00010000:3.0:1746129576.114583:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129576.114627:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6fd0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ada2ffba-8920-4ecb-8068-68caa9806978+29:1962:x1830948734272000:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 9042us (9611us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129576.114634:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8500 00000100:00100000:2.0:1746129576.115859:0:31520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094efed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+19:1962:x1830948734273536:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 1678us (2407us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129576.115867:0:31520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7970 00002000:00100000:2.0:1746129576.115875:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3f3:0x0] (1679360->1683455) req@ffff880094efed80 x1830948734273536/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:317/0 lens 488/4536 e 0 to 0 dl 1746129587 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129576.115882:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094efed80 with x1830948734273536 ext(1679360->1683455) 00002000:00010000:2.0:1746129576.115888:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094efed80 00000100:00100000:0.0:1746129576.122874:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129576.123283:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094efe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+29:1962:x1830948734273280:12345-192.168.202.4@tcp:3:cat.0 Request processed in 9182us (9863us total) trans 0 rc 495616/495616 00000100:00100000:0.0:1746129576.123314:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7969 00002000:00100000:0.0:1746129576.123329:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f5:0x0] (3145728->3641343) req@ffff880094efe300 x1830948734273280/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:317/0 lens 488/440 e 0 to 0 dl 1746129587 ref 1 fl Complete:/200/0 rc 495616/495616 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129576.123338:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094efe300 with x1830948734273280 ext(3145728->3641343) 00002000:00010000:0.0:1746129576.123345:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094efe300 00000100:00100000:2.0:1746129576.123508:0:20861:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734273792 00000100:00100000:2.0:1746129576.123517:0:20861:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734273792 00000100:00100000:2.0:1746129576.123573:0:20861:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4808 00000100:00100000:2.0:1746129576.123580:0:20861:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f95bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:ada2ffba-8920-4ecb-8068-68caa9806978+313:32471:x1830948734273792:12345-192.168.202.4@tcp:35:multiop.0 00000100:00100000:2.0:1746129576.123770:0:20861:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f95bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:ada2ffba-8920-4ecb-8068-68caa9806978+314:32471:x1830948734273792:12345-192.168.202.4@tcp:35:multiop.0 Request processed in 190us (907us total) trans 8589945408 rc 0/0 00000100:00100000:2.0:1746129576.123776:0:20861:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4808 00000100:00100000:0.0:1746129576.127334:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129576.128378:0:22480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734273920 00000100:00100000:2.0:1746129576.128389:0:22480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734273920 00000100:00100000:2.0:1746129576.128452:0:22480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16510 00000100:00100000:2.0:1746129576.128460:0:22480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f959c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+19:32469:x1830948734273920:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:2.0:1746129576.128479:0:22480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129576.128498:0:22480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ee1b200/0x40a459093b06acb4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2195b expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129576.128530:0:22480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009487e200/0x40a459093b06ab56 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21897 expref: 20 pid: 8411 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129576.128540:0:22480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f590a00/0x40a459093b06ab9c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f218c8 expref: 28 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129576.128547:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129576.128549:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129576.128552:0:22480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ee1b200/0x40a459093b06acb4 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [1048576->1257471] (req 1048576->1257471) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2195b expref: 20 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129576.128583:0:22480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f590a00/0x40a459093b06ab9c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f218c8 expref: 28 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129576.128595:0:22480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f590a00/0x40a459093b06ab9c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f218c8 expref: 28 pid: 22481 timeout: 931 lvb_type: 1 00000100:00100000:2.0:1746129576.128608:0:22480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f44b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22480:1830948737570048:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129576.128708:0:22480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009487e200/0x40a459093b06ab56 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21897 expref: 20 pid: 8411 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129576.128717:0:22480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009487e200/0x40a459093b06ab56 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21897 expref: 20 pid: 8411 timeout: 931 lvb_type: 1 00000100:00100000:2.0:1746129576.128725:0:22480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f449880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22480:1830948737570176:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129576.128745:0:22480:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132f36d80 going to sleep for 11 seconds 00000100:00100000:3.0:1746129576.133760:0:31519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094efea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ada2ffba-8920-4ecb-8068-68caa9806978+27:1962:x1830948734273024:12345-192.168.202.4@tcp:3:cat.0 Request processed in 19835us (20351us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129576.133771:0:31519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7968 00002000:00100000:3.0:1746129576.133783:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f5:0x0] (2097152->3145727) req@ffff880094efea00 x1830948734273024/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:317/0 lens 488/440 e 0 to 0 dl 1746129587 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129576.133792:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094efea00 with x1830948734273024 ext(2097152->3145727) 00002000:00010000:3.0:1746129576.133798:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094efea00 00000100:00100000:0.0:1746129576.135585:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129576.135726:0:22480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f44b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22480:1830948737570048:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129576.135738:0:22480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f449880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22480:1830948737570176:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129576.135769:0:22480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ee1b200/0x40a459093b06acb4 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [1048576->1257471] (req 1048576->1257471) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2195b expref: 20 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129576.135786:0:22480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ee1b200, rc 0) 00000100:00100000:2.0:1746129576.135842:0:22480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f959c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:32469:x1830948734273920:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 7381us (8549us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129576.135851:0:22480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16510 00000100:00100000:3.0:1746129576.136129:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734274048 00000100:00100000:3.0:1746129576.136137:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734274048 00010000:00010000:3.0:1746129576.136171:0:9823:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f590a00/0x40a459093b06ab9c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f218c8 expref: 27 pid: 22481 timeout: 931 lvb_type: 1 00000100:00100000:3.0:1746129576.136209:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8501 00000100:00100000:3.0:1746129576.136215:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baed880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ada2ffba-8920-4ecb-8068-68caa9806978+27:1962:x1830948734274048:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129576.136228:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129576.136253:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f590a00/0x40a459093b06ab9c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f218c8 expref: 27 pid: 22481 timeout: 931 lvb_type: 1 00010000:00010000:3.0:1746129576.136276:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f590a00/0x40a459093b06ab9c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f218c8 expref: 27 pid: 22481 timeout: 931 lvb_type: 1 00010000:00010000:3.0:1746129576.136330:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f590a00/0x40a459093b06ab9c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f218c8 expref: 27 pid: 22481 timeout: 931 lvb_type: 1 00010000:00010000:3.0:1746129576.136345:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129576.137376:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baed880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ada2ffba-8920-4ecb-8068-68caa9806978+26:1962:x1830948734274048:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 1152us (1790us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129576.137385:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8501 00000100:00100000:0.0:1746129576.138815:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129576.138899:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734274176 00000100:00100000:3.0:1746129576.138908:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734274176 00010000:00010000:3.0:1746129576.138939:0:9823:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009487e200/0x40a459093b06ab56 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21897 expref: 20 pid: 8411 timeout: 931 lvb_type: 1 00000100:00100000:3.0:1746129576.138979:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8502 00000100:00100000:3.0:1746129576.138986:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baedf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:1960:x1830948734274176:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129576.139001:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129576.139020:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009487e200/0x40a459093b06ab56 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21897 expref: 20 pid: 8411 timeout: 931 lvb_type: 1 00010000:00010000:3.0:1746129576.139031:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009487e200/0x40a459093b06ab56 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21897 expref: 20 pid: 8411 timeout: 931 lvb_type: 1 00010000:00010000:3.0:1746129576.139053:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009487e200/0x40a459093b06ab56 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21897 expref: 20 pid: 8411 timeout: 931 lvb_type: 1 00010000:00010000:3.0:1746129576.139068:0:9823:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129576.139069:0:9823:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129576.139076:0:9823:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ee1b200/0x40a459093b06acb4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1257471) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2195b expref: 19 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129576.139084:0:9823:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ee1b200/0x40a459093b06acb4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1257471) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2195b expref: 19 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129576.139115:0:9823:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ee1b200/0x40a459093b06acb4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1257471) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2195b expref: 19 pid: 22480 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129576.139126:0:9823:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bc700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9823:1830948737570304:192.168.202.4@tcp:105: 00000100:00100000:3.0:1746129576.139207:0:9823:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa381a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746129576.139814:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129576.140503:0:15096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734274432 00000100:00100000:2.0:1746129576.140508:0:15096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734274432 00000100:00100000:2.0:1746129576.140564:0:15096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11296 00000100:00100000:2.0:1746129576.140573:0:15096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+26:32475:x1830948734274432:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129576.140594:0:15096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129576.140610:0:15096:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1ae00/0x40a459093b06acbb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21962 expref: -99 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129576.140715:0:15096:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1a800/0x40a459093b06acc2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129576.140727:0:15096:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1a800/0x40a459093b06acc2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129576.140736:0:15096:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1a800/0x40a459093b06acc2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15096 initiator: MDT0 00000100:00080000:0.0:1746129576.140849:0:7097:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746129576.141807:0:21725:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ada2ffba-8920-4ecb-8068-68caa9806978+20:1962:x1830948734272768:12345-192.168.202.4@tcp:3:cat.0 Request processed in 28198us (28463us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129576.141817:0:21725:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7967 00002000:00100000:1.0:1746129576.141827:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ef:0x0] (2097152->3145727) req@ffff88009c7da300 x1830948734272768/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:317/0 lens 488/440 e 0 to 0 dl 1746129587 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129576.141837:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7da300 with x1830948734272768 ext(2097152->3145727) 00002000:00010000:1.0:1746129576.141845:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c7da300 00000100:00100000:3.0:1746129576.141957:0:9823:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bc700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9823:1830948737570304:192.168.202.4@tcp:105: 00010000:00010000:3.0:1746129576.141977:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129576.141997:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baedf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+19:1960:x1830948734274176:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 3011us (3189us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129576.142004:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8502 00010000:00010000:2.0:1746129576.142371:0:15096:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1b400/0x40a459093b06acc9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129576.142382:0:15096:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1b400/0x40a459093b06acc9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129576.142390:0:15096:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1b400/0x40a459093b06acc9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129576.142516:0:15096:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1a600/0x40a459093b06acd0 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129576.142525:0:15096:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1a600/0x40a459093b06acd0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129576.142532:0:15096:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1a600/0x40a459093b06acd0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 15096 initiator: MDT0 00000004:00200000:2.0:1746129576.142542:0:15096:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:2.0:1746129576.142626:0:15096:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1a800/0x40a459093b06acc2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129576.142633:0:15096:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1a800/0x40a459093b06acc2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129576.142638:0:15096:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1a800/0x40a459093b06acc2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129576.142643:0:15096:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ee1a800 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746129576.142646:0:15096:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1a800/0x40a459093b06acc2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129576.142653:0:15096:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1a800/0x40a459093b06acc2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129576.142663:0:15096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880132ef8f00) 00010000:00010000:2.0:1746129576.142665:0:15096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129576.142669:0:15096:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1a800/0x40a459093b06acc2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129576.142673:0:15096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1a800/0x40a459093b06acc2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129576.142700:0:15096:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1b400/0x40a459093b06acc9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129576.142705:0:15096:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1b400/0x40a459093b06acc9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129576.142712:0:15096:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1b400/0x40a459093b06acc9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129576.142716:0:15096:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ee1b400 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746129576.142718:0:15096:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1b400/0x40a459093b06acc9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129576.142722:0:15096:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1b400/0x40a459093b06acc9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129576.142728:0:15096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009ce7a000) 00010000:00010000:2.0:1746129576.142730:0:15096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129576.142731:0:15096:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1b400/0x40a459093b06acc9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129576.142735:0:15096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1b400/0x40a459093b06acc9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129576.142775:0:15096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1ae00/0x40a459093b06acbb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21962 expref: 29 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129576.142786:0:15096:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1a600/0x40a459093b06acd0 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21962 expref: 28 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129576.142792:0:15096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:2.0:1746129576.142794:0:15096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746129576.142796:0:15096:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ee1a600, rc 0) 00000100:00100000:2.0:1746129576.142831:0:15096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+28:32475:x1830948734274432:12345-192.168.202.4@tcp:101:cat.0 Request processed in 2261us (3017us total) trans 8589945409 rc 0/0 00000100:00100000:2.0:1746129576.142837:0:15096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11296 00000100:00100000:0.0:1746129576.143286:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129576.143603:0:21725:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734274688 00000100:00100000:2.0:1746129576.143609:0:21725:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734274688 00002000:00100000:2.0:1746129576.143642:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f4:0x0] (1253376->1257471) req@ffff88012baece00 x1830948734274688/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:317/0 lens 488/0 e 0 to 0 dl 1746129587 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129576.143651:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012baece00 with x1830948734274688 ext(1253376->1257471) 00002000:00010000:2.0:1746129576.143655:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012baece00 00000100:00100000:2.0:1746129576.143732:0:21725:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7971 00000100:00100000:2.0:1746129576.143738:0:21725:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+19:1963:x1830948734274688:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:2.0:1746129576.143878:0:21725:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+19:1963:x1830948734274688:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 140us (593us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129576.143883:0:21725:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7971 00002000:00100000:2.0:1746129576.143887:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f4:0x0] (1253376->1257471) req@ffff88012baece00 x1830948734274688/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:317/0 lens 488/4536 e 0 to 0 dl 1746129587 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129576.143894:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012baece00 with x1830948734274688 ext(1253376->1257471) 00002000:00010000:2.0:1746129576.143896:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012baece00 00000100:00100000:0.0:1746129576.146048:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129576.146333:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734275200 00000100:00100000:3.0:1746129576.146342:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734275200 00000100:00100000:3.0:1746129576.146433:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4809 00000100:00100000:3.0:1746129576.146442:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+28:32475:x1830948734275200:12345-192.168.202.4@tcp:35:cat.0 00000100:00100000:3.0:1746129576.146653:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+29:32475:x1830948734275200:12345-192.168.202.4@tcp:35:cat.0 Request processed in 211us (612us total) trans 8589945410 rc 0/0 00000100:00100000:3.0:1746129576.146663:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4809 00000100:00100000:0.0:1746129576.148642:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129576.148703:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129576.148813:0:31519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734275328 00000100:00100000:1.0:1746129576.148823:0:31519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734275328 00002000:00100000:1.0:1746129576.148897:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f5:0x0] (4075520->4194303) req@ffff88012baedc00 x1830948734275328/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:317/0 lens 488/0 e 0 to 0 dl 1746129587 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129576.148907:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012baedc00 with x1830948734275328 ext(4075520->4194303) 00002000:00010000:1.0:1746129576.148913:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012baedc00 00000100:00100000:1.0:1746129576.148945:0:31519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7972 00000100:00100000:1.0:1746129576.148952:0:31519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ada2ffba-8920-4ecb-8068-68caa9806978+26:1963:x1830948734275328:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129576.149198:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129576.149280:0:22480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734275456 00000100:00100000:2.0:1746129576.149284:0:22480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734275456 00000100:00100000:2.0:1746129576.149344:0:22480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16511 00000100:00100000:2.0:1746129576.149350:0:22480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+19:1962:x1830948734275456:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129576.149360:0:22480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746129576.149370:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734274816 00000100:00100000:3.0:1746129576.149374:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734274816 00010000:00010000:2.0:1746129576.149377:0:22480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ee1ac00/0x40a459093b06acde lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21969 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129576.149399:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 801 00000100:00100000:3.0:1746129576.149404:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baeed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+29:1963:x1830948734274816:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129576.149412:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746129576.149426:0:22480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f449880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22480:1830948737570432:192.168.202.4@tcp:106: 00010000:00010000:3.0:1746129576.149433:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1a600/0x40a459093b06acd0 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21962 expref: 29 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129576.149448:0:9823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:3.0:1746129576.149452:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129576.149752:0:22480:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132f36f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746129576.150150:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baeed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+28:1963:x1830948734274816:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 743us (1514us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129576.150254:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 801 00000100:00100000:2.0:1746129576.152556:0:22480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f449880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22480:1830948737570432:192.168.202.4@tcp:106: 00010000:00010000:2.0:1746129576.152595:0:22480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ee1ac00/0x40a459093b06acde lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21969 expref: 20 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129576.152610:0:22480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ee1ac00/0x40a459093b06acde lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21969 expref: 20 pid: 22480 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746129576.152610:0:31519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ada2ffba-8920-4ecb-8068-68caa9806978+26:1963:x1830948734275328:12345-192.168.202.4@tcp:3:cat.0 Request processed in 3657us (3905us total) trans 0 rc 118784/118784 00000100:00100000:1.0:1746129576.152620:0:31519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7972 00002000:00100000:1.0:1746129576.152630:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f5:0x0] (4075520->4194303) req@ffff88012baedc00 x1830948734275328/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:317/0 lens 488/440 e 0 to 0 dl 1746129587 ref 1 fl Complete:/200/0 rc 118784/118784 job:'cat.0' uid:0 gid:0 00010000:00010000:2.0:1746129576.152638:0:22480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ee1ac00, rc 0) 00002000:00100000:1.0:1746129576.152639:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012baedc00 with x1830948734275328 ext(4075520->4194303) 00002000:00010000:1.0:1746129576.152643:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012baedc00 00000100:00100000:2.0:1746129576.152658:0:22480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+19:1962:x1830948734275456:12345-192.168.202.4@tcp:101:cat.0 Request processed in 3309us (3461us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129576.152664:0:22480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16511 00000100:00100000:0.0:1746129576.155956:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129576.156010:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129576.156081:0:4699:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734275584 00000100:00100000:2.0:1746129576.156089:0:22480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734275712 00000100:00100000:3.0:1746129576.156092:0:4699:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734275584 00000100:00100000:2.0:1746129576.156092:0:22480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734275712 00000100:00100000:2.0:1746129576.156150:0:22480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16512 00000100:00100000:3.0:1746129576.156155:0:4699:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16513 00000100:00100000:2.0:1746129576.156157:0:22480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ada2ffba-8920-4ecb-8068-68caa9806978+27:1963:x1830948734275712:12345-192.168.202.4@tcp:101:cat.0 00000100:00100000:3.0:1746129576.156159:0:4699:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c29fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ada2ffba-8920-4ecb-8068-68caa9806978+27:1963:x1830948734275584:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129576.156180:0:4699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129576.156180:0:22480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129576.156197:0:4699:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012eac3a00/0x40a459093b06ace5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21970 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129576.156197:0:22480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ee1bc00/0x40a459093b06acec lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21977 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129576.156252:0:4699:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4699:1830948737570560:192.168.202.4@tcp:106: 00000100:00100000:2.0:1746129576.156252:0:22480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f449880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22480:1830948737570688:192.168.202.4@tcp:106: 00000100:00100000:3.0:1746129576.156368:0:4699:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa381a80 going to sleep for 11 seconds 00000100:00100000:2.0:1746129576.157091:0:22480:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132f36f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746129576.157842:0:4699:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4699:1830948737570560:192.168.202.4@tcp:106: 00010000:00010000:3.0:1746129576.157874:0:4699:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012eac3a00/0x40a459093b06ace5 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21970 expref: 29 pid: 4699 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129576.157887:0:4699:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012eac3a00/0x40a459093b06ace5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21970 expref: 29 pid: 4699 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129576.157897:0:4699:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012eac3a00, rc 0) 00000100:00100000:3.0:1746129576.157941:0:4699:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c29fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ada2ffba-8920-4ecb-8068-68caa9806978+28:1963:x1830948734275584:12345-192.168.202.4@tcp:101:cat.0 Request processed in 1780us (1996us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129576.157950:0:4699:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16513 00002000:00010000:2.0:1746129576.159220:0:22480:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb mtime: 1746129575 -> 1746129576 00002000:00010000:2.0:1746129576.159227:0:22480:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb atime: 1746129575 -> 1746129576 00002000:00010000:2.0:1746129576.159229:0:22480:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb ctime: 1746129575 -> 1746129576 00000100:00100000:2.0:1746129576.159245:0:22480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f449880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22480:1830948737570688:192.168.202.4@tcp:106: 00010000:00010000:2.0:1746129576.159281:0:22480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ee1bc00/0x40a459093b06acec lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21977 expref: 27 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129576.159491:0:22480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ee1bc00/0x40a459093b06acec lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21977 expref: 27 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129576.159516:0:22480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ee1bc00, rc 0) 00000100:00100000:2.0:1746129576.159690:0:22480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ada2ffba-8920-4ecb-8068-68caa9806978+26:1963:x1830948734275712:12345-192.168.202.4@tcp:101:cat.0 Request processed in 3531us (3677us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129576.159698:0:22480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16512 00000100:00100000:0.0:1746129576.161626:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129576.161661:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129576.161743:0:31519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734276096 00000100:00100000:1.0:1746129576.161753:0:31519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734276096 00000100:00100000:2.0:1746129576.161789:0:21725:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734275968 00000100:00100000:2.0:1746129576.161792:0:21725:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734275968 00002000:00100000:1.0:1746129576.161802:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f4:0x0] (1257472->2097151) req@ffff8800959d7800 x1830948734276096/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:317/0 lens 488/0 e 0 to 0 dl 1746129587 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129576.161809:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->1679359) req@ffff8800959d4e00 x1830948734275968/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:317/0 lens 488/0 e 0 to 0 dl 1746129587 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129576.161813:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800959d7800 with x1830948734276096 ext(1257472->2097151) 00002000:00100000:2.0:1746129576.161815:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800959d4e00 with x1830948734275968 ext(1048576->1679359) 00002000:00010000:2.0:1746129576.161818:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800959d4e00 00002000:00010000:1.0:1746129576.161818:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800959d7800 00000100:00100000:1.0:1746129576.161847:0:31519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7973 00000100:00100000:1.0:1746129576.161854:0:31519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:1963:x1830948734276096:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:2.0:1746129576.161858:0:21725:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7974 00000100:00100000:2.0:1746129576.161862:0:21725:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:1963:x1830948734275968:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129576.164842:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129576.167443:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129576.167546:0:4699:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734276480 00000100:00100000:2.0:1746129576.167553:0:22480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734276352 00000100:00100000:3.0:1746129576.167557:0:4699:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734276480 00000100:00100000:2.0:1746129576.167557:0:22480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734276352 00000100:00100000:2.0:1746129576.167620:0:22480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16514 00000100:00100000:2.0:1746129576.167628:0:22480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094efdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ada2ffba-8920-4ecb-8068-68caa9806978+27:1960:x1830948734276352:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129576.167731:0:22480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746129576.167755:0:4699:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16515 00000100:00100000:3.0:1746129576.167764:0:4699:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ada2ffba-8920-4ecb-8068-68caa9806978+27:1960:x1830948734276480:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129576.167771:0:4699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129576.167782:0:4699:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012eac3800/0x40a459093b06acf3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21985 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129576.167847:0:4699:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4699:1830948737570816:192.168.202.4@tcp:106: 00000100:00100000:3.0:1746129576.167938:0:4699:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa381a80 going to sleep for 11 seconds 00010000:00010000:2.0:1746129576.168011:0:22480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ee1ae00/0x40a459093b06acfa lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2197e expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129576.168040:0:22480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f449880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22480:1830948737570944:192.168.202.4@tcp:106: 00000100:00100000:2.0:1746129576.168078:0:22480:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132f36f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746129576.172125:0:21725:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:1963:x1830948734275968:12345-192.168.202.4@tcp:3:cat.0 Request processed in 10249us (10450us total) trans 0 rc 630784/630784 00000100:00100000:2.0:1746129576.172137:0:21725:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7974 00002000:00100000:2.0:1746129576.172149:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->1679359) req@ffff8800959d4e00 x1830948734275968/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:317/0 lens 488/440 e 0 to 0 dl 1746129587 ref 1 fl Complete:/200/0 rc 630784/630784 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129576.172159:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800959d4e00 with x1830948734275968 ext(1048576->1679359) 00002000:00010000:2.0:1746129576.172165:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800959d4e00 00000100:00100000:3.0:1746129576.173789:0:4699:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4699:1830948737570816:192.168.202.4@tcp:106: 00010000:00010000:3.0:1746129576.173831:0:4699:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012eac3800/0x40a459093b06acf3 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21985 expref: 29 pid: 4699 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129576.173845:0:4699:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012eac3800/0x40a459093b06acf3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21985 expref: 29 pid: 4699 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129576.173861:0:4699:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012eac3800, rc 0) 00000100:00100000:3.0:1746129576.173905:0:4699:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ada2ffba-8920-4ecb-8068-68caa9806978+28:1960:x1830948734276480:12345-192.168.202.4@tcp:101:cat.0 Request processed in 6141us (9073us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129576.173913:0:4699:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16515 00000100:00100000:2.0:1746129576.174007:0:22480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f449880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22480:1830948737570944:192.168.202.4@tcp:106: 00010000:00010000:2.0:1746129576.174027:0:22480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ee1ae00/0x40a459093b06acfa lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2197e expref: 27 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129576.174035:0:22480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ee1ae00/0x40a459093b06acfa lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2197e expref: 27 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129576.174053:0:22480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ee1ae00, rc 0) 00000100:00100000:2.0:1746129576.174070:0:22480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094efdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ada2ffba-8920-4ecb-8068-68caa9806978+26:1960:x1830948734276352:12345-192.168.202.4@tcp:101:cat.0 Request processed in 6443us (6640us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129576.174075:0:22480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16514 00000100:00100000:1.0:1746129576.174189:0:31519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+19:1963:x1830948734276096:12345-192.168.202.4@tcp:3:cat.0 Request processed in 12335us (12571us total) trans 0 rc 839680/839680 00000100:00100000:1.0:1746129576.174198:0:31519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7973 00002000:00100000:1.0:1746129576.174207:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f4:0x0] (1257472->2097151) req@ffff8800959d7800 x1830948734276096/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:317/0 lens 488/440 e 0 to 0 dl 1746129587 ref 1 fl Complete:/200/0 rc 839680/839680 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129576.174215:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800959d7800 with x1830948734276096 ext(1257472->2097151) 00002000:00010000:1.0:1746129576.174220:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800959d7800 00000100:00100000:0.0:1746129576.179554:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129576.179685:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129576.181201:0:4699:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734276608 00000100:00100000:3.0:1746129576.181222:0:4699:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734276608 00000100:00100000:3.0:1746129576.181321:0:4699:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734276736 00000100:00100000:3.0:1746129576.181324:0:4699:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734276736 00000100:00100000:3.0:1746129576.181358:0:8411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16516 00000100:00100000:3.0:1746129576.181369:0:8411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ada2ffba-8920-4ecb-8068-68caa9806978+27:1961:x1830948734276608:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129576.181394:0:8411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129576.181419:0:8411:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012eac3e00/0x40a459093b06ad01 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2198c expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129576.181501:0:8411:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8411:1830948737571072:192.168.202.4@tcp:106: 00000100:00100000:3.0:1746129576.181609:0:8411:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa381a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746129576.181628:0:4699:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16517 00000100:00100000:3.0:1746129576.181633:0:4699:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ada2ffba-8920-4ecb-8068-68caa9806978+28:1960:x1830948734276736:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129576.181639:0:4699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129576.181648:0:4699:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012eac2400/0x40a459093b06ad08 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21993 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129576.181673:0:4699:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4699:1830948737571200:192.168.202.4@tcp:106: 00000100:00100000:3.0:1746129576.181692:0:4699:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa381c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746129576.183438:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129576.183507:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129576.183551:0:8410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734276992 00000100:00100000:1.0:1746129576.183561:0:8410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734276992 00000100:00100000:1.0:1746129576.183604:0:8410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16518 00000100:00100000:1.0:1746129576.183610:0:8410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+19:32475:x1830948734276992:12345-192.168.202.4@tcp:101:cat.0 00000100:00100000:3.0:1746129576.183624:0:8411:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8411:1830948737571072:192.168.202.4@tcp:106: 00010000:00010000:1.0:1746129576.183624:0:8410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129576.183639:0:8410:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009584e400/0x40a459093b06ad0f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f219a1 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129576.183650:0:8411:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012eac3e00/0x40a459093b06ad01 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2198c expref: 29 pid: 8411 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129576.183659:0:8411:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012eac3e00/0x40a459093b06ad01 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2198c expref: 29 pid: 8411 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129576.183662:0:8410:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ff45c00/0x40a459093b06aca6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3641344->4075519) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2194d expref: 29 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129576.183669:0:8410:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129576.183671:0:8410:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129576.183672:0:8411:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012eac3e00, rc 0) 00010000:00010000:1.0:1746129576.183674:0:8410:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009584e400/0x40a459093b06ad0f lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f219a1 expref: 20 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129576.183697:0:8410:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012ff45c00/0x40a459093b06aca6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3641344->4075519) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2194d expref: 28 pid: 22480 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129576.183707:0:8411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ada2ffba-8920-4ecb-8068-68caa9806978+28:1961:x1830948734276608:12345-192.168.202.4@tcp:101:cat.0 Request processed in 2341us (4169us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129576.183713:0:8411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16516 00010000:00010000:1.0:1746129576.183713:0:8410:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012ff45c00/0x40a459093b06aca6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3641344->4075519) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2194d expref: 28 pid: 22480 timeout: 931 lvb_type: 0 00000100:00100000:1.0:1746129576.183723:0:8410:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094efd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8410:1830948737571328:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129576.183757:0:4699:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4699:1830948737571200:192.168.202.4@tcp:106: 00000100:00100000:1.0:1746129576.183767:0:8410:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0ac3c0 going to sleep for 11 seconds 00010000:00010000:3.0:1746129576.183772:0:4699:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012eac2400/0x40a459093b06ad08 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21993 expref: 27 pid: 4699 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129576.183780:0:4699:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012eac2400/0x40a459093b06ad08 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21993 expref: 27 pid: 4699 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746129576.183843:0:15096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734276864 00000100:00100000:2.0:1746129576.183847:0:15096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734276864 00000100:00100000:2.0:1746129576.183900:0:15096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11297 00000100:00100000:2.0:1746129576.183905:0:15096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:068dab75-d300-4ead-a742-d14572ad1e50+18:32478:x1830948734276864:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:2.0:1746129576.183922:0:15096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129576.183934:0:15096:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1b400/0x40a459093b06ad16 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2199a expref: -99 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129576.183948:0:4699:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012eac2400, rc 0) 00000100:00100000:3.0:1746129576.183989:0:4699:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ada2ffba-8920-4ecb-8068-68caa9806978+26:1960:x1830948734276736:12345-192.168.202.4@tcp:101:cat.0 Request processed in 2355us (4304us total) trans 0 rc 301/301 00010000:00010000:2.0:1746129576.183993:0:15096:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1a800/0x40a459093b06ad1d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15096 initiator: MDT0 00000100:00100000:3.0:1746129576.183995:0:4699:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16517 00010000:00010000:2.0:1746129576.184004:0:15096:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1a800/0x40a459093b06ad1d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129576.184016:0:15096:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1a800/0x40a459093b06ad1d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129576.184029:0:15096:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1a000/0x40a459093b06ad24 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129576.184036:0:15096:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1a000/0x40a459093b06ad24 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129576.184041:0:15096:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1a000/0x40a459093b06ad24 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15096 initiator: MDT0 00000100:00080000:1.0:1746129576.184156:0:7097:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1746129576.184349:0:15096:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1b000/0x40a459093b06ad2b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129576.184360:0:15096:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cdfdc00/0x40a459093b06abdb lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f218f9 expref: 27 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129576.184365:0:15096:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1b000/0x40a459093b06ad2b lrc: 4/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129576.184385:0:15096:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009cdfdc00/0x40a459093b06abdb lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f218f9 expref: 27 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129576.184394:0:15096:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cdfdc00/0x40a459093b06abdb lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f218f9 expref: 27 pid: 16908 timeout: 931 lvb_type: 0 00000100:00100000:2.0:1746129576.184407:0:15096:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f449880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15096:1830948737571456:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129576.184458:0:15096:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132f36f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746129576.186556:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129576.186688:0:8410:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094efd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8410:1830948737571328:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129576.186729:0:8410:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009584e400/0x40a459093b06ad0f lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f219a1 expref: 20 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129576.186750:0:8410:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009584e400, rc 0) 00000100:00100000:1.0:1746129576.186808:0:8410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:32475:x1830948734276992:12345-192.168.202.4@tcp:101:cat.0 Request processed in 3196us (3297us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129576.186819:0:8410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16518 00000100:00100000:3.0:1746129576.187020:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734277376 00000100:00100000:3.0:1746129576.187028:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734277376 00000100:00100000:3.0:1746129576.187068:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4810 00000100:00100000:3.0:1746129576.187075:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+28:7700:x1830948734277376:12345-192.168.202.4@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1746129576.187282:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+29:7700:x1830948734277376:12345-192.168.202.4@tcp:35:ldlm_bl.0 Request processed in 208us (738us total) trans 8589945411 rc 0/0 00000100:00100000:3.0:1746129576.187288:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4810 00000100:00100000:2.0:1746129576.187432:0:15096:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f449880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15096:1830948737571456:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129576.187448:0:15096:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1b000/0x40a459093b06ad2b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 15096 initiator: MDT0 00000100:00100000:0.0:1746129576.187665:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129576.187800:0:31519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734277120 00000100:00100000:1.0:1746129576.187804:0:31519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734277120 00002000:00100000:1.0:1746129576.187830:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f5:0x0] (3641344->4075519) req@ffff8800959d6300 x1830948734277120/t0(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:317/0 lens 488/0 e 0 to 0 dl 1746129587 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129576.187839:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800959d6300 with x1830948734277120 ext(3641344->4075519) 00010000:00010000:1.0:1746129576.187846:0:31519:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012ff45c00/0x40a459093b06aca6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3641344->4075519) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2194d expref: 26 pid: 22480 timeout: 931 lvb_type: 0 00010000:00010000:1.0:1746129576.187856:0:31519:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012ff45c00/0x40a459093b06aca6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3641344->4075519) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2194d expref: 26 pid: 22480 timeout: 931 lvb_type: 0 00002000:00010000:1.0:1746129576.187868:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800959d6300 00000100:00100000:1.0:1746129576.187892:0:31519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2470 00000100:00100000:1.0:1746129576.187898:0:31519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ada2ffba-8920-4ecb-8068-68caa9806978+26:1960:x1830948734277120:12345-192.168.202.4@tcp:4:cat.0 00000100:00100000:2.0:1746129576.192017:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129576.192672:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734277504 00000100:00100000:3.0:1746129576.192682:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734277504 00010000:00010000:3.0:1746129576.192724:0:9823:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cdfdc00/0x40a459093b06abdb lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f218f9 expref: 29 pid: 16908 timeout: 931 lvb_type: 0 00000100:00100000:3.0:1746129576.193083:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8503 00000100:00100000:3.0:1746129576.193092:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f449880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+29:1963:x1830948734277504:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129576.193109:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129576.193115:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009cdfdc00/0x40a459093b06abdb lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f218f9 expref: 29 pid: 16908 timeout: 931 lvb_type: 0 00010000:00010000:3.0:1746129576.193126:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009cdfdc00/0x40a459093b06abdb lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f218f9 expref: 29 pid: 16908 timeout: 931 lvb_type: 0 00010000:00010000:3.0:1746129576.193148:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cdfdc00/0x40a459093b06abdb lrc: 0/0,0 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f218f9 expref: 29 pid: 16908 timeout: 931 lvb_type: 0 00010000:00010000:3.0:1746129576.193177:0:9823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:3.0:1746129576.193183:0:9823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1b000/0x40a459093b06ad2b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 15096 initiator: MDT0 00010000:00010000:3.0:1746129576.193194:0:9823:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1b000/0x40a459093b06ad2b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 15096 initiator: MDT0 00010000:00010000:3.0:1746129576.193200:0:9823:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1b000/0x40a459093b06ad2b lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 15096 initiator: MDT0 00010000:00010000:3.0:1746129576.193670:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129576.193723:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f449880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+28:1963:x1830948734277504:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 632us (1715us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129576.193730:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8503 00010000:00010000:2.0:1746129576.193816:0:15096:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1b000/0x40a459093b06ad2b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129576.193823:0:15096:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1b000/0x40a459093b06ad2b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15096 initiator: MDT0 00000004:00200000:2.0:1746129576.193867:0:15096:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00000004:00200000:2.0:1746129576.193871:0:15096:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746129576.193885:0:15096:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1b000/0x40a459093b06ad2b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129576.193895:0:15096:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1b000/0x40a459093b06ad2b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129576.193904:0:15096:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1a800/0x40a459093b06ad1d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129576.193908:0:15096:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1a800/0x40a459093b06ad1d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129576.193913:0:15096:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1a800/0x40a459093b06ad1d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129576.193918:0:15096:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ee1a800 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746129576.193921:0:15096:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1a800/0x40a459093b06ad1d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129576.193927:0:15096:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1a800/0x40a459093b06ad1d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129576.193935:0:15096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880132ef8f00) 00010000:00010000:2.0:1746129576.193937:0:15096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129576.193940:0:15096:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1a800/0x40a459093b06ad1d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129576.193945:0:15096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1a800/0x40a459093b06ad1d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129576.193968:0:15096:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1a000/0x40a459093b06ad24 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129576.193972:0:15096:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1a000/0x40a459093b06ad24 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129576.193976:0:15096:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1a000/0x40a459093b06ad24 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129576.193979:0:15096:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ee1a000 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746129576.193981:0:15096:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1a000/0x40a459093b06ad24 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129576.193985:0:15096:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1a000/0x40a459093b06ad24 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129576.193991:0:15096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009ce7a000) 00010000:00010000:2.0:1746129576.193993:0:15096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129576.193995:0:15096:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1a000/0x40a459093b06ad24 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129576.194002:0:15096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1a000/0x40a459093b06ad24 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129576.194037:0:15096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1b400/0x40a459093b06ad16 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2199a expref: 20 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129576.194048:0:15096:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1b000/0x40a459093b06ad2b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2199a expref: 19 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129576.194053:0:15096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:2.0:1746129576.194055:0:15096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746129576.194057:0:15096:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ee1b000, rc 0) 00000100:00100000:2.0:1746129576.194080:0:15096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:068dab75-d300-4ead-a742-d14572ad1e50+19:32478:x1830948734276864:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 10175us (10654us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129576.194086:0:15096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11297 00000100:00100000:1.0:1746129576.195954:0:31519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ada2ffba-8920-4ecb-8068-68caa9806978+28:1960:x1830948734277120:12345-192.168.202.4@tcp:4:cat.0 Request processed in 8048us (8281us total) trans 17179874155 rc 0/0 00000100:00100000:1.0:1746129576.195964:0:31519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2470 00002000:00100000:1.0:1746129576.195976:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f5:0x0] (3641344->4075519) req@ffff8800959d6300 x1830948734277120/t17179874155(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:317/0 lens 488/448 e 0 to 0 dl 1746129587 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129576.195985:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800959d6300 with x1830948734277120 ext(3641344->4075519) 00010000:00010000:1.0:1746129576.195995:0:31519:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012ff45c00/0x40a459093b06aca6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3641344->4075519) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2194d expref: 28 pid: 22480 timeout: 931 lvb_type: 0 00010000:00010000:1.0:1746129576.196009:0:31519:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012ff45c00/0x40a459093b06aca6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3641344->4075519) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2194d expref: 28 pid: 22480 timeout: 931 lvb_type: 0 00002000:00010000:1.0:1746129576.196016:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800959d6300 00000100:00100000:0.0:1746129576.197761:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129576.197798:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129576.197823:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129576.197844:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129576.197856:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129576.197880:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129576.197986:0:8411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734277632 00000100:00100000:1.0:1746129576.197986:0:22481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734277888 00000100:00100000:3.0:1746129576.197995:0:8411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734277632 00000100:00100000:1.0:1746129576.197995:0:22481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734277888 00000100:00100000:1.0:1746129576.198037:0:22481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734278144 00000100:00100000:1.0:1746129576.198039:0:22481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734278144 00000100:00100000:1.0:1746129576.198050:0:22481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734277760 00000100:00100000:1.0:1746129576.198052:0:22481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734277760 00000100:00100000:1.0:1746129576.198060:0:22481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734278016 00000100:00100000:1.0:1746129576.198061:0:22481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734278016 00000100:00100000:2.0:1746129576.198068:0:20577:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734278272 00000100:00100000:2.0:1746129576.198071:0:20577:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734278272 00000100:00100000:1.0:1746129576.198075:0:22481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16519 00000100:00100000:1.0:1746129576.198082:0:22481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:068dab75-d300-4ead-a742-d14572ad1e50+7:1962:x1830948734277888:12345-192.168.202.4@tcp:101:lfs.0 00000100:00100000:2.0:1746129576.198089:0:20577:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16520 00000100:00100000:2.0:1746129576.198093:0:20577:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:068dab75-d300-4ead-a742-d14572ad1e50+7:1962:x1830948734278144:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:2.0:1746129576.198100:0:20577:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129576.198100:0:22481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129576.198116:0:20577:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ee1be00/0x40a459093b06ad32 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f219c4 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129576.198116:0:22481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095f6c000/0x40a459093b06ad39 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f219b6 expref: -99 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129576.198140:0:20577:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129576.198142:0:20577:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129576.198150:0:20577:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ee1be00/0x40a459093b06ad32 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f219c4 expref: 8 pid: 20577 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129576.198168:0:20577:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ee1be00/0x40a459093b06ad32 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f219c4 expref: 8 pid: 20577 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746129576.198170:0:22481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094efd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:22481:1830948737571584:192.168.202.4@tcp:106: 00010000:00010000:2.0:1746129576.198178:0:20577:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ee1be00, rc 0) 00000100:00100000:3.0:1746129576.198224:0:8411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16521 00000100:00100000:3.0:1746129576.198229:0:8411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:068dab75-d300-4ead-a742-d14572ad1e50+8:1962:x1830948734277760:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:3.0:1746129576.198235:0:8411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129576.198242:0:8411:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012eac3e00/0x40a459093b06ad40 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f219af expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129576.198277:0:8411:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8411:1830948737571712:192.168.202.4@tcp:106: 00000100:00100000:0.0:1746129576.198359:0:11014:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16522 00000100:00100000:0.0:1746129576.198366:0:11014:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ced880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:068dab75-d300-4ead-a742-d14572ad1e50+8:1962:x1830948734278016:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:0.0:1746129576.198373:0:11014:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129576.198381:0:11014:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095800e00/0x40a459093b06ad47 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f219bd expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129576.198396:0:11014:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129576.198397:0:11014:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129576.198402:0:11014:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095800e00/0x40a459093b06ad47 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f219bd expref: 9 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129576.198411:0:11014:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095800e00/0x40a459093b06ad47 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f219bd expref: 9 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129576.198417:0:11014:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095800e00, rc 0) 00000100:00100000:3.0:1746129576.198524:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16523 00000100:00100000:3.0:1746129576.198530:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ceca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:068dab75-d300-4ead-a742-d14572ad1e50+9:1962:x1830948734278272:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:3.0:1746129576.198537:0:7148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129576.198543:0:7148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012eac2000/0x40a459093b06ad4e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f219cb expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129576.198545:0:22481:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0ac3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746129576.198564:0:7148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:7148:1830948737571840:192.168.202.4@tcp:106: 00000100:00100000:1.0:1746129576.198564:0:8410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16524 00000100:00100000:1.0:1746129576.198569:0:8410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:068dab75-d300-4ead-a742-d14572ad1e50+9:1962:x1830948734277632:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:1.0:1746129576.198574:0:8410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129576.198580:0:8410:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095c59000/0x40a459093b06ad55 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f219a8 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129576.198584:0:7148:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa381e40 going to sleep for 11 seconds 00010000:00010000:1.0:1746129576.198589:0:8410:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129576.198591:0:8410:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129576.198595:0:8410:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095c59000/0x40a459093b06ad55 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f219a8 expref: 10 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129576.198603:0:8410:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095c59000/0x40a459093b06ad55 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f219a8 expref: 10 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129576.198610:0:8410:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095c59000, rc 0) 00000100:00100000:1.0:1746129576.198625:0:8410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:068dab75-d300-4ead-a742-d14572ad1e50+10:1962:x1830948734277632:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 56us (872us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129576.198630:0:8410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16524 00000100:00100000:2.0:1746129576.198643:0:20577:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:068dab75-d300-4ead-a742-d14572ad1e50+9:1962:x1830948734278144:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 549us (819us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129576.198648:0:20577:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16520 00000100:00100000:1.0:1746129576.198650:0:8411:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa381c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746129576.198688:0:11014:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ced880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:068dab75-d300-4ead-a742-d14572ad1e50+8:1962:x1830948734278016:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 323us (830us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129576.198693:0:11014:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16522 00000100:00100000:0.0:1746129576.200314:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00010000:00010000:3.0:1746129576.200325:0:7148:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.202.4@tcp) returned -22 from glimpse AST (req@ffff8800947bc700 x1830948737571840) - normal race ns: filter-lustre-OST0001_UUID lock: ffff88012ff45c00/0x40a459093b06aca6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3641344->4075519) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2194d expref: 27 pid: 22480 timeout: 931 lvb_type: 0 00000100:00100000:2.0:1746129576.200416:0:8411:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8411:1830948737571712:192.168.202.4@tcp:106: 00000100:00100000:1.0:1746129576.200417:0:22481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094efd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:22481:1830948737571584:192.168.202.4@tcp:106: 00010000:00010000:2.0:1746129576.200442:0:8411:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012eac3e00/0x40a459093b06ad40 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f219af expref: 10 pid: 8411 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129576.200442:0:22481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095f6c000/0x40a459093b06ad39 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f219b6 expref: 10 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129576.200452:0:8411:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012eac3e00/0x40a459093b06ad40 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f219af expref: 10 pid: 8411 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129576.200452:0:22481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095f6c000/0x40a459093b06ad39 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f219b6 expref: 10 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129576.200464:0:22481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f6c000, rc 0) 00010000:00010000:2.0:1746129576.200473:0:8411:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012eac3e00, rc 0) 00010000:00010000:3.0:1746129576.200514:0:7148:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012ff45c00/0x40a459093b06aca6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3641344->4075519) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2194d expref: 27 pid: 22480 timeout: 931 lvb_type: 0 00010000:00010000:3.0:1746129576.200535:0:7148:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ff45c00/0x40a459093b06aca6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3641344->4075519) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2194d expref: 27 pid: 22480 timeout: 931 lvb_type: 0 00000100:00100000:2.0:1746129576.200536:0:8411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:068dab75-d300-4ead-a742-d14572ad1e50+8:1962:x1830948734277760:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 2306us (2690us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129576.200543:0:8411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16521 00000100:00100000:3.0:1746129576.200548:0:7148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:7148:1830948737571840:192.168.202.4@tcp:106: 00010000:00010000:3.0:1746129576.200558:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129576.200559:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129576.200565:0:7148:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009584e400/0x40a459093b06ad0f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f219a1 expref: 19 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129576.200574:0:7148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009584e400/0x40a459093b06ad0f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f219a1 expref: 19 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129576.200597:0:7148:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009584e400/0x40a459093b06ad0f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f219a1 expref: 19 pid: 8410 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129576.200607:0:7148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:7148:1830948737571968:192.168.202.4@tcp:105: 00000100:00100000:3.0:1746129576.200649:0:7148:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa381e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746129576.200668:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734278400 00000100:00100000:3.0:1746129576.200673:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734278400 00000100:00100000:3.0:1746129576.200716:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 802 00000100:00100000:3.0:1746129576.200722:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ceed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ada2ffba-8920-4ecb-8068-68caa9806978+27:1962:x1830948734278400:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129576.200733:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129576.200735:0:9823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 40a459093b06aca6) 00010000:00010000:3.0:1746129576.200736:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129576.200751:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ceed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ada2ffba-8920-4ecb-8068-68caa9806978+27:1962:x1830948734278400:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 29us (458us total) trans 0 rc 116/116 00000100:00100000:3.0:1746129576.200757:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 802 00000100:00100000:1.0:1746129576.200980:0:22481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:068dab75-d300-4ead-a742-d14572ad1e50+7:1962:x1830948734277888:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 2411us (2694us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129576.200986:0:22481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16519 00000100:00100000:3.0:1746129576.202277:0:7148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:7148:1830948737571968:192.168.202.4@tcp:105: 00010000:00010000:3.0:1746129576.202428:0:7148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012eac2000/0x40a459093b06ad4e lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f219cb expref: 6 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129576.202441:0:7148:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012eac2000/0x40a459093b06ad4e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f219cb expref: 6 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129576.202453:0:7148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012eac2000, rc 0) 00000100:00100000:3.0:1746129576.202677:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ceca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:068dab75-d300-4ead-a742-d14572ad1e50+5:1962:x1830948734278272:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 4146us (4795us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129576.202684:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16523 00000100:00100000:0.0:1746129576.204961:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129576.205113:0:15096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734278656 00000100:00100000:2.0:1746129576.205121:0:15096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734278656 00000100:00100000:2.0:1746129576.205181:0:15096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11298 00000100:00100000:2.0:1746129576.205188:0:15096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:068dab75-d300-4ead-a742-d14572ad1e50+19:32478:x1830948734278656:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:2.0:1746129576.205220:0:15096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129576.205238:0:15096:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1ae00/0x40a459093b06ad5c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f219d2 expref: -99 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129576.205379:0:15096:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1bc00/0x40a459093b06ad63 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129576.205395:0:15096:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1b000/0x40a459093b06ad2b lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2199a expref: 20 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129576.205402:0:15096:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1bc00/0x40a459093b06ad63 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129576.205436:0:15096:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1b000/0x40a459093b06ad2b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2199a expref: 20 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129576.205449:0:15096:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1b000/0x40a459093b06ad2b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2199a expref: 20 pid: 15096 timeout: 931 lvb_type: 0 00000100:00100000:2.0:1746129576.205461:0:15096:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f44b800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15096:1830948737572096:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129576.205554:0:15096:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132f36f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746129576.205962:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129576.206035:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129576.206102:0:21725:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734279040 00000100:00100000:3.0:1746129576.206107:0:21725:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734279040 00002000:00100000:3.0:1746129576.206143:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f5:0x0] (3145728->4194303) req@ffff880091b05180 x1830948734279040/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:317/0 lens 488/0 e 0 to 0 dl 1746129587 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129576.206152:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091b05180 with x1830948734279040 ext(3145728->4194303) 00002000:00010000:3.0:1746129576.206157:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091b05180 00000100:00100000:3.0:1746129576.206176:0:31520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734278912 00000100:00100000:3.0:1746129576.206178:0:31520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734278912 00002000:00100000:3.0:1746129576.206192:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3f5:0x0] (2097152->3145727) req@ffff880091b05c00 x1830948734278912/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:317/0 lens 488/0 e 0 to 0 dl 1746129587 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129576.206203:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091b05c00 with x1830948734278912 ext(2097152->3145727) 00002000:00010000:3.0:1746129576.206205:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091b05c00 00000100:00100000:3.0:1746129576.206217:0:31520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7975 00000100:00100000:3.0:1746129576.206513:0:31520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:1963:x1830948734279040:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:1.0:1746129576.206747:0:31519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7976 00000100:00100000:1.0:1746129576.206756:0:31519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:1963:x1830948734278912:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:2.0:1746129576.208103:0:15096:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f44b800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15096:1830948737572096:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129576.208133:0:15096:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1bc00/0x40a459093b06ad63 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 15096 initiator: MDT0 00000100:00100000:0.0:1746129576.208172:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129576.208328:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734279296 00000100:00100000:3.0:1746129576.208334:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734279296 00010000:00010000:3.0:1746129576.208364:0:9823:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1b000/0x40a459093b06ad2b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2199a expref: 21 pid: 15096 timeout: 931 lvb_type: 0 00000100:00100000:3.0:1746129576.208389:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8504 00000100:00100000:3.0:1746129576.208394:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b06300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:068dab75-d300-4ead-a742-d14572ad1e50+21:1962:x1830948734279296:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129576.208406:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129576.208411:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1b000/0x40a459093b06ad2b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2199a expref: 21 pid: 15096 timeout: 931 lvb_type: 0 00010000:00010000:3.0:1746129576.208422:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1b000/0x40a459093b06ad2b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2199a expref: 21 pid: 15096 timeout: 931 lvb_type: 0 00010000:00010000:3.0:1746129576.208444:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1b000/0x40a459093b06ad2b lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2199a expref: 21 pid: 15096 timeout: 931 lvb_type: 0 00010000:00010000:3.0:1746129576.208457:0:9823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:3.0:1746129576.208461:0:9823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1bc00/0x40a459093b06ad63 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 15096 initiator: MDT0 00010000:00010000:3.0:1746129576.208470:0:9823:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1bc00/0x40a459093b06ad63 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 15096 initiator: MDT0 00010000:00010000:3.0:1746129576.208476:0:9823:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1bc00/0x40a459093b06ad63 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 15096 initiator: MDT0 00010000:00010000:3.0:1746129576.208492:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129576.208536:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b06300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:068dab75-d300-4ead-a742-d14572ad1e50+20:1962:x1830948734279296:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 141us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129576.208542:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8504 00010000:00010000:2.0:1746129576.208622:0:15096:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1bc00/0x40a459093b06ad63 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129576.208628:0:15096:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1bc00/0x40a459093b06ad63 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15096 initiator: MDT0 00000004:00200000:2.0:1746129576.208648:0:15096:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:2.0:1746129576.208793:0:15096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1ae00/0x40a459093b06ad5c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f219d2 expref: 21 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129576.208810:0:15096:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1bc00/0x40a459093b06ad63 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f219d2 expref: 20 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129576.208816:0:15096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:2.0:1746129576.208818:0:15096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746129576.208821:0:15096:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ee1bc00, rc 0) 00000100:00100000:2.0:1746129576.208844:0:15096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:068dab75-d300-4ead-a742-d14572ad1e50+20:32478:x1830948734278656:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 3656us (3892us total) trans 8589945412 rc 0/0 00000100:00100000:2.0:1746129576.208849:0:15096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11298 00000100:00100000:0.0:1746129576.214595:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129576.214663:0:15096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734279424 00000100:00100000:2.0:1746129576.214673:0:15096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734279424 00000100:00100000:2.0:1746129576.215277:0:15096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11299 00000100:00100000:2.0:1746129576.215286:0:15096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:068dab75-d300-4ead-a742-d14572ad1e50+20:32478:x1830948734279424:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:2.0:1746129576.215340:0:15096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129576.215364:0:15096:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8e2c00/0x40a459093b06ad71 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f219d9 expref: -99 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129576.215454:0:15096:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8e2000/0x40a459093b06ad78 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129576.215468:0:15096:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1bc00/0x40a459093b06ad63 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f219d2 expref: 21 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129576.215474:0:15096:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8e2000/0x40a459093b06ad78 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x50210000000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129576.215504:0:15096:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1bc00/0x40a459093b06ad63 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f219d2 expref: 21 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129576.215516:0:15096:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1bc00/0x40a459093b06ad63 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f219d2 expref: 21 pid: 15096 timeout: 931 lvb_type: 0 00000100:00100000:2.0:1746129576.215528:0:15096:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f44b800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15096:1830948737572224:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129576.215615:0:15096:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132f36f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746129576.225204:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129576.225234:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734279552 00000100:00100000:0.0:1746129576.225243:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734279552 00010000:00010000:0.0:1746129576.225311:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1bc00/0x40a459093b06ad63 lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f219d2 expref: 22 pid: 15096 timeout: 931 lvb_type: 0 00000100:00100000:0.0:1746129576.225358:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8505 00000100:00100000:0.0:1746129576.225367:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6fd0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:068dab75-d300-4ead-a742-d14572ad1e50+22:1962:x1830948734279552:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129576.225384:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129576.225390:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1bc00/0x40a459093b06ad63 lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f219d2 expref: 22 pid: 15096 timeout: 931 lvb_type: 0 00010000:00010000:0.0:1746129576.225401:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1bc00/0x40a459093b06ad63 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f219d2 expref: 22 pid: 15096 timeout: 931 lvb_type: 0 00010000:00010000:0.0:1746129576.225425:0:7085:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:0.0:1746129576.225430:0:7085:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8e2000/0x40a459093b06ad78 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x8 rrc: 12 type: IBT flags: 0x50210000000000 pid: 15096 initiator: MDT0 00010000:00010000:0.0:1746129576.225440:0:7085:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8e2000/0x40a459093b06ad78 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x50290000000000 pid: 15096 initiator: MDT0 00010000:00010000:0.0:1746129576.225446:0:7085:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8e2000/0x40a459093b06ad78 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x50290000000000 pid: 15096 initiator: MDT0 00010000:00010000:0.0:1746129576.225463:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129576.225504:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6fd0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:068dab75-d300-4ead-a742-d14572ad1e50+22:1962:x1830948734279552:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 138us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129576.225510:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8505 00010000:00010000:2.0:1746129576.225692:0:15096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1bc00/0x40a459093b06ad63 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f219d2 expref: 21 pid: 15096 timeout: 931 lvb_type: 0 00000100:00100000:2.0:1746129576.225725:0:15096:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f44b800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15096:1830948737572224:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129576.225744:0:15096:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8e2000/0x40a459093b06ad78 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129576.225753:0:15096:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8e2000/0x40a459093b06ad78 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129576.225758:0:15096:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8e2000/0x40a459093b06ad78 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 15096 initiator: MDT0 00000004:00200000:2.0:1746129576.225809:0:15096:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00000004:00200000:2.0:1746129576.225813:0:15096:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746129576.225832:0:15096:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8e2000/0x40a459093b06ad78 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129576.225863:0:15096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8e2c00/0x40a459093b06ad71 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f219d9 expref: 21 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129576.225875:0:15096:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8e2000/0x40a459093b06ad78 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f219d9 expref: 20 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129576.225886:0:15096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:2.0:1746129576.225888:0:15096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746129576.225891:0:15096:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f8e2000, rc 0) 00000100:00100000:2.0:1746129576.225917:0:15096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:068dab75-d300-4ead-a742-d14572ad1e50+20:32478:x1830948734279424:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 10632us (11333us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129576.225928:0:15096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11299 00000100:00100000:1.0:1746129576.227690:0:31520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+22:1963:x1830948734279040:12345-192.168.202.4@tcp:3:cat.0 Request processed in 21456us (21717us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129576.227701:0:31520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7975 00002000:00100000:1.0:1746129576.227713:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3f5:0x0] (3145728->4194303) req@ffff880091b05180 x1830948734279040/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:317/0 lens 488/440 e 0 to 0 dl 1746129587 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129576.227724:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091b05180 with x1830948734279040 ext(3145728->4194303) 00002000:00010000:1.0:1746129576.227730:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091b05180 00000100:00100000:1.0:1746129576.228320:0:31519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:1963:x1830948734278912:12345-192.168.202.4@tcp:3:cat.0 Request processed in 21562us (22281us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129576.228326:0:31519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7976 00002000:00100000:1.0:1746129576.228333:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f5:0x0] (2097152->3145727) req@ffff880091b05c00 x1830948734278912/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:317/0 lens 488/440 e 0 to 0 dl 1746129587 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129576.228345:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091b05c00 with x1830948734278912 ext(2097152->3145727) 00002000:00010000:1.0:1746129576.228348:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091b05c00 00000100:00100000:0.0:1746129576.237714:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129576.237755:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129576.237792:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129576.239758:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734279680 00000100:00100000:3.0:1746129576.239772:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734279680 00000100:00100000:3.0:1746129576.239825:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734279936 00000100:00100000:3.0:1746129576.239828:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734279936 00000100:00100000:3.0:1746129576.239842:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734279808 00000100:00100000:3.0:1746129576.239845:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734279808 00000100:00100000:3.0:1746129576.239864:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16525 00000100:00100000:3.0:1746129576.239872:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:068dab75-d300-4ead-a742-d14572ad1e50+7:1960:x1830948734279680:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:3.0:1746129576.239892:0:7148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129576.239912:0:7148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012eac2600/0x40a459093b06ad7f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f219e0 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129576.239975:0:7148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:7148:1830948737572352:192.168.202.4@tcp:106: 00000100:00100000:3.0:1746129576.240062:0:7148:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa381e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746129576.240085:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16526 00000100:00100000:3.0:1746129576.240090:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:068dab75-d300-4ead-a742-d14572ad1e50+8:1960:x1830948734279936:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:3.0:1746129576.240097:0:4385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129576.240104:0:4385:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012eac2000/0x40a459093b06ad86 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f219ee expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129576.240115:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129576.240117:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129576.240126:0:4385:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012eac2000/0x40a459093b06ad86 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f219ee expref: 9 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129576.240143:0:4385:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012eac2000/0x40a459093b06ad86 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f219ee expref: 9 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129576.240155:0:4385:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012eac2000, rc 0) 00000100:00100000:3.0:1746129576.240178:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:068dab75-d300-4ead-a742-d14572ad1e50+9:1960:x1830948734279936:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 89us (2423us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129576.240184:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16526 00000100:00100000:3.0:1746129576.240201:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16527 00000100:00100000:3.0:1746129576.240205:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:068dab75-d300-4ead-a742-d14572ad1e50+8:1960:x1830948734279808:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:3.0:1746129576.240211:0:4385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129576.240216:0:4385:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012eac3000/0x40a459093b06ad8d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f219e7 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129576.240235:0:4385:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:4385:1830948737572480:192.168.202.4@tcp:106: 00000100:00100000:3.0:1746129576.240252:0:4385:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa381180 going to sleep for 11 seconds 00000100:00100000:2.0:1746129576.252388:0:4385:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:4385:1830948737572480:192.168.202.4@tcp:106: 00010000:00010000:2.0:1746129576.252425:0:4385:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012eac3000/0x40a459093b06ad8d lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f219e7 expref: 9 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129576.252438:0:4385:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012eac3000/0x40a459093b06ad8d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f219e7 expref: 9 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129576.252453:0:4385:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012eac3000, rc 0) 00000100:00100000:2.0:1746129576.252509:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:068dab75-d300-4ead-a742-d14572ad1e50+8:1960:x1830948734279808:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 12302us (14716us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129576.252517:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16527 00000100:00100000:3.0:1746129576.252985:0:7148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:7148:1830948737572352:192.168.202.4@tcp:106: 00010000:00010000:3.0:1746129576.253000:0:7148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012eac2600/0x40a459093b06ad7f lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f219e0 expref: 7 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129576.253010:0:7148:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012eac2600/0x40a459093b06ad7f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f219e0 expref: 7 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129576.253643:0:7148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012eac2600, rc 0) 00000100:00100000:3.0:1746129576.254215:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:068dab75-d300-4ead-a742-d14572ad1e50+6:1960:x1830948734279680:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 14343us (16510us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129576.254223:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16525 00000100:00100000:0.0:1746129576.264127:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129576.264632:0:15096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734280192 00000100:00100000:2.0:1746129576.264642:0:15096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734280192 00000100:00100000:2.0:1746129576.264765:0:15096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11300 00000100:00100000:2.0:1746129576.264775:0:15096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:068dab75-d300-4ead-a742-d14572ad1e50+20:32478:x1830948734280192:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:2.0:1746129576.264797:0:15096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129576.264816:0:15096:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1a600/0x40a459093b06ad94 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f219f5 expref: -99 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129576.264927:0:15096:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1ae00/0x40a459093b06ad9b lrc: 3/0,1 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129576.264943:0:15096:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1ae00/0x40a459093b06ad9b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129576.264953:0:15096:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1ae00/0x40a459093b06ad9b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 15096 initiator: MDT0 00000004:00200000:2.0:1746129576.264965:0:15096:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:2.0:1746129576.265088:0:15096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1a600/0x40a459093b06ad94 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x1/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f219f5 expref: 23 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129576.265121:0:15096:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1ae00/0x40a459093b06ad9b lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f219f5 expref: 22 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129576.265129:0:15096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:2.0:1746129576.265132:0:15096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746129576.265135:0:15096:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ee1ae00, rc 0) 00000100:00100000:2.0:1746129576.266436:0:15096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:068dab75-d300-4ead-a742-d14572ad1e50+22:32478:x1830948734280192:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 1659us (2318us total) trans 8589945413 rc 0/0 00000100:00100000:2.0:1746129576.266443:0:15096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11300 00000100:00100000:0.0:1746129576.272448:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129576.272524:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129576.272544:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129576.272558:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129576.272592:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129576.272609:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129576.272631:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129576.272674:0:22481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734280576 00000100:00100000:0.0:1746129576.272683:0:22481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734280576 00000100:00100000:0.0:1746129576.272724:0:22481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734280704 00000100:00100000:0.0:1746129576.272727:0:22481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734280704 00000100:00100000:0.0:1746129576.272738:0:22481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734280960 00000100:00100000:0.0:1746129576.272740:0:22481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734280960 00000100:00100000:0.0:1746129576.272749:0:22481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734281216 00000100:00100000:0.0:1746129576.272751:0:22481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734281216 00000100:00100000:0.0:1746129576.272759:0:22481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734280832 00000100:00100000:0.0:1746129576.272761:0:22481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734280832 00000100:00100000:0.0:1746129576.272769:0:22481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734281088 00000100:00100000:0.0:1746129576.272771:0:22481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734281088 00000100:00100000:0.0:1746129576.272784:0:22481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16528 00000100:00100000:0.0:1746129576.272791:0:22481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:068dab75-d300-4ead-a742-d14572ad1e50+10:1962:x1830948734280576:12345-192.168.202.4@tcp:1:lfs.0 00010000:00010000:0.0:1746129576.272844:0:22481:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012cd31800/0x40a459093b06ada9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129576.272864:0:22481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cdfc400/0x40a459093b06ac1a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21915 expref: 12 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129576.272872:0:22481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095c59000/0x40a459093b06ad55 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f219a8 expref: 10 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129576.272879:0:22481:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012eac2200/0x40a459093b06ac60 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21923 expref: 19 pid: 4699 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129576.272886:0:22481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129576.272888:0:22481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129576.272891:0:22481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012cd31800/0x40a459093b06ada9 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129576.272926:0:22481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012eac2200/0x40a459093b06ac60 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21923 expref: 19 pid: 4699 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129576.272939:0:22481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012eac2200/0x40a459093b06ac60 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21923 expref: 19 pid: 4699 timeout: 931 lvb_type: 1 00000100:00100000:0.0:1746129576.272954:0:22481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ceed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:22481:1830948737572608:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129576.273043:0:22481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095c59000/0x40a459093b06ad55 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f219a8 expref: 10 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129576.273052:0:22481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095c59000/0x40a459093b06ad55 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f219a8 expref: 10 pid: 8410 timeout: 931 lvb_type: 1 00000100:00100000:0.0:1746129576.273060:0:22481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013145ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:22481:1830948737572736:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129576.273086:0:22481:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009cdfc400/0x40a459093b06ac1a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21915 expref: 12 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129576.273094:0:22481:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009cdfc400/0x40a459093b06ac1a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21915 expref: 12 pid: 4699 timeout: 931 lvb_type: 0 00000100:00100000:0.0:1746129576.273101:0:22481:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013145d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:22481:1830948737572864:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129576.273118:0:22481:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a6dc8a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746129576.273140:0:8412:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16529 00000100:00100000:0.0:1746129576.273147:0:8412:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:068dab75-d300-4ead-a742-d14572ad1e50+8:1962:x1830948734280704:12345-192.168.202.4@tcp:1:lfs.0 00010000:00010000:0.0:1746129576.273169:0:8412:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012cd31200/0x40a459093b06adb0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129576.273180:0:8412:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a6ca1e00/0x40a459093b06acad lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1679360->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21954 expref: 19 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129576.273185:0:8412:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129576.273187:0:8412:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129576.273189:0:8412:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012cd31200/0x40a459093b06adb0 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129576.273204:0:8412:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a6ca1e00/0x40a459093b06acad lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1679360->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21954 expref: 19 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129576.273212:0:8412:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a6ca1e00/0x40a459093b06acad lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1679360->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21954 expref: 19 pid: 22480 timeout: 931 lvb_type: 0 00000100:00100000:0.0:1746129576.273221:0:8412:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013145d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8412:1830948737572992:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129576.273240:0:8412:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a6dc8240 going to sleep for 11 seconds 00000100:00100000:0.0:1746129576.273255:0:20577:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16530 00000100:00100000:0.0:1746129576.273260:0:20577:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:068dab75-d300-4ead-a742-d14572ad1e50+10:1962:x1830948734280960:12345-192.168.202.4@tcp:1:lfs.0 00000100:00100000:2.0:1746129576.273642:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16531 00000100:00100000:2.0:1746129576.273651:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:068dab75-d300-4ead-a742-d14572ad1e50+8:1962:x1830948734281216:12345-192.168.202.4@tcp:1:lfs.0 00010000:00010000:2.0:1746129576.273670:0:4385:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009ee1b800/0x40a459093b06adbe lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129576.273688:0:4385:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009584e400/0x40a459093b06ad0f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f219a1 expref: 19 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129576.273694:0:4385:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012eac2000/0x40a459093b06ad86 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f219ee expref: 8 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129576.273700:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129576.273702:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129576.273703:0:4385:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ee1b800/0x40a459093b06adbe lrc: 5/0,1 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129576.273720:0:4385:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012eac2000/0x40a459093b06ad86 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f219ee expref: 8 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129576.273727:0:4385:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012eac2000/0x40a459093b06ad86 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f219ee expref: 8 pid: 4385 timeout: 931 lvb_type: 1 00000100:00100000:2.0:1746129576.273735:0:4385:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f44b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:4385:1830948737573120:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129576.273780:0:4385:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009584e400/0x40a459093b06ad0f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f219a1 expref: 19 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129576.273787:0:4385:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009584e400/0x40a459093b06ad0f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f219a1 expref: 19 pid: 8410 timeout: 931 lvb_type: 0 00000100:00100000:2.0:1746129576.273795:0:4385:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f44ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:4385:1830948737573248:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129576.273812:0:4385:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132f36f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746129576.273829:0:8411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16532 00000100:00100000:2.0:1746129576.273834:0:8411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:068dab75-d300-4ead-a742-d14572ad1e50+8:1962:x1830948734280832:12345-192.168.202.4@tcp:1:lfs.0 00010000:00010000:2.0:1746129576.273850:0:8411:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009ee1a000/0x40a459093b06adc5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129576.273859:0:8411:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ee1b200/0x40a459093b06acb4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1257471) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2195b expref: 19 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129576.273864:0:8411:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129576.273865:0:8411:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129576.273867:0:8411:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ee1a000/0x40a459093b06adc5 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129576.273877:0:8411:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ee1b200/0x40a459093b06acb4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1257471) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2195b expref: 19 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129576.273884:0:8411:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ee1b200/0x40a459093b06acb4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1257471) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2195b expref: 19 pid: 22480 timeout: 931 lvb_type: 0 00000100:00100000:2.0:1746129576.273891:0:8411:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f44bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8411:1830948737573376:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129576.273907:0:8411:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132f36480 going to sleep for 11 seconds 00010000:00010000:0.0:1746129576.273994:0:20577:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009f8e2200/0x40a459093b06adb7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129576.274005:0:20577:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a6caee00/0x40a459093b06ab5d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2189e expref: 12 pid: 22481 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746129576.274014:0:15096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734280448 00010000:00010000:0.0:1746129576.274016:0:20577:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095800e00/0x40a459093b06ad47 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f219bd expref: 10 pid: 11014 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746129576.274017:0:15096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734280448 00010000:00010000:0.0:1746129576.274022:0:20577:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cdfd000/0x40a459093b06abaa lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f218cf expref: 19 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129576.274028:0:20577:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129576.274029:0:20577:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129576.274031:0:20577:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f8e2200/0x40a459093b06adb7 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129576.274046:0:20577:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009cdfd000/0x40a459093b06abaa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f218cf expref: 19 pid: 11014 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746129576.274052:0:16908:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11301 00010000:00010000:0.0:1746129576.274053:0:20577:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009cdfd000/0x40a459093b06abaa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f218cf expref: 19 pid: 11014 timeout: 931 lvb_type: 1 00000100:00100000:2.0:1746129576.274057:0:16908:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ada2ffba-8920-4ecb-8068-68caa9806978+314:32482:x1830948734280448:12345-192.168.202.4@tcp:101:multiop.0 00000100:00100000:0.0:1746129576.274061:0:20577:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013145e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20577:1830948737573504:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129576.274071:0:16908:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129576.274085:0:16908:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6cf7000/0x40a459093b06adcc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f219fc expref: -99 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129576.274087:0:20577:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095800e00/0x40a459093b06ad47 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f219bd expref: 10 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129576.274094:0:20577:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095800e00/0x40a459093b06ad47 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f219bd expref: 10 pid: 11014 timeout: 931 lvb_type: 1 00000100:00100000:0.0:1746129576.274101:0:20577:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013145ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20577:1830948737573632:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129576.274118:0:20577:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a6caee00/0x40a459093b06ab5d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2189e expref: 12 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129576.274125:0:20577:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a6caee00/0x40a459093b06ab5d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2189e expref: 12 pid: 22481 timeout: 931 lvb_type: 1 00000100:00100000:0.0:1746129576.274132:0:20577:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013145f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20577:1830948737573760:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129576.274145:0:20577:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a6dc8300 going to sleep for 11 seconds 00010000:00010000:2.0:1746129576.274195:0:16908:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6cf7400/0x40a459093b06add3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129576.274206:0:16908:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6cf7400/0x40a459093b06add3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00000100:00100000:0.0:1746129576.274208:0:8410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16533 00000100:00100000:0.0:1746129576.274213:0:8410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baeed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:068dab75-d300-4ead-a742-d14572ad1e50+10:1962:x1830948734281088:12345-192.168.202.4@tcp:1:lfs.0 00010000:00010000:2.0:1746129576.274216:0:16908:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6cf7400/0x40a459093b06add3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129576.274227:0:16908:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6cf6200/0x40a459093b06adda lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129576.274228:0:8410:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880095fb0a00/0x40a459093b06ade1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129576.274233:0:16908:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6cf6200/0x40a459093b06adda lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129576.274238:0:16908:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6cf6200/0x40a459093b06adda lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129576.274238:0:8410:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a6caec00/0x40a459093b06ab64 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f218a5 expref: 12 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129576.274244:0:8410:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ee1be00/0x40a459093b06ad32 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f219c4 expref: 10 pid: 20577 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129576.274251:0:8410:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f384600/0x40a459093b06ab6b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f218ac expref: 19 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129576.274256:0:8410:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129576.274257:0:8410:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129576.274259:0:8410:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095fb0a00/0x40a459093b06ade1 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129576.274290:0:8410:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f384600/0x40a459093b06ab6b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f218ac expref: 19 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129576.274312:0:8410:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f384600/0x40a459093b06ab6b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f218ac expref: 19 pid: 22481 timeout: 931 lvb_type: 0 00000100:00100000:0.0:1746129576.274319:0:8410:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013145df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8410:1830948737573888:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129576.274355:0:8410:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ee1be00/0x40a459093b06ad32 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f219c4 expref: 10 pid: 20577 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129576.274362:0:8410:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ee1be00/0x40a459093b06ad32 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f219c4 expref: 10 pid: 20577 timeout: 931 lvb_type: 1 00000100:00100000:0.0:1746129576.274368:0:8410:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013145f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8410:1830948737574016:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129576.274375:0:16908:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6cf6600/0x40a459093b06ade8 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129576.274384:0:16908:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1ae00/0x40a459093b06ad9b lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f219f5 expref: 21 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129576.274387:0:8410:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a6caec00/0x40a459093b06ab64 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f218a5 expref: 12 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129576.274390:0:16908:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6cf6600/0x40a459093b06ade8 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129576.274394:0:8410:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a6caec00/0x40a459093b06ab64 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f218a5 expref: 12 pid: 22481 timeout: 931 lvb_type: 1 00000100:00100000:0.0:1746129576.274400:0:8410:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013145fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8410:1830948737574144:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129576.274405:0:16908:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1ae00/0x40a459093b06ad9b lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f219f5 expref: 21 pid: 15096 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129576.274411:0:8410:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a6dc8e40 going to sleep for 11 seconds 00010000:00010000:2.0:1746129576.274412:0:16908:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1ae00/0x40a459093b06ad9b lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f219f5 expref: 21 pid: 15096 timeout: 931 lvb_type: 0 00000100:00100000:2.0:1746129576.274424:0:16908:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f449880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16908:1830948737574272:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129576.274439:0:16908:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132f369c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746129576.280385:0:22481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ceed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:22481:1830948737572608:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129576.287958:0:8412:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013145d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8412:1830948737572992:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129576.287991:0:8412:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012cd31200/0x40a459093b06adb0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129576.288194:0:8410:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013145df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8410:1830948737573888:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129576.288223:0:8410:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013145f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8410:1830948737574016:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129576.288248:0:8410:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013145fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8410:1830948737574144:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129576.288251:0:20577:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013145e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20577:1830948737573504:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129576.288258:0:20577:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013145ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20577:1830948737573632:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129576.288263:0:20577:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013145f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20577:1830948737573760:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129576.288274:0:8410:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880095fb0a00/0x40a459093b06ade1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129576.288285:0:20577:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009f8e2200/0x40a459093b06adb7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129576.288430:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129576.288451:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129576.288473:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734281856 00000100:00100000:0.0:1746129576.288479:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734281856 00010000:00010000:0.0:1746129576.288509:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095800e00/0x40a459093b06ad47 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f219bd expref: 11 pid: 11014 timeout: 931 lvb_type: 1 00000100:00100000:0.0:1746129576.288535:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8506 00000100:00100000:0.0:1746129576.288541:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013145f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:068dab75-d300-4ead-a742-d14572ad1e50+11:1960:x1830948734281856:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129576.288554:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129576.288578:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095800e00/0x40a459093b06ad47 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f219bd expref: 11 pid: 11014 timeout: 931 lvb_type: 1 00010000:00010000:0.0:1746129576.288588:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095800e00/0x40a459093b06ad47 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f219bd expref: 11 pid: 11014 timeout: 931 lvb_type: 1 00010000:00010000:0.0:1746129576.288611:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095800e00/0x40a459093b06ad47 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f219bd expref: 11 pid: 11014 timeout: 931 lvb_type: 1 00010000:00010000:0.0:1746129576.288630:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129576.288667:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013145f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:068dab75-d300-4ead-a742-d14572ad1e50+10:1960:x1830948734281856:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 126us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129576.288677:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8506 00000100:00100000:0.0:1746129576.288713:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129576.288723:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734282112 00000100:00100000:0.0:1746129576.288725:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734282112 00010000:00010000:0.0:1746129576.288734:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6caee00/0x40a459093b06ab5d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2189e expref: 13 pid: 22481 timeout: 931 lvb_type: 1 00000100:00100000:0.0:1746129576.288746:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8507 00000100:00100000:0.0:1746129576.288749:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013145df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+13:1960:x1830948734282112:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129576.288755:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129576.288760:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a6caee00/0x40a459093b06ab5d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2189e expref: 13 pid: 22481 timeout: 931 lvb_type: 1 00010000:00010000:0.0:1746129576.288767:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a6caee00/0x40a459093b06ab5d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2189e expref: 13 pid: 22481 timeout: 931 lvb_type: 1 00010000:00010000:0.0:1746129576.288778:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a6caee00/0x40a459093b06ab5d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2189e expref: 13 pid: 22481 timeout: 931 lvb_type: 1 00010000:00010000:0.0:1746129576.288784:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129576.288796:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013145df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+12:1960:x1830948734282112:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 46us (82us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129576.288801:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8507 00000100:00100000:0.0:1746129576.288843:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129576.288851:0:20578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734281728 00000100:00100000:0.0:1746129576.288853:0:20578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734281728 00010000:00010000:0.0:1746129576.288863:0:20578:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012eac2200/0x40a459093b06ac60 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21923 expref: 20 pid: 4699 timeout: 931 lvb_type: 1 00000100:00100000:0.0:1746129576.288874:0:20578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8508 00000100:00100000:0.0:1746129576.288877:0:20578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013145e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ada2ffba-8920-4ecb-8068-68caa9806978+20:1960:x1830948734281728:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129576.288884:0:20578:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129576.288892:0:20578:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012eac2200/0x40a459093b06ac60 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21923 expref: 20 pid: 4699 timeout: 931 lvb_type: 1 00010000:00010000:0.0:1746129576.288900:0:20578:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012eac2200/0x40a459093b06ac60 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21923 expref: 20 pid: 4699 timeout: 931 lvb_type: 1 00010000:00010000:0.0:1746129576.288910:0:20578:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012eac2200/0x40a459093b06ac60 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21923 expref: 20 pid: 4699 timeout: 931 lvb_type: 1 00010000:00010000:0.0:1746129576.288918:0:20578:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129576.288928:0:20578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013145e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ada2ffba-8920-4ecb-8068-68caa9806978+19:1960:x1830948734281728:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 50us (85us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129576.288932:0:20578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8508 00000100:00100000:0.0:1746129576.288953:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129576.288960:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734281984 00000100:00100000:0.0:1746129576.288962:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734281984 00010000:00010000:0.0:1746129576.288969:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095c59000/0x40a459093b06ad55 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f219a8 expref: 10 pid: 8410 timeout: 931 lvb_type: 1 00000100:00100000:0.0:1746129576.288978:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8509 00000100:00100000:0.0:1746129576.288981:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013145f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:068dab75-d300-4ead-a742-d14572ad1e50+10:1960:x1830948734281984:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129576.288989:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129576.288993:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095c59000/0x40a459093b06ad55 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f219a8 expref: 10 pid: 8410 timeout: 931 lvb_type: 1 00010000:00010000:0.0:1746129576.289000:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095c59000/0x40a459093b06ad55 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f219a8 expref: 10 pid: 8410 timeout: 931 lvb_type: 1 00010000:00010000:0.0:1746129576.289007:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129576.289016:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013145f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:068dab75-d300-4ead-a742-d14572ad1e50+10:1960:x1830948734281984:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 34us (62us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129576.289019:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8509 00000100:00100000:0.0:1746129576.289040:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129576.289047:0:20578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734282496 00000100:00100000:0.0:1746129576.289049:0:20578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734282496 00010000:00010000:0.0:1746129576.289055:0:20578:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f384600/0x40a459093b06ab6b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f218ac expref: 19 pid: 22481 timeout: 931 lvb_type: 0 00000100:00100000:0.0:1746129576.289064:0:20578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8510 00000100:00100000:0.0:1746129576.289068:0:20578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013145ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ada2ffba-8920-4ecb-8068-68caa9806978+19:1960:x1830948734282496:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129576.289074:0:20578:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129576.289081:0:20578:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f384600/0x40a459093b06ab6b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f218ac expref: 19 pid: 22481 timeout: 931 lvb_type: 0 00010000:00010000:0.0:1746129576.289088:0:20578:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f384600/0x40a459093b06ab6b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f218ac expref: 19 pid: 22481 timeout: 931 lvb_type: 0 00010000:00010000:0.0:1746129576.289097:0:20578:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f384600/0x40a459093b06ab6b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f218ac expref: 19 pid: 22481 timeout: 931 lvb_type: 0 00010000:00010000:0.0:1746129576.289107:0:20578:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129576.289119:0:20578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013145ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ada2ffba-8920-4ecb-8068-68caa9806978+18:1960:x1830948734282496:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 51us (79us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129576.289124:0:20578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8510 00000100:00100000:0.0:1746129576.289153:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129576.289213:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129576.289224:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734282368 00000100:00100000:0.0:1746129576.289227:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734282368 00010000:00010000:0.0:1746129576.289236:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ee1be00/0x40a459093b06ad32 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f219c4 expref: 10 pid: 20577 timeout: 931 lvb_type: 1 00000100:00100000:1.0:1746129576.289238:0:31520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734281344 00000100:00100000:1.0:1746129576.289241:0:31520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734281344 00000100:00100000:0.0:1746129576.289247:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8511 00000100:00100000:0.0:1746129576.289252:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013145d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:068dab75-d300-4ead-a742-d14572ad1e50+10:1963:x1830948734282368:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129576.289257:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129576.289263:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ee1be00/0x40a459093b06ad32 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f219c4 expref: 10 pid: 20577 timeout: 931 lvb_type: 1 00002000:00100000:1.0:1746129576.289280:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3f3:0x0] (1679360->2097151) req@ffff88013145fb80 x1830948734281344/t0(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:317/0 lens 488/0 e 0 to 0 dl 1746129587 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:0.0:1746129576.289280:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ee1be00/0x40a459093b06ad32 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f219c4 expref: 10 pid: 20577 timeout: 931 lvb_type: 1 00002000:00100000:1.0:1746129576.289290:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013145fb80 with x1830948734281344 ext(1679360->2097151) 00010000:00010000:0.0:1746129576.289290:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ee1be00/0x40a459093b06ad32 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f219c4 expref: 10 pid: 20577 timeout: 931 lvb_type: 1 00010000:00010000:1.0:1746129576.289316:0:31520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a6ca1e00/0x40a459093b06acad lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1679360->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21954 expref: 20 pid: 22480 timeout: 931 lvb_type: 0 00010000:00010000:1.0:1746129576.289325:0:31520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a6ca1e00/0x40a459093b06acad lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1679360->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21954 expref: 20 pid: 22480 timeout: 931 lvb_type: 0 00002000:00010000:1.0:1746129576.289336:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88013145fb80 00000100:00100000:1.0:1746129576.289349:0:31520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734281600 00000100:00100000:1.0:1746129576.289351:0:31520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734281600 00002000:00100000:1.0:1746129576.289363:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3f4:0x0] (1048576->1257471) req@ffff88013145e300 x1830948734281600/t0(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:317/0 lens 488/0 e 0 to 0 dl 1746129587 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129576.289369:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013145e300 with x1830948734281600 ext(1048576->1257471) 00010000:00010000:1.0:1746129576.289374:0:31520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ee1b200/0x40a459093b06acb4 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1257471) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2195b expref: 21 pid: 22480 timeout: 931 lvb_type: 0 00010000:00010000:1.0:1746129576.289381:0:31520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ee1b200/0x40a459093b06acb4 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1257471) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2195b expref: 21 pid: 22480 timeout: 931 lvb_type: 0 00002000:00010000:1.0:1746129576.289386:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88013145e300 00000100:00100000:1.0:1746129576.289397:0:31520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2471 00000100:00100000:1.0:1746129576.289401:0:31520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013145fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:1963:x1830948734281344:12345-192.168.202.4@tcp:4:cat.0 00000100:00100000:2.0:1746129576.289502:0:22481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013145d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:22481:1830948737572864:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129576.289514:0:22481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095c59000/0x40a459093b06ad55 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f219a8 expref: 10 pid: 8410 timeout: 931 lvb_type: 1 00000100:00100000:2.0:1746129576.289529:0:22481:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013145ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:22481:1830948737572736:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129576.289553:0:22481:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012cd31800/0x40a459093b06ada9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 22481 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129576.289575:0:8411:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f44bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8411:1830948737573376:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129576.289585:0:8411:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009ee1a000/0x40a459093b06adc5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129576.289616:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129576.289629:0:15749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734281472 00000100:00100000:2.0:1746129576.289631:0:15749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734281472 00010000:00010000:2.0:1746129576.289646:0:15749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012eac2000/0x40a459093b06ad86 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f219ee expref: 9 pid: 4385 timeout: 931 lvb_type: 1 00000100:00100000:2.0:1746129576.289660:0:15749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8512 00000100:00100000:2.0:1746129576.289664:0:15749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6fd0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:068dab75-d300-4ead-a742-d14572ad1e50+9:1963:x1830948734281472:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129576.289675:0:15749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129576.289686:0:15749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012eac2000/0x40a459093b06ad86 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f219ee expref: 9 pid: 4385 timeout: 931 lvb_type: 1 00010000:00010000:2.0:1746129576.289694:0:15749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012eac2000/0x40a459093b06ad86 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f219ee expref: 9 pid: 4385 timeout: 931 lvb_type: 1 00010000:00010000:2.0:1746129576.289706:0:15749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129576.289724:0:15749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6fd0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:068dab75-d300-4ead-a742-d14572ad1e50+9:1963:x1830948734281472:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 59us (107us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129576.289729:0:15749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8512 00000100:00100000:2.0:1746129576.289758:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129576.289805:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129576.289836:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734282240 00000100:00100000:2.0:1746129576.289838:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734282240 00010000:00010000:2.0:1746129576.289848:0:7087:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009584e400/0x40a459093b06ad0f lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f219a1 expref: 22 pid: 8410 timeout: 931 lvb_type: 0 00000100:00100000:2.0:1746129576.289859:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734282624 00000100:00100000:2.0:1746129576.289861:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734282624 00010000:00010000:2.0:1746129576.289867:0:7087:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6caec00/0x40a459093b06ab64 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f218a5 expref: 12 pid: 22481 timeout: 931 lvb_type: 1 00000100:00100000:2.0:1746129576.289875:0:7087:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8513 00000100:00100000:2.0:1746129576.289878:0:7087:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f44bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+22:1963:x1830948734282240:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129576.289884:0:7087:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129576.289890:0:7087:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009584e400/0x40a459093b06ad0f lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f219a1 expref: 22 pid: 8410 timeout: 931 lvb_type: 0 00010000:00010000:2.0:1746129576.289898:0:7087:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009584e400/0x40a459093b06ad0f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f219a1 expref: 22 pid: 8410 timeout: 931 lvb_type: 0 00010000:00010000:2.0:1746129576.289908:0:7087:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129576.289909:0:7087:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129576.289914:0:7087:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ee1b800/0x40a459093b06adbe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129576.289920:0:7087:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ee1b800/0x40a459093b06adbe lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129576.289933:0:7087:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129576.289946:0:7087:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f44bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+22:1963:x1830948734282240:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 67us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129576.289950:0:7087:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8513 00000100:00100000:2.0:1746129576.289957:0:7087:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8514 00000100:00100000:2.0:1746129576.289961:0:7087:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f449f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+12:1963:x1830948734282624:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129576.289966:0:7087:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129576.289972:0:7087:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a6caec00/0x40a459093b06ab64 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f218a5 expref: 12 pid: 22481 timeout: 931 lvb_type: 1 00010000:00010000:2.0:1746129576.289978:0:7087:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a6caec00/0x40a459093b06ab64 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f218a5 expref: 12 pid: 22481 timeout: 931 lvb_type: 1 00010000:00010000:2.0:1746129576.289986:0:7087:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a6caec00/0x40a459093b06ab64 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f218a5 expref: 12 pid: 22481 timeout: 931 lvb_type: 1 00010000:00010000:2.0:1746129576.289998:0:7087:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129576.289999:0:7087:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129576.290001:0:7087:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880095fb0a00/0x40a459093b06ade1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129576.290006:0:7087:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095fb0a00/0x40a459093b06ade1 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129576.290016:0:7087:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129576.290024:0:7087:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f449f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+11:1963:x1830948734282624:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 63us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129576.290028:0:7087:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8514 00000100:00100000:2.0:1746129576.290077:0:21725:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2472 00000100:00100000:2.0:1746129576.290082:0:21725:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013145e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:1963:x1830948734281600:12345-192.168.202.4@tcp:4:cat.0 00010000:00010000:2.0:1746129576.290286:0:8410:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880095fb0a00/0x40a459093b06ade1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129576.291722:0:8410:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095fb0a00/0x40a459093b06ade1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129576.291750:0:8410:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880095fb0a00/0x40a459093b06ade1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129576.291758:0:8410:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880095fb0a00/0x40a459093b06ade1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129576.291770:0:8410:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880095fb0a00/0x40a459093b06ade1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129576.291776:0:8410:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095fb0a00 already unused, calling callback (ffffffffa086ed70) 00010000:00010000:2.0:1746129576.291780:0:8410:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880095fb0a00/0x40a459093b06ade1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129576.291787:0:8410:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880095fb0a00/0x40a459093b06ade1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129576.291802:0:8410:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880095fb0a00/0x40a459093b06ade1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129576.291808:0:8410:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095fb0a00/0x40a459093b06ade1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129576.291869:0:8410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baeed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:068dab75-d300-4ead-a742-d14572ad1e50+9:1962:x1830948734281088:12345-192.168.202.4@tcp:1:lfs.0 Request processed in 17654us (19235us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129576.291878:0:8410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16533 00010000:00010000:0.0:1746129576.292152:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129576.292348:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129576.292365:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129576.292391:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00010000:00010000:3.0:1746129576.292423:0:4385:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012eac2000/0x40a459093b06ad86 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f219ee expref: 8 pid: 4385 timeout: 931 lvb_type: 1 00000100:00100000:3.0:1746129576.292442:0:4385:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f44b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:4385:1830948737573120:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129576.292563:0:20578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734282752 00000100:00100000:2.0:1746129576.292568:0:20578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734282752 00010000:00010000:2.0:1746129576.292593:0:20578:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1ae00/0x40a459093b06ad9b lrc: 5/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f219f5 expref: 22 pid: 15096 timeout: 931 lvb_type: 0 00000100:00100000:2.0:1746129576.292611:0:20578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734282880 00000100:00100000:2.0:1746129576.292613:0:20578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734282880 00010000:00010000:2.0:1746129576.292622:0:20578:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009cdfc400/0x40a459093b06ac1a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21915 expref: 11 pid: 4699 timeout: 931 lvb_type: 0 00000100:00100000:2.0:1746129576.292634:0:20578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734283008 00000100:00100000:2.0:1746129576.292635:0:20578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734283008 00010000:00010000:2.0:1746129576.292644:0:20578:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009cdfd000/0x40a459093b06abaa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f218cf expref: 18 pid: 11014 timeout: 931 lvb_type: 1 00000100:00100000:2.0:1746129576.292654:0:20578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8515 00000100:00100000:2.0:1746129576.292660:0:20578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013145ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:068dab75-d300-4ead-a742-d14572ad1e50+22:1960:x1830948734282752:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129576.292670:0:20578:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129576.292675:0:20578:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1ae00/0x40a459093b06ad9b lrc: 5/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f219f5 expref: 22 pid: 15096 timeout: 931 lvb_type: 0 00010000:00010000:2.0:1746129576.292683:0:20578:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1ae00/0x40a459093b06ad9b lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f219f5 expref: 22 pid: 15096 timeout: 931 lvb_type: 0 00010000:00010000:2.0:1746129576.292700:0:20578:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:2.0:1746129576.292704:0:20578:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6cf6600/0x40a459093b06ade8 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129576.292714:0:20578:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6cf6600/0x40a459093b06ade8 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50290000000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129576.292720:0:20578:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6cf6600/0x40a459093b06ade8 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50290000000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129576.292734:0:20578:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129576.293636:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8516 00000100:00100000:0.0:1746129576.293645:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013145d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+11:1961:x1830948734282880:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129576.293656:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129576.293674:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009cdfc400/0x40a459093b06ac1a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21915 expref: 11 pid: 4699 timeout: 931 lvb_type: 0 00010000:00010000:0.0:1746129576.293682:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009cdfc400/0x40a459093b06ac1a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21915 expref: 11 pid: 4699 timeout: 931 lvb_type: 0 00010000:00010000:0.0:1746129576.293696:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cdfc400/0x40a459093b06ac1a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21915 expref: 11 pid: 4699 timeout: 931 lvb_type: 0 00010000:00010000:0.0:1746129576.293708:0:9823:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129576.293711:0:9823:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129576.293714:0:9823:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012cd31800/0x40a459093b06ada9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129576.293722:0:9823:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012cd31800/0x40a459093b06ada9 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129576.293739:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746129576.293752:0:22481:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012cd31800/0x40a459093b06ada9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129576.293760:0:22481:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012cd31800/0x40a459093b06ada9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129576.293780:0:22481:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012cd31800/0x40a459093b06ada9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129576.293788:0:22481:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012cd31800/0x40a459093b06ada9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129576.293795:0:22481:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012cd31800/0x40a459093b06ada9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129576.293800:0:22481:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012cd31800 already unused, calling callback (ffffffffa086ed70) 00010000:00010000:0.0:1746129576.293804:0:22481:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012cd31800/0x40a459093b06ada9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129576.293811:0:22481:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012cd31800/0x40a459093b06ada9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129576.293819:0:22481:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012cd31800/0x40a459093b06ada9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129576.293825:0:22481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012cd31800/0x40a459093b06ada9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 22481 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129576.293878:0:22481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:068dab75-d300-4ead-a742-d14572ad1e50+7:1962:x1830948734280576:12345-192.168.202.4@tcp:1:lfs.0 Request processed in 21086us (21440us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129576.293885:0:22481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16528 00000100:00100000:0.0:1746129576.293914:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013145d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+10:1961:x1830948734282880:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 270us (1547us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129576.293919:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8516 00000100:00100000:0.0:1746129576.293931:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8517 00000100:00100000:0.0:1746129576.293936:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800912aea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ada2ffba-8920-4ecb-8068-68caa9806978+18:1962:x1830948734283008:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129576.293943:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129576.293952:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009cdfd000/0x40a459093b06abaa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f218cf expref: 18 pid: 11014 timeout: 931 lvb_type: 1 00010000:00010000:0.0:1746129576.293961:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009cdfd000/0x40a459093b06abaa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f218cf expref: 18 pid: 11014 timeout: 931 lvb_type: 1 00010000:00010000:0.0:1746129576.293973:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cdfd000/0x40a459093b06abaa lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f218cf expref: 18 pid: 11014 timeout: 931 lvb_type: 1 00010000:00010000:0.0:1746129576.293983:0:9823:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129576.293985:0:9823:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129576.293987:0:9823:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f8e2200/0x40a459093b06adb7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129576.293993:0:9823:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f8e2200/0x40a459093b06adb7 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129576.294015:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129576.294031:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800912aea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ada2ffba-8920-4ecb-8068-68caa9806978+17:1962:x1830948734283008:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 94us (1639us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129576.294036:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8517 00010000:00010000:3.0:1746129576.297531:0:4385:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009584e400/0x40a459093b06ad0f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f219a1 expref: 23 pid: 8410 timeout: 931 lvb_type: 0 00000100:00100000:3.0:1746129576.297555:0:4385:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f44ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:4385:1830948737573248:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129576.297586:0:4385:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009ee1b800/0x40a459093b06adbe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129576.297596:0:4385:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009ee1b800/0x40a459093b06adbe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129576.297603:0:4385:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ee1b800/0x40a459093b06adbe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129576.297637:0:4385:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009ee1b800/0x40a459093b06adbe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129576.297644:0:4385:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009ee1b800/0x40a459093b06adbe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129576.297653:0:4385:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009ee1b800/0x40a459093b06adbe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129576.297660:0:4385:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ee1b800 already unused, calling callback (ffffffffa086ed70) 00010000:00010000:3.0:1746129576.297664:0:4385:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009ee1b800/0x40a459093b06adbe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129576.297671:0:4385:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009ee1b800/0x40a459093b06adbe lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129576.297690:0:4385:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009ee1b800/0x40a459093b06adbe lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129576.297695:0:4385:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ee1b800/0x40a459093b06adbe lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129576.297775:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:068dab75-d300-4ead-a742-d14572ad1e50+7:1962:x1830948734281216:12345-192.168.202.4@tcp:1:lfs.0 Request processed in 24125us (25181us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129576.297785:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16531 00010000:00010000:3.0:1746129576.297887:0:16908:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1ae00/0x40a459093b06ad9b lrc: 0/0,0 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f219f5 expref: 22 pid: 15096 timeout: 931 lvb_type: 0 00000100:00100000:3.0:1746129576.297898:0:16908:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f449880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16908:1830948737574272:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129576.297908:0:16908:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6cf6600/0x40a459093b06ade8 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129576.297914:0:16908:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6cf6600/0x40a459093b06ade8 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129576.297918:0:16908:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6cf6600/0x40a459093b06ade8 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00000004:00200000:3.0:1746129576.297934:0:16908:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:3.0:1746129576.298050:0:16908:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6cf6600/0x40a459093b06ade8 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129576.298055:0:16908:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6cf6600/0x40a459093b06ade8 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129576.298059:0:16908:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6cf6600/0x40a459093b06ade8 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129576.298064:0:16908:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a6cf6600 already unused, calling callback (ffffffffa136e690) 00010000:00010000:3.0:1746129576.298067:0:16908:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6cf6600/0x40a459093b06ade8 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129576.298071:0:16908:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6cf6600/0x40a459093b06ade8 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129576.298082:0:16908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:3.0:1746129576.298085:0:16908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746129576.298087:0:16908:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6cf6600/0x40a459093b06ade8 lrc: 2/0,0 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129576.298091:0:16908:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6cf6600/0x40a459093b06ade8 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129576.298105:0:16908:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6cf7400/0x40a459093b06add3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129576.298109:0:16908:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6cf7400/0x40a459093b06add3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129576.298114:0:16908:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6cf7400/0x40a459093b06add3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129576.298120:0:16908:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a6cf7400 already unused, calling callback (ffffffffa136e690) 00010000:00010000:3.0:1746129576.298122:0:16908:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6cf7400/0x40a459093b06add3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129576.298127:0:16908:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6cf7400/0x40a459093b06add3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129576.298134:0:16908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880132ef8f00) 00010000:00010000:3.0:1746129576.298135:0:16908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129576.298137:0:16908:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6cf7400/0x40a459093b06add3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129576.298141:0:16908:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6cf7400/0x40a459093b06add3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129576.298147:0:16908:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6cf6200/0x40a459093b06adda lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129576.298152:0:16908:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6cf6200/0x40a459093b06adda lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129576.298156:0:16908:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6cf6200/0x40a459093b06adda lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129576.298159:0:16908:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a6cf6200 already unused, calling callback (ffffffffa136e690) 00010000:00010000:3.0:1746129576.298161:0:16908:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6cf6200/0x40a459093b06adda lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129576.298166:0:16908:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6cf6200/0x40a459093b06adda lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129576.298171:0:16908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009ce7a500) 00010000:00010000:3.0:1746129576.298173:0:16908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129576.298176:0:16908:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6cf6200/0x40a459093b06adda lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129576.298180:0:16908:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6cf6200/0x40a459093b06adda lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129576.298227:0:16908:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6cf7000/0x40a459093b06adcc lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f219fc expref: 316 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129576.298234:0:16908:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6cf7000/0x40a459093b06adcc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f219fc expref: 316 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129576.298241:0:16908:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6cf7000, rc 0) 00000100:00100000:3.0:1746129576.298280:0:16908:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ada2ffba-8920-4ecb-8068-68caa9806978+315:32482:x1830948734280448:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 24223us (25756us total) trans 8589945414 rc 301/301 00000100:00100000:3.0:1746129576.298287:0:16908:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11301 00010000:00010000:3.0:1746129576.298407:0:20577:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009f8e2200/0x40a459093b06adb7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129576.298415:0:20577:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f8e2200/0x40a459093b06adb7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129576.298435:0:20577:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009f8e2200/0x40a459093b06adb7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129576.298440:0:20577:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009f8e2200/0x40a459093b06adb7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129576.298447:0:20577:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009f8e2200/0x40a459093b06adb7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129576.298453:0:20577:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f8e2200 already unused, calling callback (ffffffffa086ed70) 00010000:00010000:3.0:1746129576.298455:0:20577:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f8e2200/0x40a459093b06adb7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129576.298461:0:20577:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f8e2200/0x40a459093b06adb7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129576.298471:0:20577:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009f8e2200/0x40a459093b06adb7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129576.298476:0:20577:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f8e2200/0x40a459093b06adb7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129576.298509:0:20577:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:068dab75-d300-4ead-a742-d14572ad1e50+6:1962:x1830948734280960:12345-192.168.202.4@tcp:1:lfs.0 Request processed in 25249us (25949us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129576.298515:0:20577:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16530 00000100:00100000:2.0:1746129576.299439:0:20578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013145ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:068dab75-d300-4ead-a742-d14572ad1e50+21:1960:x1830948734282752:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 6773us (7086us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129576.299450:0:20578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8515 00000100:00100000:2.0:1746129576.299488:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013145d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:068dab75-d300-4ead-a742-d14572ad1e50+5:1963:x1830948734282368:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 10235us (10274us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129576.299494:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8511 00000100:00100000:1.0:1746129576.303813:0:21725:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013145e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+23:1963:x1830948734281600:12345-192.168.202.4@tcp:4:cat.0 Request processed in 13712us (14640us total) trans 17179874156 rc 0/0 00000100:00100000:1.0:1746129576.303829:0:21725:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2472 00002000:00100000:1.0:1746129576.303848:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f4:0x0] (1048576->1257471) req@ffff88013145e300 x1830948734281600/t17179874156(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:317/0 lens 488/448 e 0 to 0 dl 1746129587 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129576.303858:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013145e300 with x1830948734281600 ext(1048576->1257471) 00010000:00010000:1.0:1746129576.303871:0:21725:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ee1b200/0x40a459093b06acb4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1257471) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2195b expref: 23 pid: 22480 timeout: 931 lvb_type: 0 00010000:00010000:1.0:1746129576.303892:0:21725:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ee1b200/0x40a459093b06acb4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1257471) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2195b expref: 23 pid: 22480 timeout: 931 lvb_type: 0 00002000:00010000:1.0:1746129576.303899:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88013145e300 00000100:00100000:0.0:1746129576.319836:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129576.321729:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734283136 00000100:00100000:2.0:1746129576.321744:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734283136 00010000:00010000:2.0:1746129576.321798:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ee1b200/0x40a459093b06acb4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1257471) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2195b expref: 23 pid: 22480 timeout: 931 lvb_type: 0 00000100:00100000:2.0:1746129576.321845:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8518 00000100:00100000:2.0:1746129576.321854:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800912adc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+23:1960:x1830948734283136:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129576.321869:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129576.321896:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ee1b200/0x40a459093b06acb4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1257471) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2195b expref: 23 pid: 22480 timeout: 931 lvb_type: 0 00010000:00010000:2.0:1746129576.321907:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ee1b200/0x40a459093b06acb4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1257471) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2195b expref: 23 pid: 22480 timeout: 931 lvb_type: 0 00010000:00010000:2.0:1746129576.321931:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ee1b200/0x40a459093b06acb4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1257471) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2195b expref: 23 pid: 22480 timeout: 931 lvb_type: 0 00010000:00010000:2.0:1746129576.321952:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129576.321955:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129576.321959:0:7085:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ee1a000/0x40a459093b06adc5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129576.321968:0:7085:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ee1a000/0x40a459093b06adc5 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129576.321998:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129576.322049:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800912adc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+22:1960:x1830948734283136:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 197us (2224us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129576.322057:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8518 00010000:00010000:2.0:1746129576.322081:0:8411:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009ee1a000/0x40a459093b06adc5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129576.322090:0:8411:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ee1a000/0x40a459093b06adc5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129576.322111:0:8411:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009ee1a000/0x40a459093b06adc5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129576.322118:0:8411:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009ee1a000/0x40a459093b06adc5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129576.322125:0:8411:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009ee1a000/0x40a459093b06adc5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129576.322131:0:8411:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ee1a000 already unused, calling callback (ffffffffa086ed70) 00010000:00010000:2.0:1746129576.322134:0:8411:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009ee1a000/0x40a459093b06adc5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129576.322141:0:8411:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009ee1a000/0x40a459093b06adc5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129576.322154:0:8411:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009ee1a000/0x40a459093b06adc5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129576.322160:0:8411:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ee1a000/0x40a459093b06adc5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129576.322201:0:8411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:068dab75-d300-4ead-a742-d14572ad1e50+6:1962:x1830948734280832:12345-192.168.202.4@tcp:1:lfs.0 Request processed in 48367us (49590us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129576.322210:0:8411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16532 00000100:00100000:2.0:1746129576.327048:0:31520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013145fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+22:1963:x1830948734281344:12345-192.168.202.4@tcp:4:cat.0 Request processed in 37633us (38606us total) trans 17179874157 rc 0/0 00000100:00100000:2.0:1746129576.327063:0:31520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2471 00002000:00100000:2.0:1746129576.327075:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3f3:0x0] (1679360->2097151) req@ffff88013145fb80 x1830948734281344/t17179874157(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:317/0 lens 488/448 e 0 to 0 dl 1746129587 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129576.327085:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013145fb80 with x1830948734281344 ext(1679360->2097151) 00010000:00010000:2.0:1746129576.327097:0:31520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a6ca1e00/0x40a459093b06acad lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1679360->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21954 expref: 22 pid: 22480 timeout: 931 lvb_type: 0 00010000:00010000:2.0:1746129576.327113:0:31520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a6ca1e00/0x40a459093b06acad lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1679360->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21954 expref: 22 pid: 22480 timeout: 931 lvb_type: 0 00002000:00010000:2.0:1746129576.327121:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88013145fb80 00000100:00100000:0.0:1746129576.333591:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129576.333717:0:20578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734283264 00000100:00100000:3.0:1746129576.333729:0:20578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734283264 00010000:00010000:3.0:1746129576.333770:0:20578:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6ca1e00/0x40a459093b06acad lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1679360->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21954 expref: 22 pid: 22480 timeout: 931 lvb_type: 0 00000100:00100000:3.0:1746129576.334114:0:20578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8519 00000100:00100000:3.0:1746129576.334122:0:20578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6fd0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+22:1961:x1830948734283264:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129576.334137:0:20578:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129576.334161:0:20578:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a6ca1e00/0x40a459093b06acad lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1679360->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21954 expref: 22 pid: 22480 timeout: 931 lvb_type: 0 00010000:00010000:3.0:1746129576.334175:0:20578:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a6ca1e00/0x40a459093b06acad lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1679360->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21954 expref: 22 pid: 22480 timeout: 931 lvb_type: 0 00010000:00010000:3.0:1746129576.334199:0:20578:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a6ca1e00/0x40a459093b06acad lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1679360->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21954 expref: 22 pid: 22480 timeout: 931 lvb_type: 0 00010000:00010000:3.0:1746129576.334263:0:20578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129576.334273:0:20578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129576.334278:0:20578:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012cd31200/0x40a459093b06adb0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129576.334287:0:20578:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012cd31200/0x40a459093b06adb0 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129576.334594:0:20578:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129576.334639:0:20578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6fd0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:1961:x1830948734283264:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 518us (1060us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129576.334647:0:20578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8519 00010000:00010000:1.0:1746129576.334899:0:8412:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012cd31200/0x40a459093b06adb0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129576.334907:0:8412:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012cd31200/0x40a459093b06adb0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129576.334930:0:8412:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012cd31200/0x40a459093b06adb0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129576.334937:0:8412:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012cd31200/0x40a459093b06adb0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129576.334944:0:8412:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012cd31200/0x40a459093b06adb0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129576.334950:0:8412:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012cd31200 already unused, calling callback (ffffffffa086ed70) 00010000:00010000:1.0:1746129576.334954:0:8412:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012cd31200/0x40a459093b06adb0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129576.334961:0:8412:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012cd31200/0x40a459093b06adb0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129576.334976:0:8412:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012cd31200/0x40a459093b06adb0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129576.334981:0:8412:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012cd31200/0x40a459093b06adb0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129576.335052:0:8412:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:068dab75-d300-4ead-a742-d14572ad1e50+5:1962:x1830948734280704:12345-192.168.202.4@tcp:1:lfs.0 Request processed in 61905us (62505us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129576.335061:0:8412:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16529 00000100:00100000:2.0:1746129576.338687:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129576.338790:0:16908:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734283520 00000100:00100000:3.0:1746129576.338800:0:16908:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734283520 00000100:00100000:3.0:1746129576.338899:0:16908:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11302 00000100:00100000:3.0:1746129576.338908:0:16908:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f449500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:068dab75-d300-4ead-a742-d14572ad1e50+21:32478:x1830948734283520:12345-192.168.202.4@tcp:36:lfs.0 00010000:00010000:3.0:1746129576.338966:0:16908:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129576.338995:0:16908:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8e2000/0x40a459093b06ad78 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f219d9 expref: 21 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129576.339367:0:16908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:3.0:1746129576.339373:0:16908:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129576.339576:0:16908:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f449500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:068dab75-d300-4ead-a742-d14572ad1e50+20:32478:x1830948734283520:12345-192.168.202.4@tcp:36:lfs.0 Request processed in 668us (900us total) trans 0 rc -116/-116 00000100:00100000:3.0:1746129576.339583:0:16908:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11302 00000100:00100000:0.0:1746129576.342970:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129576.343076:0:20861:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734283776 00000100:00100000:2.0:1746129576.343086:0:20861:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734283776 00000100:00100000:2.0:1746129576.343148:0:20861:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4811 00000100:00100000:2.0:1746129576.343156:0:20861:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800912ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:068dab75-d300-4ead-a742-d14572ad1e50+20:32478:x1830948734283776:12345-192.168.202.4@tcp:35:lfs.0 00000100:00100000:2.0:1746129576.343804:0:20861:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800912ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:068dab75-d300-4ead-a742-d14572ad1e50+21:32478:x1830948734283776:12345-192.168.202.4@tcp:35:lfs.0 Request processed in 648us (844us total) trans 8589945415 rc 0/0 00000100:00100000:2.0:1746129576.343812:0:20861:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4811 00000100:00100000:0.0:1746129576.345372:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129576.346202:0:20861:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734284032 00000100:00100000:2.0:1746129576.346210:0:20861:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734284032 00000100:00100000:2.0:1746129576.346275:0:20861:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4812 00000100:00100000:2.0:1746129576.346283:0:20861:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800912ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:068dab75-d300-4ead-a742-d14572ad1e50+21:32478:x1830948734284032:12345-192.168.202.4@tcp:35:lfs.0 00000100:00100000:2.0:1746129576.346481:0:20861:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800912ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:068dab75-d300-4ead-a742-d14572ad1e50+22:32478:x1830948734284032:12345-192.168.202.4@tcp:35:lfs.0 Request processed in 199us (1112us total) trans 8589945416 rc 0/0 00000100:00100000:2.0:1746129576.346488:0:20861:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4812 00000100:00100000:0.0:1746129576.379863:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129576.380172:0:16908:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734284288 00000100:00100000:3.0:1746129576.380183:0:16908:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734284288 00000100:00100000:3.0:1746129576.380801:0:16908:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11303 00000100:00100000:3.0:1746129576.380812:0:16908:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800912aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+28:32486:x1830948734284288:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:3.0:1746129576.380837:0:16908:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129576.380856:0:16908:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012eac2800/0x40a459093b06adf6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21a03 expref: -99 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129576.380967:0:16908:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012eac2400/0x40a459093b06adfd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129576.380980:0:16908:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012eac2400/0x40a459093b06adfd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129576.380991:0:16908:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012eac2400/0x40a459093b06adfd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129576.381004:0:16908:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012eac3800/0x40a459093b06ae04 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129576.381011:0:16908:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012eac3800/0x40a459093b06ae04 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129576.381016:0:16908:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012eac3800/0x40a459093b06ae04 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129576.381126:0:16908:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012eac3c00/0x40a459093b06ae0b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129576.381135:0:16908:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012eac3c00/0x40a459093b06ae0b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129576.381141:0:16908:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012eac3c00/0x40a459093b06ae0b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00000004:00200000:3.0:1746129576.381150:0:16908:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:3.0:1746129576.381237:0:16908:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012eac2400/0x40a459093b06adfd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129576.381244:0:16908:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012eac2400/0x40a459093b06adfd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129576.381249:0:16908:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012eac2400/0x40a459093b06adfd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129576.381255:0:16908:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012eac2400 already unused, calling callback (ffffffffa136e690) 00010000:00010000:3.0:1746129576.381258:0:16908:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012eac2400/0x40a459093b06adfd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129576.381275:0:16908:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012eac2400/0x40a459093b06adfd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129576.381310:0:16908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880132ef8f00) 00010000:00010000:3.0:1746129576.381313:0:16908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129576.381319:0:16908:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012eac2400/0x40a459093b06adfd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129576.381324:0:16908:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012eac2400/0x40a459093b06adfd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129576.381368:0:16908:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012eac3800/0x40a459093b06ae04 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129576.381376:0:16908:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012eac3800/0x40a459093b06ae04 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129576.381382:0:16908:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012eac3800/0x40a459093b06ae04 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129576.381386:0:16908:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012eac3800 already unused, calling callback (ffffffffa136e690) 00010000:00010000:3.0:1746129576.381388:0:16908:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012eac3800/0x40a459093b06ae04 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129576.381393:0:16908:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012eac3800/0x40a459093b06ae04 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129576.381399:0:16908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880136997000) 00010000:00010000:3.0:1746129576.381402:0:16908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129576.381404:0:16908:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012eac3800/0x40a459093b06ae04 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129576.381409:0:16908:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012eac3800/0x40a459093b06ae04 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129576.381456:0:16908:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012eac2800/0x40a459093b06adf6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21a03 expref: 31 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129576.381469:0:16908:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012eac3c00/0x40a459093b06ae0b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21a03 expref: 30 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129576.381476:0:16908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:3.0:1746129576.381479:0:16908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746129576.381481:0:16908:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012eac3c00, rc 0) 00000100:00100000:3.0:1746129576.384846:0:16908:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800912aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+30:32486:x1830948734284288:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 4022us (4981us total) trans 8589945417 rc 0/0 00000100:00100000:3.0:1746129576.384858:0:16908:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11303 00000100:00100000:0.0:1746129576.406400:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129576.406447:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129576.406473:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129576.406500:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129576.406515:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129576.406544:0:22481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734284416 00000100:00100000:0.0:1746129576.406552:0:22481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734284416 00000100:00100000:0.0:1746129576.406594:0:22481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734284544 00000100:00100000:0.0:1746129576.406596:0:22481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734284544 00000100:00100000:0.0:1746129576.406607:0:22481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734284672 00000100:00100000:0.0:1746129576.406609:0:22481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734284672 00000100:00100000:0.0:1746129576.406617:0:22481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734284928 00000100:00100000:0.0:1746129576.406619:0:22481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734284928 00000100:00100000:0.0:1746129576.406627:0:22481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734284800 00000100:00100000:0.0:1746129576.406629:0:22481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734284800 00000100:00100000:0.0:1746129576.406643:0:22481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16534 00000100:00100000:0.0:1746129576.406650:0:22481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800912adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+12:1962:x1830948734284416:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129576.406670:0:22481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129576.406690:0:22481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f91aa00/0x40a459093b06ae19 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21a0a expref: -99 pid: 22481 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746129576.406718:0:22481:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3ec:0x0] initial LVB size: 1048576, mtime: 0x6813d2a8, atime: 0x6813d2a3, ctime: 0x6813d2a8, blocks: 0x819 00010000:00010000:0.0:1746129576.406740:0:22481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129576.406742:0:22481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129576.406751:0:22481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f91aa00/0x40a459093b06ae19 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21a0a expref: 13 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129576.406772:0:22481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f91aa00/0x40a459093b06ae19 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21a0a expref: 13 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129576.406783:0:22481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f91aa00, rc 0) 00000100:00100000:0.0:1746129576.406827:0:22481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800912adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+13:1962:x1830948734284416:12345-192.168.202.4@tcp:101:cat.0 Request processed in 178us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129576.406833:0:22481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16534 00000100:00100000:0.0:1746129576.406851:0:22481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16535 00000100:00100000:0.0:1746129576.406855:0:22481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+22:1963:x1830948734284544:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129576.406862:0:22481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129576.406874:0:22481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f91b600/0x40a459093b06ae20 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21a11 expref: -99 pid: 22481 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746129576.406889:0:22481:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3f3:0x0] initial LVB size: 2097152, mtime: 0x6813d2a8, atime: 0x6813d2a8, ctime: 0x6813d2a8, blocks: 0x821 00010000:00010000:0.0:1746129576.406898:0:22481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129576.406899:0:22481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129576.406903:0:22481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f91b600/0x40a459093b06ae20 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21a11 expref: 23 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129576.406913:0:22481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f91b600/0x40a459093b06ae20 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21a11 expref: 23 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129576.406920:0:22481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f91b600, rc 0) 00000100:00100000:0.0:1746129576.406936:0:22481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+23:1963:x1830948734284544:12345-192.168.202.4@tcp:101:cat.0 Request processed in 80us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129576.406944:0:22481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16535 00000100:00100000:0.0:1746129576.406953:0:22481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16536 00000100:00100000:0.0:1746129576.406957:0:22481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+22:1962:x1830948734284672:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129576.406963:0:22481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129576.406970:0:22481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f91b400/0x40a459093b06ae27 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21a18 expref: -99 pid: 22481 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746129576.406979:0:22481:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3f4:0x0] initial LVB size: 2097152, mtime: 0x6813d2a8, atime: 0x6813d2a8, ctime: 0x6813d2a8, blocks: 0x81f 00010000:00010000:0.0:1746129576.406986:0:22481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129576.406987:0:22481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129576.406990:0:22481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f91b400/0x40a459093b06ae27 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21a18 expref: 23 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129576.406998:0:22481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f91b400/0x40a459093b06ae27 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21a18 expref: 23 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129576.407004:0:22481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f91b400, rc 0) 00000100:00100000:0.0:1746129576.407019:0:22481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+23:1962:x1830948734284672:12345-192.168.202.4@tcp:101:cat.0 Request processed in 62us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129576.407024:0:22481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16536 00000100:00100000:0.0:1746129576.407033:0:22481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16537 00000100:00100000:0.0:1746129576.407036:0:22481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+12:1962:x1830948734284928:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129576.407042:0:22481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129576.407048:0:22481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f91b200/0x40a459093b06ae2e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21a26 expref: -99 pid: 22481 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746129576.407063:0:22481:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3ef:0x0] initial LVB size: 5146336, mtime: 0x6813d2a8, atime: 0x6813d2a8, ctime: 0x6813d2a8, blocks: 0x1791 00010000:00010000:0.0:1746129576.407070:0:22481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129576.407071:0:22481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129576.407075:0:22481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f91b200/0x40a459093b06ae2e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21a26 expref: 13 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129576.407083:0:22481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f91b200/0x40a459093b06ae2e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21a26 expref: 13 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129576.407089:0:22481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f91b200, rc 0) 00000100:00100000:0.0:1746129576.407103:0:22481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+13:1962:x1830948734284928:12345-192.168.202.4@tcp:101:cat.0 Request processed in 66us (603us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129576.407108:0:22481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16537 00000100:00100000:0.0:1746129576.407117:0:22481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16538 00000100:00100000:0.0:1746129576.407121:0:22481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+12:1962:x1830948734284800:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129576.407126:0:22481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129576.407133:0:22481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f91a200/0x40a459093b06ae35 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21a1f expref: -99 pid: 22481 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746129576.407143:0:22481:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3ee:0x0] initial LVB size: 2097152, mtime: 0x6813d2a7, atime: 0x6813d2a7, ctime: 0x6813d2a7, blocks: 0x81f 00010000:00010000:0.0:1746129576.407151:0:22481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129576.407152:0:22481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129576.407155:0:22481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f91a200/0x40a459093b06ae35 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21a1f expref: 13 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129576.407168:0:22481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f91a200/0x40a459093b06ae35 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21a1f expref: 13 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129576.407175:0:22481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f91a200, rc 0) 00000100:00100000:0.0:1746129576.407189:0:22481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+13:1962:x1830948734284800:12345-192.168.202.4@tcp:101:cat.0 Request processed in 68us (673us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129576.407194:0:22481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16538 00000100:00100000:0.0:1746129576.407241:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129576.407256:0:4699:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734285056 00000100:00100000:0.0:1746129576.407259:0:4699:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734285056 00000100:00100000:0.0:1746129576.407288:0:4699:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16539 00000100:00100000:0.0:1746129576.407327:0:4699:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+23:1962:x1830948734285056:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129576.407333:0:4699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129576.407341:0:4699:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f91a000/0x40a459093b06ae3c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21a2d expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746129576.407353:0:4699:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3f5:0x0] initial LVB size: 4194304, mtime: 0x6813d2a8, atime: 0x6813d2a8, ctime: 0x6813d2a8, blocks: 0x1029 00010000:00010000:0.0:1746129576.407360:0:4699:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129576.407361:0:4699:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129576.407365:0:4699:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f91a000/0x40a459093b06ae3c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21a2d expref: 24 pid: 4699 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129576.407373:0:4699:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f91a000/0x40a459093b06ae3c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21a2d expref: 24 pid: 4699 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129576.407384:0:4699:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f91a000, rc 0) 00000100:00100000:0.0:1746129576.407398:0:4699:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+24:1962:x1830948734285056:12345-192.168.202.4@tcp:101:cat.0 Request processed in 105us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129576.407402:0:4699:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16539 00000100:00100000:0.0:1746129576.435089:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129576.437655:0:16908:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734285312 00000100:00100000:3.0:1746129576.437670:0:16908:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734285312 00000100:00100000:3.0:1746129576.437751:0:16908:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11304 00000100:00100000:3.0:1746129576.437759:0:16908:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ada2ffba-8920-4ecb-8068-68caa9806978+315:32491:x1830948734285312:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129576.437789:0:16908:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129576.437808:0:16908:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012eac2000/0x40a459093b06ae43 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21a34 expref: -99 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129576.437923:0:16908:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012eac3600/0x40a459093b06ae4a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129576.437937:0:16908:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012eac3600/0x40a459093b06ae4a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129576.437947:0:16908:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012eac3600/0x40a459093b06ae4a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129576.437961:0:16908:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012eac2200/0x40a459093b06ae51 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129576.437966:0:16908:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012eac2200/0x40a459093b06ae51 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129576.437971:0:16908:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012eac2200/0x40a459093b06ae51 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129576.438083:0:16908:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012eac2600/0x40a459093b06ae58 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129576.438093:0:16908:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012eac2600/0x40a459093b06ae58 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129576.438099:0:16908:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012eac2600/0x40a459093b06ae58 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00000004:00200000:3.0:1746129576.438108:0:16908:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:3.0:1746129576.438197:0:16908:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012eac3600/0x40a459093b06ae4a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129576.438203:0:16908:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012eac3600/0x40a459093b06ae4a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129576.438209:0:16908:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012eac3600/0x40a459093b06ae4a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129576.438214:0:16908:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012eac3600 already unused, calling callback (ffffffffa136e690) 00010000:00010000:3.0:1746129576.438218:0:16908:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012eac3600/0x40a459093b06ae4a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129576.438224:0:16908:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012eac3600/0x40a459093b06ae4a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129576.438234:0:16908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880132ef8f00) 00010000:00010000:3.0:1746129576.438237:0:16908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129576.438241:0:16908:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012eac3600/0x40a459093b06ae4a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129576.438246:0:16908:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012eac3600/0x40a459093b06ae4a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129576.438336:0:16908:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012eac2200/0x40a459093b06ae51 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129576.438347:0:16908:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012eac2200/0x40a459093b06ae51 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129576.438352:0:16908:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012eac2200/0x40a459093b06ae51 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129576.438356:0:16908:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012eac2200 already unused, calling callback (ffffffffa136e690) 00010000:00010000:3.0:1746129576.438359:0:16908:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012eac2200/0x40a459093b06ae51 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129576.438363:0:16908:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012eac2200/0x40a459093b06ae51 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129576.438369:0:16908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880136997f00) 00010000:00010000:3.0:1746129576.438372:0:16908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129576.438374:0:16908:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012eac2200/0x40a459093b06ae51 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129576.438378:0:16908:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012eac2200/0x40a459093b06ae51 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129576.438418:0:16908:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012eac2000/0x40a459093b06ae43 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21a34 expref: 318 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129576.438430:0:16908:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012eac2600/0x40a459093b06ae58 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21a34 expref: 317 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129576.438437:0:16908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:3.0:1746129576.438439:0:16908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746129576.438442:0:16908:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012eac2600, rc 0) 00000100:00100000:3.0:1746129576.438526:0:16908:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ada2ffba-8920-4ecb-8068-68caa9806978+317:32491:x1830948734285312:12345-192.168.202.4@tcp:101:cat.0 Request processed in 766us (3447us total) trans 8589945418 rc 0/0 00000100:00100000:3.0:1746129576.438533:0:16908:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11304 00000100:00100000:0.0:1746129576.443847:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129576.443883:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129576.443924:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129576.444015:0:21725:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734285568 00000100:00100000:1.0:1746129576.444025:0:21725:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734285568 00002000:00100000:1.0:1746129576.444073:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ec:0x0] (0->1048575) req@ffff8800903a1f80 x1830948734285568/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:317/0 lens 488/0 e 0 to 0 dl 1746129587 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129576.444084:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800903a1f80 with x1830948734285568 ext(0->1048575) 00002000:00010000:1.0:1746129576.444089:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800903a1f80 00000100:00100000:1.0:1746129576.444105:0:21725:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734285824 00000100:00100000:1.0:1746129576.444107:0:21725:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734285824 00002000:00100000:1.0:1746129576.444116:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff8800903a2300 x1830948734285824/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:317/0 lens 488/0 e 0 to 0 dl 1746129587 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129576.444122:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800903a2300 with x1830948734285824 ext(1048576->2097151) 00002000:00010000:1.0:1746129576.444124:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800903a2300 00000100:00100000:1.0:1746129576.444131:0:21725:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734286080 00000100:00100000:1.0:1746129576.444133:0:21725:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734286080 00002000:00100000:1.0:1746129576.444139:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f4:0x0] (1048576->2097151) req@ffff8800903a1880 x1830948734286080/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:317/0 lens 488/0 e 0 to 0 dl 1746129587 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129576.444150:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800903a1880 with x1830948734286080 ext(1048576->2097151) 00002000:00010000:1.0:1746129576.444153:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800903a1880 00000100:00100000:1.0:1746129576.444163:0:21725:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7977 00000100:00100000:1.0:1746129576.444169:0:21725:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800903a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+13:1963:x1830948734285568:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:1.0:1746129576.446459:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7978 00000100:00100000:1.0:1746129576.446474:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800903a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+25:1963:x1830948734285824:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:2.0:1746129576.447359:0:31520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7979 00000100:00100000:2.0:1746129576.447373:0:31520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800903a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+26:1963:x1830948734286080:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129576.454262:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129576.454353:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129576.454417:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734286592 00000100:00100000:3.0:1746129576.454426:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734286592 00000100:00100000:3.0:1746129576.454469:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4813 00000100:00100000:3.0:1746129576.454476:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094cca050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ada2ffba-8920-4ecb-8068-68caa9806978+317:32491:x1830948734286592:12345-192.168.202.4@tcp:35:cat.0 00000100:00100000:3.0:1746129576.455184:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094cca050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ada2ffba-8920-4ecb-8068-68caa9806978+318:32491:x1830948734286592:12345-192.168.202.4@tcp:35:cat.0 Request processed in 706us (931us total) trans 8589945419 rc 0/0 00000100:00100000:3.0:1746129576.455191:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4813 00000100:00100000:2.0:1746129576.455721:0:31519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734286336 00000100:00100000:2.0:1746129576.455728:0:31519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734286336 00002000:00100000:2.0:1746129576.455762:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3ee:0x0] (1048576->2097151) req@ffff8800903a1180 x1830948734286336/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:317/0 lens 488/0 e 0 to 0 dl 1746129587 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129576.455773:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800903a1180 with x1830948734286336 ext(1048576->2097151) 00002000:00010000:2.0:1746129576.455778:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800903a1180 00000100:00100000:2.0:1746129576.455797:0:31519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7980 00000100:00100000:2.0:1746129576.455802:0:31519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800903a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+15:1963:x1830948734286336:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:1.0:1746129576.467061:0:21725:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800903a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+15:1963:x1830948734285568:12345-192.168.202.4@tcp:3:cat.0 Request processed in 22880us (23214us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129576.467074:0:21725:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7977 00002000:00100000:1.0:1746129576.467086:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ec:0x0] (0->1048575) req@ffff8800903a1f80 x1830948734285568/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:317/0 lens 488/440 e 0 to 0 dl 1746129587 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129576.467096:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800903a1f80 with x1830948734285568 ext(0->1048575) 00002000:00010000:1.0:1746129576.467102:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800903a1f80 00000100:00100000:0.0:1746129576.471774:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129576.472243:0:31520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800903a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+26:1963:x1830948734286080:12345-192.168.202.4@tcp:3:cat.0 Request processed in 24872us (28315us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129576.472257:0:31520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7979 00002000:00100000:2.0:1746129576.472283:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3f4:0x0] (1048576->2097151) req@ffff8800903a1880 x1830948734286080/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:317/0 lens 488/440 e 0 to 0 dl 1746129587 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129576.472321:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800903a1880 with x1830948734286080 ext(1048576->2097151) 00002000:00010000:2.0:1746129576.472327:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800903a1880 00000100:00100000:3.0:1746129576.472479:0:20577:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734286720 00000100:00100000:3.0:1746129576.472488:0:20577:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734286720 00000100:00100000:3.0:1746129576.472540:0:20577:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16540 00000100:00100000:3.0:1746129576.472547:0:20577:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800903a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+26:32486:x1830948734286720:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:3.0:1746129576.472563:0:20577:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129576.472582:0:20577:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091b63000/0x40a459093b06ae66 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21a3b expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129576.472610:0:20577:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f91a000/0x40a459093b06ae3c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21a2d expref: 27 pid: 4699 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129576.472618:0:20577:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129576.472620:0:20577:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129576.472623:0:20577:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091b63000/0x40a459093b06ae66 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [4018176->4194303] (req 4018176->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21a3b expref: 27 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129576.472655:0:20577:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f91a000/0x40a459093b06ae3c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21a2d expref: 27 pid: 4699 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129576.472672:0:20577:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f91a000/0x40a459093b06ae3c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21a2d expref: 27 pid: 4699 timeout: 931 lvb_type: 1 00000100:00100000:3.0:1746129576.472683:0:20577:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20577:1830948737574400:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129576.473621:0:20577:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa381d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746129576.479963:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129576.480006:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129576.480037:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129576.480066:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734286976 00000100:00100000:0.0:1746129576.480075:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734286976 00000100:00100000:0.0:1746129576.480115:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734287232 00000100:00100000:0.0:1746129576.480117:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734287232 00000100:00100000:0.0:1746129576.480128:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734287488 00000100:00100000:0.0:1746129576.480129:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734287488 00000100:00100000:0.0:1746129576.480143:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16541 00000100:00100000:0.0:1746129576.480150:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800903a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ada2ffba-8920-4ecb-8068-68caa9806978+28:1963:x1830948734286976:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129576.480170:0:4385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129576.480190:0:4385:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f890200/0x40a459093b06ae6d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21a49 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129576.480219:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129576.480222:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129576.480230:0:4385:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f890200/0x40a459093b06ae6d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21a49 expref: 29 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129576.480246:0:4385:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f890200/0x40a459093b06ae6d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21a49 expref: 29 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129576.480258:0:4385:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f890200, rc 0) 00000100:00100000:0.0:1746129576.480347:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800903a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ada2ffba-8920-4ecb-8068-68caa9806978+29:1963:x1830948734286976:12345-192.168.202.4@tcp:101:cat.0 Request processed in 196us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129576.480353:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16541 00000100:00100000:0.0:1746129576.480370:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16542 00000100:00100000:0.0:1746129576.480374:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800903a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ada2ffba-8920-4ecb-8068-68caa9806978+17:1963:x1830948734287232:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129576.480382:0:4385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129576.480391:0:4385:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f890c00/0x40a459093b06ae74 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21a57 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129576.480400:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129576.480402:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129576.480405:0:4385:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f890c00/0x40a459093b06ae74 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21a57 expref: 18 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129576.480414:0:4385:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f890c00/0x40a459093b06ae74 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21a57 expref: 18 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129576.480426:0:4385:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f890c00, rc 0) 00000100:00100000:0.0:1746129576.480440:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800903a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ada2ffba-8920-4ecb-8068-68caa9806978+18:1963:x1830948734287232:12345-192.168.202.4@tcp:101:cat.0 Request processed in 66us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129576.480445:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16542 00000100:00100000:0.0:1746129576.480454:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16543 00000100:00100000:0.0:1746129576.480457:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013575d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ada2ffba-8920-4ecb-8068-68caa9806978+28:1963:x1830948734287488:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129576.480462:0:4385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129576.480469:0:4385:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f890400/0x40a459093b06ae7b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21a65 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129576.480477:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129576.480486:0:4385:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f890400/0x40a459093b06ae7b lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21a65 expref: 29 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129576.480493:0:4385:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f890400/0x40a459093b06ae7b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21a65 expref: 29 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129576.480524:0:4385:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f890400, rc 0) 00000100:00100000:0.0:1746129576.480539:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013575d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ada2ffba-8920-4ecb-8068-68caa9806978+28:1963:x1830948734287488:12345-192.168.202.4@tcp:101:cat.0 Request processed in 81us (501us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129576.480545:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16543 00000100:00100000:0.0:1746129576.480581:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129576.480598:0:22480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734286848 00000100:00100000:0.0:1746129576.480601:0:22480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734286848 00000100:00100000:0.0:1746129576.480614:0:22480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16544 00000100:00100000:0.0:1746129576.480619:0:22480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135726a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ada2ffba-8920-4ecb-8068-68caa9806978+18:1963:x1830948734286848:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129576.480625:0:22480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129576.480631:0:22480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f890a00/0x40a459093b06ae82 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21a42 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129576.480641:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129576.480643:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129576.480647:0:22480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f890a00/0x40a459093b06ae82 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21a42 expref: 19 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129576.480655:0:22480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f890a00/0x40a459093b06ae82 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21a42 expref: 19 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129576.480662:0:22480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f890a00, rc 0) 00000100:00100000:0.0:1746129576.480676:0:22480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135726a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ada2ffba-8920-4ecb-8068-68caa9806978+19:1963:x1830948734286848:12345-192.168.202.4@tcp:101:cat.0 Request processed in 56us (95us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129576.480681:0:22480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16544 00000100:00100000:0.0:1746129576.480724:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129576.480736:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734287104 00000100:00100000:0.0:1746129576.480738:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734287104 00000100:00100000:0.0:1746129576.480750:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16545 00000100:00100000:0.0:1746129576.480754:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135727b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ada2ffba-8920-4ecb-8068-68caa9806978+28:1963:x1830948734287104:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129576.480760:0:7148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129576.480766:0:7148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f890000/0x40a459093b06ae89 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21a50 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129576.480775:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129576.480777:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129576.480781:0:7148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f890000/0x40a459093b06ae89 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21a50 expref: 29 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129576.480789:0:7148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f890000/0x40a459093b06ae89 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21a50 expref: 29 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129576.480796:0:7148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f890000, rc 0) 00000100:00100000:0.0:1746129576.480810:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135727b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ada2ffba-8920-4ecb-8068-68caa9806978+29:1963:x1830948734287104:12345-192.168.202.4@tcp:101:cat.0 Request processed in 54us (85us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129576.480814:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16545 00000100:00100000:0.0:1746129576.480843:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129576.480853:0:22480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734287360 00000100:00100000:0.0:1746129576.480855:0:22480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734287360 00000100:00100000:0.0:1746129576.480867:0:22480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16546 00000100:00100000:0.0:1746129576.480871:0:22480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135725500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ada2ffba-8920-4ecb-8068-68caa9806978+19:1963:x1830948734287360:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129576.480877:0:22480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129576.480883:0:22480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f891c00/0x40a459093b06ae90 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21a5e expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129576.480893:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129576.480894:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129576.480898:0:22480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f891c00/0x40a459093b06ae90 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21a5e expref: 20 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129576.480905:0:22480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f891c00/0x40a459093b06ae90 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21a5e expref: 20 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129576.480917:0:22480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f891c00, rc 0) 00000100:00100000:0.0:1746129576.480930:0:22480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135725500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ada2ffba-8920-4ecb-8068-68caa9806978+20:1963:x1830948734287360:12345-192.168.202.4@tcp:101:cat.0 Request processed in 58us (86us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129576.480934:0:22480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16546 00000100:00100000:0.0:1746129576.480965:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129576.480974:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734287616 00000100:00100000:0.0:1746129576.480976:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734287616 00000100:00100000:0.0:1746129576.480988:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16547 00000100:00100000:0.0:1746129576.480992:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135725f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ada2ffba-8920-4ecb-8068-68caa9806978+20:32482:x1830948734287616:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:0.0:1746129576.480997:0:7148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129576.481003:0:7148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f891400/0x40a459093b06ae97 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21a6c expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129576.481017:0:7148:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f91aa00/0x40a459093b06ae19 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21a0a expref: 14 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129576.481024:0:7148:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f890a00/0x40a459093b06ae82 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21a42 expref: 21 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129576.481029:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129576.481031:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129576.481034:0:7148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f891400/0x40a459093b06ae97 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [368640->1044479] (req 368640->1044479) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21a6c expref: 21 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129576.481059:0:7148:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f890a00/0x40a459093b06ae82 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21a42 expref: 21 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129576.481076:0:7148:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f890a00/0x40a459093b06ae82 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21a42 expref: 21 pid: 22480 timeout: 931 lvb_type: 1 00000100:00100000:0.0:1746129576.481087:0:7148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135727800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7148:1830948737574528:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129576.481154:0:7148:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f91aa00/0x40a459093b06ae19 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21a0a expref: 14 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129576.481162:0:7148:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f91aa00/0x40a459093b06ae19 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21a0a expref: 14 pid: 22481 timeout: 931 lvb_type: 1 00000100:00100000:0.0:1746129576.481170:0:7148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135724700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7148:1830948737574656:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129576.481189:0:7148:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4123a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746129576.481780:0:31519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800903a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+13:1963:x1830948734286336:12345-192.168.202.4@tcp:3:cat.0 Request processed in 25976us (27424us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129576.481788:0:31519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7980 00002000:00100000:0.0:1746129576.481796:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3ee:0x0] (1048576->2097151) req@ffff8800903a1180 x1830948734286336/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:317/0 lens 488/440 e 0 to 0 dl 1746129587 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129576.481805:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800903a1180 with x1830948734286336 ext(1048576->2097151) 00002000:00010000:0.0:1746129576.481810:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800903a1180 00000100:00100000:1.0:1746129576.490633:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800903a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+26:1963:x1830948734285824:12345-192.168.202.4@tcp:3:cat.0 Request processed in 44151us (46735us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129576.490646:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7978 00002000:00100000:1.0:1746129576.490658:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff8800903a2300 x1830948734285824/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:317/0 lens 488/440 e 0 to 0 dl 1746129587 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129576.490668:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800903a2300 with x1830948734285824 ext(1048576->2097151) 00002000:00010000:1.0:1746129576.490675:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800903a2300 00000100:00100000:3.0:1746129576.490888:0:20577:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20577:1830948737574400:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129576.490917:0:20577:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091b63000/0x40a459093b06ae66 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [4018176->4194303] (req 4018176->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21a3b expref: 25 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129576.490935:0:20577:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091b63000, rc 0) 00000100:00100000:3.0:1746129576.490959:0:20577:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800903a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+25:32486:x1830948734286720:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 18413us (19198us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129576.490966:0:20577:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16540 00000100:00100000:0.0:1746129576.491222:0:7148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135727800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7148:1830948737574528:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129576.491231:0:7148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135724700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7148:1830948737574656:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129576.491249:0:7148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f891400/0x40a459093b06ae97 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [368640->1044479] (req 368640->1044479) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21a6c expref: 21 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129576.491259:0:7148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f891400, rc 0) 00000100:00100000:0.0:1746129576.491283:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135725f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ada2ffba-8920-4ecb-8068-68caa9806978+21:32482:x1830948734287616:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 10291us (10318us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129576.491289:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16547 00010000:00010000:2.0:1746129576.493369:0:7088:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1746129576.493949:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129576.494001:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734287744 00000100:00100000:0.0:1746129576.494010:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734287744 00010000:00010000:0.0:1746129576.494063:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f91a000/0x40a459093b06ae3c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21a2d expref: 25 pid: 4699 timeout: 931 lvb_type: 1 00000100:00100000:0.0:1746129576.494096:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8520 00000100:00100000:0.0:1746129576.494102:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f44b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+25:1962:x1830948734287744:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129576.494116:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129576.494139:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f91a000/0x40a459093b06ae3c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21a2d expref: 25 pid: 4699 timeout: 931 lvb_type: 1 00010000:00010000:0.0:1746129576.494150:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f91a000/0x40a459093b06ae3c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21a2d expref: 25 pid: 4699 timeout: 931 lvb_type: 1 00010000:00010000:0.0:1746129576.494174:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f91a000/0x40a459093b06ae3c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21a2d expref: 25 pid: 4699 timeout: 931 lvb_type: 1 00010000:00010000:0.0:1746129576.494726:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129576.494728:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129576.494736:0:7085:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091b63000/0x40a459093b06ae66 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4018176->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21a3b expref: 24 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129576.494749:0:7085:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091b63000/0x40a459093b06ae66 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4018176->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21a3b expref: 24 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129576.494780:0:7085:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091b63000/0x40a459093b06ae66 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4018176->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21a3b expref: 24 pid: 20577 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129576.494790:0:7085:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135724700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7085:1830948737574784:192.168.202.4@tcp:105: 00000100:00100000:0.0:1746129576.495560:0:7085:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4123a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746129576.496821:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129576.496979:0:7085:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135724700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7085:1830948737574784:192.168.202.4@tcp:105: 00010000:00010000:0.0:1746129576.496998:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129576.497592:0:20578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734287872 00000100:00100000:3.0:1746129576.497599:0:20578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734287872 00010000:00010000:3.0:1746129576.497634:0:20578:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f91aa00/0x40a459093b06ae19 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21a0a expref: 13 pid: 22481 timeout: 931 lvb_type: 1 00000100:00100000:3.0:1746129576.497674:0:7087:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8521 00000100:00100000:3.0:1746129576.497681:0:7087:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094efd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+13:1960:x1830948734287872:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129576.497695:0:7087:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129576.497717:0:7087:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f91aa00/0x40a459093b06ae19 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21a0a expref: 13 pid: 22481 timeout: 931 lvb_type: 1 00010000:00010000:3.0:1746129576.497733:0:7087:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f91aa00/0x40a459093b06ae19 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21a0a expref: 13 pid: 22481 timeout: 931 lvb_type: 1 00010000:00010000:3.0:1746129576.497756:0:7087:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f91aa00/0x40a459093b06ae19 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21a0a expref: 13 pid: 22481 timeout: 931 lvb_type: 1 00000100:00100000:0.0:1746129576.499217:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f44b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+24:1962:x1830948734287744:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 5102us (5261us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129576.499229:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8520 00010000:00010000:3.0:1746129576.500901:0:7087:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129576.500974:0:7087:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094efd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+12:1960:x1830948734287872:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 3287us (4153us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129576.500985:0:7087:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8521 00000100:00100000:0.0:1746129576.502700:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129576.503456:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734288128 00000100:00100000:1.0:1746129576.503467:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734288128 00002000:00100000:1.0:1746129576.503528:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f5:0x0] (4018176->4022271) req@ffff880135724700 x1830948734288128/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:317/0 lens 488/0 e 0 to 0 dl 1746129587 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129576.503539:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135724700 with x1830948734288128 ext(4018176->4022271) 00002000:00010000:1.0:1746129576.503545:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135724700 00000100:00100000:1.0:1746129576.503576:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7981 00000100:00100000:1.0:1746129576.503584:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135724700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+24:1962:x1830948734288128:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:1.0:1746129576.503775:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135724700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+24:1962:x1830948734288128:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 192us (1083us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746129576.503782:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7981 00002000:00100000:1.0:1746129576.503788:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f5:0x0] (4018176->4022271) req@ffff880135724700 x1830948734288128/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:317/0 lens 488/4536 e 0 to 0 dl 1746129587 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129576.503795:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135724700 with x1830948734288128 ext(4018176->4022271) 00002000:00010000:1.0:1746129576.503798:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135724700 00000100:00100000:0.0:1746129576.507155:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129576.507231:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734288256 00000100:00100000:2.0:1746129576.507242:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734288256 00000100:00100000:2.0:1746129576.507330:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16548 00000100:00100000:2.0:1746129576.507340:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135727800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+12:32486:x1830948734288256:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:2.0:1746129576.507360:0:7148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129576.507378:0:7148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095044a00/0x40a459093b06ae9e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21a73 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129576.507409:0:7148:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f91b200/0x40a459093b06ae2e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21a26 expref: 13 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129576.507418:0:7148:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f891c00/0x40a459093b06ae90 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21a5e expref: 20 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129576.507424:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129576.507426:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129576.507429:0:7148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095044a00/0x40a459093b06ae9e lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [4194304->4468735] (req 4194304->4468735) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21a73 expref: 13 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129576.507466:0:7148:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f891c00/0x40a459093b06ae90 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21a5e expref: 20 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129576.507477:0:7148:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f891c00/0x40a459093b06ae90 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21a5e expref: 20 pid: 22480 timeout: 931 lvb_type: 1 00000100:00100000:2.0:1746129576.507490:0:7148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f448380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7148:1830948737574912:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129576.508331:0:7148:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f91b200/0x40a459093b06ae2e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21a26 expref: 13 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129576.508341:0:7148:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f91b200/0x40a459093b06ae2e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21a26 expref: 13 pid: 22481 timeout: 931 lvb_type: 1 00000100:00100000:2.0:1746129576.508349:0:7148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f448700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7148:1830948737575040:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129576.509122:0:7148:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132f360c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129576.513732:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129576.513766:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129576.513782:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129576.513792:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129576.513815:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129576.513895:0:31519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734288896 00000100:00100000:0.0:1746129576.513903:0:31519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734288896 00002000:00100000:0.0:1746129576.513943:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f4:0x0] (1048576->2097151) req@ffff880095625c00 x1830948734288896/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:317/0 lens 488/0 e 0 to 0 dl 1746129587 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129576.513953:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095625c00 with x1830948734288896 ext(1048576->2097151) 00002000:00010000:0.0:1746129576.513960:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095625c00 00000100:00100000:0.0:1746129576.513978:0:31518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734288768 00000100:00100000:0.0:1746129576.513980:0:31518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734288768 00002000:00100000:0.0:1746129576.513989:0:31518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff880095627800 x1830948734288768/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:317/0 lens 488/0 e 0 to 0 dl 1746129587 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129576.513995:0:31518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095627800 with x1830948734288768 ext(1048576->2097151) 00002000:00010000:0.0:1746129576.513997:0:31518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095627800 00000100:00100000:0.0:1746129576.514004:0:31518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734289152 00000100:00100000:0.0:1746129576.514005:0:31518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734289152 00002000:00100000:0.0:1746129576.514014:0:31518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3ec:0x0] (0->1048575) req@ffff880095624700 x1830948734289152/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:317/0 lens 488/0 e 0 to 0 dl 1746129587 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129576.514020:0:31518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095624700 with x1830948734289152 ext(0->1048575) 00010000:00010000:0.0:1746129576.514026:0:31518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012f890a00/0x40a459093b06ae82 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21a42 expref: 21 pid: 22480 timeout: 931 lvb_type: 1 00010000:00010000:0.0:1746129576.514038:0:31518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012f890a00/0x40a459093b06ae82 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21a42 expref: 21 pid: 22480 timeout: 931 lvb_type: 1 00002000:00010000:0.0:1746129576.514043:0:31518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095624700 00000100:00100000:0.0:1746129576.514050:0:31518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734289280 00000100:00100000:0.0:1746129576.514052:0:31518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734289280 00002000:00100000:0.0:1746129576.514058:0:31518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3ee:0x0] (1048576->2097151) req@ffff88009f37d180 x1830948734289280/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:317/0 lens 488/0 e 0 to 0 dl 1746129587 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129576.514063:0:31518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f37d180 with x1830948734289280 ext(1048576->2097151) 00002000:00010000:0.0:1746129576.514066:0:31518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f37d180 00000100:00100000:0.0:1746129576.514073:0:31518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2473 00000100:00100000:0.0:1746129576.514078:0:31518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095624700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ada2ffba-8920-4ecb-8068-68caa9806978+22:1961:x1830948734289152:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129576.515518:0:31519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7982 00000100:00100000:0.0:1746129576.515530:0:31519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095625c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ada2ffba-8920-4ecb-8068-68caa9806978+30:1961:x1830948734288896:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:2.0:1746129576.517211:0:31522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7983 00000100:00100000:2.0:1746129576.517227:0:31522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095627800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ada2ffba-8920-4ecb-8068-68caa9806978+31:1961:x1830948734288768:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:1.0:1746129576.518695:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7984 00000100:00100000:1.0:1746129576.518708:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f37d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+23:1961:x1830948734289280:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:2.0:1746129576.518763:0:7148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f448380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7148:1830948737574912:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129576.518776:0:7148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f448700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7148:1830948737575040:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129576.518807:0:7148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095044a00/0x40a459093b06ae9e lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [4194304->4468735] (req 4194304->4468735) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21a73 expref: 13 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129576.518825:0:7148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095044a00, rc 0) 00000100:00100000:2.0:1746129576.518855:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135727800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+13:32486:x1830948734288256:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 11516us (11709us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129576.518863:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16548 00000100:00100000:1.0:1746129576.520126:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734288384 00000100:00100000:1.0:1746129576.520138:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734288384 00010000:00010000:1.0:1746129576.520168:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f891c00/0x40a459093b06ae90 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21a5e expref: 25 pid: 22480 timeout: 931 lvb_type: 1 00000100:00100000:1.0:1746129576.520217:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8522 00000100:00100000:1.0:1746129576.520224:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009016a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ada2ffba-8920-4ecb-8068-68caa9806978+25:1961:x1830948734288384:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129576.520237:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129576.520258:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f891c00/0x40a459093b06ae90 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21a5e expref: 25 pid: 22480 timeout: 931 lvb_type: 1 00010000:00010000:1.0:1746129576.521216:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f891c00/0x40a459093b06ae90 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21a5e expref: 25 pid: 22480 timeout: 931 lvb_type: 1 00010000:00010000:1.0:1746129576.521240:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f891c00/0x40a459093b06ae90 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21a5e expref: 25 pid: 22480 timeout: 931 lvb_type: 1 00010000:00010000:1.0:1746129576.521274:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129576.521321:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009016a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ada2ffba-8920-4ecb-8068-68caa9806978+24:1961:x1830948734288384:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 1097us (7598us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129576.521327:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8522 00000100:00100000:2.0:1746129576.529605:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129576.529947:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734289536 00000100:00100000:1.0:1746129576.529957:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734289536 00010000:00010000:1.0:1746129576.529999:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f91b200/0x40a459093b06ae2e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21a26 expref: 13 pid: 22481 timeout: 931 lvb_type: 1 00000100:00100000:1.0:1746129576.530028:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8523 00000100:00100000:1.0:1746129576.530036:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f448700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+13:1962:x1830948734289536:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129576.530050:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129576.530074:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f91b200/0x40a459093b06ae2e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21a26 expref: 13 pid: 22481 timeout: 931 lvb_type: 1 00010000:00010000:1.0:1746129576.530086:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f91b200/0x40a459093b06ae2e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21a26 expref: 13 pid: 22481 timeout: 931 lvb_type: 1 00010000:00010000:1.0:1746129576.530115:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f91b200/0x40a459093b06ae2e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21a26 expref: 13 pid: 22481 timeout: 931 lvb_type: 1 00000100:00100000:0.0:1746129576.531574:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129576.531982:0:31518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095624700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ada2ffba-8920-4ecb-8068-68caa9806978+22:1961:x1830948734289152:12345-192.168.202.4@tcp:3:cat.0 Request processed in 17901us (18185us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129576.531994:0:31518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2473 00002000:00100000:0.0:1746129576.532005:0:31518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3ec:0x0] (0->1048575) req@ffff880095624700 x1830948734289152/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:317/0 lens 488/440 e 0 to 0 dl 1746129587 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129576.532015:0:31518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095624700 with x1830948734289152 ext(0->1048575) 00010000:00010000:0.0:1746129576.532024:0:31518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012f890a00/0x40a459093b06ae82 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21a42 expref: 22 pid: 22480 timeout: 931 lvb_type: 1 00010000:00010000:0.0:1746129576.532038:0:31518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012f890a00/0x40a459093b06ae82 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21a42 expref: 22 pid: 22480 timeout: 931 lvb_type: 1 00002000:00010000:0.0:1746129576.532045:0:31518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095624700 00000100:00100000:2.0:1746129576.536409:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734289664 00000100:00100000:2.0:1746129576.536425:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734289664 00000100:00100000:2.0:1746129576.536497:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16549 00000100:00100000:2.0:1746129576.536506:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f37e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+13:32488:x1830948734289664:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129576.536526:0:7148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129576.536546:0:7148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095044200/0x40a459093b06aea5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21a7a expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129576.536575:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129576.536577:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129576.536585:0:7148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095044200/0x40a459093b06aea5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21a7a expref: 14 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129576.536600:0:7148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095044200/0x40a459093b06aea5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21a7a expref: 14 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129576.536609:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129576.536610:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129576.536614:0:7148:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880095044a00/0x40a459093b06ae9e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4468735) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21a73 expref: 14 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129576.536621:0:7148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095044a00/0x40a459093b06ae9e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4468735) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21a73 expref: 14 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129576.536651:0:7148:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880095044a00/0x40a459093b06ae9e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4468735) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21a73 expref: 14 pid: 7148 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129576.536664:0:7148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f448380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7148:1830948737575168:192.168.202.4@tcp:105: 00000100:00100000:2.0:1746129576.536753:0:7148:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132f360c0 going to sleep for 11 seconds 00010000:00010000:1.0:1746129576.536945:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129576.536974:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f448700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+14:1962:x1830948734289536:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 6938us (7380us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129576.536983:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8523 00000100:00100000:3.0:1746129576.544803:0:7148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f448380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7148:1830948737575168:192.168.202.4@tcp:105: 00010000:00010000:3.0:1746129576.544828:0:7148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095044200, rc 0) 00000100:00100000:3.0:1746129576.544878:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f37e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+13:32488:x1830948734289664:12345-192.168.202.4@tcp:101:cat.0 Request processed in 8373us (13311us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129576.544887:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16549 00000100:00100000:2.0:1746129576.545912:0:31519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095625c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ada2ffba-8920-4ecb-8068-68caa9806978+31:1961:x1830948734288896:12345-192.168.202.4@tcp:3:cat.0 Request processed in 30382us (32140us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129576.545920:0:31519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7982 00002000:00100000:2.0:1746129576.545932:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f4:0x0] (1048576->2097151) req@ffff880095625c00 x1830948734288896/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:317/0 lens 488/440 e 0 to 0 dl 1746129587 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129576.545941:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095625c00 with x1830948734288896 ext(1048576->2097151) 00002000:00010000:2.0:1746129576.545946:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095625c00 00000100:00100000:0.0:1746129576.554105:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129576.556330:0:31519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734289920 00000100:00100000:2.0:1746129576.556343:0:31519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734289920 00002000:00100000:2.0:1746129576.556398:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3ef:0x0] (4464640->4468735) req@ffff88009f37f100 x1830948734289920/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:317/0 lens 488/0 e 0 to 0 dl 1746129587 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129576.556408:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f37f100 with x1830948734289920 ext(4464640->4468735) 00002000:00010000:2.0:1746129576.556414:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f37f100 00000100:00100000:2.0:1746129576.557439:0:31519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7985 00000100:00100000:2.0:1746129576.557451:0:31519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f37f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+13:1963:x1830948734289920:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:2.0:1746129576.557665:0:31519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f37f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+13:1963:x1830948734289920:12345-192.168.202.4@tcp:3:cat.0 Request processed in 216us (3570us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129576.557672:0:31519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7985 00002000:00100000:2.0:1746129576.557678:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3ef:0x0] (4464640->4468735) req@ffff88009f37f100 x1830948734289920/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:317/0 lens 488/4536 e 0 to 0 dl 1746129587 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129576.557691:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f37f100 with x1830948734289920 ext(4464640->4468735) 00002000:00010000:2.0:1746129576.557694:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f37f100 00000100:00100000:0.0:1746129576.558084:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129576.558601:0:31522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095627800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ada2ffba-8920-4ecb-8068-68caa9806978+29:1961:x1830948734288768:12345-192.168.202.4@tcp:3:cat.0 Request processed in 41379us (44815us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129576.558607:0:31522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7983 00002000:00100000:3.0:1746129576.558612:0:31522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff880095627800 x1830948734288768/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:317/0 lens 488/440 e 0 to 0 dl 1746129587 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129576.558619:0:31522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095627800 with x1830948734288768 ext(1048576->2097151) 00002000:00010000:3.0:1746129576.558623:0:31522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095627800 00000100:00100000:1.0:1746129576.560468:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734290048 00000100:00100000:1.0:1746129576.560481:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734290048 00010000:00010000:1.0:1746129576.560519:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f890a00/0x40a459093b06ae82 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21a42 expref: 22 pid: 22480 timeout: 931 lvb_type: 1 00000100:00100000:1.0:1746129576.560560:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8524 00000100:00100000:1.0:1746129576.560567:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f37d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ada2ffba-8920-4ecb-8068-68caa9806978+22:1963:x1830948734290048:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129576.560583:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129576.560604:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f890a00/0x40a459093b06ae82 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21a42 expref: 22 pid: 22480 timeout: 931 lvb_type: 1 00010000:00010000:1.0:1746129576.560616:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f890a00/0x40a459093b06ae82 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21a42 expref: 22 pid: 22480 timeout: 931 lvb_type: 1 00010000:00010000:1.0:1746129576.560640:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f890a00/0x40a459093b06ae82 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21a42 expref: 22 pid: 22480 timeout: 931 lvb_type: 1 00010000:00010000:1.0:1746129576.560658:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129576.560662:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129576.560668:0:7085:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f891400/0x40a459093b06ae97 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 368640->1044479) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21a6c expref: 21 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129576.560676:0:7085:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f891400/0x40a459093b06ae97 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 368640->1044479) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21a6c expref: 21 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129576.560708:0:7085:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012f891400/0x40a459093b06ae97 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 368640->1044479) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21a6c expref: 21 pid: 7148 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129576.560720:0:7085:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094efce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7085:1830948737575296:192.168.202.4@tcp:105: 00000100:00100000:1.0:1746129576.560797:0:7085:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0acc00 going to sleep for 11 seconds 00000100:00100000:2.0:1746129576.561372:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f37d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+20:1961:x1830948734289280:12345-192.168.202.4@tcp:3:cat.0 Request processed in 42665us (47552us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129576.561382:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7984 00002000:00100000:2.0:1746129576.561391:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ee:0x0] (1048576->2097151) req@ffff88009f37d180 x1830948734289280/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:317/0 lens 488/440 e 0 to 0 dl 1746129587 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129576.561399:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f37d180 with x1830948734289280 ext(1048576->2097151) 00002000:00010000:2.0:1746129576.561403:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f37d180 00000100:00100000:0.0:1746129576.572141:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129576.572164:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129576.572177:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129576.572190:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129576.572206:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129576.572221:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129576.572499:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129576.572536:0:31518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734290304 00000100:00100000:0.0:1746129576.572544:0:31518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734290304 00002000:00100000:0.0:1746129576.572587:0:31518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3ef:0x0] (2097152->3145727) req@ffff88009f327b80 x1830948734290304/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:317/0 lens 488/0 e 0 to 0 dl 1746129587 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129576.572597:0:31518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f327b80 with x1830948734290304 ext(2097152->3145727) 00002000:00010000:0.0:1746129576.572603:0:31518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f327b80 00000100:00100000:0.0:1746129576.572617:0:31518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734290560 00000100:00100000:0.0:1746129576.572618:0:31518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734290560 00002000:00100000:0.0:1746129576.572627:0:31518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->4194303) req@ffff880093edc000 x1830948734290560/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:317/0 lens 488/0 e 0 to 0 dl 1746129587 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129576.572633:0:31518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093edc000 with x1830948734290560 ext(3145728->4194303) 00002000:00010000:0.0:1746129576.572636:0:31518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093edc000 00000100:00100000:0.0:1746129576.572644:0:31518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734290816 00000100:00100000:0.0:1746129576.572646:0:31518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734290816 00002000:00100000:0.0:1746129576.572657:0:31518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3f5:0x0] (2097152->3145727) req@ffff880093eddf80 x1830948734290816/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:317/0 lens 488/0 e 0 to 0 dl 1746129587 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129576.572664:0:31518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093eddf80 with x1830948734290816 ext(2097152->3145727) 00002000:00010000:0.0:1746129576.572667:0:31518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093eddf80 00000100:00100000:0.0:1746129576.572675:0:31518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734291072 00000100:00100000:0.0:1746129576.572677:0:31518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734291072 00002000:00100000:0.0:1746129576.572686:0:31518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3f5:0x0] (3145728->4018175) req@ffff880093edce00 x1830948734291072/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:317/0 lens 488/0 e 0 to 0 dl 1746129587 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129576.572691:0:31518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093edce00 with x1830948734291072 ext(3145728->4018175) 00002000:00010000:0.0:1746129576.572694:0:31518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093edce00 00000100:00100000:0.0:1746129576.572704:0:31518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7986 00000100:00100000:0.0:1746129576.572711:0:31518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f327b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+14:1962:x1830948734290304:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:3.0:1746129576.572835:0:31522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7987 00000100:00100000:3.0:1746129576.572842:0:31522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093edc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+14:1962:x1830948734290560:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:3.0:1746129576.574124:0:20861:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734291584 00000100:00100000:3.0:1746129576.574130:0:20861:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734291584 00000100:00100000:3.0:1746129576.574159:0:20861:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4814 00000100:00100000:3.0:1746129576.574164:0:20861:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132c27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+30:32486:x1830948734291584:12345-192.168.202.4@tcp:35:multiop.0 00000100:00100000:3.0:1746129576.574413:0:20861:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132c27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+31:32486:x1830948734291584:12345-192.168.202.4@tcp:35:multiop.0 Request processed in 247us (1913us total) trans 8589945420 rc 0/0 00000100:00100000:3.0:1746129576.574420:0:20861:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4814 00000100:00100000:3.0:1746129576.574446:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734291200 00000100:00100000:3.0:1746129576.574449:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734291200 00000100:00100000:3.0:1746129576.574466:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734291328 00000100:00100000:3.0:1746129576.574468:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734291328 00000100:00100000:3.0:1746129576.574481:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16550 00000100:00100000:3.0:1746129576.574485:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093edfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ada2ffba-8920-4ecb-8068-68caa9806978+20:1961:x1830948734291200:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129576.574495:0:7148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129576.574511:0:7148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a77f6c00/0x40a459093b06aeac lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21a81 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129576.574558:0:7148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7148:1830948737575424:192.168.202.4@tcp:106: 00000100:00100000:3.0:1746129576.574603:0:7148:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa381a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746129576.574619:0:8411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16551 00000100:00100000:3.0:1746129576.574624:0:8411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132c26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ada2ffba-8920-4ecb-8068-68caa9806978+29:1961:x1830948734291328:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129576.574632:0:8411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129576.574642:0:8411:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a77f6200/0x40a459093b06aeb3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21a88 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129576.574664:0:8411:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8411:1830948737575552:192.168.202.4@tcp:106: 00000100:00100000:3.0:1746129576.574684:0:8411:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa381c00 going to sleep for 11 seconds 00000100:00100000:3.0:1746129576.574721:0:21463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7988 00000100:00100000:3.0:1746129576.574727:0:21463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093eddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+25:1962:x1830948734290816:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:3.0:1746129576.576078:0:31523:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7989 00000100:00100000:3.0:1746129576.576085:0:31523:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093edce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+26:1962:x1830948734291072:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:1.0:1746129576.578836:0:7085:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094efce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7085:1830948737575296:192.168.202.4@tcp:105: 00010000:00010000:1.0:1746129576.578861:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129576.578898:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f37d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ada2ffba-8920-4ecb-8068-68caa9806978+21:1963:x1830948734290048:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 18330us (20813us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129576.578907:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8524 00000100:00100000:2.0:1746129576.581847:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129576.581884:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129576.581906:0:15096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734291968 00000100:00100000:2.0:1746129576.581915:0:15096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734291968 00000100:00100000:2.0:1746129576.581972:0:15096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11305 00000100:00100000:2.0:1746129576.581980:0:15096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f449180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:068dab75-d300-4ead-a742-d14572ad1e50+22:32492:x1830948734291968:12345-192.168.202.4@tcp:101:mirror_io.0 00010000:00010000:2.0:1746129576.582003:0:15096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129576.582022:0:15096:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095045a00/0x40a459093b06aeba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21a8f expref: -99 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129576.582081:0:15096:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095044600/0x40a459093b06aec1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129576.582093:0:15096:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095044600/0x40a459093b06aec1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129576.582103:0:15096:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095044600/0x40a459093b06aec1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129576.582117:0:15096:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095044400/0x40a459093b06aec8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129576.582122:0:15096:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095044400/0x40a459093b06aec8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129576.582127:0:15096:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095044400/0x40a459093b06aec8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129576.582234:0:15096:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095044c00/0x40a459093b06aecf lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129576.582243:0:15096:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095044c00/0x40a459093b06aecf lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129576.582248:0:15096:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095044c00/0x40a459093b06aecf lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 15096 initiator: MDT0 00000004:00200000:2.0:1746129576.582291:0:15096:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00000004:00200000:2.0:1746129576.582310:0:15096:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746129576.582328:0:15096:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880095044c00/0x40a459093b06aecf lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129576.582337:0:15096:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095044c00/0x40a459093b06aecf lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129576.582343:0:15096:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095044600/0x40a459093b06aec1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129576.582349:0:15096:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095044600/0x40a459093b06aec1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129576.582354:0:15096:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095044600/0x40a459093b06aec1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129576.582363:0:15096:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095044600 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746129576.582366:0:15096:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095044600/0x40a459093b06aec1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129576.582372:0:15096:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095044600/0x40a459093b06aec1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129576.582382:0:15096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880132ef8f00) 00010000:00010000:2.0:1746129576.582385:0:15096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129576.582389:0:15096:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095044600/0x40a459093b06aec1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129576.582393:0:15096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095044600/0x40a459093b06aec1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129576.582416:0:15096:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095044400/0x40a459093b06aec8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129576.582420:0:15096:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095044400/0x40a459093b06aec8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129576.582424:0:15096:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095044400/0x40a459093b06aec8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129576.582428:0:15096:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095044400 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746129576.582430:0:15096:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095044400/0x40a459093b06aec8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129576.582435:0:15096:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095044400/0x40a459093b06aec8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129576.582441:0:15096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009ce7a000) 00010000:00010000:2.0:1746129576.582443:0:15096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129576.582445:0:15096:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095044400/0x40a459093b06aec8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129576.582450:0:15096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095044400/0x40a459093b06aec8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129576.582479:0:15096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095045a00/0x40a459093b06aeba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21a8f expref: 24 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129576.582490:0:15096:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095044c00/0x40a459093b06aecf lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21a8f expref: 23 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129576.582495:0:15096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:2.0:1746129576.582496:0:15096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746129576.582499:0:15096:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095044c00, rc 0) 00000100:00100000:2.0:1746129576.582542:0:15096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f449180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:068dab75-d300-4ead-a742-d14572ad1e50+23:32492:x1830948734291968:12345-192.168.202.4@tcp:101:mirror_io.0 Request processed in 563us (656us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129576.582548:0:15096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11305 00002000:00010000:2.0:1746129576.582666:0:8411:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3f5:0x0] updating lvb mtime: 1746129576 -> 1746129577 00002000:00010000:2.0:1746129576.582670:0:8411:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3f5:0x0] updating lvb atime: 1746129576 -> 1746129577 00002000:00010000:2.0:1746129576.582672:0:8411:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3f5:0x0] updating lvb ctime: 1746129576 -> 1746129577 00000100:00100000:2.0:1746129576.582686:0:8411:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8411:1830948737575552:192.168.202.4@tcp:106: 00010000:00010000:2.0:1746129576.582711:0:8411:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a77f6200/0x40a459093b06aeb3 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21a88 expref: 30 pid: 8411 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129576.582720:0:8411:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a77f6200/0x40a459093b06aeb3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21a88 expref: 30 pid: 8411 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129576.582728:0:8411:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a77f6200, rc 0) 00000100:00100000:2.0:1746129576.582752:0:8411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132c26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ada2ffba-8920-4ecb-8068-68caa9806978+29:1961:x1830948734291328:12345-192.168.202.4@tcp:101:cat.0 Request processed in 8127us (10529us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129576.582758:0:8411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16551 00000100:00100000:1.0:1746129576.582898:0:31520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734291840 00000100:00100000:1.0:1746129576.582903:0:31520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734291840 00002000:00100000:1.0:1746129576.582929:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3ec:0x0] (368640->372735) req@ffff88008f44aa00 x1830948734291840/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:317/0 lens 488/0 e 0 to 0 dl 1746129587 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129576.582939:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f44aa00 with x1830948734291840 ext(368640->372735) 00002000:00010000:1.0:1746129576.582944:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f44aa00 00000100:00100000:1.0:1746129576.582957:0:31520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7990 00000100:00100000:1.0:1746129576.582963:0:31520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f44aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ada2ffba-8920-4ecb-8068-68caa9806978+21:1962:x1830948734291840:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:1.0:1746129576.583085:0:31520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f44aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ada2ffba-8920-4ecb-8068-68caa9806978+21:1962:x1830948734291840:12345-192.168.202.4@tcp:3:cat.0 Request processed in 122us (1248us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746129576.583092:0:31520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7990 00002000:00100000:1.0:1746129576.583097:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3ec:0x0] (368640->372735) req@ffff88008f44aa00 x1830948734291840/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:317/0 lens 488/4536 e 0 to 0 dl 1746129587 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129576.583103:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f44aa00 with x1830948734291840 ext(368640->372735) 00002000:00010000:1.0:1746129576.583106:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f44aa00 00002000:00010000:2.0:1746129576.584252:0:7148:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb mtime: 1746129576 -> 1746129577 00002000:00010000:2.0:1746129576.584257:0:7148:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb atime: 1746129576 -> 1746129577 00002000:00010000:2.0:1746129576.584259:0:7148:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb ctime: 1746129576 -> 1746129577 00000100:00100000:2.0:1746129576.584279:0:7148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7148:1830948737575424:192.168.202.4@tcp:106: 00010000:00010000:2.0:1746129576.584313:0:7148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a77f6c00/0x40a459093b06aeac lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21a81 expref: 20 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129576.584323:0:7148:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a77f6c00/0x40a459093b06aeac lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21a81 expref: 20 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129576.584332:0:7148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a77f6c00, rc 0) 00000100:00100000:2.0:1746129576.584358:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093edfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ada2ffba-8920-4ecb-8068-68caa9806978+19:1961:x1830948734291200:12345-192.168.202.4@tcp:101:cat.0 Request processed in 9872us (12151us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129576.584363:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16550 00000100:00100000:1.0:1746129576.594044:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129576.595206:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734292096 00000100:00100000:2.0:1746129576.595217:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734292096 00000100:00100000:2.0:1746129576.595289:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16552 00000100:00100000:2.0:1746129576.595307:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094efce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ada2ffba-8920-4ecb-8068-68caa9806978+19:32491:x1830948734292096:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129576.595326:0:7148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129576.595342:0:7148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f891a00/0x40a459093b06aed6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21a96 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129576.595369:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129576.595372:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129576.595379:0:7148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f891a00/0x40a459093b06aed6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21a96 expref: 20 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129576.595393:0:7148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f891a00/0x40a459093b06aed6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21a96 expref: 20 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129576.595402:0:7148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f891a00, rc 0) 00000100:00100000:2.0:1746129576.595449:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094efce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ada2ffba-8920-4ecb-8068-68caa9806978+20:32491:x1830948734292096:12345-192.168.202.4@tcp:101:cat.0 Request processed in 143us (1417us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129576.595454:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16552 00000100:00100000:3.0:1746129576.603417:0:31522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093edc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+15:1962:x1830948734290560:12345-192.168.202.4@tcp:3:cat.0 Request processed in 30562us (31237us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129576.603431:0:31522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7987 00002000:00100000:3.0:1746129576.603445:0:31522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->4194303) req@ffff880093edc000 x1830948734290560/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:317/0 lens 488/440 e 0 to 0 dl 1746129587 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129576.603456:0:31522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093edc000 with x1830948734290560 ext(3145728->4194303) 00002000:00010000:3.0:1746129576.603461:0:31522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093edc000 00000100:00100000:0.0:1746129576.607822:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129576.607917:0:31522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734292352 00000100:00100000:3.0:1746129576.607927:0:31522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734292352 00002000:00100000:3.0:1746129576.607975:0:31522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3ef:0x0] (2097152->3145727) req@ffff880132c25500 x1830948734292352/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:317/0 lens 488/0 e 0 to 0 dl 1746129587 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129576.607986:0:31522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880132c25500 with x1830948734292352 ext(2097152->3145727) 00002000:00010000:3.0:1746129576.607992:0:31522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880132c25500 00000100:00100000:3.0:1746129576.609686:0:31522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7991 00000100:00100000:3.0:1746129576.609703:0:31522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132c25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ada2ffba-8920-4ecb-8068-68caa9806978+20:1962:x1830948734292352:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:1.0:1746129576.616878:0:31518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f327b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+13:1962:x1830948734290304:12345-192.168.202.4@tcp:3:cat.0 Request processed in 44155us (44740us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129576.616890:0:31518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7986 00002000:00100000:1.0:1746129576.616902:0:31518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3ef:0x0] (2097152->3145727) req@ffff88009f327b80 x1830948734290304/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:317/0 lens 488/440 e 0 to 0 dl 1746129587 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129576.616912:0:31518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f327b80 with x1830948734290304 ext(2097152->3145727) 00002000:00010000:1.0:1746129576.616918:0:31518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f327b80 00000100:00100000:3.0:1746129576.617428:0:21463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093eddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+26:1962:x1830948734290816:12345-192.168.202.4@tcp:3:cat.0 Request processed in 42698us (45247us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129576.617436:0:21463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7988 00002000:00100000:3.0:1746129576.617442:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3f5:0x0] (2097152->3145727) req@ffff880093eddf80 x1830948734290816/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:317/0 lens 488/440 e 0 to 0 dl 1746129587 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129576.617449:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093eddf80 with x1830948734290816 ext(2097152->3145727) 00002000:00010000:3.0:1746129576.617453:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093eddf80 00000100:00100000:3.0:1746129576.619127:0:31523:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093edce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+24:1962:x1830948734291072:12345-192.168.202.4@tcp:3:cat.0 Request processed in 43034us (46927us total) trans 0 rc 872448/872448 00000100:00100000:3.0:1746129576.619138:0:31523:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7989 00002000:00100000:3.0:1746129576.619146:0:31523:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f5:0x0] (3145728->4018175) req@ffff880093edce00 x1830948734291072/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:317/0 lens 488/440 e 0 to 0 dl 1746129587 ref 1 fl Complete:/200/0 rc 872448/872448 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129576.619155:0:31523:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093edce00 with x1830948734291072 ext(3145728->4018175) 00002000:00010000:3.0:1746129576.619160:0:31523:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093edce00 00000100:00100000:0.0:1746129576.623958:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129576.624095:0:8411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734292608 00000100:00100000:3.0:1746129576.624105:0:8411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734292608 00000100:00100000:3.0:1746129576.624148:0:8411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16553 00000100:00100000:3.0:1746129576.624155:0:8411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132c24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:068dab75-d300-4ead-a742-d14572ad1e50+5:1962:x1830948734292608:12345-192.168.202.4@tcp:101:mirror_io.0 00010000:00010000:3.0:1746129576.624173:0:8411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129576.624189:0:8411:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a77f7a00/0x40a459093b06aedd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21a9d expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129576.624247:0:8411:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8411:1830948737575680:192.168.202.4@tcp:106: 00000100:00100000:3.0:1746129576.624898:0:8411:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa381840 going to sleep for 11 seconds 00000100:00100000:2.0:1746129576.625144:0:31522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132c25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ada2ffba-8920-4ecb-8068-68caa9806978+20:1962:x1830948734292352:12345-192.168.202.4@tcp:3:cat.0 Request processed in 15445us (17332us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129576.625153:0:31522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7991 00002000:00100000:2.0:1746129576.625164:0:31522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3ef:0x0] (2097152->3145727) req@ffff880132c25500 x1830948734292352/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:317/0 lens 488/440 e 0 to 0 dl 1746129587 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129576.625172:0:31522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880132c25500 with x1830948734292352 ext(2097152->3145727) 00002000:00010000:2.0:1746129576.625176:0:31522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880132c25500 00000100:00100000:0.0:1746129576.625216:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129576.625252:0:31522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734292736 00000100:00100000:2.0:1746129576.625256:0:31522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734292736 00000100:00100000:0.0:1746129576.625280:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00002000:00100000:2.0:1746129576.625290:0:31522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3ec:0x0] (1040384->1044479) req@ffff880132c27480 x1830948734292736/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:317/0 lens 488/0 e 0 to 0 dl 1746129587 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746129576.625305:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734292864 00000100:00100000:0.0:1746129576.625308:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734292864 00002000:00100000:2.0:1746129576.625309:0:31522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880132c27480 with x1830948734292736 ext(1040384->1044479) 00002000:00010000:2.0:1746129576.625312:0:31522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880132c27480 00000100:00100000:0.0:1746129576.625329:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16554 00000100:00100000:2.0:1746129576.625334:0:31522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7992 00000100:00100000:0.0:1746129576.625335:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132c24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:068dab75-d300-4ead-a742-d14572ad1e50+5:1963:x1830948734292864:12345-192.168.202.4@tcp:101:mirror_io.0 00000100:00100000:2.0:1746129576.625339:0:31522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132c27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ada2ffba-8920-4ecb-8068-68caa9806978+20:1963:x1830948734292736:12345-192.168.202.4@tcp:3:cat.0 00010000:00010000:0.0:1746129576.625342:0:7148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129576.625353:0:7148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008fbb6e00/0x40a459093b06aee4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21aa4 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129576.625365:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129576.625367:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129576.625374:0:7148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fbb6e00/0x40a459093b06aee4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21aa4 expref: 6 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129576.625387:0:7148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008fbb6e00/0x40a459093b06aee4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21aa4 expref: 6 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129576.625395:0:7148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fbb6e00, rc 0) 00000100:00100000:0.0:1746129576.625411:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132c24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:068dab75-d300-4ead-a742-d14572ad1e50+6:1963:x1830948734292864:12345-192.168.202.4@tcp:101:mirror_io.0 Request processed in 76us (130us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129576.625415:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16554 00000100:00100000:0.0:1746129576.625450:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129576.625459:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734292992 00000100:00100000:0.0:1746129576.625461:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734292992 00000100:00100000:0.0:1746129576.625473:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16555 00000100:00100000:0.0:1746129576.625478:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132c25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:068dab75-d300-4ead-a742-d14572ad1e50+6:1963:x1830948734292992:12345-192.168.202.4@tcp:101:mirror_io.0 00000100:00100000:2.0:1746129576.625479:0:31522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132c27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ada2ffba-8920-4ecb-8068-68caa9806978+20:1963:x1830948734292736:12345-192.168.202.4@tcp:3:cat.0 Request processed in 140us (264us total) trans 0 rc 4096/4096 00010000:00010000:0.0:1746129576.625483:0:7148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746129576.625484:0:31522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7992 00002000:00100000:2.0:1746129576.625488:0:31522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3ec:0x0] (1040384->1044479) req@ffff880132c27480 x1830948734292736/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:317/0 lens 488/4536 e 0 to 0 dl 1746129587 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00010000:00010000:0.0:1746129576.625489:0:7148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008fbb7a00/0x40a459093b06aeeb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21aab expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00002000:00100000:2.0:1746129576.625495:0:31522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880132c27480 with x1830948734292736 ext(1040384->1044479) 00002000:00010000:2.0:1746129576.625497:0:31522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880132c27480 00010000:00010000:0.0:1746129576.625499:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129576.625500:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129576.625504:0:7148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fbb7a00/0x40a459093b06aeeb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21aab expref: 7 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129576.625513:0:7148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008fbb7a00/0x40a459093b06aeeb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21aab expref: 7 pid: 7148 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746129576.625720:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129576.625819:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129576.625977:0:20577:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734293120 00000100:00100000:3.0:1746129576.625981:0:20577:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734293120 00000100:00100000:3.0:1746129576.625999:0:20577:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734293248 00000100:00100000:3.0:1746129576.626001:0:20577:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734293248 00000100:00100000:3.0:1746129576.626012:0:20577:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16556 00000100:00100000:3.0:1746129576.626016:0:20577:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092fd1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:068dab75-d300-4ead-a742-d14572ad1e50+8:1963:x1830948734293120:12345-192.168.202.4@tcp:101:mirror_io.0 00010000:00010000:3.0:1746129576.626023:0:20577:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129576.626031:0:20577:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a77f6e00/0x40a459093b06aef2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21ab2 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129576.626042:0:20577:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129576.626043:0:20577:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129576.626048:0:20577:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a77f6e00/0x40a459093b06aef2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21ab2 expref: 9 pid: 20577 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129576.626057:0:20577:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a77f6e00/0x40a459093b06aef2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21ab2 expref: 9 pid: 20577 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129576.626063:0:20577:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a77f6e00, rc 0) 00000100:00100000:3.0:1746129576.626079:0:20577:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092fd1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:068dab75-d300-4ead-a742-d14572ad1e50+9:1963:x1830948734293120:12345-192.168.202.4@tcp:101:mirror_io.0 Request processed in 62us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129576.626084:0:20577:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16556 00000100:00100000:3.0:1746129576.626094:0:20577:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16557 00000100:00100000:3.0:1746129576.626098:0:20577:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c29f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:068dab75-d300-4ead-a742-d14572ad1e50+8:1963:x1830948734293248:12345-192.168.202.4@tcp:101:mirror_io.0 00010000:00010000:3.0:1746129576.626103:0:20577:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129576.626108:0:20577:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a77f7200/0x40a459093b06aef9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21ab9 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129576.626134:0:20577:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20577:1830948737575808:192.168.202.4@tcp:106: 00000100:00100000:3.0:1746129576.626164:0:20577:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa3819c0 going to sleep for 11 seconds 00010000:00010000:0.0:1746129576.626625:0:7148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fbb7a00, rc 0) 00000100:00100000:2.0:1746129576.626961:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129576.626968:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132c25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:068dab75-d300-4ead-a742-d14572ad1e50+7:1963:x1830948734292992:12345-192.168.202.4@tcp:101:mirror_io.0 Request processed in 1488us (1516us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129576.626973:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16555 00000100:00100000:2.0:1746129576.626977:0:8412:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734293376 00000100:00100000:2.0:1746129576.626980:0:8412:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734293376 00000100:00100000:2.0:1746129576.626997:0:8412:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16558 00000100:00100000:2.0:1746129576.627003:0:8412:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f448380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:068dab75-d300-4ead-a742-d14572ad1e50+7:1963:x1830948734293376:12345-192.168.202.4@tcp:101:mirror_io.0 00010000:00010000:2.0:1746129576.627010:0:8412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129576.627018:0:8412:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f891c00/0x40a459093b06af00 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21ac0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129576.627045:0:8412:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f44bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8412:1830948737575936:192.168.202.4@tcp:106: 00000100:00100000:2.0:1746129576.627084:0:8412:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132f363c0 going to sleep for 11 seconds 00002000:00010000:3.0:1746129576.631379:0:8411:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3ec:0x0] updating lvb mtime: 1746129576 -> 1746129577 00002000:00010000:3.0:1746129576.631388:0:8411:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3ec:0x0] updating lvb atime: 1746129571 -> 1746129577 00002000:00010000:3.0:1746129576.631390:0:8411:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3ec:0x0] updating lvb ctime: 1746129576 -> 1746129577 00000100:00100000:3.0:1746129576.631422:0:8411:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8411:1830948737575680:192.168.202.4@tcp:106: 00010000:00010000:3.0:1746129576.631458:0:8411:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a77f7a00/0x40a459093b06aedd lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21a9d expref: 9 pid: 8411 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129576.631472:0:8411:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a77f7a00/0x40a459093b06aedd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21a9d expref: 9 pid: 8411 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129576.631506:0:8411:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a77f7a00, rc 0) 00000100:00100000:3.0:1746129576.631803:0:8411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132c24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:068dab75-d300-4ead-a742-d14572ad1e50+8:1962:x1830948734292608:12345-192.168.202.4@tcp:101:mirror_io.0 Request processed in 7645us (7854us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129576.631811:0:8411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16553 00000100:00100000:0.0:1746129576.632060:0:8412:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f44bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8412:1830948737575936:192.168.202.4@tcp:106: 00010000:00010000:0.0:1746129576.632081:0:8412:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f891c00/0x40a459093b06af00 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21ac0 expref: 8 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129576.632091:0:8412:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f891c00/0x40a459093b06af00 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21ac0 expref: 8 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129576.632102:0:8412:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f891c00, rc 0) 00000100:00100000:0.0:1746129576.632122:0:8412:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f448380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:068dab75-d300-4ead-a742-d14572ad1e50+7:1963:x1830948734293376:12345-192.168.202.4@tcp:101:mirror_io.0 Request processed in 5119us (5161us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129576.632128:0:8412:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16558 00000100:00100000:3.0:1746129576.632576:0:20577:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20577:1830948737575808:192.168.202.4@tcp:106: 00010000:00010000:3.0:1746129576.632600:0:20577:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a77f7200/0x40a459093b06aef9 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21ab9 expref: 7 pid: 20577 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129576.632608:0:20577:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a77f7200/0x40a459093b06aef9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21ab9 expref: 7 pid: 20577 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129576.632615:0:20577:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a77f7200, rc 0) 00000100:00100000:3.0:1746129576.632635:0:20577:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c29f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:068dab75-d300-4ead-a742-d14572ad1e50+6:1963:x1830948734293248:12345-192.168.202.4@tcp:101:mirror_io.0 Request processed in 6536us (6816us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129576.632640:0:20577:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16557 00000100:00100000:0.0:1746129576.634797:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129576.634842:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129576.635166:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129576.635724:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129576.635762:0:20577:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734293632 00000100:00100000:1.0:1746129576.635762:0:8412:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734293504 00000100:00100000:3.0:1746129576.635771:0:20577:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734293632 00000100:00100000:1.0:1746129576.635771:0:8412:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734293504 00000100:00100000:2.0:1746129576.635841:0:8411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734293760 00000100:00100000:2.0:1746129576.635845:0:8411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734293760 00000100:00100000:2.0:1746129576.635959:0:8411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16559 00000100:00100000:2.0:1746129576.635968:0:8411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132c24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ada2ffba-8920-4ecb-8068-68caa9806978+29:32491:x1830948734293760:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129576.635985:0:8411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129576.636004:0:8411:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f890400/0x40a459093b06af07 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21ad5 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129576.636037:0:8411:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091b63000/0x40a459093b06ae66 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4018176->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21a3b expref: 23 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129576.636045:0:8411:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129576.636047:0:8411:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129576.636051:0:8411:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f890400/0x40a459093b06af07 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21ad5 expref: 30 pid: 8411 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129576.636082:0:8411:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091b63000/0x40a459093b06ae66 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4018176->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21a3b expref: 23 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129576.636095:0:8411:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091b63000/0x40a459093b06ae66 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4018176->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21a3b expref: 23 pid: 20577 timeout: 931 lvb_type: 0 00000100:00100000:2.0:1746129576.636107:0:8411:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f449f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8411:1830948737576064:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129576.636207:0:20577:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16560 00000100:00100000:1.0:1746129576.636211:0:8412:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16561 00000100:00100000:3.0:1746129576.636213:0:20577:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132c26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+14:1962:x1830948734293632:12345-192.168.202.4@tcp:101:cat.0 00000100:00100000:1.0:1746129576.636216:0:8412:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132c26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+14:1962:x1830948734293504:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129576.636222:0:20577:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129576.636222:0:8412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129576.636232:0:20577:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008fb0fc00/0x40a459093b06af0e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21ace expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129576.636232:0:8412:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136b1c200/0x40a459093b06af15 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21ac7 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129576.636273:0:20577:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20577:1830948737576320:192.168.202.4@tcp:106: 00000100:00100000:1.0:1746129576.636273:0:8412:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092fd2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8412:1830948737576192:192.168.202.4@tcp:106: 00000100:00100000:3.0:1746129576.636552:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734294016 00000100:00100000:3.0:1746129576.636556:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734294016 00000100:00100000:1.0:1746129576.636561:0:8412:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0acc00 going to sleep for 11 seconds 00000100:00100000:3.0:1746129576.636581:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4815 00000100:00100000:3.0:1746129576.636586:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132c25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ada2ffba-8920-4ecb-8068-68caa9806978+318:32482:x1830948734294016:12345-192.168.202.4@tcp:35:multiop.0 00000100:00100000:2.0:1746129576.636607:0:8411:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132f36d80 going to sleep for 11 seconds 00000100:00100000:3.0:1746129576.637188:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132c25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ada2ffba-8920-4ecb-8068-68caa9806978+319:32482:x1830948734294016:12345-192.168.202.4@tcp:35:multiop.0 Request processed in 600us (1463us total) trans 8589945421 rc 0/0 00000100:00100000:3.0:1746129576.637195:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4815 00000100:00100000:3.0:1746129576.637224:0:20577:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa3819c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129576.637528:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129576.637675:0:16908:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734294272 00000100:00100000:2.0:1746129576.637679:0:16908:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734294272 00000100:00100000:2.0:1746129576.637711:0:16908:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11306 00000100:00100000:2.0:1746129576.637716:0:16908:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132c24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:068dab75-d300-4ead-a742-d14572ad1e50+23:32492:x1830948734294272:12345-192.168.202.4@tcp:101:mirror_io.0 00010000:00010000:2.0:1746129576.637725:0:16908:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129576.637739:0:16908:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c22dc00/0x40a459093b06af1c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21adc expref: -99 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129576.637811:0:16908:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c22cc00/0x40a459093b06af23 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129576.637830:0:16908:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012eac3c00/0x40a459093b06ae0b lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21a03 expref: 30 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129576.637836:0:16908:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012eac2600/0x40a459093b06ae58 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21a34 expref: 318 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129576.637842:0:16908:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095044c00/0x40a459093b06aecf lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21a8f expref: 24 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129576.637848:0:16908:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c22cc00/0x40a459093b06af23 lrc: 6/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129576.637873:0:16908:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880095044c00/0x40a459093b06aecf lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21a8f expref: 24 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129576.637882:0:16908:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880095044c00/0x40a459093b06aecf lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21a8f expref: 24 pid: 15096 timeout: 931 lvb_type: 0 00000100:00100000:2.0:1746129576.637890:0:16908:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f449880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16908:1830948737576448:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129576.637942:0:16908:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012eac2600/0x40a459093b06ae58 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21a34 expref: 318 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129576.637949:0:16908:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012eac2600/0x40a459093b06ae58 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21a34 expref: 318 pid: 16908 timeout: 931 lvb_type: 0 00000100:00100000:2.0:1746129576.637957:0:16908:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f44ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16908:1830948737576576:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129576.637981:0:16908:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012eac3c00/0x40a459093b06ae0b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21a03 expref: 30 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129576.637989:0:16908:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012eac3c00/0x40a459093b06ae0b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21a03 expref: 30 pid: 16908 timeout: 931 lvb_type: 0 00000100:00100000:2.0:1746129576.637996:0:16908:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f44b800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16908:1830948737576704:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129576.638012:0:16908:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132f36a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746129576.639492:0:20577:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20577:1830948737576320:192.168.202.4@tcp:106: 00000100:00100000:2.0:1746129576.639492:0:8412:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092fd2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8412:1830948737576192:192.168.202.4@tcp:106: 00010000:00010000:3.0:1746129576.639517:0:20577:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008fb0fc00/0x40a459093b06af0e lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21ace expref: 16 pid: 20577 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129576.639517:0:8412:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880136b1c200/0x40a459093b06af15 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21ac7 expref: 16 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129576.639528:0:20577:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008fb0fc00/0x40a459093b06af0e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21ace expref: 16 pid: 20577 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129576.639528:0:8412:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136b1c200/0x40a459093b06af15 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21ac7 expref: 16 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129576.639540:0:20577:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fb0fc00, rc 0) 00010000:00010000:2.0:1746129576.639859:0:8412:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136b1c200, rc 0) 00000100:00100000:3.0:1746129576.639962:0:20577:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132c26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+14:1962:x1830948734293632:12345-192.168.202.4@tcp:101:cat.0 Request processed in 3747us (5175us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129576.639973:0:20577:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16560 00000100:00100000:2.0:1746129576.640029:0:8412:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132c26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+13:1962:x1830948734293504:12345-192.168.202.4@tcp:101:cat.0 Request processed in 3811us (5185us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129576.640035:0:8412:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16561 00000100:00100000:2.0:1746129576.640064:0:8411:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f449f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8411:1830948737576064:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129576.640082:0:8411:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f890400/0x40a459093b06af07 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21ad5 expref: 30 pid: 8411 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129576.640094:0:8411:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f890400, rc 0) 00000100:00100000:2.0:1746129576.640319:0:8411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132c24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ada2ffba-8920-4ecb-8068-68caa9806978+30:32491:x1830948734293760:12345-192.168.202.4@tcp:101:cat.0 Request processed in 4352us (5152us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129576.640325:0:8411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16559 00000100:00100000:1.0:1746129576.640378:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129576.640406:0:31523:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734294400 00000100:00100000:3.0:1746129576.640413:0:31523:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734294400 00002000:00100000:3.0:1746129576.640445:0:31523:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f5:0x0] (4018176->4194303) req@ffff880092fd3800 x1830948734294400/t0(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:317/0 lens 488/0 e 0 to 0 dl 1746129587 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129576.640454:0:31523:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092fd3800 with x1830948734294400 ext(4018176->4194303) 00010000:00010000:3.0:1746129576.640461:0:31523:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091b63000/0x40a459093b06ae66 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4018176->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21a3b expref: 24 pid: 20577 timeout: 931 lvb_type: 0 00010000:00010000:3.0:1746129576.640471:0:31523:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091b63000/0x40a459093b06ae66 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4018176->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21a3b expref: 24 pid: 20577 timeout: 931 lvb_type: 0 00002000:00010000:3.0:1746129576.640477:0:31523:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092fd3800 00000100:00100000:3.0:1746129576.640493:0:31523:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2474 00000100:00100000:3.0:1746129576.640499:0:31523:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092fd3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+24:1963:x1830948734294400:12345-192.168.202.4@tcp:4:cat.0 00000100:00100000:0.0:1746129576.642597:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129576.642635:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129576.642659:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129576.642731:0:16908:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f449880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16908:1830948737576448:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129576.642740:0:16908:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f44ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16908:1830948737576576:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129576.642748:0:16908:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f44b800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16908:1830948737576704:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129576.642774:0:16908:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012c22cc00/0x40a459093b06af23 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00000100:00100000:1.0:1746129576.642935:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734294528 00000100:00100000:1.0:1746129576.642943:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734294528 00010000:00010000:1.0:1746129576.642974:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095044c00/0x40a459093b06aecf lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21a8f expref: 25 pid: 15096 timeout: 931 lvb_type: 0 00000100:00100000:1.0:1746129576.642998:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734294656 00000100:00100000:1.0:1746129576.642999:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734294656 00010000:00010000:1.0:1746129576.643008:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012eac2600/0x40a459093b06ae58 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21a34 expref: 319 pid: 16908 timeout: 931 lvb_type: 0 00000100:00100000:1.0:1746129576.643021:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734294784 00000100:00100000:1.0:1746129576.643023:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734294784 00010000:00010000:1.0:1746129576.643031:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012eac3c00/0x40a459093b06ae0b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21a03 expref: 31 pid: 16908 timeout: 931 lvb_type: 0 00000100:00100000:1.0:1746129576.643045:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8525 00000100:00100000:1.0:1746129576.643051:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009507ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:068dab75-d300-4ead-a742-d14572ad1e50+25:1962:x1830948734294528:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129576.643064:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129576.643069:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880095044c00/0x40a459093b06aecf lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21a8f expref: 25 pid: 15096 timeout: 931 lvb_type: 0 00010000:00010000:1.0:1746129576.643078:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880095044c00/0x40a459093b06aecf lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21a8f expref: 25 pid: 15096 timeout: 931 lvb_type: 0 00010000:00010000:1.0:1746129576.643104:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095044c00/0x40a459093b06aecf lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21a8f expref: 25 pid: 15096 timeout: 931 lvb_type: 0 00010000:00010000:1.0:1746129576.643119:0:7085:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:1.0:1746129576.643124:0:7085:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c22cc00/0x40a459093b06af23 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129576.643131:0:7085:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c22cc00/0x40a459093b06af23 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129576.643135:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129576.643173:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009507ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:068dab75-d300-4ead-a742-d14572ad1e50+24:1962:x1830948734294528:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 122us (585us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129576.643179:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8525 00000100:00100000:1.0:1746129576.643194:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8526 00000100:00100000:1.0:1746129576.643198:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6027c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ada2ffba-8920-4ecb-8068-68caa9806978+319:1963:x1830948734294656:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129576.643206:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129576.643209:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012eac2600/0x40a459093b06ae58 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21a34 expref: 319 pid: 16908 timeout: 931 lvb_type: 0 00010000:00010000:1.0:1746129576.643217:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012eac2600/0x40a459093b06ae58 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21a34 expref: 319 pid: 16908 timeout: 931 lvb_type: 0 00010000:00010000:1.0:1746129576.643227:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012eac2600/0x40a459093b06ae58 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21a34 expref: 319 pid: 16908 timeout: 931 lvb_type: 0 00010000:00010000:1.0:1746129576.643239:0:7085:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:1.0:1746129576.643243:0:7085:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c22cc00/0x40a459093b06af23 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129576.643248:0:7085:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c22cc00/0x40a459093b06af23 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129576.643252:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129576.643276:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6027c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ada2ffba-8920-4ecb-8068-68caa9806978+318:1963:x1830948734294656:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 77us (640us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129576.643281:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8526 00000100:00100000:1.0:1746129576.643341:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8527 00000100:00100000:1.0:1746129576.643345:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009507ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+31:1963:x1830948734294784:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129576.643351:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129576.643355:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012eac3c00/0x40a459093b06ae0b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21a03 expref: 31 pid: 16908 timeout: 931 lvb_type: 0 00010000:00010000:1.0:1746129576.643364:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012eac3c00/0x40a459093b06ae0b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21a03 expref: 31 pid: 16908 timeout: 931 lvb_type: 0 00010000:00010000:1.0:1746129576.643374:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012eac3c00/0x40a459093b06ae0b lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21a03 expref: 31 pid: 16908 timeout: 931 lvb_type: 0 00010000:00010000:1.0:1746129576.643382:0:7085:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:1.0:1746129576.643385:0:7085:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c22cc00/0x40a459093b06af23 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129576.643391:0:7085:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c22cc00/0x40a459093b06af23 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129576.643397:0:7085:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c22cc00/0x40a459093b06af23 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129576.643413:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129576.643427:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009507ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+30:1963:x1830948734294784:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 81us (767us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129576.643432:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8527 00010000:00010000:2.0:1746129576.643751:0:16908:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012c22cc00/0x40a459093b06af23 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129576.643758:0:16908:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c22cc00/0x40a459093b06af23 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00000004:00200000:2.0:1746129576.643779:0:16908:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:2.0:1746129576.643927:0:16908:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c22dc00/0x40a459093b06af1c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21adc expref: 25 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129576.643938:0:16908:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c22cc00/0x40a459093b06af23 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21adc expref: 24 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129576.643943:0:16908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:2.0:1746129576.643945:0:16908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746129576.643947:0:16908:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c22cc00, rc 0) 00000100:00100000:2.0:1746129576.643969:0:16908:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132c24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:068dab75-d300-4ead-a742-d14572ad1e50+24:32492:x1830948734294272:12345-192.168.202.4@tcp:101:mirror_io.0 Request processed in 6253us (6441us total) trans 8589945422 rc 0/0 00000100:00100000:2.0:1746129576.643974:0:16908:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11306 00000100:00100000:0.0:1746129576.648279:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129576.648438:0:16908:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734295040 00000100:00100000:2.0:1746129576.648447:0:16908:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734295040 00000100:00100000:2.0:1746129576.648503:0:16908:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11307 00000100:00100000:2.0:1746129576.648512:0:16908:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009507df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:068dab75-d300-4ead-a742-d14572ad1e50+24:32492:x1830948734295040:12345-192.168.202.4@tcp:101:mirror_io.0 00010000:00010000:2.0:1746129576.648535:0:16908:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129576.648538:0:16908:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746129576.648561:0:16908:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c22cc00/0x40a459093b06af23 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21adc expref: 24 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129576.648577:0:16908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:2.0:1746129576.648581:0:16908:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746129576.648592:0:16908:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c22c000/0x40a459093b06af31 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21ae3 expref: -99 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129576.648679:0:16908:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c22d400/0x40a459093b06af38 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129576.648692:0:16908:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c22d400/0x40a459093b06af38 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129576.648701:0:16908:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c22d400/0x40a459093b06af38 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00000004:00200000:2.0:1746129576.648712:0:16908:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:2.0:1746129576.648801:0:16908:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c22c000/0x40a459093b06af31 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21ae3 expref: 26 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129576.648812:0:16908:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c22d400/0x40a459093b06af38 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21ae3 expref: 25 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129576.648817:0:16908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:2.0:1746129576.648820:0:16908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746129576.648821:0:16908:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c22d400, rc 0) 00000100:00100000:2.0:1746129576.648880:0:16908:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009507df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:068dab75-d300-4ead-a742-d14572ad1e50+25:32492:x1830948734295040:12345-192.168.202.4@tcp:101:mirror_io.0 Request processed in 369us (617us total) trans 8589945423 rc 0/0 00000100:00100000:2.0:1746129576.648887:0:16908:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11307 00000100:00100000:3.0:1746129576.651397:0:31523:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092fd3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+26:1963:x1830948734294400:12345-192.168.202.4@tcp:4:cat.0 Request processed in 10888us (11008us total) trans 17179874158 rc 0/0 00000100:00100000:3.0:1746129576.651408:0:31523:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2474 00002000:00100000:3.0:1746129576.651424:0:31523:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f5:0x0] (4018176->4194303) req@ffff880092fd3800 x1830948734294400/t17179874158(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:317/0 lens 488/448 e 0 to 0 dl 1746129587 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129576.651434:0:31523:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092fd3800 with x1830948734294400 ext(4018176->4194303) 00000100:00100000:1.0:1746129576.651509:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129576.651529:0:31522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734295296 00000100:00100000:2.0:1746129576.651537:0:31522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734295296 00002000:00100000:2.0:1746129576.651572:0:31522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3ef:0x0] (4468736->5148671) req@ffff880092fd0700 x1830948734295296/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:317/0 lens 488/0 e 0 to 0 dl 1746129587 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129576.651580:0:31522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092fd0700 with x1830948734295296 ext(4468736->5148671) 00002000:00010000:2.0:1746129576.651584:0:31522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092fd0700 00000100:00100000:2.0:1746129576.651607:0:31522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7993 00000100:00100000:2.0:1746129576.651614:0:31522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092fd0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+13:1962:x1830948734295296:12345-192.168.202.4@tcp:3:cat.0 00010000:00010000:3.0:1746129576.651823:0:31523:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091b63000/0x40a459093b06ae66 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4018176->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21a3b expref: 26 pid: 20577 timeout: 931 lvb_type: 0 00010000:00010000:3.0:1746129576.651843:0:31523:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091b63000/0x40a459093b06ae66 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4018176->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21a3b expref: 26 pid: 20577 timeout: 931 lvb_type: 0 00002000:00010000:3.0:1746129576.651849:0:31523:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092fd3800 00000100:00100000:1.0:1746129576.651941:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129576.652128:0:15096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734295424 00000100:00100000:0.0:1746129576.652133:0:15096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734295424 00000100:00100000:0.0:1746129576.652167:0:15096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11308 00000100:00100000:0.0:1746129576.652172:0:15096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092fd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:068dab75-d300-4ead-a742-d14572ad1e50+25:32492:x1830948734295424:12345-192.168.202.4@tcp:101:mirror_io.0 00010000:00010000:0.0:1746129576.652188:0:15096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129576.652204:0:15096:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fbb6a00/0x40a459093b06af46 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21aea expref: -99 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129576.652253:0:15096:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fbb6a00/0x40a459093b06af46 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21aea expref: 26 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129576.652277:0:15096:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fbb6a00/0x40a459093b06af46 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21aea expref: 26 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129576.652308:0:15096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:0.0:1746129576.652311:0:15096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746129576.652314:0:15096:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fbb6a00, rc 0) 00000100:00100000:0.0:1746129576.652351:0:15096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092fd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:068dab75-d300-4ead-a742-d14572ad1e50+26:32492:x1830948734295424:12345-192.168.202.4@tcp:101:mirror_io.0 Request processed in 178us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129576.652356:0:15096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11308 00000100:00100000:0.0:1746129576.657394:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129576.657841:0:8411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734295552 00000100:00100000:0.0:1746129576.657848:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129576.657851:0:8411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734295552 00000100:00100000:2.0:1746129576.657913:0:8411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16562 00000100:00100000:2.0:1746129576.657921:0:8411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009507d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:068dab75-d300-4ead-a742-d14572ad1e50+6:1963:x1830948734295552:12345-192.168.202.4@tcp:1:mirror_io.0 00010000:00010000:2.0:1746129576.657969:0:8411:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009cfd7800/0x40a459093b06af4d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129576.657988:0:8411:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f891400/0x40a459093b06ae97 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 368640->1044479) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21a6c expref: 19 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129576.657996:0:8411:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129576.657998:0:8411:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129576.658001:0:8411:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cfd7800/0x40a459093b06af4d lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129576.658031:0:8411:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f891400/0x40a459093b06ae97 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 368640->1044479) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21a6c expref: 19 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129576.658047:0:8411:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f891400/0x40a459093b06ae97 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 368640->1044479) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21a6c expref: 19 pid: 7148 timeout: 931 lvb_type: 0 00000100:00100000:2.0:1746129576.658060:0:8411:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f44b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8411:1830948737576832:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129576.658135:0:8411:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132f36600 going to sleep for 11 seconds 00000100:00100000:1.0:1746129576.658208:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734295680 00000100:00100000:1.0:1746129576.658213:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734295680 00010000:00010000:1.0:1746129576.658237:0:9823:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091b63000/0x40a459093b06ae66 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4018176->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21a3b expref: 26 pid: 20577 timeout: 931 lvb_type: 0 00000100:00100000:1.0:1746129576.658406:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8528 00000100:00100000:1.0:1746129576.658412:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009507e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+26:1963:x1830948734295680:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129576.658422:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129576.658447:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091b63000/0x40a459093b06ae66 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4018176->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21a3b expref: 26 pid: 20577 timeout: 931 lvb_type: 0 00010000:00010000:1.0:1746129576.658456:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091b63000/0x40a459093b06ae66 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4018176->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21a3b expref: 26 pid: 20577 timeout: 931 lvb_type: 0 00010000:00010000:1.0:1746129576.658474:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091b63000/0x40a459093b06ae66 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4018176->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21a3b expref: 26 pid: 20577 timeout: 931 lvb_type: 0 00010000:00010000:1.0:1746129576.658502:0:9823:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129576.658504:0:9823:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129576.658512:0:9823:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f890400/0x40a459093b06af07 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21ad5 expref: 29 pid: 8411 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129576.658523:0:9823:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f890400/0x40a459093b06af07 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21ad5 expref: 29 pid: 8411 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129576.658541:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00010000:00010000:1.0:1746129576.658545:0:9823:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012f890400/0x40a459093b06af07 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21ad5 expref: 29 pid: 8411 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129576.658554:0:8412:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734295808 00000100:00100000:1.0:1746129576.658554:0:9823:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092fd2300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9823:1830948737576960:192.168.202.4@tcp:105: 00000100:00100000:3.0:1746129576.658557:0:8412:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734295808 00000100:00100000:1.0:1746129576.658579:0:9823:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0ac000 going to sleep for 11 seconds 00000100:00100000:3.0:1746129576.658581:0:20577:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16563 00000100:00100000:3.0:1746129576.658586:0:20577:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:068dab75-d300-4ead-a742-d14572ad1e50+7:1962:x1830948734295808:12345-192.168.202.4@tcp:1:mirror_io.0 00000100:00100000:1.0:1746129576.658600:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00010000:00010000:3.0:1746129576.658604:0:20577:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880091b67c00/0x40a459093b06af54 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129576.658615:0:20577:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f91b600/0x40a459093b06ae20 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21a11 expref: 25 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129576.658622:0:20577:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008fbb6e00/0x40a459093b06aee4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21aa4 expref: 7 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129576.658628:0:20577:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f890200/0x40a459093b06ae6d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21a49 expref: 29 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129576.658634:0:20577:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129576.658636:0:20577:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129576.658638:0:20577:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091b67c00/0x40a459093b06af54 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129576.658640:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129576.658652:0:22480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734295936 00000100:00100000:1.0:1746129576.658655:0:22480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734295936 00010000:00010000:3.0:1746129576.658658:0:20577:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012f890200/0x40a459093b06ae6d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21a49 expref: 29 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129576.658665:0:20577:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012f890200/0x40a459093b06ae6d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21a49 expref: 29 pid: 4385 timeout: 931 lvb_type: 1 00000100:00100000:1.0:1746129576.658669:0:22480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734296064 00000100:00100000:1.0:1746129576.658670:0:22480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734296064 00000100:00100000:3.0:1746129576.658674:0:20577:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20577:1830948737577088:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129576.658683:0:22480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16564 00000100:00100000:1.0:1746129576.658687:0:22480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092fd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:068dab75-d300-4ead-a742-d14572ad1e50+8:1963:x1830948734295936:12345-192.168.202.4@tcp:1:mirror_io.0 00010000:00010000:3.0:1746129576.658703:0:20577:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008fbb6e00/0x40a459093b06aee4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21aa4 expref: 8 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129576.658704:0:22480:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136b1d600/0x40a459093b06af5b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129576.658711:0:20577:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008fbb6e00/0x40a459093b06aee4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21aa4 expref: 8 pid: 7148 timeout: 931 lvb_type: 1 00010000:00010000:1.0:1746129576.658713:0:22480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f91b400/0x40a459093b06ae27 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21a18 expref: 25 pid: 22481 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746129576.658718:0:20577:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20577:1830948737577216:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129576.658720:0:22480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008fbb7a00/0x40a459093b06aeeb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21aab expref: 8 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129576.658727:0:22480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f890000/0x40a459093b06ae89 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21a50 expref: 29 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129576.658733:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129576.658734:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129576.658736:0:22480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136b1d600/0x40a459093b06af5b lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129576.658739:0:20577:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f91b600/0x40a459093b06ae20 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21a11 expref: 25 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129576.658746:0:20577:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f91b600/0x40a459093b06ae20 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21a11 expref: 25 pid: 22481 timeout: 931 lvb_type: 1 00010000:00010000:1.0:1746129576.658749:0:22480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012f890000/0x40a459093b06ae89 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21a50 expref: 29 pid: 7148 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746129576.658754:0:20577:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20577:1830948737577344:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129576.658756:0:22480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012f890000/0x40a459093b06ae89 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21a50 expref: 29 pid: 7148 timeout: 931 lvb_type: 1 00000100:00100000:1.0:1746129576.658762:0:22480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092fd1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22480:1830948737577472:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129576.658780:0:20577:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa3819c0 going to sleep for 11 seconds 00010000:00010000:1.0:1746129576.658782:0:22480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008fbb7a00/0x40a459093b06aeeb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21aab expref: 8 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129576.658788:0:22480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008fbb7a00/0x40a459093b06aeeb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21aab expref: 8 pid: 7148 timeout: 931 lvb_type: 1 00000100:00100000:3.0:1746129576.658795:0:8410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16565 00000100:00100000:1.0:1746129576.658795:0:22480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009016a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22480:1830948737577600:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129576.658800:0:8410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092fd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:068dab75-d300-4ead-a742-d14572ad1e50+7:1963:x1830948734296064:12345-192.168.202.4@tcp:1:mirror_io.0 00010000:00010000:3.0:1746129576.658814:0:8410:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012c22ca00/0x40a459093b06af62 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129576.658816:0:22480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f91b400/0x40a459093b06ae27 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21a18 expref: 25 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129576.658823:0:22480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f91b400/0x40a459093b06ae27 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21a18 expref: 25 pid: 22481 timeout: 931 lvb_type: 1 00010000:00010000:3.0:1746129576.658824:0:8410:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f91a200/0x40a459093b06ae35 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21a1f expref: 14 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129576.658831:0:8410:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a77f6e00/0x40a459093b06aef2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21ab2 expref: 7 pid: 20577 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746129576.658835:0:22480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a07aea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22480:1830948737577728:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129576.658836:0:8410:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f890c00/0x40a459093b06ae74 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21a57 expref: 19 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129576.658841:0:8410:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129576.658842:0:8410:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129576.658844:0:8410:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c22ca00/0x40a459093b06af62 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129576.658847:0:22480:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0aca80 going to sleep for 11 seconds 00010000:00010000:3.0:1746129576.658856:0:8410:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f890c00/0x40a459093b06ae74 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21a57 expref: 19 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129576.658863:0:8410:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f890c00/0x40a459093b06ae74 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21a57 expref: 19 pid: 4385 timeout: 931 lvb_type: 1 00000100:00100000:1.0:1746129576.658869:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129576.658870:0:8410:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8410:1830948737577856:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129576.658880:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734296320 00000100:00100000:1.0:1746129576.658882:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734296320 00010000:00010000:3.0:1746129576.658896:0:8410:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a77f6e00/0x40a459093b06aef2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21ab2 expref: 7 pid: 20577 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746129576.658898:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16566 00000100:00100000:1.0:1746129576.658901:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a07af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:068dab75-d300-4ead-a742-d14572ad1e50+9:1963:x1830948734296320:12345-192.168.202.4@tcp:1:mirror_io.0 00010000:00010000:3.0:1746129576.658907:0:8410:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a77f6e00/0x40a459093b06aef2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21ab2 expref: 7 pid: 20577 timeout: 931 lvb_type: 1 00000100:00100000:3.0:1746129576.658914:0:8410:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091b05880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8410:1830948737577984:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129576.658914:0:4385:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a6caee00/0x40a459093b06af69 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129576.658923:0:4385:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f890400/0x40a459093b06af07 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21ad5 expref: 29 pid: 8411 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129576.658928:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129576.658929:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129576.658931:0:4385:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6caee00/0x40a459093b06af69 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129576.658935:0:8410:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f91a200/0x40a459093b06ae35 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21a1f expref: 14 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129576.658942:0:8410:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f91a200/0x40a459093b06ae35 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21a1f expref: 14 pid: 22481 timeout: 931 lvb_type: 1 00010000:00010000:1.0:1746129576.658942:0:4385:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012f890400/0x40a459093b06af07 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21ad5 expref: 29 pid: 8411 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129576.658949:0:8410:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091b06680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8410:1830948737578112:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129576.658949:0:4385:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012f890400/0x40a459093b06af07 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21ad5 expref: 29 pid: 8411 timeout: 931 lvb_type: 0 00000100:00100000:1.0:1746129576.658956:0:4385:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a07ad500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:4385:1830948737578240:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129576.658960:0:8410:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa381180 going to sleep for 11 seconds 00000100:00100000:1.0:1746129576.658969:0:4385:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0acc00 going to sleep for 11 seconds 00000100:00100000:3.0:1746129576.658986:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129576.659002:0:11014:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734296192 00000100:00100000:1.0:1746129576.659004:0:11014:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734296192 00000100:00100000:1.0:1746129576.659024:0:11014:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16567 00000100:00100000:1.0:1746129576.659029:0:11014:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:068dab75-d300-4ead-a742-d14572ad1e50+8:1963:x1830948734296192:12345-192.168.202.4@tcp:1:mirror_io.0 00010000:00010000:1.0:1746129576.659043:0:11014:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a6cae600/0x40a459093b06af70 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129576.659052:0:11014:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095044a00/0x40a459093b06ae9e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4468735) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21a73 expref: 14 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129576.659059:0:11014:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095044200/0x40a459093b06aea5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->4194303] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21a7a expref: 14 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129576.659066:0:11014:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f891a00/0x40a459093b06aed6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21a96 expref: 19 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129576.659071:0:11014:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 3 00010000:00010000:1.0:1746129576.659072:0:11014:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 3 00010000:00010000:1.0:1746129576.659074:0:11014:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6cae600/0x40a459093b06af70 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129576.659088:0:11014:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f891a00/0x40a459093b06aed6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21a96 expref: 19 pid: 7148 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129576.659548:0:31522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092fd0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+13:1962:x1830948734295296:12345-192.168.202.4@tcp:3:cat.0 Request processed in 7933us (8038us total) trans 0 rc 679936/679936 00000100:00100000:2.0:1746129576.659557:0:31522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7993 00002000:00100000:2.0:1746129576.659566:0:31522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3ef:0x0] (4468736->5148671) req@ffff880092fd0700 x1830948734295296/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:317/0 lens 488/440 e 0 to 0 dl 1746129587 ref 1 fl Complete:/200/0 rc 679936/679936 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129576.659574:0:31522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092fd0700 with x1830948734295296 ext(4468736->5148671) 00010000:00010000:2.0:1746129576.659580:0:31522:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880095044a00/0x40a459093b06ae9e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4468735) gid 0 flags: 0x40000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21a73 expref: 13 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129576.662035:0:31522:0:(ldlm_lockd.c:596:ldlm_refresh_waiting_lock()) ### wasn't waiting ns: filter-lustre-OST0000_UUID lock: ffff880095044a00/0x40a459093b06ae9e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4468735) gid 0 flags: 0x40000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21a73 expref: 13 pid: 7148 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746129576.662049:0:31522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092fd0700 00010000:00010000:1.0:1746129576.662117:0:11014:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f891a00/0x40a459093b06aed6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21a96 expref: 19 pid: 7148 timeout: 931 lvb_type: 0 00000100:00100000:1.0:1746129576.662141:0:11014:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a07af480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11014:1830948737578368:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129576.662234:0:11014:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095044200/0x40a459093b06aea5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->4194303] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21a7a expref: 12 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129576.662245:0:11014:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095044200/0x40a459093b06aea5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->4194303] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21a7a expref: 12 pid: 7148 timeout: 931 lvb_type: 0 00000100:00100000:1.0:1746129576.662253:0:11014:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a07afb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11014:1830948737578496:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129576.662291:0:11014:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095044a00/0x40a459093b06ae9e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4468735) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21a73 expref: 12 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129576.662310:0:11014:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095044a00/0x40a459093b06ae9e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4468735) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21a73 expref: 12 pid: 7148 timeout: 931 lvb_type: 0 00000100:00100000:1.0:1746129576.662318:0:11014:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cda4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11014:1830948737578624:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129576.662332:0:11014:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0ac600 going to sleep for 11 seconds 00000100:00100000:0.0:1746129576.662787:0:9823:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092fd2300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9823:1830948737576960:192.168.202.4@tcp:105: 00010000:00010000:0.0:1746129576.662804:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129576.662845:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009507e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+25:1963:x1830948734295680:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 4432us (4994us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129576.662856:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8528 00000100:00100000:2.0:1746129576.663907:0:8411:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f44b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8411:1830948737576832:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129576.663929:0:8411:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009cfd7800/0x40a459093b06af4d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129576.664181:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129576.664254:0:31522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734296448 00000100:00100000:2.0:1746129576.664270:0:31522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734296448 00002000:00100000:2.0:1746129576.664331:0:31522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3ec:0x0] (368640->1044479) req@ffff88009507dc00 x1830948734296448/t0(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:317/0 lens 488/0 e 0 to 0 dl 1746129587 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129576.664340:0:31522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009507dc00 with x1830948734296448 ext(368640->1044479) 00010000:00010000:2.0:1746129576.664347:0:31522:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012f891400/0x40a459093b06ae97 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 368640->1044479) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21a6c expref: 20 pid: 7148 timeout: 931 lvb_type: 0 00010000:00010000:2.0:1746129576.666535:0:31522:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012f891400/0x40a459093b06ae97 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 368640->1044479) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21a6c expref: 20 pid: 7148 timeout: 931 lvb_type: 0 00002000:00010000:2.0:1746129576.666546:0:31522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009507dc00 00000100:00100000:2.0:1746129576.666600:0:31522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2475 00000100:00100000:2.0:1746129576.666615:0:31522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009507dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ada2ffba-8920-4ecb-8068-68caa9806978+20:1963:x1830948734296448:12345-192.168.202.4@tcp:4:cat.0 00000100:00100000:0.0:1746129576.671374:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129576.671402:0:20577:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20577:1830948737577088:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129576.671405:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129576.671415:0:20577:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20577:1830948737577216:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129576.671427:0:7086:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734296704 00000100:00100000:0.0:1746129576.671433:0:7086:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734296704 00010000:00010000:0.0:1746129576.671470:0:7086:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008fbb6e00/0x40a459093b06aee4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21aa4 expref: 10 pid: 7148 timeout: 931 lvb_type: 1 00000100:00100000:1.0:1746129576.671477:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734296576 00000100:00100000:1.0:1746129576.671480:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734296576 00010000:00010000:1.0:1746129576.671495:0:9823:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012f890200/0x40a459093b06ae6d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21a49 expref: 30 pid: 4385 timeout: 931 lvb_type: 1 00000100:00100000:0.0:1746129576.671496:0:7086:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8529 00000100:00100000:0.0:1746129576.671503:0:7086:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009507ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:068dab75-d300-4ead-a742-d14572ad1e50+10:1961:x1830948734296704:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129576.671517:0:7086:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746129576.671524:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8530 00000100:00100000:1.0:1746129576.671529:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009507f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ada2ffba-8920-4ecb-8068-68caa9806978+30:1961:x1830948734296576:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129576.671535:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129576.671540:0:7086:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008fbb6e00/0x40a459093b06aee4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21aa4 expref: 10 pid: 7148 timeout: 931 lvb_type: 1 00010000:00010000:1.0:1746129576.671542:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012f890200/0x40a459093b06ae6d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21a49 expref: 30 pid: 4385 timeout: 931 lvb_type: 1 00010000:00010000:0.0:1746129576.671550:0:7086:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008fbb6e00/0x40a459093b06aee4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21aa4 expref: 10 pid: 7148 timeout: 931 lvb_type: 1 00010000:00010000:1.0:1746129576.671564:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012f890200/0x40a459093b06ae6d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21a49 expref: 30 pid: 4385 timeout: 931 lvb_type: 1 00010000:00010000:0.0:1746129576.671628:0:7086:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008fbb6e00/0x40a459093b06aee4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21aa4 expref: 10 pid: 7148 timeout: 931 lvb_type: 1 00010000:00010000:1.0:1746129576.671638:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f890200/0x40a459093b06ae6d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21a49 expref: 30 pid: 4385 timeout: 931 lvb_type: 1 00010000:00010000:0.0:1746129576.671651:0:7086:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746129576.671655:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129576.671690:0:7086:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009507ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:068dab75-d300-4ead-a742-d14572ad1e50+9:1961:x1830948734296704:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 188us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129576.671697:0:7086:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8529 00000100:00100000:1.0:1746129576.671790:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009507f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ada2ffba-8920-4ecb-8068-68caa9806978+29:1961:x1830948734296576:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 260us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129576.671796:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8530 00000100:00100000:1.0:1746129576.671833:0:22480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092fd1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22480:1830948737577472:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129576.680968:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129576.680985:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129576.681006:0:7086:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734296960 00000100:00100000:0.0:1746129576.681014:0:7086:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734296960 00010000:00010000:0.0:1746129576.681050:0:7086:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f91b600/0x40a459093b06ae20 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21a11 expref: 25 pid: 22481 timeout: 931 lvb_type: 1 00000100:00100000:0.0:1746129576.681072:0:7086:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734297216 00000100:00100000:0.0:1746129576.681074:0:7086:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734297216 00010000:00010000:0.0:1746129576.681084:0:7086:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a77f6e00/0x40a459093b06aef2 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21ab2 expref: 9 pid: 20577 timeout: 931 lvb_type: 1 00000100:00100000:0.0:1746129576.681100:0:7086:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8531 00000100:00100000:0.0:1746129576.681106:0:7086:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009507ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+25:1962:x1830948734296960:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129576.681120:0:7086:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129576.681141:0:7086:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f91b600/0x40a459093b06ae20 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21a11 expref: 25 pid: 22481 timeout: 931 lvb_type: 1 00010000:00010000:0.0:1746129576.681153:0:7086:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f91b600/0x40a459093b06ae20 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21a11 expref: 25 pid: 22481 timeout: 931 lvb_type: 1 00010000:00010000:0.0:1746129576.681179:0:7086:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129576.681182:0:7086:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129576.681186:0:7086:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091b67c00/0x40a459093b06af54 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129576.681194:0:7086:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091b67c00/0x40a459093b06af54 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129576.681212:0:7086:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129576.681249:0:7086:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009507ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+25:1962:x1830948734296960:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 142us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129576.681255:0:7086:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8531 00000100:00100000:0.0:1746129576.681290:0:7086:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8532 00000100:00100000:0.0:1746129576.681314:0:7086:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092fd2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:068dab75-d300-4ead-a742-d14572ad1e50+9:1962:x1830948734297216:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129576.681322:0:7086:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129576.681335:0:7086:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a77f6e00/0x40a459093b06aef2 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21ab2 expref: 9 pid: 20577 timeout: 931 lvb_type: 1 00010000:00010000:0.0:1746129576.681343:0:7086:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a77f6e00/0x40a459093b06aef2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21ab2 expref: 9 pid: 20577 timeout: 931 lvb_type: 1 00010000:00010000:0.0:1746129576.681355:0:7086:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129576.681367:0:7086:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092fd2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:068dab75-d300-4ead-a742-d14572ad1e50+9:1962:x1830948734297216:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 73us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129576.681372:0:7086:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8532 00000100:00100000:0.0:1746129576.681400:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129576.681414:0:7086:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734296832 00000100:00100000:0.0:1746129576.681416:0:7086:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734296832 00010000:00010000:0.0:1746129576.681426:0:7086:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008fbb7a00/0x40a459093b06aeeb lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21aab expref: 9 pid: 7148 timeout: 931 lvb_type: 1 00000100:00100000:0.0:1746129576.681438:0:7086:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8533 00000100:00100000:0.0:1746129576.681441:0:7086:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6027450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:068dab75-d300-4ead-a742-d14572ad1e50+9:1962:x1830948734296832:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129576.681447:0:7086:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129576.681455:0:7086:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008fbb7a00/0x40a459093b06aeeb lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21aab expref: 9 pid: 7148 timeout: 931 lvb_type: 1 00010000:00010000:0.0:1746129576.681461:0:7086:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008fbb7a00/0x40a459093b06aeeb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21aab expref: 9 pid: 7148 timeout: 931 lvb_type: 1 00010000:00010000:0.0:1746129576.681470:0:7086:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129576.681481:0:7086:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6027450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:068dab75-d300-4ead-a742-d14572ad1e50+9:1962:x1830948734296832:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 40us (81us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129576.681486:0:7086:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8533 00000100:00100000:0.0:1746129576.681547:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129576.681555:0:7086:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734297088 00000100:00100000:0.0:1746129576.681557:0:7086:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734297088 00010000:00010000:0.0:1746129576.681566:0:7086:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f890c00/0x40a459093b06ae74 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21a57 expref: 22 pid: 4385 timeout: 931 lvb_type: 1 00000100:00100000:0.0:1746129576.681577:0:7086:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8534 00000100:00100000:0.0:1746129576.681581:0:7086:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092fd2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ada2ffba-8920-4ecb-8068-68caa9806978+22:1962:x1830948734297088:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129576.681586:0:7086:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129576.681591:0:7086:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f890c00/0x40a459093b06ae74 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21a57 expref: 22 pid: 4385 timeout: 931 lvb_type: 1 00010000:00010000:0.0:1746129576.681602:0:7086:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f890c00/0x40a459093b06ae74 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21a57 expref: 22 pid: 4385 timeout: 931 lvb_type: 1 00010000:00010000:0.0:1746129576.681612:0:7086:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129576.681622:0:7086:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092fd2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ada2ffba-8920-4ecb-8068-68caa9806978+22:1962:x1830948734297088:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 41us (75us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129576.681626:0:7086:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8534 00000100:00100000:0.0:1746129576.681651:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129576.681659:0:7086:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734297344 00000100:00100000:0.0:1746129576.681661:0:7086:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734297344 00010000:00010000:0.0:1746129576.681670:0:7086:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012f890000/0x40a459093b06ae89 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21a50 expref: 29 pid: 7148 timeout: 931 lvb_type: 1 00000100:00100000:0.0:1746129576.681679:0:7086:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8535 00000100:00100000:0.0:1746129576.681682:0:7086:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009507ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ada2ffba-8920-4ecb-8068-68caa9806978+29:1961:x1830948734297344:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129576.681687:0:7086:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129576.681692:0:7086:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012f890000/0x40a459093b06ae89 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21a50 expref: 29 pid: 7148 timeout: 931 lvb_type: 1 00010000:00010000:0.0:1746129576.681699:0:7086:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012f890000/0x40a459093b06ae89 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21a50 expref: 29 pid: 7148 timeout: 931 lvb_type: 1 00010000:00010000:0.0:1746129576.681709:0:7086:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f890000/0x40a459093b06ae89 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21a50 expref: 29 pid: 7148 timeout: 931 lvb_type: 1 00010000:00010000:0.0:1746129576.681727:0:7086:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129576.681740:0:7086:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009507ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ada2ffba-8920-4ecb-8068-68caa9806978+28:1961:x1830948734297344:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 57us (88us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129576.681744:0:7086:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8535 00000100:00100000:0.0:1746129576.681775:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129576.681784:0:7086:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734297472 00000100:00100000:0.0:1746129576.681787:0:7086:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734297472 00010000:00010000:0.0:1746129576.681795:0:7086:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f91b400/0x40a459093b06ae27 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21a18 expref: 25 pid: 22481 timeout: 931 lvb_type: 1 00000100:00100000:0.0:1746129576.681806:0:7086:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8536 00000100:00100000:0.0:1746129576.681809:0:7086:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009507e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+25:1962:x1830948734297472:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129576.681814:0:7086:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129576.681819:0:7086:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f91b400/0x40a459093b06ae27 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21a18 expref: 25 pid: 22481 timeout: 931 lvb_type: 1 00010000:00010000:0.0:1746129576.681826:0:7086:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f91b400/0x40a459093b06ae27 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21a18 expref: 25 pid: 22481 timeout: 931 lvb_type: 1 00010000:00010000:0.0:1746129576.681834:0:7086:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129576.681836:0:7086:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129576.681839:0:7086:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136b1d600/0x40a459093b06af5b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129576.681845:0:7086:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136b1d600/0x40a459093b06af5b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129576.681858:0:7086:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129576.681870:0:7086:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009507e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+25:1962:x1830948734297472:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 60us (94us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129576.681874:0:7086:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8536 00000100:00100000:0.0:1746129576.682027:0:4385:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a07ad500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:4385:1830948737578240:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129576.682048:0:4385:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a6caee00/0x40a459093b06af69 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129576.682068:0:11014:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a07af480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11014:1830948737578368:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129576.682077:0:11014:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a07afb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11014:1830948737578496:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129576.682083:0:11014:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cda4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11014:1830948737578624:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129576.682098:0:11014:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800a6cae600/0x40a459093b06af70 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129576.682716:0:22480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008fbb7a00/0x40a459093b06aeeb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21aab expref: 8 pid: 7148 timeout: 931 lvb_type: 1 00000100:00100000:1.0:1746129576.682731:0:22480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009016a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22480:1830948737577600:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129576.682741:0:22480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f91b400/0x40a459093b06ae27 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21a18 expref: 24 pid: 22481 timeout: 931 lvb_type: 1 00000100:00100000:1.0:1746129576.682749:0:22480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a07aea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22480:1830948737577728:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129576.682767:0:22480:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136b1d600/0x40a459093b06af5b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129576.682774:0:22480:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136b1d600/0x40a459093b06af5b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129576.682781:0:22480:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136b1d600/0x40a459093b06af5b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129576.682803:0:22480:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136b1d600/0x40a459093b06af5b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129576.682811:0:22480:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136b1d600/0x40a459093b06af5b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129576.682818:0:22480:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136b1d600/0x40a459093b06af5b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129576.682825:0:22480:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880136b1d600 already unused, calling callback (ffffffffa086ed70) 00010000:00010000:1.0:1746129576.682829:0:22480:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136b1d600/0x40a459093b06af5b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129576.682836:0:22480:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136b1d600/0x40a459093b06af5b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129576.682847:0:22480:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136b1d600/0x40a459093b06af5b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129576.682853:0:22480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136b1d600/0x40a459093b06af5b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129576.682904:0:22480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092fd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:068dab75-d300-4ead-a742-d14572ad1e50+7:1963:x1830948734295936:12345-192.168.202.4@tcp:1:mirror_io.0 Request processed in 24216us (24303us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129576.682913:0:22480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16564 00000100:00100000:0.0:1746129576.683132:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00010000:00010000:3.0:1746129576.683255:0:8410:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f890c00/0x40a459093b06ae74 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21a57 expref: 21 pid: 4385 timeout: 931 lvb_type: 1 00000100:00100000:3.0:1746129576.684344:0:8410:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8410:1830948737577856:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129576.684363:0:8410:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a77f6e00/0x40a459093b06aef2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21ab2 expref: 8 pid: 20577 timeout: 931 lvb_type: 1 00000100:00100000:3.0:1746129576.684375:0:8410:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091b05880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8410:1830948737577984:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129576.684386:0:8410:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091b06680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8410:1830948737578112:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129576.684409:0:8410:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012c22ca00/0x40a459093b06af62 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129576.684440:0:20577:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f91b600/0x40a459093b06ae20 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21a11 expref: 23 pid: 22481 timeout: 931 lvb_type: 1 00000100:00100000:3.0:1746129576.684448:0:20577:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20577:1830948737577344:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129576.684465:0:20577:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880091b67c00/0x40a459093b06af54 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129576.684471:0:20577:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880091b67c00/0x40a459093b06af54 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129576.684476:0:20577:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091b67c00/0x40a459093b06af54 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129576.684496:0:20577:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880091b67c00/0x40a459093b06af54 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129576.684502:0:20577:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880091b67c00/0x40a459093b06af54 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129576.684507:0:20577:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880091b67c00/0x40a459093b06af54 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129576.684517:0:20577:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091b67c00 already unused, calling callback (ffffffffa086ed70) 00010000:00010000:3.0:1746129576.684520:0:20577:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880091b67c00/0x40a459093b06af54 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129576.684525:0:20577:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880091b67c00/0x40a459093b06af54 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129576.684537:0:20577:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880091b67c00/0x40a459093b06af54 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129576.684542:0:20577:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091b67c00/0x40a459093b06af54 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129576.684592:0:20577:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:068dab75-d300-4ead-a742-d14572ad1e50+6:1962:x1830948734295808:12345-192.168.202.4@tcp:1:mirror_io.0 Request processed in 26006us (26051us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129576.684599:0:20577:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16563 00000100:00100000:0.0:1746129576.685160:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129576.685189:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129576.685195:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734297856 00000100:00100000:1.0:1746129576.685202:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734297856 00000100:00100000:0.0:1746129576.685214:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129576.685227:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00010000:00010000:1.0:1746129576.685228:0:9823:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f91a200/0x40a459093b06ae35 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21a1f expref: 13 pid: 22481 timeout: 931 lvb_type: 1 00000100:00100000:1.0:1746129576.685255:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8537 00000100:00100000:0.0:1746129576.685258:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129576.685272:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009507f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+13:1963:x1830948734297856:12345-192.168.202.4@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746129576.685282:0:20578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734298624 00000100:00100000:0.0:1746129576.685284:0:20578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734298624 00010000:00010000:1.0:1746129576.685285:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129576.685310:0:20578:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095044200/0x40a459093b06aea5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->4194303] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21a7a expref: 14 pid: 7148 timeout: 931 lvb_type: 0 00010000:00010000:1.0:1746129576.685316:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: ffff88008f91a200/0x40a459093b06ae35 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21a1f expref: 14 pid: 22481 timeout: 931 lvb_type: 1 00010000:00010000:1.0:1746129576.685329:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f91a200/0x40a459093b06ae35 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21a1f expref: 14 pid: 22481 timeout: 931 lvb_type: 1 00000100:00100000:0.0:1746129576.685330:0:20578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8538 00000100:00100000:0.0:1746129576.685335:0:20578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a07af480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+14:1962:x1830948734298624:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129576.685341:0:20578:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129576.685345:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f91a200/0x40a459093b06ae35 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21a1f expref: 14 pid: 22481 timeout: 931 lvb_type: 1 00010000:00010000:0.0:1746129576.685350:0:20578:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: ffff880095044200/0x40a459093b06aea5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->4194303] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21a7a expref: 14 pid: 7148 timeout: 931 lvb_type: 0 00010000:00010000:1.0:1746129576.685356:0:9823:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129576.685357:0:20578:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095044200/0x40a459093b06aea5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->4194303] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21a7a expref: 13 pid: 7148 timeout: 931 lvb_type: 0 00010000:00010000:1.0:1746129576.685358:0:9823:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129576.685362:0:9823:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c22ca00/0x40a459093b06af62 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129576.685366:0:20578:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095044200/0x40a459093b06aea5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->4194303] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21a7a expref: 13 pid: 7148 timeout: 931 lvb_type: 0 00010000:00010000:1.0:1746129576.685369:0:9823:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c22ca00/0x40a459093b06af62 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129576.685375:0:20578:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746129576.685385:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129576.685393:0:20578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a07af480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+12:1962:x1830948734298624:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 58us (134us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129576.685396:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009507f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+12:1963:x1830948734297856:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 136us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129576.685399:0:20578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8538 00000100:00100000:1.0:1746129576.685401:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8537 00000100:00100000:1.0:1746129576.685417:0:31518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734297600 00000100:00100000:1.0:1746129576.685420:0:31518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734297600 00002000:00100000:1.0:1746129576.685444:0:31518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3ef:0x0] (4194304->4468735) req@ffff88009507ea00 x1830948734297600/t0(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:317/0 lens 488/0 e 0 to 0 dl 1746129587 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746129576.685452:0:21725:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734297984 00002000:00100000:1.0:1746129576.685453:0:31518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009507ea00 with x1830948734297600 ext(4194304->4468735) 00000100:00100000:0.0:1746129576.685454:0:21725:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734297984 00010000:00010000:1.0:1746129576.685458:0:31518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880095044a00/0x40a459093b06ae9e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4468735) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21a73 expref: 11 pid: 7148 timeout: 931 lvb_type: 0 00010000:00010000:1.0:1746129576.685466:0:31518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880095044a00/0x40a459093b06ae9e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4468735) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21a73 expref: 11 pid: 7148 timeout: 932 lvb_type: 0 00002000:00100000:0.0:1746129576.685467:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f5:0x0] (2097152->3145727) req@ffff88009507ed80 x1830948734297984/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:317/0 lens 488/0 e 0 to 0 dl 1746129587 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00010000:1.0:1746129576.685472:0:31518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009507ea00 00002000:00100000:0.0:1746129576.685474:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009507ed80 with x1830948734297984 ext(2097152->3145727) 00010000:00010000:0.0:1746129576.685478:0:21725:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012f890400/0x40a459093b06af07 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21ad5 expref: 28 pid: 8411 timeout: 931 lvb_type: 0 00010000:00010000:0.0:1746129576.685485:0:21725:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012f890400/0x40a459093b06af07 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21ad5 expref: 28 pid: 8411 timeout: 932 lvb_type: 0 00000100:00100000:1.0:1746129576.685486:0:31520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734298240 00000100:00100000:1.0:1746129576.685488:0:31520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734298240 00002000:00010000:0.0:1746129576.685491:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009507ed80 00000100:00100000:0.0:1746129576.685498:0:21725:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734298496 00002000:00100000:1.0:1746129576.685499:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3f5:0x0] (3145728->4194303) req@ffff8800a07aea00 x1830948734298240/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:317/0 lens 488/0 e 0 to 0 dl 1746129587 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746129576.685500:0:21725:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734298496 00002000:00100000:1.0:1746129576.685505:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a07aea00 with x1830948734298240 ext(3145728->4194303) 00002000:00100000:0.0:1746129576.685508:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->4194303) req@ffff8800a07afb80 x1830948734298496/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:317/0 lens 488/0 e 0 to 0 dl 1746129587 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:1.0:1746129576.685509:0:31520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012f890400/0x40a459093b06af07 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21ad5 expref: 29 pid: 8411 timeout: 932 lvb_type: 0 00002000:00100000:0.0:1746129576.685515:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a07afb80 with x1830948734298496 ext(3145728->4194303) 00010000:00010000:1.0:1746129576.685516:0:31520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012f890400/0x40a459093b06af07 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21ad5 expref: 29 pid: 8411 timeout: 932 lvb_type: 0 00010000:00010000:0.0:1746129576.685519:0:21725:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012f891a00/0x40a459093b06aed6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21a96 expref: 21 pid: 7148 timeout: 931 lvb_type: 0 00002000:00010000:1.0:1746129576.685520:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a07aea00 00010000:00010000:0.0:1746129576.685525:0:21725:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012f891a00/0x40a459093b06aed6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21a96 expref: 21 pid: 7148 timeout: 932 lvb_type: 0 00002000:00010000:0.0:1746129576.685529:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a07afb80 00000100:00100000:1.0:1746129576.685530:0:31520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2476 00000100:00100000:1.0:1746129576.685534:0:31520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009507ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+11:1963:x1830948734297600:12345-192.168.202.4@tcp:4:cat.0 00000100:00100000:0.0:1746129576.685543:0:8416:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2477 00000100:00100000:0.0:1746129576.685547:0:8416:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009507ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ada2ffba-8920-4ecb-8068-68caa9806978+29:1960:x1830948734297984:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:1.0:1746129576.685831:0:31518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2478 00000100:00100000:1.0:1746129576.685836:0:31518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a07aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ada2ffba-8920-4ecb-8068-68caa9806978+29:1960:x1830948734298240:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129576.685879:0:21725:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2479 00010000:00010000:3.0:1746129576.685991:0:8410:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012c22ca00/0x40a459093b06af62 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129576.685998:0:8410:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c22ca00/0x40a459093b06af62 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129576.686013:0:8410:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012c22ca00/0x40a459093b06af62 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129576.686019:0:8410:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012c22ca00/0x40a459093b06af62 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129576.686026:0:8410:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012c22ca00/0x40a459093b06af62 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129576.686030:0:8410:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c22ca00 already unused, calling callback (ffffffffa086ed70) 00010000:00010000:3.0:1746129576.686033:0:8410:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012c22ca00/0x40a459093b06af62 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129576.686038:0:8410:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012c22ca00/0x40a459093b06af62 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129576.686047:0:8410:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012c22ca00/0x40a459093b06af62 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129576.686052:0:8410:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c22ca00/0x40a459093b06af62 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129576.686085:0:8410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092fd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:068dab75-d300-4ead-a742-d14572ad1e50+7:1963:x1830948734296064:12345-192.168.202.4@tcp:1:mirror_io.0 Request processed in 27285us (27444us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129576.686091:0:8410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16565 00000100:00100000:0.0:1746129576.686797:0:21725:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a07afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ada2ffba-8920-4ecb-8068-68caa9806978+21:1960:x1830948734298496:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129576.696077:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129576.696107:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129576.696120:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129576.696131:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129576.696143:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129576.696163:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734298752 00000100:00100000:0.0:1746129576.696171:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734298752 00000100:00100000:0.0:1746129576.696213:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734299008 00000100:00100000:0.0:1746129576.696215:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734299008 00000100:00100000:0.0:1746129576.696227:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734299264 00000100:00100000:0.0:1746129576.696229:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734299264 00000100:00100000:0.0:1746129576.696238:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734298880 00000100:00100000:0.0:1746129576.696239:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734298880 00000100:00100000:0.0:1746129576.696248:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734299136 00000100:00100000:0.0:1746129576.696249:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734299136 00000100:00100000:0.0:1746129576.696259:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16568 00000100:00100000:0.0:1746129576.696277:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a07ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+15:1963:x1830948734298752:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129576.696312:0:7148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129576.696332:0:7148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a6cafc00/0x40a459093b06af77 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21af1 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129576.696386:0:7148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094066680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7148:1830948737578752:192.168.202.4@tcp:106: 00000100:00100000:0.0:1746129576.696453:0:7148:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4123c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746129576.696474:0:22481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16569 00000100:00100000:0.0:1746129576.696479:0:22481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094065500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+24:1963:x1830948734299008:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129576.696488:0:22481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129576.696500:0:22481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a6caec00/0x40a459093b06af7e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21aff expref: -99 pid: 22481 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746129576.696525:0:22481:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3f4:0x0] initial LVB size: 2097152, mtime: 0x6813d2a8, atime: 0x6813d2a8, ctime: 0x6813d2a8, blocks: 0x81f 00010000:00010000:0.0:1746129576.696536:0:22481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129576.696538:0:22481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129576.696546:0:22481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6caec00/0x40a459093b06af7e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21aff expref: 25 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129576.696562:0:22481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a6caec00/0x40a459093b06af7e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21aff expref: 25 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129576.696572:0:22481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6caec00, rc 0) 00000100:00100000:1.0:1746129576.696589:0:22480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16570 00000100:00100000:0.0:1746129576.696595:0:22481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094065500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+25:1963:x1830948734299008:12345-192.168.202.4@tcp:101:cat.0 Request processed in 116us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129576.696597:0:22480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094067480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+16:1963:x1830948734299264:12345-192.168.202.4@tcp:101:cat.0 00000100:00100000:0.0:1746129576.696601:0:22481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16569 00010000:00010000:1.0:1746129576.696602:0:22480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129576.696610:0:22480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095c15a00/0x40a459093b06af85 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21b0d expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129576.696617:0:22481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16571 00000100:00100000:0.0:1746129576.696621:0:22481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094066300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+24:1963:x1830948734298880:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129576.696625:0:22481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746129576.696632:0:22480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cda4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22480:1830948737578880:192.168.202.4@tcp:106: 00010000:00010000:0.0:1746129576.696633:0:22481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a6caf800/0x40a459093b06af8c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21af8 expref: -99 pid: 22481 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746129576.696643:0:22481:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3f3:0x0] initial LVB size: 2097152, mtime: 0x6813d2a8, atime: 0x6813d2a8, ctime: 0x6813d2a8, blocks: 0x821 00010000:00010000:0.0:1746129576.696650:0:22481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129576.696651:0:22481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746129576.696652:0:22480:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0aca80 going to sleep for 11 seconds 00010000:00010000:0.0:1746129576.696654:0:22481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6caf800/0x40a459093b06af8c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21af8 expref: 25 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129576.696662:0:22481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a6caf800/0x40a459093b06af8c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21af8 expref: 25 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129576.696669:0:22481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6caf800, rc 0) 00000100:00100000:1.0:1746129576.696683:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129576.696683:0:22481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094066300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+25:1963:x1830948734298880:12345-192.168.202.4@tcp:101:cat.0 Request processed in 61us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129576.696687:0:22481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16571 00000100:00100000:0.0:1746129576.696696:0:22481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734299392 00000100:00100000:0.0:1746129576.696698:0:22481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734299392 00000100:00100000:0.0:1746129576.696707:0:22481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16572 00000100:00100000:0.0:1746129576.696711:0:22481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094066d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+17:1963:x1830948734299136:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129576.696716:0:22481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129576.696723:0:22481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008fbb7400/0x40a459093b06af93 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21b06 expref: -99 pid: 22481 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746129576.696736:0:22481:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3ee:0x0] initial LVB size: 2097152, mtime: 0x6813d2a7, atime: 0x6813d2a7, ctime: 0x6813d2a7, blocks: 0x81f 00010000:00010000:0.0:1746129576.696742:0:22481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129576.696743:0:22481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129576.696746:0:22481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008fbb7400/0x40a459093b06af93 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21b06 expref: 18 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129576.696755:0:22481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008fbb7400/0x40a459093b06af93 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21b06 expref: 18 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129576.696761:0:22481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fbb7400, rc 0) 00000100:00100000:0.0:1746129576.696775:0:22481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094066d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+18:1963:x1830948734299136:12345-192.168.202.4@tcp:101:cat.0 Request processed in 64us (631us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129576.696780:0:22481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16572 00000100:00100000:0.0:1746129576.696789:0:22481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16573 00000100:00100000:0.0:1746129576.696793:0:22481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cda6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+25:1963:x1830948734299392:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129576.696797:0:22481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129576.696804:0:22481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c47d200/0x40a459093b06af9a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21b14 expref: -99 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129576.696812:0:22481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129576.696820:0:22481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c47d200/0x40a459093b06af9a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21b14 expref: 26 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129576.696827:0:22481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c47d200/0x40a459093b06af9a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21b14 expref: 26 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129576.696835:0:22481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c47d200, rc 0) 00000100:00100000:0.0:1746129576.696847:0:22481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cda6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+25:1963:x1830948734299392:12345-192.168.202.4@tcp:101:cat.0 Request processed in 54us (164us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129576.696851:0:22481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16573 00000100:00100000:1.0:1746129576.707471:0:7148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094066680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7148:1830948737578752:192.168.202.4@tcp:106: 00010000:00010000:1.0:1746129576.707510:0:7148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a6cafc00/0x40a459093b06af77 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21af1 expref: 17 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129576.707524:0:7148:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a6cafc00/0x40a459093b06af77 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21af1 expref: 17 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129576.707535:0:7148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6cafc00, rc 0) 00000100:00100000:1.0:1746129576.707579:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a07ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+16:1963:x1830948734298752:12345-192.168.202.4@tcp:101:cat.0 Request processed in 11303us (11514us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129576.707588:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16568 00000100:00100000:2.0:1746129576.709779:0:31520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009507ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+16:1963:x1830948734297600:12345-192.168.202.4@tcp:4:cat.0 Request processed in 24232us (26635us total) trans 21474841403 rc 0/0 00000100:00100000:2.0:1746129576.709792:0:31520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2476 00002000:00100000:2.0:1746129576.709805:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3ef:0x0] (4194304->4468735) req@ffff88009507ea00 x1830948734297600/t21474841403(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:317/0 lens 488/448 e 0 to 0 dl 1746129587 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129576.709815:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009507ea00 with x1830948734297600 ext(4194304->4468735) 00010000:00010000:2.0:1746129576.709825:0:31520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880095044a00/0x40a459093b06ae9e lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4468735) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21a73 expref: 16 pid: 7148 timeout: 932 lvb_type: 0 00000100:00100000:0.0:1746129576.712216:0:31522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009507dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ada2ffba-8920-4ecb-8068-68caa9806978+23:1963:x1830948734296448:12345-192.168.202.4@tcp:4:cat.0 Request processed in 45598us (48024us total) trans 21474841404 rc 0/0 00000100:00100000:0.0:1746129576.712228:0:31522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2475 00002000:00100000:0.0:1746129576.712240:0:31522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3ec:0x0] (368640->1044479) req@ffff88009507dc00 x1830948734296448/t21474841404(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:317/0 lens 488/448 e 0 to 0 dl 1746129587 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129576.712249:0:31522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009507dc00 with x1830948734296448 ext(368640->1044479) 00010000:00010000:0.0:1746129576.712258:0:31522:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012f891400/0x40a459093b06ae97 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 368640->1044479) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21a6c expref: 23 pid: 7148 timeout: 931 lvb_type: 0 00010000:00010000:0.0:1746129576.712291:0:31522:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012f891400/0x40a459093b06ae97 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 368640->1044479) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21a6c expref: 23 pid: 7148 timeout: 932 lvb_type: 0 00002000:00010000:0.0:1746129576.712321:0:31522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009507dc00 00000100:00100000:0.0:1746129576.712560:0:22480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cda4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22480:1830948737578880:192.168.202.4@tcp:106: 00010000:00010000:0.0:1746129576.712590:0:22480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095c15a00/0x40a459093b06af85 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21b0d expref: 16 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129576.712606:0:22480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095c15a00/0x40a459093b06af85 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21b0d expref: 16 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129576.712617:0:22480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095c15a00, rc 0) 00000100:00100000:0.0:1746129576.712637:0:22480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094067480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+15:1963:x1830948734299264:12345-192.168.202.4@tcp:101:cat.0 Request processed in 16042us (16517us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129576.712644:0:22480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16570 00010000:00010000:2.0:1746129576.712923:0:31520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880095044a00/0x40a459093b06ae9e lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4468735) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21a73 expref: 16 pid: 7148 timeout: 932 lvb_type: 0 00002000:00010000:2.0:1746129576.712934:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009507ea00 00000100:00100000:1.0:1746129576.715622:0:21725:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a07afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ada2ffba-8920-4ecb-8068-68caa9806978+21:1960:x1830948734298496:12345-192.168.202.4@tcp:3:cat.0 Request processed in 29725us (30381us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129576.715633:0:21725:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2479 00002000:00100000:1.0:1746129576.715645:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->4194303) req@ffff8800a07afb80 x1830948734298496/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:317/0 lens 488/440 e 0 to 0 dl 1746129587 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129576.715655:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a07afb80 with x1830948734298496 ext(3145728->4194303) 00010000:00010000:1.0:1746129576.715666:0:21725:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012f891a00/0x40a459093b06aed6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21a96 expref: 21 pid: 7148 timeout: 932 lvb_type: 0 00010000:00010000:1.0:1746129576.715676:0:21725:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012f891a00/0x40a459093b06aed6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21a96 expref: 21 pid: 7148 timeout: 932 lvb_type: 0 00002000:00010000:1.0:1746129576.715683:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a07afb80 00000100:00100000:0.0:1746129576.718464:0:8416:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009507ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ada2ffba-8920-4ecb-8068-68caa9806978+30:1960:x1830948734297984:12345-192.168.202.4@tcp:3:cat.0 Request processed in 32901us (33260us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129576.718477:0:8416:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2477 00002000:00100000:0.0:1746129576.718491:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3f5:0x0] (2097152->3145727) req@ffff88009507ed80 x1830948734297984/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:317/0 lens 488/440 e 0 to 0 dl 1746129587 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129576.718501:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009507ed80 with x1830948734297984 ext(2097152->3145727) 00010000:00010000:0.0:1746129576.718512:0:8416:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012f890400/0x40a459093b06af07 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21ad5 expref: 30 pid: 8411 timeout: 932 lvb_type: 0 00010000:00010000:0.0:1746129576.718529:0:8416:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012f890400/0x40a459093b06af07 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21ad5 expref: 30 pid: 8411 timeout: 932 lvb_type: 0 00002000:00010000:0.0:1746129576.718535:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009507ed80 00000100:00100000:2.0:1746129576.722147:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129576.722173:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129576.722270:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129576.722721:0:31518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a07aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ada2ffba-8920-4ecb-8068-68caa9806978+28:1960:x1830948734298240:12345-192.168.202.4@tcp:3:cat.0 Request processed in 36881us (37503us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129576.722732:0:31518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2478 00002000:00100000:1.0:1746129576.722742:0:31518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3f5:0x0] (3145728->4194303) req@ffff8800a07aea00 x1830948734298240/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:317/0 lens 488/440 e 0 to 0 dl 1746129587 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129576.722751:0:31518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a07aea00 with x1830948734298240 ext(3145728->4194303) 00010000:00010000:1.0:1746129576.722762:0:31518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012f890400/0x40a459093b06af07 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21ad5 expref: 28 pid: 8411 timeout: 932 lvb_type: 0 00010000:00010000:1.0:1746129576.722774:0:31518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012f890400/0x40a459093b06af07 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21ad5 expref: 28 pid: 8411 timeout: 932 lvb_type: 0 00002000:00010000:1.0:1746129576.722780:0:31518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a07aea00 00000100:00100000:0.0:1746129576.723095:0:15749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734299520 00000100:00100000:0.0:1746129576.723104:0:15749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734299520 00010000:00010000:0.0:1746129576.723130:0:15749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095044a00/0x40a459093b06ae9e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4468735) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21a73 expref: 14 pid: 7148 timeout: 932 lvb_type: 0 00000100:00100000:0.0:1746129576.723165:0:15749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734299776 00000100:00100000:0.0:1746129576.723168:0:15749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734299776 00010000:00010000:0.0:1746129576.723179:0:15749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f891400/0x40a459093b06ae97 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 368640->1044479) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21a6c expref: 21 pid: 7148 timeout: 932 lvb_type: 0 00000100:00100000:0.0:1746129576.723192:0:15749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8539 00000100:00100000:0.0:1746129576.723198:0:15749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f44b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+14:1961:x1830948734299520:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129576.723210:0:15749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129576.723231:0:15749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095044a00/0x40a459093b06ae9e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4468735) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21a73 expref: 14 pid: 7148 timeout: 932 lvb_type: 0 00010000:00010000:0.0:1746129576.723241:0:15749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095044a00/0x40a459093b06ae9e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4468735) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21a73 expref: 14 pid: 7148 timeout: 932 lvb_type: 0 00010000:00010000:0.0:1746129576.723273:0:15749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095044a00/0x40a459093b06ae9e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4468735) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21a73 expref: 14 pid: 7148 timeout: 932 lvb_type: 0 00010000:00010000:0.0:1746129576.723290:0:15749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129576.723329:0:15749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f44b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+13:1961:x1830948734299520:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 130us (1192us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129576.723334:0:15749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8539 00000100:00100000:0.0:1746129576.723346:0:15749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8540 00000100:00100000:0.0:1746129576.723350:0:15749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6027850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ada2ffba-8920-4ecb-8068-68caa9806978+21:1963:x1830948734299776:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129576.723357:0:15749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129576.723367:0:15749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f891400/0x40a459093b06ae97 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 368640->1044479) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21a6c expref: 21 pid: 7148 timeout: 932 lvb_type: 0 00010000:00010000:0.0:1746129576.723374:0:15749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f891400/0x40a459093b06ae97 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 368640->1044479) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21a6c expref: 21 pid: 7148 timeout: 932 lvb_type: 0 00010000:00010000:0.0:1746129576.723385:0:15749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f891400/0x40a459093b06ae97 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 368640->1044479) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21a6c expref: 21 pid: 7148 timeout: 932 lvb_type: 0 00010000:00010000:0.0:1746129576.723394:0:15749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129576.723396:0:15749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129576.723400:0:15749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cfd7800/0x40a459093b06af4d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129576.723408:0:15749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cfd7800/0x40a459093b06af4d lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129576.723447:0:15749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129576.723462:0:15749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6027850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ada2ffba-8920-4ecb-8068-68caa9806978+20:1963:x1830948734299776:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 111us (1200us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129576.723467:0:15749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8540 00010000:00010000:3.0:1746129576.723485:0:8411:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009cfd7800/0x40a459093b06af4d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129576.723494:0:8411:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cfd7800/0x40a459093b06af4d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129576.723513:0:22480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734299648 00010000:00010000:3.0:1746129576.723515:0:8411:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009cfd7800/0x40a459093b06af4d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129576.723516:0:22480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734299648 00010000:00010000:3.0:1746129576.723522:0:8411:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009cfd7800/0x40a459093b06af4d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129576.723529:0:8411:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009cfd7800/0x40a459093b06af4d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129576.723533:0:22480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16574 00010000:00010000:3.0:1746129576.723536:0:8411:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009cfd7800 already unused, calling callback (ffffffffa086ed70) 00000100:00100000:0.0:1746129576.723537:0:22480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f44ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+13:32488:x1830948734299648:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129576.723540:0:8411:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009cfd7800/0x40a459093b06af4d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129576.723546:0:8411:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009cfd7800/0x40a459093b06af4d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129576.723550:0:22480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129576.723554:0:8411:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009cfd7800/0x40a459093b06af4d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129576.723559:0:22480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c47d000/0x40a459093b06afa1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21b1b expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129576.723560:0:8411:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cfd7800/0x40a459093b06af4d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129576.723574:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129576.723577:0:22480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a6cae600/0x40a459093b06af70 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129576.723582:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129576.723585:0:22480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c47d000/0x40a459093b06afa1 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [5144576->5242879] (req 5144576->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21b1b expref: 14 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129576.723594:0:22480:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: ffff8800a6cae600/0x40a459093b06af70 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129576.723598:0:8411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009507d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:068dab75-d300-4ead-a742-d14572ad1e50+6:1963:x1830948734295552:12345-192.168.202.4@tcp:1:mirror_io.0 Request processed in 65679us (66216us total) trans 0 rc 0/0 00010000:00010000:0.0:1746129576.723604:0:22480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c47d000/0x40a459093b06afa1 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [5144576->5242879] (req 5144576->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21b1b expref: 14 pid: 22480 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129576.723605:0:8411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16562 00010000:00010000:0.0:1746129576.723612:0:22480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c47d000, rc 0) 00000100:00100000:0.0:1746129576.723626:0:22480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f44ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+14:32488:x1830948734299648:12345-192.168.202.4@tcp:101:cat.0 Request processed in 88us (1452us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129576.723630:0:22480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16574 00000100:00100000:0.0:1746129576.725339:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129576.725601:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734299904 00000100:00100000:1.0:1746129576.725607:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734299904 00010000:00010000:1.0:1746129576.725637:0:9823:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f891a00/0x40a459093b06aed6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21a96 expref: 20 pid: 7148 timeout: 932 lvb_type: 0 00000100:00100000:1.0:1746129576.725662:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8541 00000100:00100000:1.0:1746129576.725669:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094065c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ada2ffba-8920-4ecb-8068-68caa9806978+20:1962:x1830948734299904:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129576.725680:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129576.725700:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f891a00/0x40a459093b06aed6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21a96 expref: 20 pid: 7148 timeout: 932 lvb_type: 0 00010000:00010000:1.0:1746129576.725710:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f891a00/0x40a459093b06aed6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21a96 expref: 20 pid: 7148 timeout: 932 lvb_type: 0 00010000:00010000:1.0:1746129576.725726:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f891a00/0x40a459093b06aed6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21a96 expref: 20 pid: 7148 timeout: 932 lvb_type: 0 00010000:00010000:1.0:1746129576.725737:0:9823:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129576.725739:0:9823:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129576.725742:0:9823:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a6cae600/0x40a459093b06af70 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129576.725749:0:9823:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6cae600/0x40a459093b06af70 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129576.726898:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129576.726969:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094065c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ada2ffba-8920-4ecb-8068-68caa9806978+19:1962:x1830948734299904:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 1296us (1633us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129576.726982:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8541 00010000:00010000:2.0:1746129576.727095:0:11014:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a6cae600/0x40a459093b06af70 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129576.727105:0:11014:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a6cae600/0x40a459093b06af70 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129576.727131:0:11014:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a6cae600/0x40a459093b06af70 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129576.727139:0:11014:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6cae600/0x40a459093b06af70 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129576.727145:0:11014:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a6cae600/0x40a459093b06af70 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129576.727152:0:11014:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a6cae600 already unused, calling callback (ffffffffa086ed70) 00010000:00010000:2.0:1746129576.727155:0:11014:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a6cae600/0x40a459093b06af70 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129576.727163:0:11014:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a6cae600/0x40a459093b06af70 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129576.727176:0:11014:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129576.727178:0:11014:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129576.727184:0:11014:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c47d000/0x40a459093b06afa1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5144576->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21b1b expref: 13 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129576.727196:0:11014:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c47d000/0x40a459093b06afa1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5144576->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21b1b expref: 13 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129576.727230:0:11014:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009c47d000/0x40a459093b06afa1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5144576->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21b1b expref: 13 pid: 22480 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129576.727242:0:11014:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f449880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11014:1830948737579008:192.168.202.4@tcp:105: 00000100:00100000:2.0:1746129576.727356:0:11014:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132f36600 going to sleep for 11 seconds 00000100:00100000:3.0:1746129576.727960:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129576.728083:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734300032 00000100:00100000:1.0:1746129576.728089:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734300032 00000100:00100000:1.0:1746129576.728132:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16575 00000100:00100000:1.0:1746129576.728139:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ada2ffba-8920-4ecb-8068-68caa9806978+19:32491:x1830948734300032:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129576.728154:0:7148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129576.728167:0:7148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009be04800/0x40a459093b06afa8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21b22 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129576.728183:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129576.728185:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129576.728189:0:7148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009be04800/0x40a459093b06afa8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21b22 expref: 20 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129576.728199:0:7148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009be04800/0x40a459093b06afa8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21b22 expref: 20 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129576.728207:0:7148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009be04800, rc 0) 00000100:00100000:1.0:1746129576.728231:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ada2ffba-8920-4ecb-8068-68caa9806978+20:32491:x1830948734300032:12345-192.168.202.4@tcp:101:cat.0 Request processed in 92us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129576.728236:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16575 00000100:00100000:0.0:1746129576.729767:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129576.730389:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734300160 00000100:00100000:1.0:1746129576.730397:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734300160 00010000:00010000:1.0:1746129576.730428:0:9823:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012f890400/0x40a459093b06af07 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21ad5 expref: 28 pid: 8411 timeout: 932 lvb_type: 0 00000100:00100000:1.0:1746129576.730458:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8542 00000100:00100000:1.0:1746129576.730466:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094067800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ada2ffba-8920-4ecb-8068-68caa9806978+28:1963:x1830948734300160:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129576.730480:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129576.730501:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012f890400/0x40a459093b06af07 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21ad5 expref: 28 pid: 8411 timeout: 932 lvb_type: 0 00010000:00010000:1.0:1746129576.730513:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012f890400/0x40a459093b06af07 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21ad5 expref: 28 pid: 8411 timeout: 932 lvb_type: 0 00010000:00010000:1.0:1746129576.730532:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f890400/0x40a459093b06af07 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21ad5 expref: 28 pid: 8411 timeout: 932 lvb_type: 0 00010000:00010000:1.0:1746129576.730544:0:9823:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129576.730546:0:9823:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129576.730549:0:9823:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a6caee00/0x40a459093b06af69 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129576.730557:0:9823:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6caee00/0x40a459093b06af69 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129576.731053:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746129576.731688:0:4385:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a6caee00/0x40a459093b06af69 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129576.731699:0:4385:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a6caee00/0x40a459093b06af69 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129576.731725:0:4385:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a6caee00/0x40a459093b06af69 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129576.731733:0:4385:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6caee00/0x40a459093b06af69 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129576.731740:0:4385:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a6caee00/0x40a459093b06af69 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129576.731746:0:4385:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a6caee00 already unused, calling callback (ffffffffa086ed70) 00000100:00100000:1.0:1746129576.731988:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094067800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ada2ffba-8920-4ecb-8068-68caa9806978+27:1963:x1830948734300160:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 1519us (2223us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129576.731997:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8542 00010000:00010000:2.0:1746129576.732084:0:4385:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a6caee00/0x40a459093b06af69 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129576.732094:0:4385:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a6caee00/0x40a459093b06af69 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129576.732108:0:4385:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a6caee00/0x40a459093b06af69 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129576.732114:0:4385:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a6caee00/0x40a459093b06af69 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129576.732172:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a07af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:068dab75-d300-4ead-a742-d14572ad1e50+5:1963:x1830948734296320:12345-192.168.202.4@tcp:1:mirror_io.0 Request processed in 73269us (73301us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129576.732180:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16566 00000100:00100000:0.0:1746129576.736126:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129576.736154:0:15096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734300928 00000100:00100000:0.0:1746129576.736163:0:15096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734300928 00000100:00100000:0.0:1746129576.736211:0:15096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11309 00000100:00100000:0.0:1746129576.736220:0:15096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094065180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+30:32496:x1830948734300928:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:0.0:1746129576.736243:0:15096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129576.736271:0:15096:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c47d200/0x40a459093b06afaf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21b37 expref: -99 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129576.736395:0:15096:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880094c09a00/0x40a459093b06afb6 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 15096 initiator: MDT0 00010000:00010000:0.0:1746129576.736411:0:15096:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c22d400/0x40a459093b06af38 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21ae3 expref: 25 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129576.736417:0:15096:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094c09a00/0x40a459093b06afb6 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 15096 initiator: MDT0 00000100:00100000:2.0:1746129576.736480:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129576.736498:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734300416 00000100:00100000:2.0:1746129576.736500:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734300416 00000100:00100000:2.0:1746129576.736523:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16576 00000100:00100000:2.0:1746129576.736527:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f449f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+25:1963:x1830948734300416:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129576.736536:0:4385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129576.736549:0:4385:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091b4f000/0x40a459093b06afbd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21b30 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746129576.736576:0:4385:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3f5:0x0] initial LVB size: 4194304, mtime: 0x6813d2a9, atime: 0x6813d2a9, ctime: 0x6813d2a9, blocks: 0x1029 00010000:00010000:2.0:1746129576.736589:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129576.736591:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129576.736598:0:4385:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091b4f000/0x40a459093b06afbd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21b30 expref: 26 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129576.736616:0:4385:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091b4f000/0x40a459093b06afbd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21b30 expref: 26 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129576.736625:0:4385:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091b4f000, rc 0) 00000100:00100000:3.0:1746129576.736722:0:11014:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f449880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11014:1830948737579008:192.168.202.4@tcp:105: 00010000:00010000:3.0:1746129576.736744:0:11014:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a6cae600/0x40a459093b06af70 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129576.736754:0:11014:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a6cae600/0x40a459093b06af70 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129576.736799:0:11014:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:068dab75-d300-4ead-a742-d14572ad1e50+5:1963:x1830948734296192:12345-192.168.202.4@tcp:1:mirror_io.0 Request processed in 77769us (77812us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129576.736805:0:11014:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16567 00000100:00100000:3.0:1746129576.736890:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129576.736901:0:11014:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734300288 00000100:00100000:3.0:1746129576.736904:0:11014:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734300288 00000100:00100000:2.0:1746129576.736941:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f449f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+26:1963:x1830948734300416:12345-192.168.202.4@tcp:101:cat.0 Request processed in 412us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129576.736947:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16576 00000100:00100000:2.0:1746129576.736958:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16577 00000100:00100000:2.0:1746129576.736963:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+14:1963:x1830948734300288:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129576.736970:0:4385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129576.736979:0:4385:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091b4fc00/0x40a459093b06afc4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21b29 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746129576.736993:0:4385:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3ec:0x0] initial LVB size: 1048576, mtime: 0x6813d2a9, atime: 0x6813d2a3, ctime: 0x6813d2a9, blocks: 0x819 00010000:00010000:2.0:1746129576.737002:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129576.737004:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129576.737008:0:4385:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091b4fc00/0x40a459093b06afc4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21b29 expref: 15 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129576.737017:0:4385:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091b4fc00/0x40a459093b06afc4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21b29 expref: 15 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129576.737024:0:4385:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091b4fc00, rc 0) 00010000:00010000:0.0:1746129576.737144:0:15096:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012c22d400/0x40a459093b06af38 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21ae3 expref: 25 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129576.737159:0:15096:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c22d400/0x40a459093b06af38 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21ae3 expref: 25 pid: 16908 timeout: 932 lvb_type: 0 00000100:00100000:0.0:1746129576.737170:0:15096:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094065f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15096:1830948737579136:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129576.737278:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+15:1963:x1830948734300288:12345-192.168.202.4@tcp:101:cat.0 Request processed in 315us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129576.737286:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16577 00000100:00100000:2.0:1746129576.737577:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129576.737919:0:15096:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009cdf33c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746129576.737979:0:31518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734300672 00000100:00100000:1.0:1746129576.737983:0:31518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734300672 00002000:00100000:1.0:1746129576.738012:0:31518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->4194303) req@ffff88008f449880 x1830948734300672/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:317/0 lens 488/0 e 0 to 0 dl 1746129587 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129576.738026:0:31518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f449880 with x1830948734300672 ext(3145728->4194303) 00002000:00010000:1.0:1746129576.738030:0:31518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f449880 00000100:00100000:1.0:1746129576.738044:0:31518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7994 00000100:00100000:1.0:1746129576.738048:0:31518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f449880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ada2ffba-8920-4ecb-8068-68caa9806978+20:1960:x1830948734300672:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129576.739541:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129576.739927:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129576.739946:0:8416:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734301440 00000100:00100000:0.0:1746129576.739953:0:8416:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734301440 00002000:00100000:0.0:1746129576.739984:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3ef:0x0] (5144576->5148671) req@ffff880094064380 x1830948734301440/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:317/0 lens 488/0 e 0 to 0 dl 1746129587 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129576.739992:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094064380 with x1830948734301440 ext(5144576->5148671) 00002000:00010000:0.0:1746129576.739997:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094064380 00000100:00100000:0.0:1746129576.740012:0:8416:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7995 00000100:00100000:0.0:1746129576.740018:0:8416:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094064380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+15:1963:x1830948734301440:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129576.740153:0:8416:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094064380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+15:1963:x1830948734301440:12345-192.168.202.4@tcp:3:cat.0 Request processed in 133us (226us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746129576.740159:0:8416:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7995 00002000:00100000:0.0:1746129576.740164:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3ef:0x0] (5144576->5148671) req@ffff880094064380 x1830948734301440/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:317/0 lens 488/4536 e 0 to 0 dl 1746129587 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129576.740171:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094064380 with x1830948734301440 ext(5144576->5148671) 00002000:00010000:0.0:1746129576.740174:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094064380 00000100:00100000:3.0:1746129576.740282:0:16908:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734301184 00000100:00100000:3.0:1746129576.740286:0:16908:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734301184 00000100:00100000:0.0:1746129576.740312:0:15096:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094065f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15096:1830948737579136:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129576.740332:0:16908:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11310 00010000:00010000:0.0:1746129576.740334:0:15096:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880094c09a00/0x40a459093b06afb6 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 15096 initiator: MDT0 00000100:00100000:3.0:1746129576.740337:0:16908:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094064000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:068dab75-d300-4ead-a742-d14572ad1e50+26:32492:x1830948734301184:12345-192.168.202.4@tcp:36:mirror_io.0 00010000:00010000:3.0:1746129576.740376:0:16908:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129576.740400:0:16908:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fbb6a00/0x40a459093b06af46 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21aea expref: 26 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129576.740412:0:16908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:3.0:1746129576.740417:0:16908:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880094c09a00/0x40a459093b06afb6 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 15096 initiator: MDT0 00010000:00010000:3.0:1746129576.740426:0:16908:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880094c09a00/0x40a459093b06afb6 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 15096 initiator: MDT0 00010000:00010000:3.0:1746129576.740431:0:16908:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129576.740462:0:16908:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094064000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:068dab75-d300-4ead-a742-d14572ad1e50+25:32492:x1830948734301184:12345-192.168.202.4@tcp:36:mirror_io.0 Request processed in 125us (928us total) trans 0 rc -16/-16 00000100:00100000:3.0:1746129576.740471:0:16908:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11310 00000100:00100000:2.0:1746129576.742255:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129576.742501:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734301568 00000100:00100000:1.0:1746129576.742508:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734301568 00010000:00010000:1.0:1746129576.742538:0:9823:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c22d400/0x40a459093b06af38 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21ae3 expref: 25 pid: 16908 timeout: 932 lvb_type: 0 00000100:00100000:1.0:1746129576.742581:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8543 00000100:00100000:1.0:1746129576.742587:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f44b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:068dab75-d300-4ead-a742-d14572ad1e50+25:1963:x1830948734301568:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129576.742600:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129576.742605:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012c22d400/0x40a459093b06af38 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21ae3 expref: 25 pid: 16908 timeout: 932 lvb_type: 0 00010000:00010000:1.0:1746129576.742620:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012c22d400/0x40a459093b06af38 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21ae3 expref: 25 pid: 16908 timeout: 932 lvb_type: 0 00010000:00010000:1.0:1746129576.742638:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c22d400/0x40a459093b06af38 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21ae3 expref: 25 pid: 16908 timeout: 932 lvb_type: 0 00010000:00010000:1.0:1746129576.742650:0:9823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:1.0:1746129576.742654:0:9823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880094c09a00/0x40a459093b06afb6 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 15096 initiator: MDT0 00010000:00010000:1.0:1746129576.742662:0:9823:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094c09a00/0x40a459093b06afb6 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 15096 initiator: MDT0 00010000:00010000:1.0:1746129576.742669:0:9823:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094c09a00/0x40a459093b06afb6 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 15096 initiator: MDT0 00010000:00010000:1.0:1746129576.742688:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129576.744142:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f44b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:068dab75-d300-4ead-a742-d14572ad1e50+24:1963:x1830948734301568:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 1545us (1886us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129576.744153:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8543 00010000:00010000:2.0:1746129576.744244:0:15096:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880094c09a00/0x40a459093b06afb6 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129576.744253:0:15096:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094c09a00/0x40a459093b06afb6 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15096 initiator: MDT0 00000004:00200000:2.0:1746129576.744284:0:15096:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:2.0:1746129576.744461:0:15096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c47d200/0x40a459093b06afaf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21b37 expref: 33 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129576.744482:0:15096:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094c09a00/0x40a459093b06afb6 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21b37 expref: 32 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129576.744489:0:15096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:2.0:1746129576.744492:0:15096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746129576.744495:0:15096:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094c09a00, rc 0) 00000100:00100000:2.0:1746129576.744535:0:15096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094065180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+32:32496:x1830948734300928:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 8319us (8422us total) trans 8589945424 rc 0/0 00000100:00100000:2.0:1746129576.744541:0:15096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11309 00000100:00100000:0.0:1746129576.745898:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129576.745980:0:20861:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734301824 00000100:00100000:3.0:1746129576.745989:0:20861:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734301824 00000100:00100000:3.0:1746129576.746024:0:20861:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4816 00000100:00100000:3.0:1746129576.746029:0:20861:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094065f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:068dab75-d300-4ead-a742-d14572ad1e50+24:32492:x1830948734301824:12345-192.168.202.4@tcp:35:mirror_io.0 00000100:00100000:3.0:1746129576.746196:0:20861:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094065f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:068dab75-d300-4ead-a742-d14572ad1e50+25:32492:x1830948734301824:12345-192.168.202.4@tcp:35:mirror_io.0 Request processed in 165us (302us total) trans 8589945425 rc 0/0 00000100:00100000:3.0:1746129576.746202:0:20861:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4816 00000100:00100000:0.0:1746129576.752346:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129576.752378:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734302080 00000100:00100000:0.0:1746129576.752387:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734302080 00000100:00100000:0.0:1746129576.752447:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4817 00000100:00100000:0.0:1746129576.752455:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094064700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:068dab75-d300-4ead-a742-d14572ad1e50+25:32492:x1830948734302080:12345-192.168.202.4@tcp:35:mirror_io.0 00000100:00100000:0.0:1746129576.752671:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094064700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:068dab75-d300-4ead-a742-d14572ad1e50+26:32492:x1830948734302080:12345-192.168.202.4@tcp:35:mirror_io.0 Request processed in 216us (336us total) trans 8589945426 rc 0/0 00000100:00100000:0.0:1746129576.752678:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4817 00000100:00100000:1.0:1746129576.753207:0:31518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f449880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ada2ffba-8920-4ecb-8068-68caa9806978+20:1960:x1830948734300672:12345-192.168.202.4@tcp:3:cat.0 Request processed in 15156us (15628us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129576.753215:0:31518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7994 00002000:00100000:1.0:1746129576.753225:0:31518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->4194303) req@ffff88008f449880 x1830948734300672/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:317/0 lens 488/440 e 0 to 0 dl 1746129587 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129576.753233:0:31518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f449880 with x1830948734300672 ext(3145728->4194303) 00002000:00010000:1.0:1746129576.753238:0:31518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f449880 00000100:00100000:0.0:1746129576.757273:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129576.757368:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734302208 00000100:00100000:1.0:1746129576.757377:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734302208 00000100:00100000:1.0:1746129576.757424:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16578 00000100:00100000:1.0:1746129576.757432:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094066680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ada2ffba-8920-4ecb-8068-68caa9806978+27:32491:x1830948734302208:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129576.757452:0:7148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129576.757470:0:7148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009be04a00/0x40a459093b06afd2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21b3e expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129576.757498:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129576.757499:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129576.757507:0:7148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009be04a00/0x40a459093b06afd2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21b3e expref: 28 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129576.757526:0:7148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009be04a00/0x40a459093b06afd2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21b3e expref: 28 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129576.757536:0:7148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009be04a00, rc 0) 00000100:00100000:1.0:1746129576.757666:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094066680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ada2ffba-8920-4ecb-8068-68caa9806978+28:32491:x1830948734302208:12345-192.168.202.4@tcp:101:cat.0 Request processed in 234us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129576.757672:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16578 00000100:00100000:0.0:1746129576.768195:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129576.768327:0:31518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734302464 00000100:00100000:1.0:1746129576.768337:0:31518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734302464 00002000:00100000:1.0:1746129576.768387:0:31518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3f5:0x0] (3145728->4194303) req@ffff8800a07af480 x1830948734302464/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:317/0 lens 488/0 e 0 to 0 dl 1746129587 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129576.768397:0:31518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a07af480 with x1830948734302464 ext(3145728->4194303) 00002000:00010000:1.0:1746129576.768403:0:31518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a07af480 00000100:00100000:1.0:1746129576.768653:0:31518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7996 00000100:00100000:1.0:1746129576.768662:0:31518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a07af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ada2ffba-8920-4ecb-8068-68caa9806978+28:1960:x1830948734302464:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129576.785627:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129576.786104:0:15096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734302720 00000100:00100000:3.0:1746129576.786113:0:15096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734302720 00000100:00100000:3.0:1746129576.786156:0:15096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11311 00000100:00100000:3.0:1746129576.786163:0:15096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009507ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ada2ffba-8920-4ecb-8068-68caa9806978+318:32500:x1830948734302720:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:3.0:1746129576.786185:0:15096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129576.786205:0:15096:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cfd7000/0x40a459093b06afd9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21b45 expref: -99 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129576.786647:0:15096:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880094bb3400/0x40a459093b06afe0 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 15096 initiator: MDT0 00010000:00010000:3.0:1746129576.786664:0:15096:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094bb3400/0x40a459093b06afe0 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 15096 initiator: MDT0 00010000:00010000:3.0:1746129576.786676:0:15096:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094bb3400/0x40a459093b06afe0 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 15096 initiator: MDT0 00000004:00200000:3.0:1746129576.786725:0:15096:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:3.0:1746129576.786953:0:15096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cfd7000/0x40a459093b06afd9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21b45 expref: 321 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129576.786974:0:15096:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094bb3400/0x40a459093b06afe0 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21b45 expref: 320 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129576.786982:0:15096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:3.0:1746129576.786984:0:15096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746129576.786988:0:15096:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094bb3400, rc 0) 00000100:00100000:3.0:1746129576.787622:0:15096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009507ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ada2ffba-8920-4ecb-8068-68caa9806978+320:32500:x1830948734302720:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 1454us (2001us total) trans 8589945427 rc 0/0 00000100:00100000:3.0:1746129576.787630:0:15096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11311 00000100:00100000:1.0:1746129576.790304:0:31518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a07af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ada2ffba-8920-4ecb-8068-68caa9806978+28:1960:x1830948734302464:12345-192.168.202.4@tcp:3:cat.0 Request processed in 21617us (22094us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129576.790319:0:31518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7996 00002000:00100000:1.0:1746129576.790336:0:31518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3f5:0x0] (3145728->4194303) req@ffff8800a07af480 x1830948734302464/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:317/0 lens 488/440 e 0 to 0 dl 1746129587 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129576.790346:0:31518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a07af480 with x1830948734302464 ext(3145728->4194303) 00002000:00010000:1.0:1746129576.790353:0:31518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a07af480 00000100:00100000:0.0:1746129576.796970:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129576.797016:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129576.797049:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129576.797088:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129576.797137:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734302848 00000100:00100000:0.0:1746129576.797145:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734302848 00000100:00100000:0.0:1746129576.797185:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734303104 00000100:00100000:0.0:1746129576.797187:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734303104 00000100:00100000:0.0:1746129576.797197:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734302976 00000100:00100000:0.0:1746129576.797199:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734302976 00000100:00100000:0.0:1746129576.797206:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734303232 00000100:00100000:0.0:1746129576.797208:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734303232 00000100:00100000:0.0:1746129576.797221:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16579 00000100:00100000:0.0:1746129576.797228:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009507e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ada2ffba-8920-4ecb-8068-68caa9806978+21:1960:x1830948734302848:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129576.797247:0:4385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129576.797280:0:4385:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b1b23000/0x40a459093b06afee lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21b4c expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129576.797331:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129576.797334:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129576.797342:0:4385:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b1b23000/0x40a459093b06afee lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21b4c expref: 22 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129576.797358:0:4385:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b1b23000/0x40a459093b06afee lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21b4c expref: 22 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129576.797369:0:4385:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b1b23000, rc 0) 00000100:00100000:0.0:1746129576.797414:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009507e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ada2ffba-8920-4ecb-8068-68caa9806978+22:1960:x1830948734302848:12345-192.168.202.4@tcp:101:cat.0 Request processed in 188us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129576.797420:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16579 00000100:00100000:0.0:1746129576.797438:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16580 00000100:00100000:0.0:1746129576.797444:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009507f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ada2ffba-8920-4ecb-8068-68caa9806978+29:1960:x1830948734303104:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129576.797450:0:4385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129576.797461:0:4385:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095129400/0x40a459093b06aff5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21b5a expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129576.797471:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129576.797472:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129576.797476:0:4385:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095129400/0x40a459093b06aff5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21b5a expref: 30 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129576.797485:0:4385:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095129400/0x40a459093b06aff5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21b5a expref: 30 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129576.797491:0:4385:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095129400, rc 0) 00000100:00100000:0.0:1746129576.797510:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009507f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ada2ffba-8920-4ecb-8068-68caa9806978+30:1960:x1830948734303104:12345-192.168.202.4@tcp:101:cat.0 Request processed in 67us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129576.797515:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16580 00000100:00100000:0.0:1746129576.797523:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16581 00000100:00100000:0.0:1746129576.797527:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baeed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ada2ffba-8920-4ecb-8068-68caa9806978+29:1960:x1830948734302976:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129576.797532:0:4385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129576.797538:0:4385:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095128400/0x40a459093b06affc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21b53 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129576.797547:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129576.797548:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129576.797551:0:4385:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095128400/0x40a459093b06affc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21b53 expref: 30 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129576.797564:0:4385:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095128400/0x40a459093b06affc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21b53 expref: 30 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129576.797570:0:4385:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095128400, rc 0) 00000100:00100000:0.0:1746129576.797582:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baeed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ada2ffba-8920-4ecb-8068-68caa9806978+30:1960:x1830948734302976:12345-192.168.202.4@tcp:101:cat.0 Request processed in 54us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129576.797586:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16581 00000100:00100000:0.0:1746129576.797594:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16582 00000100:00100000:0.0:1746129576.797598:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ada2ffba-8920-4ecb-8068-68caa9806978+21:1960:x1830948734303232:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129576.797602:0:4385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129576.797609:0:4385:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095129800/0x40a459093b06b003 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21b61 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129576.797618:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129576.797620:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129576.797623:0:4385:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095129800/0x40a459093b06b003 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21b61 expref: 22 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129576.797631:0:4385:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095129800/0x40a459093b06b003 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21b61 expref: 22 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129576.797637:0:4385:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095129800, rc 0) 00000100:00100000:0.0:1746129576.797648:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ada2ffba-8920-4ecb-8068-68caa9806978+22:1960:x1830948734303232:12345-192.168.202.4@tcp:101:cat.0 Request processed in 50us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129576.797652:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16582 00000100:00100000:0.0:1746129576.819357:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129576.819467:0:31518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734303488 00000100:00100000:1.0:1746129576.819476:0:31518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734303488 00002000:00100000:1.0:1746129576.819528:0:31518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3ef:0x0] (4194304->5148671) req@ffff88012baedf80 x1830948734303488/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:317/0 lens 488/0 e 0 to 0 dl 1746129587 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129576.819539:0:31518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012baedf80 with x1830948734303488 ext(4194304->5148671) 00002000:00010000:1.0:1746129576.819544:0:31518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012baedf80 00000100:00100000:1.0:1746129576.819582:0:31518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7997 00000100:00100000:1.0:1746129576.819592:0:31518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ada2ffba-8920-4ecb-8068-68caa9806978+22:1961:x1830948734303488:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:1.0:1746129576.836219:0:31518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ada2ffba-8920-4ecb-8068-68caa9806978+22:1961:x1830948734303488:12345-192.168.202.4@tcp:3:cat.0 Request processed in 16616us (16860us total) trans 0 rc 954368/954368 00000100:00100000:1.0:1746129576.836232:0:31518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7997 00002000:00100000:1.0:1746129576.836250:0:31518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3ef:0x0] (4194304->5148671) req@ffff88012baedf80 x1830948734303488/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:317/0 lens 488/440 e 0 to 0 dl 1746129587 ref 1 fl Complete:/200/0 rc 954368/954368 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129576.836270:0:31518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012baedf80 with x1830948734303488 ext(4194304->5148671) 00002000:00010000:1.0:1746129576.836276:0:31518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012baedf80 00000100:00100000:0.0:1746129576.838801:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129576.838901:0:22480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734303616 00000100:00100000:2.0:1746129576.838910:0:22480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734303616 00000100:00100000:2.0:1746129576.838976:0:22480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16583 00000100:00100000:2.0:1746129576.838985:0:22480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+26:32496:x1830948734303616:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:2.0:1746129576.839004:0:22480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129576.839023:0:22480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091b4f400/0x40a459093b06b00a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21b68 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129576.839055:0:22480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091b4f000/0x40a459093b06afbd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21b30 expref: 27 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129576.839064:0:22480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009be04a00/0x40a459093b06afd2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21b3e expref: 29 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129576.839070:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129576.839072:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129576.839076:0:22480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091b4f400/0x40a459093b06b00a lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [2699264->3145727] (req 2699264->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21b68 expref: 27 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129576.839107:0:22480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009be04a00/0x40a459093b06afd2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21b3e expref: 29 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129576.839120:0:22480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009be04a00/0x40a459093b06afd2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21b3e expref: 29 pid: 7148 timeout: 932 lvb_type: 0 00000100:00100000:2.0:1746129576.839132:0:22480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f44b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22480:1830948737579264:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129576.839234:0:22480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091b4f000/0x40a459093b06afbd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21b30 expref: 27 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129576.839242:0:22480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091b4f000/0x40a459093b06afbd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21b30 expref: 27 pid: 4385 timeout: 932 lvb_type: 1 00000100:00100000:2.0:1746129576.839251:0:22480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f448700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22480:1830948737579392:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129576.839342:0:22480:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132f36d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746129576.841035:0:22480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f44b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22480:1830948737579264:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129576.841044:0:22480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f448700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22480:1830948737579392:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129576.841075:0:22480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091b4f400/0x40a459093b06b00a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [2699264->3145727] (req 2699264->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21b68 expref: 27 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129576.841089:0:22480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091b4f400, rc 0) 00000100:00100000:2.0:1746129576.842595:0:22480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+27:32496:x1830948734303616:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 3600us (3793us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129576.842606:0:22480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16583 00000100:00100000:0.0:1746129576.846938:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129576.847017:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129576.847146:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734303744 00000100:00100000:1.0:1746129576.847157:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734303744 00010000:00010000:1.0:1746129576.847206:0:9823:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091b4f000/0x40a459093b06afbd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21b30 expref: 27 pid: 4385 timeout: 932 lvb_type: 1 00000100:00100000:1.0:1746129576.847237:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734303872 00000100:00100000:1.0:1746129576.847241:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734303872 00010000:00010000:1.0:1746129576.847255:0:9823:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009be04a00/0x40a459093b06afd2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21b3e expref: 30 pid: 7148 timeout: 932 lvb_type: 0 00000100:00100000:1.0:1746129576.847290:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8544 00000100:00100000:1.0:1746129576.847334:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959d4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+27:1962:x1830948734303744:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129576.847352:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129576.847382:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091b4f000/0x40a459093b06afbd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21b30 expref: 27 pid: 4385 timeout: 932 lvb_type: 1 00010000:00010000:1.0:1746129576.847394:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091b4f000/0x40a459093b06afbd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21b30 expref: 27 pid: 4385 timeout: 932 lvb_type: 1 00010000:00010000:1.0:1746129576.847421:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091b4f000/0x40a459093b06afbd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21b30 expref: 27 pid: 4385 timeout: 932 lvb_type: 1 00010000:00010000:1.0:1746129576.847448:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129576.847504:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959d4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+26:1962:x1830948734303744:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 173us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129576.847511:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8544 00000100:00100000:1.0:1746129576.847533:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8545 00000100:00100000:1.0:1746129576.847539:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ada2ffba-8920-4ecb-8068-68caa9806978+30:1962:x1830948734303872:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129576.847548:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129576.847558:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009be04a00/0x40a459093b06afd2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21b3e expref: 30 pid: 7148 timeout: 932 lvb_type: 0 00010000:00010000:1.0:1746129576.847569:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009be04a00/0x40a459093b06afd2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21b3e expref: 30 pid: 7148 timeout: 932 lvb_type: 0 00010000:00010000:1.0:1746129576.847582:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009be04a00/0x40a459093b06afd2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21b3e expref: 30 pid: 7148 timeout: 932 lvb_type: 0 00010000:00010000:1.0:1746129576.847597:0:9823:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129576.847599:0:9823:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129576.847608:0:9823:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091b4f400/0x40a459093b06b00a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2699264->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21b68 expref: 25 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129576.847616:0:9823:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091b4f400/0x40a459093b06b00a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2699264->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21b68 expref: 25 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129576.847654:0:9823:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091b4f400/0x40a459093b06b00a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2699264->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21b68 expref: 25 pid: 22480 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129576.847668:0:9823:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cda4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9823:1830948737579520:192.168.202.4@tcp:105: 00000100:00100000:1.0:1746129576.849189:0:9823:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0ac3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746129576.850133:0:9823:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cda4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9823:1830948737579520:192.168.202.4@tcp:105: 00010000:00010000:1.0:1746129576.850156:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129576.850205:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ada2ffba-8920-4ecb-8068-68caa9806978+29:1962:x1830948734303872:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 2662us (3186us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129576.850215:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8545 00000100:00100000:3.0:1746129576.863784:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129576.865039:0:31518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734304128 00000100:00100000:1.0:1746129576.865054:0:31518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734304128 00002000:00100000:1.0:1746129576.865115:0:31518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3f5:0x0] (2699264->2703359) req@ffff880091b07480 x1830948734304128/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:317/0 lens 488/0 e 0 to 0 dl 1746129587 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129576.865126:0:31518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091b07480 with x1830948734304128 ext(2699264->2703359) 00002000:00010000:1.0:1746129576.865133:0:31518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091b07480 00000100:00100000:2.0:1746129576.866984:0:21725:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7998 00000100:00100000:2.0:1746129576.867002:0:21725:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+26:1962:x1830948734304128:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:2.0:1746129576.867338:0:21725:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+26:1962:x1830948734304128:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 340us (3565us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129576.867346:0:21725:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7998 00002000:00100000:2.0:1746129576.867356:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f5:0x0] (2699264->2703359) req@ffff880091b07480 x1830948734304128/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:317/0 lens 488/4536 e 0 to 0 dl 1746129587 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129576.867365:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091b07480 with x1830948734304128 ext(2699264->2703359) 00002000:00010000:2.0:1746129576.867370:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091b07480 00000100:00100000:0.0:1746129576.878636:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129576.880069:0:22480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734304256 00000100:00100000:2.0:1746129576.880082:0:22480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734304256 00000100:00100000:3.0:1746129576.880785:0:22480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16584 00000100:00100000:3.0:1746129576.880797:0:22480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+15:32496:x1830948734304256:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:3.0:1746129576.880821:0:22480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129576.880842:0:22480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cfd7000/0x40a459093b06b011 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21b6f expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129576.880879:0:22480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c47d000/0x40a459093b06afa1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5144576->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21b1b expref: 16 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129576.880889:0:22480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009be04800/0x40a459093b06afa8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21b22 expref: 21 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129576.880896:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129576.880898:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129576.880901:0:22480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cfd7000/0x40a459093b06b011 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [3145728->3411967] (req 3145728->3411967) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21b6f expref: 16 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129576.880942:0:22480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009be04800/0x40a459093b06afa8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21b22 expref: 21 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129576.880956:0:22480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009be04800/0x40a459093b06afa8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21b22 expref: 21 pid: 7148 timeout: 932 lvb_type: 0 00000100:00100000:3.0:1746129576.880970:0:22480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091b06a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22480:1830948737579648:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129576.881119:0:22480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c47d000/0x40a459093b06afa1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5144576->5242879) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21b1b expref: 16 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129576.881129:0:22480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c47d000/0x40a459093b06afa1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5144576->5242879) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21b1b expref: 16 pid: 22480 timeout: 932 lvb_type: 0 00000100:00100000:3.0:1746129576.881138:0:22480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091b06d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22480:1830948737579776:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129576.881167:0:22480:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa381300 going to sleep for 11 seconds 00000100:00100000:3.0:1746129576.883166:0:22480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091b06a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22480:1830948737579648:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129576.883176:0:22480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091b06d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22480:1830948737579776:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129576.883207:0:22480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009cfd7000/0x40a459093b06b011 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [3145728->3411967] (req 3145728->3411967) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21b6f expref: 16 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129576.883220:0:22480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cfd7000, rc 0) 00000100:00100000:3.0:1746129576.883685:0:22480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+16:32496:x1830948734304256:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 2889us (5061us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129576.883696:0:22480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16584 00000100:00100000:0.0:1746129576.885768:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129576.885850:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129576.887095:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734304384 00000100:00100000:1.0:1746129576.887110:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734304384 00010000:00010000:1.0:1746129576.887158:0:9823:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c47d000/0x40a459093b06afa1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5144576->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21b1b expref: 16 pid: 22480 timeout: 932 lvb_type: 0 00000100:00100000:1.0:1746129576.887218:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734304512 00000100:00100000:1.0:1746129576.887223:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734304512 00010000:00010000:1.0:1746129576.887240:0:9823:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009be04800/0x40a459093b06afa8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21b22 expref: 22 pid: 7148 timeout: 932 lvb_type: 0 00000100:00100000:1.0:1746129576.887275:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8546 00000100:00100000:1.0:1746129576.887285:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+16:1960:x1830948734304384:12345-192.168.202.4@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746129576.887442:0:7087:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8547 00000100:00100000:2.0:1746129576.887450:0:7087:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6027050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ada2ffba-8920-4ecb-8068-68caa9806978+22:1960:x1830948734304512:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129576.887463:0:7087:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129576.887488:0:7087:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009be04800/0x40a459093b06afa8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21b22 expref: 22 pid: 7148 timeout: 932 lvb_type: 0 00010000:00010000:2.0:1746129576.887498:0:7087:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009be04800/0x40a459093b06afa8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21b22 expref: 22 pid: 7148 timeout: 932 lvb_type: 0 00010000:00010000:2.0:1746129576.887519:0:7087:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009be04800/0x40a459093b06afa8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21b22 expref: 22 pid: 7148 timeout: 932 lvb_type: 0 00010000:00010000:2.0:1746129576.887553:0:7087:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746129576.887554:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129576.887562:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c47d000/0x40a459093b06afa1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5144576->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21b1b expref: 16 pid: 22480 timeout: 932 lvb_type: 0 00010000:00010000:1.0:1746129576.887571:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c47d000/0x40a459093b06afa1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5144576->5242879) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21b1b expref: 16 pid: 22480 timeout: 932 lvb_type: 0 00010000:00010000:1.0:1746129576.887581:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c47d000/0x40a459093b06afa1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5144576->5242879) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21b1b expref: 16 pid: 22480 timeout: 932 lvb_type: 0 00010000:00010000:1.0:1746129576.887595:0:9823:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129576.887597:0:9823:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746129576.887603:0:7087:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6027050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ada2ffba-8920-4ecb-8068-68caa9806978+21:1960:x1830948734304512:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 156us (1756us total) trans 0 rc 0/0 00010000:00010000:1.0:1746129576.887604:0:9823:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cfd7000/0x40a459093b06b011 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3411967) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21b6f expref: 15 pid: 22480 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129576.887609:0:7087:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8547 00010000:00010000:1.0:1746129576.887611:0:9823:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cfd7000/0x40a459093b06b011 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3411967) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21b6f expref: 15 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129576.887648:0:9823:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009cfd7000/0x40a459093b06b011 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3411967) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21b6f expref: 15 pid: 22480 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129576.887660:0:9823:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cda4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9823:1830948737579904:192.168.202.4@tcp:105: 00000100:00100000:1.0:1746129576.887717:0:9823:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0ac3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746129576.889673:0:9823:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cda4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9823:1830948737579904:192.168.202.4@tcp:105: 00010000:00010000:1.0:1746129576.889697:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129576.890464:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+15:1960:x1830948734304384:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 3176us (4703us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129576.890476:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8546 00000100:00100000:0.0:1746129576.892796:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129576.892862:0:31518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734304768 00000100:00100000:2.0:1746129576.892871:0:31518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734304768 00002000:00100000:2.0:1746129576.892923:0:31518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3ef:0x0] (3407872->3411967) req@ffff8800959d4700 x1830948734304768/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:317/0 lens 488/0 e 0 to 0 dl 1746129587 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129576.892933:0:31518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800959d4700 with x1830948734304768 ext(3407872->3411967) 00002000:00010000:2.0:1746129576.892938:0:31518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800959d4700 00000100:00100000:2.0:1746129576.892970:0:31518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7999 00000100:00100000:2.0:1746129576.892977:0:31518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+15:1961:x1830948734304768:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:2.0:1746129576.893157:0:31518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+15:1961:x1830948734304768:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 180us (372us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129576.893163:0:31518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7999 00002000:00100000:2.0:1746129576.893168:0:31518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3ef:0x0] (3407872->3411967) req@ffff8800959d4700 x1830948734304768/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:317/0 lens 488/4536 e 0 to 0 dl 1746129587 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129576.893182:0:31518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800959d4700 with x1830948734304768 ext(3407872->3411967) 00002000:00010000:2.0:1746129576.893188:0:31518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800959d4700 00000100:00100000:0.0:1746129576.938811:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129576.938912:0:22480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734304896 00000100:00100000:3.0:1746129576.938922:0:22480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734304896 00000100:00100000:3.0:1746129576.938970:0:22480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16585 00000100:00100000:3.0:1746129576.938977:0:22480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ada2ffba-8920-4ecb-8068-68caa9806978+21:32500:x1830948734304896:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:3.0:1746129576.938997:0:22480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129576.939013:0:22480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012eac3a00/0x40a459093b06b018 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21b76 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129576.939045:0:22480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cfd7000/0x40a459093b06b011 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3411967) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21b6f expref: 14 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129576.939051:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129576.939054:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129576.939057:0:22480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012eac3a00/0x40a459093b06b018 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [3497984->4194303] (req 3497984->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21b76 expref: 22 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129576.939088:0:22480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009cfd7000/0x40a459093b06b011 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3411967) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21b6f expref: 14 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129576.939100:0:22480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009cfd7000/0x40a459093b06b011 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3411967) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21b6f expref: 14 pid: 22480 timeout: 932 lvb_type: 0 00000100:00100000:3.0:1746129576.939112:0:22480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091b06d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22480:1830948737580032:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129576.939215:0:22480:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa381300 going to sleep for 11 seconds 00000100:00100000:3.0:1746129576.941192:0:22480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091b06d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22480:1830948737580032:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129576.941222:0:22480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012eac3a00/0x40a459093b06b018 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [3497984->4194303] (req 3497984->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21b76 expref: 22 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129576.941235:0:22480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012eac3a00, rc 0) 00000100:00100000:3.0:1746129576.941283:0:22480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ada2ffba-8920-4ecb-8068-68caa9806978+22:32500:x1830948734304896:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 2305us (2480us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129576.941312:0:22480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16585 00000100:00100000:0.0:1746129576.941712:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129576.941895:0:31518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734305024 00000100:00100000:2.0:1746129576.941901:0:31518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734305024 00002000:00100000:2.0:1746129576.941941:0:31518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->3411967) req@ffff8800959d5500 x1830948734305024/t0(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:317/0 lens 488/0 e 0 to 0 dl 1746129587 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129576.941949:0:31518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800959d5500 with x1830948734305024 ext(3145728->3411967) 00010000:00010000:2.0:1746129576.941956:0:31518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009cfd7000/0x40a459093b06b011 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3411967) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21b6f expref: 15 pid: 22480 timeout: 932 lvb_type: 0 00010000:00010000:2.0:1746129576.941967:0:31518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009cfd7000/0x40a459093b06b011 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3411967) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21b6f expref: 15 pid: 22480 timeout: 932 lvb_type: 0 00002000:00010000:2.0:1746129576.941974:0:31518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800959d5500 00000100:00100000:2.0:1746129576.941989:0:31518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2480 00000100:00100000:2.0:1746129576.941995:0:31518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+15:1962:x1830948734305024:12345-192.168.202.4@tcp:4:multiop.0 00000100:00100000:2.0:1746129576.947633:0:31518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+17:1962:x1830948734305024:12345-192.168.202.4@tcp:4:multiop.0 Request processed in 5624us (5908us total) trans 21474841405 rc 0/0 00000100:00100000:2.0:1746129576.947647:0:31518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2480 00002000:00100000:2.0:1746129576.947659:0:31518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->3411967) req@ffff8800959d5500 x1830948734305024/t21474841405(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:317/0 lens 488/448 e 0 to 0 dl 1746129587 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129576.947668:0:31518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800959d5500 with x1830948734305024 ext(3145728->3411967) 00010000:00010000:2.0:1746129576.947679:0:31518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009cfd7000/0x40a459093b06b011 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3411967) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21b6f expref: 17 pid: 22480 timeout: 932 lvb_type: 0 00010000:00010000:2.0:1746129576.947695:0:31518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009cfd7000/0x40a459093b06b011 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3411967) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21b6f expref: 17 pid: 22480 timeout: 932 lvb_type: 0 00002000:00010000:2.0:1746129576.947702:0:31518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800959d5500 00000100:00100000:0.0:1746129576.950469:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129576.955479:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734305152 00000100:00100000:1.0:1746129576.955494:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734305152 00010000:00010000:1.0:1746129576.955543:0:9823:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009cfd7000/0x40a459093b06b011 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3411967) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21b6f expref: 17 pid: 22480 timeout: 932 lvb_type: 0 00000100:00100000:1.0:1746129576.955600:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8548 00000100:00100000:1.0:1746129576.955608:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959d4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+17:1961:x1830948734305152:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129576.955623:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129576.955649:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009cfd7000/0x40a459093b06b011 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3411967) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21b6f expref: 17 pid: 22480 timeout: 932 lvb_type: 0 00010000:00010000:1.0:1746129576.955661:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009cfd7000/0x40a459093b06b011 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3411967) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21b6f expref: 17 pid: 22480 timeout: 932 lvb_type: 0 00010000:00010000:1.0:1746129576.955691:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cfd7000/0x40a459093b06b011 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3411967) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21b6f expref: 17 pid: 22480 timeout: 932 lvb_type: 0 00010000:00010000:1.0:1746129576.955714:0:9823:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129576.955716:0:9823:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129576.955723:0:9823:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012eac3a00/0x40a459093b06b018 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3497984->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21b76 expref: 21 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129576.955731:0:9823:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012eac3a00/0x40a459093b06b018 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3497984->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21b76 expref: 21 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129576.955768:0:9823:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012eac3a00/0x40a459093b06b018 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3497984->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21b76 expref: 21 pid: 22480 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129576.955779:0:9823:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cda4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9823:1830948737580160:192.168.202.4@tcp:105: 00000100:00100000:1.0:1746129576.955866:0:9823:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0ac540 going to sleep for 11 seconds 00000100:00100000:3.0:1746129576.958707:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129576.958915:0:31518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734305408 00000100:00100000:2.0:1746129576.958925:0:31518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734305408 00002000:00100000:2.0:1746129576.958974:0:31518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3ef:0x0] (3497984->3502079) req@ffff880091b06d80 x1830948734305408/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:317/0 lens 488/0 e 0 to 0 dl 1746129587 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129576.958984:0:31518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091b06d80 with x1830948734305408 ext(3497984->3502079) 00002000:00010000:2.0:1746129576.958990:0:31518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091b06d80 00000100:00100000:1.0:1746129576.959140:0:9823:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cda4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9823:1830948737580160:192.168.202.4@tcp:105: 00010000:00010000:1.0:1746129576.959160:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129576.959364:0:31518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8000 00000100:00100000:2.0:1746129576.959374:0:31518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ada2ffba-8920-4ecb-8068-68caa9806978+22:1962:x1830948734305408:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:1.0:1746129576.959624:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959d4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+16:1961:x1830948734305152:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 4016us (9165us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129576.959634:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8548 00000100:00100000:2.0:1746129576.961236:0:31518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ada2ffba-8920-4ecb-8068-68caa9806978+22:1962:x1830948734305408:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 1856us (2532us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129576.961246:0:31518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8000 00002000:00100000:2.0:1746129576.961257:0:31518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3ef:0x0] (3497984->3502079) req@ffff880091b06d80 x1830948734305408/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:317/0 lens 488/4536 e 0 to 0 dl 1746129587 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129576.961274:0:31518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091b06d80 with x1830948734305408 ext(3497984->3502079) 00002000:00010000:2.0:1746129576.961279:0:31518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091b06d80 00000100:00100000:0.0:1746129576.970164:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129576.970285:0:22480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734305536 00000100:00100000:3.0:1746129576.970327:0:22480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734305536 00000100:00100000:3.0:1746129576.970375:0:22480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16586 00000100:00100000:3.0:1746129576.970383:0:22480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ada2ffba-8920-4ecb-8068-68caa9806978+29:32500:x1830948734305536:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:3.0:1746129576.970403:0:22480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129576.970421:0:22480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012eac2400/0x40a459093b06b01f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21b7d expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129576.970452:0:22480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091b4f400/0x40a459093b06b00a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2699264->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21b68 expref: 25 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129576.970459:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129576.970461:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129576.970465:0:22480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012eac2400/0x40a459093b06b01f lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [3145728->3280895] (req 3145728->3280895) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21b7d expref: 30 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129576.970495:0:22480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091b4f400/0x40a459093b06b00a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2699264->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21b68 expref: 25 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129576.970513:0:22480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091b4f400/0x40a459093b06b00a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2699264->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21b68 expref: 25 pid: 22480 timeout: 932 lvb_type: 0 00000100:00100000:3.0:1746129576.970525:0:22480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091b06a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22480:1830948737580288:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129576.972214:0:22480:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa381300 going to sleep for 11 seconds 00000100:00100000:0.0:1746129576.972636:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129576.973066:0:22480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091b06a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22480:1830948737580288:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129576.973095:0:22480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012eac2400/0x40a459093b06b01f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [3145728->3280895] (req 3145728->3280895) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21b7d expref: 30 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129576.973111:0:22480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012eac2400, rc 0) 00000100:00100000:3.0:1746129576.973153:0:22480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ada2ffba-8920-4ecb-8068-68caa9806978+30:32500:x1830948734305536:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 2771us (3000us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129576.973161:0:22480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16586 00000100:00100000:2.0:1746129576.973237:0:31518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734305664 00000100:00100000:2.0:1746129576.973245:0:31518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734305664 00002000:00100000:2.0:1746129576.973315:0:31518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3f5:0x0] (2699264->3145727) req@ffff8800959d5c00 x1830948734305664/t0(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:317/0 lens 488/0 e 0 to 0 dl 1746129587 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129576.973330:0:31518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800959d5c00 with x1830948734305664 ext(2699264->3145727) 00010000:00010000:2.0:1746129576.973336:0:31518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091b4f400/0x40a459093b06b00a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2699264->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21b68 expref: 26 pid: 22480 timeout: 932 lvb_type: 0 00010000:00010000:2.0:1746129576.973348:0:31518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091b4f400/0x40a459093b06b00a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2699264->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21b68 expref: 26 pid: 22480 timeout: 932 lvb_type: 0 00002000:00010000:2.0:1746129576.973355:0:31518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800959d5c00 00000100:00100000:2.0:1746129576.973371:0:31518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2481 00000100:00100000:2.0:1746129576.973377:0:31518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+26:1962:x1830948734305664:12345-192.168.202.4@tcp:4:multiop.0 00000100:00100000:0.0:1746129576.974266:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129576.974327:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129576.974789:0:11014:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734305792 00000100:00100000:1.0:1746129576.974796:0:11014:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734305792 00000100:00100000:1.0:1746129576.974826:0:11014:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734305920 00000100:00100000:1.0:1746129576.974828:0:11014:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734305920 00000100:00100000:1.0:1746129576.974843:0:11014:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16587 00000100:00100000:1.0:1746129576.974851:0:11014:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800912adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+16:1962:x1830948734305792:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129576.974863:0:11014:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129576.974879:0:11014:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136b1c800/0x40a459093b06b026 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21b84 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129576.974925:0:11014:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cda4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11014:1830948737580416:192.168.202.4@tcp:106: 00000100:00100000:1.0:1746129576.974987:0:11014:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0ac540 going to sleep for 11 seconds 00000100:00100000:1.0:1746129576.975059:0:8410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16588 00000100:00100000:1.0:1746129576.975065:0:8410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800912ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+28:1962:x1830948734305920:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129576.975072:0:8410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129576.975082:0:8410:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009be05c00/0x40a459093b06b02d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21b8b expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129576.975107:0:8410:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cda5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8410:1830948737580544:192.168.202.4@tcp:106: 00000100:00100000:1.0:1746129576.975129:0:8410:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0ac240 going to sleep for 11 seconds 00000100:00100000:1.0:1746129576.981027:0:8410:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cda5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8410:1830948737580544:192.168.202.4@tcp:106: 00010000:00010000:1.0:1746129576.981063:0:8410:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009be05c00/0x40a459093b06b02d lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21b8b expref: 29 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129576.981077:0:8410:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009be05c00/0x40a459093b06b02d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21b8b expref: 29 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129576.981098:0:8410:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009be05c00, rc 0) 00000100:00100000:1.0:1746129576.981142:0:8410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800912ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+28:1962:x1830948734305920:12345-192.168.202.4@tcp:101:cat.0 Request processed in 6077us (6814us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129576.981153:0:8410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16588 00000100:00100000:1.0:1746129576.981206:0:11014:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cda4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11014:1830948737580416:192.168.202.4@tcp:106: 00010000:00010000:1.0:1746129576.981220:0:11014:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880136b1c800/0x40a459093b06b026 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21b84 expref: 17 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129576.981228:0:11014:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136b1c800/0x40a459093b06b026 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21b84 expref: 17 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129576.981235:0:11014:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136b1c800, rc 0) 00000100:00100000:1.0:1746129576.981248:0:11014:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800912adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+16:1962:x1830948734305792:12345-192.168.202.4@tcp:101:cat.0 Request processed in 6398us (6995us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129576.981252:0:11014:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16587 00000100:00100000:3.0:1746129576.984128:0:31518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+28:1962:x1830948734305664:12345-192.168.202.4@tcp:4:multiop.0 Request processed in 10740us (11485us total) trans 17179874159 rc 0/0 00000100:00100000:3.0:1746129576.984141:0:31518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2481 00002000:00100000:3.0:1746129576.984152:0:31518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3f5:0x0] (2699264->3145727) req@ffff8800959d5c00 x1830948734305664/t17179874159(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:317/0 lens 488/448 e 0 to 0 dl 1746129587 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129576.984160:0:31518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800959d5c00 with x1830948734305664 ext(2699264->3145727) 00010000:00010000:3.0:1746129576.984170:0:31518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091b4f400/0x40a459093b06b00a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2699264->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21b68 expref: 28 pid: 22480 timeout: 932 lvb_type: 0 00010000:00010000:3.0:1746129576.984186:0:31518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091b4f400/0x40a459093b06b00a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2699264->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21b68 expref: 28 pid: 22480 timeout: 932 lvb_type: 0 00002000:00010000:3.0:1746129576.984193:0:31518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800959d5c00 00000100:00100000:0.0:1746129576.989221:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129576.989463:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734306048 00000100:00100000:1.0:1746129576.989473:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734306048 00010000:00010000:1.0:1746129576.989511:0:9823:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091b4f400/0x40a459093b06b00a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2699264->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21b68 expref: 28 pid: 22480 timeout: 932 lvb_type: 0 00000100:00100000:1.0:1746129576.989554:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8549 00000100:00100000:1.0:1746129576.989562:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800912ac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+28:1963:x1830948734306048:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129576.989577:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129576.989601:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091b4f400/0x40a459093b06b00a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2699264->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21b68 expref: 28 pid: 22480 timeout: 932 lvb_type: 0 00010000:00010000:1.0:1746129576.989612:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091b4f400/0x40a459093b06b00a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2699264->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21b68 expref: 28 pid: 22480 timeout: 932 lvb_type: 0 00010000:00010000:1.0:1746129576.989638:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091b4f400/0x40a459093b06b00a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2699264->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21b68 expref: 28 pid: 22480 timeout: 932 lvb_type: 0 00010000:00010000:1.0:1746129576.989662:0:9823:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129576.989664:0:9823:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129576.989671:0:9823:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012eac2400/0x40a459093b06b01f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3280895) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21b7d expref: 29 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129576.989679:0:9823:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012eac2400/0x40a459093b06b01f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3280895) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21b7d expref: 29 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129576.989714:0:9823:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012eac2400/0x40a459093b06b01f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3280895) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21b7d expref: 29 pid: 22480 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129576.989725:0:9823:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cda4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9823:1830948737580672:192.168.202.4@tcp:105: 00000100:00100000:1.0:1746129576.989818:0:9823:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0ac540 going to sleep for 11 seconds 00000100:00100000:0.0:1746129576.993290:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129576.993389:0:11014:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734306176 00000100:00100000:1.0:1746129576.993397:0:11014:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734306176 00000100:00100000:1.0:1746129576.993443:0:11014:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16589 00000100:00100000:1.0:1746129576.993452:0:11014:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013577e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ada2ffba-8920-4ecb-8068-68caa9806978+30:1960:x1830948734306176:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129576.993471:0:11014:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129576.993492:0:11014:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e0b4a00/0x40a459093b06b034 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21b92 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129576.993544:0:11014:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cda5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11014:1830948737580800:192.168.202.4@tcp:106: 00000100:00100000:1.0:1746129576.993618:0:11014:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0ac240 going to sleep for 11 seconds 00000100:00100000:1.0:1746129576.995501:0:11014:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cda5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11014:1830948737580800:192.168.202.4@tcp:106: 00010000:00010000:1.0:1746129576.995535:0:11014:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012e0b4a00/0x40a459093b06b034 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21b92 expref: 31 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129576.995548:0:11014:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e0b4a00/0x40a459093b06b034 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21b92 expref: 31 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129576.995564:0:11014:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e0b4a00, rc 0) 00000100:00100000:1.0:1746129576.995603:0:11014:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013577e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ada2ffba-8920-4ecb-8068-68caa9806978+30:1960:x1830948734306176:12345-192.168.202.4@tcp:101:cat.0 Request processed in 2151us (2322us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129576.995611:0:11014:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16589 00000100:00100000:1.0:1746129576.995661:0:9823:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cda4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9823:1830948737580672:192.168.202.4@tcp:105: 00010000:00010000:1.0:1746129576.995672:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129576.997347:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800912ac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+27:1963:x1830948734306048:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 7778us (8128us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129576.997360:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8549 00000100:00100000:2.0:1746129577.000997:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129577.001108:0:31518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734306432 00000100:00100000:3.0:1746129577.001119:0:31518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734306432 00000100:00080000:2.0:1746129577.001174:0:7097:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00100000:3.0:1746129577.001175:0:31518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3f5:0x0] (3276800->3280895) req@ffff88008f448700 x1830948734306432/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:318/0 lens 488/0 e 0 to 0 dl 1746129588 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129577.001186:0:31518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f448700 with x1830948734306432 ext(3276800->3280895) 00002000:00010000:3.0:1746129577.001191:0:31518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f448700 00000100:00100000:0.0:1746129577.002895:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129577.003042:0:31518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734306816 00000100:00100000:3.0:1746129577.003051:0:31518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734306816 00000100:00100000:0.0:1746129577.003052:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00080000:3.0:1746129577.003070:0:7097:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746129577.003077:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129577.003091:0:31522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734306944 00000100:00100000:0.0:1746129577.003095:0:31522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734306944 00002000:00100000:3.0:1746129577.003097:0:31518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3ec:0x0] (0->1048575) req@ffff88013577c380 x1830948734306816/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:318/0 lens 488/0 e 0 to 0 dl 1746129588 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129577.003107:0:31518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013577c380 with x1830948734306816 ext(0->1048575) 00002000:00100000:0.0:1746129577.003111:0:31522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3ee:0x0] (1048576->2097151) req@ffff88013577d880 x1830948734306944/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:318/0 lens 488/0 e 0 to 0 dl 1746129588 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00010000:3.0:1746129577.003112:0:31518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013577c380 00002000:00100000:0.0:1746129577.003119:0:31522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013577d880 with x1830948734306944 ext(1048576->2097151) 00002000:00010000:0.0:1746129577.003122:0:31522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013577d880 00000100:00100000:0.0:1746129577.003131:0:31522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734307328 00000100:00100000:0.0:1746129577.003133:0:31522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734307328 00000100:00100000:3.0:1746129577.003142:0:31523:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8001 00002000:00100000:0.0:1746129577.003145:0:31522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f4:0x0] (1048576->2097151) req@ffff88013577dc00 x1830948734307328/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:318/0 lens 488/0 e 0 to 0 dl 1746129588 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746129577.003151:0:31523:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f448700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ada2ffba-8920-4ecb-8068-68caa9806978+30:1962:x1830948734306432:12345-192.168.202.4@tcp:3:multiop.0 00002000:00100000:0.0:1746129577.003151:0:31522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013577dc00 with x1830948734307328 ext(1048576->2097151) 00002000:00010000:0.0:1746129577.003154:0:31522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013577dc00 00000100:00100000:0.0:1746129577.003164:0:31522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8002 00000100:00100000:0.0:1746129577.003169:0:31522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013577c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+17:1962:x1830948734306816:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:3.0:1746129577.003356:0:31523:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f448700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ada2ffba-8920-4ecb-8068-68caa9806978+30:1962:x1830948734306432:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 206us (2370us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129577.003362:0:31523:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8001 00002000:00100000:3.0:1746129577.003367:0:31523:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f5:0x0] (3276800->3280895) req@ffff88008f448700 x1830948734306432/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:318/0 lens 488/4536 e 0 to 0 dl 1746129588 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129577.003374:0:31523:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f448700 with x1830948734306432 ext(3276800->3280895) 00002000:00010000:3.0:1746129577.003377:0:31523:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f448700 00000100:00100000:3.0:1746129577.003391:0:31523:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8003 00000100:00100000:3.0:1746129577.003396:0:31523:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013577d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+17:1962:x1830948734306944:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129577.004548:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129577.004611:0:21725:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734307200 00000100:00100000:2.0:1746129577.004623:0:21725:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734307200 00000100:00100000:2.0:1746129577.004661:0:31520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8004 00000100:00100000:2.0:1746129577.004674:0:31520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013577dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+28:1962:x1830948734307328:12345-192.168.202.4@tcp:3:cat.0 00002000:00100000:2.0:1746129577.006319:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff88013577ca80 x1830948734307200/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:318/0 lens 488/0 e 0 to 0 dl 1746129588 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129577.006330:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013577ca80 with x1830948734307200 ext(1048576->2097151) 00002000:00010000:2.0:1746129577.006335:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013577ca80 00000100:00100000:2.0:1746129577.006371:0:21725:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8005 00000100:00100000:2.0:1746129577.006378:0:21725:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013577ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+29:1962:x1830948734307200:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:2.0:1746129577.015759:0:31522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013577c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+18:1962:x1830948734306816:12345-192.168.202.4@tcp:3:cat.0 Request processed in 12576us (12858us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129577.015772:0:31522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8002 00002000:00100000:2.0:1746129577.015785:0:31522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3ec:0x0] (0->1048575) req@ffff88013577c380 x1830948734306816/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:318/0 lens 488/440 e 0 to 0 dl 1746129588 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129577.015794:0:31522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013577c380 with x1830948734306816 ext(0->1048575) 00002000:00010000:2.0:1746129577.015801:0:31522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013577c380 00000100:00100000:0.0:1746129577.028536:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129577.028581:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129577.030370:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129577.030397:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734307840 00000100:00100000:3.0:1746129577.030407:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734307840 00002000:00100000:3.0:1746129577.030465:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ec:0x0] (0->1048575) req@ffff88012e38b100 x1830948734307840/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:318/0 lens 488/0 e 0 to 0 dl 1746129588 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129577.030476:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e38b100 with x1830948734307840 ext(0->1048575) 00002000:00010000:3.0:1746129577.030482:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e38b100 00000100:00100000:3.0:1746129577.030498:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734307968 00000100:00100000:3.0:1746129577.030501:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734307968 00002000:00100000:3.0:1746129577.030512:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ee:0x0] (1048576->2097151) req@ffff88012e38a680 x1830948734307968/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:318/0 lens 488/0 e 0 to 0 dl 1746129588 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129577.030519:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e38a680 with x1830948734307968 ext(1048576->2097151) 00002000:00010000:3.0:1746129577.030523:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e38a680 00000100:00100000:3.0:1746129577.030530:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734308352 00000100:00100000:3.0:1746129577.030532:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734308352 00002000:00100000:3.0:1746129577.030543:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f4:0x0] (1048576->2097151) req@ffff880091b06a00 x1830948734308352/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:318/0 lens 488/0 e 0 to 0 dl 1746129588 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129577.030550:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091b06a00 with x1830948734308352 ext(1048576->2097151) 00002000:00010000:3.0:1746129577.030553:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091b06a00 00000100:00100000:3.0:1746129577.030564:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8006 00000100:00100000:3.0:1746129577.030571:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e38b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+23:1960:x1830948734307840:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:1.0:1746129577.034637:0:8416:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8007 00000100:00100000:1.0:1746129577.034655:0:8416:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e38a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ada2ffba-8920-4ecb-8068-68caa9806978+24:1960:x1830948734307968:12345-192.168.202.4@tcp:3:cat.0 00000100:00080000:3.0:1746129577.034966:0:7097:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1746129577.034987:0:31519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8008 00000100:00100000:3.0:1746129577.034996:0:31519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ada2ffba-8920-4ecb-8068-68caa9806978+30:1960:x1830948734308352:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129577.036163:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129577.036191:0:8417:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734308224 00000100:00100000:0.0:1746129577.036199:0:8417:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734308224 00002000:00100000:0.0:1746129577.036235:0:8417:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff88012e388a80 x1830948734308224/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:318/0 lens 488/0 e 0 to 0 dl 1746129588 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129577.036245:0:8417:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e388a80 with x1830948734308224 ext(1048576->2097151) 00002000:00010000:0.0:1746129577.036250:0:8417:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e388a80 00000100:00100000:0.0:1746129577.036283:0:8417:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8009 00000100:00100000:0.0:1746129577.036289:0:8417:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e388a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ada2ffba-8920-4ecb-8068-68caa9806978+32:1960:x1830948734308224:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129577.038647:0:31523:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013577d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+16:1962:x1830948734306944:12345-192.168.202.4@tcp:3:cat.0 Request processed in 35238us (35583us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129577.038659:0:31523:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8003 00002000:00100000:0.0:1746129577.038670:0:31523:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3ee:0x0] (1048576->2097151) req@ffff88013577d880 x1830948734306944/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:318/0 lens 488/440 e 0 to 0 dl 1746129588 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129577.038679:0:31523:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013577d880 with x1830948734306944 ext(1048576->2097151) 00002000:00010000:0.0:1746129577.038686:0:31523:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013577d880 00000100:00100000:3.0:1746129577.053336:0:31520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013577dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+29:1962:x1830948734307328:12345-192.168.202.4@tcp:3:cat.0 Request processed in 48654us (50244us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129577.053350:0:31520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8004 00002000:00100000:3.0:1746129577.053365:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3f4:0x0] (1048576->2097151) req@ffff88013577dc00 x1830948734307328/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:318/0 lens 488/440 e 0 to 0 dl 1746129588 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129577.053375:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013577dc00 with x1830948734307328 ext(1048576->2097151) 00002000:00010000:3.0:1746129577.053381:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013577dc00 00000100:00100000:3.0:1746129577.060335:0:21725:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013577ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+27:1962:x1830948734307200:12345-192.168.202.4@tcp:3:cat.0 Request processed in 53945us (55777us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129577.060348:0:21725:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8005 00002000:00100000:3.0:1746129577.060360:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff88013577ca80 x1830948734307200/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:318/0 lens 488/440 e 0 to 0 dl 1746129588 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129577.060370:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013577ca80 with x1830948734307200 ext(1048576->2097151) 00002000:00010000:3.0:1746129577.060375:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013577ca80 00000100:00100000:0.0:1746129577.077832:0:8417:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e388a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ada2ffba-8920-4ecb-8068-68caa9806978+32:1960:x1830948734308224:12345-192.168.202.4@tcp:3:cat.0 Request processed in 41527us (41658us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129577.077848:0:8417:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8009 00002000:00100000:0.0:1746129577.077864:0:8417:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff88012e388a80 x1830948734308224/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:318/0 lens 488/440 e 0 to 0 dl 1746129588 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129577.077873:0:8417:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e388a80 with x1830948734308224 ext(1048576->2097151) 00002000:00010000:0.0:1746129577.077881:0:8417:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e388a80 00000100:00100000:0.0:1746129577.080016:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129577.080511:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e38b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+24:1960:x1830948734307840:12345-192.168.202.4@tcp:3:cat.0 Request processed in 49938us (51985us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129577.080522:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8006 00002000:00100000:2.0:1746129577.080534:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ec:0x0] (0->1048575) req@ffff88012e38b100 x1830948734307840/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:318/0 lens 488/440 e 0 to 0 dl 1746129588 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129577.080542:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e38b100 with x1830948734307840 ext(0->1048575) 00002000:00010000:2.0:1746129577.080547:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e38b100 00000100:00100000:0.0:1746129577.082157:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129577.082738:0:11014:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734308608 00000100:00100000:1.0:1746129577.082749:0:11014:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734308608 00000100:00100000:1.0:1746129577.082805:0:11014:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734308736 00000100:00100000:1.0:1746129577.082808:0:11014:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734308736 00000100:00100000:1.0:1746129577.082828:0:11014:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16590 00000100:00100000:1.0:1746129577.082835:0:11014:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e389c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+16:1963:x1830948734308608:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129577.082856:0:11014:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129577.082873:0:11014:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a77f7a00/0x40a459093b06b03b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21b99 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129577.082929:0:11014:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cda4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11014:1830948737580928:192.168.202.4@tcp:106: 00000100:00100000:1.0:1746129577.083010:0:11014:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0ac540 going to sleep for 11 seconds 00000100:00100000:2.0:1746129577.083359:0:8410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16591 00000100:00100000:2.0:1746129577.083369:0:8410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e38b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+27:1963:x1830948734308736:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129577.083376:0:8410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129577.083388:0:8410:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880132f99600/0x40a459093b06b042 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21ba0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129577.083414:0:8410:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f44b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8410:1830948737581056:192.168.202.4@tcp:106: 00000100:00100000:2.0:1746129577.083729:0:8410:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132f36840 going to sleep for 11 seconds 00000100:00100000:3.0:1746129577.087341:0:31519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ada2ffba-8920-4ecb-8068-68caa9806978+30:1960:x1830948734308352:12345-192.168.202.4@tcp:3:cat.0 Request processed in 52297us (56930us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129577.087355:0:31519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8008 00002000:00100000:3.0:1746129577.087367:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f4:0x0] (1048576->2097151) req@ffff880091b06a00 x1830948734308352/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:318/0 lens 488/440 e 0 to 0 dl 1746129588 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129577.087377:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091b06a00 with x1830948734308352 ext(1048576->2097151) 00002000:00010000:3.0:1746129577.087383:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091b06a00 00000100:00100000:1.0:1746129577.094217:0:8416:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e38a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ada2ffba-8920-4ecb-8068-68caa9806978+22:1960:x1830948734307968:12345-192.168.202.4@tcp:3:cat.0 Request processed in 59543us (65608us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129577.094232:0:8416:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8007 00002000:00100000:1.0:1746129577.094251:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3ee:0x0] (1048576->2097151) req@ffff88012e38a680 x1830948734307968/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:318/0 lens 488/440 e 0 to 0 dl 1746129588 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129577.094271:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e38a680 with x1830948734307968 ext(1048576->2097151) 00002000:00010000:1.0:1746129577.094277:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e38a680 00000100:00100000:2.0:1746129577.096836:0:8410:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f44b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8410:1830948737581056:192.168.202.4@tcp:106: 00000100:00100000:1.0:1746129577.096836:0:11014:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cda4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11014:1830948737580928:192.168.202.4@tcp:106: 00010000:00010000:2.0:1746129577.096870:0:8410:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880132f99600/0x40a459093b06b042 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21ba0 expref: 28 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129577.096870:0:11014:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a77f7a00/0x40a459093b06b03b lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21b99 expref: 17 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129577.096886:0:8410:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880132f99600/0x40a459093b06b042 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21ba0 expref: 28 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129577.096886:0:11014:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a77f7a00/0x40a459093b06b03b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21b99 expref: 17 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129577.096901:0:8410:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132f99600, rc 0) 00010000:00010000:1.0:1746129577.096902:0:11014:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a77f7a00, rc 0) 00000100:00100000:2.0:1746129577.096945:0:8410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e38b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+27:1963:x1830948734308736:12345-192.168.202.4@tcp:101:cat.0 Request processed in 13578us (14795us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129577.096953:0:8410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16591 00000100:00100000:1.0:1746129577.097417:0:11014:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e389c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+16:1963:x1830948734308608:12345-192.168.202.4@tcp:101:cat.0 Request processed in 14582us (17410us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129577.097424:0:11014:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16590 00000100:00100000:0.0:1746129577.101428:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129577.101543:0:11014:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734308864 00000100:00100000:1.0:1746129577.101553:0:11014:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734308864 00000100:00100000:1.0:1746129577.101929:0:11014:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16592 00000100:00100000:1.0:1746129577.101939:0:11014:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e388380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+16:32507:x1830948734308864:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129577.101961:0:11014:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129577.101979:0:11014:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d306800/0x40a459093b06b049 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21ba7 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129577.102010:0:11014:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012eac3a00/0x40a459093b06b018 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3497984->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21b76 expref: 21 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129577.102017:0:11014:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129577.102018:0:11014:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129577.102021:0:11014:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d306800/0x40a459093b06b049 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21ba7 expref: 17 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129577.102058:0:11014:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012eac3a00/0x40a459093b06b018 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3497984->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21b76 expref: 21 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129577.102069:0:11014:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012eac3a00/0x40a459093b06b018 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3497984->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21b76 expref: 21 pid: 22480 timeout: 932 lvb_type: 0 00000100:00100000:1.0:1746129577.102082:0:11014:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cda4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11014:1830948737581184:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129577.102281:0:11014:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0ac540 going to sleep for 11 seconds 00000100:00100000:1.0:1746129577.106834:0:11014:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cda4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11014:1830948737581184:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129577.106873:0:11014:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009d306800/0x40a459093b06b049 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21ba7 expref: 17 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129577.106899:0:11014:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d306800, rc 0) 00000100:00100000:1.0:1746129577.106966:0:11014:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e388380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+17:32507:x1830948734308864:12345-192.168.202.4@tcp:101:cat.0 Request processed in 5027us (5547us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129577.106976:0:11014:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16592 00000100:00100000:0.0:1746129577.108435:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129577.108525:0:8416:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734308992 00000100:00100000:1.0:1746129577.108533:0:8416:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734308992 00002000:00100000:1.0:1746129577.108581:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3ef:0x0] (3497984->4194303) req@ffff880094f46680 x1830948734308992/t0(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:318/0 lens 488/0 e 0 to 0 dl 1746129588 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129577.108590:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094f46680 with x1830948734308992 ext(3497984->4194303) 00010000:00010000:1.0:1746129577.108599:0:8416:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012eac3a00/0x40a459093b06b018 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3497984->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21b76 expref: 22 pid: 22480 timeout: 932 lvb_type: 0 00010000:00010000:1.0:1746129577.108612:0:8416:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012eac3a00/0x40a459093b06b018 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3497984->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21b76 expref: 22 pid: 22480 timeout: 932 lvb_type: 0 00002000:00010000:1.0:1746129577.108619:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094f46680 00000100:00100000:1.0:1746129577.108654:0:8416:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2482 00000100:00100000:1.0:1746129577.108662:0:8416:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ada2ffba-8920-4ecb-8068-68caa9806978+22:1963:x1830948734308992:12345-192.168.202.4@tcp:4:cat.0 00000100:00100000:0.0:1746129577.111037:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129577.111146:0:11014:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734309120 00000100:00100000:1.0:1746129577.111155:0:11014:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734309120 00000100:00100000:1.0:1746129577.111207:0:11014:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16593 00000100:00100000:1.0:1746129577.111215:0:11014:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ada2ffba-8920-4ecb-8068-68caa9806978+24:32509:x1830948734309120:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129577.111231:0:11014:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129577.111249:0:11014:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d306a00/0x40a459093b06b050 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21bae expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129577.111289:0:11014:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129577.111316:0:11014:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d306a00/0x40a459093b06b050 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21bae expref: 25 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129577.111329:0:11014:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009d306a00/0x40a459093b06b050 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21bae expref: 25 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129577.111340:0:11014:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d306a00, rc 0) 00000100:00100000:1.0:1746129577.111382:0:11014:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ada2ffba-8920-4ecb-8068-68caa9806978+25:32509:x1830948734309120:12345-192.168.202.4@tcp:101:cat.0 Request processed in 169us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129577.111388:0:11014:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16593 00000100:00100000:0.0:1746129577.129059:0:8416:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ada2ffba-8920-4ecb-8068-68caa9806978+25:1963:x1830948734308992:12345-192.168.202.4@tcp:4:cat.0 Request processed in 20385us (20621us total) trans 21474841406 rc 0/0 00000100:00100000:0.0:1746129577.129072:0:8416:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2482 00002000:00100000:0.0:1746129577.129084:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3ef:0x0] (3497984->4194303) req@ffff880094f46680 x1830948734308992/t21474841406(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:318/0 lens 488/448 e 0 to 0 dl 1746129588 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129577.129094:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094f46680 with x1830948734308992 ext(3497984->4194303) 00010000:00010000:0.0:1746129577.129105:0:8416:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012eac3a00/0x40a459093b06b018 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3497984->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21b76 expref: 25 pid: 22480 timeout: 932 lvb_type: 0 00010000:00010000:0.0:1746129577.129119:0:8416:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012eac3a00/0x40a459093b06b018 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3497984->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21b76 expref: 25 pid: 22480 timeout: 932 lvb_type: 0 00002000:00010000:0.0:1746129577.129126:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094f46680 00000100:00100000:0.0:1746129577.135625:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129577.140156:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734309248 00000100:00100000:1.0:1746129577.140173:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734309248 00010000:00010000:1.0:1746129577.140228:0:9823:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012eac3a00/0x40a459093b06b018 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3497984->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21b76 expref: 25 pid: 22480 timeout: 932 lvb_type: 0 00000100:00100000:1.0:1746129577.140314:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8550 00000100:00100000:1.0:1746129577.140575:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f44a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ada2ffba-8920-4ecb-8068-68caa9806978+25:1963:x1830948734309248:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129577.140593:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129577.140620:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012eac3a00/0x40a459093b06b018 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3497984->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21b76 expref: 25 pid: 22480 timeout: 932 lvb_type: 0 00010000:00010000:1.0:1746129577.140635:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012eac3a00/0x40a459093b06b018 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3497984->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21b76 expref: 25 pid: 22480 timeout: 932 lvb_type: 0 00010000:00010000:1.0:1746129577.140659:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012eac3a00/0x40a459093b06b018 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3497984->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21b76 expref: 25 pid: 22480 timeout: 932 lvb_type: 0 00010000:00010000:1.0:1746129577.141094:0:9823:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129577.141097:0:9823:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129577.141106:0:9823:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d306800/0x40a459093b06b049 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21ba7 expref: 16 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129577.141115:0:9823:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d306800/0x40a459093b06b049 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21ba7 expref: 16 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129577.141123:0:9823:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129577.141124:0:9823:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129577.141127:0:9823:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d306a00/0x40a459093b06b050 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21bae expref: 24 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129577.141133:0:9823:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d306a00/0x40a459093b06b050 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21bae expref: 24 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129577.141167:0:9823:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009d306a00/0x40a459093b06b050 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21bae expref: 24 pid: 11014 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129577.141180:0:9823:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cda4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9823:1830948737581312:192.168.202.4@tcp:105: 00010000:00010000:1.0:1746129577.141836:0:9823:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009d306800/0x40a459093b06b049 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21ba7 expref: 16 pid: 11014 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129577.141845:0:9823:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cda5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9823:1830948737581440:192.168.202.4@tcp:105: 00000100:00100000:1.0:1746129577.143114:0:9823:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0ac240 going to sleep for 11 seconds 00000100:00100000:1.0:1746129577.148180:0:9823:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cda4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9823:1830948737581312:192.168.202.4@tcp:105: 00000100:00100000:1.0:1746129577.148567:0:9823:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cda5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9823:1830948737581440:192.168.202.4@tcp:105: 00010000:00010000:1.0:1746129577.148588:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129577.148643:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f44a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ada2ffba-8920-4ecb-8068-68caa9806978+24:1963:x1830948734309248:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 8070us (13028us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129577.148655:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8550 00000100:00100000:0.0:1746129577.149066:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129577.149185:0:8416:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734309504 00000100:00100000:2.0:1746129577.149192:0:8416:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734309504 00002000:00100000:2.0:1746129577.149233:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3ef:0x0] (2097152->3145727) req@ffff88009c7d8e00 x1830948734309504/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:318/0 lens 488/0 e 0 to 0 dl 1746129588 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129577.149242:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7d8e00 with x1830948734309504 ext(2097152->3145727) 00002000:00010000:2.0:1746129577.149247:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c7d8e00 00000100:00100000:2.0:1746129577.149283:0:8416:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8010 00000100:00100000:2.0:1746129577.149289:0:8416:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+17:1961:x1830948734309504:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129577.159826:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129577.160967:0:31519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734309760 00000100:00100000:3.0:1746129577.160980:0:31519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734309760 00002000:00100000:3.0:1746129577.161028:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3ef:0x0] (2097152->3145727) req@ffff88009c7d9c00 x1830948734309760/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:318/0 lens 488/0 e 0 to 0 dl 1746129588 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129577.161039:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7d9c00 with x1830948734309760 ext(2097152->3145727) 00002000:00010000:3.0:1746129577.161045:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c7d9c00 00000100:00100000:3.0:1746129577.161605:0:31519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8011 00000100:00100000:3.0:1746129577.161613:0:31519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ada2ffba-8920-4ecb-8068-68caa9806978+24:1963:x1830948734309760:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:2.0:1746129577.162746:0:8416:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+17:1961:x1830948734309504:12345-192.168.202.4@tcp:3:cat.0 Request processed in 13451us (13675us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129577.162756:0:8416:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8010 00002000:00100000:2.0:1746129577.162766:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3ef:0x0] (2097152->3145727) req@ffff88009c7d8e00 x1830948734309504/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:318/0 lens 488/440 e 0 to 0 dl 1746129588 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129577.162775:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7d8e00 with x1830948734309504 ext(2097152->3145727) 00002000:00010000:2.0:1746129577.162782:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c7d8e00 00000100:00100000:0.0:1746129577.167225:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129577.167276:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129577.167364:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129577.167409:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734310016 00000100:00100000:0.0:1746129577.167420:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734310016 00002000:00100000:0.0:1746129577.167468:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->4194303) req@ffff88009c7d9880 x1830948734310016/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:318/0 lens 488/0 e 0 to 0 dl 1746129588 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129577.167478:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7d9880 with x1830948734310016 ext(3145728->4194303) 00002000:00010000:0.0:1746129577.167484:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c7d9880 00000100:00100000:0.0:1746129577.167505:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734310272 00000100:00100000:0.0:1746129577.167508:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734310272 00002000:00100000:0.0:1746129577.167522:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f5:0x0] (2097152->3145727) req@ffff88009c7dbb80 x1830948734310272/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:318/0 lens 488/0 e 0 to 0 dl 1746129588 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129577.167528:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7dbb80 with x1830948734310272 ext(2097152->3145727) 00002000:00010000:0.0:1746129577.167531:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c7dbb80 00000100:00100000:0.0:1746129577.167540:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734310528 00000100:00100000:0.0:1746129577.167542:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734310528 00002000:00100000:0.0:1746129577.167552:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f5:0x0] (3280896->4194303) req@ffff880094029f80 x1830948734310528/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:318/0 lens 488/0 e 0 to 0 dl 1746129588 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129577.167559:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094029f80 with x1830948734310528 ext(3280896->4194303) 00002000:00010000:0.0:1746129577.167561:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094029f80 00000100:00100000:0.0:1746129577.167584:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8012 00000100:00100000:0.0:1746129577.167590:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+26:1962:x1830948734310016:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129577.169889:0:31520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8013 00000100:00100000:0.0:1746129577.169906:0:31520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ada2ffba-8920-4ecb-8068-68caa9806978+31:1962:x1830948734310272:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129577.172237:0:21725:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8014 00000100:00100000:0.0:1746129577.172254:0:21725:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094029f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ada2ffba-8920-4ecb-8068-68caa9806978+32:1963:x1830948734310528:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:1.0:1746129577.183198:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129577.183254:0:8410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734310656 00000100:00100000:2.0:1746129577.183274:0:8410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734310656 00000100:00100000:2.0:1746129577.183345:0:8410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16594 00000100:00100000:2.0:1746129577.183354:0:8410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cda5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+27:32507:x1830948734310656:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129577.183373:0:8410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129577.183395:0:8410:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b5263800/0x40a459093b06b057 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21bb5 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129577.183428:0:8410:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012eac2400/0x40a459093b06b01f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3280895) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21b7d expref: 33 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129577.183437:0:8410:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129577.183439:0:8410:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129577.183442:0:8410:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b5263800/0x40a459093b06b057 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21bb5 expref: 28 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129577.183480:0:8410:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012eac2400/0x40a459093b06b01f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3280895) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21b7d expref: 33 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129577.183492:0:8410:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012eac2400/0x40a459093b06b01f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3280895) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21b7d expref: 33 pid: 22480 timeout: 932 lvb_type: 0 00000100:00100000:2.0:1746129577.183505:0:8410:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f44b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8410:1830948737581568:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129577.186000:0:31519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ada2ffba-8920-4ecb-8068-68caa9806978+26:1963:x1830948734309760:12345-192.168.202.4@tcp:3:cat.0 Request processed in 24376us (26172us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129577.186013:0:31519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8011 00002000:00100000:0.0:1746129577.186026:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3ef:0x0] (2097152->3145727) req@ffff88009c7d9c00 x1830948734309760/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:318/0 lens 488/440 e 0 to 0 dl 1746129588 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129577.186036:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7d9c00 with x1830948734309760 ext(2097152->3145727) 00002000:00010000:0.0:1746129577.186042:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c7d9c00 00000100:00100000:2.0:1746129577.186227:0:8410:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132f36840 going to sleep for 11 seconds 00000100:00100000:2.0:1746129577.197506:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+24:1962:x1830948734310016:12345-192.168.202.4@tcp:3:cat.0 Request processed in 29904us (30284us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129577.197518:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8012 00002000:00100000:2.0:1746129577.197531:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->4194303) req@ffff88009c7d9880 x1830948734310016/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:318/0 lens 488/440 e 0 to 0 dl 1746129588 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129577.197542:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7d9880 with x1830948734310016 ext(3145728->4194303) 00002000:00010000:2.0:1746129577.197549:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c7d9880 00000100:00100000:0.0:1746129577.200006:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129577.200135:0:8410:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f44b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8410:1830948737581568:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129577.200172:0:8410:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b5263800/0x40a459093b06b057 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21bb5 expref: 28 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129577.200190:0:8410:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b5263800, rc 0) 00000100:00100000:2.0:1746129577.200265:0:8410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cda5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+28:32507:x1830948734310656:12345-192.168.202.4@tcp:101:cat.0 Request processed in 16903us (17068us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129577.200273:0:8410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16594 00000100:00100000:3.0:1746129577.201093:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734310784 00000100:00100000:3.0:1746129577.201103:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734310784 00002000:00100000:3.0:1746129577.201143:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f5:0x0] (3145728->3280895) req@ffff880094028a80 x1830948734310784/t0(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:318/0 lens 488/0 e 0 to 0 dl 1746129588 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129577.201154:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094028a80 with x1830948734310784 ext(3145728->3280895) 00010000:00010000:3.0:1746129577.201161:0:25745:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012eac2400/0x40a459093b06b01f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3280895) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21b7d expref: 34 pid: 22480 timeout: 932 lvb_type: 0 00010000:00010000:3.0:1746129577.201176:0:25745:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012eac2400/0x40a459093b06b01f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3280895) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21b7d expref: 34 pid: 22480 timeout: 932 lvb_type: 0 00002000:00010000:3.0:1746129577.201182:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094028a80 00000100:00100000:3.0:1746129577.201207:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2483 00000100:00100000:3.0:1746129577.201214:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094028a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+34:1963:x1830948734310784:12345-192.168.202.4@tcp:4:cat.0 00000100:00100000:0.0:1746129577.204633:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129577.204702:0:8410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734310912 00000100:00100000:2.0:1746129577.204712:0:8410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734310912 00000100:00100000:2.0:1746129577.206304:0:8410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16595 00000100:00100000:2.0:1746129577.206320:0:8410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009402bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ada2ffba-8920-4ecb-8068-68caa9806978+36:32509:x1830948734310912:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129577.206342:0:8410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129577.206363:0:8410:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a6cae400/0x40a459093b06b05e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21bbc expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129577.206395:0:8410:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129577.206402:0:8410:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6cae400/0x40a459093b06b05e lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21bbc expref: 37 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129577.206414:0:8410:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a6cae400/0x40a459093b06b05e lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21bbc expref: 37 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129577.206432:0:8410:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6cae400, rc 0) 00000100:00100000:2.0:1746129577.206496:0:8410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009402bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ada2ffba-8920-4ecb-8068-68caa9806978+37:32509:x1830948734310912:12345-192.168.202.4@tcp:101:cat.0 Request processed in 182us (1875us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129577.206502:0:8410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16595 00000100:00100000:1.0:1746129577.207023:0:31520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ada2ffba-8920-4ecb-8068-68caa9806978+35:1962:x1830948734310272:12345-192.168.202.4@tcp:3:cat.0 Request processed in 37121us (39744us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129577.207033:0:31520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8013 00002000:00100000:1.0:1746129577.207042:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3f5:0x0] (2097152->3145727) req@ffff88009c7dbb80 x1830948734310272/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:318/0 lens 488/440 e 0 to 0 dl 1746129588 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129577.207052:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7dbb80 with x1830948734310272 ext(2097152->3145727) 00010000:00010000:1.0:1746129577.207063:0:31520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012eac2400/0x40a459093b06b01f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3280895) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21b7d expref: 35 pid: 22480 timeout: 932 lvb_type: 0 00010000:00010000:1.0:1746129577.207079:0:31520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012eac2400/0x40a459093b06b01f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3280895) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21b7d expref: 35 pid: 22480 timeout: 932 lvb_type: 0 00002000:00010000:1.0:1746129577.207085:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c7dbb80 00000100:00100000:3.0:1746129577.210963:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094028a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+35:1963:x1830948734310784:12345-192.168.202.4@tcp:4:cat.0 Request processed in 9739us (10957us total) trans 17179874160 rc 0/0 00000100:00100000:3.0:1746129577.211797:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2483 00002000:00100000:3.0:1746129577.211816:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f5:0x0] (3145728->3280895) req@ffff880094028a80 x1830948734310784/t17179874160(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:318/0 lens 488/448 e 0 to 0 dl 1746129588 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129577.211827:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094028a80 with x1830948734310784 ext(3145728->3280895) 00010000:00010000:3.0:1746129577.211838:0:25745:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012eac2400/0x40a459093b06b01f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3280895) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21b7d expref: 35 pid: 22480 timeout: 932 lvb_type: 0 00010000:00010000:3.0:1746129577.211853:0:25745:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012eac2400/0x40a459093b06b01f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3280895) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21b7d expref: 35 pid: 22480 timeout: 932 lvb_type: 0 00002000:00010000:3.0:1746129577.211859:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094028a80 00000100:00100000:1.0:1746129577.216872:0:21725:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094029f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ada2ffba-8920-4ecb-8068-68caa9806978+33:1963:x1830948734310528:12345-192.168.202.4@tcp:3:cat.0 Request processed in 44609us (49496us total) trans 0 rc 913408/913408 00000100:00100000:1.0:1746129577.216886:0:21725:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8014 00002000:00100000:1.0:1746129577.216900:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f5:0x0] (3280896->4194303) req@ffff880094029f80 x1830948734310528/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:318/0 lens 488/440 e 0 to 0 dl 1746129588 ref 1 fl Complete:/200/0 rc 913408/913408 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129577.216914:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094029f80 with x1830948734310528 ext(3280896->4194303) 00010000:00010000:1.0:1746129577.216926:0:21725:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012eac2400/0x40a459093b06b01f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3280895) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21b7d expref: 33 pid: 22480 timeout: 932 lvb_type: 0 00010000:00010000:1.0:1746129577.216942:0:21725:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012eac2400/0x40a459093b06b01f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3280895) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21b7d expref: 33 pid: 22480 timeout: 932 lvb_type: 0 00002000:00010000:1.0:1746129577.216948:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094029f80 00000100:00100000:0.0:1746129577.229146:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129577.229250:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734311040 00000100:00100000:1.0:1746129577.229268:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734311040 00010000:00010000:1.0:1746129577.229338:0:9823:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012eac2400/0x40a459093b06b01f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3280895) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21b7d expref: 33 pid: 22480 timeout: 932 lvb_type: 0 00000100:00100000:1.0:1746129577.229380:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8551 00000100:00100000:1.0:1746129577.229388:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f95bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ada2ffba-8920-4ecb-8068-68caa9806978+33:1962:x1830948734311040:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129577.229402:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129577.229426:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012eac2400/0x40a459093b06b01f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3280895) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21b7d expref: 33 pid: 22480 timeout: 932 lvb_type: 0 00010000:00010000:1.0:1746129577.229438:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012eac2400/0x40a459093b06b01f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3280895) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21b7d expref: 33 pid: 22480 timeout: 932 lvb_type: 0 00010000:00010000:1.0:1746129577.229461:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012eac2400/0x40a459093b06b01f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3280895) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21b7d expref: 33 pid: 22480 timeout: 932 lvb_type: 0 00010000:00010000:1.0:1746129577.229495:0:9823:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129577.229497:0:9823:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129577.229505:0:9823:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b5263800/0x40a459093b06b057 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21bb5 expref: 27 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129577.229513:0:9823:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b5263800/0x40a459093b06b057 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21bb5 expref: 27 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129577.229521:0:9823:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129577.229522:0:9823:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129577.229525:0:9823:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a6cae400/0x40a459093b06b05e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21bbc expref: 32 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129577.229531:0:9823:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6cae400/0x40a459093b06b05e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21bbc expref: 32 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129577.229562:0:9823:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a6cae400/0x40a459093b06b05e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21bbc expref: 32 pid: 8410 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129577.229574:0:9823:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cda4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9823:1830948737581696:192.168.202.4@tcp:105: 00010000:00010000:1.0:1746129577.229662:0:9823:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800b5263800/0x40a459093b06b057 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21bb5 expref: 27 pid: 8410 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129577.229670:0:9823:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cda5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9823:1830948737581824:192.168.202.4@tcp:105: 00000100:00100000:1.0:1746129577.229685:0:9823:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0ac240 going to sleep for 11 seconds 00000100:00100000:1.0:1746129577.232627:0:9823:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cda4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9823:1830948737581696:192.168.202.4@tcp:105: 00000100:00100000:1.0:1746129577.232639:0:9823:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cda5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9823:1830948737581824:192.168.202.4@tcp:105: 00010000:00010000:1.0:1746129577.232659:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129577.232703:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f95bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ada2ffba-8920-4ecb-8068-68caa9806978+32:1962:x1830948734311040:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 3316us (3568us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129577.232714:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8551 00000100:00100000:0.0:1746129577.240997:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129577.241357:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129577.241732:0:21725:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734311424 00000100:00100000:1.0:1746129577.241740:0:21725:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734311424 00002000:00100000:1.0:1746129577.241774:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f5:0x0] (3145728->4194303) req@ffff88009f959c00 x1830948734311424/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:318/0 lens 488/0 e 0 to 0 dl 1746129588 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129577.241783:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f959c00 with x1830948734311424 ext(3145728->4194303) 00002000:00010000:1.0:1746129577.241788:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f959c00 00000100:00100000:1.0:1746129577.241812:0:21725:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734311296 00000100:00100000:1.0:1746129577.241814:0:21725:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734311296 00002000:00100000:1.0:1746129577.241825:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f5:0x0] (2097152->3145727) req@ffff8800900f5f80 x1830948734311296/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:318/0 lens 488/0 e 0 to 0 dl 1746129588 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129577.241831:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800900f5f80 with x1830948734311296 ext(2097152->3145727) 00002000:00010000:1.0:1746129577.241834:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800900f5f80 00000100:00100000:1.0:1746129577.241846:0:21725:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8015 00000100:00100000:1.0:1746129577.241853:0:21725:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f959c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ada2ffba-8920-4ecb-8068-68caa9806978+33:1962:x1830948734311424:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:2.0:1746129577.242379:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8016 00000100:00100000:2.0:1746129577.242388:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+33:1963:x1830948734311296:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129577.247529:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129577.247787:0:31519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734311808 00000100:00100000:2.0:1746129577.247794:0:31519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734311808 00002000:00100000:2.0:1746129577.247830:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f5:0x0] (2097152->3145727) req@ffff8800900f7480 x1830948734311808/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:318/0 lens 488/0 e 0 to 0 dl 1746129588 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129577.247839:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800900f7480 with x1830948734311808 ext(2097152->3145727) 00002000:00010000:2.0:1746129577.247843:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800900f7480 00000100:00100000:2.0:1746129577.247966:0:31519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8017 00000100:00100000:2.0:1746129577.247973:0:31519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+28:1962:x1830948734311808:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129577.256052:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129577.256103:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129577.256192:0:8416:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734312064 00000100:00100000:3.0:1746129577.256205:0:8416:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734312064 00002000:00100000:3.0:1746129577.256274:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3f5:0x0] (3145728->4194303) req@ffff8800900f5500 x1830948734312064/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:318/0 lens 488/0 e 0 to 0 dl 1746129588 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129577.256285:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800900f5500 with x1830948734312064 ext(3145728->4194303) 00002000:00010000:3.0:1746129577.256337:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800900f5500 00000100:00100000:3.0:1746129577.256365:0:8416:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734312320 00000100:00100000:3.0:1746129577.256368:0:8416:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734312320 00002000:00100000:3.0:1746129577.256389:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->4194303) req@ffff8800900f6680 x1830948734312320/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:318/0 lens 488/0 e 0 to 0 dl 1746129588 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129577.256396:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800900f6680 with x1830948734312320 ext(3145728->4194303) 00002000:00010000:3.0:1746129577.256400:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800900f6680 00000100:00100000:3.0:1746129577.256415:0:8416:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8018 00000100:00100000:3.0:1746129577.256424:0:8416:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+30:1962:x1830948734312064:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:3.0:1746129577.256710:0:8417:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8019 00000100:00100000:3.0:1746129577.256716:0:8417:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+17:1962:x1830948734312320:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:1.0:1746129577.258633:0:21725:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f959c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ada2ffba-8920-4ecb-8068-68caa9806978+34:1962:x1830948734311424:12345-192.168.202.4@tcp:3:cat.0 Request processed in 16768us (17630us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129577.258646:0:21725:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8015 00002000:00100000:1.0:1746129577.258660:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f5:0x0] (3145728->4194303) req@ffff88009f959c00 x1830948734311424/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:318/0 lens 488/440 e 0 to 0 dl 1746129588 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129577.258669:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f959c00 with x1830948734311424 ext(3145728->4194303) 00002000:00010000:1.0:1746129577.258675:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f959c00 00000100:00100000:3.0:1746129577.264641:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+32:1963:x1830948734311296:12345-192.168.202.4@tcp:3:cat.0 Request processed in 22242us (23271us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129577.264653:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8016 00002000:00100000:3.0:1746129577.264667:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f5:0x0] (2097152->3145727) req@ffff8800900f5f80 x1830948734311296/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:318/0 lens 488/440 e 0 to 0 dl 1746129588 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129577.264676:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800900f5f80 with x1830948734311296 ext(2097152->3145727) 00002000:00010000:3.0:1746129577.264683:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800900f5f80 00000100:00100000:2.0:1746129577.272328:0:31519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+30:1962:x1830948734311808:12345-192.168.202.4@tcp:3:cat.0 Request processed in 24343us (24794us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129577.272343:0:31519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8017 00002000:00100000:2.0:1746129577.272357:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f5:0x0] (2097152->3145727) req@ffff8800900f7480 x1830948734311808/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:318/0 lens 488/440 e 0 to 0 dl 1746129588 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129577.272367:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800900f7480 with x1830948734311808 ext(2097152->3145727) 00002000:00010000:2.0:1746129577.272373:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800900f7480 00000100:00100000:3.0:1746129577.274866:0:8417:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+17:1962:x1830948734312320:12345-192.168.202.4@tcp:3:cat.0 Request processed in 18138us (18750us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129577.274880:0:8417:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8019 00002000:00100000:3.0:1746129577.274893:0:8417:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->4194303) req@ffff8800900f6680 x1830948734312320/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:318/0 lens 488/440 e 0 to 0 dl 1746129588 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129577.274903:0:8417:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800900f6680 with x1830948734312320 ext(3145728->4194303) 00002000:00010000:3.0:1746129577.274909:0:8417:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800900f6680 00000100:00100000:0.0:1746129577.275561:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129577.275619:0:8417:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734312576 00000100:00100000:3.0:1746129577.275627:0:8417:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734312576 00002000:00100000:3.0:1746129577.275661:0:8417:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3ef:0x0] (4194304->5148671) req@ffff8800900f4380 x1830948734312576/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:318/0 lens 488/0 e 0 to 0 dl 1746129588 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129577.275668:0:8417:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800900f4380 with x1830948734312576 ext(4194304->5148671) 00002000:00010000:3.0:1746129577.275672:0:8417:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800900f4380 00000100:00100000:3.0:1746129577.275936:0:8417:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8020 00000100:00100000:3.0:1746129577.275943:0:8417:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ada2ffba-8920-4ecb-8068-68caa9806978+24:1963:x1830948734312576:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:2.0:1746129577.275992:0:8416:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+28:1962:x1830948734312064:12345-192.168.202.4@tcp:3:cat.0 Request processed in 19569us (19952us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129577.276001:0:8416:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8018 00002000:00100000:2.0:1746129577.276006:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3f5:0x0] (3145728->4194303) req@ffff8800900f5500 x1830948734312064/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:318/0 lens 488/440 e 0 to 0 dl 1746129588 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129577.276013:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800900f5500 with x1830948734312064 ext(3145728->4194303) 00002000:00010000:2.0:1746129577.276016:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800900f5500 00000100:00100000:1.0:1746129577.291267:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129577.291516:0:31519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734312832 00000100:00100000:0.0:1746129577.291526:0:31519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734312832 00002000:00100000:0.0:1746129577.291574:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3ef:0x0] (4194304->5148671) req@ffff88012cda5f80 x1830948734312832/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:318/0 lens 488/0 e 0 to 0 dl 1746129588 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129577.291590:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cda5f80 with x1830948734312832 ext(4194304->5148671) 00002000:00010000:0.0:1746129577.291596:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012cda5f80 00000100:00100000:0.0:1746129577.291631:0:31519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8021 00000100:00100000:0.0:1746129577.291638:0:31519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cda5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+17:1962:x1830948734312832:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:3.0:1746129577.292474:0:8417:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ada2ffba-8920-4ecb-8068-68caa9806978+24:1963:x1830948734312576:12345-192.168.202.4@tcp:3:cat.0 Request processed in 16526us (16911us total) trans 0 rc 954368/954368 00000100:00100000:3.0:1746129577.292485:0:8417:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8020 00002000:00100000:3.0:1746129577.292492:0:8417:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3ef:0x0] (4194304->5148671) req@ffff8800900f4380 x1830948734312576/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:318/0 lens 488/440 e 0 to 0 dl 1746129588 ref 1 fl Complete:/200/0 rc 954368/954368 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129577.292500:0:8417:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800900f4380 with x1830948734312576 ext(4194304->5148671) 00002000:00010000:3.0:1746129577.292505:0:8417:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800900f4380 00000100:00100000:2.0:1746129577.310713:0:31519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cda5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+17:1962:x1830948734312832:12345-192.168.202.4@tcp:3:cat.0 Request processed in 19060us (19456us total) trans 0 rc 954368/954368 00000100:00100000:2.0:1746129577.310726:0:31519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8021 00002000:00100000:2.0:1746129577.310738:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3ef:0x0] (4194304->5148671) req@ffff88012cda5f80 x1830948734312832/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:318/0 lens 488/440 e 0 to 0 dl 1746129588 ref 1 fl Complete:/200/0 rc 954368/954368 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129577.310747:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cda5f80 with x1830948734312832 ext(4194304->5148671) 00002000:00010000:2.0:1746129577.310753:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012cda5f80 00000100:00100000:0.0:1746129577.366473:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129577.367688:0:8410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734312960 00000100:00100000:2.0:1746129577.367700:0:8410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734312960 00000100:00100000:2.0:1746129577.367854:0:8410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16596 00000100:00100000:2.0:1746129577.367864:0:8410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b550e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+28:32512:x1830948734312960:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:2.0:1746129577.367885:0:8410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129577.367904:0:8410:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a6cafc00/0x40a459093b06b065 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21bc3 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129577.367936:0:8410:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b5263800/0x40a459093b06b057 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21bb5 expref: 29 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129577.367945:0:8410:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a6cae400/0x40a459093b06b05e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21bbc expref: 31 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129577.367953:0:8410:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129577.367955:0:8410:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129577.367958:0:8410:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6cafc00/0x40a459093b06b065 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [3764224->4194303] (req 3764224->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21bc3 expref: 29 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129577.367989:0:8410:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a6cae400/0x40a459093b06b05e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21bbc expref: 31 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129577.368002:0:8410:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a6cae400/0x40a459093b06b05e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21bbc expref: 31 pid: 8410 timeout: 932 lvb_type: 0 00000100:00100000:2.0:1746129577.368014:0:8410:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f44b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8410:1830948737581952:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129577.368887:0:8410:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b5263800/0x40a459093b06b057 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21bb5 expref: 29 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129577.368897:0:8410:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b5263800/0x40a459093b06b057 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21bb5 expref: 29 pid: 8410 timeout: 932 lvb_type: 0 00000100:00100000:2.0:1746129577.368906:0:8410:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f44bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8410:1830948737582080:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129577.368929:0:8410:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132f36840 going to sleep for 11 seconds 00000100:00100000:0.0:1746129577.376345:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129577.377013:0:8410:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f44bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8410:1830948737582080:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129577.377157:0:15096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734313088 00000100:00100000:3.0:1746129577.377165:0:15096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734313088 00000100:00100000:3.0:1746129577.377219:0:15096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11312 00000100:00100000:3.0:1746129577.377226:0:15096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b553100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:068dab75-d300-4ead-a742-d14572ad1e50+26:32517:x1830948734313088:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:3.0:1746129577.377253:0:15096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129577.377276:0:15096:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f890200/0x40a459093b06b06c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21bca expref: -99 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129577.377391:0:15096:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f890000/0x40a459093b06b073 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15096 initiator: MDT0 00010000:00010000:3.0:1746129577.377404:0:15096:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f890000/0x40a459093b06b073 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15096 initiator: MDT0 00010000:00010000:3.0:1746129577.377414:0:15096:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f890000/0x40a459093b06b073 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15096 initiator: MDT0 00010000:00010000:3.0:1746129577.377425:0:15096:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f890c00/0x40a459093b06b07a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15096 initiator: MDT0 00010000:00010000:3.0:1746129577.377430:0:15096:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f890c00/0x40a459093b06b07a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15096 initiator: MDT0 00010000:00010000:3.0:1746129577.377435:0:15096:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f890c00/0x40a459093b06b07a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15096 initiator: MDT0 00010000:00010000:3.0:1746129577.377542:0:15096:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f891400/0x40a459093b06b081 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 15096 initiator: MDT0 00010000:00010000:3.0:1746129577.377551:0:15096:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094c09a00/0x40a459093b06afb6 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21b37 expref: 31 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129577.377558:0:15096:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094bb3400/0x40a459093b06afe0 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21b45 expref: 319 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129577.377563:0:15096:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f891400/0x40a459093b06b081 lrc: 5/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x50210000000000 pid: 15096 initiator: MDT0 00010000:00010000:3.0:1746129577.377591:0:15096:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094bb3400/0x40a459093b06afe0 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21b45 expref: 319 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129577.377600:0:15096:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094bb3400/0x40a459093b06afe0 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21b45 expref: 319 pid: 15096 timeout: 932 lvb_type: 0 00000100:00100000:3.0:1746129577.377611:0:15096:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bed80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15096:1830948737582208:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129577.379863:0:15096:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094c09a00/0x40a459093b06afb6 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21b37 expref: 31 pid: 15096 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129577.379864:0:8410:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f44b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8410:1830948737581952:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129577.379876:0:15096:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094c09a00/0x40a459093b06afb6 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21b37 expref: 31 pid: 15096 timeout: 932 lvb_type: 0 00000100:00100000:3.0:1746129577.379888:0:15096:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bc000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15096:1830948737582336:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129577.379907:0:8410:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a6cafc00/0x40a459093b06b065 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [3764224->4194303] (req 3764224->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21bc3 expref: 29 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129577.379928:0:8410:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6cafc00, rc 0) 00000100:00100000:3.0:1746129577.379940:0:15096:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa3813c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746129577.379960:0:8410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b550e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+29:32512:x1830948734312960:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 12098us (13499us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129577.379969:0:8410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16596 00000100:00100000:1.0:1746129577.380602:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129577.380653:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734313216 00000100:00100000:2.0:1746129577.380659:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734313216 00010000:00010000:2.0:1746129577.380684:0:9823:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b5263800/0x40a459093b06b057 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21bb5 expref: 29 pid: 8410 timeout: 932 lvb_type: 0 00000100:00100000:2.0:1746129577.380757:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8552 00000100:00100000:2.0:1746129577.380765:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cda4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+29:1963:x1830948734313216:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129577.380777:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129577.380802:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b5263800/0x40a459093b06b057 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21bb5 expref: 29 pid: 8410 timeout: 932 lvb_type: 0 00010000:00010000:2.0:1746129577.380811:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b5263800/0x40a459093b06b057 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21bb5 expref: 29 pid: 8410 timeout: 932 lvb_type: 0 00010000:00010000:2.0:1746129577.380834:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b5263800/0x40a459093b06b057 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21bb5 expref: 29 pid: 8410 timeout: 932 lvb_type: 0 00010000:00010000:2.0:1746129577.381467:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129577.381512:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cda4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+28:1963:x1830948734313216:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 746us (910us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129577.381520:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8552 00000100:00100000:0.0:1746129577.384069:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129577.384128:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129577.384168:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129577.384216:0:15749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734313344 00000100:00100000:0.0:1746129577.384224:0:15749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734313344 00010000:00010000:0.0:1746129577.384273:0:15749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6cae400/0x40a459093b06b05e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21bbc expref: 32 pid: 8410 timeout: 932 lvb_type: 0 00000100:00100000:0.0:1746129577.384350:0:15749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734313600 00000100:00100000:0.0:1746129577.384355:0:15749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734313600 00010000:00010000:0.0:1746129577.384373:0:15749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094c09a00/0x40a459093b06afb6 lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21b37 expref: 32 pid: 15096 timeout: 932 lvb_type: 0 00000100:00100000:0.0:1746129577.384402:0:15749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734313472 00000100:00100000:0.0:1746129577.384407:0:15749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734313472 00010000:00010000:0.0:1746129577.384441:0:15749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094bb3400/0x40a459093b06afe0 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21b45 expref: 320 pid: 15096 timeout: 932 lvb_type: 0 00000100:00100000:0.0:1746129577.384464:0:15749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8553 00000100:00100000:0.0:1746129577.384472:0:15749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e954000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ada2ffba-8920-4ecb-8068-68caa9806978+32:1960:x1830948734313344:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129577.384494:0:15749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129577.384522:0:15749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a6cae400/0x40a459093b06b05e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21bbc expref: 32 pid: 8410 timeout: 932 lvb_type: 0 00010000:00010000:0.0:1746129577.384534:0:15749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a6cae400/0x40a459093b06b05e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21bbc expref: 32 pid: 8410 timeout: 932 lvb_type: 0 00010000:00010000:0.0:1746129577.384560:0:15749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a6cae400/0x40a459093b06b05e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21bbc expref: 32 pid: 8410 timeout: 932 lvb_type: 0 00010000:00010000:0.0:1746129577.384581:0:15749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129577.384584:0:15749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129577.384591:0:15749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a6cafc00/0x40a459093b06b065 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3764224->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21bc3 expref: 27 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129577.384601:0:15749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6cafc00/0x40a459093b06b065 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3764224->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21bc3 expref: 27 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129577.384641:0:15749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a6cafc00/0x40a459093b06b065 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3764224->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21bc3 expref: 27 pid: 8410 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129577.384656:0:15749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a77b0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15749:1830948737582464:192.168.202.4@tcp:105: 00000100:00100000:0.0:1746129577.384750:0:15749:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009cdf33c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129577.384776:0:7086:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8554 00000100:00100000:0.0:1746129577.384784:0:7086:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6026c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+32:1960:x1830948734313600:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129577.384794:0:7086:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129577.384802:0:7086:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094c09a00/0x40a459093b06afb6 lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21b37 expref: 32 pid: 15096 timeout: 932 lvb_type: 0 00010000:00010000:0.0:1746129577.384810:0:7086:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094c09a00/0x40a459093b06afb6 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21b37 expref: 32 pid: 15096 timeout: 932 lvb_type: 0 00010000:00010000:0.0:1746129577.384826:0:7086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:0.0:1746129577.384831:0:7086:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f891400/0x40a459093b06b081 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x50210000000000 pid: 15096 initiator: MDT0 00010000:00010000:0.0:1746129577.384839:0:7086:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f891400/0x40a459093b06b081 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x50210000000000 pid: 15096 initiator: MDT0 00010000:00010000:0.0:1746129577.384844:0:7086:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f891400/0x40a459093b06b081 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x50210000000000 pid: 15096 initiator: MDT0 00010000:00010000:0.0:1746129577.384849:0:7086:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129577.384876:0:7086:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6026c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+32:1960:x1830948734313600:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 92us (747us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129577.384883:0:7086:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8554 00000100:00100000:0.0:1746129577.384907:0:7086:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8555 00000100:00100000:0.0:1746129577.384913:0:7086:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e957b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ada2ffba-8920-4ecb-8068-68caa9806978+320:1960:x1830948734313472:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129577.384921:0:7086:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129577.384925:0:7086:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094bb3400/0x40a459093b06afe0 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21b45 expref: 320 pid: 15096 timeout: 932 lvb_type: 0 00010000:00010000:0.0:1746129577.384935:0:7086:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094bb3400/0x40a459093b06afe0 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21b45 expref: 320 pid: 15096 timeout: 932 lvb_type: 0 00010000:00010000:0.0:1746129577.384947:0:7086:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094bb3400/0x40a459093b06afe0 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21b45 expref: 320 pid: 15096 timeout: 932 lvb_type: 0 00010000:00010000:0.0:1746129577.384960:0:7086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:0.0:1746129577.384963:0:7086:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f891400/0x40a459093b06b081 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x50210000000000 pid: 15096 initiator: MDT0 00010000:00010000:0.0:1746129577.384969:0:7086:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f891400/0x40a459093b06b081 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x50290000000000 pid: 15096 initiator: MDT0 00010000:00010000:0.0:1746129577.384975:0:7086:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f891400/0x40a459093b06b081 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x50290000000000 pid: 15096 initiator: MDT0 00010000:00010000:0.0:1746129577.384990:0:7086:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129577.385011:0:7086:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e957b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ada2ffba-8920-4ecb-8068-68caa9806978+319:1960:x1830948734313472:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 97us (843us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129577.385017:0:7086:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8555 00000100:00080000:0.0:1746129577.385066:0:7097:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746129577.385464:0:15096:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bed80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15096:1830948737582208:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129577.385501:0:15096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094c09a00/0x40a459093b06afb6 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21b37 expref: 31 pid: 15096 timeout: 932 lvb_type: 0 00000100:00100000:3.0:1746129577.385521:0:15096:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bc000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15096:1830948737582336:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129577.385545:0:15096:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012f891400/0x40a459093b06b081 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15096 initiator: MDT0 00010000:00010000:3.0:1746129577.385554:0:15096:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012f891400/0x40a459093b06b081 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15096 initiator: MDT0 00010000:00010000:3.0:1746129577.385559:0:15096:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f891400/0x40a459093b06b081 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15096 initiator: MDT0 00000004:00200000:3.0:1746129577.385608:0:15096:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00000004:00200000:3.0:1746129577.385613:0:15096:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746129577.385632:0:15096:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012f891400/0x40a459093b06b081 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15096 initiator: MDT0 00010000:00010000:3.0:1746129577.385641:0:15096:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f891400/0x40a459093b06b081 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 15096 initiator: MDT0 00010000:00010000:3.0:1746129577.385651:0:15096:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f890000/0x40a459093b06b073 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15096 initiator: MDT0 00010000:00010000:3.0:1746129577.385657:0:15096:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f890000/0x40a459093b06b073 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15096 initiator: MDT0 00010000:00010000:3.0:1746129577.385663:0:15096:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012f890000/0x40a459093b06b073 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15096 initiator: MDT0 00010000:00010000:3.0:1746129577.385669:0:15096:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f890000 already unused, calling callback (ffffffffa136e690) 00010000:00010000:3.0:1746129577.385672:0:15096:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f890000/0x40a459093b06b073 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15096 initiator: MDT0 00010000:00010000:3.0:1746129577.385682:0:15096:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f890000/0x40a459093b06b073 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15096 initiator: MDT0 00010000:00010000:3.0:1746129577.385691:0:15096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880132ef8f00) 00010000:00010000:3.0:1746129577.385694:0:15096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129577.385697:0:15096:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012f890000/0x40a459093b06b073 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15096 initiator: MDT0 00010000:00010000:3.0:1746129577.385701:0:15096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f890000/0x40a459093b06b073 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15096 initiator: MDT0 00010000:00010000:3.0:1746129577.385711:0:15096:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f890c00/0x40a459093b06b07a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15096 initiator: MDT0 00010000:00010000:3.0:1746129577.385716:0:15096:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f890c00/0x40a459093b06b07a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15096 initiator: MDT0 00010000:00010000:3.0:1746129577.385720:0:15096:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012f890c00/0x40a459093b06b07a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15096 initiator: MDT0 00010000:00010000:3.0:1746129577.385724:0:15096:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f890c00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:3.0:1746129577.385726:0:15096:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f890c00/0x40a459093b06b07a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15096 initiator: MDT0 00010000:00010000:3.0:1746129577.385731:0:15096:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f890c00/0x40a459093b06b07a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15096 initiator: MDT0 00010000:00010000:3.0:1746129577.385738:0:15096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f727b00) 00010000:00010000:3.0:1746129577.385740:0:15096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129577.385742:0:15096:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012f890c00/0x40a459093b06b07a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15096 initiator: MDT0 00010000:00010000:3.0:1746129577.385747:0:15096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f890c00/0x40a459093b06b07a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15096 initiator: MDT0 00010000:00010000:3.0:1746129577.385798:0:15096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f890200/0x40a459093b06b06c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21bca expref: 28 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129577.385811:0:15096:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f891400/0x40a459093b06b081 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21bca expref: 27 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129577.385818:0:15096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:3.0:1746129577.385819:0:15096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746129577.385822:0:15096:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f891400, rc 0) 00000100:00100000:3.0:1746129577.385861:0:15096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b553100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:068dab75-d300-4ead-a742-d14572ad1e50+27:32517:x1830948734313088:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 8633us (9570us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129577.385868:0:15096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11312 00000100:00100000:2.0:1746129577.389941:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129577.390555:0:8410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734313728 00000100:00100000:0.0:1746129577.390563:0:8410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734313728 00000100:00100000:0.0:1746129577.390613:0:8410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16597 00000100:00100000:0.0:1746129577.390620:0:8410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f44b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:068dab75-d300-4ead-a742-d14572ad1e50+5:1961:x1830948734313728:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:0.0:1746129577.390638:0:8410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129577.390654:0:8410:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136b1c400/0x40a459093b06b088 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21bd1 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129577.390676:0:8410:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129577.390677:0:8410:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129577.390687:0:8410:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136b1c400/0x40a459093b06b088 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21bd1 expref: 6 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129577.390703:0:8410:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880136b1c400/0x40a459093b06b088 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21bd1 expref: 6 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129577.390719:0:8410:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136b1c400, rc 0) 00000100:00100000:2.0:1746129577.390720:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129577.390745:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734313856 00000100:00100000:2.0:1746129577.390751:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734313856 00000100:00100000:0.0:1746129577.390763:0:8410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f44b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:068dab75-d300-4ead-a742-d14572ad1e50+6:1961:x1830948734313728:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 143us (834us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129577.390768:0:8410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16597 00000100:00100000:2.0:1746129577.390788:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16598 00000100:00100000:2.0:1746129577.390980:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f44bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:068dab75-d300-4ead-a742-d14572ad1e50+5:1961:x1830948734313856:12345-192.168.202.4@tcp:101:lfs.0 00000100:00080000:0.0:1746129577.390986:0:7097:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1746129577.390990:0:7148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:0.0:1746129577.390990:0:7097:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1746129577.391004:0:7148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a77f6e00/0x40a459093b06b08f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21bd8 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129577.391018:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129577.391020:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129577.391026:0:7148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a77f6e00/0x40a459093b06b08f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21bd8 expref: 6 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129577.391038:0:7148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a77f6e00/0x40a459093b06b08f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21bd8 expref: 6 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129577.391046:0:7148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a77f6e00, rc 0) 00000100:00100000:2.0:1746129577.391072:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f44bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:068dab75-d300-4ead-a742-d14572ad1e50+6:1961:x1830948734313856:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 96us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129577.391078:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16598 00000100:00100000:2.0:1746129577.391123:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129577.391144:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734313984 00000100:00100000:2.0:1746129577.391148:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734313984 00000100:00100000:2.0:1746129577.391171:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16599 00000100:00100000:2.0:1746129577.391178:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f44b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:068dab75-d300-4ead-a742-d14572ad1e50+6:1961:x1830948734313984:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:2.0:1746129577.391186:0:7148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129577.391196:0:7148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f119000/0x40a459093b06b096 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21bdf expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129577.391211:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129577.391212:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129577.391217:0:7148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f119000/0x40a459093b06b096 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21bdf expref: 7 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129577.391227:0:7148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f119000/0x40a459093b06b096 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21bdf expref: 7 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129577.391235:0:7148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f119000, rc 0) 00000100:00100000:2.0:1746129577.391269:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f44b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:068dab75-d300-4ead-a742-d14572ad1e50+7:1961:x1830948734313984:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 79us (134us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129577.391275:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16599 00000100:00100000:2.0:1746129577.391346:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129577.391364:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734314112 00000100:00100000:2.0:1746129577.391368:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734314112 00000100:00100000:0.0:1746129577.391451:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129577.391462:0:15749:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a77b0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15749:1830948737582464:192.168.202.4@tcp:105: 00000100:00100000:0.0:1746129577.391464:0:11014:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734314240 00000100:00100000:0.0:1746129577.391466:0:11014:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734314240 00000100:00100000:0.0:1746129577.391483:0:11014:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16600 00010000:00010000:1.0:1746129577.391485:0:15749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129577.391488:0:11014:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a77b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:068dab75-d300-4ead-a742-d14572ad1e50+7:1961:x1830948734314240:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:0.0:1746129577.391495:0:11014:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129577.391503:0:11014:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136b1ca00/0x40a459093b06b09d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21bed expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129577.391505:0:15749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e954000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ada2ffba-8920-4ecb-8068-68caa9806978+31:1960:x1830948734313344:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 7034us (7448us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129577.391513:0:15749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8553 00010000:00010000:0.0:1746129577.391513:0:11014:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129577.391514:0:11014:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129577.391519:0:11014:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136b1ca00/0x40a459093b06b09d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21bed expref: 8 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129577.391528:0:11014:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880136b1ca00/0x40a459093b06b09d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21bed expref: 8 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129577.391534:0:11014:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136b1ca00, rc 0) 00000100:00100000:0.0:1746129577.391548:0:11014:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a77b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:068dab75-d300-4ead-a742-d14572ad1e50+8:1961:x1830948734314240:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 60us (98us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129577.391556:0:11014:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16600 00000100:00100000:1.0:1746129577.391602:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129577.391646:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129577.391670:0:31519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734314624 00000100:00100000:1.0:1746129577.391673:0:31519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734314624 00002000:00100000:1.0:1746129577.391701:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f5:0x0] (3764224->3768319) req@ffff88012cda4000 x1830948734314624/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:318/0 lens 488/0 e 0 to 0 dl 1746129588 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129577.391710:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cda4000 with x1830948734314624 ext(3764224->3768319) 00002000:00010000:1.0:1746129577.391714:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012cda4000 00000100:00100000:1.0:1746129577.391728:0:31519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8022 00000100:00100000:1.0:1746129577.391734:0:31519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cda4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+28:1960:x1830948734314624:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:1.0:1746129577.391865:0:31519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cda4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+28:1960:x1830948734314624:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 131us (218us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746129577.391870:0:31519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8022 00002000:00100000:1.0:1746129577.391874:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f5:0x0] (3764224->3768319) req@ffff88012cda4000 x1830948734314624/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:318/0 lens 488/4536 e 0 to 0 dl 1746129588 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129577.391881:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cda4000 with x1830948734314624 ext(3764224->3768319) 00002000:00010000:1.0:1746129577.391884:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012cda4000 00000100:00100000:3.0:1746129577.392178:0:22480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734314368 00000100:00100000:3.0:1746129577.392185:0:22480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734314368 00000100:00100000:3.0:1746129577.392213:0:22480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16601 00000100:00100000:3.0:1746129577.392220:0:22480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c29f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:068dab75-d300-4ead-a742-d14572ad1e50+7:1961:x1830948734314368:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:3.0:1746129577.392228:0:22480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129577.392237:0:22480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f891a00/0x40a459093b06b0a4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21bf4 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129577.392307:0:22480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22480:1830948737582592:192.168.202.4@tcp:106: 00000100:00100000:3.0:1746129577.392371:0:22480:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa3813c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746129577.392627:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16602 00000100:00100000:2.0:1746129577.392633:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013145d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:068dab75-d300-4ead-a742-d14572ad1e50+7:1961:x1830948734314112:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:2.0:1746129577.392639:0:7148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129577.392646:0:7148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a6caf000/0x40a459093b06b0ab lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21be6 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129577.392657:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129577.392659:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129577.392664:0:7148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6caf000/0x40a459093b06b0ab lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21be6 expref: 8 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129577.392677:0:7148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a6caf000/0x40a459093b06b0ab lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21be6 expref: 8 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129577.392684:0:7148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6caf000, rc 0) 00000100:00100000:2.0:1746129577.392711:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013145d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:068dab75-d300-4ead-a742-d14572ad1e50+8:1961:x1830948734314112:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 78us (1366us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129577.392716:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16602 00002000:00010000:3.0:1746129577.397033:0:22480:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3f5:0x0] updating lvb mtime: 1746129577 -> 1746129578 00002000:00010000:3.0:1746129577.397045:0:22480:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3f5:0x0] updating lvb atime: 1746129577 -> 1746129578 00002000:00010000:3.0:1746129577.397047:0:22480:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3f5:0x0] updating lvb ctime: 1746129577 -> 1746129578 00000100:00100000:3.0:1746129577.397078:0:22480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22480:1830948737582592:192.168.202.4@tcp:106: 00010000:00010000:3.0:1746129577.397120:0:22480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f891a00/0x40a459093b06b0a4 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21bf4 expref: 8 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129577.397137:0:22480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f891a00/0x40a459093b06b0a4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21bf4 expref: 8 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129577.397156:0:22480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f891a00, rc 0) 00000100:00100000:3.0:1746129577.397949:0:22480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c29f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:068dab75-d300-4ead-a742-d14572ad1e50+7:1961:x1830948734314368:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 5724us (6341us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129577.397959:0:22480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16601 00000100:00100000:0.0:1746129577.398345:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129577.398376:0:8410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734314752 00000100:00100000:0.0:1746129577.398383:0:8410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734314752 00000100:00100000:0.0:1746129577.398433:0:8410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16603 00000100:00100000:0.0:1746129577.398440:0:8410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a77b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+17:32512:x1830948734314752:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:0.0:1746129577.398455:0:8410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129577.398469:0:8410:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136b1d000/0x40a459093b06b0b2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21bfb expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129577.398493:0:8410:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d306800/0x40a459093b06b049 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21ba7 expref: 18 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129577.398501:0:8410:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880136b1ca00/0x40a459093b06b09d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21bed expref: 7 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129577.398507:0:8410:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d306a00/0x40a459093b06b050 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21bae expref: 23 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129577.398513:0:8410:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129577.398517:0:8410:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129577.398520:0:8410:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136b1d000/0x40a459093b06b0b2 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [4194304->4808703] (req 4194304->4808703) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21bfb expref: 18 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129577.398874:0:8410:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009d306a00/0x40a459093b06b050 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21bae expref: 23 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129577.398894:0:8410:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009d306a00/0x40a459093b06b050 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21bae expref: 23 pid: 11014 timeout: 932 lvb_type: 0 00000100:00100000:1.0:1746129577.398906:0:8410:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cda6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8410:1830948737582720:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129577.398987:0:8410:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880136b1ca00/0x40a459093b06b09d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21bed expref: 7 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129577.398996:0:8410:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880136b1ca00/0x40a459093b06b09d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21bed expref: 7 pid: 11014 timeout: 932 lvb_type: 1 00000100:00100000:1.0:1746129577.399004:0:8410:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cda7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8410:1830948737582848:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129577.399031:0:8410:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009d306800/0x40a459093b06b049 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21ba7 expref: 18 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129577.399038:0:8410:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009d306800/0x40a459093b06b049 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21ba7 expref: 18 pid: 11014 timeout: 932 lvb_type: 0 00000100:00100000:1.0:1746129577.399046:0:8410:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cda5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8410:1830948737582976:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129577.399060:0:8410:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0acb40 going to sleep for 11 seconds 00000100:00100000:0.0:1746129577.400620:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129577.401648:0:15096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734315008 00000100:00100000:1.0:1746129577.401652:0:8410:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cda6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8410:1830948737582720:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129577.401655:0:15096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734315008 00000100:00100000:1.0:1746129577.401663:0:8410:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cda7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8410:1830948737582848:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129577.401669:0:8410:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cda5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8410:1830948737582976:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129577.401698:0:8410:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880136b1d000/0x40a459093b06b0b2 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [4194304->4808703] (req 4194304->4808703) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21bfb expref: 18 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129577.401716:0:8410:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136b1d000, rc 0) 00000100:00100000:3.0:1746129577.402153:0:15096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11313 00000100:00100000:3.0:1746129577.402161:0:15096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a77b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:068dab75-d300-4ead-a742-d14572ad1e50+27:32517:x1830948734315008:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:3.0:1746129577.402177:0:15096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129577.402193:0:15096:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f890400/0x40a459093b06b0b9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21c02 expref: -99 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129577.402415:0:15096:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f891800/0x40a459093b06b0c0 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 15096 initiator: MDT0 00010000:00010000:3.0:1746129577.402430:0:15096:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f891400/0x40a459093b06b081 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21bca expref: 28 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129577.402437:0:15096:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f891800/0x40a459093b06b0c0 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 15096 initiator: MDT0 00010000:00010000:3.0:1746129577.402467:0:15096:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012f891400/0x40a459093b06b081 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21bca expref: 28 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129577.402478:0:15096:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f891400/0x40a459093b06b081 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21bca expref: 28 pid: 15096 timeout: 932 lvb_type: 0 00000100:00100000:3.0:1746129577.402490:0:15096:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bd500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15096:1830948737583104:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129577.402590:0:8410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a77b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+18:32512:x1830948734314752:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 4149us (4246us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129577.402598:0:8410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16603 00000100:00100000:3.0:1746129577.402921:0:15096:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa3813c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746129577.404012:0:15096:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bd500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15096:1830948737583104:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129577.404028:0:15096:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012f891800/0x40a459093b06b0c0 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 15096 initiator: MDT0 00000100:00100000:0.0:1746129577.404411:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129577.404452:0:15749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734315264 00000100:00100000:1.0:1746129577.404459:0:15749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734315264 00010000:00010000:1.0:1746129577.404485:0:15749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f891400/0x40a459093b06b081 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21bca expref: 29 pid: 15096 timeout: 932 lvb_type: 0 00000100:00100000:1.0:1746129577.404518:0:15749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8556 00000100:00100000:1.0:1746129577.404526:0:15749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a77b1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:068dab75-d300-4ead-a742-d14572ad1e50+29:1960:x1830948734315264:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129577.404537:0:15749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129577.404542:0:15749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012f891400/0x40a459093b06b081 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21bca expref: 29 pid: 15096 timeout: 932 lvb_type: 0 00010000:00010000:1.0:1746129577.404551:0:15749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012f891400/0x40a459093b06b081 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21bca expref: 29 pid: 15096 timeout: 932 lvb_type: 0 00010000:00010000:1.0:1746129577.404569:0:15749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f891400/0x40a459093b06b081 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21bca expref: 29 pid: 15096 timeout: 932 lvb_type: 0 00010000:00010000:1.0:1746129577.404735:0:15749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:1.0:1746129577.404739:0:15749:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f891800/0x40a459093b06b0c0 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 15096 initiator: MDT0 00010000:00010000:1.0:1746129577.404752:0:15749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f891800/0x40a459093b06b0c0 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 15096 initiator: MDT0 00010000:00010000:1.0:1746129577.404758:0:15749:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f891800/0x40a459093b06b0c0 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 15096 initiator: MDT0 00010000:00010000:1.0:1746129577.404782:0:15749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129577.404812:0:15749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a77b1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:068dab75-d300-4ead-a742-d14572ad1e50+28:1960:x1830948734315264:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 286us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129577.404818:0:15749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8556 00010000:00010000:3.0:1746129577.404981:0:15096:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012f891800/0x40a459093b06b0c0 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15096 initiator: MDT0 00010000:00010000:3.0:1746129577.404988:0:15096:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f891800/0x40a459093b06b0c0 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15096 initiator: MDT0 00000004:00200000:3.0:1746129577.405006:0:15096:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:3.0:1746129577.405148:0:15096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f890400/0x40a459093b06b0b9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21c02 expref: 29 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129577.405163:0:15096:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f891800/0x40a459093b06b0c0 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21c02 expref: 28 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129577.405170:0:15096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:3.0:1746129577.405173:0:15096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746129577.405175:0:15096:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f891800, rc 0) 00000100:00100000:3.0:1746129577.405200:0:15096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a77b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:068dab75-d300-4ead-a742-d14572ad1e50+28:32517:x1830948734315008:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 3040us (4587us total) trans 8589945428 rc 0/0 00000100:00100000:3.0:1746129577.405210:0:15096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11313 00000100:00100000:0.0:1746129577.407247:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129577.407321:0:15749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734315136 00000100:00100000:0.0:1746129577.407323:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129577.407329:0:15749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734315136 00000100:00100000:0.0:1746129577.407356:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00010000:00010000:1.0:1746129577.407359:0:15749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880136b1ca00/0x40a459093b06b09d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21bed expref: 8 pid: 11014 timeout: 932 lvb_type: 1 00000100:00100000:3.0:1746129577.407505:0:15096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734315648 00000100:00100000:3.0:1746129577.407509:0:15096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734315648 00000100:00100000:1.0:1746129577.407611:0:15749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734315520 00000100:00100000:1.0:1746129577.407614:0:15749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734315520 00000100:00100000:0.0:1746129577.407618:0:7087:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8557 00010000:00010000:1.0:1746129577.407625:0:15749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009d306a00/0x40a459093b06b050 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21bae expref: 24 pid: 11014 timeout: 932 lvb_type: 0 00000100:00100000:0.0:1746129577.407626:0:7087:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a77b0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:068dab75-d300-4ead-a742-d14572ad1e50+8:1963:x1830948734315136:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129577.407639:0:7087:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746129577.407641:0:15749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8558 00000100:00100000:1.0:1746129577.407645:0:15749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a77b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ada2ffba-8920-4ecb-8068-68caa9806978+24:1963:x1830948734315520:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129577.407650:0:15749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129577.407661:0:15749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009d306a00/0x40a459093b06b050 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21bae expref: 24 pid: 11014 timeout: 932 lvb_type: 0 00010000:00010000:0.0:1746129577.407661:0:7087:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880136b1ca00/0x40a459093b06b09d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21bed expref: 8 pid: 11014 timeout: 932 lvb_type: 1 00010000:00010000:0.0:1746129577.407670:0:7087:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880136b1ca00/0x40a459093b06b09d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21bed expref: 8 pid: 11014 timeout: 932 lvb_type: 1 00010000:00010000:1.0:1746129577.407677:0:15749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009d306a00/0x40a459093b06b050 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21bae expref: 24 pid: 11014 timeout: 932 lvb_type: 0 00010000:00010000:0.0:1746129577.407701:0:7087:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136b1ca00/0x40a459093b06b09d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21bed expref: 8 pid: 11014 timeout: 932 lvb_type: 1 00010000:00010000:1.0:1746129577.407705:0:15749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d306a00/0x40a459093b06b050 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21bae expref: 24 pid: 11014 timeout: 932 lvb_type: 0 00010000:00010000:1.0:1746129577.407717:0:15749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746129577.407721:0:7087:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129577.407755:0:7087:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a77b0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:068dab75-d300-4ead-a742-d14572ad1e50+7:1963:x1830948734315136:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 130us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129577.407761:0:7087:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8557 00000100:00100000:3.0:1746129577.408008:0:15096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11314 00000100:00100000:3.0:1746129577.408017:0:15096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a77b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:068dab75-d300-4ead-a742-d14572ad1e50+28:32517:x1830948734315648:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:3.0:1746129577.408038:0:15096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129577.408052:0:15096:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f890200/0x40a459093b06b0ce lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21c09 expref: -99 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129577.408124:0:15096:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f890c00/0x40a459093b06b0d5 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 15096 initiator: MDT0 00010000:00010000:3.0:1746129577.408136:0:15096:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f891800/0x40a459093b06b0c0 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21c02 expref: 29 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129577.408143:0:15096:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f890c00/0x40a459093b06b0d5 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x50210000000000 pid: 15096 initiator: MDT0 00010000:00010000:3.0:1746129577.408170:0:15096:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012f891800/0x40a459093b06b0c0 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21c02 expref: 29 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129577.408181:0:15096:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f891800/0x40a459093b06b0c0 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21c02 expref: 29 pid: 15096 timeout: 932 lvb_type: 0 00000100:00100000:3.0:1746129577.408192:0:15096:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bd500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15096:1830948737583232:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129577.408240:0:15096:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa3813c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746129577.408620:0:15749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a77b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ada2ffba-8920-4ecb-8068-68caa9806978+23:1963:x1830948734315520:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 971us (1260us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129577.408627:0:15749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8558 00000100:00100000:0.0:1746129577.408731:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129577.408772:0:20578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734315392 00000100:00100000:1.0:1746129577.408777:0:20578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734315392 00010000:00010000:1.0:1746129577.408792:0:20578:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009d306800/0x40a459093b06b049 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21ba7 expref: 18 pid: 11014 timeout: 932 lvb_type: 0 00000100:00100000:1.0:1746129577.408865:0:20578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8559 00000100:00100000:1.0:1746129577.408871:0:20578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a77b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+18:1963:x1830948734315392:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129577.408879:0:20578:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129577.408892:0:20578:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009d306800/0x40a459093b06b049 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21ba7 expref: 18 pid: 11014 timeout: 932 lvb_type: 0 00010000:00010000:1.0:1746129577.408900:0:20578:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009d306800/0x40a459093b06b049 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21ba7 expref: 18 pid: 11014 timeout: 932 lvb_type: 0 00010000:00010000:1.0:1746129577.408914:0:20578:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d306800/0x40a459093b06b049 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21ba7 expref: 18 pid: 11014 timeout: 932 lvb_type: 0 00010000:00010000:1.0:1746129577.408924:0:20578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129577.408926:0:20578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129577.408932:0:20578:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880136b1d000/0x40a459093b06b0b2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4808703) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21bfb expref: 17 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129577.408938:0:20578:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136b1d000/0x40a459093b06b0b2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4808703) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21bfb expref: 17 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129577.408960:0:20578:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880136b1d000/0x40a459093b06b0b2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4808703) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21bfb expref: 17 pid: 8410 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129577.408969:0:20578:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cda5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:20578:1830948737583360:192.168.202.4@tcp:105: 00000100:00100000:0.0:1746129577.409417:0:20578:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0acb40 going to sleep for 11 seconds 00000100:00100000:3.0:1746129577.410575:0:15096:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bd500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15096:1830948737583232:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129577.410599:0:15096:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012f890c00/0x40a459093b06b0d5 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 15096 initiator: MDT0 00000100:00100000:0.0:1746129577.411943:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129577.412276:0:15749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734315776 00000100:00100000:2.0:1746129577.412285:0:15749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734315776 00010000:00010000:2.0:1746129577.412354:0:15749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f891800/0x40a459093b06b0c0 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21c02 expref: 30 pid: 15096 timeout: 932 lvb_type: 0 00000100:00100000:2.0:1746129577.412396:0:15749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8560 00000100:00100000:2.0:1746129577.412404:0:15749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c079f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:068dab75-d300-4ead-a742-d14572ad1e50+30:1962:x1830948734315776:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129577.412418:0:15749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129577.412423:0:15749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012f891800/0x40a459093b06b0c0 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21c02 expref: 30 pid: 15096 timeout: 932 lvb_type: 0 00010000:00010000:2.0:1746129577.412434:0:15749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012f891800/0x40a459093b06b0c0 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21c02 expref: 30 pid: 15096 timeout: 932 lvb_type: 0 00010000:00010000:2.0:1746129577.413011:0:15749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f891800/0x40a459093b06b0c0 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21c02 expref: 30 pid: 15096 timeout: 932 lvb_type: 0 00010000:00010000:2.0:1746129577.413036:0:15749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:2.0:1746129577.413041:0:15749:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f890c00/0x40a459093b06b0d5 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129577.413052:0:15749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f890c00/0x40a459093b06b0d5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129577.413059:0:15749:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f890c00/0x40a459093b06b0d5 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129577.413086:0:15749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129577.413134:0:15749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c079f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:068dab75-d300-4ead-a742-d14572ad1e50+29:1962:x1830948734315776:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 731us (1197us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129577.413141:0:15749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8560 00010000:00010000:3.0:1746129577.413199:0:15096:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012f890c00/0x40a459093b06b0d5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 15096 initiator: MDT0 00010000:00010000:3.0:1746129577.413207:0:15096:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f890c00/0x40a459093b06b0d5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 15096 initiator: MDT0 00000004:00200000:3.0:1746129577.413268:0:15096:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00000004:00200000:3.0:1746129577.413272:0:15096:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746129577.413288:0:15096:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012f890c00/0x40a459093b06b0d5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 15096 initiator: MDT0 00010000:00010000:3.0:1746129577.413355:0:15096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f890200/0x40a459093b06b0ce lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21c09 expref: 29 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129577.413370:0:15096:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f890c00/0x40a459093b06b0d5 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21c09 expref: 28 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129577.413376:0:15096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:3.0:1746129577.413378:0:15096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746129577.413380:0:15096:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f890c00, rc 0) 00000100:00100000:3.0:1746129577.413408:0:15096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a77b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:068dab75-d300-4ead-a742-d14572ad1e50+28:32517:x1830948734315648:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 5393us (6084us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129577.413414:0:15096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11314 00000100:00100000:2.0:1746129577.413679:0:20578:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cda5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:20578:1830948737583360:192.168.202.4@tcp:105: 00010000:00010000:2.0:1746129577.413932:0:20578:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129577.414223:0:20578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a77b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+17:1963:x1830948734315392:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 5349us (5489us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129577.414231:0:20578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8559 00000100:00100000:0.0:1746129577.415590:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129577.415625:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129577.415636:0:8410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734315904 00000100:00100000:1.0:1746129577.415643:0:8410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734315904 00000100:00100000:1.0:1746129577.415681:0:8410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734316032 00000100:00100000:1.0:1746129577.415683:0:8410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734316032 00000100:00100000:1.0:1746129577.415728:0:8410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16604 00000100:00100000:1.0:1746129577.415736:0:8410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c078380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:068dab75-d300-4ead-a742-d14572ad1e50+7:1960:x1830948734315904:12345-192.168.202.4@tcp:101:lfs.0 00000100:00100000:2.0:1746129577.415737:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16605 00000100:00100000:2.0:1746129577.415744:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009507d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:068dab75-d300-4ead-a742-d14572ad1e50+7:1960:x1830948734316032:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:2.0:1746129577.415751:0:7148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129577.415751:0:8410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129577.415768:0:7148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a6cae400/0x40a459093b06b0dc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21c17 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129577.415768:0:8410:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c47d400/0x40a459093b06b0e3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21c10 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129577.415811:0:7148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013145ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:7148:1830948737583488:192.168.202.4@tcp:106: 00000100:00100000:1.0:1746129577.415811:0:8410:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cda7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8410:1830948737583616:192.168.202.4@tcp:106: 00000100:00100000:1.0:1746129577.415948:0:8410:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0ac900 going to sleep for 11 seconds 00000100:00100000:2.0:1746129577.416014:0:7148:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132f36840 going to sleep for 11 seconds 00000100:00100000:2.0:1746129577.418222:0:7148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013145ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:7148:1830948737583488:192.168.202.4@tcp:106: 00002000:00010000:1.0:1746129577.418226:0:8410:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb mtime: 1746129577 -> 1746129578 00002000:00010000:1.0:1746129577.418229:0:8410:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb atime: 1746129577 -> 1746129578 00002000:00010000:1.0:1746129577.418231:0:8410:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb ctime: 1746129577 -> 1746129578 00000100:00100000:1.0:1746129577.418244:0:8410:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cda7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8410:1830948737583616:192.168.202.4@tcp:106: 00010000:00010000:2.0:1746129577.418277:0:7148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a6cae400/0x40a459093b06b0dc lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21c17 expref: 8 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129577.418277:0:8410:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c47d400/0x40a459093b06b0e3 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21c10 expref: 8 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129577.418291:0:8410:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c47d400/0x40a459093b06b0e3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21c10 expref: 8 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129577.418292:0:7148:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a6cae400/0x40a459093b06b0dc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21c17 expref: 8 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129577.418327:0:7148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6cae400, rc 0) 00010000:00010000:1.0:1746129577.418327:0:8410:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c47d400, rc 0) 00000100:00100000:2.0:1746129577.418372:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009507d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:068dab75-d300-4ead-a742-d14572ad1e50+7:1960:x1830948734316032:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 2628us (2744us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129577.418381:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16605 00000100:00100000:1.0:1746129577.418457:0:8410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c078380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:068dab75-d300-4ead-a742-d14572ad1e50+7:1960:x1830948734315904:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 2721us (2869us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129577.418462:0:8410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16604 00000100:00100000:0.0:1746129577.420215:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129577.420328:0:8417:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734316288 00000100:00100000:3.0:1746129577.420337:0:8417:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734316288 00002000:00100000:3.0:1746129577.420388:0:8417:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3ef:0x0] (4804608->4808703) req@ffff88009507e300 x1830948734316288/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:318/0 lens 488/0 e 0 to 0 dl 1746129588 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129577.420398:0:8417:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009507e300 with x1830948734316288 ext(4804608->4808703) 00002000:00010000:3.0:1746129577.420403:0:8417:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009507e300 00000100:00100000:3.0:1746129577.420442:0:8417:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8023 00000100:00100000:3.0:1746129577.420450:0:8417:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009507e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+17:1961:x1830948734316288:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:0.0:1746129577.420938:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129577.421015:0:15096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734316544 00000100:00100000:2.0:1746129577.421020:0:15096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734316544 00000100:00100000:2.0:1746129577.421051:0:15096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11315 00000100:00100000:2.0:1746129577.421056:0:15096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009507f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:068dab75-d300-4ead-a742-d14572ad1e50+28:32517:x1830948734316544:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:2.0:1746129577.421068:0:15096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129577.421086:0:15096:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6cae600/0x40a459093b06b0ea lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21c1e expref: -99 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129577.421176:0:15096:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880135a35000/0x40a459093b06b0f1 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129577.421191:0:15096:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135a35000/0x40a459093b06b0f1 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129577.421202:0:15096:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135a35000/0x40a459093b06b0f1 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129577.421213:0:15096:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880135a35000/0x40a459093b06b0f1 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129577.421219:0:15096:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135a35000/0x40a459093b06b0f1 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129577.421225:0:15096:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135a35000/0x40a459093b06b0f1 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129577.421230:0:15096:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135a35000 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746129577.421234:0:15096:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135a35000/0x40a459093b06b0f1 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129577.421240:0:15096:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135a35000/0x40a459093b06b0f1 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40218400000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129577.421250:0:15096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:2.0:1746129577.421252:0:15096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746129577.421268:0:15096:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135a35000/0x40a459093b06b0f1 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129577.421274:0:15096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135a35000/0x40a459093b06b0f1 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129577.421325:0:15096:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6cae600/0x40a459093b06b0ea lrc: 1/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21c1e expref: 29 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129577.421332:0:15096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6cae600/0x40a459093b06b0ea lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21c1e expref: 29 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129577.421340:0:15096:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6cae600, rc 0) 00000100:00100000:2.0:1746129577.421384:0:15096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009507f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:068dab75-d300-4ead-a742-d14572ad1e50+28:32517:x1830948734316544:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 327us (446us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129577.421390:0:15096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11315 00000100:00100000:3.0:1746129577.421655:0:8417:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009507e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+17:1961:x1830948734316288:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 1206us (1447us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129577.421662:0:8417:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8023 00002000:00100000:3.0:1746129577.421668:0:8417:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3ef:0x0] (4804608->4808703) req@ffff88009507e300 x1830948734316288/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:318/0 lens 488/4536 e 0 to 0 dl 1746129588 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129577.421676:0:8417:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009507e300 with x1830948734316288 ext(4804608->4808703) 00002000:00010000:3.0:1746129577.421679:0:8417:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009507e300 00000100:00100000:2.0:1746129577.423074:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129577.423578:0:8410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734316672 00000100:00100000:1.0:1746129577.423585:0:8410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734316672 00000100:00100000:1.0:1746129577.423621:0:8410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16606 00000100:00100000:1.0:1746129577.423628:0:8410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013145ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ada2ffba-8920-4ecb-8068-68caa9806978+23:32514:x1830948734316672:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:1.0:1746129577.423642:0:8410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129577.423658:0:8410:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f93e400/0x40a459093b06b0f8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21c25 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129577.423684:0:8410:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880136b1d000/0x40a459093b06b0b2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4808703) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21bfb expref: 16 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129577.423691:0:8410:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129577.423693:0:8410:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129577.423696:0:8410:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f93e400/0x40a459093b06b0f8 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [4186112->4194303] (req 4186112->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21c25 expref: 24 pid: 8410 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129577.423702:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00010000:00010000:1.0:1746129577.423727:0:8410:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880136b1d000/0x40a459093b06b0b2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4808703) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21bfb expref: 16 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129577.423740:0:8410:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880136b1d000/0x40a459093b06b0b2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4808703) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21bfb expref: 16 pid: 8410 timeout: 932 lvb_type: 0 00000100:00100000:3.0:1746129577.423906:0:20861:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734316928 00000100:00100000:3.0:1746129577.423910:0:20861:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734316928 00000100:00100000:1.0:1746129577.423923:0:8410:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cda7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8410:1830948737583744:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129577.423935:0:20861:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4818 00000100:00100000:3.0:1746129577.423939:0:20861:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013577e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:068dab75-d300-4ead-a742-d14572ad1e50+28:32517:x1830948734316928:12345-192.168.202.4@tcp:35:lfs.0 00000100:00100000:1.0:1746129577.423996:0:8410:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0ac900 going to sleep for 11 seconds 00000100:00100000:3.0:1746129577.424144:0:20861:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013577e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:068dab75-d300-4ead-a742-d14572ad1e50+29:32517:x1830948734316928:12345-192.168.202.4@tcp:35:lfs.0 Request processed in 203us (441us total) trans 8589945429 rc 0/0 00000100:00100000:3.0:1746129577.424150:0:20861:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4818 00000100:00100000:1.0:1746129577.424354:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129577.424431:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734317184 00000100:00100000:0.0:1746129577.424435:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734317184 00000100:00100000:0.0:1746129577.424458:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4819 00000100:00100000:0.0:1746129577.424463:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ccb050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+31:32512:x1830948734317184:12345-192.168.202.4@tcp:35:multiop.0 00000100:00100000:0.0:1746129577.424560:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ccb050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+32:32512:x1830948734317184:12345-192.168.202.4@tcp:35:multiop.0 Request processed in 96us (205us total) trans 8589945430 rc 0/0 00000100:00100000:0.0:1746129577.424566:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4819 00000100:00100000:1.0:1746129577.428110:0:8410:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cda7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8410:1830948737583744:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129577.428145:0:8410:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f93e400/0x40a459093b06b0f8 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [4186112->4194303] (req 4186112->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21c25 expref: 24 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129577.428163:0:8410:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f93e400, rc 0) 00000100:00100000:1.0:1746129577.428208:0:8410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013145ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ada2ffba-8920-4ecb-8068-68caa9806978+24:32514:x1830948734316672:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 4579us (5138us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129577.428217:0:8410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16606 00000100:00100000:0.0:1746129577.428828:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129577.429046:0:8417:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734317312 00000100:00100000:3.0:1746129577.429054:0:8417:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734317312 00002000:00100000:3.0:1746129577.429092:0:8417:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3ef:0x0] (4194304->4808703) req@ffff88013577e300 x1830948734317312/t0(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:318/0 lens 488/0 e 0 to 0 dl 1746129588 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129577.429101:0:8417:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013577e300 with x1830948734317312 ext(4194304->4808703) 00010000:00010000:3.0:1746129577.429108:0:8417:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880136b1d000/0x40a459093b06b0b2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4808703) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21bfb expref: 17 pid: 8410 timeout: 932 lvb_type: 0 00010000:00010000:3.0:1746129577.429120:0:8417:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880136b1d000/0x40a459093b06b0b2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4808703) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21bfb expref: 17 pid: 8410 timeout: 932 lvb_type: 0 00002000:00010000:3.0:1746129577.429127:0:8417:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88013577e300 00000100:00100000:3.0:1746129577.429407:0:8417:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2484 00000100:00100000:3.0:1746129577.429416:0:8417:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013577e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+17:1960:x1830948734317312:12345-192.168.202.4@tcp:4:multiop.0 00000100:00100000:3.0:1746129577.440164:0:8417:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013577e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+19:1960:x1830948734317312:12345-192.168.202.4@tcp:4:multiop.0 Request processed in 10737us (11325us total) trans 21474841407 rc 0/0 00000100:00100000:3.0:1746129577.440176:0:8417:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2484 00002000:00100000:3.0:1746129577.440189:0:8417:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3ef:0x0] (4194304->4808703) req@ffff88013577e300 x1830948734317312/t21474841407(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:318/0 lens 488/448 e 0 to 0 dl 1746129588 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129577.440198:0:8417:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013577e300 with x1830948734317312 ext(4194304->4808703) 00010000:00010000:3.0:1746129577.440209:0:8417:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880136b1d000/0x40a459093b06b0b2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4808703) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21bfb expref: 19 pid: 8410 timeout: 932 lvb_type: 0 00010000:00010000:3.0:1746129577.440226:0:8417:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880136b1d000/0x40a459093b06b0b2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4808703) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21bfb expref: 19 pid: 8410 timeout: 932 lvb_type: 0 00002000:00010000:3.0:1746129577.440233:0:8417:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88013577e300 00000100:00100000:0.0:1746129577.443204:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129577.444181:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129577.444247:0:8410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734317440 00000100:00100000:2.0:1746129577.444322:0:20578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734317568 00000100:00100000:2.0:1746129577.444328:0:20578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734317568 00010000:00010000:2.0:1746129577.444368:0:20578:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880136b1d000/0x40a459093b06b0b2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4808703) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21bfb expref: 19 pid: 8410 timeout: 932 lvb_type: 0 00000100:00100000:2.0:1746129577.444408:0:20578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8561 00000100:00100000:2.0:1746129577.444415:0:20578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6026850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+19:1961:x1830948734317568:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129577.444428:0:20578:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129577.444452:0:20578:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880136b1d000/0x40a459093b06b0b2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4808703) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21bfb expref: 19 pid: 8410 timeout: 932 lvb_type: 0 00010000:00010000:2.0:1746129577.444464:0:20578:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880136b1d000/0x40a459093b06b0b2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4808703) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21bfb expref: 19 pid: 8410 timeout: 932 lvb_type: 0 00010000:00010000:2.0:1746129577.444488:0:20578:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136b1d000/0x40a459093b06b0b2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4808703) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21bfb expref: 19 pid: 8410 timeout: 932 lvb_type: 0 00010000:00010000:2.0:1746129577.444507:0:20578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129577.444509:0:20578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129577.444516:0:20578:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f93e400/0x40a459093b06b0f8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4186112->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21c25 expref: 23 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129577.444523:0:20578:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f93e400/0x40a459093b06b0f8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4186112->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21c25 expref: 23 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129577.444556:0:20578:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008f93e400/0x40a459093b06b0f8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4186112->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21c25 expref: 23 pid: 8410 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129577.444566:0:20578:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013145f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:20578:1830948737583872:192.168.202.4@tcp:105: 00000100:00100000:2.0:1746129577.444642:0:20578:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132f36840 going to sleep for 11 seconds 00000100:00100000:1.0:1746129577.444730:0:8410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734317440 00000100:00100000:1.0:1746129577.444757:0:8410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16607 00000100:00100000:1.0:1746129577.444762:0:8410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baeed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+19:1962:x1830948734317440:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129577.444776:0:8410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129577.444786:0:8410:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091799c00/0x40a459093b06b0ff lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21c2c expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129577.444815:0:8410:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cda7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8410:1830948737584000:192.168.202.4@tcp:106: 00000100:00100000:1.0:1746129577.444837:0:8410:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0ac900 going to sleep for 11 seconds 00000100:00100000:1.0:1746129577.447059:0:8410:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cda7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8410:1830948737584000:192.168.202.4@tcp:106: 00010000:00010000:1.0:1746129577.447094:0:8410:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091799c00/0x40a459093b06b0ff lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21c2c expref: 20 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129577.447107:0:8410:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091799c00/0x40a459093b06b0ff lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21c2c expref: 20 pid: 8410 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746129577.447111:0:20578:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013145f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:20578:1830948737583872:192.168.202.4@tcp:105: 00010000:00010000:1.0:1746129577.447120:0:8410:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091799c00, rc 0) 00010000:00010000:2.0:1746129577.447126:0:20578:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129577.447176:0:20578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6026850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+19:1961:x1830948734317568:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 2760us (2998us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129577.447176:0:8410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baeed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+19:1962:x1830948734317440:12345-192.168.202.4@tcp:101:cat.0 Request processed in 2412us (3981us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129577.447184:0:20578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8561 00000100:00100000:1.0:1746129577.447184:0:8410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16607 00000100:00100000:0.0:1746129577.447468:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129577.447558:0:8417:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734317824 00000100:00100000:2.0:1746129577.447563:0:8417:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734317824 00002000:00100000:2.0:1746129577.447595:0:8417:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3ef:0x0] (4186112->4190207) req@ffff88012baed880 x1830948734317824/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:318/0 lens 488/0 e 0 to 0 dl 1746129588 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129577.447605:0:8417:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012baed880 with x1830948734317824 ext(4186112->4190207) 00002000:00010000:2.0:1746129577.447609:0:8417:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012baed880 00000100:00100000:2.0:1746129577.447634:0:8417:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8024 00000100:00100000:2.0:1746129577.447641:0:8417:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ada2ffba-8920-4ecb-8068-68caa9806978+24:1962:x1830948734317824:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:2.0:1746129577.447793:0:8417:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ada2ffba-8920-4ecb-8068-68caa9806978+24:1962:x1830948734317824:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 151us (324us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129577.447799:0:8417:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8024 00002000:00100000:2.0:1746129577.447804:0:8417:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3ef:0x0] (4186112->4190207) req@ffff88012baed880 x1830948734317824/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:318/0 lens 488/4536 e 0 to 0 dl 1746129588 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129577.447811:0:8417:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012baed880 with x1830948734317824 ext(4186112->4190207) 00002000:00010000:2.0:1746129577.447814:0:8417:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012baed880 00000100:00100000:0.0:1746129577.449917:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129577.449982:0:8410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734317952 00000100:00100000:1.0:1746129577.449995:0:8410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734317952 00000100:00100000:1.0:1746129577.450055:0:8410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16608 00000100:00100000:1.0:1746129577.450063:0:8410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ada2ffba-8920-4ecb-8068-68caa9806978+31:32514:x1830948734317952:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:1.0:1746129577.450080:0:8410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129577.450097:0:8410:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091799800/0x40a459093b06b106 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21c33 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129577.450127:0:8410:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a6cafc00/0x40a459093b06b065 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3764224->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21bc3 expref: 27 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129577.450134:0:8410:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129577.450135:0:8410:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129577.450139:0:8410:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091799800/0x40a459093b06b106 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [3145728->4091903] (req 3145728->4091903) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21c33 expref: 32 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129577.450175:0:8410:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a6cafc00/0x40a459093b06b065 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3764224->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21bc3 expref: 27 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129577.450187:0:8410:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a6cafc00/0x40a459093b06b065 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3764224->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21bc3 expref: 27 pid: 8410 timeout: 932 lvb_type: 0 00000100:00100000:1.0:1746129577.450199:0:8410:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cda7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8410:1830948737584128:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129577.450806:0:8410:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0ac900 going to sleep for 11 seconds 00000100:00100000:0.0:1746129577.452939:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129577.453267:0:8410:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cda7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8410:1830948737584128:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129577.453333:0:8410:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091799800/0x40a459093b06b106 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [3145728->4091903] (req 3145728->4091903) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21c33 expref: 32 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129577.453353:0:8410:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091799800, rc 0) 00000100:00100000:2.0:1746129577.453483:0:31519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734318080 00000100:00100000:2.0:1746129577.453491:0:31519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734318080 00002000:00100000:2.0:1746129577.453536:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f5:0x0] (3764224->4194303) req@ffff88012e38b480 x1830948734318080/t0(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:318/0 lens 488/0 e 0 to 0 dl 1746129588 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:1.0:1746129577.453597:0:8410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ada2ffba-8920-4ecb-8068-68caa9806978+32:32514:x1830948734317952:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 3533us (3688us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129577.453607:0:8410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16608 00000100:00100000:0.0:1746129577.453674:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00002000:00100000:2.0:1746129577.453721:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e38b480 with x1830948734318080 ext(3764224->4194303) 00010000:00010000:2.0:1746129577.453730:0:31519:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a6cafc00/0x40a459093b06b065 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3764224->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21bc3 expref: 28 pid: 8410 timeout: 932 lvb_type: 0 00010000:00010000:2.0:1746129577.453743:0:31519:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a6cafc00/0x40a459093b06b065 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3764224->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21bc3 expref: 28 pid: 8410 timeout: 932 lvb_type: 0 00002000:00010000:2.0:1746129577.453751:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012e38b480 00000100:00100000:2.0:1746129577.453770:0:31519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2485 00000100:00100000:2.0:1746129577.453777:0:31519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e38b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+28:1961:x1830948734318080:12345-192.168.202.4@tcp:4:multiop.0 00000100:00100000:1.0:1746129577.453878:0:8410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734318208 00000100:00100000:1.0:1746129577.453882:0:8410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734318208 00000100:00100000:1.0:1746129577.453902:0:8410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16609 00000100:00100000:1.0:1746129577.453906:0:8410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e389c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+18:32522:x1830948734318208:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129577.453916:0:8410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129577.453932:0:8410:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091798200/0x40a459093b06b10d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21c3a expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129577.453957:0:8410:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f93e400/0x40a459093b06b0f8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4186112->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21c25 expref: 23 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129577.453963:0:8410:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129577.453965:0:8410:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129577.453969:0:8410:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091798200/0x40a459093b06b10d lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21c3a expref: 19 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129577.453996:0:8410:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f93e400/0x40a459093b06b0f8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4186112->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21c25 expref: 23 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129577.454008:0:8410:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f93e400/0x40a459093b06b0f8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4186112->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21c25 expref: 23 pid: 8410 timeout: 932 lvb_type: 0 00000100:00100000:1.0:1746129577.454019:0:8410:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cda7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8410:1830948737584256:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129577.454615:0:8410:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0ac900 going to sleep for 11 seconds 00000100:00100000:0.0:1746129577.458534:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129577.458814:0:8417:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734318336 00000100:00100000:3.0:1746129577.458823:0:8417:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734318336 00002000:00100000:3.0:1746129577.458859:0:8417:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3ef:0x0] (4186112->4194303) req@ffff88012e388380 x1830948734318336/t0(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:318/0 lens 8680/0 e 0 to 0 dl 1746129588 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129577.458867:0:8417:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e388380 with x1830948734318336 ext(4186112->4194303) 00010000:00010000:3.0:1746129577.458875:0:8417:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008f93e400/0x40a459093b06b0f8 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4186112->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21c25 expref: 24 pid: 8410 timeout: 932 lvb_type: 0 00000100:00100000:1.0:1746129577.458887:0:8410:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cda7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8410:1830948737584256:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129577.458889:0:8417:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008f93e400/0x40a459093b06b0f8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4186112->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21c25 expref: 24 pid: 8410 timeout: 932 lvb_type: 0 00002000:00010000:3.0:1746129577.458894:0:8417:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012e388380 00010000:00010000:1.0:1746129577.458914:0:8410:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091798200/0x40a459093b06b10d lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21c3a expref: 19 pid: 8410 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129577.458923:0:8417:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2486 00000100:00100000:3.0:1746129577.458930:0:8417:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e388380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ada2ffba-8920-4ecb-8068-68caa9806978+24:1963:x1830948734318336:12345-192.168.202.4@tcp:4:multiop.0 00010000:00010000:1.0:1746129577.458930:0:8410:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091798200, rc 0) 00000100:00100000:1.0:1746129577.458977:0:8410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e389c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+19:32522:x1830948734318208:12345-192.168.202.4@tcp:101:cat.0 Request processed in 5069us (5302us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129577.458985:0:8410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16609 00000100:00100000:3.0:1746129577.461285:0:31519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e38b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+30:1961:x1830948734318080:12345-192.168.202.4@tcp:4:multiop.0 Request processed in 7497us (8345us total) trans 17179874161 rc 0/0 00000100:00100000:3.0:1746129577.461315:0:31519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2485 00002000:00100000:3.0:1746129577.461533:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f5:0x0] (3764224->4194303) req@ffff88012e38b480 x1830948734318080/t17179874161(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:318/0 lens 488/448 e 0 to 0 dl 1746129588 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129577.461543:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e38b480 with x1830948734318080 ext(3764224->4194303) 00010000:00010000:3.0:1746129577.461554:0:31519:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a6cafc00/0x40a459093b06b065 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3764224->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21bc3 expref: 30 pid: 8410 timeout: 932 lvb_type: 0 00010000:00010000:3.0:1746129577.461567:0:31519:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a6cafc00/0x40a459093b06b065 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3764224->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21bc3 expref: 30 pid: 8410 timeout: 932 lvb_type: 0 00002000:00010000:3.0:1746129577.461575:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012e38b480 00000100:00100000:3.0:1746129577.461797:0:8417:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e388380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ada2ffba-8920-4ecb-8068-68caa9806978+26:1963:x1830948734318336:12345-192.168.202.4@tcp:4:multiop.0 Request processed in 2865us (3275us total) trans 21474841408 rc 0/0 00000100:00100000:3.0:1746129577.461803:0:8417:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2486 00002000:00100000:3.0:1746129577.461810:0:8417:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3ef:0x0] (4186112->4194303) req@ffff88012e388380 x1830948734318336/t21474841408(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:318/0 lens 8680/448 e 0 to 0 dl 1746129588 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129577.461818:0:8417:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e388380 with x1830948734318336 ext(4186112->4194303) 00010000:00010000:3.0:1746129577.461824:0:8417:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008f93e400/0x40a459093b06b0f8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4186112->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21c25 expref: 26 pid: 8410 timeout: 932 lvb_type: 0 00010000:00010000:3.0:1746129577.461832:0:8417:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008f93e400/0x40a459093b06b0f8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4186112->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21c25 expref: 26 pid: 8410 timeout: 932 lvb_type: 0 00002000:00010000:3.0:1746129577.461838:0:8417:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012e388380 00000100:00100000:0.0:1746129577.465800:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129577.465861:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129577.465942:0:15749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734318464 00000100:00100000:3.0:1746129577.465954:0:15749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734318464 00000100:00100000:2.0:1746129577.465990:0:20578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734318592 00000100:00100000:2.0:1746129577.465995:0:20578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734318592 00010000:00010000:3.0:1746129577.466000:0:15749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6cafc00/0x40a459093b06b065 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3764224->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21bc3 expref: 30 pid: 8410 timeout: 932 lvb_type: 0 00010000:00010000:2.0:1746129577.466016:0:20578:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f93e400/0x40a459093b06b0f8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4186112->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21c25 expref: 26 pid: 8410 timeout: 932 lvb_type: 0 00000100:00100000:3.0:1746129577.466035:0:15749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8562 00000100:00100000:3.0:1746129577.466044:0:15749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f448380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+30:1960:x1830948734318464:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129577.466061:0:15749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129577.466088:0:15749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a6cafc00/0x40a459093b06b065 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3764224->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21bc3 expref: 30 pid: 8410 timeout: 932 lvb_type: 0 00010000:00010000:3.0:1746129577.466100:0:15749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a6cafc00/0x40a459093b06b065 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3764224->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21bc3 expref: 30 pid: 8410 timeout: 932 lvb_type: 0 00010000:00010000:3.0:1746129577.466127:0:15749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a6cafc00/0x40a459093b06b065 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3764224->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21bc3 expref: 30 pid: 8410 timeout: 932 lvb_type: 0 00000100:00100000:2.0:1746129577.466235:0:20578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8563 00000100:00100000:2.0:1746129577.466243:0:20578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f44ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ada2ffba-8920-4ecb-8068-68caa9806978+26:1962:x1830948734318592:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129577.466253:0:20578:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129577.466280:0:20578:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f93e400/0x40a459093b06b0f8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4186112->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21c25 expref: 26 pid: 8410 timeout: 932 lvb_type: 0 00010000:00010000:2.0:1746129577.466290:0:20578:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f93e400/0x40a459093b06b0f8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4186112->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21c25 expref: 26 pid: 8410 timeout: 932 lvb_type: 0 00010000:00010000:2.0:1746129577.466339:0:20578:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f93e400/0x40a459093b06b0f8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4186112->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21c25 expref: 26 pid: 8410 timeout: 932 lvb_type: 0 00010000:00010000:2.0:1746129577.466357:0:20578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129577.466359:0:20578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129577.466367:0:20578:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091798200/0x40a459093b06b10d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21c3a expref: 18 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129577.466374:0:20578:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091798200/0x40a459093b06b10d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21c3a expref: 18 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129577.466417:0:15749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129577.466420:0:15749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129577.466425:0:15749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091799800/0x40a459093b06b106 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4091903) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21c33 expref: 31 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129577.466430:0:15749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091799800/0x40a459093b06b106 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4091903) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21c33 expref: 31 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129577.466456:0:15749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091799800/0x40a459093b06b106 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4091903) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21c33 expref: 31 pid: 8410 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129577.466467:0:15749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bd500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15749:1830948737584384:192.168.202.4@tcp:105: 00010000:00010000:2.0:1746129577.466485:0:20578:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091798200/0x40a459093b06b10d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21c3a expref: 18 pid: 8410 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129577.466494:0:20578:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013145f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:20578:1830948737584512:192.168.202.4@tcp:105: 00000100:00100000:3.0:1746129577.466547:0:15749:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa381300 going to sleep for 11 seconds 00000100:00100000:2.0:1746129577.467205:0:20578:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132f36300 going to sleep for 11 seconds 00000100:00100000:2.0:1746129577.471462:0:20578:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013145f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:20578:1830948737584512:192.168.202.4@tcp:105: 00010000:00010000:2.0:1746129577.471494:0:20578:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129577.471565:0:20578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f44ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ada2ffba-8920-4ecb-8068-68caa9806978+25:1962:x1830948734318592:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 5320us (5701us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129577.471577:0:20578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8563 00000100:00100000:3.0:1746129577.472236:0:15749:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bd500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15749:1830948737584384:192.168.202.4@tcp:105: 00010000:00010000:3.0:1746129577.472250:0:15749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129577.472545:0:15749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f448380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+29:1960:x1830948734318464:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 6501us (6757us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129577.472554:0:15749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8562 00000100:00100000:0.0:1746129577.473499:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129577.473578:0:8417:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734318848 00000100:00100000:3.0:1746129577.473586:0:8417:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734318848 00002000:00100000:3.0:1746129577.473628:0:8417:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3ef:0x0] (2097152->3145727) req@ffff88008f449f80 x1830948734318848/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:318/0 lens 488/0 e 0 to 0 dl 1746129588 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129577.473638:0:8417:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f449f80 with x1830948734318848 ext(2097152->3145727) 00002000:00010000:3.0:1746129577.473643:0:8417:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f449f80 00000100:00100000:3.0:1746129577.473661:0:8417:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8025 00000100:00100000:3.0:1746129577.473667:0:8417:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f449f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+19:1963:x1830948734318848:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129577.481758:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129577.483090:0:31519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734319104 00000100:00100000:2.0:1746129577.483105:0:31519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734319104 00002000:00100000:2.0:1746129577.483167:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f5:0x0] (4087808->4091903) req@ffff88008f44b100 x1830948734319104/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:318/0 lens 488/0 e 0 to 0 dl 1746129588 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129577.483177:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f44b100 with x1830948734319104 ext(4087808->4091903) 00002000:00010000:2.0:1746129577.483183:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f44b100 00000100:00100000:2.0:1746129577.483233:0:31519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8026 00000100:00100000:2.0:1746129577.483242:0:31519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f44b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ada2ffba-8920-4ecb-8068-68caa9806978+32:1963:x1830948734319104:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:2.0:1746129577.483508:0:31519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f44b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ada2ffba-8920-4ecb-8068-68caa9806978+32:1963:x1830948734319104:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 266us (1759us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129577.483515:0:31519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8026 00002000:00100000:2.0:1746129577.483520:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f5:0x0] (4087808->4091903) req@ffff88008f44b100 x1830948734319104/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:318/0 lens 488/4536 e 0 to 0 dl 1746129588 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129577.483527:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f44b100 with x1830948734319104 ext(4087808->4091903) 00002000:00010000:2.0:1746129577.483530:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f44b100 00000100:00100000:3.0:1746129577.492335:0:8417:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f449f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+19:1963:x1830948734318848:12345-192.168.202.4@tcp:3:cat.0 Request processed in 18618us (18789us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129577.492349:0:8417:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8025 00002000:00100000:3.0:1746129577.492360:0:8417:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3ef:0x0] (2097152->3145727) req@ffff88008f449f80 x1830948734318848/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:318/0 lens 488/440 e 0 to 0 dl 1746129588 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129577.492370:0:8417:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f449f80 with x1830948734318848 ext(2097152->3145727) 00002000:00010000:3.0:1746129577.492376:0:8417:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f449f80 00000100:00100000:0.0:1746129577.493513:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00010000:00010000:2.0:1746129577.494028:0:7089:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1746129577.494951:0:20861:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734319360 00000100:00100000:3.0:1746129577.494964:0:20861:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734319360 00000100:00100000:3.0:1746129577.495024:0:20861:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4820 00000100:00100000:3.0:1746129577.495033:0:20861:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f44bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:ada2ffba-8920-4ecb-8068-68caa9806978+319:32514:x1830948734319360:12345-192.168.202.4@tcp:35:multiop.0 00000100:00100000:3.0:1746129577.495677:0:20861:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f44bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:ada2ffba-8920-4ecb-8068-68caa9806978+320:32514:x1830948734319360:12345-192.168.202.4@tcp:35:multiop.0 Request processed in 642us (2165us total) trans 8589945431 rc 0/0 00000100:00100000:3.0:1746129577.495684:0:20861:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4820 00000100:00100000:0.0:1746129577.498984:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129577.500791:0:8410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734319488 00000100:00100000:1.0:1746129577.500806:0:8410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734319488 00000100:00100000:1.0:1746129577.500867:0:8410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16610 00000100:00100000:1.0:1746129577.500875:0:8410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f44b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+29:32522:x1830948734319488:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129577.500896:0:8410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129577.500918:0:8410:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880132fc2400/0x40a459093b06b114 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21c41 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129577.500956:0:8410:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091799800/0x40a459093b06b106 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4091903) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21c33 expref: 31 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129577.500964:0:8410:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129577.500966:0:8410:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129577.500969:0:8410:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880132fc2400/0x40a459093b06b114 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21c41 expref: 30 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129577.501001:0:8410:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091799800/0x40a459093b06b106 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4091903) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21c33 expref: 31 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129577.501013:0:8410:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091799800/0x40a459093b06b106 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4091903) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21c33 expref: 31 pid: 8410 timeout: 932 lvb_type: 0 00000100:00100000:1.0:1746129577.501024:0:8410:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cda7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8410:1830948737584640:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129577.501115:0:8410:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0ac900 going to sleep for 11 seconds 00000100:00100000:0.0:1746129577.507493:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129577.507559:0:8417:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734319616 00000100:00100000:3.0:1746129577.507568:0:8417:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734319616 00002000:00100000:3.0:1746129577.507606:0:8417:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3f5:0x0] (3145728->4091903) req@ffff88012b550e00 x1830948734319616/t0(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:318/0 lens 488/0 e 0 to 0 dl 1746129588 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129577.507613:0:8417:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b550e00 with x1830948734319616 ext(3145728->4091903) 00010000:00010000:3.0:1746129577.507621:0:8417:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091799800/0x40a459093b06b106 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4091903) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21c33 expref: 32 pid: 8410 timeout: 932 lvb_type: 0 00010000:00010000:3.0:1746129577.507631:0:8417:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091799800/0x40a459093b06b106 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4091903) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21c33 expref: 32 pid: 8410 timeout: 932 lvb_type: 0 00002000:00010000:3.0:1746129577.507636:0:8417:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b550e00 00000100:00100000:3.0:1746129577.507656:0:8417:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2487 00000100:00100000:3.0:1746129577.507660:0:8417:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b550e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ada2ffba-8920-4ecb-8068-68caa9806978+32:1961:x1830948734319616:12345-192.168.202.4@tcp:4:multiop.0 00000100:00100000:2.0:1746129577.507915:0:8410:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cda7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8410:1830948737584640:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129577.507968:0:8410:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880132fc2400/0x40a459093b06b114 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21c41 expref: 30 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129577.507986:0:8410:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132fc2400, rc 0) 00000100:00100000:2.0:1746129577.508032:0:8410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f44b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+30:32522:x1830948734319488:12345-192.168.202.4@tcp:101:cat.0 Request processed in 7157us (9059us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129577.508040:0:8410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16610 00000100:00100000:0.0:1746129577.529824:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129577.529880:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129577.529921:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734319744 00000100:00100000:0.0:1746129577.529929:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734319744 00000100:00100000:0.0:1746129577.529968:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734319872 00000100:00100000:0.0:1746129577.529969:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734319872 00000100:00100000:0.0:1746129577.530001:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16611 00000100:00100000:0.0:1746129577.530009:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009402bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ada2ffba-8920-4ecb-8068-68caa9806978+25:1960:x1830948734319744:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129577.530030:0:7148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746129577.530041:0:11014:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16612 00000100:00100000:1.0:1746129577.530048:0:11014:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ada2ffba-8920-4ecb-8068-68caa9806978+34:1960:x1830948734319872:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129577.530048:0:7148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136b1d600/0x40a459093b06b11b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21c48 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129577.530055:0:11014:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129577.530064:0:11014:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091799a00/0x40a459093b06b122 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21c4f expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129577.530071:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129577.530073:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129577.530081:0:7148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136b1d600/0x40a459093b06b11b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21c48 expref: 26 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129577.530095:0:7148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880136b1d600/0x40a459093b06b11b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21c48 expref: 26 pid: 7148 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746129577.530104:0:11014:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cda6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11014:1830948737584768:192.168.202.4@tcp:106: 00010000:00010000:0.0:1746129577.530106:0:7148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136b1d600, rc 0) 00000100:00100000:1.0:1746129577.530478:0:11014:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0ac780 going to sleep for 11 seconds 00000100:00100000:2.0:1746129577.530799:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009402bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ada2ffba-8920-4ecb-8068-68caa9806978+26:1960:x1830948734319744:12345-192.168.202.4@tcp:101:cat.0 Request processed in 788us (984us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129577.530806:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16611 00000100:00100000:1.0:1746129577.531761:0:11014:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cda6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11014:1830948737584768:192.168.202.4@tcp:106: 00010000:00010000:1.0:1746129577.531792:0:11014:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091799a00/0x40a459093b06b122 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21c4f expref: 35 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129577.531806:0:11014:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091799a00/0x40a459093b06b122 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21c4f expref: 35 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129577.531821:0:11014:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091799a00, rc 0) 00000100:00100000:1.0:1746129577.531846:0:11014:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ada2ffba-8920-4ecb-8068-68caa9806978+34:1960:x1830948734319872:12345-192.168.202.4@tcp:101:cat.0 Request processed in 1799us (1965us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129577.531851:0:11014:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16612 00000100:00100000:3.0:1746129577.534628:0:8417:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b550e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ada2ffba-8920-4ecb-8068-68caa9806978+34:1961:x1830948734319616:12345-192.168.202.4@tcp:4:multiop.0 Request processed in 26958us (27139us total) trans 17179874162 rc 0/0 00000100:00100000:3.0:1746129577.534638:0:8417:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2487 00002000:00100000:3.0:1746129577.534648:0:8417:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3f5:0x0] (3145728->4091903) req@ffff88012b550e00 x1830948734319616/t17179874162(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:318/0 lens 488/448 e 0 to 0 dl 1746129588 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129577.534656:0:8417:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b550e00 with x1830948734319616 ext(3145728->4091903) 00010000:00010000:3.0:1746129577.534665:0:8417:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091799800/0x40a459093b06b106 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4091903) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21c33 expref: 34 pid: 8410 timeout: 932 lvb_type: 0 00010000:00010000:3.0:1746129577.534679:0:8417:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091799800/0x40a459093b06b106 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4091903) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21c33 expref: 34 pid: 8410 timeout: 932 lvb_type: 0 00002000:00010000:3.0:1746129577.534684:0:8417:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b550e00 00000100:00100000:0.0:1746129577.541250:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129577.541559:0:15749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734320000 00000100:00100000:3.0:1746129577.541566:0:15749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734320000 00010000:00010000:3.0:1746129577.541596:0:15749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091799800/0x40a459093b06b106 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4091903) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21c33 expref: 34 pid: 8410 timeout: 932 lvb_type: 0 00000100:00100000:2.0:1746129577.541690:0:20578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8564 00000100:00100000:2.0:1746129577.541708:0:20578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa27480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ada2ffba-8920-4ecb-8068-68caa9806978+34:1960:x1830948734320000:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129577.541726:0:20578:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129577.541754:0:20578:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091799800/0x40a459093b06b106 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4091903) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21c33 expref: 34 pid: 8410 timeout: 932 lvb_type: 0 00010000:00010000:2.0:1746129577.541768:0:20578:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091799800/0x40a459093b06b106 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4091903) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21c33 expref: 34 pid: 8410 timeout: 932 lvb_type: 0 00010000:00010000:2.0:1746129577.541791:0:20578:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091799800/0x40a459093b06b106 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4091903) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21c33 expref: 34 pid: 8410 timeout: 932 lvb_type: 0 00010000:00010000:2.0:1746129577.541814:0:20578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129577.541816:0:20578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129577.541823:0:20578:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880132fc2400/0x40a459093b06b114 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21c41 expref: 29 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129577.541830:0:20578:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880132fc2400/0x40a459093b06b114 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21c41 expref: 29 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129577.541867:0:20578:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880132fc2400/0x40a459093b06b114 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21c41 expref: 29 pid: 8410 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129577.541879:0:20578:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013145f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:20578:1830948737584896:192.168.202.4@tcp:105: 00000100:00100000:2.0:1746129577.542662:0:20578:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132f36300 going to sleep for 11 seconds 00000100:00100000:3.0:1746129577.545575:0:20578:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013145f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:20578:1830948737584896:192.168.202.4@tcp:105: 00010000:00010000:3.0:1746129577.545608:0:20578:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129577.545773:0:20578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa27480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ada2ffba-8920-4ecb-8068-68caa9806978+33:1960:x1830948734320000:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 4071us (4822us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129577.545785:0:20578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8564 00000100:00100000:0.0:1746129577.556494:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129577.556583:0:8417:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734320256 00000100:00100000:3.0:1746129577.556596:0:8417:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734320256 00002000:00100000:3.0:1746129577.556651:0:8417:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3ef:0x0] (2097152->3145727) req@ffff88009fa24000 x1830948734320256/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:318/0 lens 488/0 e 0 to 0 dl 1746129588 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129577.556668:0:8417:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fa24000 with x1830948734320256 ext(2097152->3145727) 00002000:00010000:3.0:1746129577.556674:0:8417:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fa24000 00000100:00100000:3.0:1746129577.556716:0:8417:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8027 00000100:00100000:3.0:1746129577.556724:0:8417:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ada2ffba-8920-4ecb-8068-68caa9806978+26:1963:x1830948734320256:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129577.570822:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129577.572476:0:8417:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ada2ffba-8920-4ecb-8068-68caa9806978+26:1963:x1830948734320256:12345-192.168.202.4@tcp:3:cat.0 Request processed in 15742us (15977us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129577.572489:0:8417:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8027 00002000:00100000:3.0:1746129577.572502:0:8417:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3ef:0x0] (2097152->3145727) req@ffff88009fa24000 x1830948734320256/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:318/0 lens 488/440 e 0 to 0 dl 1746129588 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129577.572512:0:8417:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fa24000 with x1830948734320256 ext(2097152->3145727) 00002000:00010000:3.0:1746129577.572519:0:8417:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fa24000 00000100:00100000:0.0:1746129577.572770:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129577.574949:0:8417:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734320640 00000100:00100000:3.0:1746129577.574965:0:8417:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734320640 00002000:00100000:3.0:1746129577.575021:0:8417:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->4194303) req@ffff88009fa27800 x1830948734320640/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:318/0 lens 488/0 e 0 to 0 dl 1746129588 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129577.575031:0:8417:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fa27800 with x1830948734320640 ext(3145728->4194303) 00002000:00010000:3.0:1746129577.575036:0:8417:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fa27800 00000100:00100000:3.0:1746129577.575076:0:8417:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8028 00000100:00100000:3.0:1746129577.575084:0:8417:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+19:1961:x1830948734320640:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:1.0:1746129577.578236:0:8416:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734320768 00000100:00100000:1.0:1746129577.578252:0:8416:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734320768 00002000:00100000:1.0:1746129577.578501:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3f5:0x0] (2097152->3145727) req@ffff88009fa26a00 x1830948734320768/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:318/0 lens 488/0 e 0 to 0 dl 1746129588 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129577.578512:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fa26a00 with x1830948734320768 ext(2097152->3145727) 00002000:00010000:1.0:1746129577.578518:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fa26a00 00000100:00100000:1.0:1746129577.578545:0:8416:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8029 00000100:00100000:1.0:1746129577.578553:0:8416:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+30:1961:x1830948734320768:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:3.0:1746129577.582814:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129577.584487:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734320896 00000100:00100000:0.0:1746129577.584497:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734320896 00002000:00100000:0.0:1746129577.584534:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f5:0x0] (3145728->4194303) req@ffff8800947bd500 x1830948734320896/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:318/0 lens 488/0 e 0 to 0 dl 1746129588 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129577.584543:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800947bd500 with x1830948734320896 ext(3145728->4194303) 00002000:00010000:0.0:1746129577.584548:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800947bd500 00000100:00100000:0.0:1746129577.584577:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8030 00000100:00100000:0.0:1746129577.584585:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+32:1961:x1830948734320896:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:3.0:1746129577.588367:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129577.588458:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734321152 00000100:00100000:2.0:1746129577.588470:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734321152 00000100:00100000:2.0:1746129577.588544:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16613 00000100:00100000:2.0:1746129577.588552:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ada2ffba-8920-4ecb-8068-68caa9806978+33:32526:x1830948734321152:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129577.588573:0:7148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129577.588593:0:7148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129861200/0x40a459093b06b129 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21c56 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129577.588619:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129577.588622:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129577.588628:0:7148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129861200/0x40a459093b06b129 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21c56 expref: 34 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129577.588643:0:7148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129861200/0x40a459093b06b129 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21c56 expref: 34 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129577.588653:0:7148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129861200, rc 0) 00000100:00100000:2.0:1746129577.588705:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ada2ffba-8920-4ecb-8068-68caa9806978+34:32526:x1830948734321152:12345-192.168.202.4@tcp:101:cat.0 Request processed in 155us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129577.588711:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16613 00000100:00100000:3.0:1746129577.590245:0:8417:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+19:1961:x1830948734320640:12345-192.168.202.4@tcp:3:cat.0 Request processed in 15155us (19429us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129577.590266:0:8417:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8028 00002000:00100000:3.0:1746129577.590278:0:8417:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->4194303) req@ffff88009fa27800 x1830948734320640/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:318/0 lens 488/440 e 0 to 0 dl 1746129588 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129577.590286:0:8417:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fa27800 with x1830948734320640 ext(3145728->4194303) 00002000:00010000:3.0:1746129577.590291:0:8417:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fa27800 00000100:00100000:1.0:1746129577.594450:0:8416:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+32:1961:x1830948734320768:12345-192.168.202.4@tcp:3:cat.0 Request processed in 15886us (21669us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129577.594465:0:8416:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8029 00002000:00100000:1.0:1746129577.594476:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3f5:0x0] (2097152->3145727) req@ffff88009fa26a00 x1830948734320768/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:318/0 lens 488/440 e 0 to 0 dl 1746129588 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129577.594486:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fa26a00 with x1830948734320768 ext(2097152->3145727) 00002000:00010000:1.0:1746129577.594492:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fa26a00 00000100:00100000:0.0:1746129577.602808:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129577.602839:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129577.603095:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129577.604150:0:8417:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734321536 00000100:00100000:3.0:1746129577.604158:0:8417:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734321536 00000100:00100000:1.0:1746129577.604169:0:8416:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734321664 00000100:00100000:1.0:1746129577.604178:0:8416:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734321664 00002000:00100000:3.0:1746129577.604192:0:8417:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->4194303) req@ffff8800903a0700 x1830948734321536/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:318/0 lens 488/0 e 0 to 0 dl 1746129588 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129577.604201:0:8417:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800903a0700 with x1830948734321536 ext(3145728->4194303) 00002000:00010000:3.0:1746129577.604206:0:8417:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800903a0700 00002000:00100000:1.0:1746129577.604216:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3f5:0x0] (2097152->3145727) req@ffff8800903a0000 x1830948734321664/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:318/0 lens 488/0 e 0 to 0 dl 1746129588 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129577.604228:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800903a0000 with x1830948734321664 ext(2097152->3145727) 00000100:00100000:3.0:1746129577.604229:0:8417:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734321792 00000100:00100000:3.0:1746129577.604232:0:8417:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734321792 00002000:00010000:1.0:1746129577.604232:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800903a0000 00002000:00100000:3.0:1746129577.604245:0:8417:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3f5:0x0] (3145728->4194303) req@ffff8800903a0380 x1830948734321792/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:318/0 lens 488/0 e 0 to 0 dl 1746129588 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129577.604251:0:8417:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800903a0380 with x1830948734321792 ext(3145728->4194303) 00002000:00010000:3.0:1746129577.604268:0:8417:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800903a0380 00000100:00100000:1.0:1746129577.604279:0:21725:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8031 00000100:00100000:1.0:1746129577.604287:0:21725:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800903a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ada2ffba-8920-4ecb-8068-68caa9806978+26:1963:x1830948734321536:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:3.0:1746129577.604347:0:8417:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8032 00000100:00100000:3.0:1746129577.604355:0:8417:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800903a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ada2ffba-8920-4ecb-8068-68caa9806978+35:1963:x1830948734321664:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:2.0:1746129577.604355:0:31520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8033 00000100:00100000:2.0:1746129577.604361:0:31520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800903a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ada2ffba-8920-4ecb-8068-68caa9806978+35:1963:x1830948734321792:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129577.605325:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+30:1961:x1830948734320896:12345-192.168.202.4@tcp:3:cat.0 Request processed in 20738us (22516us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129577.605332:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8030 00002000:00100000:0.0:1746129577.605338:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f5:0x0] (3145728->4194303) req@ffff8800947bd500 x1830948734320896/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:318/0 lens 488/440 e 0 to 0 dl 1746129588 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129577.605344:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800947bd500 with x1830948734320896 ext(3145728->4194303) 00002000:00010000:0.0:1746129577.605347:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800947bd500 00000100:00100000:0.0:1746129577.623724:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129577.623803:0:8416:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734322176 00000100:00100000:2.0:1746129577.623813:0:8416:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734322176 00002000:00100000:2.0:1746129577.623862:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3ef:0x0] (4194304->5148671) req@ffff88013575d180 x1830948734322176/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:318/0 lens 488/0 e 0 to 0 dl 1746129588 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129577.623872:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013575d180 with x1830948734322176 ext(4194304->5148671) 00002000:00010000:2.0:1746129577.623877:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013575d180 00000100:00100000:2.0:1746129577.623898:0:8416:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8034 00000100:00100000:2.0:1746129577.623906:0:8416:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013575d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+19:1963:x1830948734322176:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:3.0:1746129577.624418:0:8417:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800903a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ada2ffba-8920-4ecb-8068-68caa9806978+36:1963:x1830948734321664:12345-192.168.202.4@tcp:3:cat.0 Request processed in 20063us (21576us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129577.624426:0:8417:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8032 00002000:00100000:3.0:1746129577.624432:0:8417:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3f5:0x0] (2097152->3145727) req@ffff8800903a0000 x1830948734321664/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:318/0 lens 488/440 e 0 to 0 dl 1746129588 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129577.624444:0:8417:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800903a0000 with x1830948734321664 ext(2097152->3145727) 00002000:00010000:3.0:1746129577.624447:0:8417:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800903a0000 00000100:00100000:2.0:1746129577.632143:0:31520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800903a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ada2ffba-8920-4ecb-8068-68caa9806978+34:1963:x1830948734321792:12345-192.168.202.4@tcp:3:cat.0 Request processed in 27769us (29035us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129577.632156:0:31520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8033 00002000:00100000:2.0:1746129577.632168:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3f5:0x0] (3145728->4194303) req@ffff8800903a0380 x1830948734321792/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:318/0 lens 488/440 e 0 to 0 dl 1746129588 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129577.632177:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800903a0380 with x1830948734321792 ext(3145728->4194303) 00002000:00010000:2.0:1746129577.632183:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800903a0380 00000100:00100000:0.0:1746129577.638174:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129577.638243:0:31520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734322432 00000100:00100000:2.0:1746129577.638261:0:31520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734322432 00002000:00100000:2.0:1746129577.638341:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3ef:0x0] (4194304->5148671) req@ffff880135726a00 x1830948734322432/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:318/0 lens 488/0 e 0 to 0 dl 1746129588 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129577.638352:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135726a00 with x1830948734322432 ext(4194304->5148671) 00002000:00010000:2.0:1746129577.638357:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135726a00 00000100:00100000:2.0:1746129577.638380:0:31520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8035 00000100:00100000:2.0:1746129577.638387:0:31520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135726a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ada2ffba-8920-4ecb-8068-68caa9806978+28:1962:x1830948734322432:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:2.0:1746129577.648049:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129577.648112:0:14547:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734322688 00000100:00100000:0.0:1746129577.648124:0:14547:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734322688 00000100:00100000:0.0:1746129577.648175:0:14547:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11316 00000100:00100000:0.0:1746129577.648182:0:14547:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013145df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ada2ffba-8920-4ecb-8068-68caa9806978+320:32528:x1830948734322688:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:0.0:1746129577.648209:0:14547:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746129577.648912:0:8416:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013575d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+19:1963:x1830948734322176:12345-192.168.202.4@tcp:3:cat.0 Request processed in 25005us (25198us total) trans 0 rc 954368/954368 00000100:00100000:3.0:1746129577.648922:0:8416:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8034 00002000:00100000:3.0:1746129577.648932:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3ef:0x0] (4194304->5148671) req@ffff88013575d180 x1830948734322176/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:318/0 lens 488/440 e 0 to 0 dl 1746129588 ref 1 fl Complete:/200/0 rc 954368/954368 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129577.648943:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013575d180 with x1830948734322176 ext(4194304->5148671) 00002000:00010000:3.0:1746129577.648948:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013575d180 00000100:00100000:1.0:1746129577.650781:0:21725:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800903a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ada2ffba-8920-4ecb-8068-68caa9806978+28:1963:x1830948734321536:12345-192.168.202.4@tcp:3:cat.0 Request processed in 46487us (47972us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129577.650790:0:21725:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8031 00002000:00100000:1.0:1746129577.650800:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->4194303) req@ffff8800903a0700 x1830948734321536/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:318/0 lens 488/440 e 0 to 0 dl 1746129588 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129577.650808:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800903a0700 with x1830948734321536 ext(3145728->4194303) 00002000:00010000:1.0:1746129577.650812:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800903a0700 00010000:00010000:0.0:1746129577.651732:0:14547:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f889000/0x40a459093b06b130 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21c5d expref: -99 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129577.651844:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f888e00/0x40a459093b06b137 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129577.651862:0:14547:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f890c00/0x40a459093b06b0d5 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21c09 expref: 28 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129577.651868:0:14547:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f888e00/0x40a459093b06b137 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129577.651903:0:14547:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012f890c00/0x40a459093b06b0d5 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21c09 expref: 28 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129577.651916:0:14547:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f890c00/0x40a459093b06b0d5 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21c09 expref: 28 pid: 15096 timeout: 932 lvb_type: 0 00000100:00100000:0.0:1746129577.651929:0:14547:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135727b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14547:1830948737585024:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129577.653969:0:14547:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009cdf3600 going to sleep for 11 seconds 00000100:00100000:3.0:1746129577.657002:0:31520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135726a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ada2ffba-8920-4ecb-8068-68caa9806978+26:1962:x1830948734322432:12345-192.168.202.4@tcp:3:cat.0 Request processed in 18595us (18820us total) trans 0 rc 954368/954368 00000100:00100000:3.0:1746129577.657018:0:31520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8035 00002000:00100000:3.0:1746129577.657033:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3ef:0x0] (4194304->5148671) req@ffff880135726a00 x1830948734322432/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:318/0 lens 488/440 e 0 to 0 dl 1746129588 ref 1 fl Complete:/200/0 rc 954368/954368 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129577.657042:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135726a00 with x1830948734322432 ext(4194304->5148671) 00002000:00010000:3.0:1746129577.657050:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135726a00 00000100:00100000:1.0:1746129577.657419:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129577.657537:0:14547:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135727b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14547:1830948737585024:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129577.657564:0:14547:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009f888e00/0x40a459093b06b137 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00000100:00100000:3.0:1746129577.657626:0:20578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734322816 00000100:00100000:3.0:1746129577.657632:0:20578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734322816 00010000:00010000:3.0:1746129577.657660:0:20578:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f890c00/0x40a459093b06b0d5 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21c09 expref: 29 pid: 15096 timeout: 932 lvb_type: 0 00000100:00100000:3.0:1746129577.657694:0:20578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8565 00000100:00100000:3.0:1746129577.657701:0:20578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cda6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:068dab75-d300-4ead-a742-d14572ad1e50+29:1961:x1830948734322816:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129577.657717:0:20578:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129577.657722:0:20578:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012f890c00/0x40a459093b06b0d5 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21c09 expref: 29 pid: 15096 timeout: 932 lvb_type: 0 00010000:00010000:3.0:1746129577.657732:0:20578:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012f890c00/0x40a459093b06b0d5 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21c09 expref: 29 pid: 15096 timeout: 932 lvb_type: 0 00010000:00010000:3.0:1746129577.657755:0:20578:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f890c00/0x40a459093b06b0d5 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21c09 expref: 29 pid: 15096 timeout: 932 lvb_type: 0 00010000:00010000:3.0:1746129577.657770:0:20578:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:3.0:1746129577.657774:0:20578:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f888e00/0x40a459093b06b137 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746129577.657783:0:20578:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f888e00/0x40a459093b06b137 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746129577.657789:0:20578:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f888e00/0x40a459093b06b137 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14547 initiator: MDT0 00010000:00010000:3.0:1746129577.658147:0:20578:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129577.658201:0:20578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cda6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:068dab75-d300-4ead-a742-d14572ad1e50+28:1961:x1830948734322816:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 499us (783us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129577.658208:0:20578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8565 00010000:00010000:2.0:1746129577.658277:0:14547:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f888e00/0x40a459093b06b137 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746129577.658283:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f888e00/0x40a459093b06b137 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00000004:00200000:2.0:1746129577.658329:0:14547:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:2.0:1746129577.658475:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f889000/0x40a459093b06b130 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21c5d expref: 323 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129577.658505:0:14547:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f888e00/0x40a459093b06b137 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21c5d expref: 322 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129577.658512:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:2.0:1746129577.658515:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746129577.658517:0:14547:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f888e00, rc 0) 00000100:00100000:2.0:1746129577.658554:0:14547:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013145df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ada2ffba-8920-4ecb-8068-68caa9806978+322:32528:x1830948734322688:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 10372us (10513us total) trans 8589945432 rc 0/0 00000100:00100000:2.0:1746129577.658559:0:14547:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11316 00000100:00100000:0.0:1746129577.676668:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129577.676763:0:14547:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734323072 00000100:00100000:2.0:1746129577.676770:0:14547:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734323072 00000100:00100000:2.0:1746129577.676814:0:14547:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11317 00000100:00100000:2.0:1746129577.676821:0:14547:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135725500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+32:32530:x1830948734323072:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:2.0:1746129577.676842:0:14547:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129577.676858:0:14547:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800951adc00/0x40a459093b06b145 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21c64 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129577.677222:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800951ada00/0x40a459093b06b14c lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746129577.677234:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800951ada00/0x40a459093b06b14c lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746129577.677243:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800951ada00/0x40a459093b06b14c lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00000004:00200000:2.0:1746129577.677278:0:14547:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:2.0:1746129577.677501:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800951adc00/0x40a459093b06b145 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21c64 expref: 35 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129577.677529:0:14547:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800951ada00/0x40a459093b06b14c lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21c64 expref: 34 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129577.677537:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:2.0:1746129577.677539:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746129577.677542:0:14547:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800951ada00, rc 0) 00000100:00100000:2.0:1746129577.678320:0:14547:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135725500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+34:32530:x1830948734323072:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 1498us (1657us total) trans 8589945433 rc 0/0 00000100:00100000:2.0:1746129577.678328:0:14547:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11317 00000100:00100000:0.0:1746129577.722356:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129577.722529:0:11014:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734323200 00000100:00100000:1.0:1746129577.722545:0:11014:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734323200 00000100:00100000:1.0:1746129577.724140:0:11014:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16614 00000100:00100000:1.0:1746129577.724154:0:11014:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135725f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+19:32530:x1830948734323200:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:1.0:1746129577.724171:0:11014:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129577.724186:0:11014:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091799a00/0x40a459093b06b15a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21c6b expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129577.724210:0:11014:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091798200/0x40a459093b06b10d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21c3a expref: 20 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129577.724218:0:11014:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880136b1d600/0x40a459093b06b11b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21c48 expref: 25 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129577.724224:0:11014:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129577.724225:0:11014:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129577.724228:0:11014:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091799a00/0x40a459093b06b15a lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [3194880->3608575] (req 3194880->3608575) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21c6b expref: 20 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129577.724263:0:11014:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880136b1d600/0x40a459093b06b11b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21c48 expref: 25 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129577.724274:0:11014:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880136b1d600/0x40a459093b06b11b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21c48 expref: 25 pid: 7148 timeout: 933 lvb_type: 1 00000100:00100000:1.0:1746129577.724284:0:11014:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cda5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11014:1830948737585152:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129577.725710:0:11014:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091798200/0x40a459093b06b10d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21c3a expref: 20 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129577.725726:0:11014:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091798200/0x40a459093b06b10d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21c3a expref: 20 pid: 8410 timeout: 933 lvb_type: 0 00000100:00100000:1.0:1746129577.725735:0:11014:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cda7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11014:1830948737585280:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129577.725756:0:11014:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0ac780 going to sleep for 11 seconds 00000100:00100000:0.0:1746129577.733011:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129577.733245:0:20578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734323328 00000100:00100000:3.0:1746129577.733262:0:20578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734323328 00010000:00010000:3.0:1746129577.733315:0:20578:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880136b1d600/0x40a459093b06b11b lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21c48 expref: 26 pid: 7148 timeout: 933 lvb_type: 1 00000100:00100000:3.0:1746129577.733346:0:20578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8566 00000100:00100000:3.0:1746129577.733356:0:20578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135727800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ada2ffba-8920-4ecb-8068-68caa9806978+26:1963:x1830948734323328:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129577.733369:0:20578:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129577.733392:0:20578:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880136b1d600/0x40a459093b06b11b lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21c48 expref: 26 pid: 7148 timeout: 933 lvb_type: 1 00010000:00010000:3.0:1746129577.733403:0:20578:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880136b1d600/0x40a459093b06b11b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21c48 expref: 26 pid: 7148 timeout: 933 lvb_type: 1 00010000:00010000:3.0:1746129577.733430:0:20578:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129577.733476:0:20578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135727800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ada2ffba-8920-4ecb-8068-68caa9806978+26:1963:x1830948734323328:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 121us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129577.733483:0:20578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8566 00010000:00010000:1.0:1746129577.733638:0:11014:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136b1d600/0x40a459093b06b11b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21c48 expref: 25 pid: 7148 timeout: 933 lvb_type: 1 00000100:00100000:1.0:1746129577.733665:0:11014:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cda5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11014:1830948737585152:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129577.733677:0:11014:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cda7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11014:1830948737585280:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129577.733702:0:11014:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091799a00/0x40a459093b06b15a lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [3194880->3608575] (req 3194880->3608575) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21c6b expref: 20 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129577.733712:0:11014:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091799a00, rc 0) 00000100:00100000:1.0:1746129577.733735:0:11014:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135725f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:32530:x1830948734323200:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 9587us (11392us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129577.733741:0:11014:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16614 00000100:00100000:0.0:1746129577.735422:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129577.735536:0:15749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734323456 00000100:00100000:3.0:1746129577.735543:0:15749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734323456 00010000:00010000:3.0:1746129577.735570:0:15749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091798200/0x40a459093b06b10d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21c3a expref: 20 pid: 8410 timeout: 933 lvb_type: 0 00000100:00100000:3.0:1746129577.735593:0:15749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8567 00000100:00100000:3.0:1746129577.735598:0:15749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135727b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:1963:x1830948734323456:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129577.735610:0:15749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129577.735629:0:15749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091798200/0x40a459093b06b10d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21c3a expref: 20 pid: 8410 timeout: 933 lvb_type: 0 00010000:00010000:3.0:1746129577.735640:0:15749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091798200/0x40a459093b06b10d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21c3a expref: 20 pid: 8410 timeout: 933 lvb_type: 0 00010000:00010000:3.0:1746129577.735658:0:15749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091798200/0x40a459093b06b10d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21c3a expref: 20 pid: 8410 timeout: 933 lvb_type: 0 00010000:00010000:3.0:1746129577.736450:0:15749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129577.736454:0:15749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129577.736463:0:15749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091799a00/0x40a459093b06b15a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3194880->3608575) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21c6b expref: 19 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129577.736471:0:15749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091799a00/0x40a459093b06b15a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3194880->3608575) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21c6b expref: 19 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129577.736509:0:15749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091799a00/0x40a459093b06b15a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3194880->3608575) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21c6b expref: 19 pid: 11014 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129577.736521:0:15749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15749:1830948737585408:192.168.202.4@tcp:105: 00000100:00100000:3.0:1746129577.737596:0:15749:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa381840 going to sleep for 11 seconds 00000100:00100000:0.0:1746129577.741502:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129577.741660:0:31520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734323712 00000100:00100000:2.0:1746129577.741670:0:31520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734323712 00002000:00100000:2.0:1746129577.741723:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3ef:0x0] (3194880->3198975) req@ffff88009f37d880 x1830948734323712/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:318/0 lens 488/0 e 0 to 0 dl 1746129588 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129577.741733:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f37d880 with x1830948734323712 ext(3194880->3198975) 00002000:00010000:2.0:1746129577.741739:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f37d880 00000100:00100000:2.0:1746129577.741777:0:31520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8036 00000100:00100000:2.0:1746129577.741785:0:31520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f37d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:1963:x1830948734323712:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:3.0:1746129577.741891:0:15749:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15749:1830948737585408:192.168.202.4@tcp:105: 00010000:00010000:3.0:1746129577.741915:0:15749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129577.741968:0:15749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135727b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:1963:x1830948734323456:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 6368us (6552us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129577.741977:0:15749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8567 00000100:00100000:2.0:1746129577.745695:0:31520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f37d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+19:1963:x1830948734323712:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 3899us (4192us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129577.745707:0:31520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8036 00002000:00100000:2.0:1746129577.745717:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3ef:0x0] (3194880->3198975) req@ffff88009f37d880 x1830948734323712/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:318/0 lens 488/4536 e 0 to 0 dl 1746129588 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129577.745727:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f37d880 with x1830948734323712 ext(3194880->3198975) 00002000:00010000:2.0:1746129577.745733:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f37d880 00000100:00100000:0.0:1746129577.754112:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129577.754219:0:31520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734323968 00000100:00100000:2.0:1746129577.754229:0:31520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734323968 00002000:00100000:2.0:1746129577.754327:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3ef:0x0] (3604480->3608575) req@ffff88009f37e680 x1830948734323968/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:318/0 lens 488/0 e 0 to 0 dl 1746129588 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129577.754338:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f37e680 with x1830948734323968 ext(3604480->3608575) 00002000:00010000:2.0:1746129577.754343:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f37e680 00000100:00100000:2.0:1746129577.754384:0:31520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8037 00000100:00100000:2.0:1746129577.754561:0:31520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f37e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+19:1962:x1830948734323968:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:2.0:1746129577.754777:0:31520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f37e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+19:1962:x1830948734323968:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 218us (677us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129577.755659:0:31520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8037 00002000:00100000:2.0:1746129577.755668:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3ef:0x0] (3604480->3608575) req@ffff88009f37e680 x1830948734323968/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:318/0 lens 488/4536 e 0 to 0 dl 1746129588 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129577.755675:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f37e680 with x1830948734323968 ext(3604480->3608575) 00002000:00010000:2.0:1746129577.755679:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f37e680 00000100:00100000:0.0:1746129577.789205:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129577.789395:0:11014:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734324096 00000100:00100000:1.0:1746129577.789405:0:11014:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734324096 00000100:00100000:1.0:1746129577.789467:0:11014:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16615 00000100:00100000:1.0:1746129577.789475:0:11014:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093edfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ada2ffba-8920-4ecb-8068-68caa9806978+34:32528:x1830948734324096:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:1.0:1746129577.789495:0:11014:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129577.789512:0:11014:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091798600/0x40a459093b06b161 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21c72 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129577.789541:0:11014:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a6caf800/0x40a459093b06af8c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21af8 expref: 29 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129577.789551:0:11014:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a77f6e00/0x40a459093b06b08f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21bd8 expref: 6 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129577.789558:0:11014:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095128400/0x40a459093b06affc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21b53 expref: 35 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129577.789564:0:11014:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129577.789566:0:11014:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129577.789569:0:11014:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091798600/0x40a459093b06b161 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [1609728->2097151] (req 1609728->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21c72 expref: 35 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129577.789601:0:11014:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095128400/0x40a459093b06affc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21b53 expref: 35 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129577.789613:0:11014:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095128400/0x40a459093b06affc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21b53 expref: 35 pid: 4385 timeout: 933 lvb_type: 1 00000100:00100000:1.0:1746129577.789624:0:11014:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cda7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11014:1830948737585536:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129577.789739:0:11014:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a77f6e00/0x40a459093b06b08f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21bd8 expref: 6 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129577.789748:0:11014:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a77f6e00/0x40a459093b06b08f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21bd8 expref: 6 pid: 7148 timeout: 933 lvb_type: 1 00000100:00100000:1.0:1746129577.789756:0:11014:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cda5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11014:1830948737585664:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129577.789787:0:11014:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a6caf800/0x40a459093b06af8c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21af8 expref: 29 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129577.789795:0:11014:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a6caf800/0x40a459093b06af8c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21af8 expref: 29 pid: 22481 timeout: 933 lvb_type: 1 00000100:00100000:1.0:1746129577.789802:0:11014:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cda6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11014:1830948737585792:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129577.789816:0:11014:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0ac780 going to sleep for 11 seconds 00000100:00100000:0.0:1746129577.793583:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129577.793918:0:15749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734324224 00000100:00100000:3.0:1746129577.793927:0:15749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734324224 00010000:00010000:3.0:1746129577.793965:0:15749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a77f6e00/0x40a459093b06b08f lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21bd8 expref: 7 pid: 7148 timeout: 933 lvb_type: 1 00000100:00100000:3.0:1746129577.794003:0:15749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8568 00000100:00100000:3.0:1746129577.794011:0:15749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6026450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:068dab75-d300-4ead-a742-d14572ad1e50+7:1962:x1830948734324224:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129577.794026:0:15749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129577.794051:0:15749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a77f6e00/0x40a459093b06b08f lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21bd8 expref: 7 pid: 7148 timeout: 933 lvb_type: 1 00010000:00010000:3.0:1746129577.794062:0:15749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a77f6e00/0x40a459093b06b08f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21bd8 expref: 7 pid: 7148 timeout: 933 lvb_type: 1 00010000:00010000:3.0:1746129577.794091:0:15749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129577.794131:0:15749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6026450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:068dab75-d300-4ead-a742-d14572ad1e50+7:1962:x1830948734324224:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 122us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129577.794137:0:15749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8568 00010000:00010000:1.0:1746129577.794535:0:11014:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a77f6e00/0x40a459093b06b08f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21bd8 expref: 6 pid: 7148 timeout: 933 lvb_type: 1 00000100:00100000:1.0:1746129577.795671:0:11014:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cda5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11014:1830948737585664:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129577.799643:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129577.799680:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129577.799788:0:11014:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cda7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11014:1830948737585536:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129577.799800:0:11014:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cda6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11014:1830948737585792:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129577.799837:0:11014:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091798600/0x40a459093b06b161 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [1609728->2097151] (req 1609728->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21c72 expref: 35 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129577.799857:0:11014:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091798600, rc 0) 00000100:00100000:1.0:1746129577.799907:0:11014:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093edfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ada2ffba-8920-4ecb-8068-68caa9806978+35:32528:x1830948734324096:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 10432us (10711us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129577.799916:0:11014:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16615 00000100:00100000:0.0:1746129577.800095:0:20578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734324352 00000100:00100000:0.0:1746129577.800104:0:20578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734324352 00010000:00010000:0.0:1746129577.800136:0:20578:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6caf800/0x40a459093b06af8c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21af8 expref: 30 pid: 22481 timeout: 933 lvb_type: 1 00000100:00100000:0.0:1746129577.800157:0:20578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734324480 00000100:00100000:0.0:1746129577.800159:0:20578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734324480 00010000:00010000:0.0:1746129577.800170:0:20578:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095128400/0x40a459093b06affc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21b53 expref: 35 pid: 4385 timeout: 933 lvb_type: 1 00000100:00100000:0.0:1746129577.800185:0:20578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8569 00000100:00100000:0.0:1746129577.800192:0:20578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013145e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+30:1963:x1830948734324352:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129577.800206:0:20578:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129577.800231:0:20578:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a6caf800/0x40a459093b06af8c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21af8 expref: 30 pid: 22481 timeout: 933 lvb_type: 1 00010000:00010000:0.0:1746129577.800240:0:20578:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a6caf800/0x40a459093b06af8c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21af8 expref: 30 pid: 22481 timeout: 933 lvb_type: 1 00010000:00010000:0.0:1746129577.800274:0:20578:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a6caf800/0x40a459093b06af8c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21af8 expref: 30 pid: 22481 timeout: 933 lvb_type: 1 00010000:00010000:0.0:1746129577.800314:0:20578:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129577.800337:0:20578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013145e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+29:1963:x1830948734324352:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 144us (706us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129577.800343:0:20578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8569 00000100:00100000:0.0:1746129577.800356:0:20578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8570 00000100:00100000:0.0:1746129577.800360:0:20578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013145f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ada2ffba-8920-4ecb-8068-68caa9806978+35:1963:x1830948734324480:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129577.800366:0:20578:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129577.800373:0:20578:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095128400/0x40a459093b06affc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21b53 expref: 35 pid: 4385 timeout: 933 lvb_type: 1 00010000:00010000:0.0:1746129577.800381:0:20578:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095128400/0x40a459093b06affc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21b53 expref: 35 pid: 4385 timeout: 933 lvb_type: 1 00010000:00010000:0.0:1746129577.800392:0:20578:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095128400/0x40a459093b06affc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21b53 expref: 35 pid: 4385 timeout: 933 lvb_type: 1 00010000:00010000:0.0:1746129577.800404:0:20578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129577.800407:0:20578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129577.800413:0:20578:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091798600/0x40a459093b06b161 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1609728->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21c72 expref: 34 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129577.800420:0:20578:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091798600/0x40a459093b06b161 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1609728->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21c72 expref: 34 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129577.800452:0:20578:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091798600/0x40a459093b06b161 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1609728->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21c72 expref: 34 pid: 11014 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129577.800465:0:20578:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094efd180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:20578:1830948737585920:192.168.202.4@tcp:105: 00000100:00100000:0.0:1746129577.800518:0:20578:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009cdf3f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746129577.809695:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129577.810372:0:11014:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734324608 00000100:00100000:1.0:1746129577.810381:0:11014:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734324608 00000100:00100000:1.0:1746129577.810443:0:11014:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16616 00000100:00100000:1.0:1746129577.810452:0:11014:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094efdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+29:1962:x1830948734324608:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129577.810472:0:11014:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129577.810490:0:11014:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091798a00/0x40a459093b06b168 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21c79 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129577.810548:0:11014:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cda6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11014:1830948737586048:192.168.202.4@tcp:106: 00000100:00100000:1.0:1746129577.810624:0:11014:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0ac780 going to sleep for 11 seconds 00000100:00100000:2.0:1746129577.811214:0:20578:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094efd180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:20578:1830948737585920:192.168.202.4@tcp:105: 00010000:00010000:2.0:1746129577.811232:0:20578:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129577.811275:0:20578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013145f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ada2ffba-8920-4ecb-8068-68caa9806978+34:1963:x1830948734324480:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 10913us (11594us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129577.811288:0:20578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8570 00000100:00100000:0.0:1746129577.811465:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129577.811937:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734324736 00000100:00100000:3.0:1746129577.811943:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734324736 00000100:00100000:3.0:1746129577.811980:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16617 00000100:00100000:3.0:1746129577.811986:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094efce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ada2ffba-8920-4ecb-8068-68caa9806978+34:32528:x1830948734324736:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:3.0:1746129577.811997:0:7148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129577.812010:0:7148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a6cae400/0x40a459093b06b16f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21c80 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129577.812031:0:7148:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a6caec00/0x40a459093b06af7e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21aff expref: 30 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129577.812039:0:7148:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f119000/0x40a459093b06b096 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21bdf expref: 5 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129577.812045:0:7148:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095129400/0x40a459093b06aff5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21b5a expref: 35 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129577.812057:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129577.812058:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129577.812062:0:7148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6cae400/0x40a459093b06b16f lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [1048576->1257471] (req 1048576->1257471) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21c80 expref: 35 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129577.812082:0:7148:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095129400/0x40a459093b06aff5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21b5a expref: 35 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129577.812095:0:7148:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095129400/0x40a459093b06aff5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21b5a expref: 35 pid: 4385 timeout: 933 lvb_type: 1 00000100:00100000:3.0:1746129577.812105:0:7148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:7148:1830948737586176:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129577.812165:0:7148:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f119000/0x40a459093b06b096 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21bdf expref: 5 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129577.812173:0:7148:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f119000/0x40a459093b06b096 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21bdf expref: 5 pid: 7148 timeout: 933 lvb_type: 1 00000100:00100000:3.0:1746129577.812182:0:7148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:7148:1830948737586304:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129577.812206:0:7148:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a6caec00/0x40a459093b06af7e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21aff expref: 30 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129577.812213:0:7148:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a6caec00/0x40a459093b06af7e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21aff expref: 30 pid: 22481 timeout: 933 lvb_type: 1 00000100:00100000:3.0:1746129577.812226:0:7148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:7148:1830948737586432:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129577.812241:0:7148:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa381f00 going to sleep for 11 seconds 00002000:00010000:1.0:1746129577.812680:0:11014:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb mtime: 1746129576 -> 1746129578 00002000:00010000:1.0:1746129577.812683:0:11014:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb atime: 1746129576 -> 1746129578 00002000:00010000:1.0:1746129577.812685:0:11014:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb ctime: 1746129576 -> 1746129578 00000100:00100000:1.0:1746129577.812705:0:11014:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cda6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11014:1830948737586048:192.168.202.4@tcp:106: 00010000:00010000:1.0:1746129577.812725:0:11014:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091798a00/0x40a459093b06b168 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21c79 expref: 30 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129577.812735:0:11014:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091798a00/0x40a459093b06b168 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21c79 expref: 30 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129577.813755:0:11014:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091798a00, rc 0) 00000100:00100000:1.0:1746129577.813796:0:11014:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094efdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+29:1962:x1830948734324608:12345-192.168.202.4@tcp:101:cat.0 Request processed in 3344us (4110us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129577.813803:0:11014:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16616 00000100:00100000:0.0:1746129577.814545:0:7148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:7148:1830948737586176:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129577.814556:0:7148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:7148:1830948737586432:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129577.816128:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129577.820933:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129577.821935:0:20578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734324864 00000100:00100000:2.0:1746129577.821946:0:20578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734324864 00010000:00010000:3.0:1746129577.822059:0:20578:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095129400/0x40a459093b06aff5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21b5a expref: 36 pid: 4385 timeout: 933 lvb_type: 1 00000100:00100000:3.0:1746129577.822546:0:20578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8571 00000100:00100000:3.0:1746129577.822554:0:20578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094efd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ada2ffba-8920-4ecb-8068-68caa9806978+36:1962:x1830948734324864:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129577.822569:0:20578:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129577.822592:0:20578:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095129400/0x40a459093b06aff5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21b5a expref: 36 pid: 4385 timeout: 933 lvb_type: 1 00010000:00010000:3.0:1746129577.822604:0:20578:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095129400/0x40a459093b06aff5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21b5a expref: 36 pid: 4385 timeout: 933 lvb_type: 1 00010000:00010000:3.0:1746129577.822629:0:20578:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095129400/0x40a459093b06aff5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21b5a expref: 36 pid: 4385 timeout: 933 lvb_type: 1 00000100:00100000:0.0:1746129577.822779:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734324992 00000100:00100000:0.0:1746129577.822784:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734324992 00010000:00010000:0.0:1746129577.822799:0:9823:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6caec00/0x40a459093b06af7e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21aff expref: 29 pid: 22481 timeout: 933 lvb_type: 1 00000100:00100000:0.0:1746129577.822816:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8572 00000100:00100000:0.0:1746129577.822820:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cda6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+29:1962:x1830948734324992:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129577.822829:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129577.822837:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a6caec00/0x40a459093b06af7e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21aff expref: 29 pid: 22481 timeout: 933 lvb_type: 1 00010000:00010000:0.0:1746129577.822845:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a6caec00/0x40a459093b06af7e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21aff expref: 29 pid: 22481 timeout: 933 lvb_type: 1 00010000:00010000:0.0:1746129577.822856:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a6caec00/0x40a459093b06af7e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21aff expref: 29 pid: 22481 timeout: 933 lvb_type: 1 00010000:00010000:0.0:1746129577.822878:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129577.822916:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cda6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+28:1962:x1830948734324992:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 95us (1994us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129577.822922:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8572 00000100:00100000:1.0:1746129577.823098:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129577.823120:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734325120 00000100:00100000:1.0:1746129577.823123:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734325120 00010000:00010000:1.0:1746129577.823138:0:7087:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f119000/0x40a459093b06b096 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21bdf expref: 6 pid: 7148 timeout: 933 lvb_type: 1 00000100:00100000:1.0:1746129577.823150:0:7087:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8573 00000100:00100000:1.0:1746129577.823155:0:7087:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cda7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:068dab75-d300-4ead-a742-d14572ad1e50+6:1961:x1830948734325120:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129577.823161:0:7087:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129577.823169:0:7087:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f119000/0x40a459093b06b096 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21bdf expref: 6 pid: 7148 timeout: 933 lvb_type: 1 00010000:00010000:1.0:1746129577.823178:0:7087:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f119000/0x40a459093b06b096 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21bdf expref: 6 pid: 7148 timeout: 933 lvb_type: 1 00010000:00010000:1.0:1746129577.823188:0:7087:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129577.823190:0:7087:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129577.823197:0:7087:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a6cae400/0x40a459093b06b16f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1257471) gid 0 flags: 0x50080000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21c80 expref: 35 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129577.823205:0:7087:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6cae400/0x40a459093b06b16f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1257471) gid 0 flags: 0x50080000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21c80 expref: 35 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129577.823232:0:7087:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a6cae400/0x40a459093b06b16f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1257471) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21c80 expref: 35 pid: 7148 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129577.823243:0:7087:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cda5c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7087:1830948737586560:192.168.202.4@tcp:105: 00000100:00100000:1.0:1746129577.823328:0:7087:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0ac780 going to sleep for 11 seconds 00010000:00010000:0.0:1746129577.823639:0:7148:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f119000/0x40a459093b06b096 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21bdf expref: 6 pid: 7148 timeout: 933 lvb_type: 1 00000100:00100000:0.0:1746129577.823650:0:7148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:7148:1830948737586304:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129577.823714:0:7148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a6cae400/0x40a459093b06b16f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1257471) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21c80 expref: 35 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129577.823723:0:7148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6cae400, rc 0) 00000100:00100000:0.0:1746129577.823744:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094efce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ada2ffba-8920-4ecb-8068-68caa9806978+35:32528:x1830948734324736:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 11758us (12279us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129577.823751:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16617 00010000:00010000:3.0:1746129577.824019:0:20578:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129577.824045:0:20578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094efd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ada2ffba-8920-4ecb-8068-68caa9806978+34:1962:x1830948734324864:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 1492us (7924us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129577.824050:0:20578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8571 00000100:00100000:0.0:1746129577.827713:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129577.829637:0:7087:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cda5c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7087:1830948737586560:192.168.202.4@tcp:105: 00010000:00010000:1.0:1746129577.829659:0:7087:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129577.829701:0:7087:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cda7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:068dab75-d300-4ead-a742-d14572ad1e50+5:1961:x1830948734325120:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 6545us (6602us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129577.829712:0:7087:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8573 00000100:00100000:2.0:1746129577.829832:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734325248 00000100:00100000:2.0:1746129577.829839:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734325248 00000100:00100000:2.0:1746129577.829875:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16618 00000100:00100000:2.0:1746129577.829881:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800915d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+28:32536:x1830948734325248:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129577.829898:0:7148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129577.829914:0:7148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800951ade00/0x40a459093b06b176 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21c87 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129577.829940:0:7148:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091798600/0x40a459093b06b161 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1609728->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21c72 expref: 33 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129577.829947:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129577.829948:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129577.829952:0:7148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800951ade00/0x40a459093b06b176 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21c87 expref: 29 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129577.829976:0:7148:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091798600/0x40a459093b06b161 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1609728->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21c72 expref: 33 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129577.829986:0:7148:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091798600/0x40a459093b06b161 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1609728->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21c72 expref: 33 pid: 11014 timeout: 933 lvb_type: 0 00000100:00100000:2.0:1746129577.829997:0:7148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013145ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:7148:1830948737586688:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129577.830056:0:7148:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132f36f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746129577.830111:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129577.830694:0:31520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734325504 00000100:00100000:3.0:1746129577.830699:0:31520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734325504 00002000:00100000:3.0:1746129577.830726:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3f4:0x0] (1253376->1257471) req@ffff8800915d0380 x1830948734325504/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:318/0 lens 488/0 e 0 to 0 dl 1746129588 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129577.830741:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800915d0380 with x1830948734325504 ext(1253376->1257471) 00002000:00010000:3.0:1746129577.830745:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800915d0380 00000100:00100000:3.0:1746129577.830768:0:31520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8038 00000100:00100000:3.0:1746129577.830773:0:31520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800915d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ada2ffba-8920-4ecb-8068-68caa9806978+34:1963:x1830948734325504:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:3.0:1746129577.830908:0:31520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800915d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ada2ffba-8920-4ecb-8068-68caa9806978+34:1963:x1830948734325504:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 135us (797us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129577.830913:0:31520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8038 00002000:00100000:3.0:1746129577.830917:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3f4:0x0] (1253376->1257471) req@ffff8800915d0380 x1830948734325504/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:318/0 lens 488/4536 e 0 to 0 dl 1746129588 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129577.830923:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800915d0380 with x1830948734325504 ext(1253376->1257471) 00002000:00010000:3.0:1746129577.830926:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800915d0380 00000100:00100000:0.0:1746129577.833005:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129577.833173:0:21725:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734325632 00000100:00100000:1.0:1746129577.833180:0:21725:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734325632 00002000:00100000:1.0:1746129577.833210:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f3:0x0] (1609728->2097151) req@ffff8800915d0700 x1830948734325632/t0(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:318/0 lens 488/0 e 0 to 0 dl 1746129588 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129577.833219:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800915d0700 with x1830948734325632 ext(1609728->2097151) 00010000:00010000:1.0:1746129577.833229:0:21725:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091798600/0x40a459093b06b161 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1609728->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21c72 expref: 34 pid: 11014 timeout: 933 lvb_type: 0 00010000:00010000:1.0:1746129577.833242:0:21725:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091798600/0x40a459093b06b161 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1609728->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21c72 expref: 34 pid: 11014 timeout: 933 lvb_type: 0 00002000:00010000:1.0:1746129577.833248:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800915d0700 00000100:00100000:2.0:1746129577.834018:0:7148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013145ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:7148:1830948737586688:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129577.834044:0:7148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800951ade00/0x40a459093b06b176 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21c87 expref: 29 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129577.834058:0:7148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800951ade00, rc 0) 00000100:00100000:0.0:1746129577.834318:0:21725:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2488 00000100:00100000:0.0:1746129577.834326:0:21725:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800915d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ada2ffba-8920-4ecb-8068-68caa9806978+34:1962:x1830948734325632:12345-192.168.202.4@tcp:4:multiop.0 00000100:00100000:3.0:1746129577.837013:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800915d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+29:32536:x1830948734325248:12345-192.168.202.4@tcp:101:cat.0 Request processed in 7120us (9299us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129577.837024:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16618 00000100:00100000:2.0:1746129577.848971:0:21725:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800915d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ada2ffba-8920-4ecb-8068-68caa9806978+36:1962:x1830948734325632:12345-192.168.202.4@tcp:4:multiop.0 Request processed in 14634us (15961us total) trans 17179874163 rc 0/0 00000100:00100000:2.0:1746129577.848983:0:21725:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2488 00002000:00100000:2.0:1746129577.848994:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f3:0x0] (1609728->2097151) req@ffff8800915d0700 x1830948734325632/t17179874163(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:318/0 lens 488/448 e 0 to 0 dl 1746129588 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129577.849004:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800915d0700 with x1830948734325632 ext(1609728->2097151) 00010000:00010000:2.0:1746129577.849014:0:21725:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091798600/0x40a459093b06b161 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1609728->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21c72 expref: 36 pid: 11014 timeout: 933 lvb_type: 0 00010000:00010000:2.0:1746129577.849031:0:21725:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091798600/0x40a459093b06b161 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1609728->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21c72 expref: 36 pid: 11014 timeout: 933 lvb_type: 0 00002000:00010000:2.0:1746129577.849038:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800915d0700 00000100:00100000:0.0:1746129577.851487:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129577.851758:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734325760 00000100:00100000:1.0:1746129577.851767:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734325760 00010000:00010000:1.0:1746129577.851807:0:7087:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091798600/0x40a459093b06b161 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1609728->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21c72 expref: 36 pid: 11014 timeout: 933 lvb_type: 0 00000100:00100000:1.0:1746129577.851849:0:7087:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8574 00000100:00100000:1.0:1746129577.851855:0:7087:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800915d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ada2ffba-8920-4ecb-8068-68caa9806978+36:1960:x1830948734325760:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129577.851871:0:7087:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129577.851893:0:7087:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091798600/0x40a459093b06b161 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1609728->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21c72 expref: 36 pid: 11014 timeout: 933 lvb_type: 0 00010000:00010000:1.0:1746129577.851905:0:7087:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091798600/0x40a459093b06b161 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1609728->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21c72 expref: 36 pid: 11014 timeout: 933 lvb_type: 0 00010000:00010000:1.0:1746129577.851928:0:7087:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091798600/0x40a459093b06b161 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1609728->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21c72 expref: 36 pid: 11014 timeout: 933 lvb_type: 0 00010000:00010000:1.0:1746129577.851962:0:7087:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129577.851964:0:7087:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129577.851972:0:7087:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800951ade00/0x40a459093b06b176 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21c87 expref: 28 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129577.851980:0:7087:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800951ade00/0x40a459093b06b176 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21c87 expref: 28 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129577.852014:0:7087:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800951ade00/0x40a459093b06b176 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21c87 expref: 28 pid: 7148 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129577.852027:0:7087:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cda5c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7087:1830948737586816:192.168.202.4@tcp:105: 00000100:00100000:1.0:1746129577.852102:0:7087:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0ac780 going to sleep for 11 seconds 00000100:00100000:0.0:1746129577.856965:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129577.857056:0:21725:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734326016 00000100:00100000:3.0:1746129577.857066:0:21725:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734326016 00002000:00100000:3.0:1746129577.857116:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff8800915d0e00 x1830948734326016/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:318/0 lens 488/0 e 0 to 0 dl 1746129588 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129577.857126:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800915d0e00 with x1830948734326016 ext(1048576->2097151) 00002000:00010000:3.0:1746129577.857131:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800915d0e00 00000100:00100000:3.0:1746129577.857153:0:21725:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8039 00000100:00100000:3.0:1746129577.857161:0:21725:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800915d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+29:1963:x1830948734326016:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:1.0:1746129577.858588:0:7087:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cda5c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7087:1830948737586816:192.168.202.4@tcp:105: 00010000:00010000:1.0:1746129577.858609:0:7087:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129577.858637:0:7087:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800915d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ada2ffba-8920-4ecb-8068-68caa9806978+35:1960:x1830948734325760:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 6782us (7160us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129577.858648:0:7087:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8574 00000100:00100000:3.0:1746129577.866871:0:21725:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800915d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+29:1963:x1830948734326016:12345-192.168.202.4@tcp:3:cat.0 Request processed in 9292us (9500us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129577.866885:0:21725:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8039 00002000:00100000:3.0:1746129577.866897:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff8800915d0e00 x1830948734326016/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:318/0 lens 488/440 e 0 to 0 dl 1746129588 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129577.866906:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800915d0e00 with x1830948734326016 ext(1048576->2097151) 00002000:00010000:3.0:1746129577.866912:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800915d0e00 00000100:00100000:0.0:1746129577.872458:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129577.872528:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734326144 00000100:00100000:3.0:1746129577.872538:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734326144 00000100:00100000:3.0:1746129577.872601:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16619 00000100:00100000:3.0:1746129577.872609:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800915d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+29:32536:x1830948734326144:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129577.872629:0:7148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129577.872650:0:7148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b5263800/0x40a459093b06b17d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21c8e expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129577.872682:0:7148:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a6cae400/0x40a459093b06b16f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1257471) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21c80 expref: 34 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129577.872689:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129577.872690:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129577.872693:0:7148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b5263800/0x40a459093b06b17d lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21c8e expref: 30 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129577.872726:0:7148:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a6cae400/0x40a459093b06b16f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1257471) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21c80 expref: 34 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129577.872739:0:7148:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a6cae400/0x40a459093b06b16f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1257471) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21c80 expref: 34 pid: 7148 timeout: 933 lvb_type: 0 00000100:00100000:3.0:1746129577.872755:0:7148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:7148:1830948737586944:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129577.872852:0:7148:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa381180 going to sleep for 11 seconds 00000100:00100000:3.0:1746129577.877124:0:7148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:7148:1830948737586944:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129577.877163:0:7148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b5263800/0x40a459093b06b17d lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21c8e expref: 30 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129577.877184:0:7148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b5263800, rc 0) 00000100:00100000:3.0:1746129577.877235:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800915d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+30:32536:x1830948734326144:12345-192.168.202.4@tcp:101:cat.0 Request processed in 4625us (4786us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129577.877245:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16619 00000100:00100000:0.0:1746129577.879520:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129577.879891:0:21725:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734326272 00000100:00100000:3.0:1746129577.879901:0:21725:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734326272 00002000:00100000:3.0:1746129577.879948:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f4:0x0] (1048576->1257471) req@ffff8800915d1500 x1830948734326272/t0(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:318/0 lens 488/0 e 0 to 0 dl 1746129588 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129577.879957:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800915d1500 with x1830948734326272 ext(1048576->1257471) 00010000:00010000:3.0:1746129577.879967:0:21725:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a6cae400/0x40a459093b06b16f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1257471) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21c80 expref: 35 pid: 7148 timeout: 933 lvb_type: 0 00010000:00010000:3.0:1746129577.879981:0:21725:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a6cae400/0x40a459093b06b16f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1257471) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21c80 expref: 35 pid: 7148 timeout: 933 lvb_type: 0 00002000:00010000:3.0:1746129577.879988:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800915d1500 00000100:00100000:3.0:1746129577.880009:0:21725:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2489 00000100:00100000:3.0:1746129577.880016:0:21725:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800915d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ada2ffba-8920-4ecb-8068-68caa9806978+35:1962:x1830948734326272:12345-192.168.202.4@tcp:4:multiop.0 00000100:00100000:3.0:1746129577.886751:0:21725:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800915d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ada2ffba-8920-4ecb-8068-68caa9806978+37:1962:x1830948734326272:12345-192.168.202.4@tcp:4:multiop.0 Request processed in 6723us (7226us total) trans 17179874164 rc 0/0 00000100:00100000:3.0:1746129577.886763:0:21725:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2489 00002000:00100000:3.0:1746129577.886776:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f4:0x0] (1048576->1257471) req@ffff8800915d1500 x1830948734326272/t17179874164(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:318/0 lens 488/448 e 0 to 0 dl 1746129588 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129577.886784:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800915d1500 with x1830948734326272 ext(1048576->1257471) 00010000:00010000:3.0:1746129577.886795:0:21725:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a6cae400/0x40a459093b06b16f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1257471) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21c80 expref: 37 pid: 7148 timeout: 933 lvb_type: 0 00010000:00010000:3.0:1746129577.886811:0:21725:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a6cae400/0x40a459093b06b16f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1257471) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21c80 expref: 37 pid: 7148 timeout: 933 lvb_type: 0 00002000:00010000:3.0:1746129577.886818:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800915d1500 00000100:00100000:0.0:1746129577.893781:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129577.894466:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734326400 00000100:00100000:1.0:1746129577.894477:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734326400 00010000:00010000:1.0:1746129577.894518:0:7087:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6cae400/0x40a459093b06b16f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1257471) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21c80 expref: 37 pid: 7148 timeout: 933 lvb_type: 0 00000100:00100000:1.0:1746129577.894566:0:7087:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8575 00000100:00100000:1.0:1746129577.894575:0:7087:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6026050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ada2ffba-8920-4ecb-8068-68caa9806978+37:1961:x1830948734326400:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129577.894591:0:7087:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746129577.894611:0:7087:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb mtime from disk: 1746129576 -> 1746129578 00002000:00010000:1.0:1746129577.894614:0:7087:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb ctime from disk: 1746129576 -> 1746129578 00010000:00010000:1.0:1746129577.894625:0:7087:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a6cae400/0x40a459093b06b16f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1257471) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21c80 expref: 37 pid: 7148 timeout: 933 lvb_type: 0 00010000:00010000:1.0:1746129577.894638:0:7087:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a6cae400/0x40a459093b06b16f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1257471) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21c80 expref: 37 pid: 7148 timeout: 933 lvb_type: 0 00010000:00010000:1.0:1746129577.894663:0:7087:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a6cae400/0x40a459093b06b16f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1257471) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21c80 expref: 37 pid: 7148 timeout: 933 lvb_type: 0 00010000:00010000:1.0:1746129577.894693:0:7087:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129577.894695:0:7087:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129577.894703:0:7087:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b5263800/0x40a459093b06b17d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21c8e expref: 29 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129577.894711:0:7087:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b5263800/0x40a459093b06b17d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21c8e expref: 29 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129577.894949:0:7087:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800b5263800/0x40a459093b06b17d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21c8e expref: 29 pid: 7148 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129577.894967:0:7087:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cda5c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7087:1830948737587072:192.168.202.4@tcp:105: 00000100:00100000:1.0:1746129577.895046:0:7087:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0ac780 going to sleep for 11 seconds 00000100:00100000:2.0:1746129577.898832:0:7087:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cda5c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7087:1830948737587072:192.168.202.4@tcp:105: 00010000:00010000:2.0:1746129577.898858:0:7087:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129577.898906:0:7087:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6026050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ada2ffba-8920-4ecb-8068-68caa9806978+36:1961:x1830948734326400:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 4330us (5135us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129577.898918:0:7087:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8575 00000100:00100000:0.0:1746129577.901865:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129577.901942:0:21725:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734326656 00000100:00100000:3.0:1746129577.901952:0:21725:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734326656 00002000:00100000:3.0:1746129577.901998:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f4:0x0] (1048576->2097151) req@ffff8800915d1880 x1830948734326656/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:318/0 lens 488/0 e 0 to 0 dl 1746129588 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129577.902008:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800915d1880 with x1830948734326656 ext(1048576->2097151) 00002000:00010000:3.0:1746129577.902014:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800915d1880 00000100:00100000:3.0:1746129577.902044:0:21725:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8040 00000100:00100000:3.0:1746129577.902053:0:21725:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800915d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+30:1963:x1830948734326656:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:3.0:1746129577.912560:0:21725:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800915d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+30:1963:x1830948734326656:12345-192.168.202.4@tcp:3:cat.0 Request processed in 10497us (10692us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129577.912572:0:21725:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8040 00002000:00100000:3.0:1746129577.912585:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f4:0x0] (1048576->2097151) req@ffff8800915d1880 x1830948734326656/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:318/0 lens 488/440 e 0 to 0 dl 1746129588 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129577.912594:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800915d1880 with x1830948734326656 ext(1048576->2097151) 00002000:00010000:3.0:1746129577.912600:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800915d1880 00000100:00100000:0.0:1746129577.916783:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129577.916831:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129577.916884:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129577.916933:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734326784 00000100:00100000:3.0:1746129577.916944:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734326784 00000100:00100000:3.0:1746129577.916984:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734326912 00000100:00100000:3.0:1746129577.916986:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734326912 00000100:00100000:3.0:1746129577.916996:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734327040 00000100:00100000:3.0:1746129577.916998:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734327040 00000100:00100000:3.0:1746129577.917016:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16620 00000100:00100000:3.0:1746129577.917022:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800915d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ada2ffba-8920-4ecb-8068-68caa9806978+37:1963:x1830948734326784:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129577.917036:0:7148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129577.917051:0:7148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f119000/0x40a459093b06b184 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21c95 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129577.917069:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129577.917071:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129577.917078:0:7148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f119000/0x40a459093b06b184 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21c95 expref: 38 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129577.917090:0:7148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f119000/0x40a459093b06b184 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21c95 expref: 38 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129577.917099:0:7148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f119000, rc 0) 00000100:00100000:3.0:1746129577.917145:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800915d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ada2ffba-8920-4ecb-8068-68caa9806978+38:1963:x1830948734326784:12345-192.168.202.4@tcp:101:cat.0 Request processed in 123us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129577.917150:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16620 00000100:00100000:3.0:1746129577.917163:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16621 00000100:00100000:3.0:1746129577.917167:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800915d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ada2ffba-8920-4ecb-8068-68caa9806978+37:1963:x1830948734326912:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129577.917173:0:7148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129577.917178:0:7148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095129400/0x40a459093b06b18b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21c9c expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129577.917187:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129577.917188:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129577.917191:0:7148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095129400/0x40a459093b06b18b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21c9c expref: 38 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129577.917199:0:7148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095129400/0x40a459093b06b18b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21c9c expref: 38 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129577.917218:0:7148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095129400, rc 0) 00000100:00100000:3.0:1746129577.917233:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800915d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ada2ffba-8920-4ecb-8068-68caa9806978+38:1963:x1830948734326912:12345-192.168.202.4@tcp:101:cat.0 Request processed in 65us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129577.917237:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16621 00000100:00100000:3.0:1746129577.917246:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16622 00000100:00100000:3.0:1746129577.917262:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800915d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ada2ffba-8920-4ecb-8068-68caa9806978+25:1963:x1830948734327040:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129577.917269:0:7148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129577.917277:0:7148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095128400/0x40a459093b06b192 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21ca3 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129577.917341:0:7148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7148:1830948737587200:192.168.202.4@tcp:106: 00000100:00100000:3.0:1746129577.917390:0:7148:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa381180 going to sleep for 11 seconds 00000100:00100000:3.0:1746129577.923109:0:7148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7148:1830948737587200:192.168.202.4@tcp:106: 00010000:00010000:3.0:1746129577.923145:0:7148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095128400/0x40a459093b06b192 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21ca3 expref: 26 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129577.923160:0:7148:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095128400/0x40a459093b06b192 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21ca3 expref: 26 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129577.923264:0:7148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095128400, rc 0) 00000100:00100000:3.0:1746129577.923375:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800915d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ada2ffba-8920-4ecb-8068-68caa9806978+25:1963:x1830948734327040:12345-192.168.202.4@tcp:101:cat.0 Request processed in 6121us (6487us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129577.923381:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16622 00000100:00100000:0.0:1746129577.932779:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129577.932833:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129577.934479:0:21725:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734327296 00000100:00100000:3.0:1746129577.934494:0:21725:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734327296 00002000:00100000:3.0:1746129577.934547:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ef:0x0] (2097152->3145727) req@ffff8800915d2680 x1830948734327296/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:318/0 lens 488/0 e 0 to 0 dl 1746129588 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129577.934557:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800915d2680 with x1830948734327296 ext(2097152->3145727) 00002000:00010000:3.0:1746129577.934562:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800915d2680 00000100:00100000:3.0:1746129577.934595:0:21725:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734327552 00000100:00100000:3.0:1746129577.934598:0:21725:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734327552 00002000:00100000:3.0:1746129577.934608:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->4194303) req@ffff8800915d2a00 x1830948734327552/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:318/0 lens 504/0 e 0 to 0 dl 1746129588 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129577.934615:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800915d2a00 with x1830948734327552 ext(3145728->4194303) 00002000:00010000:3.0:1746129577.934617:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800915d2a00 00000100:00100000:3.0:1746129577.934634:0:21725:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8041 00000100:00100000:3.0:1746129577.934640:0:21725:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800915d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:1960:x1830948734327296:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:1.0:1746129577.938599:0:31520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8042 00000100:00100000:1.0:1746129577.938621:0:31520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800915d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:1960:x1830948734327552:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129577.941777:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129577.941808:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734327808 00000100:00100000:0.0:1746129577.941817:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734327808 00002000:00100000:0.0:1746129577.941877:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff8800915d2d80 x1830948734327808/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:318/0 lens 488/0 e 0 to 0 dl 1746129588 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129577.941888:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800915d2d80 with x1830948734327808 ext(1048576->2097151) 00002000:00010000:0.0:1746129577.941895:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800915d2d80 00000100:00100000:0.0:1746129577.941922:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8043 00000100:00100000:0.0:1746129577.941930:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800915d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+38:1962:x1830948734327808:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:1.0:1746129577.942273:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129577.942322:0:8417:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734328064 00000100:00100000:1.0:1746129577.942325:0:8417:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734328064 00002000:00100000:1.0:1746129577.942348:0:8417:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3f4:0x0] (1048576->2097151) req@ffff88012cda6680 x1830948734328064/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:318/0 lens 488/0 e 0 to 0 dl 1746129588 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129577.942355:0:8417:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cda6680 with x1830948734328064 ext(1048576->2097151) 00002000:00010000:1.0:1746129577.942358:0:8417:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012cda6680 00000100:00100000:1.0:1746129577.942371:0:8417:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8044 00000100:00100000:1.0:1746129577.942376:0:8417:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cda6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ada2ffba-8920-4ecb-8068-68caa9806978+39:1962:x1830948734328064:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129577.960499:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129577.962944:0:14547:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734328192 00000100:00100000:2.0:1746129577.962960:0:14547:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734328192 00000100:00100000:2.0:1746129577.963020:0:14547:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11318 00000100:00100000:2.0:1746129577.963029:0:14547:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800915d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:068dab75-d300-4ead-a742-d14572ad1e50+28:32541:x1830948734328192:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:2.0:1746129577.963055:0:14547:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129577.963074:0:14547:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fba4e00/0x40a459093b06b199 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21caa expref: -99 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129577.963144:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fba5000/0x40a459093b06b1a0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746129577.963158:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fba5000/0x40a459093b06b1a0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746129577.963170:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fba5000/0x40a459093b06b1a0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746129577.963183:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fba5200/0x40a459093b06b1a7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746129577.963188:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fba5200/0x40a459093b06b1a7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746129577.963193:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fba5200/0x40a459093b06b1a7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746129577.963324:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fba5400/0x40a459093b06b1ae lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746129577.963333:0:14547:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f888e00/0x40a459093b06b137 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21c5d expref: 321 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129577.963340:0:14547:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800951ada00/0x40a459093b06b14c lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21c64 expref: 33 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129577.963345:0:14547:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fba5400/0x40a459093b06b1ae lrc: 5/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746129577.963376:0:14547:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800951ada00/0x40a459093b06b14c lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21c64 expref: 33 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129577.963387:0:14547:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800951ada00/0x40a459093b06b14c lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21c64 expref: 33 pid: 14547 timeout: 933 lvb_type: 0 00000100:00100000:2.0:1746129577.963398:0:14547:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013145e680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14547:1830948737587328:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129577.964016:0:14547:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f888e00/0x40a459093b06b137 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21c5d expref: 321 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129577.964024:0:14547:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f888e00/0x40a459093b06b137 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21c5d expref: 321 pid: 14547 timeout: 933 lvb_type: 0 00000100:00100000:2.0:1746129577.964032:0:14547:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013145f100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14547:1830948737587456:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129577.964055:0:14547:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132f369c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746129577.964632:0:21725:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800915d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:1960:x1830948734327296:12345-192.168.202.4@tcp:3:cat.0 Request processed in 29990us (31860us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129577.964632:0:31520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800915d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:1960:x1830948734327552:12345-192.168.202.4@tcp:3:cat.0 Request processed in 26019us (31796us total) trans 0 rc 634880/634880 00000100:00100000:3.0:1746129577.964642:0:21725:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8041 00002000:00100000:3.0:1746129577.964655:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ef:0x0] (2097152->3145727) req@ffff8800915d2680 x1830948734327296/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:318/0 lens 488/440 e 0 to 0 dl 1746129588 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129577.964665:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800915d2680 with x1830948734327296 ext(2097152->3145727) 00002000:00010000:3.0:1746129577.964670:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800915d2680 00000100:00100000:1.0:1746129577.965566:0:31520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8042 00002000:00100000:1.0:1746129577.965575:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->4194303) req@ffff8800915d2a00 x1830948734327552/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:318/0 lens 504/440 e 0 to 0 dl 1746129588 ref 1 fl Complete:/200/0 rc 634880/634880 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129577.965583:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800915d2a00 with x1830948734327552 ext(3145728->4194303) 00002000:00010000:1.0:1746129577.965587:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800915d2a00 00000100:00100000:2.0:1746129577.972483:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800915d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+40:1962:x1830948734327808:12345-192.168.202.4@tcp:3:cat.0 Request processed in 30540us (30704us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129577.972495:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8043 00002000:00100000:2.0:1746129577.972507:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff8800915d2d80 x1830948734327808/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:318/0 lens 488/440 e 0 to 0 dl 1746129588 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129577.972515:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800915d2d80 with x1830948734327808 ext(1048576->2097151) 00002000:00010000:2.0:1746129577.972522:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800915d2d80 00000100:00100000:2.0:1746129577.972944:0:14547:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013145e680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14547:1830948737587328:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129577.978691:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129577.978886:0:20861:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734328448 00000100:00100000:3.0:1746129577.978896:0:20861:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734328448 00000100:00100000:3.0:1746129577.978943:0:20861:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4821 00000100:00100000:3.0:1746129577.978950:0:20861:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800915d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+34:27234:x1830948734328448:12345-192.168.202.4@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1746129577.979775:0:14547:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013145f100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14547:1830948737587456:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129577.979808:0:14547:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008fba5400/0x40a459093b06b1ae lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00000100:00100000:3.0:1746129577.979836:0:20861:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800915d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+35:27234:x1830948734328448:12345-192.168.202.4@tcp:35:ldlm_bl.0 Request processed in 886us (1154us total) trans 8589945434 rc 0/0 00000100:00100000:3.0:1746129577.979844:0:20861:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4821 00000100:00100000:1.0:1746129577.980045:0:8417:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cda6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ada2ffba-8920-4ecb-8068-68caa9806978+38:1962:x1830948734328064:12345-192.168.202.4@tcp:3:cat.0 Request processed in 37667us (37772us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129577.980057:0:8417:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8044 00002000:00100000:1.0:1746129577.980066:0:8417:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3f4:0x0] (1048576->2097151) req@ffff88012cda6680 x1830948734328064/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:318/0 lens 488/440 e 0 to 0 dl 1746129588 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129577.980075:0:8417:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cda6680 with x1830948734328064 ext(1048576->2097151) 00002000:00010000:1.0:1746129577.980079:0:8417:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012cda6680 00000100:00100000:1.0:1746129577.983014:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129577.983802:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129577.983903:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734328576 00000100:00100000:2.0:1746129577.983912:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734328576 00010000:00010000:2.0:1746129577.983951:0:7087:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f888e00/0x40a459093b06b137 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21c5d expref: 322 pid: 14547 timeout: 933 lvb_type: 0 00000100:00100000:2.0:1746129577.983984:0:7087:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8576 00000100:00100000:2.0:1746129577.983992:0:7087:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cda7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ada2ffba-8920-4ecb-8068-68caa9806978+322:1960:x1830948734328576:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129577.984008:0:7087:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129577.984015:0:7087:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f888e00/0x40a459093b06b137 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21c5d expref: 322 pid: 14547 timeout: 933 lvb_type: 0 00010000:00010000:2.0:1746129577.984025:0:7087:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f888e00/0x40a459093b06b137 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21c5d expref: 322 pid: 14547 timeout: 933 lvb_type: 0 00010000:00010000:2.0:1746129577.984047:0:7087:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f888e00/0x40a459093b06b137 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21c5d expref: 322 pid: 14547 timeout: 933 lvb_type: 0 00010000:00010000:2.0:1746129577.984065:0:7087:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:2.0:1746129577.984070:0:7087:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008fba5400/0x40a459093b06b1ae lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746129577.984077:0:7087:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88008fba5400/0x40a459093b06b1ae lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746129577.984082:0:7087:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88008fba5400/0x40a459093b06b1ae lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746129577.984089:0:7087:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129577.984182:0:8417:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734328832 00000100:00100000:1.0:1746129577.984186:0:8417:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734328832 00002000:00100000:1.0:1746129577.984217:0:8417:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3ef:0x0] (4194304->5148671) req@ffff8800915d3800 x1830948734328832/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:318/0 lens 488/0 e 0 to 0 dl 1746129588 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129577.984225:0:8417:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800915d3800 with x1830948734328832 ext(4194304->5148671) 00002000:00010000:1.0:1746129577.984229:0:8417:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800915d3800 00000100:00100000:1.0:1746129577.984241:0:8417:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8045 00000100:00100000:1.0:1746129577.984246:0:8417:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800915d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+19:1960:x1830948734328832:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:2.0:1746129577.986046:0:7087:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cda7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ada2ffba-8920-4ecb-8068-68caa9806978+321:1960:x1830948734328576:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 2044us (3031us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129577.986060:0:7087:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8576 00000100:00100000:0.0:1746129577.991636:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129577.991869:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734328960 00000100:00100000:2.0:1746129577.991880:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734328960 00010000:00010000:2.0:1746129577.991924:0:7087:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800951ada00/0x40a459093b06b14c lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21c64 expref: 35 pid: 14547 timeout: 933 lvb_type: 0 00000100:00100000:2.0:1746129577.991970:0:7087:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8577 00000100:00100000:2.0:1746129577.991978:0:7087:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800915d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+35:1963:x1830948734328960:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129577.991994:0:7087:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129577.992000:0:7087:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800951ada00/0x40a459093b06b14c lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21c64 expref: 35 pid: 14547 timeout: 933 lvb_type: 0 00010000:00010000:2.0:1746129577.992012:0:7087:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800951ada00/0x40a459093b06b14c lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21c64 expref: 35 pid: 14547 timeout: 933 lvb_type: 0 00010000:00010000:2.0:1746129577.992035:0:7087:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800951ada00/0x40a459093b06b14c lrc: 0/0,0 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21c64 expref: 35 pid: 14547 timeout: 933 lvb_type: 0 00010000:00010000:2.0:1746129577.992050:0:7087:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:2.0:1746129577.992055:0:7087:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008fba5400/0x40a459093b06b1ae lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746129577.992066:0:7087:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fba5400/0x40a459093b06b1ae lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746129577.992076:0:7087:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fba5400/0x40a459093b06b1ae lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129577.992391:0:14547:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008fba5400/0x40a459093b06b1ae lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129577.992397:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fba5400/0x40a459093b06b1ae lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00000004:00200000:0.0:1746129577.992441:0:14547:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00000004:00200000:0.0:1746129577.992444:0:14547:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746129577.992459:0:14547:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008fba5400/0x40a459093b06b1ae lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129577.992467:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fba5400/0x40a459093b06b1ae lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129577.992476:0:14547:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fba5000/0x40a459093b06b1a0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129577.992482:0:14547:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fba5000/0x40a459093b06b1a0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129577.992487:0:14547:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008fba5000/0x40a459093b06b1a0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129577.992492:0:14547:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008fba5000 already unused, calling callback (ffffffffa136e690) 00010000:00010000:0.0:1746129577.992495:0:14547:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fba5000/0x40a459093b06b1a0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129577.992501:0:14547:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fba5000/0x40a459093b06b1a0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129577.992508:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880132ef8f00) 00010000:00010000:0.0:1746129577.992510:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129577.992513:0:14547:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008fba5000/0x40a459093b06b1a0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129577.992517:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fba5000/0x40a459093b06b1a0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746129577.992889:0:7087:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129577.992945:0:7087:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800915d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+34:1963:x1830948734328960:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 967us (1318us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129577.992953:0:7087:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8577 00010000:00010000:0.0:1746129577.994027:0:14547:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fba5200/0x40a459093b06b1a7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129577.994040:0:14547:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fba5200/0x40a459093b06b1a7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129577.994045:0:14547:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008fba5200/0x40a459093b06b1a7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129577.994051:0:14547:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008fba5200 already unused, calling callback (ffffffffa136e690) 00010000:00010000:0.0:1746129577.994054:0:14547:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fba5200/0x40a459093b06b1a7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129577.994061:0:14547:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fba5200/0x40a459093b06b1a7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129577.994070:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880129fb1500) 00010000:00010000:0.0:1746129577.994072:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129577.994075:0:14547:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008fba5200/0x40a459093b06b1a7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129577.994079:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fba5200/0x40a459093b06b1a7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14547 initiator: MDT0 00010000:00010000:0.0:1746129577.994121:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fba4e00/0x40a459093b06b199 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21caa expref: 30 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129577.994134:0:14547:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fba5400/0x40a459093b06b1ae lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21caa expref: 29 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129577.994141:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:0.0:1746129577.994143:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746129577.994145:0:14547:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fba5400, rc 0) 00000100:00100000:0.0:1746129577.994195:0:14547:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800915d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:068dab75-d300-4ead-a742-d14572ad1e50+29:32541:x1830948734328192:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 31165us (33707us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129577.994202:0:14547:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11318 00000100:00100000:1.0:1746129577.996748:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129577.996824:0:14547:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734329344 00000100:00100000:2.0:1746129577.996834:0:14547:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734329344 00000100:00100000:2.0:1746129577.996880:0:14547:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11319 00000100:00100000:2.0:1746129577.996889:0:14547:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cda5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+34:32545:x1830948734329344:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:2.0:1746129577.996913:0:14547:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129577.996930:0:14547:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095287600/0x40a459093b06b1b5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21cb8 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129577.997032:0:14547:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880095287800/0x40a459093b06b1bc lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746129577.997048:0:14547:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fba5400/0x40a459093b06b1ae lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21caa expref: 28 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129577.997055:0:14547:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095287800/0x40a459093b06b1bc lrc: 4/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746129577.997086:0:14547:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008fba5400/0x40a459093b06b1ae lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21caa expref: 28 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129577.997098:0:14547:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fba5400/0x40a459093b06b1ae lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21caa expref: 28 pid: 14547 timeout: 933 lvb_type: 0 00000100:00100000:2.0:1746129577.997115:0:14547:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013145f100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14547:1830948737587584:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129577.997194:0:14547:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132f36540 going to sleep for 11 seconds 00000100:00100000:0.0:1746129577.997453:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129577.997895:0:8417:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800915d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+19:1960:x1830948734328832:12345-192.168.202.4@tcp:3:cat.0 Request processed in 13647us (14093us total) trans 0 rc 954368/954368 00000100:00100000:0.0:1746129577.997905:0:8417:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8045 00002000:00100000:0.0:1746129577.997916:0:8417:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3ef:0x0] (4194304->5148671) req@ffff8800915d3800 x1830948734328832/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:318/0 lens 488/440 e 0 to 0 dl 1746129588 ref 1 fl Complete:/200/0 rc 954368/954368 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129577.997925:0:8417:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800915d3800 with x1830948734328832 ext(4194304->5148671) 00002000:00010000:0.0:1746129577.997930:0:8417:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800915d3800 00000100:00100000:2.0:1746129577.998470:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734329088 00000100:00100000:2.0:1746129577.998476:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734329088 00000100:00100000:2.0:1746129577.998509:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16623 00000100:00100000:2.0:1746129577.998515:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800915d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ada2ffba-8920-4ecb-8068-68caa9806978+25:32540:x1830948734329088:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129577.998525:0:7148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129577.998538:0:7148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095287200/0x40a459093b06b1c3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21cb1 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129577.998561:0:7148:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091799a00/0x40a459093b06b15a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3194880->3608575) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21c6b expref: 18 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129577.998568:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129577.998570:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129577.998573:0:7148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095287200/0x40a459093b06b1c3 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21cb1 expref: 26 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129577.998593:0:7148:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091799a00/0x40a459093b06b15a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3194880->3608575) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21c6b expref: 18 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129577.998602:0:7148:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091799a00/0x40a459093b06b15a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3194880->3608575) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21c6b expref: 18 pid: 11014 timeout: 933 lvb_type: 0 00000100:00100000:2.0:1746129577.998610:0:7148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013145e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7148:1830948737587712:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129577.999660:0:7148:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132f369c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129578.000279:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129578.002724:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129578.002758:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129578.002784:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129578.002831:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129578.002855:0:8417:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734330112 00000100:00100000:0.0:1746129578.002863:0:8417:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734330112 00002000:00100000:0.0:1746129578.002914:0:8417:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3ef:0x0] (3194880->3608575) req@ffff88009f3e4e00 x1830948734330112/t0(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:319/0 lens 488/0 e 0 to 0 dl 1746129589 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129578.002925:0:8417:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f3e4e00 with x1830948734330112 ext(3194880->3608575) 00010000:00010000:0.0:1746129578.002935:0:8417:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091799a00/0x40a459093b06b15a lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3194880->3608575) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21c6b expref: 19 pid: 11014 timeout: 933 lvb_type: 0 00010000:00010000:0.0:1746129578.002948:0:8417:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091799a00/0x40a459093b06b15a lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3194880->3608575) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21c6b expref: 19 pid: 11014 timeout: 933 lvb_type: 0 00002000:00010000:0.0:1746129578.002955:0:8417:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f3e4e00 00000100:00100000:0.0:1746129578.002972:0:8417:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2490 00000100:00100000:0.0:1746129578.002979:0:8417:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+19:1960:x1830948734330112:12345-192.168.202.4@tcp:4:cat.0 00000100:00100000:1.0:1746129578.003244:0:11014:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734329472 00000100:00100000:1.0:1746129578.003259:0:11014:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734329472 00000100:00100000:1.0:1746129578.003286:0:8410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734329600 00000100:00100000:1.0:1746129578.003288:0:8410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734329600 00000100:00100000:1.0:1746129578.003315:0:8410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734329728 00000100:00100000:1.0:1746129578.003317:0:8410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734329728 00000100:00100000:1.0:1746129578.003326:0:8410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734329856 00000100:00100000:1.0:1746129578.003328:0:8410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734329856 00000100:00100000:1.0:1746129578.003338:0:8410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16624 00000100:00100000:1.0:1746129578.003343:0:8410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:068dab75-d300-4ead-a742-d14572ad1e50+7:1960:x1830948734329472:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:1.0:1746129578.003355:0:8410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129578.003370:0:8410:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a6caf800/0x40a459093b06b1ca lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21cbf expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129578.003388:0:8410:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129578.003390:0:8410:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129578.003398:0:8410:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6caf800/0x40a459093b06b1ca lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21cbf expref: 8 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129578.003412:0:8410:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a6caf800/0x40a459093b06b1ca lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21cbf expref: 8 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129578.003422:0:8410:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6caf800, rc 0) 00000100:00100000:1.0:1746129578.003466:0:8410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:068dab75-d300-4ead-a742-d14572ad1e50+8:1960:x1830948734329472:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 123us (3191us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129578.003471:0:8410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16624 00000100:00100000:1.0:1746129578.003488:0:8410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16625 00000100:00100000:1.0:1746129578.003492:0:8410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:068dab75-d300-4ead-a742-d14572ad1e50+7:1960:x1830948734329600:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:1.0:1746129578.003497:0:8410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129578.003502:0:8410:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a6cafe00/0x40a459093b06b1d1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21cc6 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129578.003510:0:8410:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129578.003511:0:8410:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129578.003515:0:8410:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6cafe00/0x40a459093b06b1d1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21cc6 expref: 8 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129578.003522:0:8410:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a6cafe00/0x40a459093b06b1d1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21cc6 expref: 8 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129578.003529:0:8410:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6cafe00, rc 0) 00000100:00100000:1.0:1746129578.003541:0:8410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:068dab75-d300-4ead-a742-d14572ad1e50+8:1960:x1830948734329600:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 48us (826us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129578.003545:0:8410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16625 00000100:00100000:1.0:1746129578.003554:0:8410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16626 00000100:00100000:1.0:1746129578.003558:0:8410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:068dab75-d300-4ead-a742-d14572ad1e50+7:1960:x1830948734329728:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:1.0:1746129578.003563:0:8410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129578.003572:0:8410:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a6cafc00/0x40a459093b06b1d8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21ccd expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129578.004009:0:8411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16627 00000100:00100000:2.0:1746129578.004018:0:8411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:068dab75-d300-4ead-a742-d14572ad1e50+7:1960:x1830948734329856:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:2.0:1746129578.004025:0:8411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129578.004032:0:8411:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095286c00/0x40a459093b06b1df lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21cd4 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129578.004042:0:8411:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129578.004043:0:8411:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129578.004047:0:8411:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095286c00/0x40a459093b06b1df lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21cd4 expref: 8 pid: 8411 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129578.004055:0:8411:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095286c00/0x40a459093b06b1df lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21cd4 expref: 8 pid: 8411 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129578.004061:0:8411:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095286c00, rc 0) 00000100:00100000:2.0:1746129578.004076:0:8411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:068dab75-d300-4ead-a742-d14572ad1e50+8:1960:x1830948734329856:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 62us (1293us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129578.004081:0:8411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16627 00000100:00100000:2.0:1746129578.004117:0:7148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013145e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7148:1830948737587712:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129578.004138:0:7148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095287200/0x40a459093b06b1c3 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21cb1 expref: 26 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129578.004145:0:7148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095287200, rc 0) 00000100:00100000:2.0:1746129578.004156:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800915d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ada2ffba-8920-4ecb-8068-68caa9806978+26:32540:x1830948734329088:12345-192.168.202.4@tcp:101:cat.0 Request processed in 5642us (6706us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129578.004164:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16623 00000100:00100000:2.0:1746129578.004185:0:14547:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013145f100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14547:1830948737587584:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129578.004196:0:14547:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880095287800/0x40a459093b06b1bc lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00000100:00100000:1.0:1746129578.006656:0:8410:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cda6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8410:1830948737587840:192.168.202.4@tcp:106: 00000100:00100000:1.0:1746129578.006746:0:8410:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0ac900 going to sleep for 11 seconds 00000100:00100000:1.0:1746129578.006819:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129578.006906:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129578.006924:0:11014:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734330240 00000100:00100000:1.0:1746129578.006930:0:11014:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734330240 00000100:00100000:1.0:1746129578.006969:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16628 00000100:00100000:1.0:1746129578.006976:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cda5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:1960:x1830948734330240:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129578.006988:0:4385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129578.006999:0:4385:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008fba5200/0x40a459093b06b1e6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21cdb expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129578.007036:0:4385:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cda6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:4385:1830948737587968:192.168.202.4@tcp:106: 00000100:00100000:1.0:1746129578.007054:0:4385:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0acb40 going to sleep for 11 seconds 00000100:00100000:2.0:1746129578.007287:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734329984 00000100:00100000:2.0:1746129578.007309:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734329984 00000100:00080000:2.0:1746129578.007335:0:7097:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1746129578.007361:0:7087:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fba5400/0x40a459093b06b1ae lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21caa expref: 29 pid: 14547 timeout: 933 lvb_type: 0 00000100:00100000:2.0:1746129578.007389:0:7087:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8578 00000100:00100000:2.0:1746129578.007398:0:7087:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cda7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:068dab75-d300-4ead-a742-d14572ad1e50+29:1960:x1830948734329984:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129578.007414:0:7087:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129578.007421:0:7087:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008fba5400/0x40a459093b06b1ae lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21caa expref: 29 pid: 14547 timeout: 933 lvb_type: 0 00010000:00010000:2.0:1746129578.007433:0:7087:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008fba5400/0x40a459093b06b1ae lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21caa expref: 29 pid: 14547 timeout: 933 lvb_type: 0 00010000:00010000:2.0:1746129578.007454:0:7087:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fba5400/0x40a459093b06b1ae lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21caa expref: 29 pid: 14547 timeout: 933 lvb_type: 0 00010000:00010000:2.0:1746129578.007468:0:7087:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:2.0:1746129578.007473:0:7087:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880095287800/0x40a459093b06b1bc lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746129578.007483:0:7087:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095287800/0x40a459093b06b1bc lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746129578.007491:0:7087:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095287800/0x40a459093b06b1bc lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746129578.007512:0:7087:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129578.007548:0:7087:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cda7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:068dab75-d300-4ead-a742-d14572ad1e50+28:1960:x1830948734329984:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 149us (726us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129578.007555:0:7087:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8578 00010000:00010000:2.0:1746129578.007585:0:14547:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880095287800/0x40a459093b06b1bc lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00010000:00010000:2.0:1746129578.007592:0:14547:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095287800/0x40a459093b06b1bc lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14547 initiator: MDT0 00000004:00200000:2.0:1746129578.007612:0:14547:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:2.0:1746129578.008059:0:14547:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095287600/0x40a459093b06b1b5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21cb8 expref: 37 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129578.008075:0:14547:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095287800/0x40a459093b06b1bc lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21cb8 expref: 36 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129578.008081:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:2.0:1746129578.008084:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746129578.008086:0:14547:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095287800, rc 0) 00000100:00100000:2.0:1746129578.008122:0:14547:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cda5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+36:32545:x1830948734329344:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 11233us (11382us total) trans 8589945435 rc 0/0 00000100:00100000:2.0:1746129578.008129:0:14547:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11319 00000100:00100000:1.0:1746129578.013382:0:8410:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cda6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8410:1830948737587840:192.168.202.4@tcp:106: 00010000:00010000:1.0:1746129578.013417:0:8410:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a6cafc00/0x40a459093b06b1d8 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21ccd expref: 8 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129578.013432:0:8410:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a6cafc00/0x40a459093b06b1d8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21ccd expref: 8 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129578.013463:0:8410:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6cafc00, rc 0) 00000100:00100000:1.0:1746129578.013508:0:8410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:068dab75-d300-4ead-a742-d14572ad1e50+7:1960:x1830948734329728:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 9948us (10748us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129578.013517:0:8410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16626 00000100:00100000:1.0:1746129578.019712:0:4385:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cda6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:4385:1830948737587968:192.168.202.4@tcp:106: 00010000:00010000:1.0:1746129578.019749:0:4385:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008fba5200/0x40a459093b06b1e6 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21cdb expref: 22 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129578.019763:0:4385:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008fba5200/0x40a459093b06b1e6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21cdb expref: 22 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129578.019775:0:4385:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fba5200, rc 0) 00000100:00100000:1.0:1746129578.019846:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cda5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:1960:x1830948734330240:12345-192.168.202.4@tcp:101:cat.0 Request processed in 12868us (12936us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129578.019855:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16628 00000100:00100000:0.0:1746129578.023195:0:8417:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:1960:x1830948734330112:12345-192.168.202.4@tcp:4:cat.0 Request processed in 20204us (20352us total) trans 21474841409 rc 0/0 00000100:00100000:0.0:1746129578.023207:0:8417:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2490 00002000:00100000:0.0:1746129578.023218:0:8417:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3ef:0x0] (3194880->3608575) req@ffff88009f3e4e00 x1830948734330112/t21474841409(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:319/0 lens 488/448 e 0 to 0 dl 1746129589 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129578.023226:0:8417:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f3e4e00 with x1830948734330112 ext(3194880->3608575) 00010000:00010000:0.0:1746129578.023237:0:8417:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091799a00/0x40a459093b06b15a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3194880->3608575) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21c6b expref: 21 pid: 11014 timeout: 933 lvb_type: 0 00010000:00010000:0.0:1746129578.023265:0:8417:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091799a00/0x40a459093b06b15a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3194880->3608575) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21c6b expref: 21 pid: 11014 timeout: 933 lvb_type: 0 00002000:00010000:0.0:1746129578.023272:0:8417:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f3e4e00 00000100:00100000:0.0:1746129578.027456:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129578.027503:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129578.027597:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734330496 00000100:00100000:1.0:1746129578.027607:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734330496 00000100:00100000:1.0:1746129578.027684:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16629 00000100:00100000:1.0:1746129578.027693:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+30:32545:x1830948734330496:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:1.0:1746129578.027714:0:4385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129578.027734:0:4385:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008fba5000/0x40a459093b06b1f4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21ce9 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129578.027765:0:4385:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880132fc2400/0x40a459093b06b114 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21c41 expref: 31 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129578.027773:0:4385:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095286c00/0x40a459093b06b1df lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21cd4 expref: 7 pid: 8411 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129578.027781:0:4385:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129861200/0x40a459093b06b129 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21c56 expref: 37 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129578.027787:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129578.027789:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129578.027792:0:4385:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fba5000/0x40a459093b06b1f4 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [3518464->3792895] (req 3518464->3792895) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21ce9 expref: 31 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129578.027826:0:4385:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129861200/0x40a459093b06b129 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21c56 expref: 37 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129578.027837:0:4385:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129861200/0x40a459093b06b129 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21c56 expref: 37 pid: 7148 timeout: 933 lvb_type: 0 00000100:00100000:1.0:1746129578.027849:0:4385:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cda6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:4385:1830948737588096:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129578.027888:0:14547:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734330368 00000100:00100000:2.0:1746129578.027893:0:14547:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734330368 00000100:00100000:2.0:1746129578.027930:0:14547:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11320 00010000:00010000:1.0:1746129578.027934:0:4385:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095286c00/0x40a459093b06b1df lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21cd4 expref: 7 pid: 8411 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746129578.027938:0:14547:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:068dab75-d300-4ead-a742-d14572ad1e50+28:32541:x1830948734330368:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:1.0:1746129578.027947:0:4385:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095286c00/0x40a459093b06b1df lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21cd4 expref: 7 pid: 8411 timeout: 933 lvb_type: 1 00010000:00010000:2.0:1746129578.027948:0:14547:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746129578.027955:0:4385:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cda6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:4385:1830948737588224:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129578.027962:0:14547:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095287e00/0x40a459093b06b1fb lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21ce2 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129578.027977:0:4385:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880132fc2400/0x40a459093b06b114 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21c41 expref: 31 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129578.027983:0:4385:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880132fc2400/0x40a459093b06b114 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21c41 expref: 31 pid: 8410 timeout: 933 lvb_type: 0 00000100:00100000:1.0:1746129578.027990:0:4385:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cda5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:4385:1830948737588352:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129578.028002:0:4385:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0acb40 going to sleep for 11 seconds 00010000:00010000:2.0:1746129578.028015:0:14547:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095287e00/0x40a459093b06b1fb lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21ce2 expref: 29 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129578.028028:0:14547:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095287e00/0x40a459093b06b1fb lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21ce2 expref: 29 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129578.028047:0:14547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:2.0:1746129578.028050:0:14547:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746129578.028053:0:14547:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095287e00, rc 0) 00000100:00100000:2.0:1746129578.028082:0:14547:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:068dab75-d300-4ead-a742-d14572ad1e50+29:32541:x1830948734330368:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 145us (639us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129578.028088:0:14547:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11320 00000100:00080000:3.0:1746129578.028097:0:7097:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746129578.028173:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129578.028430:0:8410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734330624 00000100:00100000:1.0:1746129578.028434:0:8410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734330624 00000100:00100000:1.0:1746129578.028456:0:8410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16630 00000100:00100000:1.0:1746129578.028461:0:8410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:32536:x1830948734330624:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129578.028469:0:8410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129578.028479:0:8410:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008fba5a00/0x40a459093b06b202 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21cf0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129578.028493:0:8410:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129578.028495:0:8410:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129578.028498:0:8410:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008fba5a00/0x40a459093b06b202 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [5144576->5242879] (req 5144576->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21cf0 expref: 22 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129578.028511:0:8410:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008fba5a00/0x40a459093b06b202 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [5144576->5242879] (req 5144576->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21cf0 expref: 22 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129578.028659:0:8410:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fba5a00, rc 0) 00000100:00100000:1.0:1746129578.028678:0:8410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+22:32536:x1830948734330624:12345-192.168.202.4@tcp:101:cat.0 Request processed in 217us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129578.028683:0:8410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16630 00000100:00100000:0.0:1746129578.032393:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129578.032472:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129578.032498:0:20578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734331136 00000100:00100000:0.0:1746129578.032506:0:20578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734331136 00010000:00010000:0.0:1746129578.032545:0:20578:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129861200/0x40a459093b06b129 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21c56 expref: 38 pid: 7148 timeout: 933 lvb_type: 0 00000100:00100000:0.0:1746129578.032591:0:20578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8579 00000100:00100000:0.0:1746129578.032599:0:20578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ada2ffba-8920-4ecb-8068-68caa9806978+38:1961:x1830948734331136:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129578.032614:0:20578:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129578.032639:0:20578:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129861200/0x40a459093b06b129 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21c56 expref: 38 pid: 7148 timeout: 933 lvb_type: 0 00010000:00010000:0.0:1746129578.032649:0:20578:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129861200/0x40a459093b06b129 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21c56 expref: 38 pid: 7148 timeout: 933 lvb_type: 0 00010000:00010000:0.0:1746129578.032674:0:20578:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129578.032711:0:20578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ada2ffba-8920-4ecb-8068-68caa9806978+38:1961:x1830948734331136:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 114us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129578.032718:0:20578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8579 00010000:00010000:0.0:1746129578.032826:0:4385:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129861200/0x40a459093b06b129 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21c56 expref: 37 pid: 7148 timeout: 933 lvb_type: 0 00000100:00100000:0.0:1746129578.032855:0:4385:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cda6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:4385:1830948737588096:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129578.032866:0:4385:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cda6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:4385:1830948737588224:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129578.032873:0:4385:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cda5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:4385:1830948737588352:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129578.032900:0:4385:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008fba5000/0x40a459093b06b1f4 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [3518464->3792895] (req 3518464->3792895) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21ce9 expref: 31 pid: 4385 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129578.033094:0:15096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734330880 00000100:00100000:1.0:1746129578.033099:0:15096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734330880 00000100:00100000:1.0:1746129578.033123:0:15096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11321 00000100:00100000:1.0:1746129578.033128:0:15096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:068dab75-d300-4ead-a742-d14572ad1e50+29:32541:x1830948734330880:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:1.0:1746129578.033144:0:15096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129578.033157:0:15096:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fba5c00/0x40a459093b06b209 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21cf7 expref: -99 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129578.033204:0:4385:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fba5000, rc 0) 00010000:00010000:1.0:1746129578.033265:0:15096:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fba4c00/0x40a459093b06b210 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15096 initiator: MDT0 00010000:00010000:1.0:1746129578.033281:0:15096:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fba4c00/0x40a459093b06b210 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15096 initiator: MDT0 00010000:00010000:1.0:1746129578.033290:0:15096:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fba4c00/0x40a459093b06b210 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15096 initiator: MDT0 00010000:00010000:1.0:1746129578.033319:0:15096:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fba5800/0x40a459093b06b217 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15096 initiator: MDT0 00010000:00010000:1.0:1746129578.033325:0:15096:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fba5800/0x40a459093b06b217 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15096 initiator: MDT0 00010000:00010000:1.0:1746129578.033330:0:15096:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fba5800/0x40a459093b06b217 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15096 initiator: MDT0 00010000:00010000:1.0:1746129578.033435:0:15096:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fba5600/0x40a459093b06b21e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 15096 initiator: MDT0 00010000:00010000:1.0:1746129578.033444:0:15096:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fba5600/0x40a459093b06b21e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 15096 initiator: MDT0 00010000:00010000:1.0:1746129578.033450:0:15096:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fba5600/0x40a459093b06b21e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 15096 initiator: MDT0 00000004:00200000:1.0:1746129578.033458:0:15096:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:1.0:1746129578.033544:0:15096:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fba4c00/0x40a459093b06b210 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15096 initiator: MDT0 00010000:00010000:1.0:1746129578.033550:0:15096:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fba4c00/0x40a459093b06b210 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15096 initiator: MDT0 00010000:00010000:1.0:1746129578.033556:0:15096:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008fba4c00/0x40a459093b06b210 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15096 initiator: MDT0 00010000:00010000:1.0:1746129578.033562:0:15096:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008fba4c00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:1.0:1746129578.033565:0:15096:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fba4c00/0x40a459093b06b210 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15096 initiator: MDT0 00010000:00010000:1.0:1746129578.033571:0:15096:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fba4c00/0x40a459093b06b210 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15096 initiator: MDT0 00010000:00010000:1.0:1746129578.033579:0:15096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880132ef8f00) 00010000:00010000:1.0:1746129578.033582:0:15096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129578.033585:0:15096:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008fba4c00/0x40a459093b06b210 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15096 initiator: MDT0 00010000:00010000:1.0:1746129578.033594:0:15096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fba4c00/0x40a459093b06b210 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15096 initiator: MDT0 00010000:00010000:1.0:1746129578.033620:0:15096:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fba5800/0x40a459093b06b217 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15096 initiator: MDT0 00010000:00010000:1.0:1746129578.033625:0:15096:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fba5800/0x40a459093b06b217 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15096 initiator: MDT0 00010000:00010000:1.0:1746129578.033629:0:15096:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008fba5800/0x40a459093b06b217 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15096 initiator: MDT0 00010000:00010000:1.0:1746129578.033633:0:15096:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008fba5800 already unused, calling callback (ffffffffa136e690) 00010000:00010000:1.0:1746129578.033636:0:15096:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fba5800/0x40a459093b06b217 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15096 initiator: MDT0 00010000:00010000:1.0:1746129578.033640:0:15096:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fba5800/0x40a459093b06b217 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15096 initiator: MDT0 00010000:00010000:1.0:1746129578.033646:0:15096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009cffe300) 00010000:00010000:1.0:1746129578.033648:0:15096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129578.033650:0:15096:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008fba5800/0x40a459093b06b217 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15096 initiator: MDT0 00010000:00010000:1.0:1746129578.033655:0:15096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fba5800/0x40a459093b06b217 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15096 initiator: MDT0 00010000:00010000:1.0:1746129578.033687:0:15096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fba5c00/0x40a459093b06b209 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21cf7 expref: 32 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129578.033695:0:15096:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fba5600/0x40a459093b06b21e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21cf7 expref: 31 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129578.033705:0:15096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:1.0:1746129578.033708:0:15096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746129578.033710:0:15096:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fba5600, rc 0) 00000100:00100000:1.0:1746129578.034088:0:15096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:068dab75-d300-4ead-a742-d14572ad1e50+31:32541:x1830948734330880:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 957us (1705us total) trans 8589945436 rc 0/0 00000100:00100000:1.0:1746129578.034096:0:15096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11321 00000100:00100000:0.0:1746129578.034327:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+31:32545:x1830948734330496:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 6633us (6820us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129578.034335:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16629 00000100:00100000:3.0:1746129578.034599:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129578.034621:0:20578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734331008 00000100:00100000:3.0:1746129578.034626:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129578.034627:0:20578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734331008 00010000:00010000:0.0:1746129578.034648:0:20578:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095286c00/0x40a459093b06b1df lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21cd4 expref: 8 pid: 8411 timeout: 933 lvb_type: 1 00000100:00100000:3.0:1746129578.034675:0:15749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734331264 00000100:00100000:3.0:1746129578.034678:0:15749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734331264 00010000:00010000:3.0:1746129578.034693:0:15749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091799a00/0x40a459093b06b15a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3194880->3608575) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21c6b expref: 22 pid: 11014 timeout: 933 lvb_type: 0 00000100:00100000:2.0:1746129578.034697:0:7087:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8580 00000100:00100000:2.0:1746129578.034707:0:7087:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947bc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:068dab75-d300-4ead-a742-d14572ad1e50+8:1962:x1830948734331008:12345-192.168.202.4@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746129578.034717:0:15749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8581 00010000:00010000:2.0:1746129578.034718:0:7087:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746129578.034721:0:15749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+22:1962:x1830948734331264:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129578.034729:0:15749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129578.034738:0:7087:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095286c00/0x40a459093b06b1df lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21cd4 expref: 8 pid: 8411 timeout: 933 lvb_type: 1 00010000:00010000:3.0:1746129578.034743:0:15749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091799a00/0x40a459093b06b15a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3194880->3608575) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21c6b expref: 22 pid: 11014 timeout: 933 lvb_type: 0 00010000:00010000:2.0:1746129578.034748:0:7087:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095286c00/0x40a459093b06b1df lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21cd4 expref: 8 pid: 8411 timeout: 933 lvb_type: 1 00010000:00010000:3.0:1746129578.034752:0:15749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091799a00/0x40a459093b06b15a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3194880->3608575) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21c6b expref: 22 pid: 11014 timeout: 933 lvb_type: 0 00010000:00010000:2.0:1746129578.034762:0:7087:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095286c00/0x40a459093b06b1df lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21cd4 expref: 8 pid: 8411 timeout: 933 lvb_type: 1 00010000:00010000:3.0:1746129578.034765:0:15749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091799a00/0x40a459093b06b15a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3194880->3608575) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21c6b expref: 22 pid: 11014 timeout: 933 lvb_type: 0 00010000:00010000:2.0:1746129578.034777:0:7087:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746129578.034778:0:15749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129578.034780:0:15749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129578.034787:0:15749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880095287200/0x40a459093b06b1c3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21cb1 expref: 25 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129578.034794:0:15749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095287200/0x40a459093b06b1c3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21cb1 expref: 25 pid: 7148 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129578.034800:0:7087:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947bc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:068dab75-d300-4ead-a742-d14572ad1e50+7:1962:x1830948734331008:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 97us (203us total) trans 0 rc 0/0 00010000:00010000:3.0:1746129578.034801:0:15749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129578.034801:0:15749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129578.034804:0:15749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008fba5a00/0x40a459093b06b202 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5144576->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21cf0 expref: 21 pid: 8410 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129578.034806:0:7087:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8580 00010000:00010000:3.0:1746129578.034809:0:15749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008fba5a00/0x40a459093b06b202 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5144576->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21cf0 expref: 21 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129578.034832:0:15749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008fba5a00/0x40a459093b06b202 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5144576->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21cf0 expref: 21 pid: 8410 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129578.034842:0:15749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15749:1830948737588480:192.168.202.4@tcp:105: 00010000:00010000:3.0:1746129578.035097:0:15749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880095287200/0x40a459093b06b1c3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21cb1 expref: 25 pid: 7148 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129578.035105:0:15749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f44ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15749:1830948737588608:192.168.202.4@tcp:105: 00000100:00100000:3.0:1746129578.035178:0:15749:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa381000 going to sleep for 11 seconds 00000100:00100000:2.0:1746129578.042042:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129578.042083:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129578.042132:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129578.042134:0:8410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734331392 00000100:00100000:1.0:1746129578.042143:0:8410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734331392 00000100:00100000:1.0:1746129578.042178:0:8410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734331520 00000100:00100000:1.0:1746129578.042180:0:8410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734331520 00000100:00100000:1.0:1746129578.042191:0:8410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16631 00000100:00100000:1.0:1746129578.042197:0:8410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013145f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:068dab75-d300-4ead-a742-d14572ad1e50+7:1960:x1830948734331392:12345-192.168.202.4@tcp:101:lfs.0 00000100:00100000:0.0:1746129578.042201:0:8412:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16632 00000100:00100000:0.0:1746129578.042209:0:8412:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013145e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:068dab75-d300-4ead-a742-d14572ad1e50+7:1960:x1830948734331520:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:1.0:1746129578.042215:0:8410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129578.042218:0:8412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129578.042234:0:8410:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008fba5200/0x40a459093b06b233 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21cfe expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129578.042234:0:8412:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091799a00/0x40a459093b06b22c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21d05 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129578.042265:0:8410:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129578.042265:0:8412:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129578.042267:0:8410:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129578.042277:0:8410:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008fba5200/0x40a459093b06b233 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21cfe expref: 8 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129578.042277:0:8412:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091799a00/0x40a459093b06b22c lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21d05 expref: 8 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129578.042311:0:8410:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008fba5200/0x40a459093b06b233 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21cfe expref: 8 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129578.042321:0:8410:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fba5200, rc 0) 00000100:00100000:1.0:1746129578.042912:0:8410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013145f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:068dab75-d300-4ead-a742-d14572ad1e50+8:1960:x1830948734331392:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 712us (878us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129578.042920:0:8410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16631 00000100:00100000:1.0:1746129578.042945:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734331648 00000100:00100000:1.0:1746129578.042948:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734331648 00010000:00010000:1.0:1746129578.042964:0:9823:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880132fc2400/0x40a459093b06b114 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21c41 expref: 31 pid: 8410 timeout: 933 lvb_type: 0 00000100:00100000:1.0:1746129578.042982:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8582 00000100:00100000:1.0:1746129578.042987:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6025c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+31:1961:x1830948734331648:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129578.042996:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129578.043020:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880132fc2400/0x40a459093b06b114 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21c41 expref: 31 pid: 8410 timeout: 933 lvb_type: 0 00010000:00010000:1.0:1746129578.043031:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880132fc2400/0x40a459093b06b114 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21c41 expref: 31 pid: 8410 timeout: 933 lvb_type: 0 00010000:00010000:1.0:1746129578.043046:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880132fc2400/0x40a459093b06b114 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21c41 expref: 31 pid: 8410 timeout: 933 lvb_type: 0 00010000:00010000:1.0:1746129578.043083:0:9823:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129578.043085:0:9823:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129578.043090:0:9823:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008fba5000/0x40a459093b06b1f4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3518464->3792895) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21ce9 expref: 30 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129578.043098:0:9823:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fba5000/0x40a459093b06b1f4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3518464->3792895) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21ce9 expref: 30 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129578.043130:0:9823:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008fba5000/0x40a459093b06b1f4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3518464->3792895) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21ce9 expref: 30 pid: 4385 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129578.043142:0:9823:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cda4e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9823:1830948737588736:192.168.202.4@tcp:105: 00010000:00010000:0.0:1746129578.043258:0:8412:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091799a00/0x40a459093b06b22c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21d05 expref: 8 pid: 8412 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746129578.043271:0:9823:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0ac900 going to sleep for 11 seconds 00010000:00010000:0.0:1746129578.043274:0:8412:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091799a00, rc 0) 00000100:00100000:0.0:1746129578.043315:0:8412:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013145e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:068dab75-d300-4ead-a742-d14572ad1e50+7:1960:x1830948734331520:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 1107us (1231us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129578.043324:0:8412:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16632 00000100:00100000:1.0:1746129578.043786:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129578.043858:0:15749:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15749:1830948737588480:192.168.202.4@tcp:105: 00000100:00100000:0.0:1746129578.043878:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734331776 00000100:00100000:0.0:1746129578.043882:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734331776 00000100:00100000:0.0:1746129578.043917:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16633 00000100:00100000:0.0:1746129578.043923:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cda4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+31:1960:x1830948734331776:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129578.043933:0:4385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129578.043941:0:4385:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091798800/0x40a459093b06b23a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21d0c expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129578.043971:0:4385:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f3e6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:4385:1830948737588864:192.168.202.4@tcp:106: 00000100:00100000:0.0:1746129578.044330:0:4385:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009cdf39c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129578.044648:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129578.044712:0:15749:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f44ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15749:1830948737588608:192.168.202.4@tcp:105: 00010000:00010000:3.0:1746129578.044731:0:15749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129578.044757:0:15749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:1962:x1830948734331264:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 10034us (10129us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129578.044765:0:15749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8581 00000100:00100000:1.0:1746129578.044919:0:8417:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734332032 00000100:00100000:1.0:1746129578.044923:0:8417:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734332032 00002000:00100000:1.0:1746129578.044950:0:8417:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3ef:0x0] (2097152->3145727) req@ffff88009f3e6680 x1830948734332032/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:319/0 lens 488/0 e 0 to 0 dl 1746129589 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129578.044960:0:8417:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f3e6680 with x1830948734332032 ext(2097152->3145727) 00002000:00010000:1.0:1746129578.044964:0:8417:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f3e6680 00000100:00100000:1.0:1746129578.044978:0:8417:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8046 00000100:00100000:1.0:1746129578.044984:0:8417:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ada2ffba-8920-4ecb-8068-68caa9806978+26:1962:x1830948734332032:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:2.0:1746129578.057174:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129578.057231:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129578.057406:0:4385:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f3e6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:4385:1830948737588864:192.168.202.4@tcp:106: 00010000:00010000:0.0:1746129578.057443:0:4385:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091798800/0x40a459093b06b23a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21d0c expref: 32 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129578.057463:0:4385:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091798800/0x40a459093b06b23a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21d0c expref: 32 pid: 4385 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746129578.057466:0:9823:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cda4e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9823:1830948737588736:192.168.202.4@tcp:105: 00010000:00010000:1.0:1746129578.057479:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746129578.057479:0:4385:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091798800, rc 0) 00000100:00100000:3.0:1746129578.057494:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734332288 00000100:00100000:3.0:1746129578.057501:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734332288 00000100:00100000:1.0:1746129578.057522:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6025c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+32:1961:x1830948734331648:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 14533us (15387us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129578.057522:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cda4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+32:1960:x1830948734331776:12345-192.168.202.4@tcp:101:cat.0 Request processed in 13598us (13735us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129578.057531:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8582 00000100:00100000:0.0:1746129578.057531:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16633 00002000:00100000:3.0:1746129578.057539:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f5:0x0] (3518464->3522559) req@ffff88013145ea00 x1830948734332288/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:319/0 lens 488/0 e 0 to 0 dl 1746129589 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129578.057548:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013145ea00 with x1830948734332288 ext(3518464->3522559) 00002000:00010000:3.0:1746129578.057552:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013145ea00 00000100:00100000:3.0:1746129578.057569:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8047 00000100:00100000:3.0:1746129578.057576:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013145ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+30:1962:x1830948734332288:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:1.0:1746129578.057592:0:15096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734332544 00000100:00100000:1.0:1746129578.057595:0:15096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734332544 00000100:00100000:1.0:1746129578.057620:0:15096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11322 00000100:00100000:1.0:1746129578.057624:0:15096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013145d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:068dab75-d300-4ead-a742-d14572ad1e50+31:32541:x1830948734332544:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:1.0:1746129578.057639:0:15096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129578.057654:0:15096:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fba5400/0x40a459093b06b241 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21d13 expref: -99 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129578.057746:0:15096:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fba4c00/0x40a459093b06b248 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 15096 initiator: MDT0 00010000:00010000:1.0:1746129578.057760:0:15096:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095287800/0x40a459093b06b1bc lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21cb8 expref: 35 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129578.057767:0:15096:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fba4c00/0x40a459093b06b248 lrc: 4/0,1 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 15096 initiator: MDT0 00010000:00010000:1.0:1746129578.057796:0:15096:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880095287800/0x40a459093b06b1bc lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21cb8 expref: 35 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129578.057807:0:15096:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880095287800/0x40a459093b06b1bc lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21cb8 expref: 35 pid: 14547 timeout: 933 lvb_type: 0 00000100:00100000:1.0:1746129578.057818:0:15096:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cda7480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15096:1830948737588992:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129578.058454:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013145ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+30:1962:x1830948734332288:12345-192.168.202.4@tcp:3:cat.0 Request processed in 875us (1288us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129578.058463:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8047 00002000:00100000:3.0:1746129578.058470:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f5:0x0] (3518464->3522559) req@ffff88013145ea00 x1830948734332288/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:319/0 lens 488/4536 e 0 to 0 dl 1746129589 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129578.058483:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013145ea00 with x1830948734332288 ext(3518464->3522559) 00002000:00010000:3.0:1746129578.058487:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013145ea00 00000100:00100000:1.0:1746129578.060453:0:15096:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0aca80 going to sleep for 11 seconds 00000100:00100000:3.0:1746129578.062703:0:8417:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ada2ffba-8920-4ecb-8068-68caa9806978+26:1962:x1830948734332032:12345-192.168.202.4@tcp:3:cat.0 Request processed in 17704us (18041us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129578.062719:0:8417:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8046 00002000:00100000:3.0:1746129578.062736:0:8417:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3ef:0x0] (2097152->3145727) req@ffff88009f3e6680 x1830948734332032/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:319/0 lens 488/440 e 0 to 0 dl 1746129589 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129578.062747:0:8417:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f3e6680 with x1830948734332032 ext(2097152->3145727) 00002000:00010000:3.0:1746129578.062754:0:8417:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f3e6680 00000100:00100000:2.0:1746129578.064596:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129578.064791:0:8417:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734332800 00000100:00100000:3.0:1746129578.064801:0:8417:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734332800 00002000:00100000:3.0:1746129578.065205:0:8417:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3ef:0x0] (5144576->5148671) req@ffff88013145f800 x1830948734332800/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:319/0 lens 488/0 e 0 to 0 dl 1746129589 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129578.065214:0:8417:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013145f800 with x1830948734332800 ext(5144576->5148671) 00002000:00010000:3.0:1746129578.065220:0:8417:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013145f800 00000100:00100000:3.0:1746129578.065263:0:8417:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8048 00000100:00100000:3.0:1746129578.065271:0:8417:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013145f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:1961:x1830948734332800:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:3.0:1746129578.065490:0:8417:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013145f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:1961:x1830948734332800:12345-192.168.202.4@tcp:3:cat.0 Request processed in 219us (901us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129578.065497:0:8417:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8048 00002000:00100000:3.0:1746129578.065502:0:8417:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3ef:0x0] (5144576->5148671) req@ffff88013145f800 x1830948734332800/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:319/0 lens 488/4536 e 0 to 0 dl 1746129589 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129578.065508:0:8417:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013145f800 with x1830948734332800 ext(5144576->5148671) 00002000:00010000:3.0:1746129578.065511:0:8417:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013145f800 00000100:00100000:1.0:1746129578.081797:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129578.083866:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129578.083895:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734333184 00000100:00100000:1.0:1746129578.083903:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734333184 00010000:00010000:1.0:1746129578.083963:0:9823:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095287800/0x40a459093b06b1bc lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21cb8 expref: 36 pid: 14547 timeout: 933 lvb_type: 0 00000100:00100000:1.0:1746129578.083990:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8583 00000100:00100000:1.0:1746129578.083997:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cda4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+36:1961:x1830948734333184:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129578.084010:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129578.084016:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880095287800/0x40a459093b06b1bc lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21cb8 expref: 36 pid: 14547 timeout: 933 lvb_type: 0 00010000:00010000:1.0:1746129578.084026:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880095287800/0x40a459093b06b1bc lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21cb8 expref: 36 pid: 14547 timeout: 933 lvb_type: 0 00010000:00010000:1.0:1746129578.084047:0:9823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:1.0:1746129578.084052:0:9823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88008fba4c00/0x40a459093b06b248 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 15096 initiator: MDT0 00010000:00010000:1.0:1746129578.084060:0:9823:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fba4c00/0x40a459093b06b248 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT flags: 0x50290000000000 pid: 15096 initiator: MDT0 00010000:00010000:1.0:1746129578.084067:0:9823:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fba4c00/0x40a459093b06b248 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT flags: 0x50290000000000 pid: 15096 initiator: MDT0 00010000:00010000:1.0:1746129578.084082:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129578.084125:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cda4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+36:1961:x1830948734333184:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 128us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129578.084131:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8583 00010000:00010000:2.0:1746129578.084354:0:15096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095287800/0x40a459093b06b1bc lrc: 0/0,0 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21cb8 expref: 35 pid: 14547 timeout: 933 lvb_type: 0 00000100:00100000:2.0:1746129578.084380:0:15096:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cda7480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15096:1830948737588992:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129578.084398:0:15096:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008fba4c00/0x40a459093b06b248 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129578.084405:0:15096:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008fba4c00/0x40a459093b06b248 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129578.084410:0:15096:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fba4c00/0x40a459093b06b248 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129578.084428:0:15096:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fba4c00/0x40a459093b06b248 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129578.084434:0:15096:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fba4c00/0x40a459093b06b248 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210400000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129578.084444:0:15096:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008fba4c00/0x40a459093b06b248 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129578.084449:0:15096:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008fba4c00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746129578.084452:0:15096:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fba4c00/0x40a459093b06b248 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129578.084459:0:15096:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fba4c00/0x40a459093b06b248 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40218400000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129578.084466:0:15096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:2.0:1746129578.084468:0:15096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746129578.084471:0:15096:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008fba4c00/0x40a459093b06b248 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129578.084474:0:15096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fba4c00/0x40a459093b06b248 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129578.084511:0:15096:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fba5400/0x40a459093b06b241 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x1/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21d13 expref: 32 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129578.084518:0:15096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fba5400/0x40a459093b06b241 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x1/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21d13 expref: 32 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129578.084525:0:15096:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fba5400, rc 0) 00000100:00100000:2.0:1746129578.084550:0:15096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013145d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:068dab75-d300-4ead-a742-d14572ad1e50+31:32541:x1830948734332544:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 26925us (27318us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129578.084556:0:15096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11322 00000100:00080000:3.0:1746129578.084666:0:7097:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746129578.084919:0:31520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734333056 00000100:00100000:0.0:1746129578.084924:0:31520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734333056 00002000:00100000:0.0:1746129578.084957:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3f5:0x0] (3788800->3792895) req@ffff88012cda7800 x1830948734333056/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:319/0 lens 488/0 e 0 to 0 dl 1746129589 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129578.084966:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cda7800 with x1830948734333056 ext(3788800->3792895) 00002000:00010000:0.0:1746129578.084970:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012cda7800 00000100:00100000:0.0:1746129578.084983:0:31520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8049 00000100:00100000:0.0:1746129578.084988:0:31520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cda7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+30:1962:x1830948734333056:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129578.086534:0:31520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cda7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+30:1962:x1830948734333056:12345-192.168.202.4@tcp:3:cat.0 Request processed in 1538us (4744us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746129578.086543:0:31520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8049 00002000:00100000:0.0:1746129578.086552:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3f5:0x0] (3788800->3792895) req@ffff88012cda7800 x1830948734333056/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:319/0 lens 488/4536 e 0 to 0 dl 1746129589 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129578.086561:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cda7800 with x1830948734333056 ext(3788800->3792895) 00002000:00010000:0.0:1746129578.086564:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012cda7800 00000100:00100000:0.0:1746129578.098883:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129578.098940:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734333312 00000100:00100000:2.0:1746129578.098950:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734333312 00000100:00100000:2.0:1746129578.099006:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16634 00000100:00100000:2.0:1746129578.099014:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ada2ffba-8920-4ecb-8068-68caa9806978+37:32540:x1830948734333312:12345-192.168.202.4@tcp:101:cat.0 00000100:00100000:0.0:1746129578.099032:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00010000:00010000:2.0:1746129578.099033:0:4385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129578.099051:0:4385:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f798e00/0x40a459093b06b24f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21d1a expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129578.099076:0:20861:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734333568 00010000:00010000:2.0:1746129578.099080:0:4385:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008fba5000/0x40a459093b06b1f4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3518464->3792895) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21ce9 expref: 29 pid: 4385 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129578.099082:0:20861:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734333568 00010000:00010000:2.0:1746129578.099087:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129578.099089:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129578.099092:0:4385:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f798e00/0x40a459093b06b24f lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21d1a expref: 38 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129578.099122:0:4385:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008fba5000/0x40a459093b06b1f4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3518464->3792895) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21ce9 expref: 29 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129578.099134:0:4385:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008fba5000/0x40a459093b06b1f4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3518464->3792895) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21ce9 expref: 29 pid: 4385 timeout: 933 lvb_type: 0 00000100:00100000:0.0:1746129578.099141:0:20861:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4822 00000100:00100000:2.0:1746129578.099145:0:4385:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013145d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:4385:1830948737589120:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129578.099150:0:20861:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:068dab75-d300-4ead-a742-d14572ad1e50+31:32541:x1830948734333568:12345-192.168.202.4@tcp:35:lfs.0 00000100:00100000:2.0:1746129578.099224:0:4385:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132f36540 going to sleep for 11 seconds 00000100:00100000:0.0:1746129578.099522:0:20861:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:068dab75-d300-4ead-a742-d14572ad1e50+32:32541:x1830948734333568:12345-192.168.202.4@tcp:35:lfs.0 Request processed in 370us (487us total) trans 8589945437 rc 0/0 00000100:00100000:0.0:1746129578.099529:0:20861:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4822 00000100:00100000:2.0:1746129578.113880:0:4385:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013145d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:4385:1830948737589120:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129578.113917:0:4385:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f798e00/0x40a459093b06b24f lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21d1a expref: 38 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129578.113936:0:4385:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f798e00, rc 0) 00000100:00100000:2.0:1746129578.113997:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ada2ffba-8920-4ecb-8068-68caa9806978+38:32540:x1830948734333312:12345-192.168.202.4@tcp:101:cat.0 Request processed in 14984us (15129us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129578.114007:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16634 00000100:00100000:0.0:1746129578.118455:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129578.118529:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129578.118634:0:20861:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734334080 00000100:00100000:1.0:1746129578.118644:0:20861:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734334080 00000100:00100000:2.0:1746129578.118761:0:31520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734333824 00000100:00100000:2.0:1746129578.118765:0:31520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734333824 00002000:00100000:2.0:1746129578.118806:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3f5:0x0] (3518464->3792895) req@ffff88009f3e6d80 x1830948734333824/t0(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:319/0 lens 488/0 e 0 to 0 dl 1746129589 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129578.118817:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f3e6d80 with x1830948734333824 ext(3518464->3792895) 00010000:00010000:2.0:1746129578.118828:0:31520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008fba5000/0x40a459093b06b1f4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3518464->3792895) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21ce9 expref: 30 pid: 4385 timeout: 933 lvb_type: 0 00010000:00010000:2.0:1746129578.118842:0:31520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008fba5000/0x40a459093b06b1f4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3518464->3792895) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21ce9 expref: 30 pid: 4385 timeout: 933 lvb_type: 0 00002000:00010000:2.0:1746129578.118849:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f3e6d80 00000100:00100000:1.0:1746129578.119196:0:20861:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4823 00000100:00100000:1.0:1746129578.119206:0:20861:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+35:32545:x1830948734334080:12345-192.168.202.4@tcp:35:multiop.0 00000100:00100000:2.0:1746129578.119543:0:31520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2491 00000100:00100000:2.0:1746129578.119551:0:31520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+30:1962:x1830948734333824:12345-192.168.202.4@tcp:4:cat.0 00000100:00100000:1.0:1746129578.120059:0:20861:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+36:32545:x1830948734334080:12345-192.168.202.4@tcp:35:multiop.0 Request processed in 854us (1528us total) trans 8589945438 rc 0/0 00000100:00100000:1.0:1746129578.120068:0:20861:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4823 00000100:00100000:2.0:1746129578.125796:0:31520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+32:1962:x1830948734333824:12345-192.168.202.4@tcp:4:cat.0 Request processed in 6232us (7341us total) trans 17179874165 rc 0/0 00000100:00100000:2.0:1746129578.125809:0:31520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2491 00002000:00100000:2.0:1746129578.125822:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3f5:0x0] (3518464->3792895) req@ffff88009f3e6d80 x1830948734333824/t17179874165(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:319/0 lens 488/448 e 0 to 0 dl 1746129589 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129578.125831:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f3e6d80 with x1830948734333824 ext(3518464->3792895) 00010000:00010000:2.0:1746129578.125842:0:31520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008fba5000/0x40a459093b06b1f4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3518464->3792895) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21ce9 expref: 32 pid: 4385 timeout: 933 lvb_type: 0 00010000:00010000:2.0:1746129578.125864:0:31520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008fba5000/0x40a459093b06b1f4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3518464->3792895) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21ce9 expref: 32 pid: 4385 timeout: 933 lvb_type: 0 00002000:00010000:2.0:1746129578.125871:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f3e6d80 00000100:00100000:0.0:1746129578.127848:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129578.127953:0:15749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734334208 00000100:00100000:3.0:1746129578.127963:0:15749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734334208 00010000:00010000:3.0:1746129578.128003:0:15749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008fba5000/0x40a459093b06b1f4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3518464->3792895) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21ce9 expref: 32 pid: 4385 timeout: 933 lvb_type: 0 00000100:00100000:3.0:1746129578.128047:0:15749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8584 00000100:00100000:3.0:1746129578.128055:0:15749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3e7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+32:1960:x1830948734334208:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129578.128069:0:15749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129578.128091:0:15749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008fba5000/0x40a459093b06b1f4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3518464->3792895) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21ce9 expref: 32 pid: 4385 timeout: 933 lvb_type: 0 00010000:00010000:3.0:1746129578.128103:0:15749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008fba5000/0x40a459093b06b1f4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3518464->3792895) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21ce9 expref: 32 pid: 4385 timeout: 933 lvb_type: 0 00010000:00010000:3.0:1746129578.128127:0:15749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008fba5000/0x40a459093b06b1f4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3518464->3792895) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21ce9 expref: 32 pid: 4385 timeout: 933 lvb_type: 0 00010000:00010000:3.0:1746129578.128148:0:15749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129578.128149:0:15749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129578.128158:0:15749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f798e00/0x40a459093b06b24f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21d1a expref: 37 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129578.128165:0:15749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f798e00/0x40a459093b06b24f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21d1a expref: 37 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129578.128201:0:15749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f798e00/0x40a459093b06b24f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21d1a expref: 37 pid: 4385 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129578.128214:0:15749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f44ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15749:1830948737589248:192.168.202.4@tcp:105: 00000100:00100000:3.0:1746129578.128347:0:15749:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa381c00 going to sleep for 11 seconds 00000100:00100000:3.0:1746129578.129891:0:15749:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f44ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15749:1830948737589248:192.168.202.4@tcp:105: 00010000:00010000:3.0:1746129578.129911:0:15749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129578.129948:0:15749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3e7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+31:1960:x1830948734334208:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 1893us (2109us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129578.129958:0:15749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8584 00000100:00100000:0.0:1746129578.134444:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129578.134896:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129578.134947:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129578.134982:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734334592 00000100:00100000:1.0:1746129578.134992:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734334592 00000100:00100000:3.0:1746129578.135010:0:8417:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734334720 00000100:00100000:3.0:1746129578.135014:0:8417:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734334720 00002000:00100000:3.0:1746129578.135040:0:8417:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3f5:0x0] (2097152->3145727) req@ffff88012cda7480 x1830948734334720/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:319/0 lens 488/0 e 0 to 0 dl 1746129589 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129578.135040:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->4194303) req@ffff88009f3e7800 x1830948734334592/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:319/0 lens 488/0 e 0 to 0 dl 1746129589 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129578.135051:0:8417:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cda7480 with x1830948734334720 ext(2097152->3145727) 00002000:00100000:1.0:1746129578.135051:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f3e7800 with x1830948734334592 ext(3145728->4194303) 00002000:00010000:3.0:1746129578.135056:0:8417:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012cda7480 00002000:00010000:1.0:1746129578.135056:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f3e7800 00000100:00100000:3.0:1746129578.135071:0:8417:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8050 00000100:00100000:1.0:1746129578.135770:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734334848 00000100:00100000:1.0:1746129578.135775:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734334848 00002000:00100000:1.0:1746129578.135791:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f5:0x0] (3145728->4194303) req@ffff88012cda5880 x1830948734334848/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:319/0 lens 488/0 e 0 to 0 dl 1746129589 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129578.135797:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cda5880 with x1830948734334848 ext(3145728->4194303) 00002000:00010000:1.0:1746129578.135800:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012cda5880 00000100:00100000:1.0:1746129578.135846:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8051 00000100:00100000:1.0:1746129578.135852:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+26:1963:x1830948734334592:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:3.0:1746129578.136396:0:21725:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8052 00000100:00100000:3.0:1746129578.136403:0:21725:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cda5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ada2ffba-8920-4ecb-8068-68caa9806978+39:1963:x1830948734334848:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:2.0:1746129578.139906:0:8417:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cda7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ada2ffba-8920-4ecb-8068-68caa9806978+40:1963:x1830948734334720:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:1.0:1746129578.153214:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+26:1963:x1830948734334592:12345-192.168.202.4@tcp:3:cat.0 Request processed in 17348us (18767us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129578.153226:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8051 00002000:00100000:1.0:1746129578.153241:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->4194303) req@ffff88009f3e7800 x1830948734334592/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:319/0 lens 488/440 e 0 to 0 dl 1746129589 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129578.153260:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f3e7800 with x1830948734334592 ext(3145728->4194303) 00002000:00010000:1.0:1746129578.153267:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f3e7800 00000100:00100000:3.0:1746129578.168189:0:21725:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cda5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ada2ffba-8920-4ecb-8068-68caa9806978+40:1963:x1830948734334848:12345-192.168.202.4@tcp:3:cat.0 Request processed in 31775us (33229us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129578.168201:0:21725:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8052 00002000:00100000:3.0:1746129578.168212:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f5:0x0] (3145728->4194303) req@ffff88012cda5880 x1830948734334848/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:319/0 lens 488/440 e 0 to 0 dl 1746129589 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129578.168221:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cda5880 with x1830948734334848 ext(3145728->4194303) 00002000:00010000:3.0:1746129578.168229:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012cda5880 00000100:00100000:3.0:1746129578.169372:0:8417:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cda7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ada2ffba-8920-4ecb-8068-68caa9806978+38:1963:x1830948734334720:12345-192.168.202.4@tcp:3:cat.0 Request processed in 34290us (34472us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129578.169380:0:8417:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8050 00002000:00100000:3.0:1746129578.169387:0:8417:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3f5:0x0] (2097152->3145727) req@ffff88012cda7480 x1830948734334720/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:319/0 lens 488/440 e 0 to 0 dl 1746129589 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129578.169394:0:8417:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cda7480 with x1830948734334720 ext(2097152->3145727) 00002000:00010000:3.0:1746129578.169398:0:8417:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012cda7480 00000100:00100000:0.0:1746129578.182523:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129578.182593:0:8417:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734335232 00000100:00100000:3.0:1746129578.182602:0:8417:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734335232 00002000:00100000:3.0:1746129578.182647:0:8417:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3ef:0x0] (4194304->5148671) req@ffff88009f3e7b80 x1830948734335232/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:319/0 lens 488/0 e 0 to 0 dl 1746129589 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129578.182657:0:8417:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f3e7b80 with x1830948734335232 ext(4194304->5148671) 00002000:00010000:3.0:1746129578.182662:0:8417:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f3e7b80 00000100:00100000:3.0:1746129578.182694:0:8417:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8053 00000100:00100000:3.0:1746129578.182700:0:8417:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ada2ffba-8920-4ecb-8068-68caa9806978+26:1961:x1830948734335232:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:2.0:1746129578.184108:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129578.188904:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734335360 00000100:00100000:3.0:1746129578.188919:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734335360 00000100:00100000:3.0:1746129578.188994:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16635 00000100:00100000:3.0:1746129578.189002:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013145d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ada2ffba-8920-4ecb-8068-68caa9806978+38:32543:x1830948734335360:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:3.0:1746129578.189022:0:4385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129578.189041:0:4385:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a062da00/0x40a459093b06b256 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21d21 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129578.189072:0:4385:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f798e00/0x40a459093b06b24f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21d1a expref: 39 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129578.189081:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129578.189083:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129578.189087:0:4385:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a062da00/0x40a459093b06b256 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [2502656->3145727] (req 2502656->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21d21 expref: 39 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129578.189121:0:4385:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f798e00/0x40a459093b06b24f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21d1a expref: 39 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129578.189133:0:4385:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f798e00/0x40a459093b06b24f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21d1a expref: 39 pid: 4385 timeout: 933 lvb_type: 0 00000100:00100000:3.0:1746129578.189146:0:4385:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f44ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:4385:1830948737589376:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129578.189272:0:4385:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa381c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746129578.195405:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129578.195503:0:4385:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f44ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:4385:1830948737589376:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129578.195536:0:4385:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a062da00/0x40a459093b06b256 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [2502656->3145727] (req 2502656->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21d21 expref: 39 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129578.195556:0:4385:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a062da00, rc 0) 00000100:00100000:3.0:1746129578.195580:0:15749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734335488 00000100:00100000:3.0:1746129578.195587:0:15749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734335488 00000100:00100000:2.0:1746129578.195609:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013145d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ada2ffba-8920-4ecb-8068-68caa9806978+40:32543:x1830948734335360:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 6607us (11504us total) trans 0 rc 0/0 00010000:00010000:3.0:1746129578.195617:0:15749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f798e00/0x40a459093b06b24f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21d1a expref: 40 pid: 4385 timeout: 933 lvb_type: 0 00000100:00100000:2.0:1746129578.195617:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16635 00000100:00100000:3.0:1746129578.195637:0:15749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8585 00000100:00100000:3.0:1746129578.195643:0:15749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ada2ffba-8920-4ecb-8068-68caa9806978+39:1962:x1830948734335488:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129578.195657:0:15749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129578.195678:0:15749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f798e00/0x40a459093b06b24f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21d1a expref: 39 pid: 4385 timeout: 933 lvb_type: 0 00010000:00010000:3.0:1746129578.195689:0:15749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f798e00/0x40a459093b06b24f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21d1a expref: 39 pid: 4385 timeout: 933 lvb_type: 0 00010000:00010000:3.0:1746129578.195713:0:15749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f798e00/0x40a459093b06b24f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21d1a expref: 39 pid: 4385 timeout: 933 lvb_type: 0 00010000:00010000:3.0:1746129578.195728:0:15749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129578.195730:0:15749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129578.195736:0:15749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a062da00/0x40a459093b06b256 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2502656->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21d21 expref: 38 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129578.195744:0:15749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a062da00/0x40a459093b06b256 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2502656->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21d21 expref: 38 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129578.195770:0:15749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a062da00/0x40a459093b06b256 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2502656->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21d21 expref: 38 pid: 4385 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129578.195781:0:15749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f448380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15749:1830948737589504:192.168.202.4@tcp:105: 00000100:00100000:3.0:1746129578.195829:0:15749:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa381c00 going to sleep for 11 seconds 00000100:00100000:3.0:1746129578.196111:0:8417:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ada2ffba-8920-4ecb-8068-68caa9806978+26:1961:x1830948734335232:12345-192.168.202.4@tcp:3:cat.0 Request processed in 13410us (13599us total) trans 0 rc 954368/954368 00000100:00100000:3.0:1746129578.196118:0:8417:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8053 00002000:00100000:3.0:1746129578.196127:0:8417:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3ef:0x0] (4194304->5148671) req@ffff88009f3e7b80 x1830948734335232/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:319/0 lens 488/440 e 0 to 0 dl 1746129589 ref 1 fl Complete:/200/0 rc 954368/954368 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129578.196135:0:8417:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f3e7b80 with x1830948734335232 ext(4194304->5148671) 00002000:00010000:3.0:1746129578.196139:0:8417:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f3e7b80 00000100:00100000:3.0:1746129578.198886:0:15749:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f448380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15749:1830948737589504:192.168.202.4@tcp:105: 00010000:00010000:3.0:1746129578.198909:0:15749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129578.198951:0:15749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ada2ffba-8920-4ecb-8068-68caa9806978+38:1962:x1830948734335488:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 3307us (3556us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129578.198962:0:15749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8585 00000100:00100000:0.0:1746129578.202166:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129578.202468:0:8417:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734335744 00000100:00100000:3.0:1746129578.202479:0:8417:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734335744 00002000:00100000:3.0:1746129578.202525:0:8417:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3f5:0x0] (2502656->2506751) req@ffff88013570c000 x1830948734335744/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:319/0 lens 488/0 e 0 to 0 dl 1746129589 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129578.202535:0:8417:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013570c000 with x1830948734335744 ext(2502656->2506751) 00002000:00010000:3.0:1746129578.202540:0:8417:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013570c000 00000100:00100000:3.0:1746129578.202571:0:8417:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8054 00000100:00100000:3.0:1746129578.202577:0:8417:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013570c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ada2ffba-8920-4ecb-8068-68caa9806978+38:1962:x1830948734335744:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:3.0:1746129578.202791:0:8417:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013570c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ada2ffba-8920-4ecb-8068-68caa9806978+38:1962:x1830948734335744:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 213us (634us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129578.202797:0:8417:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8054 00002000:00100000:3.0:1746129578.202803:0:8417:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3f5:0x0] (2502656->2506751) req@ffff88013570c000 x1830948734335744/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:319/0 lens 488/4536 e 0 to 0 dl 1746129589 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129578.202810:0:8417:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013570c000 with x1830948734335744 ext(2502656->2506751) 00002000:00010000:3.0:1746129578.202813:0:8417:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013570c000 00000100:00100000:0.0:1746129578.223683:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129578.224091:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734335872 00000100:00100000:2.0:1746129578.224102:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734335872 00000100:00100000:2.0:1746129578.224164:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16636 00000100:00100000:2.0:1746129578.224175:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013570c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ada2ffba-8920-4ecb-8068-68caa9806978+26:32543:x1830948734335872:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:2.0:1746129578.224198:0:4385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129578.224224:0:4385:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f798800/0x40a459093b06b25d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21d28 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129578.224262:0:4385:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095287200/0x40a459093b06b1c3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21cb1 expref: 27 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129578.224275:0:4385:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008fba5200/0x40a459093b06b233 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21cfe expref: 7 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129578.224281:0:4385:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008fba5a00/0x40a459093b06b202 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 5144576->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21cf0 expref: 20 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129578.224287:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129578.224289:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129578.224326:0:4385:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f798800/0x40a459093b06b25d lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [3145728->3477503] (req 3145728->3477503) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21d28 expref: 27 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129578.224359:0:4385:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008fba5a00/0x40a459093b06b202 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 5144576->5242879) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21cf0 expref: 20 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129578.224371:0:4385:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008fba5a00/0x40a459093b06b202 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 5144576->5242879) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21cf0 expref: 20 pid: 8410 timeout: 933 lvb_type: 0 00000100:00100000:2.0:1746129578.224382:0:4385:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094efd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:4385:1830948737589632:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129578.225586:0:4385:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008fba5200/0x40a459093b06b233 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21cfe expref: 7 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129578.225600:0:4385:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008fba5200/0x40a459093b06b233 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21cfe expref: 7 pid: 8410 timeout: 933 lvb_type: 1 00000100:00100000:2.0:1746129578.225611:0:4385:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c079f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:4385:1830948737589760:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129578.226635:0:4385:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095287200/0x40a459093b06b1c3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21cb1 expref: 27 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129578.226646:0:4385:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095287200/0x40a459093b06b1c3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21cb1 expref: 27 pid: 7148 timeout: 933 lvb_type: 0 00000100:00100000:2.0:1746129578.226655:0:4385:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a77b1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:4385:1830948737589888:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129578.226816:0:4385:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132f36540 going to sleep for 11 seconds 00000100:00100000:2.0:1746129578.227666:0:4385:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094efd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:4385:1830948737589632:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129578.231528:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129578.231896:0:15749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734336000 00000100:00100000:3.0:1746129578.231905:0:15749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734336000 00010000:00010000:3.0:1746129578.231944:0:15749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008fba5a00/0x40a459093b06b202 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 5144576->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21cf0 expref: 21 pid: 8410 timeout: 933 lvb_type: 0 00000100:00100000:2.0:1746129578.232241:0:4385:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c079f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:4385:1830948737589760:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129578.232430:0:15749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8586 00000100:00100000:3.0:1746129578.232438:0:15749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013570c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:1960:x1830948734336000:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129578.232452:0:15749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129578.232477:0:15749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008fba5a00/0x40a459093b06b202 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 5144576->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21cf0 expref: 21 pid: 8410 timeout: 933 lvb_type: 0 00010000:00010000:3.0:1746129578.232488:0:15749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008fba5a00/0x40a459093b06b202 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 5144576->5242879) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21cf0 expref: 21 pid: 8410 timeout: 933 lvb_type: 0 00010000:00010000:3.0:1746129578.232509:0:15749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008fba5a00/0x40a459093b06b202 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 5144576->5242879) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21cf0 expref: 21 pid: 8410 timeout: 933 lvb_type: 0 00000100:00100000:0.0:1746129578.232678:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00010000:00010000:3.0:1746129578.234961:0:15749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129578.235047:0:15749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013570c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:1960:x1830948734336000:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 2601us (3525us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129578.235060:0:15749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8586 00000100:00100000:0.0:1746129578.235853:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129578.235908:0:15749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734336256 00000100:00100000:3.0:1746129578.235917:0:15749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734336256 00010000:00010000:3.0:1746129578.235949:0:15749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095287200/0x40a459093b06b1c3 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21cb1 expref: 28 pid: 7148 timeout: 933 lvb_type: 0 00000100:00100000:2.0:1746129578.236011:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8587 00000100:00100000:2.0:1746129578.236022:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013570ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ada2ffba-8920-4ecb-8068-68caa9806978+28:1962:x1830948734336256:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129578.236035:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129578.236061:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095287200/0x40a459093b06b1c3 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21cb1 expref: 28 pid: 7148 timeout: 933 lvb_type: 0 00010000:00010000:2.0:1746129578.236072:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095287200/0x40a459093b06b1c3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21cb1 expref: 28 pid: 7148 timeout: 933 lvb_type: 0 00010000:00010000:2.0:1746129578.236094:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129578.236121:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013570ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ada2ffba-8920-4ecb-8068-68caa9806978+28:1962:x1830948734336256:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 104us (3444us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129578.236127:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8587 00010000:00010000:2.0:1746129578.236186:0:4385:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095287200/0x40a459093b06b1c3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21cb1 expref: 27 pid: 7148 timeout: 933 lvb_type: 0 00000100:00100000:2.0:1746129578.236208:0:4385:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a77b1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:4385:1830948737589888:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129578.236241:0:4385:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f798800/0x40a459093b06b25d lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [3145728->3477503] (req 3145728->3477503) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21d28 expref: 26 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129578.236270:0:4385:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f798800, rc 0) 00000100:00100000:2.0:1746129578.236306:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013570c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ada2ffba-8920-4ecb-8068-68caa9806978+26:32543:x1830948734335872:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 12119us (12620us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129578.236313:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16636 00000100:00100000:3.0:1746129578.236707:0:15749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734336128 00000100:00100000:3.0:1746129578.236711:0:15749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734336128 00010000:00010000:3.0:1746129578.236724:0:15749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008fba5200/0x40a459093b06b233 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21cfe expref: 8 pid: 8410 timeout: 933 lvb_type: 1 00000100:00100000:3.0:1746129578.236747:0:7087:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8588 00000100:00100000:3.0:1746129578.236752:0:7087:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013570ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:068dab75-d300-4ead-a742-d14572ad1e50+8:1961:x1830948734336128:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129578.236762:0:7087:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129578.236773:0:7087:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008fba5200/0x40a459093b06b233 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21cfe expref: 8 pid: 8410 timeout: 933 lvb_type: 1 00010000:00010000:3.0:1746129578.236782:0:7087:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008fba5200/0x40a459093b06b233 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21cfe expref: 8 pid: 8410 timeout: 933 lvb_type: 1 00010000:00010000:3.0:1746129578.236801:0:7087:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008fba5200/0x40a459093b06b233 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21cfe expref: 8 pid: 8410 timeout: 933 lvb_type: 1 00010000:00010000:3.0:1746129578.236811:0:7087:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129578.236812:0:7087:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129578.236819:0:7087:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f798800/0x40a459093b06b25d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3477503) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21d28 expref: 25 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129578.236827:0:7087:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f798800/0x40a459093b06b25d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3477503) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21d28 expref: 25 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129578.236857:0:7087:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f798800/0x40a459093b06b25d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3477503) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21d28 expref: 25 pid: 4385 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129578.236869:0:7087:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f448380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7087:1830948737590016:192.168.202.4@tcp:105: 00000100:00100000:3.0:1746129578.236919:0:7087:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa381a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746129578.237336:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129578.237362:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129578.237456:0:8412:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734336384 00000100:00100000:1.0:1746129578.237461:0:8412:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734336384 00000100:00100000:1.0:1746129578.237482:0:8412:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734336512 00000100:00100000:1.0:1746129578.237484:0:8412:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734336512 00000100:00100000:1.0:1746129578.237500:0:8412:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16637 00000100:00100000:1.0:1746129578.237504:0:8412:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013570d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:1963:x1830948734336384:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129578.237518:0:8412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129578.237528:0:8412:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129861200/0x40a459093b06b264 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21d2f expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129578.237559:0:8412:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cda6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8412:1830948737590144:192.168.202.4@tcp:106: 00000100:00100000:1.0:1746129578.237591:0:8412:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0ac600 going to sleep for 11 seconds 00000100:00100000:1.0:1746129578.237607:0:8410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16638 00000100:00100000:1.0:1746129578.237612:0:8410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013570d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+31:1963:x1830948734336512:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129578.237619:0:8410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129578.237628:0:8410:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129861800/0x40a459093b06b26b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21d36 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129578.237651:0:8410:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cda6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8410:1830948737590272:192.168.202.4@tcp:106: 00000100:00100000:1.0:1746129578.237669:0:8410:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0ac000 going to sleep for 11 seconds 00000100:00100000:3.0:1746129578.238108:0:7087:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f448380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7087:1830948737590016:192.168.202.4@tcp:105: 00010000:00010000:3.0:1746129578.238119:0:7087:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129578.238141:0:7087:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013570ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:068dab75-d300-4ead-a742-d14572ad1e50+7:1961:x1830948734336128:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 1388us (2291us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129578.238149:0:7087:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8588 00000100:00100000:2.0:1746129578.241712:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129578.241846:0:8410:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cda6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8410:1830948737590272:192.168.202.4@tcp:106: 00010000:00010000:0.0:1746129578.241878:0:8410:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129861800/0x40a459093b06b26b lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21d36 expref: 32 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129578.241893:0:8410:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129861800/0x40a459093b06b26b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21d36 expref: 32 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129578.241909:0:8410:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129861800, rc 0) 00000100:00100000:0.0:1746129578.241953:0:8410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013570d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+31:1963:x1830948734336512:12345-192.168.202.4@tcp:101:cat.0 Request processed in 4340us (4590us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129578.241962:0:8410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16638 00000100:00100000:0.0:1746129578.242000:0:21725:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734336768 00000100:00100000:0.0:1746129578.242006:0:21725:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734336768 00002000:00100000:0.0:1746129578.242041:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ef:0x0] (3473408->3477503) req@ffff8800a77b1500 x1830948734336768/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:319/0 lens 488/0 e 0 to 0 dl 1746129589 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129578.242049:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a77b1500 with x1830948734336768 ext(3473408->3477503) 00002000:00010000:0.0:1746129578.242054:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a77b1500 00000100:00100000:1.0:1746129578.242161:0:8412:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cda6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8412:1830948737590144:192.168.202.4@tcp:106: 00010000:00010000:1.0:1746129578.242179:0:8412:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129861200/0x40a459093b06b264 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21d2f expref: 21 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129578.242187:0:8412:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129861200/0x40a459093b06b264 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21d2f expref: 21 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129578.242198:0:8412:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129861200, rc 0) 00000100:00100000:1.0:1746129578.242216:0:8412:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013570d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:1963:x1830948734336384:12345-192.168.202.4@tcp:101:cat.0 Request processed in 4712us (4880us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129578.242221:0:8412:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16637 00000100:00100000:0.0:1746129578.242941:0:21725:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8055 00000100:00100000:0.0:1746129578.242951:0:21725:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a77b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ada2ffba-8920-4ecb-8068-68caa9806978+26:1962:x1830948734336768:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129578.243968:0:21725:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a77b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ada2ffba-8920-4ecb-8068-68caa9806978+26:1962:x1830948734336768:12345-192.168.202.4@tcp:3:cat.0 Request processed in 1012us (2261us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746129578.243976:0:21725:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8055 00002000:00100000:0.0:1746129578.243984:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ef:0x0] (3473408->3477503) req@ffff8800a77b1500 x1830948734336768/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:319/0 lens 488/4536 e 0 to 0 dl 1746129589 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129578.243993:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a77b1500 with x1830948734336768 ext(3473408->3477503) 00002000:00010000:0.0:1746129578.243998:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a77b1500 00000100:00100000:0.0:1746129578.252387:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129578.252432:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129578.254118:0:8412:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734336896 00000100:00100000:2.0:1746129578.254131:0:8412:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734336896 00000100:00100000:2.0:1746129578.254188:0:8412:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16639 00000100:00100000:2.0:1746129578.254196:0:8412:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013570d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:1962:x1830948734336896:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129578.254215:0:8412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129578.254233:0:8412:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f798000/0x40a459093b06b272 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21d3d expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129578.254314:0:8412:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a77b0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8412:1830948737590400:192.168.202.4@tcp:106: 00000100:00100000:2.0:1746129578.254397:0:8412:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132f36540 going to sleep for 11 seconds 00000100:00100000:3.0:1746129578.254488:0:15096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734337536 00000100:00100000:3.0:1746129578.254495:0:15096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734337536 00000100:00100000:3.0:1746129578.254537:0:15096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11323 00000100:00100000:3.0:1746129578.254543:0:15096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cda6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+36:32555:x1830948734337536:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:3.0:1746129578.254556:0:15096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129578.254568:0:15096:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a062d600/0x40a459093b06b279 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21d4b expref: -99 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129578.254666:0:15096:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a062c800/0x40a459093b06b280 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 15096 initiator: MDT0 00010000:00010000:3.0:1746129578.254680:0:15096:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a062c800/0x40a459093b06b280 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 15096 initiator: MDT0 00010000:00010000:3.0:1746129578.254691:0:15096:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a062c800/0x40a459093b06b280 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 15096 initiator: MDT0 00000004:00200000:3.0:1746129578.254701:0:15096:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:3.0:1746129578.254821:0:15096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a062d600/0x40a459093b06b279 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21d4b expref: 39 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129578.254840:0:15096:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a062c800/0x40a459093b06b280 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21d4b expref: 38 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129578.254847:0:15096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:3.0:1746129578.254850:0:15096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746129578.254853:0:15096:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a062c800, rc 0) 00000100:00100000:3.0:1746129578.254880:0:15096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cda6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+38:32555:x1830948734337536:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 336us (2448us total) trans 8589945439 rc 0/0 00000100:00100000:3.0:1746129578.254887:0:15096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11323 00000100:00100000:0.0:1746129578.255201:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129578.255329:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129578.255370:0:8410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734337280 00000100:00100000:3.0:1746129578.255374:0:8410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734337280 00000100:00100000:2.0:1746129578.255392:0:20861:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734337152 00000100:00100000:3.0:1746129578.255395:0:8410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16640 00000100:00100000:2.0:1746129578.255395:0:20861:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734337152 00000100:00100000:3.0:1746129578.255400:0:8410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013570df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+31:1963:x1830948734337280:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129578.255407:0:8410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746129578.255416:0:20861:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4824 00010000:00010000:3.0:1746129578.255417:0:8410:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a062c600/0x40a459093b06b28e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21d44 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129578.255420:0:20861:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013570dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:ada2ffba-8920-4ecb-8068-68caa9806978+321:32543:x1830948734337152:12345-192.168.202.4@tcp:35:multiop.0 00000100:00100000:3.0:1746129578.255446:0:8410:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f448380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8410:1830948737590528:192.168.202.4@tcp:106: 00000100:00100000:3.0:1746129578.255479:0:8410:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa381a80 going to sleep for 11 seconds 00000100:00100000:2.0:1746129578.255515:0:20861:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013570dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:ada2ffba-8920-4ecb-8068-68caa9806978+322:32543:x1830948734337152:12345-192.168.202.4@tcp:35:multiop.0 Request processed in 93us (314us total) trans 8589945440 rc 0/0 00000100:00100000:2.0:1746129578.255522:0:20861:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4824 00000100:00100000:2.0:1746129578.259788:0:8412:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a77b0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8412:1830948737590400:192.168.202.4@tcp:106: 00010000:00010000:2.0:1746129578.259828:0:8412:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f798000/0x40a459093b06b272 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21d3d expref: 21 pid: 8412 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746129578.259841:0:8410:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f448380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8410:1830948737590528:192.168.202.4@tcp:106: 00010000:00010000:2.0:1746129578.259843:0:8412:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f798000/0x40a459093b06b272 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21d3d expref: 21 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129578.259854:0:8412:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f798000, rc 0) 00010000:00010000:3.0:1746129578.259857:0:8410:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a062c600/0x40a459093b06b28e lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21d44 expref: 32 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129578.259864:0:8410:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a062c600/0x40a459093b06b28e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21d44 expref: 32 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129578.259870:0:8410:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a062c600, rc 0) 00000100:00100000:3.0:1746129578.259927:0:8410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013570df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+31:1963:x1830948734337280:12345-192.168.202.4@tcp:101:cat.0 Request processed in 4524us (4596us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129578.259935:0:8410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16640 00000100:00100000:2.0:1746129578.260045:0:8412:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013570d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:1962:x1830948734336896:12345-192.168.202.4@tcp:101:cat.0 Request processed in 5706us (7526us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129578.260050:0:8412:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16639 00000100:00100000:0.0:1746129578.263639:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129578.263764:0:8412:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734337664 00000100:00100000:2.0:1746129578.263773:0:8412:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734337664 00000100:00100000:2.0:1746129578.263833:0:8412:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16641 00000100:00100000:2.0:1746129578.263842:0:8412:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013570e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:32553:x1830948734337664:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129578.263859:0:8412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129578.263876:0:8412:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f798600/0x40a459093b06b295 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21d52 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129578.263910:0:8412:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f798800/0x40a459093b06b25d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3477503) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21d28 expref: 25 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129578.263918:0:8412:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129578.263919:0:8412:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129578.263922:0:8412:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f798600/0x40a459093b06b295 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21d52 expref: 21 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129578.263954:0:8412:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f798800/0x40a459093b06b25d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3477503) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21d28 expref: 25 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129578.263966:0:8412:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f798800/0x40a459093b06b25d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3477503) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21d28 expref: 25 pid: 4385 timeout: 933 lvb_type: 0 00000100:00100000:2.0:1746129578.263978:0:8412:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a77b0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8412:1830948737590656:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129578.264069:0:8412:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132f36540 going to sleep for 11 seconds 00000100:00100000:2.0:1746129578.268732:0:8412:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a77b0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8412:1830948737590656:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129578.268780:0:8412:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f798600/0x40a459093b06b295 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21d52 expref: 21 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129578.268800:0:8412:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f798600, rc 0) 00000100:00100000:0.0:1746129578.269017:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129578.269723:0:8410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734337792 00000100:00100000:3.0:1746129578.269730:0:8410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734337792 00000100:00100000:2.0:1746129578.270150:0:8412:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013570e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:32553:x1830948734337664:12345-192.168.202.4@tcp:101:cat.0 Request processed in 6307us (6517us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129578.270158:0:8412:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16641 00000100:00100000:1.0:1746129578.270956:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129578.270981:0:8410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16642 00000100:00100000:3.0:1746129578.270991:0:8410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013570e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+31:32555:x1830948734337792:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:3.0:1746129578.271007:0:8410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129578.271024:0:8410:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a062c400/0x40a459093b06b29c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21d59 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129578.271027:0:21725:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734337920 00000100:00100000:0.0:1746129578.271031:0:21725:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734337920 00010000:00010000:3.0:1746129578.271048:0:8410:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800951ade00/0x40a459093b06b176 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21c87 expref: 32 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129578.271058:0:8410:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a6caf800/0x40a459093b06b1ca lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21cbf expref: 6 pid: 8410 timeout: 0 lvb_type: 1 00002000:00100000:0.0:1746129578.271061:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->3477503) req@ffff88012cda6d80 x1830948734337920/t0(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:319/0 lens 488/0 e 0 to 0 dl 1746129589 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:3.0:1746129578.271065:0:8410:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f119000/0x40a459093b06b184 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21c95 expref: 37 pid: 7148 timeout: 0 lvb_type: 1 00002000:00100000:0.0:1746129578.271070:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cda6d80 with x1830948734337920 ext(3145728->3477503) 00010000:00010000:3.0:1746129578.271071:0:8410:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129578.271072:0:8410:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129578.271075:0:8410:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a062c400/0x40a459093b06b29c lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [1388544->1724415] (req 1388544->1724415) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21d59 expref: 32 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129578.271076:0:21725:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f798800/0x40a459093b06b25d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3477503) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21d28 expref: 26 pid: 4385 timeout: 933 lvb_type: 0 00010000:00010000:0.0:1746129578.271086:0:21725:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f798800/0x40a459093b06b25d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3477503) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21d28 expref: 26 pid: 4385 timeout: 933 lvb_type: 0 00002000:00010000:0.0:1746129578.271092:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012cda6d80 00010000:00010000:3.0:1746129578.271102:0:8410:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f119000/0x40a459093b06b184 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21c95 expref: 37 pid: 7148 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746129578.271106:0:21725:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2492 00000100:00100000:0.0:1746129578.271110:0:21725:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cda6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ada2ffba-8920-4ecb-8068-68caa9806978+26:1961:x1830948734337920:12345-192.168.202.4@tcp:4:cat.0 00010000:00010000:3.0:1746129578.271111:0:8410:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f119000/0x40a459093b06b184 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21c95 expref: 37 pid: 7148 timeout: 933 lvb_type: 1 00000100:00100000:3.0:1746129578.271122:0:8410:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f448380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8410:1830948737590784:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129578.271454:0:8410:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a6caf800/0x40a459093b06b1ca lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21cbf expref: 6 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129578.271463:0:8410:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a6caf800/0x40a459093b06b1ca lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21cbf expref: 6 pid: 8410 timeout: 933 lvb_type: 1 00000100:00100000:3.0:1746129578.271471:0:8410:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f44ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8410:1830948737590912:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129578.271500:0:8410:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800951ade00/0x40a459093b06b176 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21c87 expref: 32 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129578.271506:0:8410:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800951ade00/0x40a459093b06b176 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21c87 expref: 32 pid: 7148 timeout: 933 lvb_type: 0 00000100:00100000:3.0:1746129578.271514:0:8410:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8410:1830948737591040:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129578.271528:0:8410:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa381a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746129578.275011:0:8410:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f448380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8410:1830948737590784:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129578.275055:0:8410:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8410:1830948737591040:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129578.278746:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129578.278808:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129578.280582:0:8410:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f44ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8410:1830948737590912:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129578.280624:0:8410:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a062c400/0x40a459093b06b29c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [1388544->1724415] (req 1388544->1724415) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21d59 expref: 32 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129578.280642:0:8410:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a062c400, rc 0) 00000100:00100000:0.0:1746129578.280692:0:8410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013570e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+32:32555:x1830948734337792:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 9703us (11675us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129578.280701:0:8410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16642 00000100:00100000:2.0:1746129578.281290:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129578.281625:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734338176 00000100:00100000:1.0:1746129578.281625:0:20578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734338048 00000100:00100000:3.0:1746129578.281633:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734338176 00000100:00100000:1.0:1746129578.281633:0:20578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734338048 00010000:00010000:3.0:1746129578.281664:0:7087:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800951ade00/0x40a459093b06b176 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21c87 expref: 32 pid: 7148 timeout: 933 lvb_type: 0 00010000:00010000:1.0:1746129578.281664:0:20578:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6caf800/0x40a459093b06b1ca lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21cbf expref: 7 pid: 8410 timeout: 933 lvb_type: 1 00000100:00100000:3.0:1746129578.281694:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734338304 00000100:00100000:3.0:1746129578.281696:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734338304 00010000:00010000:3.0:1746129578.281707:0:7087:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f119000/0x40a459093b06b184 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21c95 expref: 38 pid: 7148 timeout: 933 lvb_type: 1 00000100:00100000:1.0:1746129578.281891:0:20578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8589 00000100:00100000:1.0:1746129578.281898:0:20578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a77b0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+32:1963:x1830948734338176:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129578.281913:0:20578:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129578.281934:0:20578:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800951ade00/0x40a459093b06b176 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21c87 expref: 32 pid: 7148 timeout: 933 lvb_type: 0 00010000:00010000:1.0:1746129578.281943:0:20578:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800951ade00/0x40a459093b06b176 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21c87 expref: 32 pid: 7148 timeout: 933 lvb_type: 0 00010000:00010000:1.0:1746129578.281965:0:20578:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800951ade00/0x40a459093b06b176 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21c87 expref: 32 pid: 7148 timeout: 933 lvb_type: 0 00010000:00010000:1.0:1746129578.281980:0:20578:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129578.282008:0:20578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a77b0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+31:1963:x1830948734338176:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 110us (3199us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129578.282014:0:20578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8589 00000100:00100000:1.0:1746129578.282025:0:20578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8590 00000100:00100000:1.0:1746129578.282029:0:20578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6025850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:068dab75-d300-4ead-a742-d14572ad1e50+7:1962:x1830948734338048:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129578.282036:0:20578:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129578.282043:0:20578:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a6caf800/0x40a459093b06b1ca lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21cbf expref: 7 pid: 8410 timeout: 933 lvb_type: 1 00010000:00010000:1.0:1746129578.282051:0:20578:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a6caf800/0x40a459093b06b1ca lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21cbf expref: 7 pid: 8410 timeout: 933 lvb_type: 1 00010000:00010000:1.0:1746129578.282061:0:20578:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a6caf800/0x40a459093b06b1ca lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21cbf expref: 7 pid: 8410 timeout: 933 lvb_type: 1 00010000:00010000:1.0:1746129578.282074:0:20578:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129578.282086:0:20578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6025850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:068dab75-d300-4ead-a742-d14572ad1e50+6:1962:x1830948734338048:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 57us (3352us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129578.282091:0:20578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8590 00000100:00100000:1.0:1746129578.282135:0:20578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8591 00000100:00100000:1.0:1746129578.282140:0:20578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a77b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ada2ffba-8920-4ecb-8068-68caa9806978+38:1960:x1830948734338304:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129578.282146:0:20578:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129578.282153:0:20578:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f119000/0x40a459093b06b184 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21c95 expref: 38 pid: 7148 timeout: 933 lvb_type: 1 00010000:00010000:1.0:1746129578.282159:0:20578:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f119000/0x40a459093b06b184 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21c95 expref: 38 pid: 7148 timeout: 933 lvb_type: 1 00010000:00010000:1.0:1746129578.282171:0:20578:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f119000/0x40a459093b06b184 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21c95 expref: 38 pid: 7148 timeout: 933 lvb_type: 1 00010000:00010000:1.0:1746129578.282179:0:20578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129578.282181:0:20578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129578.282188:0:20578:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a062c400/0x40a459093b06b29c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1388544->1724415) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21d59 expref: 30 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129578.282195:0:20578:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a062c400/0x40a459093b06b29c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1388544->1724415) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21d59 expref: 30 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129578.282223:0:20578:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a062c400/0x40a459093b06b29c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1388544->1724415) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21d59 expref: 30 pid: 8410 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129578.282235:0:20578:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cda4e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:20578:1830948737591168:192.168.202.4@tcp:105: 00000100:00100000:1.0:1746129578.282288:0:20578:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0aca80 going to sleep for 11 seconds 00000100:00100000:2.0:1746129578.285726:0:20578:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cda4e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:20578:1830948737591168:192.168.202.4@tcp:105: 00010000:00010000:2.0:1746129578.285747:0:20578:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129578.286727:0:21725:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cda6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ada2ffba-8920-4ecb-8068-68caa9806978+28:1961:x1830948734337920:12345-192.168.202.4@tcp:4:cat.0 Request processed in 15609us (15765us total) trans 21474841410 rc 0/0 00000100:00100000:1.0:1746129578.286738:0:21725:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2492 00002000:00100000:1.0:1746129578.286752:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->3477503) req@ffff88012cda6d80 x1830948734337920/t21474841410(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:319/0 lens 488/448 e 0 to 0 dl 1746129589 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129578.286762:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cda6d80 with x1830948734337920 ext(3145728->3477503) 00010000:00010000:1.0:1746129578.286772:0:21725:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f798800/0x40a459093b06b25d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3477503) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21d28 expref: 28 pid: 4385 timeout: 933 lvb_type: 0 00010000:00010000:1.0:1746129578.286786:0:21725:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f798800/0x40a459093b06b25d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3477503) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21d28 expref: 28 pid: 4385 timeout: 933 lvb_type: 0 00002000:00010000:1.0:1746129578.286793:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012cda6d80 00000100:00100000:0.0:1746129578.287058:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129578.287109:0:20578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a77b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ada2ffba-8920-4ecb-8068-68caa9806978+37:1960:x1830948734338304:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 4967us (5821us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129578.287118:0:20578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8591 00000100:00100000:1.0:1746129578.287539:0:21725:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734338560 00000100:00100000:1.0:1746129578.287547:0:21725:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734338560 00002000:00100000:1.0:1746129578.287580:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f3:0x0] (1388544->1392639) req@ffff88013570ea00 x1830948734338560/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:319/0 lens 488/0 e 0 to 0 dl 1746129589 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129578.287588:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013570ea00 with x1830948734338560 ext(1388544->1392639) 00002000:00010000:1.0:1746129578.287592:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013570ea00 00000100:00100000:1.0:1746129578.287606:0:21725:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8056 00000100:00100000:1.0:1746129578.287611:0:21725:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013570ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+31:1962:x1830948734338560:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:1.0:1746129578.288643:0:21725:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013570ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+31:1962:x1830948734338560:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 1024us (1579us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746129578.288651:0:21725:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8056 00002000:00100000:1.0:1746129578.288657:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f3:0x0] (1388544->1392639) req@ffff88013570ea00 x1830948734338560/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:319/0 lens 488/4536 e 0 to 0 dl 1746129589 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129578.288665:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013570ea00 with x1830948734338560 ext(1388544->1392639) 00002000:00010000:1.0:1746129578.288669:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013570ea00 00000100:00100000:0.0:1746129578.289349:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129578.289880:0:20578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734338688 00000100:00100000:3.0:1746129578.289888:0:20578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734338688 00010000:00010000:3.0:1746129578.289915:0:20578:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f798800/0x40a459093b06b25d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3477503) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21d28 expref: 28 pid: 4385 timeout: 933 lvb_type: 0 00000100:00100000:3.0:1746129578.289937:0:20578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8592 00000100:00100000:3.0:1746129578.289943:0:20578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013570ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ada2ffba-8920-4ecb-8068-68caa9806978+28:1961:x1830948734338688:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129578.289954:0:20578:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129578.289975:0:20578:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f798800/0x40a459093b06b25d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3477503) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21d28 expref: 28 pid: 4385 timeout: 933 lvb_type: 0 00010000:00010000:3.0:1746129578.289985:0:20578:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f798800/0x40a459093b06b25d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3477503) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21d28 expref: 28 pid: 4385 timeout: 933 lvb_type: 0 00010000:00010000:3.0:1746129578.290006:0:20578:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f798800/0x40a459093b06b25d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3477503) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21d28 expref: 28 pid: 4385 timeout: 933 lvb_type: 0 00010000:00010000:3.0:1746129578.290021:0:20578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129578.290023:0:20578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129578.290030:0:20578:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f798600/0x40a459093b06b295 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21d52 expref: 20 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129578.290039:0:20578:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f798600/0x40a459093b06b295 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21d52 expref: 20 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129578.290072:0:20578:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f798600/0x40a459093b06b295 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21d52 expref: 20 pid: 8412 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129578.290084:0:20578:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bdc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:20578:1830948737591296:192.168.202.4@tcp:105: 00000100:00100000:3.0:1746129578.291451:0:20578:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa3813c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129578.293844:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129578.296771:0:21725:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734338944 00000100:00100000:1.0:1746129578.296785:0:21725:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734338944 00002000:00100000:1.0:1746129578.296838:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f3:0x0] (1720320->1724415) req@ffff88013570f100 x1830948734338944/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:319/0 lens 488/0 e 0 to 0 dl 1746129589 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129578.296848:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013570f100 with x1830948734338944 ext(1720320->1724415) 00002000:00010000:1.0:1746129578.296854:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013570f100 00000100:00100000:1.0:1746129578.296890:0:21725:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8057 00000100:00100000:1.0:1746129578.296897:0:21725:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013570f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+31:1960:x1830948734338944:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:1.0:1746129578.297121:0:21725:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013570f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+31:1960:x1830948734338944:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 223us (3288us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746129578.297128:0:21725:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8057 00002000:00100000:1.0:1746129578.297134:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f3:0x0] (1720320->1724415) req@ffff88013570f100 x1830948734338944/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:319/0 lens 488/4536 e 0 to 0 dl 1746129589 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129578.297141:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013570f100 with x1830948734338944 ext(1720320->1724415) 00002000:00010000:1.0:1746129578.297144:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013570f100 00000100:00100000:0.0:1746129578.303570:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129578.303898:0:8417:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734339200 00000100:00100000:2.0:1746129578.303907:0:8417:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734339200 00002000:00100000:2.0:1746129578.303958:0:8417:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3ef:0x0] (2097152->3145727) req@ffff88013570f480 x1830948734339200/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:319/0 lens 488/0 e 0 to 0 dl 1746129589 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129578.303967:0:8417:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013570f480 with x1830948734339200 ext(2097152->3145727) 00002000:00010000:2.0:1746129578.303973:0:8417:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013570f480 00000100:00100000:2.0:1746129578.304001:0:8417:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8058 00000100:00100000:2.0:1746129578.304009:0:8417:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013570f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:1963:x1830948734339200:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:3.0:1746129578.307713:0:20578:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bdc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:20578:1830948737591296:192.168.202.4@tcp:105: 00010000:00010000:3.0:1746129578.307737:0:20578:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129578.307792:0:20578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013570ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ada2ffba-8920-4ecb-8068-68caa9806978+27:1961:x1830948734338688:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 17846us (18500us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129578.307802:0:20578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8592 00000100:00100000:2.0:1746129578.319459:0:8417:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013570f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:1963:x1830948734339200:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 15441us (15890us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129578.319470:0:8417:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8058 00002000:00100000:2.0:1746129578.319480:0:8417:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3ef:0x0] (2097152->3145727) req@ffff88013570f480 x1830948734339200/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:319/0 lens 488/440 e 0 to 0 dl 1746129589 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129578.319489:0:8417:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013570f480 with x1830948734339200 ext(2097152->3145727) 00002000:00010000:2.0:1746129578.319493:0:8417:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013570f480 00000100:00100000:0.0:1746129578.325039:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129578.325543:0:8410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734339328 00000100:00100000:2.0:1746129578.325553:0:8410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734339328 00000100:00100000:2.0:1746129578.325601:0:8410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16643 00000100:00100000:2.0:1746129578.325609:0:8410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013570f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+31:32553:x1830948734339328:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129578.325624:0:8410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129578.325640:0:8410:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c144400/0x40a459093b06b2a3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21d60 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129578.328737:0:8410:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a062da00/0x40a459093b06b256 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2502656->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21d21 expref: 36 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129578.328758:0:8410:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129578.328760:0:8410:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129578.328764:0:8410:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c144400/0x40a459093b06b2a3 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21d60 expref: 32 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129578.328807:0:8410:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a062da00/0x40a459093b06b256 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2502656->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21d21 expref: 36 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129578.329009:0:8410:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a062da00/0x40a459093b06b256 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2502656->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21d21 expref: 36 pid: 4385 timeout: 933 lvb_type: 0 00000100:00100000:3.0:1746129578.329025:0:8410:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8410:1830948737591424:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129578.329141:0:8410:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa3813c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746129578.333764:0:8410:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8410:1830948737591424:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129578.333802:0:8410:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c144400/0x40a459093b06b2a3 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21d60 expref: 32 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129578.333821:0:8410:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c144400, rc 0) 00000100:00100000:3.0:1746129578.334133:0:8410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013570f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+32:32553:x1830948734339328:12345-192.168.202.4@tcp:101:cat.0 Request processed in 8523us (9104us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129578.334142:0:8410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16643 00000100:00100000:1.0:1746129578.336965:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129578.337186:0:8417:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734339456 00000100:00100000:2.0:1746129578.337197:0:8417:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734339456 00002000:00100000:2.0:1746129578.337261:0:8417:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3f5:0x0] (2502656->3145727) req@ffff88012cda4e00 x1830948734339456/t0(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:319/0 lens 488/0 e 0 to 0 dl 1746129589 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129578.337271:0:8417:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cda4e00 with x1830948734339456 ext(2502656->3145727) 00010000:00010000:2.0:1746129578.337281:0:8417:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a062da00/0x40a459093b06b256 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2502656->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21d21 expref: 37 pid: 4385 timeout: 933 lvb_type: 0 00010000:00010000:2.0:1746129578.337377:0:8417:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a062da00/0x40a459093b06b256 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2502656->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21d21 expref: 37 pid: 4385 timeout: 933 lvb_type: 0 00002000:00010000:2.0:1746129578.337385:0:8417:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012cda4e00 00000100:00100000:2.0:1746129578.337665:0:8417:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2493 00000100:00100000:2.0:1746129578.337674:0:8417:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cda4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ada2ffba-8920-4ecb-8068-68caa9806978+37:1962:x1830948734339456:12345-192.168.202.4@tcp:4:cat.0 00000100:00100000:2.0:1746129578.346537:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129578.346665:0:8410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734339584 00000100:00100000:3.0:1746129578.346675:0:8410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734339584 00000100:00100000:3.0:1746129578.346940:0:8410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16644 00000100:00100000:3.0:1746129578.346949:0:8410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a77b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ada2ffba-8920-4ecb-8068-68caa9806978+39:1962:x1830948734339584:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129578.346970:0:8410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129578.346987:0:8410:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a062ca00/0x40a459093b06b2aa lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21d67 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129578.347040:0:8410:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8410:1830948737591552:192.168.202.4@tcp:106: 00000100:00100000:3.0:1746129578.348278:0:8410:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa3813c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129578.351978:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129578.352085:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129578.352119:0:31503:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734339712 00000100:00100000:0.0:1746129578.352129:0:31503:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734339712 00002000:00010000:3.0:1746129578.352553:0:8410:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb mtime: 1746129578 -> 1746129579 00002000:00010000:3.0:1746129578.352565:0:8410:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb atime: 1746129578 -> 1746129579 00002000:00010000:3.0:1746129578.352567:0:8410:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb ctime: 1746129578 -> 1746129579 00000100:00100000:3.0:1746129578.352588:0:8410:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8410:1830948737591552:192.168.202.4@tcp:106: 00010000:00010000:3.0:1746129578.352619:0:8410:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a062ca00/0x40a459093b06b2aa lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21d67 expref: 40 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129578.352634:0:8410:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a062ca00/0x40a459093b06b2aa lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21d67 expref: 40 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129578.352653:0:8410:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a062ca00, rc 0) 00000100:00100000:3.0:1746129578.352725:0:8410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a77b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ada2ffba-8920-4ecb-8068-68caa9806978+39:1962:x1830948734339584:12345-192.168.202.4@tcp:101:cat.0 Request processed in 5776us (6199us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129578.352732:0:8410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16644 00000100:00100000:3.0:1746129578.352751:0:8410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734339840 00000100:00100000:3.0:1746129578.352754:0:8410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734339840 00000100:00100000:0.0:1746129578.352954:0:31503:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16645 00000100:00100000:0.0:1746129578.352963:0:31503:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013570fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ada2ffba-8920-4ecb-8068-68caa9806978+27:1962:x1830948734339712:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129578.352978:0:31503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129578.352994:0:31503:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091799200/0x40a459093b06b2b1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21d6e expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129578.353012:0:31503:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129578.353016:0:31503:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129578.353025:0:31503:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091799200/0x40a459093b06b2b1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21d6e expref: 28 pid: 31503 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129578.353038:0:31503:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091799200/0x40a459093b06b2b1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21d6e expref: 28 pid: 31503 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129578.353047:0:31503:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091799200, rc 0) 00000100:00100000:0.0:1746129578.353064:0:31503:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013570fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ada2ffba-8920-4ecb-8068-68caa9806978+28:1962:x1830948734339712:12345-192.168.202.4@tcp:101:cat.0 Request processed in 105us (1098us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129578.353069:0:31503:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16645 00000100:00100000:0.0:1746129578.353080:0:31503:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16646 00000100:00100000:0.0:1746129578.353085:0:31503:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013570c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ada2ffba-8920-4ecb-8068-68caa9806978+39:1962:x1830948734339840:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129578.353092:0:31503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129578.353100:0:31503:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091798600/0x40a459093b06b2b8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21d75 expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129578.353135:0:31503:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013570ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:31503:1830948737591680:192.168.202.4@tcp:106: 00000100:00100000:0.0:1746129578.353180:0:31503:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009cdf3f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746129578.356582:0:8417:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cda4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ada2ffba-8920-4ecb-8068-68caa9806978+41:1962:x1830948734339456:12345-192.168.202.4@tcp:4:cat.0 Request processed in 18897us (19616us total) trans 17179874166 rc 0/0 00000100:00100000:2.0:1746129578.356597:0:8417:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2493 00002000:00100000:2.0:1746129578.356609:0:8417:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3f5:0x0] (2502656->3145727) req@ffff88012cda4e00 x1830948734339456/t17179874166(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:319/0 lens 488/448 e 0 to 0 dl 1746129589 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129578.356618:0:8417:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cda4e00 with x1830948734339456 ext(2502656->3145727) 00010000:00010000:2.0:1746129578.356630:0:8417:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a062da00/0x40a459093b06b256 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2502656->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21d21 expref: 41 pid: 4385 timeout: 933 lvb_type: 0 00010000:00010000:2.0:1746129578.356646:0:8417:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a062da00/0x40a459093b06b256 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2502656->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21d21 expref: 41 pid: 4385 timeout: 933 lvb_type: 0 00002000:00010000:2.0:1746129578.356657:0:8417:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012cda4e00 00000100:00100000:1.0:1746129578.356797:0:31503:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013570ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:31503:1830948737591680:192.168.202.4@tcp:106: 00010000:00010000:1.0:1746129578.356829:0:31503:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091798600/0x40a459093b06b2b8 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21d75 expref: 40 pid: 31503 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129578.356840:0:31503:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091798600/0x40a459093b06b2b8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21d75 expref: 40 pid: 31503 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129578.356855:0:31503:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091798600, rc 0) 00000100:00100000:1.0:1746129578.356875:0:31503:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013570c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ada2ffba-8920-4ecb-8068-68caa9806978+39:1962:x1830948734339840:12345-192.168.202.4@tcp:101:cat.0 Request processed in 3789us (4791us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129578.356882:0:31503:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16646 00000100:00100000:0.0:1746129578.362381:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129578.362432:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129578.362445:0:31503:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734339968 00000100:00100000:3.0:1746129578.362491:0:20578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734340096 00000100:00100000:3.0:1746129578.362501:0:20578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734340096 00010000:00010000:3.0:1746129578.362540:0:20578:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a062da00/0x40a459093b06b256 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2502656->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21d21 expref: 39 pid: 4385 timeout: 933 lvb_type: 0 00000100:00100000:3.0:1746129578.362582:0:20578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8593 00000100:00100000:3.0:1746129578.362590:0:20578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013570ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ada2ffba-8920-4ecb-8068-68caa9806978+39:1961:x1830948734340096:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129578.362611:0:20578:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129578.362639:0:20578:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a062da00/0x40a459093b06b256 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2502656->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21d21 expref: 39 pid: 4385 timeout: 933 lvb_type: 0 00010000:00010000:3.0:1746129578.362655:0:20578:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a062da00/0x40a459093b06b256 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2502656->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21d21 expref: 39 pid: 4385 timeout: 933 lvb_type: 0 00010000:00010000:3.0:1746129578.362678:0:20578:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a062da00/0x40a459093b06b256 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2502656->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21d21 expref: 39 pid: 4385 timeout: 933 lvb_type: 0 00010000:00010000:3.0:1746129578.362710:0:20578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129578.362712:0:20578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129578.362720:0:20578:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c144400/0x40a459093b06b2a3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21d60 expref: 31 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129578.362729:0:20578:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c144400/0x40a459093b06b2a3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21d60 expref: 31 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129578.362765:0:20578:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012c144400/0x40a459093b06b2a3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21d60 expref: 31 pid: 8410 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129578.362778:0:20578:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bdc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:20578:1830948737591808:192.168.202.4@tcp:105: 00000100:00100000:3.0:1746129578.362859:0:20578:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa3813c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746129578.363056:0:31503:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734339968 00000100:00100000:1.0:1746129578.363200:0:31503:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16647 00000100:00100000:1.0:1746129578.363206:0:31503:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013570ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ada2ffba-8920-4ecb-8068-68caa9806978+39:32560:x1830948734339968:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129578.363219:0:31503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129578.363230:0:31503:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129861c00/0x40a459093b06b2bf lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21d7c expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129578.363256:0:31503:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a062c400/0x40a459093b06b29c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1388544->1724415) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21d59 expref: 31 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129578.363267:0:31503:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129578.363269:0:31503:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129578.363271:0:31503:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129861c00/0x40a459093b06b2bf lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21d7c expref: 40 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129578.363287:0:31503:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a062c400/0x40a459093b06b29c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1388544->1724415) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21d59 expref: 31 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129578.364209:0:31503:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a062c400/0x40a459093b06b29c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1388544->1724415) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21d59 expref: 31 pid: 8410 timeout: 933 lvb_type: 0 00000100:00100000:1.0:1746129578.364223:0:31503:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f3e7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:31503:1830948737591936:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129578.364315:0:31503:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0ac780 going to sleep for 11 seconds 00000100:00100000:3.0:1746129578.364469:0:20578:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bdc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:20578:1830948737591808:192.168.202.4@tcp:105: 00010000:00010000:3.0:1746129578.364484:0:20578:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129578.364505:0:20578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013570ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ada2ffba-8920-4ecb-8068-68caa9806978+40:1961:x1830948734340096:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 1916us (2073us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129578.364514:0:20578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8593 00000100:00100000:1.0:1746129578.368264:0:31503:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f3e7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:31503:1830948737591936:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129578.368378:0:31503:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129861c00/0x40a459093b06b2bf lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21d7c expref: 39 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129578.368398:0:31503:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129861c00, rc 0) 00000100:00100000:1.0:1746129578.368452:0:31503:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013570ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ada2ffba-8920-4ecb-8068-68caa9806978+39:32560:x1830948734339968:12345-192.168.202.4@tcp:101:cat.0 Request processed in 5245us (6080us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129578.368461:0:31503:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16647 00000100:00100000:0.0:1746129578.368736:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129578.369417:0:8417:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734340224 00000100:00100000:3.0:1746129578.369426:0:8417:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734340224 00002000:00100000:3.0:1746129578.369470:0:8417:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3f3:0x0] (1388544->1724415) req@ffff88008f44ad80 x1830948734340224/t0(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:319/0 lens 488/0 e 0 to 0 dl 1746129589 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129578.369481:0:8417:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f44ad80 with x1830948734340224 ext(1388544->1724415) 00010000:00010000:3.0:1746129578.369488:0:8417:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a062c400/0x40a459093b06b29c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1388544->1724415) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21d59 expref: 32 pid: 8410 timeout: 933 lvb_type: 0 00010000:00010000:3.0:1746129578.369502:0:8417:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a062c400/0x40a459093b06b29c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1388544->1724415) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21d59 expref: 32 pid: 8410 timeout: 933 lvb_type: 0 00002000:00010000:3.0:1746129578.369513:0:8417:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008f44ad80 00000100:00100000:3.0:1746129578.369548:0:8417:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2494 00000100:00100000:3.0:1746129578.369556:0:8417:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f44ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+32:1960:x1830948734340224:12345-192.168.202.4@tcp:4:multiop.0 00000100:00100000:1.0:1746129578.377047:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129578.377069:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129578.377087:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734340480 00000100:00100000:1.0:1746129578.377096:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734340480 00002000:00100000:1.0:1746129578.377138:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f5:0x0] (2097152->3145727) req@ffff88009f3e7480 x1830948734340480/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:319/0 lens 488/0 e 0 to 0 dl 1746129589 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129578.377147:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f3e7480 with x1830948734340480 ext(2097152->3145727) 00002000:00010000:1.0:1746129578.377154:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f3e7480 00000100:00100000:1.0:1746129578.377178:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734340736 00000100:00100000:1.0:1746129578.377179:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734340736 00002000:00100000:1.0:1746129578.377187:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f5:0x0] (3145728->4194303) req@ffff88009f3e5f80 x1830948734340736/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:319/0 lens 488/0 e 0 to 0 dl 1746129589 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129578.377193:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f3e5f80 with x1830948734340736 ext(3145728->4194303) 00002000:00010000:1.0:1746129578.377196:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f3e5f80 00000100:00100000:1.0:1746129578.377207:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8059 00000100:00100000:3.0:1746129578.377213:0:8417:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f44ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+36:1960:x1830948734340224:12345-192.168.202.4@tcp:4:multiop.0 Request processed in 7655us (8474us total) trans 17179874167 rc 0/0 00000100:00100000:1.0:1746129578.377213:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+36:1963:x1830948734340480:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:3.0:1746129578.377221:0:8417:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2494 00002000:00100000:3.0:1746129578.377228:0:8417:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3f3:0x0] (1388544->1724415) req@ffff88008f44ad80 x1830948734340224/t17179874167(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:319/0 lens 488/448 e 0 to 0 dl 1746129589 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129578.377236:0:8417:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f44ad80 with x1830948734340224 ext(1388544->1724415) 00010000:00010000:3.0:1746129578.377244:0:8417:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a062c400/0x40a459093b06b29c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1388544->1724415) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21d59 expref: 36 pid: 8410 timeout: 933 lvb_type: 0 00010000:00010000:3.0:1746129578.377271:0:8417:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a062c400/0x40a459093b06b29c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1388544->1724415) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21d59 expref: 36 pid: 8410 timeout: 933 lvb_type: 0 00002000:00010000:3.0:1746129578.377278:0:8417:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008f44ad80 00000100:00100000:3.0:1746129578.377306:0:8417:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8060 00000100:00100000:3.0:1746129578.377311:0:8417:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+35:1963:x1830948734340736:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:1.0:1746129578.378653:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129578.378680:0:31522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734340992 00000100:00100000:1.0:1746129578.378685:0:31522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734340992 00002000:00100000:1.0:1746129578.378710:0:31522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->4194303) req@ffff8800915d3b80 x1830948734340992/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:319/0 lens 488/0 e 0 to 0 dl 1746129589 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129578.378718:0:31522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800915d3b80 with x1830948734340992 ext(3145728->4194303) 00002000:00010000:1.0:1746129578.378722:0:31522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800915d3b80 00000100:00100000:1.0:1746129578.378737:0:31522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8061 00000100:00100000:1.0:1746129578.378741:0:31522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800915d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:1963:x1830948734340992:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:2.0:1746129578.385266:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129578.385323:0:20578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734341120 00000100:00100000:3.0:1746129578.385334:0:20578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734341120 00010000:00010000:3.0:1746129578.385370:0:20578:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a062c400/0x40a459093b06b29c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1388544->1724415) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21d59 expref: 38 pid: 8410 timeout: 933 lvb_type: 0 00000100:00100000:3.0:1746129578.388367:0:20578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8594 00000100:00100000:3.0:1746129578.388387:0:20578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c079f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+38:1961:x1830948734341120:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129578.388410:0:20578:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129578.388440:0:20578:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a062c400/0x40a459093b06b29c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1388544->1724415) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21d59 expref: 38 pid: 8410 timeout: 933 lvb_type: 0 00010000:00010000:3.0:1746129578.388456:0:20578:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a062c400/0x40a459093b06b29c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1388544->1724415) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21d59 expref: 38 pid: 8410 timeout: 933 lvb_type: 0 00010000:00010000:3.0:1746129578.388481:0:20578:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a062c400/0x40a459093b06b29c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1388544->1724415) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21d59 expref: 38 pid: 8410 timeout: 933 lvb_type: 0 00010000:00010000:3.0:1746129578.388507:0:20578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129578.388509:0:20578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129578.388518:0:20578:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129861c00/0x40a459093b06b2bf lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21d7c expref: 38 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129578.388526:0:20578:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129861c00/0x40a459093b06b2bf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21d7c expref: 38 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129578.389818:0:20578:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880129861c00/0x40a459093b06b2bf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21d7c expref: 38 pid: 31503 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129578.389837:0:20578:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bdc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:20578:1830948737592064:192.168.202.4@tcp:105: 00000100:00100000:3.0:1746129578.390670:0:20578:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa3813c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129578.391215:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129578.392551:0:15096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734341376 00000100:00100000:3.0:1746129578.392563:0:15096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734341376 00000100:00100000:3.0:1746129578.392630:0:15096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11324 00000100:00100000:3.0:1746129578.392639:0:15096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f448380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ada2ffba-8920-4ecb-8068-68caa9806978+322:32562:x1830948734341376:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:3.0:1746129578.392665:0:15096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129578.392684:0:15096:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc59e00/0x40a459093b06b2c6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21d83 expref: -99 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129578.392786:0:15096:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f119000/0x40a459093b06b2cd lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 15096 initiator: MDT0 00010000:00010000:3.0:1746129578.392800:0:15096:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f119000/0x40a459093b06b2cd lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 15096 initiator: MDT0 00010000:00010000:3.0:1746129578.392811:0:15096:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f119000/0x40a459093b06b2cd lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 15096 initiator: MDT0 00000004:00200000:3.0:1746129578.392821:0:15096:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:3.0:1746129578.392932:0:15096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc59e00/0x40a459093b06b2c6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21d83 expref: 325 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129578.392948:0:15096:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f119000/0x40a459093b06b2cd lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21d83 expref: 324 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129578.392956:0:15096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:3.0:1746129578.392959:0:15096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746129578.392962:0:15096:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f119000, rc 0) 00000100:00100000:3.0:1746129578.393031:0:15096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f448380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ada2ffba-8920-4ecb-8068-68caa9806978+324:32562:x1830948734341376:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 393us (1819us total) trans 8589945441 rc 0/0 00000100:00100000:3.0:1746129578.393037:0:15096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11324 00000100:00100000:1.0:1746129578.396359:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+36:1963:x1830948734340480:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 19132us (19309us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129578.396370:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8059 00002000:00100000:1.0:1746129578.396383:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f5:0x0] (2097152->3145727) req@ffff88009f3e7480 x1830948734340480/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:319/0 lens 488/440 e 0 to 0 dl 1746129589 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129578.396393:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f3e7480 with x1830948734340480 ext(2097152->3145727) 00002000:00010000:1.0:1746129578.396398:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f3e7480 00000100:00100000:3.0:1746129578.403399:0:20578:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bdc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:20578:1830948737592064:192.168.202.4@tcp:105: 00010000:00010000:3.0:1746129578.403425:0:20578:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129578.403491:0:20578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c079f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+35:1961:x1830948734341120:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 15110us (18241us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129578.403502:0:20578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8594 00000100:00100000:1.0:1746129578.409157:0:31522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800915d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:1963:x1830948734340992:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 30400us (30495us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129578.409170:0:31522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8061 00002000:00100000:1.0:1746129578.409183:0:31522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->4194303) req@ffff8800915d3b80 x1830948734340992/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:319/0 lens 488/440 e 0 to 0 dl 1746129589 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129578.409193:0:31522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800915d3b80 with x1830948734340992 ext(3145728->4194303) 00002000:00010000:1.0:1746129578.409200:0:31522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800915d3b80 00000100:00100000:0.0:1746129578.410831:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129578.410919:0:31522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734341632 00000100:00100000:1.0:1746129578.410929:0:31522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734341632 00002000:00100000:1.0:1746129578.410972:0:31522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff88009bc6f450 x1830948734341632/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:319/0 lens 488/0 e 0 to 0 dl 1746129589 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129578.410981:0:31522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bc6f450 with x1830948734341632 ext(1048576->2097151) 00002000:00010000:1.0:1746129578.410985:0:31522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bc6f450 00000100:00100000:1.0:1746129578.411059:0:31522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8062 00000100:00100000:1.0:1746129578.411067:0:31522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bc6f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ada2ffba-8920-4ecb-8068-68caa9806978+39:1963:x1830948734341632:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129578.420241:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129578.420434:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734341888 00000100:00100000:2.0:1746129578.420444:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734341888 00002000:00100000:2.0:1746129578.420495:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ef:0x0] (4194304->5148671) req@ffff880094fd4000 x1830948734341888/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:319/0 lens 488/0 e 0 to 0 dl 1746129589 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129578.420506:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094fd4000 with x1830948734341888 ext(4194304->5148671) 00002000:00010000:2.0:1746129578.420511:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094fd4000 00000100:00100000:2.0:1746129578.420553:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8063 00000100:00100000:2.0:1746129578.420560:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094fd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:1962:x1830948734341888:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:3.0:1746129578.422528:0:8417:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+33:1963:x1830948734340736:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 45204us (45446us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129578.422540:0:8417:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8060 00002000:00100000:3.0:1746129578.422550:0:8417:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3f5:0x0] (3145728->4194303) req@ffff88009f3e5f80 x1830948734340736/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:319/0 lens 488/440 e 0 to 0 dl 1746129589 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129578.422558:0:8417:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f3e5f80 with x1830948734340736 ext(3145728->4194303) 00002000:00010000:3.0:1746129578.422564:0:8417:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f3e5f80 00000100:00100000:0.0:1746129578.433360:0:31522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bc6f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ada2ffba-8920-4ecb-8068-68caa9806978+39:1963:x1830948734341632:12345-192.168.202.4@tcp:3:cat.0 Request processed in 22281us (22525us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129578.433377:0:31522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8062 00002000:00100000:0.0:1746129578.433390:0:31522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff88009bc6f450 x1830948734341632/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:319/0 lens 488/440 e 0 to 0 dl 1746129589 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129578.433400:0:31522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bc6f450 with x1830948734341632 ext(1048576->2097151) 00002000:00010000:0.0:1746129578.433406:0:31522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bc6f450 00000100:00100000:0.0:1746129578.438230:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129578.438658:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129578.438754:0:8412:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734342016 00000100:00100000:2.0:1746129578.438763:0:8412:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734342016 00000100:00100000:2.0:1746129578.439908:0:8412:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734342144 00000100:00100000:2.0:1746129578.439915:0:8412:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734342144 00000100:00100000:1.0:1746129578.439956:0:31503:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16648 00000100:00100000:1.0:1746129578.439967:0:31503:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094fd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ada2ffba-8920-4ecb-8068-68caa9806978+28:32562:x1830948734342016:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:1.0:1746129578.439989:0:31503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129578.440009:0:31503:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008fba4e00/0x40a459093b06b2db lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21d8a expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129578.440045:0:31503:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008fbb7400/0x40a459093b06af93 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21b06 expref: 22 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129578.440052:0:31503:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a6caf000/0x40a459093b06b0ab lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21be6 expref: 6 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129578.440059:0:31503:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095129800/0x40a459093b06b003 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21b61 expref: 29 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129578.440064:0:31503:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129578.440066:0:31503:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129578.440069:0:31503:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008fba4e00/0x40a459093b06b2db lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [1781760->1822719] (req 1781760->1822719) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21d8a expref: 29 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129578.440102:0:31503:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095129800/0x40a459093b06b003 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21b61 expref: 29 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129578.440114:0:31503:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095129800/0x40a459093b06b003 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21b61 expref: 29 pid: 4385 timeout: 933 lvb_type: 1 00000100:00100000:1.0:1746129578.440125:0:31503:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800915d0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:31503:1830948737592192:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129578.440480:0:8410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16649 00000100:00100000:3.0:1746129578.440490:0:8410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c29f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+33:1962:x1830948734342144:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129578.440500:0:8410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129578.440513:0:8410:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fc59e00/0x40a459093b06b2e2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21d91 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129578.440527:0:8410:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129578.440529:0:8410:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129578.440535:0:8410:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fc59e00/0x40a459093b06b2e2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21d91 expref: 34 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129578.440548:0:8410:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fc59e00/0x40a459093b06b2e2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21d91 expref: 34 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129578.440562:0:8410:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fc59e00, rc 0) 00000100:00100000:3.0:1746129578.440627:0:8410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c29f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+34:1962:x1830948734342144:12345-192.168.202.4@tcp:101:cat.0 Request processed in 139us (1968us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129578.440633:0:8410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16649 00010000:00010000:1.0:1746129578.444069:0:31503:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a6caf000/0x40a459093b06b0ab lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21be6 expref: 6 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129578.444095:0:31503:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a6caf000/0x40a459093b06b0ab lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21be6 expref: 6 pid: 7148 timeout: 933 lvb_type: 1 00000100:00100000:1.0:1746129578.444113:0:31503:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800915d0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:31503:1830948737592320:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129578.444216:0:31503:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008fbb7400/0x40a459093b06af93 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21b06 expref: 22 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129578.444223:0:31503:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008fbb7400/0x40a459093b06af93 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21b06 expref: 22 pid: 22481 timeout: 933 lvb_type: 1 00000100:00100000:1.0:1746129578.444231:0:31503:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800915d0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:31503:1830948737592448:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129578.444266:0:31503:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0ac780 going to sleep for 11 seconds 00000100:00100000:2.0:1746129578.446712:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094fd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:1962:x1830948734341888:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 26140us (26470us total) trans 0 rc 954368/954368 00000100:00100000:2.0:1746129578.446723:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8063 00002000:00100000:2.0:1746129578.446735:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ef:0x0] (4194304->5148671) req@ffff880094fd4000 x1830948734341888/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:319/0 lens 488/440 e 0 to 0 dl 1746129589 ref 1 fl Complete:/200/0 rc 954368/954368 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129578.446745:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094fd4000 with x1830948734341888 ext(4194304->5148671) 00002000:00010000:2.0:1746129578.446751:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094fd4000 00000100:00100000:1.0:1746129578.449192:0:31503:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800915d0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:31503:1830948737592192:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129578.449207:0:31503:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800915d0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:31503:1830948737592320:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129578.449215:0:31503:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800915d0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:31503:1830948737592448:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129578.449257:0:31503:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008fba4e00/0x40a459093b06b2db lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [1781760->1822719] (req 1781760->1822719) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21d8a expref: 29 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129578.449278:0:31503:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fba4e00, rc 0) 00000100:00100000:1.0:1746129578.449349:0:31503:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094fd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ada2ffba-8920-4ecb-8068-68caa9806978+29:32562:x1830948734342016:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 9384us (11128us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129578.449357:0:31503:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16648 00000100:00100000:0.0:1746129578.450168:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129578.450284:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129578.450397:0:20578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734342400 00000100:00100000:3.0:1746129578.450405:0:20578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734342400 00010000:00010000:3.0:1746129578.450436:0:20578:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008fbb7400/0x40a459093b06af93 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21b06 expref: 21 pid: 22481 timeout: 933 lvb_type: 1 00000100:00100000:3.0:1746129578.450458:0:20578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734342272 00000100:00100000:3.0:1746129578.450460:0:20578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734342272 00010000:00010000:3.0:1746129578.450470:0:20578:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6caf000/0x40a459093b06b0ab lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21be6 expref: 7 pid: 7148 timeout: 933 lvb_type: 1 00000100:00100000:3.0:1746129578.450486:0:20578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8595 00000100:00100000:3.0:1746129578.450492:0:20578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094fd4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:1962:x1830948734342400:12345-192.168.202.4@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746129578.450500:0:15749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8596 00010000:00010000:3.0:1746129578.450504:0:20578:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746129578.450510:0:15749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6025450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:068dab75-d300-4ead-a742-d14572ad1e50+7:1962:x1830948734342272:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129578.450521:0:15749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129578.450529:0:20578:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008fbb7400/0x40a459093b06af93 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21b06 expref: 21 pid: 22481 timeout: 933 lvb_type: 1 00010000:00010000:2.0:1746129578.450532:0:15749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a6caf000/0x40a459093b06b0ab lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21be6 expref: 7 pid: 7148 timeout: 933 lvb_type: 1 00010000:00010000:3.0:1746129578.450540:0:20578:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008fbb7400/0x40a459093b06af93 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21b06 expref: 21 pid: 22481 timeout: 933 lvb_type: 1 00010000:00010000:2.0:1746129578.450841:0:15749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a6caf000/0x40a459093b06b0ab lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21be6 expref: 7 pid: 7148 timeout: 933 lvb_type: 1 00010000:00010000:3.0:1746129578.450872:0:20578:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008fbb7400/0x40a459093b06af93 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21b06 expref: 21 pid: 22481 timeout: 933 lvb_type: 1 00010000:00010000:2.0:1746129578.450876:0:15749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a6caf000/0x40a459093b06b0ab lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21be6 expref: 7 pid: 7148 timeout: 933 lvb_type: 1 00010000:00010000:3.0:1746129578.450895:0:20578:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746129578.450897:0:15749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129578.451221:0:20578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094fd4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:1962:x1830948734342400:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 727us (1054us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129578.451229:0:20578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8595 00000100:00100000:2.0:1746129578.451843:0:15749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6025450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:068dab75-d300-4ead-a742-d14572ad1e50+6:1962:x1830948734342272:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 1333us (1556us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129578.451851:0:15749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8596 00000100:00100000:0.0:1746129578.453952:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129578.454087:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734342528 00000100:00100000:1.0:1746129578.454095:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734342528 00010000:00010000:1.0:1746129578.454130:0:9823:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095129800/0x40a459093b06b003 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21b61 expref: 29 pid: 4385 timeout: 933 lvb_type: 1 00000100:00100000:1.0:1746129578.454162:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8597 00000100:00100000:1.0:1746129578.454169:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094fd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ada2ffba-8920-4ecb-8068-68caa9806978+29:1962:x1830948734342528:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129578.454182:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129578.454205:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095129800/0x40a459093b06b003 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21b61 expref: 29 pid: 4385 timeout: 933 lvb_type: 1 00010000:00010000:1.0:1746129578.454215:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095129800/0x40a459093b06b003 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21b61 expref: 29 pid: 4385 timeout: 933 lvb_type: 1 00010000:00010000:1.0:1746129578.454235:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095129800/0x40a459093b06b003 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21b61 expref: 29 pid: 4385 timeout: 933 lvb_type: 1 00010000:00010000:1.0:1746129578.454968:0:9823:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129578.454971:0:9823:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129578.454979:0:9823:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008fba4e00/0x40a459093b06b2db lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1781760->1822719) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21d8a expref: 28 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129578.454987:0:9823:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008fba4e00/0x40a459093b06b2db lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1781760->1822719) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21d8a expref: 28 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129578.455021:0:9823:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008fba4e00/0x40a459093b06b2db lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1781760->1822719) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21d8a expref: 28 pid: 31503 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129578.455034:0:9823:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800915d0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9823:1830948737592576:192.168.202.4@tcp:105: 00000100:00100000:2.0:1746129578.455443:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129578.455807:0:31503:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734342656 00000100:00100000:0.0:1746129578.455813:0:31503:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734342656 00000100:00100000:0.0:1746129578.455845:0:31503:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16650 00000100:00100000:0.0:1746129578.455852:0:31503:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c079f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:1960:x1830948734342656:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129578.455865:0:31503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129578.455879:0:31503:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009407ca00/0x40a459093b06b2e9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21d98 expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129578.455909:0:31503:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094fd4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:31503:1830948737592704:192.168.202.4@tcp:106: 00000100:00100000:1.0:1746129578.456015:0:9823:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0ac780 going to sleep for 11 seconds 00000100:00100000:0.0:1746129578.456218:0:31503:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009cdf3600 going to sleep for 11 seconds 00000100:00100000:0.0:1746129578.457121:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129578.457181:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734342912 00000100:00100000:2.0:1746129578.457186:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734342912 00002000:00010000:0.0:1746129578.457219:0:31503:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb mtime: 1746129575 -> 1746129579 00002000:00100000:2.0:1746129578.457220:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ef:0x0] (2097152->3145727) req@ffff880094fd5180 x1830948734342912/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:319/0 lens 488/0 e 0 to 0 dl 1746129589 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00010000:0.0:1746129578.457227:0:31503:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb atime: 1746129575 -> 1746129579 00002000:00010000:0.0:1746129578.457230:0:31503:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb ctime: 1746129575 -> 1746129579 00002000:00100000:2.0:1746129578.457231:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094fd5180 with x1830948734342912 ext(2097152->3145727) 00002000:00010000:2.0:1746129578.457235:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094fd5180 00000100:00100000:2.0:1746129578.457260:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8064 00000100:00100000:0.0:1746129578.457261:0:31503:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094fd4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:31503:1830948737592704:192.168.202.4@tcp:106: 00000100:00100000:2.0:1746129578.457266:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094fd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+29:1963:x1830948734342912:12345-192.168.202.4@tcp:3:cat.0 00010000:00010000:0.0:1746129578.457285:0:31503:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009407ca00/0x40a459093b06b2e9 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21d98 expref: 21 pid: 31503 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129578.457313:0:31503:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009407ca00/0x40a459093b06b2e9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21d98 expref: 21 pid: 31503 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129578.457326:0:31503:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009407ca00, rc 0) 00000100:00100000:1.0:1746129578.457443:0:9823:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800915d0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9823:1830948737592576:192.168.202.4@tcp:105: 00010000:00010000:1.0:1746129578.457454:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129578.457595:0:31503:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c079f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:1960:x1830948734342656:12345-192.168.202.4@tcp:101:cat.0 Request processed in 1741us (2151us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129578.457598:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094fd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ada2ffba-8920-4ecb-8068-68caa9806978+29:1962:x1830948734342528:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 3428us (3653us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129578.457603:0:31503:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16650 00000100:00100000:1.0:1746129578.457606:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8597 00000100:00100000:0.0:1746129578.458486:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129578.458504:0:31522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734343168 00000100:00100000:0.0:1746129578.458509:0:31522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734343168 00002000:00100000:0.0:1746129578.458532:0:31522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3ee:0x0] (1781760->1785855) req@ffff880094fd4e00 x1830948734343168/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:319/0 lens 488/0 e 0 to 0 dl 1746129589 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129578.458539:0:31522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094fd4e00 with x1830948734343168 ext(1781760->1785855) 00002000:00010000:0.0:1746129578.458543:0:31522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094fd4e00 00000100:00100000:0.0:1746129578.458556:0:31522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8065 00000100:00100000:0.0:1746129578.458561:0:31522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094fd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ada2ffba-8920-4ecb-8068-68caa9806978+30:1962:x1830948734343168:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129578.458662:0:31522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094fd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ada2ffba-8920-4ecb-8068-68caa9806978+30:1962:x1830948734343168:12345-192.168.202.4@tcp:3:cat.0 Request processed in 100us (180us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746129578.458668:0:31522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8065 00002000:00100000:0.0:1746129578.458673:0:31522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3ee:0x0] (1781760->1785855) req@ffff880094fd4e00 x1830948734343168/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:319/0 lens 488/4536 e 0 to 0 dl 1746129589 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129578.458679:0:31522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094fd4e00 with x1830948734343168 ext(1781760->1785855) 00002000:00010000:0.0:1746129578.458682:0:31522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094fd4e00 00000100:00100000:0.0:1746129578.466648:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129578.466705:0:31503:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734343296 00000100:00100000:0.0:1746129578.466712:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129578.466715:0:31503:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734343296 00000100:00100000:2.0:1746129578.466774:0:31503:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16651 00000100:00100000:2.0:1746129578.466783:0:31503:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094fd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:1961:x1830948734343296:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129578.466802:0:31503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129578.466818:0:31503:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880132fc3000/0x40a459093b06b2f0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21d9f expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129578.466873:0:31503:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c078380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:31503:1830948737592832:192.168.202.4@tcp:106: 00000100:00100000:1.0:1746129578.466936:0:21725:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734343552 00000100:00100000:1.0:1746129578.466940:0:21725:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734343552 00002000:00100000:1.0:1746129578.466965:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ee:0x0] (1818624->1822719) req@ffff880094fd5880 x1830948734343552/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:319/0 lens 488/0 e 0 to 0 dl 1746129589 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129578.466975:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094fd5880 with x1830948734343552 ext(1818624->1822719) 00002000:00010000:1.0:1746129578.466978:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094fd5880 00000100:00100000:1.0:1746129578.466989:0:21725:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8066 00000100:00100000:1.0:1746129578.466993:0:21725:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094fd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ada2ffba-8920-4ecb-8068-68caa9806978+30:1962:x1830948734343552:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:1.0:1746129578.467223:0:21725:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094fd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ada2ffba-8920-4ecb-8068-68caa9806978+30:1962:x1830948734343552:12345-192.168.202.4@tcp:3:cat.0 Request processed in 228us (510us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746129578.467229:0:21725:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8066 00002000:00100000:1.0:1746129578.467234:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ee:0x0] (1818624->1822719) req@ffff880094fd5880 x1830948734343552/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:319/0 lens 488/4536 e 0 to 0 dl 1746129589 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129578.467241:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094fd5880 with x1830948734343552 ext(1818624->1822719) 00002000:00010000:1.0:1746129578.467243:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094fd5880 00000100:00100000:2.0:1746129578.467363:0:31503:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132f36d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746129578.470644:0:31503:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c078380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:31503:1830948737592832:192.168.202.4@tcp:106: 00010000:00010000:2.0:1746129578.470687:0:31503:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880132fc3000/0x40a459093b06b2f0 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21d9f expref: 21 pid: 31503 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129578.470704:0:31503:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880132fc3000/0x40a459093b06b2f0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21d9f expref: 21 pid: 31503 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129578.470752:0:31503:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132fc3000, rc 0) 00000100:00100000:2.0:1746129578.470817:0:31503:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094fd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:1961:x1830948734343296:12345-192.168.202.4@tcp:101:cat.0 Request processed in 4033us (4179us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129578.470825:0:31503:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16651 00000100:00100000:2.0:1746129578.473449:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094fd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+28:1963:x1830948734342912:12345-192.168.202.4@tcp:3:cat.0 Request processed in 16172us (16320us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129578.473461:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8064 00002000:00100000:2.0:1746129578.473473:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ef:0x0] (2097152->3145727) req@ffff880094fd5180 x1830948734342912/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:319/0 lens 488/440 e 0 to 0 dl 1746129589 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129578.473484:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094fd5180 with x1830948734342912 ext(2097152->3145727) 00002000:00010000:2.0:1746129578.473489:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094fd5180 00000100:00100000:0.0:1746129578.480537:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129578.480983:0:31503:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734343680 00000100:00100000:2.0:1746129578.480994:0:31503:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734343680 00000100:00100000:2.0:1746129578.481904:0:31503:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16652 00000100:00100000:2.0:1746129578.481917:0:31503:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094fd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ada2ffba-8920-4ecb-8068-68caa9806978+39:32560:x1830948734343680:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129578.481940:0:31503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129578.481960:0:31503:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c3d4a00/0x40a459093b06b2f7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21da6 expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129578.481989:0:31503:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129578.481991:0:31503:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129578.481999:0:31503:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c3d4a00/0x40a459093b06b2f7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21da6 expref: 40 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129578.482014:0:31503:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c3d4a00/0x40a459093b06b2f7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21da6 expref: 40 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129578.482026:0:31503:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c3d4a00, rc 0) 00000100:00100000:2.0:1746129578.482089:0:31503:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094fd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ada2ffba-8920-4ecb-8068-68caa9806978+40:32560:x1830948734343680:12345-192.168.202.4@tcp:101:cat.0 Request processed in 176us (1568us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129578.482095:0:31503:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16652 00000100:00100000:0.0:1746129578.490404:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129578.490464:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129578.490718:0:21725:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734343936 00000100:00100000:2.0:1746129578.490725:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734344192 00000100:00100000:1.0:1746129578.490729:0:21725:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734343936 00000100:00100000:2.0:1746129578.490730:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734344192 00002000:00100000:2.0:1746129578.490780:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f5:0x0] (3145728->4194303) req@ffff880094fd6300 x1830948734344192/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:319/0 lens 488/0 e 0 to 0 dl 1746129589 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129578.490780:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f5:0x0] (2097152->3145727) req@ffff880094fd5f80 x1830948734343936/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:319/0 lens 488/0 e 0 to 0 dl 1746129589 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129578.490790:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094fd6300 with x1830948734344192 ext(3145728->4194303) 00002000:00100000:1.0:1746129578.490790:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094fd5f80 with x1830948734343936 ext(2097152->3145727) 00002000:00010000:2.0:1746129578.490796:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094fd6300 00002000:00010000:1.0:1746129578.490796:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094fd5f80 00000100:00100000:1.0:1746129578.491373:0:21725:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8067 00000100:00100000:1.0:1746129578.491383:0:21725:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094fd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ada2ffba-8920-4ecb-8068-68caa9806978+41:1962:x1830948734343936:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:2.0:1746129578.491786:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8068 00000100:00100000:2.0:1746129578.491804:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094fd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+41:1963:x1830948734344192:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129578.493156:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129578.493188:0:31522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734344448 00000100:00100000:0.0:1746129578.493195:0:31522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734344448 00002000:00100000:0.0:1746129578.493236:0:31522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->4194303) req@ffff880094fd6680 x1830948734344448/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:319/0 lens 488/0 e 0 to 0 dl 1746129589 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129578.493255:0:31522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094fd6680 with x1830948734344448 ext(3145728->4194303) 00002000:00010000:0.0:1746129578.493261:0:31522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094fd6680 00000100:00100000:0.0:1746129578.493290:0:31522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8069 00000100:00100000:0.0:1746129578.493315:0:31522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094fd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ada2ffba-8920-4ecb-8068-68caa9806978+28:1963:x1830948734344448:12345-192.168.202.4@tcp:3:cat.0 00010000:00010000:3.0:1746129578.495377:0:26224:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1746129578.509726:0:21725:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094fd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ada2ffba-8920-4ecb-8068-68caa9806978+42:1962:x1830948734343936:12345-192.168.202.4@tcp:3:cat.0 Request processed in 18331us (19319us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129578.509740:0:21725:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8067 00002000:00100000:1.0:1746129578.509755:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f5:0x0] (2097152->3145727) req@ffff880094fd5f80 x1830948734343936/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:319/0 lens 488/440 e 0 to 0 dl 1746129589 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129578.509765:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094fd5f80 with x1830948734343936 ext(2097152->3145727) 00002000:00010000:1.0:1746129578.509771:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094fd5f80 00000100:00100000:0.0:1746129578.520467:0:31522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094fd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ada2ffba-8920-4ecb-8068-68caa9806978+28:1963:x1830948734344448:12345-192.168.202.4@tcp:3:cat.0 Request processed in 27139us (27303us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129578.520481:0:31522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8069 00002000:00100000:0.0:1746129578.520495:0:31522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->4194303) req@ffff880094fd6680 x1830948734344448/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:319/0 lens 488/440 e 0 to 0 dl 1746129589 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129578.520504:0:31522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094fd6680 with x1830948734344448 ext(3145728->4194303) 00002000:00010000:0.0:1746129578.520511:0:31522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094fd6680 00000100:00100000:0.0:1746129578.521277:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094fd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+40:1963:x1830948734344192:12345-192.168.202.4@tcp:3:cat.0 Request processed in 29473us (30809us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129578.521283:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8068 00002000:00100000:0.0:1746129578.521309:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f5:0x0] (3145728->4194303) req@ffff880094fd6300 x1830948734344192/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:319/0 lens 488/440 e 0 to 0 dl 1746129589 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129578.521316:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094fd6300 with x1830948734344192 ext(3145728->4194303) 00002000:00010000:0.0:1746129578.521320:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094fd6300 00000100:00100000:0.0:1746129578.531556:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129578.531664:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734344704 00000100:00100000:2.0:1746129578.531674:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734344704 00002000:00100000:2.0:1746129578.531714:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ef:0x0] (4194304->5148671) req@ffff880094fd6a00 x1830948734344704/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:319/0 lens 488/0 e 0 to 0 dl 1746129589 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129578.531724:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094fd6a00 with x1830948734344704 ext(4194304->5148671) 00002000:00010000:2.0:1746129578.531729:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094fd6a00 00000100:00100000:2.0:1746129578.531760:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8070 00000100:00100000:2.0:1746129578.531767:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094fd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+28:1962:x1830948734344704:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:2.0:1746129578.541528:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094fd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+28:1962:x1830948734344704:12345-192.168.202.4@tcp:3:cat.0 Request processed in 9753us (9971us total) trans 0 rc 954368/954368 00000100:00100000:2.0:1746129578.541539:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8070 00002000:00100000:2.0:1746129578.541554:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ef:0x0] (4194304->5148671) req@ffff880094fd6a00 x1830948734344704/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:319/0 lens 488/440 e 0 to 0 dl 1746129589 ref 1 fl Complete:/200/0 rc 954368/954368 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129578.541564:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094fd6a00 with x1830948734344704 ext(4194304->5148671) 00002000:00010000:2.0:1746129578.541569:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094fd6a00 00000100:00100000:0.0:1746129578.559803:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129578.559903:0:8410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734344832 00000100:00100000:3.0:1746129578.559910:0:8410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734344832 00000100:00100000:3.0:1746129578.559966:0:8410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16653 00000100:00100000:3.0:1746129578.559973:0:8410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094fd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+34:32566:x1830948734344832:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:3.0:1746129578.559989:0:8410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129578.560002:0:8410:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136b1ca00/0x40a459093b06b2fe lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21dad expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129578.560026:0:8410:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b5263800/0x40a459093b06b17d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21c8e expref: 35 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129578.560034:0:8410:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a6cafe00/0x40a459093b06b1d1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21cc6 expref: 5 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129578.560040:0:8410:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095129400/0x40a459093b06b18b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21c9c expref: 39 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129578.560046:0:8410:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129578.560047:0:8410:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129578.560050:0:8410:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136b1ca00/0x40a459093b06b2fe lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [1409024->1839103] (req 1409024->1839103) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21dad expref: 35 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129578.560078:0:8410:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095129400/0x40a459093b06b18b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21c9c expref: 39 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129578.560088:0:8410:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095129400/0x40a459093b06b18b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21c9c expref: 39 pid: 7148 timeout: 933 lvb_type: 1 00000100:00100000:3.0:1746129578.560098:0:8410:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8410:1830948737592960:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129578.561444:0:8410:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a6cafe00/0x40a459093b06b1d1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21cc6 expref: 5 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129578.561456:0:8410:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a6cafe00/0x40a459093b06b1d1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21cc6 expref: 5 pid: 8410 timeout: 933 lvb_type: 1 00000100:00100000:3.0:1746129578.561465:0:8410:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8410:1830948737593088:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129578.561634:0:8410:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b5263800/0x40a459093b06b17d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21c8e expref: 35 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129578.561643:0:8410:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b5263800/0x40a459093b06b17d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21c8e expref: 35 pid: 7148 timeout: 933 lvb_type: 0 00000100:00100000:3.0:1746129578.561650:0:8410:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8410:1830948737593216:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129578.561670:0:8410:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa3813c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746129578.563092:0:8410:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8410:1830948737592960:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129578.563104:0:8410:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8410:1830948737593088:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129578.563109:0:8410:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8410:1830948737593216:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129578.563131:0:8410:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880136b1ca00/0x40a459093b06b2fe lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [1409024->1839103] (req 1409024->1839103) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21dad expref: 35 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129578.563144:0:8410:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136b1ca00, rc 0) 00000100:00100000:3.0:1746129578.563186:0:8410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094fd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+35:32566:x1830948734344832:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 3212us (3389us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129578.563194:0:8410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16653 00000100:00100000:2.0:1746129578.563896:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129578.563958:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734344960 00000100:00100000:1.0:1746129578.563963:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734344960 00010000:00010000:1.0:1746129578.563988:0:9823:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6cafe00/0x40a459093b06b1d1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21cc6 expref: 6 pid: 8410 timeout: 933 lvb_type: 1 00000100:00100000:1.0:1746129578.564007:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8598 00000100:00100000:1.0:1746129578.564012:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c078380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:068dab75-d300-4ead-a742-d14572ad1e50+6:1962:x1830948734344960:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129578.564021:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129578.564039:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a6cafe00/0x40a459093b06b1d1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21cc6 expref: 6 pid: 8410 timeout: 933 lvb_type: 1 00010000:00010000:1.0:1746129578.564049:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a6cafe00/0x40a459093b06b1d1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21cc6 expref: 6 pid: 8410 timeout: 933 lvb_type: 1 00010000:00010000:1.0:1746129578.564067:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a6cafe00/0x40a459093b06b1d1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21cc6 expref: 6 pid: 8410 timeout: 933 lvb_type: 1 00010000:00010000:1.0:1746129578.564094:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129578.564125:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c078380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:068dab75-d300-4ead-a742-d14572ad1e50+5:1962:x1830948734344960:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 112us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129578.564131:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8598 00000100:00100000:0.0:1746129578.564776:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129578.564817:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129578.564836:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734345088 00000100:00100000:1.0:1746129578.564840:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734345088 00010000:00010000:1.0:1746129578.564853:0:9823:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b5263800/0x40a459093b06b17d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21c8e expref: 35 pid: 7148 timeout: 933 lvb_type: 0 00000100:00100000:1.0:1746129578.564868:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734345216 00000100:00100000:1.0:1746129578.564869:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734345216 00010000:00010000:1.0:1746129578.564877:0:9823:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095129400/0x40a459093b06b18b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21c9c expref: 40 pid: 7148 timeout: 933 lvb_type: 1 00000100:00100000:1.0:1746129578.564900:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8599 00000100:00100000:1.0:1746129578.564905:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094fd7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+35:1961:x1830948734345088:12345-192.168.202.4@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746129578.565024:0:20578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8600 00010000:00010000:1.0:1746129578.565029:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746129578.565032:0:20578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094fd7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ada2ffba-8920-4ecb-8068-68caa9806978+40:1962:x1830948734345216:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129578.565039:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b5263800/0x40a459093b06b17d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21c8e expref: 35 pid: 7148 timeout: 933 lvb_type: 0 00010000:00010000:3.0:1746129578.565040:0:20578:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129578.565048:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b5263800/0x40a459093b06b17d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21c8e expref: 35 pid: 7148 timeout: 933 lvb_type: 0 00010000:00010000:3.0:1746129578.565152:0:20578:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095129400/0x40a459093b06b18b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21c9c expref: 40 pid: 7148 timeout: 933 lvb_type: 1 00010000:00010000:1.0:1746129578.565156:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b5263800/0x40a459093b06b17d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21c8e expref: 35 pid: 7148 timeout: 933 lvb_type: 0 00010000:00010000:3.0:1746129578.565162:0:20578:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095129400/0x40a459093b06b18b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21c9c expref: 40 pid: 7148 timeout: 933 lvb_type: 1 00010000:00010000:3.0:1746129578.565174:0:20578:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095129400/0x40a459093b06b18b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21c9c expref: 40 pid: 7148 timeout: 933 lvb_type: 1 00010000:00010000:3.0:1746129578.565185:0:20578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129578.565187:0:20578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129578.565192:0:20578:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136b1ca00/0x40a459093b06b2fe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1409024->1839103) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21dad expref: 35 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129578.565202:0:20578:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136b1ca00/0x40a459093b06b2fe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1409024->1839103) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21dad expref: 35 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129578.565226:0:20578:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880136b1ca00/0x40a459093b06b2fe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1409024->1839103) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21dad expref: 35 pid: 8410 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129578.565237:0:20578:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bc000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:20578:1830948737593344:192.168.202.4@tcp:105: 00010000:00010000:1.0:1746129578.565280:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129578.565308:0:20578:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa3813c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746129578.565312:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094fd7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+34:1961:x1830948734345088:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 407us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129578.565317:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8599 00000100:00100000:0.0:1746129578.567285:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129578.567692:0:20578:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bc000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:20578:1830948737593344:192.168.202.4@tcp:105: 00010000:00010000:3.0:1746129578.567710:0:20578:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129578.567750:0:20578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094fd7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ada2ffba-8920-4ecb-8068-68caa9806978+39:1962:x1830948734345216:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 2719us (2932us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129578.567758:0:20578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8600 00000100:00100000:2.0:1746129578.567822:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734345472 00000100:00100000:2.0:1746129578.567828:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734345472 00002000:00100000:2.0:1746129578.567865:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f4:0x0] (1409024->1413119) req@ffff880094fd7800 x1830948734345472/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:319/0 lens 488/0 e 0 to 0 dl 1746129589 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129578.567874:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094fd7800 with x1830948734345472 ext(1409024->1413119) 00002000:00010000:2.0:1746129578.567877:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094fd7800 00000100:00100000:2.0:1746129578.567900:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8071 00000100:00100000:2.0:1746129578.567907:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094fd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+34:1961:x1830948734345472:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:2.0:1746129578.568362:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094fd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+34:1961:x1830948734345472:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 455us (1080us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129578.568368:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8071 00002000:00100000:2.0:1746129578.568374:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f4:0x0] (1409024->1413119) req@ffff880094fd7800 x1830948734345472/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:319/0 lens 488/4536 e 0 to 0 dl 1746129589 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129578.568380:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094fd7800 with x1830948734345472 ext(1409024->1413119) 00002000:00010000:2.0:1746129578.568383:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094fd7800 00000100:00100000:0.0:1746129578.573372:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129578.573992:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734345728 00000100:00100000:2.0:1746129578.574000:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734345728 00002000:00100000:2.0:1746129578.574037:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f4:0x0] (1835008->1839103) req@ffff880094fd7b80 x1830948734345728/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:319/0 lens 488/0 e 0 to 0 dl 1746129589 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129578.574045:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094fd7b80 with x1830948734345728 ext(1835008->1839103) 00002000:00010000:2.0:1746129578.574050:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094fd7b80 00000100:00100000:2.0:1746129578.574351:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8072 00000100:00100000:2.0:1746129578.574359:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094fd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+34:1961:x1830948734345728:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:2.0:1746129578.574494:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094fd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+34:1961:x1830948734345728:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 136us (1127us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129578.574501:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8072 00002000:00100000:2.0:1746129578.574506:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f4:0x0] (1835008->1839103) req@ffff880094fd7b80 x1830948734345728/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:319/0 lens 488/4536 e 0 to 0 dl 1746129589 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129578.574512:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094fd7b80 with x1830948734345728 ext(1835008->1839103) 00002000:00010000:2.0:1746129578.574515:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094fd7b80 00000100:00100000:0.0:1746129578.627448:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129578.627711:0:8410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734345856 00000100:00100000:3.0:1746129578.627719:0:8410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734345856 00000100:00100000:3.0:1746129578.627766:0:8410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16654 00000100:00100000:3.0:1746129578.627772:0:8410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094fd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ada2ffba-8920-4ecb-8068-68caa9806978+39:32570:x1830948734345856:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:3.0:1746129578.628264:0:8410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129578.628280:0:8410:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fc59c00/0x40a459093b06b305 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21db4 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129578.628319:0:8410:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c144400/0x40a459093b06b2a3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21d60 expref: 33 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129578.628328:0:8410:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c3d4a00/0x40a459093b06b2f7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21da6 expref: 40 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129578.628334:0:8410:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129578.628395:0:8410:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129578.628398:0:8410:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fc59c00/0x40a459093b06b305 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [4161536->4194303] (req 4161536->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21db4 expref: 40 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129578.628422:0:8410:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c3d4a00/0x40a459093b06b2f7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21da6 expref: 40 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129578.628432:0:8410:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c3d4a00/0x40a459093b06b2f7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21da6 expref: 40 pid: 31503 timeout: 933 lvb_type: 0 00000100:00100000:3.0:1746129578.628443:0:8410:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8410:1830948737593472:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129578.628645:0:8410:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c144400/0x40a459093b06b2a3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21d60 expref: 33 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129578.628652:0:8410:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c144400/0x40a459093b06b2a3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21d60 expref: 33 pid: 8410 timeout: 933 lvb_type: 0 00000100:00100000:3.0:1746129578.628660:0:8410:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8410:1830948737593600:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129578.628677:0:8410:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa3813c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746129578.630385:0:8410:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8410:1830948737593472:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129578.634450:0:8410:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8410:1830948737593600:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129578.634475:0:8410:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fc59c00/0x40a459093b06b305 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [4161536->4194303] (req 4161536->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21db4 expref: 40 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129578.634490:0:8410:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fc59c00, rc 0) 00000100:00100000:2.0:1746129578.634539:0:8410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094fd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ada2ffba-8920-4ecb-8068-68caa9806978+40:32570:x1830948734345856:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 6766us (7098us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129578.634545:0:8410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16654 00000100:00100000:0.0:1746129578.634683:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129578.634917:0:20578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734345984 00000100:00100000:3.0:1746129578.634922:0:20578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734345984 00010000:00010000:3.0:1746129578.634943:0:20578:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c144400/0x40a459093b06b2a3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21d60 expref: 34 pid: 8410 timeout: 933 lvb_type: 0 00000100:00100000:3.0:1746129578.634965:0:20578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8601 00000100:00100000:3.0:1746129578.634970:0:20578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094fd4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+34:1960:x1830948734345984:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129578.634980:0:20578:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129578.634995:0:20578:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c144400/0x40a459093b06b2a3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21d60 expref: 34 pid: 8410 timeout: 933 lvb_type: 0 00010000:00010000:3.0:1746129578.635003:0:20578:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c144400/0x40a459093b06b2a3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21d60 expref: 34 pid: 8410 timeout: 933 lvb_type: 0 00010000:00010000:3.0:1746129578.635018:0:20578:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c144400/0x40a459093b06b2a3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21d60 expref: 34 pid: 8410 timeout: 933 lvb_type: 0 00010000:00010000:3.0:1746129578.635029:0:20578:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129578.635046:0:20578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094fd4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+33:1960:x1830948734345984:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 77us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129578.635051:0:20578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8601 00000100:00100000:2.0:1746129578.637019:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129578.637572:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734346112 00000100:00100000:0.0:1746129578.637579:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734346112 00010000:00010000:0.0:1746129578.637612:0:7087:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c3d4a00/0x40a459093b06b2f7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21da6 expref: 40 pid: 31503 timeout: 933 lvb_type: 0 00000100:00100000:0.0:1746129578.637644:0:7087:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8602 00000100:00100000:0.0:1746129578.637649:0:7087:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c078a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ada2ffba-8920-4ecb-8068-68caa9806978+40:1962:x1830948734346112:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129578.637659:0:7087:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129578.637675:0:7087:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c3d4a00/0x40a459093b06b2f7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21da6 expref: 40 pid: 31503 timeout: 933 lvb_type: 0 00010000:00010000:0.0:1746129578.637686:0:7087:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c3d4a00/0x40a459093b06b2f7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21da6 expref: 40 pid: 31503 timeout: 933 lvb_type: 0 00010000:00010000:0.0:1746129578.637701:0:7087:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c3d4a00/0x40a459093b06b2f7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21da6 expref: 40 pid: 31503 timeout: 933 lvb_type: 0 00010000:00010000:0.0:1746129578.637728:0:7087:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129578.637729:0:7087:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129578.637735:0:7087:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fc59c00/0x40a459093b06b305 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4161536->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21db4 expref: 39 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129578.637741:0:7087:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fc59c00/0x40a459093b06b305 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4161536->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21db4 expref: 39 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129578.637767:0:7087:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fc59c00/0x40a459093b06b305 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4161536->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21db4 expref: 39 pid: 8410 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129578.637776:0:7087:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fbaf100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7087:1830948737593728:192.168.202.4@tcp:105: 00000100:00100000:0.0:1746129578.637846:0:7087:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009cdf3600 going to sleep for 11 seconds 00000100:00100000:2.0:1746129578.640105:0:7087:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fbaf100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7087:1830948737593728:192.168.202.4@tcp:105: 00010000:00010000:2.0:1746129578.640125:0:7087:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129578.640233:0:7087:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c078a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ada2ffba-8920-4ecb-8068-68caa9806978+39:1962:x1830948734346112:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 2581us (3222us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129578.640241:0:7087:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8602 00000100:00100000:0.0:1746129578.641971:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129578.642037:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734346368 00000100:00100000:2.0:1746129578.642043:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734346368 00002000:00100000:2.0:1746129578.642075:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f5:0x0] (4161536->4165631) req@ffff88009fbae300 x1830948734346368/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:319/0 lens 488/0 e 0 to 0 dl 1746129589 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129578.642084:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbae300 with x1830948734346368 ext(4161536->4165631) 00002000:00010000:2.0:1746129578.642088:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fbae300 00000100:00100000:2.0:1746129578.642139:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8073 00000100:00100000:2.0:1746129578.642145:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+39:1962:x1830948734346368:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:2.0:1746129578.642289:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+39:1962:x1830948734346368:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 144us (320us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129578.642571:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8073 00002000:00100000:2.0:1746129578.642578:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f5:0x0] (4161536->4165631) req@ffff88009fbae300 x1830948734346368/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:319/0 lens 488/4536 e 0 to 0 dl 1746129589 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129578.642585:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbae300 with x1830948734346368 ext(4161536->4165631) 00002000:00010000:2.0:1746129578.642588:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fbae300 00000100:00100000:0.0:1746129578.644621:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129578.644816:0:8410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734346496 00000100:00100000:2.0:1746129578.644820:0:8410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734346496 00000100:00100000:2.0:1746129578.644847:0:8410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16655 00000100:00100000:2.0:1746129578.644851:0:8410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbaed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ada2ffba-8920-4ecb-8068-68caa9806978+28:32570:x1830948734346496:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:2.0:1746129578.644861:0:8410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129578.644875:0:8410:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880132fc3000/0x40a459093b06b30c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21dbb expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129578.644893:0:8410:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f798600/0x40a459093b06b295 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21d52 expref: 19 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129578.644900:0:8410:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091799200/0x40a459093b06b2b1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21d6e expref: 29 pid: 31503 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129578.644905:0:8410:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129578.644906:0:8410:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129578.644909:0:8410:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880132fc3000/0x40a459093b06b30c lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [4194304->4456447] (req 4194304->4456447) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21dbb expref: 29 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129578.644930:0:8410:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091799200/0x40a459093b06b2b1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21d6e expref: 29 pid: 31503 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129578.644938:0:8410:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091799200/0x40a459093b06b2b1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21d6e expref: 29 pid: 31503 timeout: 933 lvb_type: 1 00000100:00100000:2.0:1746129578.644947:0:8410:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c07ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8410:1830948737593856:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129578.645020:0:8410:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f798600/0x40a459093b06b295 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21d52 expref: 19 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129578.645027:0:8410:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f798600/0x40a459093b06b295 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21d52 expref: 19 pid: 8412 timeout: 933 lvb_type: 0 00000100:00100000:2.0:1746129578.645034:0:8410:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c07aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8410:1830948737593984:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129578.645055:0:8410:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132f36300 going to sleep for 11 seconds 00000100:00100000:2.0:1746129578.649553:0:8410:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c07ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8410:1830948737593856:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129578.649565:0:8410:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c07aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8410:1830948737593984:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129578.649605:0:8410:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880132fc3000/0x40a459093b06b30c lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [4194304->4456447] (req 4194304->4456447) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21dbb expref: 29 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129578.649620:0:8410:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132fc3000, rc 0) 00000100:00100000:2.0:1746129578.650457:0:8410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbaed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ada2ffba-8920-4ecb-8068-68caa9806978+29:32570:x1830948734346496:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 5600us (5835us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129578.650465:0:8410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16655 00000100:00100000:0.0:1746129578.650938:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129578.653973:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734346624 00000100:00100000:2.0:1746129578.653984:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734346624 00010000:00010000:2.0:1746129578.654023:0:7087:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091799200/0x40a459093b06b2b1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21d6e expref: 29 pid: 31503 timeout: 933 lvb_type: 1 00000100:00100000:2.0:1746129578.654061:0:7087:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8603 00000100:00100000:2.0:1746129578.654068:0:7087:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6025050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ada2ffba-8920-4ecb-8068-68caa9806978+29:1963:x1830948734346624:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129578.654081:0:7087:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129578.654099:0:7087:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091799200/0x40a459093b06b2b1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21d6e expref: 29 pid: 31503 timeout: 933 lvb_type: 1 00010000:00010000:2.0:1746129578.654109:0:7087:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091799200/0x40a459093b06b2b1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21d6e expref: 29 pid: 31503 timeout: 933 lvb_type: 1 00010000:00010000:2.0:1746129578.654127:0:7087:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091799200/0x40a459093b06b2b1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21d6e expref: 29 pid: 31503 timeout: 933 lvb_type: 1 00010000:00010000:2.0:1746129578.654157:0:7087:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129578.654212:0:7087:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6025050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ada2ffba-8920-4ecb-8068-68caa9806978+28:1963:x1830948734346624:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 143us (3274us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129578.654217:0:7087:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8603 00000100:00100000:0.0:1746129578.661448:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129578.661561:0:20578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734346752 00000100:00100000:3.0:1746129578.661571:0:20578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734346752 00010000:00010000:3.0:1746129578.661608:0:20578:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f798600/0x40a459093b06b295 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21d52 expref: 20 pid: 8412 timeout: 933 lvb_type: 0 00000100:00100000:3.0:1746129578.661646:0:20578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8604 00000100:00100000:3.0:1746129578.661653:0:20578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:1963:x1830948734346752:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129578.661664:0:20578:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129578.661683:0:20578:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f798600/0x40a459093b06b295 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21d52 expref: 20 pid: 8412 timeout: 933 lvb_type: 0 00010000:00010000:3.0:1746129578.661694:0:20578:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f798600/0x40a459093b06b295 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21d52 expref: 20 pid: 8412 timeout: 933 lvb_type: 0 00010000:00010000:3.0:1746129578.661714:0:20578:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f798600/0x40a459093b06b295 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21d52 expref: 20 pid: 8412 timeout: 933 lvb_type: 0 00010000:00010000:3.0:1746129578.661748:0:20578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129578.661750:0:20578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129578.661756:0:20578:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880132fc3000/0x40a459093b06b30c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4456447) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21dbb expref: 27 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129578.661764:0:20578:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880132fc3000/0x40a459093b06b30c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4456447) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21dbb expref: 27 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129578.661794:0:20578:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880132fc3000/0x40a459093b06b30c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4456447) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21dbb expref: 27 pid: 8410 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129578.661804:0:20578:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bdc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:20578:1830948737594112:192.168.202.4@tcp:105: 00000100:00100000:3.0:1746129578.662830:0:20578:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa381900 going to sleep for 11 seconds 00000100:00100000:3.0:1746129578.666535:0:20578:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bdc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:20578:1830948737594112:192.168.202.4@tcp:105: 00010000:00010000:3.0:1746129578.666559:0:20578:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129578.666612:0:20578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+19:1963:x1830948734346752:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 4956us (5173us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129578.666623:0:20578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8604 00000100:00100000:0.0:1746129578.666909:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129578.667234:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734347008 00000100:00100000:3.0:1746129578.667239:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734347008 00002000:00100000:3.0:1746129578.667283:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ef:0x0] (4452352->4456447) req@ffff88009fbac000 x1830948734347008/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:319/0 lens 488/0 e 0 to 0 dl 1746129589 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129578.667291:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbac000 with x1830948734347008 ext(4452352->4456447) 00002000:00010000:3.0:1746129578.668950:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fbac000 00000100:00100000:3.0:1746129578.669114:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8074 00000100:00100000:3.0:1746129578.669125:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+28:1962:x1830948734347008:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:3.0:1746129578.669317:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+28:1962:x1830948734347008:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 194us (2407us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129578.669323:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8074 00002000:00100000:3.0:1746129578.669329:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ef:0x0] (4452352->4456447) req@ffff88009fbac000 x1830948734347008/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:319/0 lens 488/4536 e 0 to 0 dl 1746129589 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129578.669338:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbac000 with x1830948734347008 ext(4452352->4456447) 00002000:00010000:3.0:1746129578.669341:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fbac000 00000100:00100000:0.0:1746129578.690451:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129578.690491:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129578.690544:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129578.690823:0:8412:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734347136 00000100:00100000:3.0:1746129578.690831:0:8412:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734347136 00000100:00100000:3.0:1746129578.690866:0:8412:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734347264 00000100:00100000:3.0:1746129578.690869:0:8412:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734347264 00000100:00100000:3.0:1746129578.690879:0:8412:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734347392 00000100:00100000:3.0:1746129578.690880:0:8412:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734347392 00000100:00100000:3.0:1746129578.690894:0:8412:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16656 00000100:00100000:3.0:1746129578.690900:0:8412:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbaea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:1962:x1830948734347136:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129578.690915:0:8412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129578.690928:0:8412:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fc59400/0x40a459093b06b313 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21dc2 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129578.691023:0:8412:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8412:1830948737594240:192.168.202.4@tcp:106: 00000100:00100000:3.0:1746129578.691084:0:8412:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa381f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746129578.691100:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16657 00000100:00100000:3.0:1746129578.691105:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:1962:x1830948734347264:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129578.691110:0:4385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129578.691116:0:4385:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fc58800/0x40a459093b06b31a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21dc9 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129578.691133:0:4385:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:4385:1830948737594368:192.168.202.4@tcp:106: 00000100:00100000:3.0:1746129578.691148:0:4385:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa3819c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746129578.691159:0:20577:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16658 00000100:00100000:3.0:1746129578.691162:0:20577:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+33:1962:x1830948734347392:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129578.691168:0:20577:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129578.691175:0:20577:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fc58600/0x40a459093b06b321 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21dd0 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129578.691191:0:20577:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20577:1830948737594496:192.168.202.4@tcp:106: 00000100:00100000:3.0:1746129578.691204:0:20577:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa381d80 going to sleep for 11 seconds 00002000:00010000:0.0:1746129578.694561:0:20577:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3f5:0x0] updating lvb mtime: 1746129578 -> 1746129579 00002000:00010000:0.0:1746129578.694571:0:20577:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3f5:0x0] updating lvb atime: 1746129578 -> 1746129579 00002000:00010000:0.0:1746129578.694574:0:20577:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3f5:0x0] updating lvb ctime: 1746129578 -> 1746129579 00000100:00100000:0.0:1746129578.694605:0:20577:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20577:1830948737594496:192.168.202.4@tcp:106: 00010000:00010000:0.0:1746129578.694646:0:20577:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fc58600/0x40a459093b06b321 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21dd0 expref: 34 pid: 20577 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129578.694662:0:20577:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fc58600/0x40a459093b06b321 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21dd0 expref: 34 pid: 20577 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129578.694801:0:20577:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fc58600, rc 0) 00000100:00100000:0.0:1746129578.694854:0:20577:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+33:1962:x1830948734347392:12345-192.168.202.4@tcp:101:cat.0 Request processed in 3689us (4309us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129578.694864:0:20577:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16658 00002000:00010000:2.0:1746129578.695021:0:4385:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb mtime: 1746129578 -> 1746129579 00002000:00010000:2.0:1746129578.695025:0:4385:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb atime: 1746129578 -> 1746129579 00002000:00010000:2.0:1746129578.695026:0:4385:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb ctime: 1746129578 -> 1746129579 00000100:00100000:2.0:1746129578.695040:0:4385:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:4385:1830948737594368:192.168.202.4@tcp:106: 00010000:00010000:2.0:1746129578.695058:0:4385:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fc58800/0x40a459093b06b31a lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21dc9 expref: 22 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129578.695067:0:4385:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fc58800/0x40a459093b06b31a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21dc9 expref: 22 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129578.695081:0:4385:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fc58800, rc 0) 00000100:00100000:2.0:1746129578.695106:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:1962:x1830948734347264:12345-192.168.202.4@tcp:101:cat.0 Request processed in 4000us (4615us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129578.695112:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16657 00000100:00100000:3.0:1746129578.695380:0:8412:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8412:1830948737594240:192.168.202.4@tcp:106: 00010000:00010000:3.0:1746129578.695396:0:8412:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fc59400/0x40a459093b06b313 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21dc2 expref: 20 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129578.695405:0:8412:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fc59400/0x40a459093b06b313 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21dc2 expref: 20 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129578.695416:0:8412:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fc59400, rc 0) 00000100:00100000:3.0:1746129578.695455:0:8412:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbaea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+19:1962:x1830948734347136:12345-192.168.202.4@tcp:101:cat.0 Request processed in 4554us (5013us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129578.695461:0:8412:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16656 00000100:00100000:0.0:1746129578.700761:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129578.701509:0:8412:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734347520 00000100:00100000:3.0:1746129578.701521:0:8412:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734347520 00000100:00100000:3.0:1746129578.701591:0:8412:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16659 00000100:00100000:3.0:1746129578.701601:0:8412:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+19:1960:x1830948734347520:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129578.701621:0:8412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129578.701640:0:8412:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fc59200/0x40a459093b06b328 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21dd7 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129578.701701:0:8412:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8412:1830948737594624:192.168.202.4@tcp:106: 00000100:00100000:3.0:1746129578.702431:0:8412:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa381f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746129578.705024:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129578.705115:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129578.705350:0:20577:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734347648 00000100:00100000:1.0:1746129578.705360:0:20577:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734347648 00000100:00100000:1.0:1746129578.705401:0:20577:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734347776 00000100:00100000:1.0:1746129578.705403:0:20577:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734347776 00000100:00100000:1.0:1746129578.705436:0:20577:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16660 00000100:00100000:1.0:1746129578.705444:0:20577:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:1960:x1830948734347648:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129578.705464:0:20577:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129578.705482:0:20577:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095286a00/0x40a459093b06b32f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21dde expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129578.705540:0:20577:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800915d0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20577:1830948737594752:192.168.202.4@tcp:106: 00000100:00100000:1.0:1746129578.705619:0:20577:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0ac600 going to sleep for 11 seconds 00000100:00100000:0.0:1746129578.706057:0:11014:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16661 00000100:00100000:0.0:1746129578.706065:0:11014:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+33:1961:x1830948734347776:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129578.706073:0:11014:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129578.706083:0:11014:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091799800/0x40a459093b06b336 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21de5 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129578.706109:0:11014:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fbafb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11014:1830948737594880:192.168.202.4@tcp:106: 00000100:00100000:0.0:1746129578.706133:0:11014:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009cdf36c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129578.707158:0:11014:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fbafb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11014:1830948737594880:192.168.202.4@tcp:106: 00010000:00010000:0.0:1746129578.707186:0:11014:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091799800/0x40a459093b06b336 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21de5 expref: 34 pid: 11014 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746129578.707199:0:8412:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8412:1830948737594624:192.168.202.4@tcp:106: 00010000:00010000:0.0:1746129578.707201:0:11014:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091799800/0x40a459093b06b336 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21de5 expref: 34 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129578.707216:0:8412:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fc59200/0x40a459093b06b328 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21dd7 expref: 22 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129578.707223:0:11014:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091799800, rc 0) 00000100:00100000:0.0:1746129578.707262:0:11014:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+33:1961:x1830948734347776:12345-192.168.202.4@tcp:101:cat.0 Request processed in 1198us (2146us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129578.707268:0:11014:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16661 00000100:00100000:1.0:1746129578.707379:0:20577:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800915d0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20577:1830948737594752:192.168.202.4@tcp:106: 00010000:00010000:3.0:1746129578.707389:0:8412:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fc59200/0x40a459093b06b328 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21dd7 expref: 22 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129578.707394:0:20577:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095286a00/0x40a459093b06b32f lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21dde expref: 22 pid: 20577 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129578.707399:0:8412:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fc59200, rc 0) 00010000:00010000:1.0:1746129578.707401:0:20577:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095286a00/0x40a459093b06b32f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21dde expref: 21 pid: 20577 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129578.707413:0:20577:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095286a00, rc 0) 00000100:00100000:3.0:1746129578.707420:0:8412:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:1960:x1830948734347520:12345-192.168.202.4@tcp:101:cat.0 Request processed in 5821us (6673us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129578.707426:0:20577:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:1960:x1830948734347648:12345-192.168.202.4@tcp:101:cat.0 Request processed in 1984us (2412us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129578.707429:0:8412:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16659 00000100:00100000:1.0:1746129578.707431:0:20577:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16660 00000100:00100000:0.0:1746129578.717668:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129578.717732:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129578.720325:0:31522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734348160 00000100:00100000:1.0:1746129578.720340:0:31522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734348160 00002000:00100000:1.0:1746129578.720397:0:31522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f4:0x0] (1048576->2097151) req@ffff88009fbafb80 x1830948734348160/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:319/0 lens 504/0 e 0 to 0 dl 1746129589 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129578.720407:0:31522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbafb80 with x1830948734348160 ext(1048576->2097151) 00002000:00010000:1.0:1746129578.720414:0:31522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fbafb80 00000100:00100000:1.0:1746129578.720441:0:31522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734348032 00000100:00100000:1.0:1746129578.720445:0:31522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734348032 00002000:00100000:1.0:1746129578.720456:0:31522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff88009fbadc00 x1830948734348032/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:319/0 lens 488/0 e 0 to 0 dl 1746129589 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129578.720463:0:31522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbadc00 with x1830948734348032 ext(1048576->2097151) 00002000:00010000:1.0:1746129578.720466:0:31522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fbadc00 00000100:00100000:1.0:1746129578.720492:0:31522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8075 00000100:00100000:1.0:1746129578.720500:0:31522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+34:1960:x1830948734348160:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129578.720766:0:21725:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8076 00000100:00100000:0.0:1746129578.720774:0:21725:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+34:1960:x1830948734348032:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129578.729933:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129578.730007:0:8412:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734348416 00000100:00100000:3.0:1746129578.730018:0:8412:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734348416 00000100:00100000:1.0:1746129578.731355:0:31522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+36:1960:x1830948734348160:12345-192.168.202.4@tcp:3:cat.0 Request processed in 10849us (13692us total) trans 0 rc 618496/618496 00000100:00100000:1.0:1746129578.731376:0:31522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8075 00002000:00100000:1.0:1746129578.731389:0:31522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f4:0x0] (1048576->2097151) req@ffff88009fbafb80 x1830948734348160/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:319/0 lens 504/440 e 0 to 0 dl 1746129589 ref 1 fl Complete:/200/0 rc 618496/618496 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129578.731399:0:31522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbafb80 with x1830948734348160 ext(1048576->2097151) 00002000:00010000:1.0:1746129578.731406:0:31522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fbafb80 00000100:00100000:3.0:1746129578.734780:0:8412:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16662 00000100:00100000:3.0:1746129578.734797:0:8412:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+34:32576:x1830948734348416:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:3.0:1746129578.734815:0:8412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129578.734835:0:8412:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fc59a00/0x40a459093b06b33d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21dec expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129578.734875:0:8412:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fc59c00/0x40a459093b06b305 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4161536->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21db4 expref: 38 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129578.734887:0:8412:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129578.734889:0:8412:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129578.734892:0:8412:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fc59a00/0x40a459093b06b33d lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [2437120->2854911] (req 2437120->2854911) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21dec expref: 35 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129578.734928:0:8412:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fc59c00/0x40a459093b06b305 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4161536->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21db4 expref: 38 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129578.734940:0:8412:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fc59c00/0x40a459093b06b305 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4161536->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21db4 expref: 38 pid: 8410 timeout: 934 lvb_type: 0 00000100:00100000:3.0:1746129578.734952:0:8412:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8412:1830948737595008:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129578.735714:0:21725:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+35:1960:x1830948734348032:12345-192.168.202.4@tcp:3:cat.0 Request processed in 14936us (17976us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129578.735728:0:21725:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8076 00002000:00100000:1.0:1746129578.735739:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff88009fbadc00 x1830948734348032/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:319/0 lens 488/440 e 0 to 0 dl 1746129589 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129578.735748:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbadc00 with x1830948734348032 ext(1048576->2097151) 00002000:00010000:1.0:1746129578.735752:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fbadc00 00000100:00100000:3.0:1746129578.735765:0:8412:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa381f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746129578.742470:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129578.742609:0:8412:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8412:1830948737595008:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129578.742643:0:8412:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fc59a00/0x40a459093b06b33d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [2437120->2854911] (req 2437120->2854911) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21dec expref: 34 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129578.742664:0:8412:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fc59a00, rc 0) 00000100:00100000:3.0:1746129578.742729:0:8412:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+34:32576:x1830948734348416:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 7937us (12805us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129578.742738:0:8412:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16662 00000100:00100000:1.0:1746129578.742767:0:21725:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734348544 00000100:00100000:1.0:1746129578.742775:0:21725:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734348544 00002000:00100000:1.0:1746129578.742817:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f5:0x0] (4161536->4194303) req@ffff88009fbac380 x1830948734348544/t0(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:319/0 lens 488/0 e 0 to 0 dl 1746129589 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129578.742826:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbac380 with x1830948734348544 ext(4161536->4194303) 00010000:00010000:1.0:1746129578.742833:0:21725:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fc59c00/0x40a459093b06b305 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4161536->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21db4 expref: 39 pid: 8410 timeout: 934 lvb_type: 0 00010000:00010000:1.0:1746129578.742845:0:21725:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fc59c00/0x40a459093b06b305 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4161536->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21db4 expref: 39 pid: 8410 timeout: 934 lvb_type: 0 00002000:00010000:1.0:1746129578.742851:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fbac380 00000100:00100000:1.0:1746129578.742870:0:21725:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2495 00000100:00100000:1.0:1746129578.742877:0:21725:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ada2ffba-8920-4ecb-8068-68caa9806978+39:1963:x1830948734348544:12345-192.168.202.4@tcp:4:multiop.0 00000100:00100000:0.0:1746129578.745980:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129578.746068:0:8412:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734348672 00000100:00100000:3.0:1746129578.746077:0:8412:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734348672 00000100:00100000:3.0:1746129578.746121:0:8412:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16663 00000100:00100000:3.0:1746129578.746129:0:8412:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+19:32574:x1830948734348672:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129578.746148:0:8412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129578.746166:0:8412:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fc59200/0x40a459093b06b344 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21df3 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129578.746196:0:8412:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008fba4e00/0x40a459093b06b2db lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1781760->1822719) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21d8a expref: 27 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129578.746203:0:8412:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129578.746205:0:8412:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129578.746208:0:8412:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fc59200/0x40a459093b06b344 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21df3 expref: 20 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129578.746241:0:8412:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008fba4e00/0x40a459093b06b2db lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1781760->1822719) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21d8a expref: 27 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129578.746261:0:8412:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008fba4e00/0x40a459093b06b2db lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1781760->1822719) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21d8a expref: 27 pid: 31503 timeout: 934 lvb_type: 0 00000100:00100000:3.0:1746129578.746275:0:8412:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8412:1830948737595136:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129578.748832:0:8412:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa381f00 going to sleep for 11 seconds 00000100:00100000:1.0:1746129578.749061:0:21725:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ada2ffba-8920-4ecb-8068-68caa9806978+41:1963:x1830948734348544:12345-192.168.202.4@tcp:4:multiop.0 Request processed in 6178us (6597us total) trans 17179874168 rc 0/0 00000100:00100000:1.0:1746129578.749072:0:21725:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2495 00002000:00100000:1.0:1746129578.749084:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f5:0x0] (4161536->4194303) req@ffff88009fbac380 x1830948734348544/t17179874168(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:319/0 lens 488/448 e 0 to 0 dl 1746129589 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129578.749100:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbac380 with x1830948734348544 ext(4161536->4194303) 00010000:00010000:1.0:1746129578.749111:0:21725:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fc59c00/0x40a459093b06b305 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4161536->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21db4 expref: 41 pid: 8410 timeout: 934 lvb_type: 0 00010000:00010000:1.0:1746129578.749125:0:21725:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fc59c00/0x40a459093b06b305 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4161536->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21db4 expref: 41 pid: 8410 timeout: 934 lvb_type: 0 00002000:00010000:1.0:1746129578.749132:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fbac380 00000100:00100000:0.0:1746129578.754845:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129578.755239:0:21725:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734348800 00000100:00100000:1.0:1746129578.755257:0:21725:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734348800 00002000:00100000:1.0:1746129578.755908:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ee:0x0] (1781760->1822719) req@ffff88009fbaf100 x1830948734348800/t0(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:319/0 lens 488/0 e 0 to 0 dl 1746129589 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129578.755920:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbaf100 with x1830948734348800 ext(1781760->1822719) 00010000:00010000:1.0:1746129578.755931:0:21725:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008fba4e00/0x40a459093b06b2db lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1781760->1822719) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21d8a expref: 28 pid: 31503 timeout: 934 lvb_type: 0 00010000:00010000:1.0:1746129578.755944:0:21725:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008fba4e00/0x40a459093b06b2db lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1781760->1822719) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21d8a expref: 28 pid: 31503 timeout: 934 lvb_type: 0 00002000:00010000:1.0:1746129578.755952:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fbaf100 00000100:00100000:1.0:1746129578.755975:0:21725:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2496 00000100:00100000:1.0:1746129578.755983:0:21725:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ada2ffba-8920-4ecb-8068-68caa9806978+28:1961:x1830948734348800:12345-192.168.202.4@tcp:4:multiop.0 00000100:00100000:3.0:1746129578.756835:0:8412:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8412:1830948737595136:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129578.756861:0:8412:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fc59200/0x40a459093b06b344 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21df3 expref: 20 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129578.756877:0:8412:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fc59200, rc 0) 00000100:00100000:0.0:1746129578.758895:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129578.759036:0:20578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734348928 00000100:00100000:0.0:1746129578.759045:0:20578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734348928 00010000:00010000:0.0:1746129578.759084:0:20578:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fc59c00/0x40a459093b06b305 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4161536->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21db4 expref: 41 pid: 8410 timeout: 934 lvb_type: 0 00000100:00100000:0.0:1746129578.759121:0:20578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8605 00000100:00100000:0.0:1746129578.759129:0:20578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095624e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ada2ffba-8920-4ecb-8068-68caa9806978+41:1962:x1830948734348928:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129578.759143:0:20578:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129578.759168:0:20578:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fc59c00/0x40a459093b06b305 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4161536->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21db4 expref: 41 pid: 8410 timeout: 934 lvb_type: 0 00010000:00010000:0.0:1746129578.759179:0:20578:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fc59c00/0x40a459093b06b305 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4161536->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21db4 expref: 41 pid: 8410 timeout: 934 lvb_type: 0 00010000:00010000:0.0:1746129578.759206:0:20578:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fc59c00/0x40a459093b06b305 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4161536->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21db4 expref: 41 pid: 8410 timeout: 934 lvb_type: 0 00010000:00010000:0.0:1746129578.759223:0:20578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129578.759225:0:20578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129578.759232:0:20578:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fc59a00/0x40a459093b06b33d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2437120->2854911) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21dec expref: 33 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129578.759240:0:20578:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fc59a00/0x40a459093b06b33d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2437120->2854911) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21dec expref: 33 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129578.759283:0:20578:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fc59a00/0x40a459093b06b33d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2437120->2854911) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21dec expref: 33 pid: 8412 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129578.759323:0:20578:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095624380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:20578:1830948737595264:192.168.202.4@tcp:105: 00000100:00100000:3.0:1746129578.759736:0:8412:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:32574:x1830948734348672:12345-192.168.202.4@tcp:101:cat.0 Request processed in 13605us (13763us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129578.759744:0:8412:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16663 00000100:00100000:1.0:1746129578.763912:0:21725:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ada2ffba-8920-4ecb-8068-68caa9806978+30:1961:x1830948734348800:12345-192.168.202.4@tcp:4:multiop.0 Request processed in 7919us (9068us total) trans 21474841411 rc 0/0 00000100:00100000:1.0:1746129578.763930:0:21725:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2496 00002000:00100000:1.0:1746129578.763942:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ee:0x0] (1781760->1822719) req@ffff88009fbaf100 x1830948734348800/t21474841411(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:319/0 lens 488/448 e 0 to 0 dl 1746129589 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129578.763953:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbaf100 with x1830948734348800 ext(1781760->1822719) 00010000:00010000:1.0:1746129578.763964:0:21725:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008fba4e00/0x40a459093b06b2db lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1781760->1822719) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21d8a expref: 30 pid: 31503 timeout: 934 lvb_type: 0 00010000:00010000:1.0:1746129578.763978:0:21725:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008fba4e00/0x40a459093b06b2db lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1781760->1822719) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21d8a expref: 30 pid: 31503 timeout: 934 lvb_type: 0 00002000:00010000:1.0:1746129578.763986:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fbaf100 00000100:00100000:0.0:1746129578.764728:0:20578:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009cdf36c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746129578.766415:0:20578:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095624380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:20578:1830948737595264:192.168.202.4@tcp:105: 00010000:00010000:2.0:1746129578.766438:0:20578:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129578.766478:0:20578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095624e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ada2ffba-8920-4ecb-8068-68caa9806978+40:1962:x1830948734348928:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 7350us (7592us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129578.766487:0:20578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8605 00000100:00100000:0.0:1746129578.771414:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129578.771468:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129578.771622:0:21725:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734349184 00000100:00100000:1.0:1746129578.771632:0:21725:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734349184 00002000:00100000:1.0:1746129578.771681:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f5:0x0] (2437120->2441215) req@ffff880095627b80 x1830948734349184/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:319/0 lens 488/0 e 0 to 0 dl 1746129589 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129578.771691:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095627b80 with x1830948734349184 ext(2437120->2441215) 00002000:00010000:1.0:1746129578.771697:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095627b80 00000100:00100000:1.0:1746129578.771717:0:21725:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8077 00000100:00100000:1.0:1746129578.771724:0:21725:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095627b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+34:1960:x1830948734349184:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:1.0:1746129578.771937:0:21725:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095627b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+34:1960:x1830948734349184:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 212us (535us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746129578.771943:0:21725:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8077 00002000:00100000:1.0:1746129578.771949:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f5:0x0] (2437120->2441215) req@ffff880095627b80 x1830948734349184/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:319/0 lens 488/4536 e 0 to 0 dl 1746129589 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129578.771962:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095627b80 with x1830948734349184 ext(2437120->2441215) 00002000:00010000:1.0:1746129578.771964:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095627b80 00000100:00100000:2.0:1746129578.772521:0:20578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734349312 00000100:00100000:2.0:1746129578.772526:0:20578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734349312 00010000:00010000:2.0:1746129578.772549:0:20578:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008fba4e00/0x40a459093b06b2db lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1781760->1822719) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21d8a expref: 30 pid: 31503 timeout: 934 lvb_type: 0 00000100:00100000:2.0:1746129578.772569:0:20578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8606 00000100:00100000:2.0:1746129578.772573:0:20578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095626300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ada2ffba-8920-4ecb-8068-68caa9806978+30:1963:x1830948734349312:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129578.772582:0:20578:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129578.772599:0:20578:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008fba4e00/0x40a459093b06b2db lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1781760->1822719) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21d8a expref: 30 pid: 31503 timeout: 934 lvb_type: 0 00010000:00010000:2.0:1746129578.772610:0:20578:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008fba4e00/0x40a459093b06b2db lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1781760->1822719) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21d8a expref: 30 pid: 31503 timeout: 934 lvb_type: 0 00010000:00010000:2.0:1746129578.772632:0:20578:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008fba4e00/0x40a459093b06b2db lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1781760->1822719) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21d8a expref: 30 pid: 31503 timeout: 934 lvb_type: 0 00010000:00010000:2.0:1746129578.772658:0:20578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129578.772660:0:20578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129578.772667:0:20578:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fc59200/0x40a459093b06b344 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21df3 expref: 19 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129578.772675:0:20578:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fc59200/0x40a459093b06b344 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21df3 expref: 19 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129578.772702:0:20578:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009fc59200/0x40a459093b06b344 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21df3 expref: 19 pid: 8412 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129578.772712:0:20578:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c078380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:20578:1830948737595392:192.168.202.4@tcp:105: 00000100:00100000:2.0:1746129578.772766:0:20578:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132f363c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129578.781565:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129578.781609:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129578.781649:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129578.781676:0:11014:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734349440 00000100:00100000:0.0:1746129578.781686:0:11014:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734349440 00000100:00100000:0.0:1746129578.781742:0:11014:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734349568 00000100:00100000:0.0:1746129578.781744:0:11014:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734349568 00000100:00100000:0.0:1746129578.781758:0:11014:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734349696 00000100:00100000:0.0:1746129578.781759:0:11014:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734349696 00000100:00100000:0.0:1746129578.781773:0:11014:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16664 00000100:00100000:0.0:1746129578.781779:0:11014:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095625880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ada2ffba-8920-4ecb-8068-68caa9806978+41:1961:x1830948734349440:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129578.781799:0:11014:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129578.781818:0:11014:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091799000/0x40a459093b06b34b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21dfa expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129578.781874:0:11014:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095625180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11014:1830948737595520:192.168.202.4@tcp:106: 00000100:00100000:0.0:1746129578.781956:0:11014:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009cdf33c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129578.782081:0:31503:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16665 00000100:00100000:0.0:1746129578.782086:0:31503:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095624000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ada2ffba-8920-4ecb-8068-68caa9806978+30:1960:x1830948734349568:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129578.782095:0:31503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129578.782105:0:31503:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091798c00/0x40a459093b06b352 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21e01 expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129578.782117:0:31503:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129578.782119:0:31503:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129578.782127:0:31503:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091798c00/0x40a459093b06b352 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21e01 expref: 31 pid: 31503 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129578.782142:0:31503:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091798c00/0x40a459093b06b352 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21e01 expref: 31 pid: 31503 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129578.782151:0:31503:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091798c00, rc 0) 00000100:00100000:0.0:1746129578.782176:0:31503:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095624000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ada2ffba-8920-4ecb-8068-68caa9806978+31:1960:x1830948734349568:12345-192.168.202.4@tcp:101:cat.0 Request processed in 89us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129578.782181:0:31503:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16665 00000100:00100000:0.0:1746129578.782198:0:31503:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16666 00000100:00100000:0.0:1746129578.782202:0:31503:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095625500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ada2ffba-8920-4ecb-8068-68caa9806978+42:1961:x1830948734349696:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129578.782206:0:31503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129578.782212:0:31503:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091798e00/0x40a459093b06b359 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21e08 expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129578.782230:0:31503:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095626a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:31503:1830948737595648:192.168.202.4@tcp:106: 00000100:00100000:0.0:1746129578.782261:0:31503:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009cdf36c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129578.783941:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129578.784067:0:31522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734350080 00000100:00100000:1.0:1746129578.784075:0:31522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734350080 00002000:00100000:1.0:1746129578.784118:0:31522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3ee:0x0] (1048576->2097151) req@ffff880095627480 x1830948734350080/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:319/0 lens 488/0 e 0 to 0 dl 1746129589 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129578.784128:0:31522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095627480 with x1830948734350080 ext(1048576->2097151) 00002000:00010000:1.0:1746129578.784132:0:31522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095627480 00000100:00100000:1.0:1746129578.784148:0:31522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8078 00000100:00100000:1.0:1746129578.784155:0:31522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095627480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:1963:x1830948734350080:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:2.0:1746129578.784341:0:20578:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c078380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:20578:1830948737595392:192.168.202.4@tcp:105: 00010000:00010000:2.0:1746129578.784363:0:20578:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129578.784398:0:20578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095626300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ada2ffba-8920-4ecb-8068-68caa9806978+30:1963:x1830948734349312:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 11824us (12928us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129578.784405:0:20578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8606 00000100:00100000:0.0:1746129578.789185:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00002000:00010000:0.0:1746129578.789268:0:11014:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb mtime: 1746129578 -> 1746129579 00002000:00010000:0.0:1746129578.789272:0:11014:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb atime: 1746129576 -> 1746129579 00002000:00010000:0.0:1746129578.789274:0:11014:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb ctime: 1746129578 -> 1746129579 00000100:00100000:0.0:1746129578.789314:0:11014:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095625180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11014:1830948737595520:192.168.202.4@tcp:106: 00010000:00010000:0.0:1746129578.789346:0:11014:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091799000/0x40a459093b06b34b lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21dfa expref: 43 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129578.789361:0:11014:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091799000/0x40a459093b06b34b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21dfa expref: 43 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129578.789392:0:11014:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091799000, rc 0) 00000100:00100000:0.0:1746129578.789432:0:11014:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095625880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ada2ffba-8920-4ecb-8068-68caa9806978+42:1961:x1830948734349440:12345-192.168.202.4@tcp:101:cat.0 Request processed in 7653us (7878us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129578.789446:0:11014:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16664 00000100:00100000:0.0:1746129578.789526:0:31503:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095626a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:31503:1830948737595648:192.168.202.4@tcp:106: 00010000:00010000:0.0:1746129578.789539:0:31503:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091798e00/0x40a459093b06b359 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21e08 expref: 41 pid: 31503 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129578.789548:0:31503:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091798e00/0x40a459093b06b359 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21e08 expref: 41 pid: 31503 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129578.789556:0:31503:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091798e00, rc 0) 00000100:00100000:0.0:1746129578.789570:0:31503:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095625500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ada2ffba-8920-4ecb-8068-68caa9806978+40:1961:x1830948734349696:12345-192.168.202.4@tcp:101:cat.0 Request processed in 7368us (7921us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129578.789576:0:31503:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16666 00000100:00100000:1.0:1746129578.791523:0:21725:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734350208 00000100:00100000:1.0:1746129578.791536:0:21725:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734350208 00002000:00100000:1.0:1746129578.791588:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f5:0x0] (2850816->2854911) req@ffff880095624a80 x1830948734350208/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:319/0 lens 488/0 e 0 to 0 dl 1746129589 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129578.791598:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095624a80 with x1830948734350208 ext(2850816->2854911) 00002000:00010000:1.0:1746129578.791605:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095624a80 00000100:00100000:1.0:1746129578.791645:0:21725:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8079 00000100:00100000:1.0:1746129578.791652:0:21725:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095624a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+34:1960:x1830948734350208:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:1.0:1746129578.791824:0:21725:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095624a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+34:1960:x1830948734350208:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 173us (2651us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746129578.791831:0:21725:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8079 00002000:00100000:1.0:1746129578.791836:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f5:0x0] (2850816->2854911) req@ffff880095624a80 x1830948734350208/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:319/0 lens 488/4536 e 0 to 0 dl 1746129589 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129578.791848:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095624a80 with x1830948734350208 ext(2850816->2854911) 00002000:00010000:1.0:1746129578.791850:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095624a80 00000100:00100000:1.0:1746129578.800176:0:31522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095627480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:1963:x1830948734350080:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 16008us (16230us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129578.800189:0:31522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8078 00002000:00100000:1.0:1746129578.800203:0:31522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3ee:0x0] (1048576->2097151) req@ffff880095627480 x1830948734350080/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:319/0 lens 488/440 e 0 to 0 dl 1746129589 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129578.800213:0:31522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095627480 with x1830948734350080 ext(1048576->2097151) 00002000:00010000:1.0:1746129578.800219:0:31522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095627480 00000100:00100000:2.0:1746129578.800539:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129578.800598:0:31503:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734350336 00000100:00100000:0.0:1746129578.800606:0:31503:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734350336 00000100:00100000:0.0:1746129578.800640:0:31503:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16667 00000100:00100000:0.0:1746129578.800646:0:31503:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c078380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ada2ffba-8920-4ecb-8068-68caa9806978+40:32579:x1830948734350336:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129578.800661:0:31503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129578.800678:0:31503:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091799000/0x40a459093b06b360 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21e0f expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129578.800705:0:31503:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880136b1ca00/0x40a459093b06b2fe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1409024->1839103) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21dad expref: 33 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129578.800713:0:31503:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129578.800714:0:31503:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129578.800717:0:31503:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091799000/0x40a459093b06b360 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21e0f expref: 41 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129578.800751:0:31503:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880136b1ca00/0x40a459093b06b2fe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1409024->1839103) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21dad expref: 33 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129578.800764:0:31503:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880136b1ca00/0x40a459093b06b2fe lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1409024->1839103) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21dad expref: 33 pid: 8410 timeout: 934 lvb_type: 0 00000100:00100000:0.0:1746129578.800775:0:31503:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095626a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:31503:1830948737595776:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129578.800841:0:31503:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009cdf36c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746129578.802197:0:31503:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095626a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:31503:1830948737595776:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129578.802222:0:31503:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091799000/0x40a459093b06b360 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21e0f expref: 41 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129578.802233:0:31503:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091799000, rc 0) 00000100:00100000:2.0:1746129578.802270:0:31503:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c078380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ada2ffba-8920-4ecb-8068-68caa9806978+41:32579:x1830948734350336:12345-192.168.202.4@tcp:101:cat.0 Request processed in 1624us (1731us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129578.802278:0:31503:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16667 00000100:00100000:0.0:1746129578.804260:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129578.804368:0:31522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734350464 00000100:00100000:1.0:1746129578.804377:0:31522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734350464 00002000:00100000:1.0:1746129578.804416:0:31522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f4:0x0] (1409024->1839103) req@ffff880095625180 x1830948734350464/t0(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:319/0 lens 488/0 e 0 to 0 dl 1746129589 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129578.804426:0:31522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095625180 with x1830948734350464 ext(1409024->1839103) 00010000:00010000:1.0:1746129578.804435:0:31522:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880136b1ca00/0x40a459093b06b2fe lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1409024->1839103) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21dad expref: 34 pid: 8410 timeout: 934 lvb_type: 0 00010000:00010000:1.0:1746129578.804450:0:31522:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880136b1ca00/0x40a459093b06b2fe lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1409024->1839103) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21dad expref: 34 pid: 8410 timeout: 934 lvb_type: 0 00002000:00010000:1.0:1746129578.804456:0:31522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880095625180 00000100:00100000:1.0:1746129578.804486:0:31522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2497 00000100:00100000:1.0:1746129578.804492:0:31522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095625180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+34:1960:x1830948734350464:12345-192.168.202.4@tcp:4:multiop.0 00000100:00100000:2.0:1746129578.809496:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129578.809557:0:31503:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734350592 00000100:00100000:0.0:1746129578.809567:0:31503:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734350592 00000100:00100000:0.0:1746129578.809613:0:31503:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16668 00000100:00100000:0.0:1746129578.809620:0:31503:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c078a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:32574:x1830948734350592:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129578.809640:0:31503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129578.809657:0:31503:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091799800/0x40a459093b06b367 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21e16 expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129578.809685:0:31503:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880132fc3000/0x40a459093b06b30c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4456447) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21dbb expref: 29 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129578.809693:0:31503:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129578.809694:0:31503:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129578.809698:0:31503:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091799800/0x40a459093b06b367 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21e16 expref: 21 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129578.809728:0:31503:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880132fc3000/0x40a459093b06b30c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4456447) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21dbb expref: 29 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129578.809741:0:31503:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880132fc3000/0x40a459093b06b30c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4456447) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21dbb expref: 29 pid: 8410 timeout: 934 lvb_type: 0 00000100:00100000:0.0:1746129578.809757:0:31503:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095625f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:31503:1830948737595904:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129578.809850:0:31503:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009cdf33c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746129578.815187:0:31503:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095625f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:31503:1830948737595904:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129578.815205:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00010000:00010000:2.0:1746129578.815227:0:31503:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091799800/0x40a459093b06b367 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21e16 expref: 21 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129578.815727:0:31503:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091799800, rc 0) 00000100:00100000:2.0:1746129578.815786:0:31503:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c078a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:32574:x1830948734350592:12345-192.168.202.4@tcp:101:cat.0 Request processed in 6165us (6299us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129578.815795:0:31503:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16668 00000100:00100000:3.0:1746129578.815897:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734350720 00000100:00100000:3.0:1746129578.815903:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734350720 00002000:00100000:3.0:1746129578.815938:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ef:0x0] (4194304->4456447) req@ffff8800915d0000 x1830948734350720/t0(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:319/0 lens 488/0 e 0 to 0 dl 1746129589 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129578.815948:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800915d0000 with x1830948734350720 ext(4194304->4456447) 00010000:00010000:3.0:1746129578.815955:0:25745:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880132fc3000/0x40a459093b06b30c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4456447) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21dbb expref: 30 pid: 8410 timeout: 934 lvb_type: 0 00010000:00010000:3.0:1746129578.815964:0:25745:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880132fc3000/0x40a459093b06b30c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4456447) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21dbb expref: 30 pid: 8410 timeout: 934 lvb_type: 0 00002000:00010000:3.0:1746129578.815970:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800915d0000 00000100:00100000:3.0:1746129578.815985:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2498 00000100:00100000:3.0:1746129578.815992:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800915d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+30:1963:x1830948734350720:12345-192.168.202.4@tcp:4:cat.0 00000100:00100000:0.0:1746129578.818682:0:31522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095625180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+36:1960:x1830948734350464:12345-192.168.202.4@tcp:4:multiop.0 Request processed in 14179us (14429us total) trans 17179874169 rc 0/0 00000100:00100000:0.0:1746129578.818693:0:31522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2497 00002000:00100000:0.0:1746129578.818703:0:31522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f4:0x0] (1409024->1839103) req@ffff880095625180 x1830948734350464/t17179874169(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:319/0 lens 488/448 e 0 to 0 dl 1746129589 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129578.818713:0:31522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095625180 with x1830948734350464 ext(1409024->1839103) 00010000:00010000:0.0:1746129578.818721:0:31522:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880136b1ca00/0x40a459093b06b2fe lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1409024->1839103) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21dad expref: 36 pid: 8410 timeout: 934 lvb_type: 0 00010000:00010000:0.0:1746129578.818733:0:31522:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880136b1ca00/0x40a459093b06b2fe lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1409024->1839103) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21dad expref: 36 pid: 8410 timeout: 934 lvb_type: 0 00002000:00010000:0.0:1746129578.818739:0:31522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880095625180 00000100:00100000:3.0:1746129578.822896:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800915d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+32:1963:x1830948734350720:12345-192.168.202.4@tcp:4:cat.0 Request processed in 6892us (7679us total) trans 21474841412 rc 0/0 00000100:00100000:3.0:1746129578.822911:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2498 00002000:00100000:3.0:1746129578.822924:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ef:0x0] (4194304->4456447) req@ffff8800915d0000 x1830948734350720/t21474841412(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:319/0 lens 488/448 e 0 to 0 dl 1746129589 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129578.822934:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800915d0000 with x1830948734350720 ext(4194304->4456447) 00010000:00010000:3.0:1746129578.822945:0:25745:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880132fc3000/0x40a459093b06b30c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4456447) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21dbb expref: 32 pid: 8410 timeout: 934 lvb_type: 0 00010000:00010000:3.0:1746129578.822957:0:25745:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880132fc3000/0x40a459093b06b30c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4456447) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21dbb expref: 32 pid: 8410 timeout: 934 lvb_type: 0 00002000:00010000:3.0:1746129578.822965:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800915d0000 00000100:00100000:3.0:1746129578.823037:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129578.823594:0:20578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734350848 00000100:00100000:3.0:1746129578.823602:0:20578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734350848 00010000:00010000:3.0:1746129578.823629:0:20578:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880136b1ca00/0x40a459093b06b2fe lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1409024->1839103) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21dad expref: 36 pid: 8410 timeout: 934 lvb_type: 0 00000100:00100000:3.0:1746129578.823655:0:20578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8607 00000100:00100000:3.0:1746129578.823662:0:20578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+36:1963:x1830948734350848:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129578.823675:0:20578:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129578.823694:0:20578:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880136b1ca00/0x40a459093b06b2fe lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1409024->1839103) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21dad expref: 36 pid: 8410 timeout: 934 lvb_type: 0 00010000:00010000:3.0:1746129578.823708:0:20578:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880136b1ca00/0x40a459093b06b2fe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1409024->1839103) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21dad expref: 36 pid: 8410 timeout: 934 lvb_type: 0 00010000:00010000:3.0:1746129578.823731:0:20578:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136b1ca00/0x40a459093b06b2fe lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1409024->1839103) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21dad expref: 36 pid: 8410 timeout: 934 lvb_type: 0 00010000:00010000:3.0:1746129578.823749:0:20578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129578.823752:0:20578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129578.823759:0:20578:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091799000/0x40a459093b06b360 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21e0f expref: 40 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129578.823767:0:20578:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091799000/0x40a459093b06b360 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21e0f expref: 40 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129578.823800:0:20578:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091799000/0x40a459093b06b360 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21e0f expref: 40 pid: 31503 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129578.823812:0:20578:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:20578:1830948737596032:192.168.202.4@tcp:105: 00000100:00100000:3.0:1746129578.823868:0:20578:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa381f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746129578.828936:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129578.828966:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129578.829013:0:20578:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:20578:1830948737596032:192.168.202.4@tcp:105: 00010000:00010000:3.0:1746129578.829032:0:20578:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129578.829077:0:20578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+35:1963:x1830948734350848:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 5415us (6039us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129578.829092:0:20578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8607 00000100:00100000:3.0:1746129578.829119:0:20578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734350976 00000100:00100000:3.0:1746129578.829125:0:20578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734350976 00010000:00010000:3.0:1746129578.829154:0:20578:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880132fc3000/0x40a459093b06b30c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4456447) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21dbb expref: 32 pid: 8410 timeout: 934 lvb_type: 0 00000100:00100000:3.0:1746129578.829176:0:20578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8608 00000100:00100000:3.0:1746129578.829182:0:20578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947bf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ada2ffba-8920-4ecb-8068-68caa9806978+32:1963:x1830948734350976:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129578.829193:0:20578:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129578.829217:0:20578:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880132fc3000/0x40a459093b06b30c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4456447) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21dbb expref: 32 pid: 8410 timeout: 934 lvb_type: 0 00010000:00010000:3.0:1746129578.829228:0:20578:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880132fc3000/0x40a459093b06b30c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4456447) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21dbb expref: 32 pid: 8410 timeout: 934 lvb_type: 0 00010000:00010000:3.0:1746129578.829262:0:20578:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880132fc3000/0x40a459093b06b30c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4456447) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21dbb expref: 32 pid: 8410 timeout: 934 lvb_type: 0 00010000:00010000:3.0:1746129578.829307:0:20578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129578.829309:0:20578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129578.829316:0:20578:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091799800/0x40a459093b06b367 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21e16 expref: 20 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129578.829324:0:20578:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091799800/0x40a459093b06b367 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21e16 expref: 20 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129578.829351:0:20578:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091799800/0x40a459093b06b367 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21e16 expref: 20 pid: 31503 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129578.829364:0:20578:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:20578:1830948737596160:192.168.202.4@tcp:105: 00000100:00100000:3.0:1746129578.829408:0:20578:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa381f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746129578.829421:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734351232 00000100:00100000:3.0:1746129578.829424:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734351232 00002000:00100000:3.0:1746129578.829449:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f4:0x0] (1048576->2097151) req@ffff8800947be300 x1830948734351232/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:319/0 lens 488/0 e 0 to 0 dl 1746129589 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129578.829458:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800947be300 with x1830948734351232 ext(1048576->2097151) 00002000:00010000:3.0:1746129578.829462:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800947be300 00000100:00100000:3.0:1746129578.829732:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8080 00000100:00100000:3.0:1746129578.829738:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+41:1961:x1830948734351232:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:3.0:1746129578.831976:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129578.832072:0:31522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734351488 00000100:00100000:0.0:1746129578.832081:0:31522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734351488 00002000:00100000:0.0:1746129578.832122:0:31522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3ee:0x0] (1048576->2097151) req@ffff8800947bca80 x1830948734351488/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:319/0 lens 488/0 e 0 to 0 dl 1746129589 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129578.832133:0:31522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800947bca80 with x1830948734351488 ext(1048576->2097151) 00002000:00010000:0.0:1746129578.832139:0:31522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800947bca80 00000100:00100000:0.0:1746129578.832162:0:31522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8081 00000100:00100000:0.0:1746129578.832169:0:31522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ada2ffba-8920-4ecb-8068-68caa9806978+32:1961:x1830948734351488:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:2.0:1746129578.845565:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+41:1961:x1830948734351232:12345-192.168.202.4@tcp:3:cat.0 Request processed in 15816us (16586us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129578.845577:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8080 00002000:00100000:2.0:1746129578.845591:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f4:0x0] (1048576->2097151) req@ffff8800947be300 x1830948734351232/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:319/0 lens 488/440 e 0 to 0 dl 1746129589 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129578.845601:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800947be300 with x1830948734351232 ext(1048576->2097151) 00002000:00010000:2.0:1746129578.845607:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800947be300 00000100:00100000:3.0:1746129578.846063:0:20578:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:20578:1830948737596160:192.168.202.4@tcp:105: 00010000:00010000:3.0:1746129578.846084:0:20578:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129578.846121:0:20578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947bf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ada2ffba-8920-4ecb-8068-68caa9806978+33:1963:x1830948734350976:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 16939us (17194us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129578.846130:0:20578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8608 00000100:00100000:0.0:1746129578.850091:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129578.850116:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129578.850131:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129578.851277:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129578.851660:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734351744 00000100:00100000:2.0:1746129578.851670:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734351744 00002000:00100000:2.0:1746129578.851714:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ef:0x0] (2097152->3145727) req@ffff880095626d80 x1830948734351744/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:319/0 lens 488/0 e 0 to 0 dl 1746129589 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129578.851725:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095626d80 with x1830948734351744 ext(2097152->3145727) 00002000:00010000:2.0:1746129578.851730:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095626d80 00000100:00100000:2.0:1746129578.851743:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734351872 00000100:00100000:2.0:1746129578.851745:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734351872 00002000:00100000:2.0:1746129578.851753:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->4194303) req@ffff880095626680 x1830948734351872/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:319/0 lens 488/0 e 0 to 0 dl 1746129589 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129578.851764:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095626680 with x1830948734351872 ext(3145728->4194303) 00002000:00010000:2.0:1746129578.851766:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095626680 00000100:00100000:2.0:1746129578.851772:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734352256 00000100:00100000:2.0:1746129578.851774:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734352256 00002000:00100000:2.0:1746129578.851784:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f5:0x0] (2097152->3563519) req@ffff880095627100 x1830948734352256/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:319/0 lens 504/0 e 0 to 0 dl 1746129589 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129578.851789:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095627100 with x1830948734352256 ext(2097152->3563519) 00002000:00010000:2.0:1746129578.851791:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095627100 00000100:00100000:2.0:1746129578.851797:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734352384 00000100:00100000:2.0:1746129578.851798:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734352384 00002000:00100000:2.0:1746129578.851804:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f5:0x0] (3563520->4194303) req@ffff880095624700 x1830948734352384/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:319/0 lens 488/0 e 0 to 0 dl 1746129589 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129578.851809:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095624700 with x1830948734352384 ext(3563520->4194303) 00002000:00010000:2.0:1746129578.851811:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095624700 00000100:00100000:2.0:1746129578.851820:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8082 00000100:00100000:2.0:1746129578.851826:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095626d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+22:1962:x1830948734351744:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129578.852727:0:31521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8083 00000100:00100000:0.0:1746129578.852737:0:31521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095626680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+22:1963:x1830948734351872:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:2.0:1746129578.853341:0:31519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8084 00000100:00100000:2.0:1746129578.853349:0:31519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095627100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+36:1963:x1830948734352256:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129578.853889:0:21725:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8085 00000100:00100000:0.0:1746129578.853896:0:21725:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095624700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+36:1962:x1830948734352384:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:1.0:1746129578.856169:0:31522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ada2ffba-8920-4ecb-8068-68caa9806978+31:1961:x1830948734351488:12345-192.168.202.4@tcp:3:cat.0 Request processed in 23990us (24191us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129578.856181:0:31522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8081 00002000:00100000:1.0:1746129578.856192:0:31522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3ee:0x0] (1048576->2097151) req@ffff8800947bca80 x1830948734351488/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:319/0 lens 488/440 e 0 to 0 dl 1746129589 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129578.856202:0:31522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800947bca80 with x1830948734351488 ext(1048576->2097151) 00002000:00010000:1.0:1746129578.856208:0:31522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800947bca80 00000100:00100000:2.0:1746129578.870745:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095626d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+23:1962:x1830948734351744:12345-192.168.202.4@tcp:3:cat.0 Request processed in 18907us (20652us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129578.870757:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8082 00002000:00100000:2.0:1746129578.870769:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ef:0x0] (2097152->3145727) req@ffff880095626d80 x1830948734351744/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:319/0 lens 488/440 e 0 to 0 dl 1746129589 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129578.870784:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095626d80 with x1830948734351744 ext(2097152->3145727) 00002000:00010000:2.0:1746129578.870790:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095626d80 00000001:00080000:1.0:1746129578.874660:0:14619:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945437 is committed 00000001:00080000:1.0:1746129578.874685:0:14619:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945430 is committed 00000001:00080000:1.0:1746129578.874698:0:14619:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945394 is committed 00000001:00080000:1.0:1746129578.874726:0:14619:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945438 is committed 00000001:00080000:1.0:1746129578.874764:0:14619:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945440 is committed 00000001:00080000:1.0:1746129578.874828:0:14619:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945441 is committed 00000001:00080000:1.0:1746129578.874832:0:14619:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945439 is committed 00000100:00100000:1.0:1746129578.874919:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129578.874956:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129578.874965:0:31503:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734352768 00000100:00100000:2.0:1746129578.874974:0:31503:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734352768 00000100:00100000:2.0:1746129578.875015:0:31503:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734352640 00000100:00100000:2.0:1746129578.875016:0:31503:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734352640 00000100:00100000:2.0:1746129578.875032:0:31503:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16669 00000100:00100000:2.0:1746129578.875038:0:31503:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800915d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ada2ffba-8920-4ecb-8068-68caa9806978+41:1963:x1830948734352768:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129578.875054:0:31503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129578.875081:0:31503:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095014000/0x40a459093b06b36e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21e24 expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129578.875133:0:31503:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c07aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:31503:1830948737596288:192.168.202.4@tcp:106: 00000100:00100000:2.0:1746129578.875203:0:31503:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132f360c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746129578.875219:0:20577:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16670 00000100:00100000:2.0:1746129578.875224:0:20577:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800915d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ada2ffba-8920-4ecb-8068-68caa9806978+31:1963:x1830948734352640:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129578.875231:0:20577:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129578.875240:0:20577:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095014600/0x40a459093b06b375 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21e1d expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129578.875263:0:20577:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129578.875265:0:20577:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746129578.875269:0:31521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095626680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:1963:x1830948734351872:12345-192.168.202.4@tcp:3:cat.0 Request processed in 22534us (25151us total) trans 0 rc 1048576/1048576 00010000:00010000:2.0:1746129578.875274:0:20577:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095014600/0x40a459093b06b375 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21e1d expref: 32 pid: 20577 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746129578.875277:0:31521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8083 00002000:00100000:1.0:1746129578.875286:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->4194303) req@ffff880095626680 x1830948734351872/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:319/0 lens 488/440 e 0 to 0 dl 1746129589 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00010000:00010000:2.0:1746129578.875287:0:20577:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095014600/0x40a459093b06b375 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21e1d expref: 32 pid: 20577 timeout: 0 lvb_type: 1 00002000:00100000:1.0:1746129578.875313:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095626680 with x1830948734351872 ext(3145728->4194303) 00010000:00010000:2.0:1746129578.875314:0:20577:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095014600, rc 0) 00002000:00010000:1.0:1746129578.875316:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095626680 00000100:00100000:2.0:1746129578.875328:0:20577:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800915d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ada2ffba-8920-4ecb-8068-68caa9806978+32:1963:x1830948734352640:12345-192.168.202.4@tcp:101:cat.0 Request processed in 104us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129578.875333:0:20577:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16670 00000100:00100000:0.0:1746129578.879388:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129578.879423:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129578.879465:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129578.879784:0:15096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734353024 00000100:00100000:3.0:1746129578.879793:0:15096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734353024 00000100:00100000:3.0:1746129578.879840:0:15096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734353280 00000100:00100000:3.0:1746129578.879842:0:15096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734353280 00000100:00100000:0.0:1746129578.879893:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129578.880259:0:14545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734352896 00000100:00100000:1.0:1746129578.880265:0:14545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734352896 00000100:00100000:1.0:1746129578.880312:0:14545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 221 00000100:00100000:1.0:1746129578.880321:0:14545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098ecd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8b5f81a-2f18-4d7f-accf-308742f5a04f+15:1963:x1830948734352896:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:1.0:1746129578.880384:0:14545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098ecd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8b5f81a-2f18-4d7f-accf-308742f5a04f+15:1963:x1830948734352896:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 65us (917us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129578.880389:0:14545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 221 00000100:00100000:3.0:1746129578.880955:0:15096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734353152 00000100:00100000:3.0:1746129578.880960:0:15096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734353152 00000100:00100000:3.0:1746129578.880984:0:15096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 203 00000100:00100000:3.0:1746129578.880990:0:15096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095625c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ada2ffba-8920-4ecb-8068-68caa9806978+293:1963:x1830948734353024:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:0.0:1746129578.880991:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129578.881051:0:14547:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 204 00000100:00100000:2.0:1746129578.881064:0:14547:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095627800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:068dab75-d300-4ead-a742-d14572ad1e50+8:1963:x1830948734353280:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:1.0:1746129578.881070:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 205 00000100:00100000:1.0:1746129578.881077:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095625f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+10:1963:x1830948734353152:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:3.0:1746129578.881156:0:15096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095625c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ada2ffba-8920-4ecb-8068-68caa9806978+293:1963:x1830948734353024:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 165us (1776us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129578.881156:0:14547:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095627800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:068dab75-d300-4ead-a742-d14572ad1e50+8:1963:x1830948734353280:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 96us (1731us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129578.881161:0:14547:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 204 00000100:00100000:1.0:1746129578.881183:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095625f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+10:1963:x1830948734353152:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 107us (1289us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129578.881390:0:15096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 203 00000100:00100000:3.0:1746129578.881413:0:8412:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734353408 00000100:00100000:3.0:1746129578.881416:0:8412:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734353408 00000100:00100000:3.0:1746129578.881447:0:8412:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 344 00000100:00100000:3.0:1746129578.881452:0:8412:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095626a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:068dab75-d300-4ead-a742-d14572ad1e50+6:1963:x1830948734353408:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:3.0:1746129578.881478:0:8412:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095626a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:068dab75-d300-4ead-a742-d14572ad1e50+6:1963:x1830948734353408:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 26us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129578.881483:0:8412:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 344 00000100:00100000:1.0:1746129578.882646:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 205 00000100:00100000:3.0:1746129578.885307:0:31503:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c07aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:31503:1830948737596288:192.168.202.4@tcp:106: 00010000:00010000:3.0:1746129578.885350:0:31503:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095014000/0x40a459093b06b36e lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21e24 expref: 42 pid: 31503 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129578.885365:0:31503:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095014000/0x40a459093b06b36e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21e24 expref: 42 pid: 31503 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129578.885376:0:31503:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095014000, rc 0) 00000100:00100000:1.0:1746129578.885430:0:21725:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095624700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+37:1962:x1830948734352384:12345-192.168.202.4@tcp:3:cat.0 Request processed in 31532us (34157us total) trans 0 rc 630784/630784 00000100:00100000:1.0:1746129578.885441:0:21725:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8085 00002000:00100000:1.0:1746129578.885452:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f5:0x0] (3563520->4194303) req@ffff880095624700 x1830948734352384/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:319/0 lens 488/440 e 0 to 0 dl 1746129589 ref 1 fl Complete:/200/0 rc 630784/630784 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129578.885461:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095624700 with x1830948734352384 ext(3563520->4194303) 00002000:00010000:1.0:1746129578.885466:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095624700 00000100:00100000:3.0:1746129578.885814:0:31503:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800915d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ada2ffba-8920-4ecb-8068-68caa9806978+41:1963:x1830948734352768:12345-192.168.202.4@tcp:101:cat.0 Request processed in 10771us (10895us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129578.885822:0:31503:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16669 00000100:00100000:2.0:1746129578.886672:0:31519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095627100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+35:1963:x1830948734352256:12345-192.168.202.4@tcp:3:cat.0 Request processed in 33320us (36534us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129578.886680:0:31519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8084 00002000:00100000:2.0:1746129578.886688:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f5:0x0] (2097152->3563519) req@ffff880095627100 x1830948734352256/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:319/0 lens 504/440 e 0 to 0 dl 1746129589 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129578.886697:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095627100 with x1830948734352256 ext(2097152->3563519) 00002000:00010000:2.0:1746129578.886701:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095627100 00000100:00100000:0.0:1746129578.895727:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129578.895788:0:31519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734353664 00000100:00100000:2.0:1746129578.895797:0:31519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734353664 00002000:00100000:2.0:1746129578.895845:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3ef:0x0] (2097152->3145727) req@ffff880095624380 x1830948734353664/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:319/0 lens 488/0 e 0 to 0 dl 1746129589 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129578.895855:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095624380 with x1830948734353664 ext(2097152->3145727) 00002000:00010000:2.0:1746129578.895861:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095624380 00000100:00100000:2.0:1746129578.895893:0:31519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8086 00000100:00100000:2.0:1746129578.895901:0:31519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095624380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ada2ffba-8920-4ecb-8068-68caa9806978+32:1961:x1830948734353664:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129578.908491:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129578.908564:0:31503:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734353792 00000100:00100000:3.0:1746129578.908575:0:31503:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734353792 00000100:00100000:3.0:1746129578.908627:0:31503:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16671 00000100:00100000:3.0:1746129578.908634:0:31503:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f326680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+35:1963:x1830948734353792:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129578.908653:0:31503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129578.908670:0:31503:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090a19000/0x40a459093b06b37c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21e2b expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129578.908691:0:31503:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129578.908693:0:31503:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129578.908700:0:31503:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090a19000/0x40a459093b06b37c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21e2b expref: 36 pid: 31503 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129578.908787:0:31503:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090a19000/0x40a459093b06b37c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21e2b expref: 36 pid: 31503 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129578.908797:0:31503:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090a19000, rc 0) 00000100:00100000:3.0:1746129578.908851:0:31503:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f326680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+36:1963:x1830948734353792:12345-192.168.202.4@tcp:101:cat.0 Request processed in 218us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129578.908858:0:31503:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16671 00000100:00100000:2.0:1746129578.912929:0:31519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095624380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ada2ffba-8920-4ecb-8068-68caa9806978+32:1961:x1830948734353664:12345-192.168.202.4@tcp:3:cat.0 Request processed in 17015us (17200us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129578.912942:0:31519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8086 00002000:00100000:2.0:1746129578.912954:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3ef:0x0] (2097152->3145727) req@ffff880095624380 x1830948734353664/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:319/0 lens 488/440 e 0 to 0 dl 1746129589 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129578.912964:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095624380 with x1830948734353664 ext(2097152->3145727) 00002000:00010000:2.0:1746129578.912970:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095624380 00000100:00100000:0.0:1746129578.919167:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129578.920184:0:31519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734354048 00000100:00100000:2.0:1746129578.920198:0:31519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734354048 00002000:00100000:2.0:1746129578.920269:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3ef:0x0] (4194304->5148671) req@ffff88009f327100 x1830948734354048/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:319/0 lens 488/0 e 0 to 0 dl 1746129589 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129578.920281:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f327100 with x1830948734354048 ext(4194304->5148671) 00002000:00010000:2.0:1746129578.920287:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f327100 00000100:00100000:2.0:1746129578.925340:0:31519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8087 00000100:00100000:2.0:1746129578.925366:0:31519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f327100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:1963:x1830948734354048:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129578.936076:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129578.938648:0:31519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f327100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:1963:x1830948734354048:12345-192.168.202.4@tcp:3:cat.0 Request processed in 13283us (19480us total) trans 0 rc 954368/954368 00000100:00100000:2.0:1746129578.938660:0:31519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8087 00002000:00100000:2.0:1746129578.938673:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3ef:0x0] (4194304->5148671) req@ffff88009f327100 x1830948734354048/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:319/0 lens 488/440 e 0 to 0 dl 1746129589 ref 1 fl Complete:/200/0 rc 954368/954368 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129578.938682:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f327100 with x1830948734354048 ext(4194304->5148671) 00002000:00010000:2.0:1746129578.938689:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f327100 00000100:00100000:1.0:1746129578.939271:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734354176 00000100:00100000:1.0:1746129578.939281:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734354176 00000100:00100000:1.0:1746129578.939350:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11325 00000100:00100000:1.0:1746129578.939357:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f325c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:068dab75-d300-4ead-a742-d14572ad1e50+8:32583:x1830948734354176:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:1.0:1746129578.939374:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129578.939392:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b637600/0x40a459093b06b383 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21e32 expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129578.939454:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b636200/0x40a459093b06b38a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129578.939467:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b636200/0x40a459093b06b38a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129578.939478:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b636200/0x40a459093b06b38a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129578.939490:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b636000/0x40a459093b06b391 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129578.939495:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b636000/0x40a459093b06b391 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129578.939499:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b636000/0x40a459093b06b391 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129578.939608:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b636400/0x40a459093b06b398 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129578.939619:0:14549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a062c800/0x40a459093b06b280 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21d4b expref: 9 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129578.939626:0:14549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f119000/0x40a459093b06b2cd lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21d83 expref: 292 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129578.939632:0:14549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b636400/0x40a459093b06b398 lrc: 5/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129578.939663:0:14549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f119000/0x40a459093b06b2cd lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21d83 expref: 292 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129578.939674:0:14549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f119000/0x40a459093b06b2cd lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21d83 expref: 292 pid: 15096 timeout: 934 lvb_type: 0 00000100:00100000:1.0:1746129578.939690:0:14549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800915d1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830948737596416:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129578.940092:0:14549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a062c800/0x40a459093b06b280 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21d4b expref: 9 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129578.940102:0:14549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a062c800/0x40a459093b06b280 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21d4b expref: 9 pid: 15096 timeout: 934 lvb_type: 0 00000100:00100000:1.0:1746129578.940110:0:14549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800915d2300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830948737596544:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129578.940135:0:14549:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0acc00 going to sleep for 11 seconds 00000100:00100000:1.0:1746129578.946352:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129578.946455:0:8412:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734354304 00000100:00100000:0.0:1746129578.946464:0:8412:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734354304 00000100:00100000:0.0:1746129578.946525:0:8412:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16672 00000100:00100000:0.0:1746129578.946533:0:8412:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800915d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ada2ffba-8920-4ecb-8068-68caa9806978+41:32579:x1830948734354304:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129578.946551:0:8412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129578.946568:0:8412:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a65ff600/0x40a459093b06b39f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21e39 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129578.946601:0:8412:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fc59a00/0x40a459093b06b33d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2437120->2854911) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21dec expref: 35 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129578.946609:0:8412:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129578.946610:0:8412:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129578.946613:0:8412:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a65ff600/0x40a459093b06b39f lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21e39 expref: 42 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129578.946644:0:8412:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fc59a00/0x40a459093b06b33d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2437120->2854911) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21dec expref: 35 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129578.946655:0:8412:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fc59a00/0x40a459093b06b33d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2437120->2854911) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21dec expref: 35 pid: 8412 timeout: 934 lvb_type: 0 00000100:00100000:0.0:1746129578.946668:0:8412:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f327480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8412:1830948737596672:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129578.946748:0:8412:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa381d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746129578.947808:0:14549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800915d1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830948737596416:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129578.947821:0:14549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800915d2300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830948737596544:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129578.947849:0:14549:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012b636400/0x40a459093b06b398 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000100:00100000:0.0:1746129578.952993:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129578.953060:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129578.953149:0:20578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734354432 00000100:00100000:3.0:1746129578.953159:0:20578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734354432 00010000:00010000:3.0:1746129578.953200:0:20578:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f119000/0x40a459093b06b2cd lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21d83 expref: 293 pid: 15096 timeout: 934 lvb_type: 0 00000100:00100000:3.0:1746129578.953233:0:20578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8609 00000100:00100000:3.0:1746129578.953240:0:20578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f324700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ada2ffba-8920-4ecb-8068-68caa9806978+293:1962:x1830948734354432:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129578.953265:0:20578:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129578.953271:0:20578:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f119000/0x40a459093b06b2cd lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21d83 expref: 293 pid: 15096 timeout: 934 lvb_type: 0 00010000:00010000:3.0:1746129578.953288:0:20578:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f119000/0x40a459093b06b2cd lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21d83 expref: 293 pid: 15096 timeout: 934 lvb_type: 0 00010000:00010000:3.0:1746129578.953345:0:20578:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f119000/0x40a459093b06b2cd lrc: 0/0,0 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21d83 expref: 293 pid: 15096 timeout: 934 lvb_type: 0 00010000:00010000:3.0:1746129578.953371:0:20578:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:3.0:1746129578.953377:0:20578:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012b636400/0x40a459093b06b398 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129578.953388:0:20578:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012b636400/0x40a459093b06b398 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129578.953393:0:20578:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88012b636400/0x40a459093b06b398 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129578.953398:0:20578:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129578.953451:0:20578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f324700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ada2ffba-8920-4ecb-8068-68caa9806978+292:1962:x1830948734354432:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 211us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129578.953457:0:20578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8609 00000100:00100000:1.0:1746129578.953564:0:14551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734354688 00000100:00100000:1.0:1746129578.953568:0:14551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734354688 00000100:00100000:3.0:1746129578.954889:0:20861:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4825 00000100:00100000:0.0:1746129578.954954:0:20861:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094cc9050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+10:27693:x1830948734354688:12345-192.168.202.4@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746129578.957917:0:20861:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094cc9050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+11:27693:x1830948734354688:12345-192.168.202.4@tcp:35:ldlm_bl.0 Request processed in 3007us (4927us total) trans 8589945442 rc 0/0 00000100:00100000:1.0:1746129578.957929:0:20861:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4825 00000100:00100000:0.0:1746129578.959195:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129578.959289:0:8412:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f327480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8412:1830948737596672:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129578.959337:0:8412:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a65ff600/0x40a459093b06b39f lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21e39 expref: 42 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129578.959355:0:8412:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a65ff600, rc 0) 00000100:00100000:0.0:1746129578.959384:0:8412:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800915d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ada2ffba-8920-4ecb-8068-68caa9806978+42:32579:x1830948734354304:12345-192.168.202.4@tcp:101:cat.0 Request processed in 12852us (13090us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129578.959392:0:8412:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16672 00000100:00100000:1.0:1746129578.961395:0:2271:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734354944 00000100:00100000:1.0:1746129578.962023:0:2271:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734354944 00000100:00100000:1.0:1746129578.962237:0:2271:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11326 00000100:00100000:1.0:1746129578.962255:0:2271:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f326300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+11:32585:x1830948734354944:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:1.0:1746129578.962278:0:2271:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129578.962335:0:2271:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe40800/0x40a459093b06b3a6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21e40 expref: -99 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129578.962438:0:2271:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe40a00/0x40a459093b06b3ad lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 2271 initiator: MDT0 00010000:00010000:1.0:1746129578.962452:0:2271:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b636400/0x40a459093b06b398 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129578.962458:0:2271:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe40a00/0x40a459093b06b3ad lrc: 4/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:1.0:1746129578.962475:0:2271:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88012b636400/0x40a459093b06b398 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x40210400000020 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129578.962484:0:2271:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe40a00/0x40a459093b06b3ad lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00000100:00100000:0.0:1746129578.963710:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129578.964258:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129578.965522:0:31519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734355072 00000100:00100000:2.0:1746129578.965535:0:31519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734355072 00002000:00100000:2.0:1746129578.965589:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f5:0x0] (2437120->2854911) req@ffff88009f327480 x1830948734355072/t0(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:319/0 lens 488/0 e 0 to 0 dl 1746129589 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129578.965600:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f327480 with x1830948734355072 ext(2437120->2854911) 00010000:00010000:2.0:1746129578.965611:0:31519:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fc59a00/0x40a459093b06b33d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2437120->2854911) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21dec expref: 36 pid: 8412 timeout: 934 lvb_type: 0 00010000:00010000:2.0:1746129578.965625:0:31519:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fc59a00/0x40a459093b06b33d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2437120->2854911) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21dec expref: 36 pid: 8412 timeout: 934 lvb_type: 0 00002000:00010000:2.0:1746129578.965632:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f327480 00000100:00100000:3.0:1746129578.965706:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734355200 00000100:00100000:3.0:1746129578.965711:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734355200 00010000:00010000:3.0:1746129578.965732:0:9823:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a062c800/0x40a459093b06b280 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21d4b expref: 13 pid: 15096 timeout: 934 lvb_type: 0 00000100:00100000:3.0:1746129578.965754:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8610 00000100:00100000:3.0:1746129578.965761:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bbcc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+13:1963:x1830948734355200:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129578.965779:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129578.965784:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a062c800/0x40a459093b06b280 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21d4b expref: 13 pid: 15096 timeout: 934 lvb_type: 0 00010000:00010000:3.0:1746129578.965794:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a062c800/0x40a459093b06b280 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21d4b expref: 13 pid: 15096 timeout: 934 lvb_type: 0 00010000:00010000:3.0:1746129578.965815:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a062c800/0x40a459093b06b280 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21d4b expref: 13 pid: 15096 timeout: 934 lvb_type: 0 00010000:00010000:3.0:1746129578.965843:0:9823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:3.0:1746129578.965849:0:9823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012b636400/0x40a459093b06b398 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x40210400000020 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129578.965860:0:9823:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b636400/0x40a459093b06b398 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 13 type: IBT flags: 0x40290400000020 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129578.965866:0:9823:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b636400/0x40a459093b06b398 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 13 type: IBT flags: 0x40290400000020 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129578.965872:0:9823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe40a00/0x40a459093b06b3ad lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129578.965877:0:9823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe40a00/0x40a459093b06b3ad lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00000100:00100000:2.0:1746129578.966264:0:31519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2499 00000100:00100000:2.0:1746129578.966273:0:31519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f327480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+36:1963:x1830948734355072:12345-192.168.202.4@tcp:4:cat.0 00010000:00010000:3.0:1746129578.967284:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746129578.967289:0:14549:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012b636400/0x40a459093b06b398 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40210400000020 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129578.967317:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b636400/0x40a459093b06b398 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40210400000020 pid: 14549 initiator: MDT0 00000100:00100000:3.0:1746129578.967335:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bbcc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+12:1963:x1830948734355200:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 1573us (3076us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129578.967342:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8610 00000004:00200000:1.0:1746129578.967361:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00000004:00200000:1.0:1746129578.967365:0:14549:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746129578.967381:0:14549:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012b636400/0x40a459093b06b398 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40210400000020 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129578.967393:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b636400/0x40a459093b06b398 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x50210400000020 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129578.967403:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b636200/0x40a459093b06b38a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129578.967409:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b636200/0x40a459093b06b38a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129578.967415:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b636200/0x40a459093b06b38a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129578.967420:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b636200 already unused, calling callback (ffffffffa136e690) 00010000:00010000:1.0:1746129578.967424:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b636200/0x40a459093b06b38a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129578.967430:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b636200/0x40a459093b06b38a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129578.967441:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880132ef8f00) 00010000:00010000:1.0:1746129578.967443:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129578.967447:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b636200/0x40a459093b06b38a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129578.967451:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b636200/0x40a459093b06b38a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129578.967472:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b636000/0x40a459093b06b391 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129578.967477:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b636000/0x40a459093b06b391 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129578.967481:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b636000/0x40a459093b06b391 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129578.967485:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b636000 already unused, calling callback (ffffffffa136e690) 00010000:00010000:1.0:1746129578.967487:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b636000/0x40a459093b06b391 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129578.967492:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b636000/0x40a459093b06b391 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129578.967502:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009cffef00) 00010000:00010000:1.0:1746129578.967504:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129578.967506:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b636000/0x40a459093b06b391 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129578.967510:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b636000/0x40a459093b06b391 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129578.967542:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b637600/0x40a459093b06b383 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21e32 expref: 10 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129578.967556:0:14549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b636400/0x40a459093b06b398 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21e32 expref: 9 pid: 14549 timeout: 934 lvb_type: 0 00010000:00010000:1.0:1746129578.967564:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b636400/0x40a459093b06b398 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21e32 expref: 9 pid: 14549 timeout: 934 lvb_type: 0 00010000:00010000:1.0:1746129578.967569:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b636400, rc 0) 00000100:00100000:1.0:1746129578.967593:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f325c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:068dab75-d300-4ead-a742-d14572ad1e50+9:32583:x1830948734354176:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 28237us (31529us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129578.967600:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11325 00000100:00100000:2.0:1746129578.974701:0:31519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f327480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+38:1963:x1830948734355072:12345-192.168.202.4@tcp:4:cat.0 Request processed in 8417us (10986us total) trans 17179874170 rc 0/0 00000100:00100000:2.0:1746129578.974716:0:31519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2499 00002000:00100000:2.0:1746129578.974729:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f5:0x0] (2437120->2854911) req@ffff88009f327480 x1830948734355072/t17179874170(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:319/0 lens 488/448 e 0 to 0 dl 1746129589 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129578.974739:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f327480 with x1830948734355072 ext(2437120->2854911) 00010000:00010000:2.0:1746129578.974752:0:31519:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fc59a00/0x40a459093b06b33d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2437120->2854911) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21dec expref: 38 pid: 8412 timeout: 934 lvb_type: 0 00010000:00010000:2.0:1746129578.974765:0:31519:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fc59a00/0x40a459093b06b33d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2437120->2854911) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21dec expref: 38 pid: 8412 timeout: 934 lvb_type: 0 00002000:00010000:2.0:1746129578.974778:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f327480 00000100:00100000:3.0:1746129578.975039:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129578.975346:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129578.975363:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129578.975377:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129578.975388:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129578.975408:0:8410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734355328 00000100:00100000:3.0:1746129578.975415:0:8410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734355328 00000100:00100000:3.0:1746129578.975447:0:8410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734355456 00000100:00100000:3.0:1746129578.975449:0:8410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734355456 00000100:00100000:3.0:1746129578.975458:0:8410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734355584 00000100:00100000:3.0:1746129578.975459:0:8410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734355584 00000100:00100000:3.0:1746129578.975470:0:8410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734355712 00000100:00100000:3.0:1746129578.975471:0:8410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734355712 00000100:00100000:3.0:1746129578.975481:0:8410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734355840 00000100:00100000:3.0:1746129578.975482:0:8410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734355840 00000100:00100000:3.0:1746129578.975493:0:8410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16673 00000100:00100000:3.0:1746129578.975499:0:8410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:068dab75-d300-4ead-a742-d14572ad1e50+7:1960:x1830948734355328:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:3.0:1746129578.975514:0:8410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129578.975529:0:8410:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090a19e00/0x40a459093b06b3b4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21e47 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129578.975550:0:8410:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129578.975552:0:8410:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129578.975561:0:8410:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090a19e00/0x40a459093b06b3b4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21e47 expref: 8 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129578.975576:0:8410:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090a19e00/0x40a459093b06b3b4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21e47 expref: 8 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129578.975588:0:8410:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090a19e00, rc 0) 00000100:00100000:3.0:1746129578.975616:0:8410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:068dab75-d300-4ead-a742-d14572ad1e50+8:1960:x1830948734355328:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 117us (579us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129578.975622:0:8410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16673 00000100:00100000:3.0:1746129578.975632:0:8410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16674 00000100:00100000:3.0:1746129578.975636:0:8410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:068dab75-d300-4ead-a742-d14572ad1e50+7:1960:x1830948734355456:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:3.0:1746129578.975642:0:8410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129578.975647:0:8410:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090a18800/0x40a459093b06b3bb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21e4e expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129578.975656:0:8410:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129578.975657:0:8410:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129578.975661:0:8410:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090a18800/0x40a459093b06b3bb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21e4e expref: 8 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129578.975668:0:8410:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090a18800/0x40a459093b06b3bb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21e4e expref: 8 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129578.975675:0:8410:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090a18800, rc 0) 00000100:00100000:3.0:1746129578.975687:0:8410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:068dab75-d300-4ead-a742-d14572ad1e50+8:1960:x1830948734355456:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 50us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129578.975691:0:8410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16674 00000100:00100000:3.0:1746129578.975697:0:8410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16675 00000100:00100000:3.0:1746129578.975701:0:8410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:068dab75-d300-4ead-a742-d14572ad1e50+7:1960:x1830948734355584:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:3.0:1746129578.975707:0:8410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129578.975715:0:8410:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090a18600/0x40a459093b06b3c2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21e55 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129578.976704:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129578.976736:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734355968 00000100:00100000:1.0:1746129578.976741:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734355968 00010000:00010000:1.0:1746129578.976768:0:9823:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b636400/0x40a459093b06b398 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21e32 expref: 9 pid: 14549 timeout: 934 lvb_type: 0 00000100:00100000:1.0:1746129578.976791:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8611 00000100:00100000:1.0:1746129578.976796:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800915d3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:068dab75-d300-4ead-a742-d14572ad1e50+9:1962:x1830948734355968:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129578.976808:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129578.976813:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012b636400/0x40a459093b06b398 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21e32 expref: 9 pid: 14549 timeout: 934 lvb_type: 0 00010000:00010000:1.0:1746129578.976822:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012b636400/0x40a459093b06b398 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21e32 expref: 9 pid: 14549 timeout: 934 lvb_type: 0 00010000:00010000:1.0:1746129578.976839:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b636400/0x40a459093b06b398 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21e32 expref: 9 pid: 14549 timeout: 934 lvb_type: 0 00010000:00010000:1.0:1746129578.976857:0:9823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:1.0:1746129578.976862:0:9823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe40a00/0x40a459093b06b3ad lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00010000:00010000:1.0:1746129578.976870:0:9823:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe40a00/0x40a459093b06b3ad lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 2271 initiator: MDT0 00010000:00010000:1.0:1746129578.976876:0:9823:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe40a00/0x40a459093b06b3ad lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 2271 initiator: MDT0 00010000:00010000:1.0:1746129578.976894:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129578.976919:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800915d3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:068dab75-d300-4ead-a742-d14572ad1e50+8:1962:x1830948734355968:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 123us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129578.976925:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8611 00010000:00010000:1.0:1746129578.976965:0:2271:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe40a00/0x40a459093b06b3ad lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00010000:00010000:1.0:1746129578.976972:0:2271:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe40a00/0x40a459093b06b3ad lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00000004:00200000:1.0:1746129578.976989:0:2271:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:1.0:1746129578.977134:0:2271:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe40800/0x40a459093b06b3a6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21e40 expref: 13 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129578.977145:0:2271:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe40a00/0x40a459093b06b3ad lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21e40 expref: 12 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129578.977150:0:2271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:1.0:1746129578.977153:0:2271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746129578.977155:0:2271:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe40a00, rc 0) 00000100:00100000:1.0:1746129578.977175:0:2271:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f326300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+12:32585:x1830948734354944:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 14922us (17987us total) trans 8589945443 rc 0/0 00000100:00100000:1.0:1746129578.977181:0:2271:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11326 00000100:00100000:0.0:1746129578.977635:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16676 00000100:00100000:0.0:1746129578.977646:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:068dab75-d300-4ead-a742-d14572ad1e50+7:1960:x1830948734355712:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:0.0:1746129578.977657:0:4385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129578.977669:0:4385:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a65fee00/0x40a459093b06b3d0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21e5c expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129578.977683:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129578.977685:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129578.977692:0:4385:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a65fee00/0x40a459093b06b3d0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21e5c expref: 8 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129578.977702:0:4385:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a65fee00/0x40a459093b06b3d0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21e5c expref: 8 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129578.977708:0:4385:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a65fee00, rc 0) 00000100:00100000:0.0:1746129578.977745:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:068dab75-d300-4ead-a742-d14572ad1e50+8:1960:x1830948734355712:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 103us (2367us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129578.977750:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16676 00000100:00100000:0.0:1746129578.977762:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16677 00000100:00100000:0.0:1746129578.977767:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:068dab75-d300-4ead-a742-d14572ad1e50+7:1960:x1830948734355840:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:0.0:1746129578.977773:0:4385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129578.977782:0:4385:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a65ff000/0x40a459093b06b3d7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21e63 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129578.977818:0:4385:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f324380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:4385:1830948737596800:192.168.202.4@tcp:106: 00000100:00100000:0.0:1746129578.977866:0:4385:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa381d80 going to sleep for 11 seconds 00010000:00010000:3.0:1746129578.978659:0:8410:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129578.978661:0:8410:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129578.978668:0:8410:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090a18600/0x40a459093b06b3c2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21e55 expref: 8 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129578.978681:0:8410:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090a18600/0x40a459093b06b3c2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21e55 expref: 8 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129578.978690:0:8410:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090a18600, rc 0) 00000100:00100000:3.0:1746129578.978718:0:8410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:068dab75-d300-4ead-a742-d14572ad1e50+8:1960:x1830948734355584:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 3015us (3353us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129578.978723:0:8410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16675 00000100:00100000:0.0:1746129578.983926:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129578.984012:0:20578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734356096 00000100:00100000:1.0:1746129578.984022:0:20578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734356096 00010000:00010000:1.0:1746129578.984064:0:20578:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fc59a00/0x40a459093b06b33d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2437120->2854911) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21dec expref: 38 pid: 8412 timeout: 934 lvb_type: 0 00000100:00100000:1.0:1746129578.984097:0:20578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8612 00010000:00010000:2.0:1746129578.984104:0:4385:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.202.4@tcp) returned -22 from glimpse AST (req@ffff88009f324380 x1830948737596800) - normal race ns: filter-lustre-OST0001_UUID lock: ffff88009fc59a00/0x40a459093b06b33d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2437120->2854911) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21dec expref: 38 pid: 8412 timeout: 934 lvb_type: 0 00000100:00100000:1.0:1746129578.984104:0:20578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f325180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+38:1961:x1830948734356096:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129578.984121:0:20578:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129578.984151:0:20578:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fc59a00/0x40a459093b06b33d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2437120->2854911) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21dec expref: 38 pid: 8412 timeout: 934 lvb_type: 0 00010000:00010000:1.0:1746129578.984162:0:20578:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fc59a00/0x40a459093b06b33d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2437120->2854911) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21dec expref: 38 pid: 8412 timeout: 934 lvb_type: 0 00010000:00010000:1.0:1746129578.984189:0:20578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129578.984192:0:20578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129578.984202:0:20578:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a65ff600/0x40a459093b06b39f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21e39 expref: 41 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129578.984210:0:20578:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a65ff600/0x40a459093b06b39f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21e39 expref: 41 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129578.984256:0:4385:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fc59a00/0x40a459093b06b33d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2437120->2854911) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21dec expref: 38 pid: 8412 timeout: 934 lvb_type: 0 00010000:00010000:1.0:1746129578.984256:0:20578:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a65ff600/0x40a459093b06b39f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21e39 expref: 41 pid: 8412 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129578.984268:0:20578:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800915d2300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:20578:1830948737596928:192.168.202.4@tcp:105: 00000100:00100000:2.0:1746129578.984323:0:4385:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f324380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:4385:1830948737596800:192.168.202.4@tcp:106: 00010000:00010000:2.0:1746129578.984348:0:4385:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a65ff000/0x40a459093b06b3d7 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21e63 expref: 8 pid: 4385 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746129578.984357:0:20578:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0acb40 going to sleep for 11 seconds 00010000:00010000:2.0:1746129578.984358:0:4385:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a65ff000/0x40a459093b06b3d7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21e63 expref: 8 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129578.984366:0:4385:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a65ff000, rc 0) 00000100:00100000:2.0:1746129578.984486:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:068dab75-d300-4ead-a742-d14572ad1e50+7:1960:x1830948734355840:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 6718us (9095us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129578.984494:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16677 00000100:00100000:1.0:1746129578.986690:0:20578:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800915d2300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:20578:1830948737596928:192.168.202.4@tcp:105: 00010000:00010000:1.0:1746129578.986714:0:20578:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129578.986766:0:20578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f325180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+37:1961:x1830948734356096:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 2661us (2850us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129578.986778:0:20578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8612 00000100:00100000:0.0:1746129578.989107:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129578.989189:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734356224 00000100:00100000:2.0:1746129578.989199:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734356224 00000100:00100000:0.0:1746129578.989236:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129578.989263:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16678 00000100:00100000:2.0:1746129578.989336:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f324e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+37:32585:x1830948734356224:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:2.0:1746129578.989356:0:4385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129578.989375:0:4385:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800909c1a00/0x40a459093b06b3de lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21e6a expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129578.989413:0:4385:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129861c00/0x40a459093b06b2bf lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21d7c expref: 41 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129578.989421:0:4385:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880090a19e00/0x40a459093b06b3b4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21e47 expref: 6 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129578.989428:0:4385:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fc59e00/0x40a459093b06b2e2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21d91 expref: 38 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129578.989434:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129578.989436:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129578.989439:0:4385:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800909c1a00/0x40a459093b06b3de lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [1916928->2097151] (req 1916928->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21e6a expref: 38 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129578.989470:0:4385:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fc59e00/0x40a459093b06b2e2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21d91 expref: 38 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129578.989481:0:4385:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fc59e00/0x40a459093b06b2e2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21d91 expref: 38 pid: 8410 timeout: 934 lvb_type: 1 00000100:00100000:2.0:1746129578.989834:0:4385:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c07ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:4385:1830948737597056:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129578.989911:0:4385:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880090a19e00/0x40a459093b06b3b4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21e47 expref: 6 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129578.989919:0:4385:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880090a19e00/0x40a459093b06b3b4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21e47 expref: 6 pid: 8410 timeout: 934 lvb_type: 1 00000100:00100000:2.0:1746129578.989927:0:4385:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c079880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:4385:1830948737597184:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129578.989945:0:4385:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129861c00/0x40a459093b06b2bf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21d7c expref: 41 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129578.989951:0:4385:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129861c00/0x40a459093b06b2bf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21d7c expref: 41 pid: 31503 timeout: 934 lvb_type: 0 00000100:00100000:2.0:1746129578.989958:0:4385:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c07a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:4385:1830948737597312:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129578.989969:0:4385:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132f360c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746129578.993537:0:2271:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734356480 00000100:00100000:1.0:1746129578.993552:0:2271:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734356480 00000100:00100000:1.0:1746129578.993620:0:2271:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11327 00000100:00100000:1.0:1746129578.993629:0:2271:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f324a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:068dab75-d300-4ead-a742-d14572ad1e50+8:32583:x1830948734356480:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:1.0:1746129578.993650:0:2271:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129578.993669:0:2271:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe41000/0x40a459093b06b3e5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21e71 expref: -99 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129578.993785:0:2271:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe41200/0x40a459093b06b3ec lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 2271 initiator: MDT0 00010000:00010000:1.0:1746129578.993800:0:2271:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe41200/0x40a459093b06b3ec lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:1.0:1746129578.993811:0:2271:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe41200/0x40a459093b06b3ec lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00010000:00010000:1.0:1746129578.993824:0:2271:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe41400/0x40a459093b06b3f3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 2271 initiator: MDT0 00010000:00010000:1.0:1746129578.993829:0:2271:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe41400/0x40a459093b06b3f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:1.0:1746129578.993833:0:2271:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe41400/0x40a459093b06b3f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00010000:00010000:1.0:1746129578.993939:0:2271:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe41600/0x40a459093b06b3fa lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 2271 initiator: MDT0 00010000:00010000:1.0:1746129578.993948:0:2271:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe41600/0x40a459093b06b3fa lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:1.0:1746129578.993954:0:2271:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe41600/0x40a459093b06b3fa lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00000004:00200000:1.0:1746129578.993962:0:2271:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:1.0:1746129578.994052:0:2271:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe41200/0x40a459093b06b3ec lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:1.0:1746129578.994058:0:2271:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe41200/0x40a459093b06b3ec lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 2271 initiator: MDT0 00010000:00010000:1.0:1746129578.994063:0:2271:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe41200/0x40a459093b06b3ec lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 2271 initiator: MDT0 00010000:00010000:1.0:1746129578.994069:0:2271:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fe41200 already unused, calling callback (ffffffffa136e690) 00010000:00010000:1.0:1746129578.994072:0:2271:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe41200/0x40a459093b06b3ec lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 2271 initiator: MDT0 00010000:00010000:1.0:1746129578.994079:0:2271:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe41200/0x40a459093b06b3ec lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 2271 initiator: MDT0 00010000:00010000:1.0:1746129578.994089:0:2271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880132ef8f00) 00010000:00010000:1.0:1746129578.994091:0:2271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129578.994095:0:2271:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe41200/0x40a459093b06b3ec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 2271 initiator: MDT0 00010000:00010000:1.0:1746129578.994100:0:2271:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe41200/0x40a459093b06b3ec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 2271 initiator: MDT0 00010000:00010000:1.0:1746129578.994116:0:2271:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe41400/0x40a459093b06b3f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:1.0:1746129578.994121:0:2271:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe41400/0x40a459093b06b3f3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 2271 initiator: MDT0 00010000:00010000:1.0:1746129578.994126:0:2271:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe41400/0x40a459093b06b3f3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 2271 initiator: MDT0 00010000:00010000:1.0:1746129578.994130:0:2271:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fe41400 already unused, calling callback (ffffffffa136e690) 00010000:00010000:1.0:1746129578.994132:0:2271:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe41400/0x40a459093b06b3f3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 2271 initiator: MDT0 00010000:00010000:1.0:1746129578.994136:0:2271:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe41400/0x40a459093b06b3f3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 2271 initiator: MDT0 00010000:00010000:1.0:1746129578.994141:0:2271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009cffe600) 00010000:00010000:1.0:1746129578.994142:0:2271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129578.994144:0:2271:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe41400/0x40a459093b06b3f3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 2271 initiator: MDT0 00010000:00010000:1.0:1746129578.994148:0:2271:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe41400/0x40a459093b06b3f3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 2271 initiator: MDT0 00010000:00010000:1.0:1746129578.994184:0:2271:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe41000/0x40a459093b06b3e5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21e71 expref: 11 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129578.994194:0:2271:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe41600/0x40a459093b06b3fa lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21e71 expref: 10 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129578.994201:0:2271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:1.0:1746129578.994202:0:2271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746129578.994205:0:2271:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe41600, rc 0) 00000100:00100000:1.0:1746129578.994280:0:2271:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f324a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:068dab75-d300-4ead-a742-d14572ad1e50+10:32583:x1830948734356480:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 652us (5046us total) trans 8589945444 rc 0/0 00000100:00100000:1.0:1746129578.994286:0:2271:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11327 00000100:00100000:0.0:1746129578.997632:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129578.997674:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129578.997692:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129578.997860:0:31519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734356736 00000100:00100000:2.0:1746129578.997869:0:31519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734356736 00002000:00100000:2.0:1746129578.997917:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f5:0x0] (2097152->3145727) req@ffff88009f325880 x1830948734356736/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:319/0 lens 488/0 e 0 to 0 dl 1746129589 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129578.997926:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f325880 with x1830948734356736 ext(2097152->3145727) 00002000:00010000:2.0:1746129578.997931:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f325880 00000100:00100000:2.0:1746129578.997954:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734356992 00000100:00100000:2.0:1746129578.997956:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734356992 00002000:00100000:2.0:1746129578.997967:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f5:0x0] (3145728->4194303) req@ffff88009f327800 x1830948734356992/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:319/0 lens 488/0 e 0 to 0 dl 1746129589 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129578.997973:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f327800 with x1830948734356992 ext(3145728->4194303) 00002000:00010000:2.0:1746129578.997976:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f327800 00000100:00100000:2.0:1746129578.997983:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734357248 00000100:00100000:2.0:1746129578.997985:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734357248 00002000:00100000:2.0:1746129578.997994:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->4194303) req@ffff88009f326d80 x1830948734357248/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:319/0 lens 488/0 e 0 to 0 dl 1746129589 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129578.998000:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f326d80 with x1830948734357248 ext(3145728->4194303) 00002000:00010000:2.0:1746129578.998003:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f326d80 00000100:00100000:2.0:1746129578.998014:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8088 00000100:00100000:2.0:1746129578.998020:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f325880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+43:1961:x1830948734356736:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:2.0:1746129578.999448:0:8416:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8089 00000100:00100000:2.0:1746129578.999461:0:8416:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f327800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ada2ffba-8920-4ecb-8068-68caa9806978+44:1961:x1830948734356992:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:2.0:1746129579.000689:0:31519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8090 00000100:00100000:2.0:1746129579.000702:0:31519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f326d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ada2ffba-8920-4ecb-8068-68caa9806978+32:1961:x1830948734357248:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129579.001465:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129579.003452:0:20578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734357376 00000100:00100000:1.0:1746129579.003467:0:20578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734357376 00000100:00100000:3.0:1746129579.003990:0:4385:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c07ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:4385:1830948737597056:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129579.004007:0:4385:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c079880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:4385:1830948737597184:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129579.004018:0:4385:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c07a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:4385:1830948737597312:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129579.004057:0:4385:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800909c1a00/0x40a459093b06b3de lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [1916928->2097151] (req 1916928->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21e6a expref: 38 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129579.004079:0:4385:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800909c1a00, rc 0) 00000100:00100000:3.0:1746129579.004149:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f324e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+38:32585:x1830948734356224:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 14876us (15051us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129579.004158:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16678 00010000:00010000:1.0:1746129579.004431:0:20578:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090a19e00/0x40a459093b06b3b4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21e47 expref: 7 pid: 8410 timeout: 934 lvb_type: 1 00000100:00100000:1.0:1746129579.004479:0:20578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8613 00000100:00100000:1.0:1746129579.004490:0:20578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f326a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:068dab75-d300-4ead-a742-d14572ad1e50+7:1960:x1830948734357376:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129579.004508:0:20578:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129579.004534:0:20578:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090a19e00/0x40a459093b06b3b4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21e47 expref: 7 pid: 8410 timeout: 934 lvb_type: 1 00010000:00010000:1.0:1746129579.004545:0:20578:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090a19e00/0x40a459093b06b3b4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21e47 expref: 7 pid: 8410 timeout: 934 lvb_type: 1 00010000:00010000:1.0:1746129579.004575:0:20578:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090a19e00/0x40a459093b06b3b4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21e47 expref: 7 pid: 8410 timeout: 934 lvb_type: 1 00010000:00010000:1.0:1746129579.004589:0:20578:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129579.004624:0:20578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f326a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:068dab75-d300-4ead-a742-d14572ad1e50+6:1960:x1830948734357376:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 136us (3164us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129579.004631:0:20578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8613 00000100:00080000:3.0:1746129579.004836:0:7097:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746129579.013748:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129579.014257:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129579.014284:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129579.014320:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129579.014593:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734357504 00000100:00100000:2.0:1746129579.014603:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734357504 00000100:00100000:2.0:1746129579.014645:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734357632 00000100:00100000:2.0:1746129579.014647:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734357632 00000100:00100000:2.0:1746129579.014661:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16679 00000100:00100000:2.0:1746129579.014667:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800915d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:068dab75-d300-4ead-a742-d14572ad1e50+7:1960:x1830948734357504:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:2.0:1746129579.014685:0:4385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129579.014704:0:4385:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800909c1e00/0x40a459093b06b408 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21e78 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129579.014726:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129579.014737:0:4385:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800909c1e00/0x40a459093b06b408 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21e78 expref: 8 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129579.014748:0:4385:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800909c1e00/0x40a459093b06b408 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21e78 expref: 8 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129579.014766:0:4385:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800909c1e00, rc 0) 00000100:00100000:2.0:1746129579.014811:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800915d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:068dab75-d300-4ead-a742-d14572ad1e50+7:1960:x1830948734357504:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 143us (1074us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129579.014819:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16679 00000100:00100000:2.0:1746129579.014834:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16680 00000100:00100000:2.0:1746129579.014839:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800915d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:068dab75-d300-4ead-a742-d14572ad1e50+6:1960:x1830948734357632:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:2.0:1746129579.014845:0:4385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129579.014852:0:4385:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800909c0200/0x40a459093b06b40f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21e7f expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129579.014862:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129579.014863:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129579.014871:0:4385:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800909c0200/0x40a459093b06b40f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21e7f expref: 7 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129579.014883:0:4385:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800909c0200/0x40a459093b06b40f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21e7f expref: 7 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129579.014892:0:4385:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800909c0200, rc 0) 00000100:00100000:2.0:1746129579.014908:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800915d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:068dab75-d300-4ead-a742-d14572ad1e50+7:1960:x1830948734357632:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 69us (652us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129579.014913:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16680 00000100:00100000:0.0:1746129579.014968:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734357760 00000100:00100000:0.0:1746129579.014971:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734357760 00000100:00100000:0.0:1746129579.014996:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734357888 00000100:00100000:0.0:1746129579.014998:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734357888 00010000:00010000:0.0:1746129579.015018:0:9823:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129861c00/0x40a459093b06b2bf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21d7c expref: 46 pid: 31503 timeout: 934 lvb_type: 0 00000100:00100000:0.0:1746129579.015033:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8614 00000100:00100000:0.0:1746129579.015038:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800915d0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ada2ffba-8920-4ecb-8068-68caa9806978+46:1961:x1830948734357888:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129579.015046:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129579.015068:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129861c00/0x40a459093b06b2bf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21d7c expref: 46 pid: 31503 timeout: 934 lvb_type: 0 00010000:00010000:0.0:1746129579.015076:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129861c00/0x40a459093b06b2bf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21d7c expref: 46 pid: 31503 timeout: 934 lvb_type: 0 00010000:00010000:0.0:1746129579.015095:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129861c00/0x40a459093b06b2bf lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21d7c expref: 46 pid: 31503 timeout: 934 lvb_type: 0 00010000:00010000:0.0:1746129579.015109:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129579.015124:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800915d0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ada2ffba-8920-4ecb-8068-68caa9806978+45:1961:x1830948734357888:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 87us (805us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129579.015129:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8614 00000100:00100000:0.0:1746129579.015147:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 803 00000100:00100000:0.0:1746129579.015152:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800915d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:068dab75-d300-4ead-a742-d14572ad1e50+10:1962:x1830948734357760:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129579.015160:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129579.015172:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe41600/0x40a459093b06b3fa lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21e71 expref: 10 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129579.015183:0:9823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:0.0:1746129579.015186:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129579.015199:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800915d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:068dab75-d300-4ead-a742-d14572ad1e50+9:1962:x1830948734357760:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 47us (914us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129579.015205:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 803 00000100:00100000:1.0:1746129579.015263:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129579.015362:0:20578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734358016 00000100:00100000:1.0:1746129579.015366:0:20578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734358016 00010000:00010000:1.0:1746129579.015381:0:20578:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fc59e00/0x40a459093b06b2e2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21d91 expref: 38 pid: 8410 timeout: 934 lvb_type: 1 00000100:00100000:1.0:1746129579.015397:0:20578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8615 00000100:00100000:1.0:1746129579.015401:0:20578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800915d0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+38:1963:x1830948734358016:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129579.015409:0:20578:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129579.015417:0:20578:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fc59e00/0x40a459093b06b2e2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21d91 expref: 38 pid: 8410 timeout: 934 lvb_type: 1 00010000:00010000:1.0:1746129579.015426:0:20578:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fc59e00/0x40a459093b06b2e2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21d91 expref: 38 pid: 8410 timeout: 934 lvb_type: 1 00010000:00010000:1.0:1746129579.015444:0:20578:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fc59e00/0x40a459093b06b2e2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21d91 expref: 38 pid: 8410 timeout: 934 lvb_type: 1 00010000:00010000:1.0:1746129579.015452:0:20578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129579.015453:0:20578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129579.015457:0:20578:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800909c1a00/0x40a459093b06b3de lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1916928->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21e6a expref: 37 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129579.015463:0:20578:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800909c1a00/0x40a459093b06b3de lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1916928->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21e6a expref: 37 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129579.015489:0:20578:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800909c1a00/0x40a459093b06b3de lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1916928->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21e6a expref: 37 pid: 4385 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129579.015500:0:20578:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800915d1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:20578:1830948737597440:192.168.202.4@tcp:105: 00000100:00100000:1.0:1746129579.015550:0:20578:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0acb40 going to sleep for 11 seconds 00000100:00080000:3.0:1746129579.016159:0:7097:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746129579.026930:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f325880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+43:1961:x1830948734356736:12345-192.168.202.4@tcp:3:cat.0 Request processed in 28895us (29919us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129579.026945:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8088 00002000:00100000:2.0:1746129579.026960:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f5:0x0] (2097152->3145727) req@ffff88009f325880 x1830948734356736/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:319/0 lens 488/440 e 0 to 0 dl 1746129589 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129579.026970:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f325880 with x1830948734356736 ext(2097152->3145727) 00002000:00010000:2.0:1746129579.026976:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f325880 00000100:00100000:0.0:1746129579.029433:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129579.029471:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129579.029832:0:8416:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f327800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ada2ffba-8920-4ecb-8068-68caa9806978+41:1961:x1830948734356992:12345-192.168.202.4@tcp:3:cat.0 Request processed in 30374us (32154us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129579.029843:0:8416:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8089 00002000:00100000:2.0:1746129579.029856:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3f5:0x0] (3145728->4194303) req@ffff88009f327800 x1830948734356992/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:319/0 lens 488/440 e 0 to 0 dl 1746129589 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129579.029864:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f327800 with x1830948734356992 ext(3145728->4194303) 00002000:00010000:2.0:1746129579.029871:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f327800 00000100:00100000:2.0:1746129579.029893:0:8416:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734358528 00000100:00100000:2.0:1746129579.029900:0:8416:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734358528 00002000:00100000:2.0:1746129579.029930:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3f3:0x0] (1916928->1921023) req@ffff88009f325f80 x1830948734358528/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:320/0 lens 488/0 e 0 to 0 dl 1746129590 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129579.029936:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f325f80 with x1830948734358528 ext(1916928->1921023) 00002000:00010000:2.0:1746129579.029939:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f325f80 00000100:00100000:2.0:1746129579.029954:0:8416:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8091 00000100:00100000:2.0:1746129579.029961:0:8416:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f325f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+38:1963:x1830948734358528:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:2.0:1746129579.030096:0:8416:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f325f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+38:1963:x1830948734358528:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 136us (624us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129579.030101:0:8416:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8091 00002000:00100000:2.0:1746129579.030105:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3f3:0x0] (1916928->1921023) req@ffff88009f325f80 x1830948734358528/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:320/0 lens 488/4536 e 0 to 0 dl 1746129590 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129579.030118:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f325f80 with x1830948734358528 ext(1916928->1921023) 00002000:00010000:2.0:1746129579.030120:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f325f80 00000100:00100000:1.0:1746129579.030280:0:20578:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800915d1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:20578:1830948737597440:192.168.202.4@tcp:105: 00010000:00010000:1.0:1746129579.030328:0:20578:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129579.030352:0:20578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800915d0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+37:1963:x1830948734358016:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 14949us (15088us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129579.030360:0:20578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8615 00000100:00100000:3.0:1746129579.030442:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734358272 00000100:00100000:3.0:1746129579.030447:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734358272 00000100:00100000:3.0:1746129579.030477:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11328 00000100:00100000:3.0:1746129579.030481:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f324000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:068dab75-d300-4ead-a742-d14572ad1e50+9:32583:x1830948734358272:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:3.0:1746129579.030497:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129579.030515:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc59400/0x40a459093b06b416 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21e86 expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129579.030604:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc58800/0x40a459093b06b41d lrc: 3/0,1 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129579.030619:0:14549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe40a00/0x40a459093b06b3ad lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21e40 expref: 11 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129579.030626:0:14549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc58800/0x40a459093b06b41d lrc: 4/0,1 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129579.030653:0:14549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe40a00/0x40a459093b06b3ad lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21e40 expref: 11 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129579.030664:0:14549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe40a00/0x40a459093b06b3ad lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21e40 expref: 11 pid: 2271 timeout: 934 lvb_type: 0 00000100:00100000:3.0:1746129579.030681:0:14549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947be680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830948737597568:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129579.030726:0:14549:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a6ce89c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129579.037931:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129579.038723:0:31519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f326d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ada2ffba-8920-4ecb-8068-68caa9806978+32:1961:x1830948734357248:12345-192.168.202.4@tcp:3:cat.0 Request processed in 38022us (41025us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129579.038735:0:31519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8090 00002000:00100000:2.0:1746129579.038747:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->4194303) req@ffff88009f326d80 x1830948734357248/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:319/0 lens 488/440 e 0 to 0 dl 1746129589 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129579.038756:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f326d80 with x1830948734357248 ext(3145728->4194303) 00002000:00010000:2.0:1746129579.038762:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f326d80 00000100:00100000:3.0:1746129579.039076:0:14549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947be680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830948737597568:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129579.039100:0:14549:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc58800/0x40a459093b06b41d lrc: 3/0,1 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000100:00100000:0.0:1746129579.039264:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129579.039350:0:20578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734358656 00000100:00100000:1.0:1746129579.039357:0:20578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734358656 00010000:00010000:1.0:1746129579.039386:0:20578:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe40a00/0x40a459093b06b3ad lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21e40 expref: 12 pid: 2271 timeout: 934 lvb_type: 0 00000100:00100000:1.0:1746129579.039411:0:20578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8616 00000100:00100000:1.0:1746129579.039418:0:20578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bbc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+12:1963:x1830948734358656:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129579.039430:0:20578:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129579.039434:0:20578:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe40a00/0x40a459093b06b3ad lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21e40 expref: 12 pid: 2271 timeout: 934 lvb_type: 0 00010000:00010000:1.0:1746129579.039444:0:20578:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe40a00/0x40a459093b06b3ad lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21e40 expref: 12 pid: 2271 timeout: 934 lvb_type: 0 00010000:00010000:1.0:1746129579.039464:0:20578:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe40a00/0x40a459093b06b3ad lrc: 0/0,0 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21e40 expref: 12 pid: 2271 timeout: 934 lvb_type: 0 00010000:00010000:1.0:1746129579.039480:0:20578:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:1.0:1746129579.039484:0:20578:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc58800/0x40a459093b06b41d lrc: 3/0,1 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129579.039493:0:20578:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc58800/0x40a459093b06b41d lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129579.039499:0:20578:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc58800/0x40a459093b06b41d lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129579.039515:0:20578:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129579.039536:0:20578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bbc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+11:1963:x1830948734358656:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 119us (1619us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129579.039541:0:20578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8616 00000100:00100000:3.0:1746129579.039658:0:8410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734358784 00000100:00100000:3.0:1746129579.039661:0:8410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734358784 00000100:00100000:3.0:1746129579.039683:0:8410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16681 00000100:00100000:3.0:1746129579.039687:0:8410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f327b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+37:32585:x1830948734358784:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:3.0:1746129579.039701:0:8410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129579.039713:0:8410:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fc59c00/0x40a459093b06b424 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21e8d expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129579.039745:0:8410:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091799000/0x40a459093b06b360 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21e0f expref: 40 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129579.039752:0:8410:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880090a18800/0x40a459093b06b3bb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21e4e expref: 6 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129579.039758:0:8410:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880090a19000/0x40a459093b06b37c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21e2b expref: 38 pid: 31503 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129579.039763:0:8410:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129579.039764:0:8410:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129579.039767:0:8410:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fc59c00/0x40a459093b06b424 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [1048576->1056767] (req 1048576->1056767) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21e8d expref: 38 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129579.039787:0:8410:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880090a19000/0x40a459093b06b37c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21e2b expref: 38 pid: 31503 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129579.039795:0:8410:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880090a19000/0x40a459093b06b37c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21e2b expref: 38 pid: 31503 timeout: 934 lvb_type: 1 00000100:00100000:3.0:1746129579.039804:0:8410:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947be680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8410:1830948737597696:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129579.039854:0:8410:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880090a18800/0x40a459093b06b3bb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21e4e expref: 6 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129579.039866:0:8410:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880090a18800/0x40a459093b06b3bb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21e4e expref: 6 pid: 8410 timeout: 934 lvb_type: 1 00000100:00100000:3.0:1746129579.039873:0:8410:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8410:1830948737597824:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129579.039894:0:8410:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091799000/0x40a459093b06b360 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21e0f expref: 40 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129579.039901:0:8410:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091799000/0x40a459093b06b360 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21e0f expref: 40 pid: 31503 timeout: 934 lvb_type: 0 00000100:00100000:3.0:1746129579.039907:0:8410:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8410:1830948737597952:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129579.039922:0:8410:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a6ce89c0 going to sleep for 11 seconds 00010000:00010000:2.0:1746129579.040393:0:14549:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc58800/0x40a459093b06b41d lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129579.040401:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc58800/0x40a459093b06b41d lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129579.040420:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc58800/0x40a459093b06b41d lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129579.040426:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc58800/0x40a459093b06b41d lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129579.040430:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc58800/0x40a459093b06b41d lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129579.040435:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fc58800 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746129579.040439:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc58800/0x40a459093b06b41d lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129579.040444:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc58800/0x40a459093b06b41d lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129579.040454:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:2.0:1746129579.040456:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746129579.040459:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc58800/0x40a459093b06b41d lrc: 2/0,0 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129579.040463:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc58800/0x40a459093b06b41d lrc: 0/0,0 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129579.040883:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc59400/0x40a459093b06b416 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x1/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21e86 expref: 10 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129579.040890:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc59400/0x40a459093b06b416 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x1/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21e86 expref: 10 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129579.040899:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fc59400, rc 0) 00000100:00100000:2.0:1746129579.040934:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f324000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:068dab75-d300-4ead-a742-d14572ad1e50+9:32583:x1830948734358272:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 10452us (11511us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129579.040941:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11328 00000100:00100000:2.0:1746129579.045115:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129579.045309:0:8411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734358912 00000100:00100000:3.0:1746129579.045319:0:8411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734358912 00000100:00100000:3.0:1746129579.045366:0:8411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16682 00000100:00100000:3.0:1746129579.045373:0:8411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c079180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ada2ffba-8920-4ecb-8068-68caa9806978+41:1960:x1830948734358912:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129579.045394:0:8411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129579.045412:0:8411:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fc58600/0x40a459093b06b42b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21e94 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129579.045472:0:8411:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8411:1830948737598080:192.168.202.4@tcp:106: 00000100:00100000:3.0:1746129579.045553:0:8411:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a6ce8a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746129579.045966:0:8410:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947be680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8410:1830948737597696:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129579.045976:0:8410:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8410:1830948737597824:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129579.045987:0:8410:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8410:1830948737597952:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129579.046013:0:8410:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fc59c00/0x40a459093b06b424 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [1048576->1056767] (req 1048576->1056767) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21e8d expref: 38 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129579.046026:0:8410:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fc59c00, rc 0) 00000100:00100000:0.0:1746129579.046053:0:8410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f327b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+38:32585:x1830948734358784:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 6365us (6789us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129579.046060:0:8410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16681 00000100:00100000:2.0:1746129579.046211:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129579.046270:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129579.046500:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129579.047006:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734359040 00000100:00100000:1.0:1746129579.047007:0:20578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734359168 00000100:00100000:1.0:1746129579.047012:0:20578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734359168 00000100:00100000:0.0:1746129579.047012:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734359040 00010000:00010000:1.0:1746129579.047036:0:20578:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090a18800/0x40a459093b06b3bb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21e4e expref: 7 pid: 8410 timeout: 934 lvb_type: 1 00010000:00010000:0.0:1746129579.047036:0:9823:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090a19000/0x40a459093b06b37c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21e2b expref: 38 pid: 31503 timeout: 934 lvb_type: 1 00000100:00100000:0.0:1746129579.047074:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8617 00000100:00100000:0.0:1746129579.047081:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c07b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+38:1963:x1830948734359040:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129579.047092:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129579.047115:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090a19000/0x40a459093b06b37c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21e2b expref: 38 pid: 31503 timeout: 934 lvb_type: 1 00000100:00100000:1.0:1746129579.047117:0:20578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8618 00000100:00100000:1.0:1746129579.047124:0:20578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c07bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:068dab75-d300-4ead-a742-d14572ad1e50+7:1963:x1830948734359168:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129579.047126:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090a19000/0x40a459093b06b37c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21e2b expref: 38 pid: 31503 timeout: 934 lvb_type: 1 00010000:00010000:1.0:1746129579.047131:0:20578:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129579.047148:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090a19000/0x40a459093b06b37c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21e2b expref: 38 pid: 31503 timeout: 934 lvb_type: 1 00010000:00010000:1.0:1746129579.047180:0:20578:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090a18800/0x40a459093b06b3bb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21e4e expref: 7 pid: 8410 timeout: 934 lvb_type: 1 00010000:00010000:1.0:1746129579.047189:0:20578:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090a18800/0x40a459093b06b3bb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21e4e expref: 7 pid: 8410 timeout: 934 lvb_type: 1 00010000:00010000:1.0:1746129579.047202:0:20578:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090a18800/0x40a459093b06b3bb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21e4e expref: 7 pid: 8410 timeout: 934 lvb_type: 1 00010000:00010000:1.0:1746129579.047214:0:20578:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129579.047239:0:20578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c07bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:068dab75-d300-4ead-a742-d14572ad1e50+6:1963:x1830948734359168:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 116us (971us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129579.047256:0:20578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8618 00000100:00100000:1.0:1746129579.047279:0:20861:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734359424 00000100:00100000:1.0:1746129579.047282:0:20861:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734359424 00000100:00100000:1.0:1746129579.047320:0:20861:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4826 00000100:00100000:1.0:1746129579.047326:0:20861:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c07b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:068dab75-d300-4ead-a742-d14572ad1e50+9:32583:x1830948734359424:12345-192.168.202.4@tcp:35:lfs.0 00000100:00100000:1.0:1746129579.047490:0:20861:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c07b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:068dab75-d300-4ead-a742-d14572ad1e50+10:32583:x1830948734359424:12345-192.168.202.4@tcp:35:lfs.0 Request processed in 164us (990us total) trans 8589945445 rc 0/0 00000100:00100000:1.0:1746129579.047495:0:20861:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4826 00010000:00010000:0.0:1746129579.047821:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129579.047856:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c07b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+37:1963:x1830948734359040:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 774us (1644us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129579.047862:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8617 00000100:00100000:3.0:1746129579.048022:0:8411:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8411:1830948737598080:192.168.202.4@tcp:106: 00010000:00010000:3.0:1746129579.048043:0:8411:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fc58600/0x40a459093b06b42b lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21e94 expref: 42 pid: 8411 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129579.048052:0:8411:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fc58600/0x40a459093b06b42b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21e94 expref: 42 pid: 8411 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129579.048064:0:8411:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fc58600, rc 0) 00000100:00100000:3.0:1746129579.048084:0:8411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c079180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ada2ffba-8920-4ecb-8068-68caa9806978+41:1960:x1830948734358912:12345-192.168.202.4@tcp:101:cat.0 Request processed in 2713us (2981us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129579.048090:0:8411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16682 00000100:00100000:0.0:1746129579.050792:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129579.051328:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734359552 00000100:00100000:2.0:1746129579.051338:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734359552 00010000:00010000:2.0:1746129579.051375:0:9823:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091799000/0x40a459093b06b360 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21e0f expref: 41 pid: 31503 timeout: 934 lvb_type: 0 00000100:00100000:2.0:1746129579.051406:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8619 00000100:00100000:2.0:1746129579.051414:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f325180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ada2ffba-8920-4ecb-8068-68caa9806978+41:1962:x1830948734359552:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129579.051428:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129579.051452:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091799000/0x40a459093b06b360 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21e0f expref: 41 pid: 31503 timeout: 934 lvb_type: 0 00010000:00010000:2.0:1746129579.051464:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091799000/0x40a459093b06b360 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21e0f expref: 41 pid: 31503 timeout: 934 lvb_type: 0 00010000:00010000:2.0:1746129579.051488:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091799000/0x40a459093b06b360 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21e0f expref: 41 pid: 31503 timeout: 934 lvb_type: 0 00010000:00010000:2.0:1746129579.051607:0:9823:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129579.051609:0:9823:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129579.051618:0:9823:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fc59c00/0x40a459093b06b424 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1056767) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21e8d expref: 36 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129579.051628:0:9823:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fc59c00/0x40a459093b06b424 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1056767) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21e8d expref: 36 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129579.051664:0:9823:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fc59c00/0x40a459093b06b424 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1056767) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21e8d expref: 36 pid: 8410 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129579.051677:0:9823:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c079c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9823:1830948737598208:192.168.202.4@tcp:105: 00000100:00100000:2.0:1746129579.052558:0:9823:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132f369c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129579.057678:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129579.059114:0:31519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734359808 00000100:00100000:2.0:1746129579.059127:0:31519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734359808 00002000:00100000:2.0:1746129579.059202:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3ef:0x0] (4194304->5148671) req@ffff88009f326a00 x1830948734359808/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:320/0 lens 488/0 e 0 to 0 dl 1746129590 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129579.059219:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f326a00 with x1830948734359808 ext(4194304->5148671) 00002000:00010000:2.0:1746129579.059225:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f326a00 00000100:00100000:2.0:1746129579.059262:0:31519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8092 00000100:00100000:2.0:1746129579.059272:0:31519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f326a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ada2ffba-8920-4ecb-8068-68caa9806978+32:1960:x1830948734359808:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:2.0:1746129579.059516:0:9823:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c079c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9823:1830948737598208:192.168.202.4@tcp:105: 00000100:00080000:3.0:1746129579.059520:0:7097:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1746129579.059536:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129579.059595:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f325180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ada2ffba-8920-4ecb-8068-68caa9806978+40:1962:x1830948734359552:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 8181us (8812us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129579.059605:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8619 00000100:00100000:0.0:1746129579.062987:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129579.063371:0:21725:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734360064 00000100:00100000:3.0:1746129579.063382:0:21725:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734360064 00002000:00100000:3.0:1746129579.063429:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f4:0x0] (1052672->1056767) req@ffff88009f324380 x1830948734360064/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:320/0 lens 488/0 e 0 to 0 dl 1746129590 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129579.063440:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f324380 with x1830948734360064 ext(1052672->1056767) 00002000:00010000:3.0:1746129579.063446:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f324380 00000100:00100000:3.0:1746129579.063470:0:21725:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8093 00000100:00100000:3.0:1746129579.063478:0:21725:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f324380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+37:1962:x1830948734360064:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:3.0:1746129579.063668:0:21725:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f324380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+37:1962:x1830948734360064:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 189us (689us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129579.063675:0:21725:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8093 00002000:00100000:3.0:1746129579.063680:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f4:0x0] (1052672->1056767) req@ffff88009f324380 x1830948734360064/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:320/0 lens 488/4536 e 0 to 0 dl 1746129590 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129579.063687:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f324380 with x1830948734360064 ext(1052672->1056767) 00002000:00010000:3.0:1746129579.063690:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f324380 00000100:00100000:2.0:1746129579.067990:0:31519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f326a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ada2ffba-8920-4ecb-8068-68caa9806978+32:1960:x1830948734359808:12345-192.168.202.4@tcp:3:cat.0 Request processed in 8706us (10308us total) trans 0 rc 954368/954368 00000100:00100000:2.0:1746129579.068003:0:31519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8092 00002000:00100000:2.0:1746129579.068018:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3ef:0x0] (4194304->5148671) req@ffff88009f326a00 x1830948734359808/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:320/0 lens 488/440 e 0 to 0 dl 1746129590 ref 1 fl Complete:/200/0 rc 954368/954368 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129579.068027:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f326a00 with x1830948734359808 ext(4194304->5148671) 00002000:00010000:2.0:1746129579.068033:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f326a00 00000100:00100000:0.0:1746129579.070236:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129579.070332:0:14551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734360320 00000100:00100000:1.0:1746129579.070344:0:14551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734360320 00000100:00100000:1.0:1746129579.070410:0:14551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4827 00000100:00100000:1.0:1746129579.070418:0:14551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f324700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+11:32585:x1830948734360320:12345-192.168.202.4@tcp:35:multiop.0 00000100:00100000:1.0:1746129579.070667:0:14551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f324700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+12:32585:x1830948734360320:12345-192.168.202.4@tcp:35:multiop.0 Request processed in 247us (439us total) trans 8589945446 rc 0/0 00000100:00100000:1.0:1746129579.070675:0:14551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4827 00000100:00100000:2.0:1746129579.082485:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129579.082542:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129579.084977:0:8411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734360448 00000100:00100000:3.0:1746129579.084993:0:8411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734360448 00000100:00100000:3.0:1746129579.085064:0:8411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734360576 00000100:00100000:3.0:1746129579.085067:0:8411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734360576 00000100:00100000:3.0:1746129579.085091:0:8411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16683 00000100:00100000:3.0:1746129579.085099:0:8411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c079c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ada2ffba-8920-4ecb-8068-68caa9806978+41:1962:x1830948734360448:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129579.085118:0:8411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129579.085138:0:8411:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fc58a00/0x40a459093b06b432 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21e9b expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129579.085213:0:8411:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8411:1830948737598336:192.168.202.4@tcp:106: 00000100:00100000:3.0:1746129579.085403:0:8411:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a6ce8a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746129579.085449:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16684 00000100:00100000:3.0:1746129579.085458:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c078e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ada2ffba-8920-4ecb-8068-68caa9806978+42:1962:x1830948734360576:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129579.085467:0:4385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129579.085477:0:4385:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fc59400/0x40a459093b06b439 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21ea2 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129579.085510:0:4385:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:4385:1830948737598464:192.168.202.4@tcp:106: 00000100:00100000:3.0:1746129579.085536:0:4385:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a6ce89c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746129579.094647:0:4385:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:4385:1830948737598464:192.168.202.4@tcp:106: 00010000:00010000:2.0:1746129579.094689:0:4385:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fc59400/0x40a459093b06b439 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21ea2 expref: 43 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129579.094705:0:4385:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fc59400/0x40a459093b06b439 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21ea2 expref: 43 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129579.096267:0:4385:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fc59400, rc 0) 00000100:00100000:2.0:1746129579.096396:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c078e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ada2ffba-8920-4ecb-8068-68caa9806978+42:1962:x1830948734360576:12345-192.168.202.4@tcp:101:cat.0 Request processed in 10933us (13846us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129579.096408:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16684 00000100:00100000:3.0:1746129579.097464:0:8411:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8411:1830948737598336:192.168.202.4@tcp:106: 00010000:00010000:3.0:1746129579.097503:0:8411:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fc58a00/0x40a459093b06b432 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21e9b expref: 41 pid: 8411 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129579.097517:0:8411:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fc58a00/0x40a459093b06b432 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21e9b expref: 41 pid: 8411 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129579.097550:0:8411:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fc58a00, rc 0) 00000100:00100000:3.0:1746129579.097946:0:8411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c079c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ada2ffba-8920-4ecb-8068-68caa9806978+40:1962:x1830948734360448:12345-192.168.202.4@tcp:101:cat.0 Request processed in 12846us (15469us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129579.097954:0:8411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16683 00000100:00100000:0.0:1746129579.098342:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129579.098465:0:8411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734360704 00000100:00100000:3.0:1746129579.098474:0:8411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734360704 00000100:00100000:3.0:1746129579.098534:0:8411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16685 00000100:00100000:3.0:1746129579.098544:0:8411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093edfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+37:1961:x1830948734360704:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129579.098560:0:8411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129579.098578:0:8411:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fc59a00/0x40a459093b06b440 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21ea9 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129579.098600:0:8411:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129579.098602:0:8411:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129579.098611:0:8411:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fc59a00/0x40a459093b06b440 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21ea9 expref: 38 pid: 8411 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129579.098626:0:8411:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fc59a00/0x40a459093b06b440 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21ea9 expref: 38 pid: 8411 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129579.098636:0:8411:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fc59a00, rc 0) 00000100:00100000:3.0:1746129579.098671:0:8411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093edfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+38:1961:x1830948734360704:12345-192.168.202.4@tcp:101:cat.0 Request processed in 129us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129579.098676:0:8411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16685 00000100:00100000:1.0:1746129579.102439:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129579.102496:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129579.102607:0:8411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734360832 00000100:00100000:3.0:1746129579.102616:0:8411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734360832 00000100:00100000:3.0:1746129579.102657:0:8411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734360960 00000100:00100000:3.0:1746129579.102658:0:8411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734360960 00000100:00100000:3.0:1746129579.102673:0:8411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16686 00000100:00100000:3.0:1746129579.102680:0:8411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800915d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ada2ffba-8920-4ecb-8068-68caa9806978+41:1963:x1830948734360832:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129579.102698:0:8411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129579.102716:0:8411:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fc59800/0x40a459093b06b447 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21eb0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129579.102771:0:8411:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8411:1830948737598592:192.168.202.4@tcp:106: 00000100:00100000:3.0:1746129579.102849:0:8411:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a6ce8a80 going to sleep for 11 seconds 00000100:00100000:2.0:1746129579.102925:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16687 00000100:00100000:2.0:1746129579.103560:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800915d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ada2ffba-8920-4ecb-8068-68caa9806978+42:1963:x1830948734360960:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129579.103568:0:4385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129579.103578:0:4385:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800909c0800/0x40a459093b06b44e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21eb7 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129579.103604:0:4385:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c078700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:4385:1830948737598720:192.168.202.4@tcp:106: 00000100:00100000:2.0:1746129579.103648:0:4385:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132f369c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746129579.105766:0:8411:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8411:1830948737598592:192.168.202.4@tcp:106: 00000100:00100000:2.0:1746129579.105766:0:4385:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c078700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:4385:1830948737598720:192.168.202.4@tcp:106: 00010000:00010000:3.0:1746129579.105797:0:8411:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fc59800/0x40a459093b06b447 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21eb0 expref: 43 pid: 8411 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129579.105797:0:4385:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800909c0800/0x40a459093b06b44e lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21eb7 expref: 43 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129579.105811:0:8411:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fc59800/0x40a459093b06b447 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21eb0 expref: 43 pid: 8411 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129579.105811:0:4385:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800909c0800/0x40a459093b06b44e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21eb7 expref: 43 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129579.105821:0:4385:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800909c0800, rc 0) 00010000:00010000:3.0:1746129579.105824:0:8411:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fc59800, rc 0) 00000100:00100000:3.0:1746129579.106017:0:8411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800915d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ada2ffba-8920-4ecb-8068-68caa9806978+41:1963:x1830948734360832:12345-192.168.202.4@tcp:101:cat.0 Request processed in 3337us (3587us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129579.106017:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800915d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ada2ffba-8920-4ecb-8068-68caa9806978+41:1963:x1830948734360960:12345-192.168.202.4@tcp:101:cat.0 Request processed in 2462us (3518us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129579.106025:0:8411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16686 00000100:00100000:2.0:1746129579.106751:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16687 00000100:00100000:0.0:1746129579.133942:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129579.133993:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129579.134118:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734361216 00000100:00100000:1.0:1746129579.134131:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734361216 00002000:00100000:1.0:1746129579.134175:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->1916927) req@ffff880093edf800 x1830948734361216/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:320/0 lens 488/0 e 0 to 0 dl 1746129590 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129579.134184:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093edf800 with x1830948734361216 ext(1048576->1916927) 00002000:00010000:1.0:1746129579.134189:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093edf800 00000100:00100000:1.0:1746129579.134214:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734361472 00000100:00100000:1.0:1746129579.134216:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734361472 00002000:00100000:1.0:1746129579.134224:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f4:0x0] (1056768->2097151) req@ffff880093edd180 x1830948734361472/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:320/0 lens 488/0 e 0 to 0 dl 1746129590 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129579.134230:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093edd180 with x1830948734361472 ext(1056768->2097151) 00002000:00010000:1.0:1746129579.134233:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093edd180 00000100:00100000:1.0:1746129579.134268:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8094 00000100:00100000:1.0:1746129579.134275:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093edf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+39:1960:x1830948734361216:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:3.0:1746129579.134287:0:21725:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8095 00000100:00100000:3.0:1746129579.134318:0:21725:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093edd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+39:1960:x1830948734361472:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129579.143270:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129579.143332:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734361600 00000100:00100000:2.0:1746129579.143343:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734361600 00000100:00100000:2.0:1746129579.143408:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16688 00000100:00100000:2.0:1746129579.143418:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093edf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ada2ffba-8920-4ecb-8068-68caa9806978+32:32582:x1830948734361600:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:2.0:1746129579.143439:0:4385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129579.143459:0:4385:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800909c0000/0x40a459093b06b455 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21ebe expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129579.143493:0:4385:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091799800/0x40a459093b06b367 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21e16 expref: 20 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129579.143500:0:4385:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a65fee00/0x40a459093b06b3d0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21e5c expref: 7 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129579.143507:0:4385:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095014600/0x40a459093b06b375 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21e1d expref: 33 pid: 20577 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129579.143513:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129579.143515:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129579.143519:0:4385:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800909c0000/0x40a459093b06b455 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [2535424->3145727] (req 2535424->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21ebe expref: 33 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129579.143552:0:4385:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095014600/0x40a459093b06b375 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21e1d expref: 33 pid: 20577 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129579.143564:0:4385:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095014600/0x40a459093b06b375 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21e1d expref: 33 pid: 20577 timeout: 934 lvb_type: 1 00000100:00100000:2.0:1746129579.143579:0:4385:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c078700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:4385:1830948737598848:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129579.143684:0:4385:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a65fee00/0x40a459093b06b3d0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21e5c expref: 7 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129579.143693:0:4385:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a65fee00/0x40a459093b06b3d0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21e5c expref: 7 pid: 4385 timeout: 934 lvb_type: 1 00000100:00100000:2.0:1746129579.143702:0:4385:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c07a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:4385:1830948737598976:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129579.143730:0:4385:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091799800/0x40a459093b06b367 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21e16 expref: 20 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129579.143738:0:4385:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091799800/0x40a459093b06b367 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21e16 expref: 20 pid: 31503 timeout: 934 lvb_type: 0 00000100:00100000:2.0:1746129579.143746:0:4385:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c079880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:4385:1830948737599104:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129579.143765:0:4385:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132f369c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746129579.149930:0:4385:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c078700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:4385:1830948737598848:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129579.149944:0:4385:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c07a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:4385:1830948737598976:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129579.149951:0:4385:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c079880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:4385:1830948737599104:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129579.149989:0:4385:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800909c0000/0x40a459093b06b455 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [2535424->3145727] (req 2535424->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21ebe expref: 33 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129579.150007:0:4385:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800909c0000, rc 0) 00000100:00100000:2.0:1746129579.150069:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093edf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ada2ffba-8920-4ecb-8068-68caa9806978+33:32582:x1830948734361600:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 6652us (6810us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129579.150083:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16688 00000100:00100000:1.0:1746129579.160356:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129579.160385:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129579.160672:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093edf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+40:1960:x1830948734361216:12345-192.168.202.4@tcp:3:cat.0 Request processed in 26395us (26737us total) trans 0 rc 868352/868352 00000100:00100000:1.0:1746129579.160684:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8094 00002000:00100000:1.0:1746129579.160696:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->1916927) req@ffff880093edf800 x1830948734361216/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:320/0 lens 488/440 e 0 to 0 dl 1746129590 ref 1 fl Complete:/200/0 rc 868352/868352 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129579.160706:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093edf800 with x1830948734361216 ext(1048576->1916927) 00002000:00010000:1.0:1746129579.160713:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093edf800 00000100:00100000:1.0:1746129579.160747:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734361856 00000100:00100000:1.0:1746129579.160754:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734361856 00010000:00010000:1.0:1746129579.160783:0:9823:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095014600/0x40a459093b06b375 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21e1d expref: 33 pid: 20577 timeout: 934 lvb_type: 1 00000100:00100000:1.0:1746129579.160805:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734361728 00000100:00100000:1.0:1746129579.160807:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734361728 00010000:00010000:1.0:1746129579.160827:0:9823:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a65fee00/0x40a459093b06b3d0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21e5c expref: 8 pid: 4385 timeout: 934 lvb_type: 1 00000100:00100000:1.0:1746129579.160842:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8620 00000100:00100000:1.0:1746129579.160849:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800915d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ada2ffba-8920-4ecb-8068-68caa9806978+33:1963:x1830948734361856:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129579.160862:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129579.160886:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095014600/0x40a459093b06b375 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21e1d expref: 33 pid: 20577 timeout: 934 lvb_type: 1 00010000:00010000:1.0:1746129579.160897:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095014600/0x40a459093b06b375 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21e1d expref: 33 pid: 20577 timeout: 934 lvb_type: 1 00010000:00010000:1.0:1746129579.160918:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095014600/0x40a459093b06b375 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21e1d expref: 33 pid: 20577 timeout: 934 lvb_type: 1 00010000:00010000:1.0:1746129579.160940:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129579.160958:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800915d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ada2ffba-8920-4ecb-8068-68caa9806978+32:1963:x1830948734361856:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 110us (610us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129579.160964:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8620 00000100:00100000:1.0:1746129579.160975:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8621 00000100:00100000:1.0:1746129579.160980:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800915d0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:068dab75-d300-4ead-a742-d14572ad1e50+8:1963:x1830948734361728:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129579.160986:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129579.160992:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a65fee00/0x40a459093b06b3d0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21e5c expref: 8 pid: 4385 timeout: 934 lvb_type: 1 00010000:00010000:1.0:1746129579.160999:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a65fee00/0x40a459093b06b3d0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21e5c expref: 8 pid: 4385 timeout: 934 lvb_type: 1 00010000:00010000:1.0:1746129579.161008:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a65fee00/0x40a459093b06b3d0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21e5c expref: 8 pid: 4385 timeout: 934 lvb_type: 1 00010000:00010000:1.0:1746129579.161015:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129579.161029:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800915d0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:068dab75-d300-4ead-a742-d14572ad1e50+7:1963:x1830948734361728:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 48us (644us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129579.161033:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8621 00000100:00080000:3.0:1746129579.161066:0:7097:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746129579.165009:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129579.165034:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734361984 00000100:00100000:0.0:1746129579.165043:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734361984 00010000:00010000:0.0:1746129579.165088:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091799800/0x40a459093b06b367 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21e16 expref: 21 pid: 31503 timeout: 934 lvb_type: 0 00000100:00100000:0.0:1746129579.165114:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8622 00000100:00100000:0.0:1746129579.165120:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093edc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:1962:x1830948734361984:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129579.165134:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129579.165154:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091799800/0x40a459093b06b367 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21e16 expref: 21 pid: 31503 timeout: 934 lvb_type: 0 00010000:00010000:0.0:1746129579.165166:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091799800/0x40a459093b06b367 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21e16 expref: 21 pid: 31503 timeout: 934 lvb_type: 0 00010000:00010000:0.0:1746129579.165189:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091799800/0x40a459093b06b367 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21e16 expref: 21 pid: 31503 timeout: 934 lvb_type: 0 00010000:00010000:0.0:1746129579.165208:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129579.165210:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129579.165217:0:7085:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800909c0000/0x40a459093b06b455 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2535424->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21ebe expref: 31 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129579.165225:0:7085:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800909c0000/0x40a459093b06b455 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2535424->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21ebe expref: 31 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129579.165271:0:7085:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800909c0000/0x40a459093b06b455 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2535424->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21ebe expref: 31 pid: 4385 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129579.165283:0:7085:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093edca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7085:1830948737599232:192.168.202.4@tcp:105: 00000100:00100000:0.0:1746129579.165377:0:7085:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa381a80 going to sleep for 11 seconds 00000100:00080000:0.0:1746129579.165392:0:7097:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746129579.166910:0:21725:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093edd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+38:1960:x1830948734361472:12345-192.168.202.4@tcp:3:cat.0 Request processed in 32608us (32907us total) trans 0 rc 1040384/1040384 00000100:00100000:2.0:1746129579.166921:0:21725:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8095 00002000:00100000:2.0:1746129579.166931:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f4:0x0] (1056768->2097151) req@ffff880093edd180 x1830948734361472/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:320/0 lens 488/440 e 0 to 0 dl 1746129590 ref 1 fl Complete:/200/0 rc 1040384/1040384 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129579.166941:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093edd180 with x1830948734361472 ext(1056768->2097151) 00002000:00010000:2.0:1746129579.166946:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093edd180 00000100:00100000:0.0:1746129579.176498:0:7085:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093edca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7085:1830948737599232:192.168.202.4@tcp:105: 00010000:00010000:0.0:1746129579.176521:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129579.176569:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093edc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:1962:x1830948734361984:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 11446us (11564us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129579.176580:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8622 00000100:00100000:0.0:1746129579.176637:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129579.176666:0:21725:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734362240 00000100:00100000:0.0:1746129579.176672:0:21725:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734362240 00002000:00100000:0.0:1746129579.176711:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ef:0x0] (2535424->2539519) req@ffff880093edca80 x1830948734362240/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:320/0 lens 488/0 e 0 to 0 dl 1746129590 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129579.176720:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093edca80 with x1830948734362240 ext(2535424->2539519) 00002000:00010000:0.0:1746129579.176725:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093edca80 00000100:00100000:0.0:1746129579.176741:0:21725:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8096 00000100:00100000:0.0:1746129579.176747:0:21725:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093edca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ada2ffba-8920-4ecb-8068-68caa9806978+32:1963:x1830948734362240:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:0.0:1746129579.176894:0:21725:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093edca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ada2ffba-8920-4ecb-8068-68caa9806978+32:1963:x1830948734362240:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 147us (256us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746129579.176900:0:21725:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8096 00002000:00100000:0.0:1746129579.176904:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ef:0x0] (2535424->2539519) req@ffff880093edca80 x1830948734362240/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:320/0 lens 488/4536 e 0 to 0 dl 1746129590 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129579.176911:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093edca80 with x1830948734362240 ext(2535424->2539519) 00002000:00010000:0.0:1746129579.176914:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093edca80 00000100:00100000:0.0:1746129579.189970:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129579.194356:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129579.194410:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734362368 00000100:00100000:0.0:1746129579.194419:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734362368 00000100:00100000:0.0:1746129579.194454:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734362496 00000100:00100000:0.0:1746129579.194456:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734362496 00000100:00100000:0.0:1746129579.194469:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16689 00000100:00100000:0.0:1746129579.194476:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ede300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:32591:x1830948734362368:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129579.194496:0:4385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129579.194514:0:4385:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fa9b200/0x40a459093b06b45c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21ec5 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129579.194545:0:4385:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800909c0000/0x40a459093b06b455 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2535424->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21ebe expref: 31 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129579.194552:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129579.194555:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129579.194558:0:4385:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fa9b200/0x40a459093b06b45c lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21ec5 expref: 21 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129579.194585:0:4385:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800909c0000/0x40a459093b06b455 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2535424->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21ebe expref: 31 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129579.194596:0:4385:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800909c0000/0x40a459093b06b455 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2535424->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21ebe expref: 31 pid: 4385 timeout: 934 lvb_type: 0 00000100:00100000:0.0:1746129579.194608:0:4385:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ede680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:4385:1830948737599360:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129579.194692:0:4385:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa381300 going to sleep for 11 seconds 00000100:00100000:0.0:1746129579.194708:0:8410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16690 00000100:00100000:0.0:1746129579.194712:0:8410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093edd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ada2ffba-8920-4ecb-8068-68caa9806978+40:32582:x1830948734362496:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:0.0:1746129579.194719:0:8410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129579.194728:0:8410:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fa9b000/0x40a459093b06b463 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21ecc expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129579.194741:0:8410:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a65ff600/0x40a459093b06b39f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21e39 expref: 41 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129579.194748:0:8410:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fc59a00/0x40a459093b06b440 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21ea9 expref: 37 pid: 8411 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129579.194755:0:8410:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800909c0200/0x40a459093b06b40f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21e7f expref: 5 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129579.194764:0:8410:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129579.194765:0:8410:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129579.194768:0:8410:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fa9b000/0x40a459093b06b463 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [2097152->2441215] (req 2097152->2441215) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21ecc expref: 41 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129579.194780:0:8410:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800909c0200/0x40a459093b06b40f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21e7f expref: 5 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129579.194786:0:8410:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800909c0200/0x40a459093b06b40f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21e7f expref: 5 pid: 4385 timeout: 934 lvb_type: 1 00000100:00100000:0.0:1746129579.194793:0:8410:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093eddc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8410:1830948737599488:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129579.194815:0:8410:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fc59a00/0x40a459093b06b440 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21ea9 expref: 37 pid: 8411 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129579.194822:0:8410:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fc59a00/0x40a459093b06b440 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21ea9 expref: 37 pid: 8411 timeout: 934 lvb_type: 1 00000100:00100000:0.0:1746129579.194829:0:8410:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093eded80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8410:1830948737599616:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129579.194845:0:8410:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a65ff600/0x40a459093b06b39f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21e39 expref: 41 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129579.194851:0:8410:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a65ff600/0x40a459093b06b39f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21e39 expref: 41 pid: 8412 timeout: 934 lvb_type: 0 00000100:00100000:0.0:1746129579.194862:0:8410:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093edc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8410:1830948737599744:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129579.194873:0:8410:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa381000 going to sleep for 11 seconds 00000100:00100000:0.0:1746129579.206235:0:4385:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ede680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:4385:1830948737599360:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129579.206276:0:4385:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fa9b200/0x40a459093b06b45c lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21ec5 expref: 21 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129579.206312:0:4385:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fa9b200, rc 0) 00000100:00100000:0.0:1746129579.206355:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ede300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:32591:x1830948734362368:12345-192.168.202.4@tcp:101:cat.0 Request processed in 11878us (16393us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129579.206363:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16689 00000100:00100000:0.0:1746129579.206463:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129579.206476:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129579.206511:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129579.206529:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734362880 00000100:00100000:0.0:1746129579.206535:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734362880 00002000:00100000:0.0:1746129579.206569:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ef:0x0] (2535424->3145727) req@ffff880093eddf80 x1830948734362880/t0(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:320/0 lens 488/0 e 0 to 0 dl 1746129590 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129579.206578:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093eddf80 with x1830948734362880 ext(2535424->3145727) 00010000:00010000:0.0:1746129579.206584:0:25745:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800909c0000/0x40a459093b06b455 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2535424->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21ebe expref: 32 pid: 4385 timeout: 934 lvb_type: 0 00010000:00010000:0.0:1746129579.206596:0:25745:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800909c0000/0x40a459093b06b455 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2535424->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21ebe expref: 32 pid: 4385 timeout: 934 lvb_type: 0 00002000:00010000:0.0:1746129579.206607:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093eddf80 00000100:00100000:0.0:1746129579.206620:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2500 00000100:00100000:0.0:1746129579.206625:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093eddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+32:1963:x1830948734362880:12345-192.168.202.4@tcp:4:multiop.0 00000100:00100000:0.0:1746129579.207096:0:8410:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093eddc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8410:1830948737599488:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129579.207105:0:8410:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093eded80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8410:1830948737599616:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129579.207112:0:8410:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093edc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8410:1830948737599744:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129579.207129:0:8410:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fa9b000/0x40a459093b06b463 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [2097152->2441215] (req 2097152->2441215) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21ecc expref: 41 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129579.207138:0:8410:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fa9b000, rc 0) 00000100:00100000:0.0:1746129579.207151:0:8410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093edd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ada2ffba-8920-4ecb-8068-68caa9806978+41:32582:x1830948734362496:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 12438us (12806us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129579.207157:0:8410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16690 00000100:00100000:0.0:1746129579.207179:0:15749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734362752 00000100:00100000:0.0:1746129579.207182:0:15749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734362752 00010000:00010000:0.0:1746129579.207194:0:15749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fc59a00/0x40a459093b06b440 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21ea9 expref: 38 pid: 8411 timeout: 934 lvb_type: 1 00000100:00100000:0.0:1746129579.207208:0:15749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734362624 00000100:00100000:0.0:1746129579.207210:0:15749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734362624 00010000:00010000:0.0:1746129579.207216:0:15749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800909c0200/0x40a459093b06b40f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21e7f expref: 6 pid: 4385 timeout: 934 lvb_type: 1 00000100:00100000:0.0:1746129579.207227:0:15749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8623 00000100:00100000:0.0:1746129579.207232:0:15749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bbc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+38:1962:x1830948734362752:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129579.212603:0:15749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746129579.212661:0:20578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8624 00000100:00100000:0.0:1746129579.212676:0:20578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ede680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:068dab75-d300-4ead-a742-d14572ad1e50+6:1962:x1830948734362624:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129579.212691:0:20578:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129579.212704:0:20578:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800909c0200/0x40a459093b06b40f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21e7f expref: 6 pid: 4385 timeout: 934 lvb_type: 1 00010000:00010000:0.0:1746129579.212768:0:20578:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800909c0200/0x40a459093b06b40f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21e7f expref: 6 pid: 4385 timeout: 934 lvb_type: 1 00010000:00010000:0.0:1746129579.212791:0:20578:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800909c0200/0x40a459093b06b40f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21e7f expref: 6 pid: 4385 timeout: 934 lvb_type: 1 00010000:00010000:0.0:1746129579.212807:0:20578:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129579.212856:0:20578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ede680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:068dab75-d300-4ead-a742-d14572ad1e50+5:1962:x1830948734362624:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 187us (6379us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129579.212861:0:20578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8624 00000100:00100000:0.0:1746129579.213028:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129579.217128:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734363008 00000100:00100000:0.0:1746129579.217142:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734363008 00010000:00010000:0.0:1746129579.217189:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a65ff600/0x40a459093b06b39f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21e39 expref: 41 pid: 8412 timeout: 934 lvb_type: 0 00000100:00100000:0.0:1746129579.217290:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8625 00000100:00100000:0.0:1746129579.217311:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093edc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ada2ffba-8920-4ecb-8068-68caa9806978+41:1961:x1830948734363008:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129579.217327:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129579.217349:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a65ff600/0x40a459093b06b39f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21e39 expref: 41 pid: 8412 timeout: 934 lvb_type: 0 00010000:00010000:0.0:1746129579.217360:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a65ff600/0x40a459093b06b39f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21e39 expref: 41 pid: 8412 timeout: 934 lvb_type: 0 00010000:00010000:0.0:1746129579.217385:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a65ff600/0x40a459093b06b39f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21e39 expref: 41 pid: 8412 timeout: 934 lvb_type: 0 00010000:00010000:0.0:1746129579.217402:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129579.217983:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093edc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ada2ffba-8920-4ecb-8068-68caa9806978+40:1961:x1830948734363008:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 669us (4950us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129579.217990:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8625 00010000:00010000:0.0:1746129579.218228:0:15749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fc59a00/0x40a459093b06b440 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21ea9 expref: 38 pid: 8411 timeout: 934 lvb_type: 1 00010000:00010000:0.0:1746129579.218250:0:15749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fc59a00/0x40a459093b06b440 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21ea9 expref: 38 pid: 8411 timeout: 934 lvb_type: 1 00010000:00010000:0.0:1746129579.218264:0:15749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fc59a00/0x40a459093b06b440 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21ea9 expref: 38 pid: 8411 timeout: 934 lvb_type: 1 00010000:00010000:0.0:1746129579.218273:0:15749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129579.218275:0:15749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129579.218282:0:15749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fa9b000/0x40a459093b06b463 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2441215) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21ecc expref: 39 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129579.218322:0:15749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fa9b000/0x40a459093b06b463 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2441215) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21ecc expref: 39 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129579.218356:0:15749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fa9b000/0x40a459093b06b463 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2441215) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21ecc expref: 39 pid: 8410 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129579.218369:0:15749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093eded80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15749:1830948737599872:192.168.202.4@tcp:105: 00000100:00100000:0.0:1746129579.219669:0:15749:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa381a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746129579.226509:0:15749:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093eded80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15749:1830948737599872:192.168.202.4@tcp:105: 00010000:00010000:0.0:1746129579.226526:0:15749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129579.226562:0:15749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bbc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+37:1962:x1830948734362752:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 19328us (20098us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129579.226572:0:15749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8623 00000100:00100000:1.0:1746129579.233703:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093eddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+34:1963:x1830948734362880:12345-192.168.202.4@tcp:4:multiop.0 Request processed in 27068us (27181us total) trans 21474841413 rc 0/0 00000100:00100000:1.0:1746129579.233715:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2500 00002000:00100000:1.0:1746129579.233726:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ef:0x0] (2535424->3145727) req@ffff880093eddf80 x1830948734362880/t21474841413(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:320/0 lens 488/448 e 0 to 0 dl 1746129590 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129579.233736:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093eddf80 with x1830948734362880 ext(2535424->3145727) 00010000:00010000:1.0:1746129579.233745:0:25745:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800909c0000/0x40a459093b06b455 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2535424->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21ebe expref: 34 pid: 4385 timeout: 934 lvb_type: 0 00010000:00010000:1.0:1746129579.233760:0:25745:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800909c0000/0x40a459093b06b455 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2535424->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21ebe expref: 34 pid: 4385 timeout: 934 lvb_type: 0 00002000:00010000:1.0:1746129579.233767:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093eddf80 00000100:00100000:1.0:1746129579.233831:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129579.233928:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734363264 00000100:00100000:1.0:1746129579.233935:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734363264 00002000:00100000:1.0:1746129579.233963:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f5:0x0] (2437120->2441215) req@ffff8800915d1500 x1830948734363264/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:320/0 lens 488/0 e 0 to 0 dl 1746129590 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129579.233971:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800915d1500 with x1830948734363264 ext(2437120->2441215) 00002000:00010000:1.0:1746129579.233973:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800915d1500 00000100:00100000:1.0:1746129579.233995:0:31519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8097 00000100:00100000:1.0:1746129579.234002:0:31519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800915d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ada2ffba-8920-4ecb-8068-68caa9806978+40:1963:x1830948734363264:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:1.0:1746129579.234106:0:31519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800915d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ada2ffba-8920-4ecb-8068-68caa9806978+40:1963:x1830948734363264:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 104us (275us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746129579.234111:0:31519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8097 00002000:00100000:1.0:1746129579.234116:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f5:0x0] (2437120->2441215) req@ffff8800915d1500 x1830948734363264/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:320/0 lens 488/4536 e 0 to 0 dl 1746129590 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129579.234122:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800915d1500 with x1830948734363264 ext(2437120->2441215) 00002000:00010000:1.0:1746129579.234125:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800915d1500 00000100:00100000:1.0:1746129579.237889:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129579.237928:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129579.237951:0:15749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734363392 00000100:00100000:1.0:1746129579.237958:0:15749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734363392 00010000:00010000:1.0:1746129579.237989:0:15749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800909c0000/0x40a459093b06b455 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2535424->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21ebe expref: 34 pid: 4385 timeout: 934 lvb_type: 0 00000100:00100000:2.0:1746129579.238000:0:20861:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734363648 00000100:00100000:2.0:1746129579.238003:0:20861:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734363648 00000100:00100000:1.0:1746129579.238014:0:15749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8626 00000100:00100000:1.0:1746129579.238020:0:15749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800915d2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ada2ffba-8920-4ecb-8068-68caa9806978+34:1961:x1830948734363392:12345-192.168.202.4@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746129579.238031:0:20861:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4828 00010000:00010000:1.0:1746129579.238032:0:15749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746129579.238035:0:20861:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800915d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:ada2ffba-8920-4ecb-8068-68caa9806978+292:32582:x1830948734363648:12345-192.168.202.4@tcp:35:multiop.0 00010000:00010000:1.0:1746129579.238051:0:15749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800909c0000/0x40a459093b06b455 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2535424->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21ebe expref: 34 pid: 4385 timeout: 934 lvb_type: 0 00010000:00010000:1.0:1746129579.238061:0:15749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800909c0000/0x40a459093b06b455 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2535424->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21ebe expref: 34 pid: 4385 timeout: 934 lvb_type: 0 00010000:00010000:1.0:1746129579.238083:0:15749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800909c0000/0x40a459093b06b455 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2535424->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21ebe expref: 34 pid: 4385 timeout: 934 lvb_type: 0 00010000:00010000:1.0:1746129579.238096:0:15749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129579.238098:0:15749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129579.238106:0:15749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fa9b200/0x40a459093b06b45c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21ec5 expref: 20 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129579.238112:0:15749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fa9b200/0x40a459093b06b45c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21ec5 expref: 20 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129579.238143:0:15749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009fa9b200/0x40a459093b06b45c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21ec5 expref: 20 pid: 4385 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129579.238154:0:15749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800915d2a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15749:1830948737600000:192.168.202.4@tcp:105: 00000100:00100000:2.0:1746129579.238197:0:20861:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800915d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:ada2ffba-8920-4ecb-8068-68caa9806978+293:32582:x1830948734363648:12345-192.168.202.4@tcp:35:multiop.0 Request processed in 161us (321us total) trans 8589945447 rc 0/0 00000100:00100000:2.0:1746129579.238203:0:20861:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4828 00000100:00100000:1.0:1746129579.238205:0:15749:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a6dc8a80 going to sleep for 11 seconds 00000100:00080000:0.0:1746129579.238332:0:7097:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746129579.244806:0:15749:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800915d2a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15749:1830948737600000:192.168.202.4@tcp:105: 00010000:00010000:1.0:1746129579.244834:0:15749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129579.244883:0:15749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800915d2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ada2ffba-8920-4ecb-8068-68caa9806978+33:1961:x1830948734363392:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 6861us (6952us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129579.244894:0:15749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8626 00000100:00100000:1.0:1746129579.252037:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129579.252361:0:21725:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734363904 00000100:00100000:0.0:1746129579.252373:0:21725:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734363904 00002000:00100000:0.0:1746129579.252426:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ef:0x0] (2097152->3145727) req@ffff8800915d2a00 x1830948734363904/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:320/0 lens 488/0 e 0 to 0 dl 1746129590 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129579.252437:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800915d2a00 with x1830948734363904 ext(2097152->3145727) 00002000:00010000:0.0:1746129579.252442:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800915d2a00 00000100:00100000:1.0:1746129579.253582:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8098 00000100:00100000:1.0:1746129579.253595:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800915d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:1962:x1830948734363904:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:1.0:1746129579.271703:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800915d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:1962:x1830948734363904:12345-192.168.202.4@tcp:3:cat.0 Request processed in 18100us (19665us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129579.271719:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8098 00002000:00100000:1.0:1746129579.271734:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ef:0x0] (2097152->3145727) req@ffff8800915d2a00 x1830948734363904/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:320/0 lens 488/440 e 0 to 0 dl 1746129590 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129579.271745:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800915d2a00 with x1830948734363904 ext(2097152->3145727) 00002000:00010000:1.0:1746129579.271751:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800915d2a00 00000100:00100000:1.0:1746129579.279563:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129579.280214:0:8410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734364032 00000100:00100000:0.0:1746129579.280221:0:8410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734364032 00000100:00100000:0.0:1746129579.280276:0:8410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16691 00000100:00100000:0.0:1746129579.280284:0:8410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800915d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+37:32591:x1830948734364032:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129579.280320:0:8410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129579.280334:0:8410:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fa9a600/0x40a459093b06b46a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21ed3 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129579.280358:0:8410:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fa9b000/0x40a459093b06b463 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2441215) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21ecc expref: 39 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129579.280364:0:8410:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129579.280366:0:8410:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129579.280369:0:8410:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fa9a600/0x40a459093b06b46a lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21ed3 expref: 38 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129579.280391:0:8410:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fa9b000/0x40a459093b06b463 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2441215) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21ecc expref: 39 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129579.280400:0:8410:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fa9b000/0x40a459093b06b463 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2441215) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21ecc expref: 39 pid: 8410 timeout: 934 lvb_type: 0 00000100:00100000:0.0:1746129579.280410:0:8410:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093edc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8410:1830948737600128:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129579.280493:0:8410:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa381d80 going to sleep for 11 seconds 00000100:00100000:3.0:1746129579.285953:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129579.286011:0:8410:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093edc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8410:1830948737600128:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129579.286035:0:8410:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fa9a600/0x40a459093b06b46a lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21ed3 expref: 38 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129579.286050:0:8410:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fa9a600, rc 0) 00000100:00100000:0.0:1746129579.286090:0:8410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800915d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+38:32591:x1830948734364032:12345-192.168.202.4@tcp:101:cat.0 Request processed in 5806us (6533us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129579.286099:0:8410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16691 00000100:00100000:1.0:1746129579.286320:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734364160 00000100:00100000:1.0:1746129579.286327:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734364160 00002000:00100000:1.0:1746129579.286357:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f5:0x0] (2097152->2441215) req@ffff8800947bd500 x1830948734364160/t0(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:320/0 lens 488/0 e 0 to 0 dl 1746129590 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129579.286365:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800947bd500 with x1830948734364160 ext(2097152->2441215) 00010000:00010000:1.0:1746129579.286372:0:25745:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fa9b000/0x40a459093b06b463 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2441215) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21ecc expref: 40 pid: 8410 timeout: 934 lvb_type: 0 00010000:00010000:1.0:1746129579.286382:0:25745:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fa9b000/0x40a459093b06b463 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2441215) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21ecc expref: 40 pid: 8410 timeout: 934 lvb_type: 0 00002000:00010000:1.0:1746129579.286388:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800947bd500 00000100:00100000:1.0:1746129579.286400:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2501 00000100:00100000:1.0:1746129579.286406:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+40:1963:x1830948734364160:12345-192.168.202.4@tcp:4:multiop.0 00000100:00100000:0.0:1746129579.292830:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+42:1963:x1830948734364160:12345-192.168.202.4@tcp:4:multiop.0 Request processed in 6415us (6873us total) trans 17179874171 rc 0/0 00000100:00100000:0.0:1746129579.292841:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2501 00002000:00100000:0.0:1746129579.292851:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f5:0x0] (2097152->2441215) req@ffff8800947bd500 x1830948734364160/t17179874171(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:320/0 lens 488/448 e 0 to 0 dl 1746129590 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129579.292859:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800947bd500 with x1830948734364160 ext(2097152->2441215) 00010000:00010000:0.0:1746129579.292867:0:25745:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fa9b000/0x40a459093b06b463 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2441215) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21ecc expref: 42 pid: 8410 timeout: 934 lvb_type: 0 00010000:00010000:0.0:1746129579.292879:0:25745:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fa9b000/0x40a459093b06b463 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2441215) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21ecc expref: 42 pid: 8410 timeout: 934 lvb_type: 0 00002000:00010000:0.0:1746129579.292885:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800947bd500 00000100:00100000:3.0:1746129579.299714:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129579.300916:0:15749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734364288 00000100:00100000:1.0:1746129579.300925:0:15749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734364288 00010000:00010000:1.0:1746129579.300957:0:15749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fa9b000/0x40a459093b06b463 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2441215) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21ecc expref: 42 pid: 8410 timeout: 934 lvb_type: 0 00000100:00100000:1.0:1746129579.300997:0:15749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8627 00000100:00100000:1.0:1746129579.301004:0:15749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947bc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ada2ffba-8920-4ecb-8068-68caa9806978+42:1960:x1830948734364288:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129579.301015:0:15749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129579.301034:0:15749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fa9b000/0x40a459093b06b463 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2441215) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21ecc expref: 42 pid: 8410 timeout: 934 lvb_type: 0 00010000:00010000:1.0:1746129579.301044:0:15749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fa9b000/0x40a459093b06b463 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2441215) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21ecc expref: 42 pid: 8410 timeout: 934 lvb_type: 0 00010000:00010000:1.0:1746129579.301064:0:15749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fa9b000/0x40a459093b06b463 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2441215) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21ecc expref: 42 pid: 8410 timeout: 934 lvb_type: 0 00010000:00010000:1.0:1746129579.301080:0:15749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129579.301081:0:15749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129579.301128:0:15749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fa9a600/0x40a459093b06b46a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21ed3 expref: 37 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129579.301136:0:15749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fa9a600/0x40a459093b06b46a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21ed3 expref: 37 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129579.301206:0:15749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fa9a600/0x40a459093b06b46a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21ed3 expref: 37 pid: 8410 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129579.301220:0:15749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800915d3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15749:1830948737600256:192.168.202.4@tcp:105: 00000100:00100000:1.0:1746129579.301334:0:15749:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a586e780 going to sleep for 11 seconds 00000100:00100000:0.0:1746129579.305056:0:15749:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800915d3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15749:1830948737600256:192.168.202.4@tcp:105: 00010000:00010000:0.0:1746129579.305077:0:15749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129579.305126:0:15749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947bc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ada2ffba-8920-4ecb-8068-68caa9806978+41:1960:x1830948734364288:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 4120us (5415us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129579.305135:0:15749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8627 00000100:00100000:1.0:1746129579.310689:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129579.310756:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734364544 00000100:00100000:2.0:1746129579.310764:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734364544 00000100:00100000:2.0:1746129579.310800:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11329 00000100:00100000:2.0:1746129579.310807:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800915d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+12:32595:x1830948734364544:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:2.0:1746129579.310825:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129579.310839:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800909c0600/0x40a459093b06b471 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21eda expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129579.310914:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800909c0200/0x40a459093b06b478 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129579.310926:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800909c0200/0x40a459093b06b478 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129579.310934:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800909c0200/0x40a459093b06b478 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00200000:2.0:1746129579.310943:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:2.0:1746129579.311029:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800909c0600/0x40a459093b06b471 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21eda expref: 15 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129579.311040:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800909c0200/0x40a459093b06b478 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21eda expref: 14 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129579.311046:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:2.0:1746129579.311048:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746129579.311051:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800909c0200, rc 0) 00000100:00100000:2.0:1746129579.311194:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800915d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+14:32595:x1830948734364544:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 386us (510us total) trans 8589945448 rc 0/0 00000100:00100000:2.0:1746129579.311200:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11329 00000001:00080000:2.0:1746129579.312118:0:2276:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874169 is committed 00000001:00080000:2.0:1746129579.312140:0:2276:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874168 is committed 00000001:00080000:2.0:1746129579.312161:0:2276:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874170 is committed 00000100:00100000:3.0:1746129579.313916:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129579.314176:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129579.314401:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129579.314569:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734364800 00000100:00100000:0.0:1746129579.314578:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734364800 00002000:00100000:0.0:1746129579.314620:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f5:0x0] (2097152->3145727) req@ffff8800947bce00 x1830948734364800/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:320/0 lens 488/0 e 0 to 0 dl 1746129590 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129579.314629:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800947bce00 with x1830948734364800 ext(2097152->3145727) 00002000:00010000:0.0:1746129579.314633:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800947bce00 00000100:00100000:0.0:1746129579.314654:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734365312 00000100:00100000:0.0:1746129579.314657:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734365312 00002000:00100000:0.0:1746129579.314668:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->4194303) req@ffff8800947bdf80 x1830948734365312/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:320/0 lens 488/0 e 0 to 0 dl 1746129590 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129579.314673:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800947bdf80 with x1830948734365312 ext(3145728->4194303) 00002000:00010000:0.0:1746129579.314676:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800947bdf80 00000100:00100000:0.0:1746129579.314684:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734364928 00000100:00100000:0.0:1746129579.314686:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734364928 00002000:00100000:0.0:1746129579.314694:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f5:0x0] (3145728->4194303) req@ffff8800947be680 x1830948734364928/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:320/0 lens 488/0 e 0 to 0 dl 1746129590 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129579.314700:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800947be680 with x1830948734364928 ext(3145728->4194303) 00002000:00010000:0.0:1746129579.314702:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800947be680 00000100:00100000:0.0:1746129579.314713:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8099 00000100:00100000:0.0:1746129579.314719:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+9:1962:x1830948734364800:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:2.0:1746129579.316318:0:8416:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8100 00000100:00100000:2.0:1746129579.316329:0:8416:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:1962:x1830948734365312:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:1.0:1746129579.316487:0:21725:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8101 00000100:00100000:1.0:1746129579.316495:0:21725:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+10:1963:x1830948734364928:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:2.0:1746129579.331328:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+10:1962:x1830948734364800:12345-192.168.202.4@tcp:3:cat.0 Request processed in 16569us (17377us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129579.331338:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8099 00002000:00100000:2.0:1746129579.331348:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f5:0x0] (2097152->3145727) req@ffff8800947bce00 x1830948734364800/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:320/0 lens 488/440 e 0 to 0 dl 1746129590 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129579.331356:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800947bce00 with x1830948734364800 ext(2097152->3145727) 00002000:00010000:2.0:1746129579.331361:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800947bce00 00000100:00100000:2.0:1746129579.334004:0:8416:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:1962:x1830948734365312:12345-192.168.202.4@tcp:3:cat.0 Request processed in 17670us (19820us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129579.334014:0:8416:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8100 00002000:00100000:2.0:1746129579.334023:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->4194303) req@ffff8800947bdf80 x1830948734365312/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:320/0 lens 488/440 e 0 to 0 dl 1746129590 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129579.334032:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800947bdf80 with x1830948734365312 ext(3145728->4194303) 00002000:00010000:2.0:1746129579.334036:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800947bdf80 00000100:00100000:0.0:1746129579.339133:0:21725:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+8:1963:x1830948734364928:12345-192.168.202.4@tcp:3:cat.0 Request processed in 22630us (24723us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129579.339143:0:21725:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8101 00002000:00100000:0.0:1746129579.339152:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f5:0x0] (3145728->4194303) req@ffff8800947be680 x1830948734364928/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:320/0 lens 488/440 e 0 to 0 dl 1746129590 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129579.339160:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800947be680 with x1830948734364928 ext(3145728->4194303) 00002000:00010000:0.0:1746129579.339165:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800947be680 00000100:00100000:1.0:1746129579.351389:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129579.353424:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129579.353453:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129579.353465:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129579.353496:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129579.353627:0:21725:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734365568 00000100:00100000:0.0:1746129579.353638:0:21725:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734365568 00002000:00100000:0.0:1746129579.353675:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ef:0x0] (4194304->5148671) req@ffff8800915d3800 x1830948734365568/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:320/0 lens 488/0 e 0 to 0 dl 1746129590 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129579.353695:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800915d3800 with x1830948734365568 ext(4194304->5148671) 00002000:00010000:0.0:1746129579.353700:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800915d3800 00000100:00100000:0.0:1746129579.353718:0:21725:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8102 00000100:00100000:0.0:1746129579.353724:0:21725:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800915d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:1962:x1830948734365568:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:3.0:1746129579.355395:0:8411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734365696 00000100:00100000:3.0:1746129579.355401:0:8411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734365696 00000100:00100000:3.0:1746129579.355424:0:8411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734365824 00000100:00100000:3.0:1746129579.355426:0:8411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734365824 00000100:00100000:3.0:1746129579.355434:0:8411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734365952 00000100:00100000:3.0:1746129579.355436:0:8411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734365952 00000100:00100000:3.0:1746129579.355443:0:8411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734366080 00000100:00100000:3.0:1746129579.355445:0:8411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734366080 00000100:00100000:3.0:1746129579.355454:0:8411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16692 00000100:00100000:3.0:1746129579.355459:0:8411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800915d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ada2ffba-8920-4ecb-8068-68caa9806978+23:1963:x1830948734365696:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129579.355469:0:8411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129579.355481:0:8411:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fc59e00/0x40a459093b06b486 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21ee1 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129579.355522:0:8411:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8411:1830948737600384:192.168.202.4@tcp:106: 00000100:00100000:3.0:1746129579.355572:0:8411:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a6ce8a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746129579.355589:0:31503:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16693 00000100:00100000:3.0:1746129579.355594:0:31503:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800915d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ada2ffba-8920-4ecb-8068-68caa9806978+24:1963:x1830948734365824:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129579.355600:0:31503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129579.355606:0:31503:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fc58800/0x40a459093b06b48d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21ee8 expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129579.355624:0:31503:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:31503:1830948737600512:192.168.202.4@tcp:106: 00000100:00100000:3.0:1746129579.355641:0:31503:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a6ce89c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746129579.355654:0:20577:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16694 00000100:00100000:3.0:1746129579.355659:0:20577:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ada2ffba-8920-4ecb-8068-68caa9806978+33:1963:x1830948734365952:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129579.355664:0:20577:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129579.355671:0:20577:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fc58200/0x40a459093b06b494 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21eef expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129579.355681:0:20577:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129579.355682:0:20577:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129579.355688:0:20577:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fc58200/0x40a459093b06b494 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21eef expref: 34 pid: 20577 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129579.355700:0:20577:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fc58200/0x40a459093b06b494 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21eef expref: 34 pid: 20577 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129579.355709:0:20577:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fc58200, rc 0) 00000100:00100000:3.0:1746129579.355729:0:20577:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ada2ffba-8920-4ecb-8068-68caa9806978+34:1963:x1830948734365952:12345-192.168.202.4@tcp:101:cat.0 Request processed in 69us (2262us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129579.355734:0:20577:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16694 00000100:00100000:3.0:1746129579.355747:0:20577:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16695 00000100:00100000:3.0:1746129579.355751:0:20577:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ada2ffba-8920-4ecb-8068-68caa9806978+25:1963:x1830948734366080:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129579.355756:0:20577:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129579.355762:0:20577:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fc59a00/0x40a459093b06b49b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21ef6 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129579.355770:0:20577:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129579.355771:0:20577:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129579.355775:0:20577:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fc59a00/0x40a459093b06b49b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21ef6 expref: 26 pid: 20577 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129579.355788:0:20577:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fc59a00/0x40a459093b06b49b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21ef6 expref: 26 pid: 20577 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129579.355795:0:20577:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fc59a00, rc 0) 00000100:00100000:3.0:1746129579.355811:0:20577:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ada2ffba-8920-4ecb-8068-68caa9806978+26:1963:x1830948734366080:12345-192.168.202.4@tcp:101:cat.0 Request processed in 59us (2313us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129579.355815:0:20577:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16695 00002000:00010000:3.0:1746129579.359824:0:31503:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb atime: 1746129579 -> 1746129580 00002000:00010000:3.0:1746129579.359840:0:31503:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb blocks from disk: 2079 -> 2081 00000100:00100000:3.0:1746129579.359849:0:31503:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:31503:1830948737600512:192.168.202.4@tcp:106: 00010000:00010000:3.0:1746129579.359875:0:31503:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fc58800/0x40a459093b06b48d lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21ee8 expref: 25 pid: 31503 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129579.359887:0:31503:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fc58800/0x40a459093b06b48d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21ee8 expref: 25 pid: 31503 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129579.362953:0:31503:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fc58800, rc 0) 00000100:00100000:3.0:1746129579.363034:0:31503:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800915d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ada2ffba-8920-4ecb-8068-68caa9806978+24:1963:x1830948734365824:12345-192.168.202.4@tcp:101:cat.0 Request processed in 7435us (9575us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129579.363043:0:31503:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16693 00002000:00010000:3.0:1746129579.364820:0:8411:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb atime: 1746129579 -> 1746129580 00000100:00100000:3.0:1746129579.364840:0:8411:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8411:1830948737600384:192.168.202.4@tcp:106: 00010000:00010000:3.0:1746129579.364866:0:8411:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fc59e00/0x40a459093b06b486 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21ee1 expref: 23 pid: 8411 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129579.364884:0:8411:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fc59e00/0x40a459093b06b486 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21ee1 expref: 23 pid: 8411 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129579.364893:0:8411:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fc59e00, rc 0) 00000100:00100000:3.0:1746129579.364924:0:8411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800915d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ada2ffba-8920-4ecb-8068-68caa9806978+22:1963:x1830948734365696:12345-192.168.202.4@tcp:101:cat.0 Request processed in 9463us (11503us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129579.364930:0:8411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16692 00000100:00100000:0.0:1746129579.365258:0:21725:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800915d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:1962:x1830948734365568:12345-192.168.202.4@tcp:3:cat.0 Request processed in 11532us (13875us total) trans 0 rc 954368/954368 00000100:00100000:0.0:1746129579.365265:0:21725:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8102 00002000:00100000:0.0:1746129579.365273:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ef:0x0] (4194304->5148671) req@ffff8800915d3800 x1830948734365568/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:320/0 lens 488/440 e 0 to 0 dl 1746129590 ref 1 fl Complete:/200/0 rc 954368/954368 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129579.365281:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800915d3800 with x1830948734365568 ext(4194304->5148671) 00002000:00010000:0.0:1746129579.365285:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800915d3800 00000100:00100000:0.0:1746129579.368287:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129579.370266:0:8411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734366208 00000100:00100000:3.0:1746129579.370275:0:8411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734366208 00000100:00100000:0.0:1746129579.370322:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129579.370430:0:2271:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734366336 00000100:00100000:1.0:1746129579.370432:0:2271:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734366336 00000100:00100000:3.0:1746129579.370521:0:8411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16696 00000100:00100000:3.0:1746129579.370527:0:8411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c29ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ada2ffba-8920-4ecb-8068-68caa9806978+22:32599:x1830948734366208:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129579.370542:0:8411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129579.370555:0:8411:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fc59400/0x40a459093b06b4a2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21efd expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129579.370577:0:8411:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800909c1a00/0x40a459093b06b3de lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1916928->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21e6a expref: 7 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129579.370583:0:8411:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129579.370585:0:8411:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129579.370587:0:8411:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fc59400/0x40a459093b06b4a2 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21efd expref: 23 pid: 8411 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129579.370762:0:2271:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11330 00000100:00100000:1.0:1746129579.370768:0:2271:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093edc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:068dab75-d300-4ead-a742-d14572ad1e50+10:32601:x1830948734366336:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:1.0:1746129579.370779:0:2271:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129579.370788:0:2271:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f55c400/0x40a459093b06b4a9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21f04 expref: -99 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129579.370827:0:2271:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f55da00/0x40a459093b06b4b0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 2271 initiator: MDT0 00010000:00010000:1.0:1746129579.370836:0:2271:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f55da00/0x40a459093b06b4b0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:1.0:1746129579.370844:0:2271:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f55da00/0x40a459093b06b4b0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00010000:00010000:1.0:1746129579.370852:0:2271:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f55d800/0x40a459093b06b4b7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 2271 initiator: MDT0 00010000:00010000:1.0:1746129579.370856:0:2271:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f55d800/0x40a459093b06b4b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:1.0:1746129579.370861:0:2271:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f55d800/0x40a459093b06b4b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00010000:00010000:1.0:1746129579.370940:0:2271:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f55d600/0x40a459093b06b4be lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 2271 initiator: MDT0 00010000:00010000:1.0:1746129579.370948:0:2271:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800909c0200/0x40a459093b06b478 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21eda expref: 13 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129579.370952:0:2271:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f55d600/0x40a459093b06b4be lrc: 4/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:1.0:1746129579.370968:0:2271:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800909c0200/0x40a459093b06b478 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21eda expref: 13 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129579.370980:0:2271:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800909c0200/0x40a459093b06b478 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21eda expref: 13 pid: 14549 timeout: 934 lvb_type: 0 00000100:00100000:1.0:1746129579.370991:0:2271:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800959d5180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:2271:1830948737600640:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129579.371057:0:2271:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a586e240 going to sleep for 11 seconds 00010000:00010000:3.0:1746129579.371109:0:8411:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800909c1a00/0x40a459093b06b3de lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1916928->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21e6a expref: 7 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129579.371121:0:8411:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800909c1a00/0x40a459093b06b3de lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1916928->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21e6a expref: 7 pid: 4385 timeout: 934 lvb_type: 0 00000100:00100000:3.0:1746129579.371128:0:8411:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8411:1830948737600768:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129579.371144:0:8411:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a6ce8a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746129579.375765:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129579.376378:0:2271:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800959d5180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:2271:1830948737600640:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129579.376397:0:2271:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009f55d600/0x40a459093b06b4be lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00000100:00100000:0.0:1746129579.376553:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129579.376629:0:15749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734366464 00000100:00100000:2.0:1746129579.376635:0:15749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734366464 00010000:00010000:2.0:1746129579.376744:0:15749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800909c0200/0x40a459093b06b478 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21eda expref: 14 pid: 14549 timeout: 934 lvb_type: 0 00000100:00100000:2.0:1746129579.376768:0:15749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8628 00000100:00100000:2.0:1746129579.376775:0:15749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093eded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+14:1960:x1830948734366464:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129579.376786:0:15749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129579.376791:0:15749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800909c0200/0x40a459093b06b478 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21eda expref: 14 pid: 14549 timeout: 934 lvb_type: 0 00010000:00010000:2.0:1746129579.376800:0:15749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800909c0200/0x40a459093b06b478 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21eda expref: 14 pid: 14549 timeout: 934 lvb_type: 0 00010000:00010000:2.0:1746129579.376818:0:15749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800909c0200/0x40a459093b06b478 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21eda expref: 14 pid: 14549 timeout: 934 lvb_type: 0 00000100:00100000:3.0:1746129579.376896:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734366720 00000100:00100000:3.0:1746129579.376901:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734366720 00000100:00100000:3.0:1746129579.376925:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11331 00000100:00100000:3.0:1746129579.376929:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093eddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ada2ffba-8920-4ecb-8068-68caa9806978+293:32602:x1830948734366720:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:3.0:1746129579.376946:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129579.376956:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc58e00/0x40a459093b06b4c5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21f0b expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129579.377026:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc59e00/0x40a459093b06b4cc lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129579.377036:0:14549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f55d600/0x40a459093b06b4be lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129579.377041:0:14549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc59e00/0x40a459093b06b4cc lrc: 4/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129579.377054:0:14549:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88009f55d600/0x40a459093b06b4be lrc: 4/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x40210400000020 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129579.377060:0:14549:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc59e00/0x40a459093b06b4cc lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129579.377187:0:15749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:2.0:1746129579.377192:0:15749:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f55d600/0x40a459093b06b4be lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x40210400000020 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129579.377200:0:15749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f55d600/0x40a459093b06b4be lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 13 type: IBT flags: 0x40290400000020 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129579.377205:0:15749:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f55d600/0x40a459093b06b4be lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 13 type: IBT flags: 0x40290400000020 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129579.377211:0:15749:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc59e00/0x40a459093b06b4cc lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129579.377216:0:15749:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc59e00/0x40a459093b06b4cc lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129579.377318:0:15749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129579.377352:0:15749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093eded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+13:1960:x1830948734366464:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 576us (1594us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129579.377359:0:15749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8628 00010000:00010000:0.0:1746129579.377420:0:2271:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f55d600/0x40a459093b06b4be lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40210400000020 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129579.377427:0:2271:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f55d600/0x40a459093b06b4be lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40210400000020 pid: 2271 initiator: MDT0 00000004:00200000:0.0:1746129579.377447:0:2271:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00000004:00200000:0.0:1746129579.377450:0:2271:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746129579.377462:0:2271:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009f55d600/0x40a459093b06b4be lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40210400000020 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129579.377470:0:2271:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f55d600/0x40a459093b06b4be lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x50210400000020 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129579.377477:0:2271:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f55da00/0x40a459093b06b4b0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129579.377483:0:2271:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f55da00/0x40a459093b06b4b0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129579.377489:0:2271:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f55da00/0x40a459093b06b4b0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129579.377494:0:2271:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f55da00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:0.0:1746129579.377496:0:2271:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f55da00/0x40a459093b06b4b0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129579.377502:0:2271:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f55da00/0x40a459093b06b4b0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129579.377510:0:2271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880132ef8f00) 00010000:00010000:0.0:1746129579.377512:0:2271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129579.377515:0:2271:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f55da00/0x40a459093b06b4b0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129579.377519:0:2271:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f55da00/0x40a459093b06b4b0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129579.377532:0:2271:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f55d800/0x40a459093b06b4b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129579.377537:0:2271:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f55d800/0x40a459093b06b4b7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129579.377541:0:2271:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f55d800/0x40a459093b06b4b7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129579.377545:0:2271:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f55d800 already unused, calling callback (ffffffffa136e690) 00010000:00010000:0.0:1746129579.377548:0:2271:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f55d800/0x40a459093b06b4b7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129579.377553:0:2271:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f55d800/0x40a459093b06b4b7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129579.377558:0:2271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009cffe600) 00010000:00010000:0.0:1746129579.377560:0:2271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129579.377562:0:2271:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f55d800/0x40a459093b06b4b7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129579.377566:0:2271:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f55d800/0x40a459093b06b4b7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129579.377590:0:2271:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f55c400/0x40a459093b06b4a9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21f04 expref: 12 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129579.377603:0:2271:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f55d600/0x40a459093b06b4be lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21f04 expref: 11 pid: 2271 timeout: 934 lvb_type: 0 00010000:00010000:0.0:1746129579.377610:0:2271:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f55d600/0x40a459093b06b4be lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21f04 expref: 11 pid: 2271 timeout: 934 lvb_type: 0 00010000:00010000:0.0:1746129579.377616:0:2271:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f55d600, rc 0) 00000100:00100000:0.0:1746129579.377638:0:2271:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093edc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:068dab75-d300-4ead-a742-d14572ad1e50+11:32601:x1830948734366336:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 6871us (7318us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129579.377644:0:2271:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11330 00000100:00100000:3.0:1746129579.382263:0:8411:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8411:1830948737600768:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129579.382308:0:8411:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fc59400/0x40a459093b06b4a2 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21efd expref: 23 pid: 8411 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129579.382325:0:8411:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fc59400, rc 0) 00000100:00100000:3.0:1746129579.382382:0:8411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c29ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ada2ffba-8920-4ecb-8068-68caa9806978+23:32599:x1830948734366208:12345-192.168.202.4@tcp:101:cat.0 Request processed in 11853us (14102us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129579.382391:0:8411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16696 00000100:00100000:0.0:1746129579.382953:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129579.382988:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129579.383009:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129579.383022:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129579.383037:0:22480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734367104 00000100:00100000:0.0:1746129579.383043:0:22480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734367104 00000100:00100000:0.0:1746129579.383065:0:22480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734367360 00000100:00100000:0.0:1746129579.383067:0:22480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734367360 00000100:00100000:0.0:1746129579.383076:0:22480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734366976 00000100:00100000:0.0:1746129579.383077:0:22480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734366976 00000100:00100000:0.0:1746129579.383088:0:22480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16697 00000100:00100000:0.0:1746129579.383093:0:22480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093edfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:068dab75-d300-4ead-a742-d14572ad1e50+7:1963:x1830948734367104:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:0.0:1746129579.383104:0:22480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129579.383116:0:22480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094422000/0x40a459093b06b4d3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21f19 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129579.383151:0:22480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093edd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22480:1830948737600896:192.168.202.4@tcp:106: 00000100:00100000:0.0:1746129579.383196:0:22480:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa381c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746129579.383219:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129579.383265:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129579.383280:0:15749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734367488 00000100:00100000:0.0:1746129579.383282:0:15749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734367488 00010000:00010000:0.0:1746129579.383315:0:15749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f55d600/0x40a459093b06b4be lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21f04 expref: 11 pid: 2271 timeout: 934 lvb_type: 0 00000100:00100000:0.0:1746129579.383334:0:15749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8629 00000100:00100000:0.0:1746129579.383340:0:15749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f324e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:068dab75-d300-4ead-a742-d14572ad1e50+11:1962:x1830948734367488:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129579.383348:0:15749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129579.383353:0:15749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f55d600/0x40a459093b06b4be lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21f04 expref: 11 pid: 2271 timeout: 934 lvb_type: 0 00010000:00010000:0.0:1746129579.383361:0:15749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f55d600/0x40a459093b06b4be lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21f04 expref: 11 pid: 2271 timeout: 934 lvb_type: 0 00010000:00010000:0.0:1746129579.383377:0:15749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f55d600/0x40a459093b06b4be lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21f04 expref: 11 pid: 2271 timeout: 934 lvb_type: 0 00010000:00010000:0.0:1746129579.383389:0:15749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:0.0:1746129579.383393:0:15749:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc59e00/0x40a459093b06b4cc lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129579.383401:0:15749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc59e00/0x40a459093b06b4cc lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129579.383406:0:15749:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc59e00/0x40a459093b06b4cc lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129579.383419:0:15749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129579.383434:0:15749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f324e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:068dab75-d300-4ead-a742-d14572ad1e50+10:1962:x1830948734367488:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 94us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129579.383439:0:15749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8629 00000100:00100000:3.0:1746129579.383510:0:11014:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734367232 00000100:00100000:3.0:1746129579.383514:0:11014:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734367232 00000100:00100000:3.0:1746129579.383532:0:11014:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16698 00000100:00100000:3.0:1746129579.383536:0:11014:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093edf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:068dab75-d300-4ead-a742-d14572ad1e50+8:1963:x1830948734367360:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:3.0:1746129579.383543:0:11014:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129579.383549:0:11014:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fc58a00/0x40a459093b06b4da lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21f27 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129579.383559:0:11014:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129579.383561:0:11014:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129579.383567:0:11014:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fc58a00/0x40a459093b06b4da lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21f27 expref: 9 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129579.383577:0:11014:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fc58a00/0x40a459093b06b4da lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21f27 expref: 9 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129579.383585:0:11014:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fc58a00, rc 0) 00000100:00100000:3.0:1746129579.383600:0:11014:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093edf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:068dab75-d300-4ead-a742-d14572ad1e50+9:1963:x1830948734367360:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 64us (591us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129579.383605:0:11014:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16698 00000100:00100000:3.0:1746129579.383616:0:11014:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16699 00000100:00100000:3.0:1746129579.383620:0:11014:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ede300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:068dab75-d300-4ead-a742-d14572ad1e50+8:1963:x1830948734366976:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:3.0:1746129579.383625:0:11014:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129579.383631:0:11014:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fc58000/0x40a459093b06b4e1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21f12 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129579.383649:0:11014:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11014:1830948737601024:192.168.202.4@tcp:106: 00000100:00100000:2.0:1746129579.383745:0:31503:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16700 00000100:00100000:2.0:1746129579.383752:0:31503:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f326680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:068dab75-d300-4ead-a742-d14572ad1e50+7:1963:x1830948734367232:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:2.0:1746129579.383758:0:31503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129579.383767:0:31503:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e6c1c00/0x40a459093b06b4e8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21f20 expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129579.383777:0:31503:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129579.383779:0:31503:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129579.383783:0:31503:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e6c1c00/0x40a459093b06b4e8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21f20 expref: 8 pid: 31503 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129579.383792:0:31503:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008e6c1c00/0x40a459093b06b4e8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21f20 expref: 8 pid: 31503 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129579.383798:0:31503:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e6c1c00, rc 0) 00000100:00100000:2.0:1746129579.383813:0:31503:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f326680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:068dab75-d300-4ead-a742-d14572ad1e50+8:1963:x1830948734367232:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 63us (595us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129579.383818:0:31503:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16700 00000100:00100000:3.0:1746129579.383865:0:11014:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a6ce8a80 going to sleep for 11 seconds 00010000:00010000:3.0:1746129579.383883:0:14549:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc59e00/0x40a459093b06b4cc lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129579.383889:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc59e00/0x40a459093b06b4cc lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00200000:3.0:1746129579.383904:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:3.0:1746129579.384008:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc58e00/0x40a459093b06b4c5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21f0b expref: 296 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129579.384022:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc59e00/0x40a459093b06b4cc lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21f0b expref: 295 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129579.384027:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:3.0:1746129579.384030:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746129579.384032:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fc59e00, rc 0) 00000100:00100000:3.0:1746129579.384050:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093eddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ada2ffba-8920-4ecb-8068-68caa9806978+295:32602:x1830948734366720:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 7121us (7498us total) trans 8589945449 rc 0/0 00000100:00100000:3.0:1746129579.384056:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11331 00000100:00100000:2.0:1746129579.384462:0:21725:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734366848 00000100:00100000:2.0:1746129579.384466:0:21725:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734366848 00002000:00100000:2.0:1746129579.384503:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f3:0x0] (1916928->2097151) req@ffff880093edce00 x1830948734366848/t0(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:320/0 lens 488/0 e 0 to 0 dl 1746129590 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129579.384511:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093edce00 with x1830948734366848 ext(1916928->2097151) 00010000:00010000:2.0:1746129579.384517:0:21725:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800909c1a00/0x40a459093b06b3de lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1916928->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21e6a expref: 8 pid: 4385 timeout: 934 lvb_type: 0 00010000:00010000:2.0:1746129579.384526:0:21725:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800909c1a00/0x40a459093b06b3de lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1916928->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21e6a expref: 8 pid: 4385 timeout: 934 lvb_type: 0 00002000:00010000:2.0:1746129579.384532:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093edce00 00000100:00100000:2.0:1746129579.384554:0:21725:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2502 00000100:00100000:2.0:1746129579.384559:0:21725:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093edce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+8:1963:x1830948734366848:12345-192.168.202.4@tcp:4:cat.0 00000100:00100000:3.0:1746129579.388202:0:11014:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11014:1830948737601024:192.168.202.4@tcp:106: 00010000:00010000:3.0:1746129579.388231:0:11014:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fc58000/0x40a459093b06b4e1 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21f12 expref: 9 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129579.388256:0:11014:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fc58000/0x40a459093b06b4e1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21f12 expref: 9 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129579.388264:0:11014:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fc58000, rc 0) 00000100:00100000:3.0:1746129579.388315:0:11014:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ede300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:068dab75-d300-4ead-a742-d14572ad1e50+8:1963:x1830948734366976:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 4693us (5291us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129579.388323:0:11014:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16699 00000100:00100000:3.0:1746129579.389474:0:21725:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093edce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+10:1963:x1830948734366848:12345-192.168.202.4@tcp:4:cat.0 Request processed in 4911us (6519us total) trans 17179874172 rc 0/0 00000100:00100000:3.0:1746129579.389482:0:21725:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2502 00002000:00100000:3.0:1746129579.389489:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f3:0x0] (1916928->2097151) req@ffff880093edce00 x1830948734366848/t17179874172(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:320/0 lens 488/448 e 0 to 0 dl 1746129590 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129579.389497:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093edce00 with x1830948734366848 ext(1916928->2097151) 00010000:00010000:3.0:1746129579.389504:0:21725:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800909c1a00/0x40a459093b06b3de lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1916928->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21e6a expref: 10 pid: 4385 timeout: 934 lvb_type: 0 00010000:00010000:3.0:1746129579.389517:0:21725:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800909c1a00/0x40a459093b06b3de lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1916928->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21e6a expref: 10 pid: 4385 timeout: 934 lvb_type: 0 00002000:00010000:3.0:1746129579.389523:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093edce00 00000100:00100000:0.0:1746129579.390146:0:22480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093edd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22480:1830948737600896:192.168.202.4@tcp:106: 00010000:00010000:0.0:1746129579.390166:0:22480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094422000/0x40a459093b06b4d3 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21f19 expref: 7 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129579.390176:0:22480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094422000/0x40a459093b06b4d3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21f19 expref: 7 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129579.390185:0:22480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094422000, rc 0) 00000100:00100000:0.0:1746129579.390208:0:22480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093edfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:068dab75-d300-4ead-a742-d14572ad1e50+6:1963:x1830948734367104:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 7114us (7218us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129579.390217:0:22480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16697 00000100:00100000:0.0:1746129579.393897:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129579.394863:0:22480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734367616 00000100:00100000:2.0:1746129579.394872:0:22480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734367616 00000100:00100000:2.0:1746129579.394932:0:22480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16701 00000100:00100000:2.0:1746129579.394940:0:22480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f327b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ada2ffba-8920-4ecb-8068-68caa9806978+34:32602:x1830948734367616:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:2.0:1746129579.394960:0:22480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129579.394979:0:22480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a77f6a00/0x40a459093b06b4f6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21f2e expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129579.395008:0:22480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fa9b200/0x40a459093b06b45c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21ec5 expref: 20 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129579.395015:0:22480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008e6c1c00/0x40a459093b06b4e8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21f20 expref: 7 pid: 31503 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129579.395021:0:22480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fc58200/0x40a459093b06b494 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21eef expref: 35 pid: 20577 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129579.395026:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129579.395027:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129579.395030:0:22480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a77f6a00/0x40a459093b06b4f6 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [3960832->4177919] (req 3960832->4177919) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21f2e expref: 35 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129579.395058:0:22480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fc58200/0x40a459093b06b494 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21eef expref: 35 pid: 20577 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129579.395066:0:22480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fc58200/0x40a459093b06b494 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21eef expref: 35 pid: 20577 timeout: 934 lvb_type: 1 00000100:00100000:2.0:1746129579.395078:0:22480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c079880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22480:1830948737601152:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129579.395179:0:22480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008e6c1c00/0x40a459093b06b4e8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21f20 expref: 7 pid: 31503 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129579.395191:0:22480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008e6c1c00/0x40a459093b06b4e8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21f20 expref: 7 pid: 31503 timeout: 934 lvb_type: 1 00000100:00100000:2.0:1746129579.395199:0:22480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c07a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22480:1830948737601280:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129579.395223:0:22480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fa9b200/0x40a459093b06b45c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21ec5 expref: 20 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129579.395231:0:22480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fa9b200/0x40a459093b06b45c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21ec5 expref: 20 pid: 4385 timeout: 934 lvb_type: 0 00000100:00100000:2.0:1746129579.395251:0:22480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c078700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22480:1830948737601408:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129579.395271:0:22480:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132f360c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746129579.396969:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129579.397041:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734368000 00000100:00100000:3.0:1746129579.397055:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734368000 00000100:00100000:3.0:1746129579.397111:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11332 00000100:00100000:3.0:1746129579.397119:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c07ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:068dab75-d300-4ead-a742-d14572ad1e50+10:32601:x1830948734368000:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:3.0:1746129579.397136:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129579.397152:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f882c00/0x40a459093b06b4fd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21f35 expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129579.397248:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f882a00/0x40a459093b06b504 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129579.397260:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f882a00/0x40a459093b06b504 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129579.397268:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f882a00/0x40a459093b06b504 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129579.397282:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cc35c00/0x40a459093b06b50b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129579.397287:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012cc35c00/0x40a459093b06b50b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129579.397313:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cc35c00/0x40a459093b06b50b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129579.397404:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cc34000/0x40a459093b06b512 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129579.397412:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012cc34000/0x40a459093b06b512 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129579.397478:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cc34000/0x40a459093b06b512 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00200000:3.0:1746129579.397487:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:3.0:1746129579.397557:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f882a00/0x40a459093b06b504 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129579.397563:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f882a00/0x40a459093b06b504 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129579.397568:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f882a00/0x40a459093b06b504 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129579.397573:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f882a00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:3.0:1746129579.397576:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f882a00/0x40a459093b06b504 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129579.397582:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f882a00/0x40a459093b06b504 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129579.397591:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880132ef8f00) 00010000:00010000:3.0:1746129579.397593:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129579.397597:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f882a00/0x40a459093b06b504 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129579.397602:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f882a00/0x40a459093b06b504 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129579.397610:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cc35c00/0x40a459093b06b50b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129579.397615:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012cc35c00/0x40a459093b06b50b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129579.397619:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012cc35c00/0x40a459093b06b50b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129579.397622:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012cc35c00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:3.0:1746129579.397624:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012cc35c00/0x40a459093b06b50b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129579.397631:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012cc35c00/0x40a459093b06b50b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129579.397636:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800938dd600) 00010000:00010000:3.0:1746129579.397637:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129579.397639:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012cc35c00/0x40a459093b06b50b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129579.397643:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cc35c00/0x40a459093b06b50b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129579.397676:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f882c00/0x40a459093b06b4fd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21f35 expref: 13 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129579.397686:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cc34000/0x40a459093b06b512 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21f35 expref: 12 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129579.397692:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:3.0:1746129579.397694:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746129579.397696:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cc34000, rc 0) 00000100:00100000:3.0:1746129579.397930:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c07ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:068dab75-d300-4ead-a742-d14572ad1e50+12:32601:x1830948734368000:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 810us (966us total) trans 8589945450 rc 0/0 00000100:00100000:3.0:1746129579.397936:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11332 00000100:00100000:0.0:1746129579.398022:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129579.398109:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734367744 00000100:00100000:1.0:1746129579.398116:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734367744 00010000:00010000:1.0:1746129579.398146:0:9823:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800909c1a00/0x40a459093b06b3de lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1916928->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21e6a expref: 10 pid: 4385 timeout: 934 lvb_type: 0 00000100:00100000:3.0:1746129579.398150:0:22480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c079880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22480:1830948737601152:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129579.398155:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129579.398161:0:22480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c07a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22480:1830948737601280:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129579.398179:0:22480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c078700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22480:1830948737601408:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129579.398208:0:22480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a77f6a00/0x40a459093b06b4f6 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [3960832->4177919] (req 3960832->4177919) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21f2e expref: 35 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129579.398220:0:22480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a77f6a00, rc 0) 00000100:00100000:3.0:1746129579.398255:0:22480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f327b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ada2ffba-8920-4ecb-8068-68caa9806978+35:32602:x1830948734367616:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 3317us (4370us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129579.398261:0:22480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16701 00000100:00100000:1.0:1746129579.400180:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734368128 00000100:00100000:1.0:1746129579.400190:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734368128 00010000:00010000:1.0:1746129579.400247:0:9823:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fc58200/0x40a459093b06b494 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21eef expref: 35 pid: 20577 timeout: 934 lvb_type: 1 00000100:00100000:1.0:1746129579.400277:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8630 00000100:00100000:1.0:1746129579.400284:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bbc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+10:1962:x1830948734367744:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129579.400323:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129579.400349:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800909c1a00/0x40a459093b06b3de lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1916928->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21e6a expref: 10 pid: 4385 timeout: 934 lvb_type: 0 00010000:00010000:1.0:1746129579.400360:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800909c1a00/0x40a459093b06b3de lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1916928->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21e6a expref: 10 pid: 4385 timeout: 934 lvb_type: 0 00010000:00010000:1.0:1746129579.400384:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800909c1a00/0x40a459093b06b3de lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1916928->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21e6a expref: 10 pid: 4385 timeout: 934 lvb_type: 0 00010000:00010000:1.0:1746129579.400403:0:9823:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129579.400405:0:9823:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129579.400413:0:9823:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fc59400/0x40a459093b06b4a2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21efd expref: 22 pid: 8411 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129579.400421:0:9823:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fc59400/0x40a459093b06b4a2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21efd expref: 22 pid: 8411 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129579.400455:0:9823:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fc59400/0x40a459093b06b4a2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21efd expref: 22 pid: 8411 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129579.400467:0:9823:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800959d5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9823:1830948737601536:192.168.202.4@tcp:105: 00000100:00100000:1.0:1746129579.400545:0:9823:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a586e240 going to sleep for 11 seconds 00000100:00100000:1.0:1746129579.400566:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8631 00000100:00100000:1.0:1746129579.400572:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f325180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ada2ffba-8920-4ecb-8068-68caa9806978+35:1962:x1830948734368128:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129579.400580:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129579.400596:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fc58200/0x40a459093b06b494 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21eef expref: 35 pid: 20577 timeout: 934 lvb_type: 1 00010000:00010000:1.0:1746129579.400604:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fc58200/0x40a459093b06b494 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21eef expref: 35 pid: 20577 timeout: 934 lvb_type: 1 00010000:00010000:1.0:1746129579.400621:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fc58200/0x40a459093b06b494 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21eef expref: 35 pid: 20577 timeout: 934 lvb_type: 1 00010000:00010000:1.0:1746129579.400631:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129579.400650:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f325180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ada2ffba-8920-4ecb-8068-68caa9806978+34:1962:x1830948734368128:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 78us (2495us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129579.400656:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8631 00000100:00100000:1.0:1746129579.401608:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129579.401674:0:20578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734368256 00000100:00100000:3.0:1746129579.401687:0:20578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734368256 00010000:00010000:3.0:1746129579.401719:0:20578:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008e6c1c00/0x40a459093b06b4e8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21f20 expref: 8 pid: 31503 timeout: 934 lvb_type: 1 00000100:00100000:1.0:1746129579.401736:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129579.401754:0:20578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8632 00000100:00100000:3.0:1746129579.401760:0:20578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:068dab75-d300-4ead-a742-d14572ad1e50+8:1962:x1830948734368256:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129579.401772:0:20578:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129579.401792:0:20578:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008e6c1c00/0x40a459093b06b4e8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21f20 expref: 8 pid: 31503 timeout: 934 lvb_type: 1 00010000:00010000:3.0:1746129579.401802:0:20578:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008e6c1c00/0x40a459093b06b4e8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21f20 expref: 8 pid: 31503 timeout: 934 lvb_type: 1 00010000:00010000:3.0:1746129579.401822:0:20578:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e6c1c00/0x40a459093b06b4e8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21f20 expref: 8 pid: 31503 timeout: 934 lvb_type: 1 00010000:00010000:3.0:1746129579.401835:0:20578:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129579.401885:0:20578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:068dab75-d300-4ead-a742-d14572ad1e50+7:1962:x1830948734368256:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 124us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129579.401892:0:20578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8632 00000100:00100000:2.0:1746129579.401927:0:22480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734368384 00000100:00100000:2.0:1746129579.401932:0:22480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734368384 00000100:00100000:2.0:1746129579.401966:0:22480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16702 00000100:00100000:2.0:1746129579.401971:0:22480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:32595:x1830948734368384:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:2.0:1746129579.401987:0:22480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129579.401999:0:22480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009efb2a00/0x40a459093b06b520 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21f3c expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129579.402017:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129579.402019:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129579.402023:0:22480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009efb2a00/0x40a459093b06b520 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [3010560->3145727] (req 3010560->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21f3c expref: 22 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129579.402039:0:22480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009efb2a00/0x40a459093b06b520 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [3010560->3145727] (req 3010560->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21f3c expref: 22 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129579.402056:0:22480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009efb2a00, rc 0) 00000100:00100000:2.0:1746129579.402092:0:22480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+22:32595:x1830948734368384:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 120us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129579.402098:0:22480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16702 00000100:00100000:0.0:1746129579.404460:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129579.404496:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129579.404517:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129579.404546:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129579.404552:0:11014:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734368640 00000100:00100000:3.0:1746129579.404562:0:11014:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734368640 00000100:00100000:0.0:1746129579.404585:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129579.404593:0:11014:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734368896 00000100:00100000:3.0:1746129579.404596:0:11014:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734368896 00000100:00100000:0.0:1746129579.404604:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734369024 00000100:00100000:0.0:1746129579.404610:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734369024 00000100:00100000:3.0:1746129579.404613:0:11014:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734368768 00000100:00100000:3.0:1746129579.404615:0:11014:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734368768 00000100:00100000:3.0:1746129579.404632:0:11014:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16703 00000100:00100000:3.0:1746129579.404637:0:11014:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093edd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:068dab75-d300-4ead-a742-d14572ad1e50+7:1963:x1830948734368640:12345-192.168.202.4@tcp:101:lfs.0 00000100:00100000:0.0:1746129579.404645:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734368512 00000100:00100000:0.0:1746129579.404647:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734368512 00010000:00010000:3.0:1746129579.404652:0:11014:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129579.404658:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fa9b200/0x40a459093b06b45c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21ec5 expref: 22 pid: 4385 timeout: 934 lvb_type: 0 00010000:00010000:3.0:1746129579.404665:0:11014:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012cc34a00/0x40a459093b06b527 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21f43 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129579.404676:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 804 00000100:00100000:0.0:1746129579.404682:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7d8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:068dab75-d300-4ead-a742-d14572ad1e50+12:1961:x1830948734369024:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129579.404691:0:11014:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129579.404693:0:11014:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129579.404693:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129579.404700:0:11014:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012cc34a00/0x40a459093b06b527 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21f43 expref: 8 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129579.404713:0:11014:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012cc34a00/0x40a459093b06b527 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21f43 expref: 8 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129579.404714:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cc34000/0x40a459093b06b512 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21f35 expref: 12 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129579.404726:0:11014:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cc34a00, rc 0) 00010000:00010000:0.0:1746129579.404731:0:7085:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:0.0:1746129579.404736:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129579.404771:0:11014:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093edd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:068dab75-d300-4ead-a742-d14572ad1e50+8:1963:x1830948734368640:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 133us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129579.404776:0:11014:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16703 00000100:00100000:3.0:1746129579.404788:0:11014:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16704 00000100:00100000:3.0:1746129579.404793:0:11014:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:068dab75-d300-4ead-a742-d14572ad1e50+7:1963:x1830948734368896:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:3.0:1746129579.404799:0:11014:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129579.404806:0:11014:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012cc34400/0x40a459093b06b52e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21f51 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129579.404808:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16705 00000100:00100000:1.0:1746129579.404817:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:068dab75-d300-4ead-a742-d14572ad1e50+7:1963:x1830948734368768:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:3.0:1746129579.404818:0:11014:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129579.404825:0:11014:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012cc34400/0x40a459093b06b52e lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21f51 expref: 8 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129579.404829:0:4385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129579.404833:0:11014:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012cc34400/0x40a459093b06b52e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21f51 expref: 8 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129579.404840:0:4385:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f55c400/0x40a459093b06b535 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21f4a expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129579.404841:0:11014:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cc34400, rc 0) 00000100:00100000:2.0:1746129579.404880:0:7087:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8633 00000100:00100000:1.0:1746129579.404883:0:4385:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800959d6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:4385:1830948737601664:192.168.202.4@tcp:106: 00000100:00100000:2.0:1746129579.404888:0:7087:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7db100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+22:1962:x1830948734368512:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129579.404897:0:7087:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129579.404913:0:7087:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fa9b200/0x40a459093b06b45c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21ec5 expref: 22 pid: 4385 timeout: 934 lvb_type: 0 00010000:00010000:2.0:1746129579.404922:0:7087:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fa9b200/0x40a459093b06b45c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21ec5 expref: 22 pid: 4385 timeout: 934 lvb_type: 0 00010000:00010000:2.0:1746129579.404940:0:7087:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fa9b200/0x40a459093b06b45c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21ec5 expref: 22 pid: 4385 timeout: 934 lvb_type: 0 00010000:00010000:2.0:1746129579.404952:0:7087:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129579.404954:0:7087:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129579.404958:0:7087:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a77f6a00/0x40a459093b06b4f6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3960832->4177919) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21f2e expref: 33 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129579.404966:0:7087:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a77f6a00/0x40a459093b06b4f6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3960832->4177919) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21f2e expref: 33 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129579.404973:0:7087:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129579.404974:0:7087:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129579.404976:0:7087:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009efb2a00/0x40a459093b06b520 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [3010560->3145727] (req 3010560->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21f3c expref: 21 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129579.405086:0:7087:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009efb2a00/0x40a459093b06b520 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [3010560->3145727] (req 3010560->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21f3c expref: 21 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129579.405109:0:7087:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009efb2a00/0x40a459093b06b520 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [3010560->3145727] (req 3010560->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21f3c expref: 21 pid: 22480 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129579.405119:0:7087:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c07aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7087:1830948737601792:192.168.202.4@tcp:105: 00000100:00100000:0.0:1746129579.406759:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7d8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:068dab75-d300-4ead-a742-d14572ad1e50+11:1961:x1830948734369024:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 2066us (2201us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129579.406770:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 804 00000100:00100000:3.0:1746129579.407549:0:11014:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:068dab75-d300-4ead-a742-d14572ad1e50+7:1963:x1830948734368896:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 2746us (3043us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129579.407558:0:11014:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16704 00000100:00100000:0.0:1746129579.407937:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129579.407993:0:21725:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734369280 00000100:00100000:3.0:1746129579.408002:0:21725:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734369280 00002000:00100000:3.0:1746129579.408032:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff88009c7db800 x1830948734369280/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:320/0 lens 488/0 e 0 to 0 dl 1746129590 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129579.408041:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7db800 with x1830948734369280 ext(1048576->2097151) 00002000:00010000:3.0:1746129579.408045:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c7db800 00000100:00100000:3.0:1746129579.408064:0:8416:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8103 00000100:00100000:3.0:1746129579.408068:0:8416:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ada2ffba-8920-4ecb-8068-68caa9806978+23:1962:x1830948734369280:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:1.0:1746129579.408447:0:4385:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a586e9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746129579.408489:0:9823:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800959d5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9823:1830948737601536:192.168.202.4@tcp:105: 00010000:00010000:1.0:1746129579.408508:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129579.408533:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bbc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+9:1962:x1830948734367744:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 8249us (10511us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129579.408542:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8630 00010000:00010000:2.0:1746129579.408725:0:7087:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a77f6a00/0x40a459093b06b4f6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3960832->4177919) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21f2e expref: 33 pid: 22480 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129579.408739:0:7087:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c078700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7087:1830948737601920:192.168.202.4@tcp:105: 00000100:00100000:2.0:1746129579.408766:0:7087:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132f363c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746129579.417266:0:8416:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ada2ffba-8920-4ecb-8068-68caa9806978+23:1962:x1830948734369280:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 9184us (9319us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129579.417278:0:8416:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8103 00002000:00100000:3.0:1746129579.417291:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff88009c7db800 x1830948734369280/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:320/0 lens 488/440 e 0 to 0 dl 1746129590 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129579.417330:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7db800 with x1830948734369280 ext(1048576->2097151) 00002000:00010000:3.0:1746129579.417336:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c7db800 00000100:00100000:1.0:1746129579.419733:0:4385:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800959d6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:4385:1830948737601664:192.168.202.4@tcp:106: 00010000:00010000:1.0:1746129579.419762:0:4385:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f55c400/0x40a459093b06b535 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21f4a expref: 8 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129579.419775:0:4385:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f55c400/0x40a459093b06b535 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21f4a expref: 8 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129579.419796:0:4385:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f55c400, rc 0) 00000100:00100000:1.0:1746129579.419832:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:068dab75-d300-4ead-a742-d14572ad1e50+7:1963:x1830948734368768:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 15017us (15314us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129579.419839:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16705 00000100:00100000:2.0:1746129579.419936:0:7087:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c078700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7087:1830948737601920:192.168.202.4@tcp:105: 00000100:00100000:0.0:1746129579.420562:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129579.420592:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129579.420745:0:7087:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c07aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7087:1830948737601792:192.168.202.4@tcp:105: 00010000:00010000:2.0:1746129579.420759:0:7087:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129579.420790:0:7087:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7db100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:1962:x1830948734368512:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 15903us (16204us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129579.420797:0:7087:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8633 00000100:00100000:3.0:1746129579.421222:0:8416:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734369792 00000100:00100000:3.0:1746129579.421228:0:8416:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734369792 00002000:00100000:3.0:1746129579.421267:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3ef:0x0] (3010560->3014655) req@ffff88009c7da300 x1830948734369792/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:320/0 lens 488/0 e 0 to 0 dl 1746129590 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129579.421275:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7da300 with x1830948734369792 ext(3010560->3014655) 00002000:00010000:3.0:1746129579.421279:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c7da300 00000100:00100000:2.0:1746129579.421321:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734369664 00000100:00100000:3.0:1746129579.421325:0:8416:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8104 00000100:00100000:2.0:1746129579.421325:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734369664 00000100:00100000:3.0:1746129579.421331:0:8416:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:1961:x1830948734369792:12345-192.168.202.4@tcp:3:multiop.0 00002000:00100000:2.0:1746129579.421342:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ef:0x0] (3960832->3964927) req@ffff88009c7d8e00 x1830948734369664/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:320/0 lens 488/0 e 0 to 0 dl 1746129590 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129579.421349:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7d8e00 with x1830948734369664 ext(3960832->3964927) 00002000:00010000:2.0:1746129579.421352:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c7d8e00 00000100:00100000:2.0:1746129579.421369:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8105 00000100:00100000:2.0:1746129579.421374:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+34:1963:x1830948734369664:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:3.0:1746129579.421453:0:8416:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:1961:x1830948734369792:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 122us (892us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129579.421453:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+34:1963:x1830948734369664:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 78us (859us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129579.421458:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8105 00000100:00100000:3.0:1746129579.421461:0:8416:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8104 00002000:00100000:2.0:1746129579.421463:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ef:0x0] (3960832->3964927) req@ffff88009c7d8e00 x1830948734369664/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:320/0 lens 488/4536 e 0 to 0 dl 1746129590 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129579.421466:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3ef:0x0] (3010560->3014655) req@ffff88009c7da300 x1830948734369792/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:320/0 lens 488/4536 e 0 to 0 dl 1746129590 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129579.421469:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7d8e00 with x1830948734369664 ext(3960832->3964927) 00002000:00010000:2.0:1746129579.421472:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c7d8e00 00002000:00100000:3.0:1746129579.421473:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7da300 with x1830948734369792 ext(3010560->3014655) 00002000:00010000:3.0:1746129579.421476:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c7da300 00000100:00100000:0.0:1746129579.421961:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129579.422161:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734369920 00000100:00100000:1.0:1746129579.422164:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734369920 00000100:00100000:1.0:1746129579.422541:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16706 00000100:00100000:1.0:1746129579.422548:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ada2ffba-8920-4ecb-8068-68caa9806978+23:32599:x1830948734369920:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129579.422557:0:4385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129579.422569:0:4385:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095412400/0x40a459093b06b53c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21f58 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129579.422590:0:4385:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fc59c00/0x40a459093b06b424 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1056767) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21e8d expref: 8 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129579.422596:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129579.422598:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129579.422600:0:4385:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095412400/0x40a459093b06b53c lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21f58 expref: 24 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129579.422622:0:4385:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fc59c00/0x40a459093b06b424 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1056767) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21e8d expref: 8 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129579.422637:0:4385:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fc59c00/0x40a459093b06b424 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1056767) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21e8d expref: 8 pid: 8410 timeout: 934 lvb_type: 0 00000100:00100000:1.0:1746129579.422647:0:4385:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800959d6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:4385:1830948737602048:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129579.422691:0:4385:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a586e9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129579.423371:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129579.423420:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734370176 00000100:00100000:3.0:1746129579.423423:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734370176 00000100:00100000:3.0:1746129579.423456:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11333 00000100:00100000:3.0:1746129579.423461:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:068dab75-d300-4ead-a742-d14572ad1e50+11:32601:x1830948734370176:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:3.0:1746129579.423472:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129579.423483:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cc35c00/0x40a459093b06b543 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21f5f expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129579.423547:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cc34c00/0x40a459093b06b54a lrc: 3/0,1 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129579.423558:0:14549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc59e00/0x40a459093b06b4cc lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21f0b expref: 294 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129579.423562:0:14549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012cc34c00/0x40a459093b06b54a lrc: 4/0,1 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129579.423579:0:14549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc59e00/0x40a459093b06b4cc lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21f0b expref: 294 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129579.423586:0:14549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc59e00/0x40a459093b06b4cc lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21f0b expref: 294 pid: 14549 timeout: 934 lvb_type: 0 00000100:00100000:3.0:1746129579.423594:0:14549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830948737602176:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129579.423640:0:14549:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a6ce8a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746129579.428663:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129579.428741:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129579.428812:0:31519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734370432 00000100:00100000:1.0:1746129579.428819:0:31519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734370432 00002000:00100000:1.0:1746129579.428855:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f4:0x0] (1048576->1056767) req@ffff88009c7dbb80 x1830948734370432/t0(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:320/0 lens 8680/0 e 0 to 0 dl 1746129590 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129579.428864:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7dbb80 with x1830948734370432 ext(1048576->1056767) 00010000:00010000:1.0:1746129579.428873:0:31519:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fc59c00/0x40a459093b06b424 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1056767) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21e8d expref: 9 pid: 8410 timeout: 934 lvb_type: 0 00010000:00010000:1.0:1746129579.428884:0:31519:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fc59c00/0x40a459093b06b424 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1056767) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21e8d expref: 9 pid: 8410 timeout: 934 lvb_type: 0 00002000:00010000:1.0:1746129579.428891:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c7dbb80 00000100:00100000:0.0:1746129579.438012:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129579.438176:0:22480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734370304 00000100:00100000:3.0:1746129579.438185:0:22480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734370304 00000100:00100000:3.0:1746129579.439232:0:22480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16707 00000100:00100000:3.0:1746129579.439262:0:22480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009402bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+10:32595:x1830948734370304:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:3.0:1746129579.439277:0:22480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129579.439291:0:22480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012cc34000/0x40a459093b06b551 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21f66 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129579.439325:0:22480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fa9a600/0x40a459093b06b46a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21ed3 expref: 11 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129579.439337:0:22480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fc58a00/0x40a459093b06b4da lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21f27 expref: 6 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129579.439343:0:22480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fc59a00/0x40a459093b06b49b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21ef6 expref: 24 pid: 20577 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129579.439348:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129579.439350:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129579.439352:0:22480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012cc34000/0x40a459093b06b551 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [2097152->2654207] (req 2097152->2654207) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21f66 expref: 11 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129579.439376:0:22480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fc59a00/0x40a459093b06b49b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21ef6 expref: 24 pid: 20577 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129579.439385:0:22480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fc59a00/0x40a459093b06b49b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21ef6 expref: 24 pid: 20577 timeout: 934 lvb_type: 1 00000100:00100000:3.0:1746129579.439395:0:22480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22480:1830948737602304:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129579.439455:0:22480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fc58a00/0x40a459093b06b4da lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21f27 expref: 6 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129579.439462:0:22480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fc58a00/0x40a459093b06b4da lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21f27 expref: 6 pid: 11014 timeout: 934 lvb_type: 1 00000100:00100000:3.0:1746129579.439468:0:22480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22480:1830948737602432:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129579.439484:0:22480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fa9a600/0x40a459093b06b46a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21ed3 expref: 11 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129579.439490:0:22480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fa9a600/0x40a459093b06b46a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21ed3 expref: 11 pid: 8410 timeout: 934 lvb_type: 0 00000100:00100000:3.0:1746129579.439496:0:22480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22480:1830948737602560:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129579.439506:0:22480:0:(client.c:2553:ptlrpc_set_wait()) set ffff880135a559c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746129579.439535:0:14549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830948737602176:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129579.439549:0:14549:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012cc34c00/0x40a459093b06b54a lrc: 3/0,1 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000100:00100000:1.0:1746129579.442110:0:31519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734370688 00000100:00100000:1.0:1746129579.442129:0:31519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734370688 00000100:00100000:3.0:1746129579.442173:0:8416:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2503 00002000:00100000:1.0:1746129579.442191:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3ef:0x0] (4173824->4177919) req@ffff88009402b100 x1830948734370688/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:320/0 lens 488/0 e 0 to 0 dl 1746129590 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:3.0:1746129579.442194:0:8416:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+11:1961:x1830948734370432:12345-192.168.202.4@tcp:4:multiop.0 00002000:00100000:1.0:1746129579.442202:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009402b100 with x1830948734370688 ext(4173824->4177919) 00002000:00010000:1.0:1746129579.442209:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009402b100 00000100:00100000:1.0:1746129579.442261:0:31519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8106 00000100:00100000:1.0:1746129579.442270:0:31519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009402b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ada2ffba-8920-4ecb-8068-68caa9806978+34:1962:x1830948734370688:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:0.0:1746129579.442277:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129579.442470:0:31519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009402b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ada2ffba-8920-4ecb-8068-68caa9806978+34:1962:x1830948734370688:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 200us (4464us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746129579.442477:0:31519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8106 00002000:00100000:1.0:1746129579.442483:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3ef:0x0] (4173824->4177919) req@ffff88009402b100 x1830948734370688/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:320/0 lens 488/4536 e 0 to 0 dl 1746129590 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129579.442490:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009402b100 with x1830948734370688 ext(4173824->4177919) 00002000:00010000:1.0:1746129579.442493:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009402b100 00000100:00100000:1.0:1746129579.442548:0:4385:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800959d6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:4385:1830948737602048:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129579.442579:0:4385:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095412400/0x40a459093b06b53c lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21f58 expref: 24 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129579.442597:0:4385:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095412400, rc 0) 00000100:00100000:1.0:1746129579.442631:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ada2ffba-8920-4ecb-8068-68caa9806978+24:32599:x1830948734369920:12345-192.168.202.4@tcp:101:cat.0 Request processed in 20083us (20670us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129579.442638:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16706 00000100:00100000:3.0:1746129579.442664:0:8416:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+13:1961:x1830948734370432:12345-192.168.202.4@tcp:4:multiop.0 Request processed in 478us (14006us total) trans 17179874173 rc 0/0 00000100:00100000:3.0:1746129579.442671:0:8416:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2503 00002000:00100000:3.0:1746129579.442679:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3f4:0x0] (1048576->1056767) req@ffff88009c7dbb80 x1830948734370432/t17179874173(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:320/0 lens 8680/448 e 0 to 0 dl 1746129590 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129579.442689:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7dbb80 with x1830948734370432 ext(1048576->1056767) 00000100:00100000:2.0:1746129579.443682:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734370816 00000100:00100000:2.0:1746129579.443691:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734370816 00010000:00010000:2.0:1746129579.443723:0:7087:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc59e00/0x40a459093b06b4cc lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21f0b expref: 295 pid: 14549 timeout: 934 lvb_type: 0 00000100:00100000:2.0:1746129579.443772:0:7087:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8634 00000100:00100000:2.0:1746129579.443778:0:7087:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094028380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ada2ffba-8920-4ecb-8068-68caa9806978+295:1960:x1830948734370816:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129579.443788:0:7087:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129579.443793:0:7087:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc59e00/0x40a459093b06b4cc lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21f0b expref: 295 pid: 14549 timeout: 934 lvb_type: 0 00010000:00010000:2.0:1746129579.443806:0:7087:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc59e00/0x40a459093b06b4cc lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21f0b expref: 295 pid: 14549 timeout: 934 lvb_type: 0 00010000:00010000:2.0:1746129579.443824:0:7087:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc59e00/0x40a459093b06b4cc lrc: 0/0,0 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21f0b expref: 295 pid: 14549 timeout: 934 lvb_type: 0 00010000:00010000:2.0:1746129579.443846:0:7087:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:2.0:1746129579.443851:0:7087:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88012cc34c00/0x40a459093b06b54a lrc: 3/0,1 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129579.443858:0:7087:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cc34c00/0x40a459093b06b54a lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129579.443864:0:7087:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012cc34c00/0x40a459093b06b54a lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129579.443891:0:7087:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129579.443922:0:7087:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094028380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ada2ffba-8920-4ecb-8068-68caa9806978+294:1960:x1830948734370816:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 144us (1646us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129579.443928:0:7087:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8634 00010000:00010000:3.0:1746129579.443997:0:8416:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fc59c00/0x40a459093b06b424 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1056767) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21e8d expref: 13 pid: 8410 timeout: 934 lvb_type: 0 00010000:00010000:3.0:1746129579.444012:0:8416:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fc59c00/0x40a459093b06b424 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1056767) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21e8d expref: 13 pid: 8410 timeout: 934 lvb_type: 0 00002000:00010000:3.0:1746129579.444024:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c7dbb80 00010000:00010000:3.0:1746129579.444045:0:14549:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012cc34c00/0x40a459093b06b54a lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129579.444051:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cc34c00/0x40a459093b06b54a lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129579.444066:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cc34c00/0x40a459093b06b54a lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129579.444070:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012cc34c00/0x40a459093b06b54a lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129579.444075:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012cc34c00/0x40a459093b06b54a lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129579.444080:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012cc34c00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:3.0:1746129579.444083:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012cc34c00/0x40a459093b06b54a lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129579.444088:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012cc34c00/0x40a459093b06b54a lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129579.444096:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:3.0:1746129579.444098:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746129579.444100:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012cc34c00/0x40a459093b06b54a lrc: 2/0,0 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129579.444103:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cc34c00/0x40a459093b06b54a lrc: 0/0,0 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129579.444139:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cc35c00/0x40a459093b06b543 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x1/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21f5f expref: 12 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129579.444145:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cc35c00/0x40a459093b06b543 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x1/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21f5f expref: 12 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129579.444151:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cc35c00, rc 0) 00000100:00100000:3.0:1746129579.444169:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:068dab75-d300-4ead-a742-d14572ad1e50+11:32601:x1830948734370176:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 20708us (20799us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129579.444174:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11333 00000100:00100000:3.0:1746129579.449703:0:22480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22480:1830948737602304:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129579.449716:0:22480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22480:1830948737602432:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129579.449725:0:22480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22480:1830948737602560:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129579.449759:0:22480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012cc34000/0x40a459093b06b551 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [2097152->2654207] (req 2097152->2654207) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21f66 expref: 12 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129579.449774:0:22480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cc34000, rc 0) 00000100:00100000:3.0:1746129579.449829:0:22480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009402bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+12:32595:x1830948734370304:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 10590us (21087us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129579.449837:0:22480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16707 00000100:00100000:0.0:1746129579.451119:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129579.451161:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129579.451190:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129579.451222:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129579.451257:0:15749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734370944 00000100:00100000:0.0:1746129579.451266:0:15749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734370944 00010000:00010000:0.0:1746129579.451332:0:15749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fc59a00/0x40a459093b06b49b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21ef6 expref: 24 pid: 20577 timeout: 934 lvb_type: 1 00000100:00100000:0.0:1746129579.451358:0:15749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734371072 00000100:00100000:0.0:1746129579.451360:0:15749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734371072 00010000:00010000:0.0:1746129579.451370:0:15749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fc58a00/0x40a459093b06b4da lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21f27 expref: 7 pid: 11014 timeout: 934 lvb_type: 1 00000100:00100000:0.0:1746129579.451392:0:15749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734371456 00000100:00100000:0.0:1746129579.451395:0:15749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734371456 00010000:00010000:0.0:1746129579.451404:0:15749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fa9a600/0x40a459093b06b46a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21ed3 expref: 12 pid: 8410 timeout: 934 lvb_type: 0 00000100:00100000:0.0:1746129579.451419:0:15749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8635 00000100:00100000:0.0:1746129579.451428:0:15749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009402b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ada2ffba-8920-4ecb-8068-68caa9806978+24:1962:x1830948734370944:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129579.451442:0:15749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746129579.451450:0:20578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8636 00000100:00100000:1.0:1746129579.451451:0:14551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734371328 00000100:00100000:1.0:1746129579.451458:0:14551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734371328 00000100:00100000:3.0:1746129579.451462:0:20578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6ce3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:068dab75-d300-4ead-a742-d14572ad1e50+7:1962:x1830948734371072:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129579.451469:0:15749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fc59a00/0x40a459093b06b49b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21ef6 expref: 24 pid: 20577 timeout: 934 lvb_type: 1 00010000:00010000:3.0:1746129579.451480:0:20578:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129579.451480:0:15749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fc59a00/0x40a459093b06b49b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21ef6 expref: 24 pid: 20577 timeout: 934 lvb_type: 1 00000100:00100000:1.0:1746129579.451493:0:14551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4829 00000100:00100000:1.0:1746129579.451498:0:14551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094028000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ada2ffba-8920-4ecb-8068-68caa9806978+294:32602:x1830948734371328:12345-192.168.202.4@tcp:35:multiop.0 00010000:00010000:0.0:1746129579.451506:0:15749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fc59a00/0x40a459093b06b49b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21ef6 expref: 24 pid: 20577 timeout: 934 lvb_type: 1 00010000:00010000:3.0:1746129579.451555:0:20578:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fc58a00/0x40a459093b06b4da lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21f27 expref: 7 pid: 11014 timeout: 934 lvb_type: 1 00010000:00010000:3.0:1746129579.451570:0:20578:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fc58a00/0x40a459093b06b4da lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21f27 expref: 7 pid: 11014 timeout: 934 lvb_type: 1 00010000:00010000:3.0:1746129579.451586:0:20578:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fc58a00/0x40a459093b06b4da lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21f27 expref: 7 pid: 11014 timeout: 934 lvb_type: 1 00010000:00010000:3.0:1746129579.451596:0:20578:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129579.451778:0:20578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6ce3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:068dab75-d300-4ead-a742-d14572ad1e50+6:1962:x1830948734371072:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 319us (615us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129579.451794:0:7087:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8637 00000100:00100000:2.0:1746129579.451802:0:7087:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009402b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+12:1963:x1830948734371456:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129579.451808:0:7087:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129579.451816:0:7087:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fa9a600/0x40a459093b06b46a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21ed3 expref: 12 pid: 8410 timeout: 934 lvb_type: 0 00010000:00010000:2.0:1746129579.451823:0:7087:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fa9a600/0x40a459093b06b46a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21ed3 expref: 12 pid: 8410 timeout: 934 lvb_type: 0 00010000:00010000:2.0:1746129579.451834:0:7087:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fa9a600/0x40a459093b06b46a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21ed3 expref: 12 pid: 8410 timeout: 934 lvb_type: 0 00010000:00010000:2.0:1746129579.451842:0:7087:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129579.451844:0:7087:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129579.451849:0:7087:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012cc34000/0x40a459093b06b551 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2654207) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21f66 expref: 11 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129579.451855:0:7087:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012cc34000/0x40a459093b06b551 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2654207) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21f66 expref: 11 pid: 22480 timeout: 0 lvb_type: 0 00000001:00080000:1.0:1746129579.451873:0:14551:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589945451 00010000:00010000:2.0:1746129579.451876:0:7087:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012cc34000/0x40a459093b06b551 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2654207) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21f66 expref: 11 pid: 22480 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129579.451885:0:7087:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c07aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7087:1830948737602688:192.168.202.4@tcp:105: 00000100:00100000:2.0:1746129579.451918:0:7087:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132f369c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746129579.451926:0:14551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094028000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ada2ffba-8920-4ecb-8068-68caa9806978+296:32602:x1830948734371328:12345-192.168.202.4@tcp:35:multiop.0 Request processed in 427us (734us total) trans 8589945452 rc 0/0 00000100:00100000:1.0:1746129579.451933:0:14551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4829 00000020:00080000:1.0:1746129579.451937:0:14551:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1746129579.451955:0:20578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8636 00010000:00010000:0.0:1746129579.453554:0:15749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129579.453618:0:15749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009402b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ada2ffba-8920-4ecb-8068-68caa9806978+23:1962:x1830948734370944:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 2186us (2503us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129579.453628:0:15749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8635 00000100:00100000:0.0:1746129579.454574:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129579.454907:0:14551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734371712 00000100:00100000:1.0:1746129579.454917:0:14551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734371712 00000100:00100000:0.0:1746129579.454923:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129579.454969:0:14551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4830 00000100:00100000:1.0:1746129579.454977:0:14551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094028380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:068dab75-d300-4ead-a742-d14572ad1e50+11:32601:x1830948734371712:12345-192.168.202.4@tcp:35:lfs.0 00000100:00100000:1.0:1746129579.455183:0:14551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094028380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:068dab75-d300-4ead-a742-d14572ad1e50+12:32601:x1830948734371712:12345-192.168.202.4@tcp:35:lfs.0 Request processed in 205us (613us total) trans 8589945453 rc 0/0 00000100:00100000:1.0:1746129579.455189:0:14551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4830 00000100:00100000:2.0:1746129579.456177:0:7086:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734371840 00000100:00100000:2.0:1746129579.456186:0:7086:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734371840 00010000:00010000:2.0:1746129579.456213:0:7086:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fc59c00/0x40a459093b06b424 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1056767) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21e8d expref: 12 pid: 8410 timeout: 934 lvb_type: 0 00000100:00100000:2.0:1746129579.456248:0:7086:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8638 00000100:00100000:2.0:1746129579.456256:0:7086:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009402b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+12:1961:x1830948734371840:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129579.456267:0:7086:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746129579.456283:0:7086:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb mtime from disk: 1746129579 -> 1746129580 00010000:00010000:2.0:1746129579.456289:0:7086:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fc59c00/0x40a459093b06b424 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1056767) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21e8d expref: 12 pid: 8410 timeout: 934 lvb_type: 0 00010000:00010000:2.0:1746129579.456316:0:7086:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fc59c00/0x40a459093b06b424 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1056767) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21e8d expref: 12 pid: 8410 timeout: 934 lvb_type: 0 00010000:00010000:2.0:1746129579.456334:0:7086:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fc59c00/0x40a459093b06b424 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1056767) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21e8d expref: 12 pid: 8410 timeout: 934 lvb_type: 0 00010000:00010000:2.0:1746129579.456347:0:7086:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129579.456348:0:7086:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129579.456355:0:7086:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880095412400/0x40a459093b06b53c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21f58 expref: 22 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129579.456362:0:7086:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095412400/0x40a459093b06b53c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21f58 expref: 22 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129579.456392:0:7086:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880095412400/0x40a459093b06b53c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21f58 expref: 22 pid: 4385 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129579.456402:0:7086:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c078700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7086:1830948737602816:192.168.202.4@tcp:105: 00000100:00100000:2.0:1746129579.456465:0:7086:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132f36d80 going to sleep for 11 seconds 00000100:00100000:3.0:1746129579.456576:0:7087:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c07aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7087:1830948737602688:192.168.202.4@tcp:105: 00010000:00010000:3.0:1746129579.456590:0:7087:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129579.456614:0:7087:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009402b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+11:1963:x1830948734371456:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 4812us (5390us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129579.456620:0:7087:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8637 00000100:00100000:0.0:1746129579.463106:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129579.463363:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129579.463419:0:8416:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734372096 00000100:00100000:3.0:1746129579.463427:0:8416:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734372096 00002000:00100000:3.0:1746129579.463465:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3f4:0x0] (1048576->2097151) req@ffff88009402aa00 x1830948734372096/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:320/0 lens 488/0 e 0 to 0 dl 1746129590 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129579.463474:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009402aa00 with x1830948734372096 ext(1048576->2097151) 00002000:00010000:3.0:1746129579.463479:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009402aa00 00000100:00100000:3.0:1746129579.464647:0:8416:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734372352 00000100:00100000:3.0:1746129579.464652:0:8416:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734372352 00002000:00100000:3.0:1746129579.464675:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3f5:0x0] (2650112->2654207) req@ffff88009402ad80 x1830948734372352/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:320/0 lens 488/0 e 0 to 0 dl 1746129590 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129579.464689:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009402ad80 with x1830948734372352 ext(2650112->2654207) 00002000:00010000:3.0:1746129579.464693:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009402ad80 00000100:00100000:2.0:1746129579.464954:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8107 00000100:00100000:2.0:1746129579.464963:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009402aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+23:1961:x1830948734372096:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:3.0:1746129579.465768:0:8416:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8108 00000100:00100000:3.0:1746129579.465778:0:8416:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009402ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+11:1961:x1830948734372352:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:3.0:1746129579.465920:0:8416:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009402ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+11:1961:x1830948734372352:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 144us (2556us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129579.465925:0:8416:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8108 00002000:00100000:3.0:1746129579.465931:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3f5:0x0] (2650112->2654207) req@ffff88009402ad80 x1830948734372352/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:320/0 lens 488/4536 e 0 to 0 dl 1746129590 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129579.465938:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009402ad80 with x1830948734372352 ext(2650112->2654207) 00002000:00010000:3.0:1746129579.465941:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009402ad80 00000100:00100000:3.0:1746129579.466681:0:7086:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c078700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7086:1830948737602816:192.168.202.4@tcp:105: 00010000:00010000:3.0:1746129579.466698:0:7086:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129579.466732:0:7086:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009402b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+10:1961:x1830948734371840:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 10477us (11809us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129579.466740:0:7086:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8638 00000100:00100000:0.0:1746129579.477642:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129579.478063:0:14551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734372608 00000100:00100000:1.0:1746129579.478075:0:14551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734372608 00000100:00100000:1.0:1746129579.478151:0:14551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4831 00000100:00100000:1.0:1746129579.478159:0:14551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094cca450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+13:32595:x1830948734372608:12345-192.168.202.4@tcp:35:multiop.0 00000100:00100000:1.0:1746129579.479590:0:14551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094cca450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+14:32595:x1830948734372608:12345-192.168.202.4@tcp:35:multiop.0 Request processed in 1426us (1951us total) trans 8589945454 rc 0/0 00000100:00100000:2.0:1746129579.479591:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009402aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+23:1961:x1830948734372096:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 14625us (16487us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129579.479600:0:14551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4831 00000100:00100000:2.0:1746129579.479602:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8107 00002000:00100000:2.0:1746129579.479614:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f4:0x0] (1048576->2097151) req@ffff88009402aa00 x1830948734372096/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:320/0 lens 488/440 e 0 to 0 dl 1746129590 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129579.479622:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009402aa00 with x1830948734372096 ext(1048576->2097151) 00002000:00010000:2.0:1746129579.479627:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009402aa00 00000100:00100000:0.0:1746129579.497528:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129579.497662:0:22480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734372864 00000100:00100000:3.0:1746129579.497672:0:22480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734372864 00000100:00100000:3.0:1746129579.497739:0:22480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16708 00000100:00100000:3.0:1746129579.497748:0:22480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094029880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ada2ffba-8920-4ecb-8068-68caa9806978+34:32599:x1830948734372864:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129579.497766:0:22480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129579.497784:0:22480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b4020e00/0x40a459093b06b558 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21f74 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129579.497820:0:22480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009efb2a00/0x40a459093b06b520 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [3010560->3145727] (req 3010560->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21f3c expref: 20 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129579.497828:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129579.497829:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129579.497833:0:22480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4020e00/0x40a459093b06b558 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21f74 expref: 35 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129579.497864:0:22480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009efb2a00/0x40a459093b06b520 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [3010560->3145727] (req 3010560->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21f3c expref: 20 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129579.497873:0:22480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009efb2a00/0x40a459093b06b520 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [3010560->3145727] (req 3010560->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21f3c expref: 20 pid: 22480 timeout: 934 lvb_type: 0 00000100:00100000:3.0:1746129579.497884:0:22480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22480:1830948737602944:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129579.497967:0:22480:0:(client.c:2553:ptlrpc_set_wait()) set ffff880135a550c0 going to sleep for 11 seconds 00010000:00010000:2.0:1746129579.499174:0:9822:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1746129579.500958:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129579.500982:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129579.501048:0:8411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734372736 00000100:00100000:2.0:1746129579.501058:0:8411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734372736 00000100:00100000:3.0:1746129579.501072:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129579.501101:0:8411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734373120 00000100:00100000:2.0:1746129579.501103:0:8411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734373120 00000100:00100000:2.0:1746129579.501764:0:8411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16709 00000100:00100000:2.0:1746129579.501772:0:8411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+10:1963:x1830948734372736:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129579.501786:0:8411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746129579.501786:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16710 00000100:00100000:1.0:1746129579.501799:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:1963:x1830948734373120:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129579.501801:0:8411:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008fb0f800/0x40a459093b06b55f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21f6d expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129579.501814:0:4385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129579.501821:0:8411:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129579.501823:0:8411:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129579.501829:0:4385:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091545000/0x40a459093b06b566 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21f82 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129579.501831:0:8411:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fb0f800/0x40a459093b06b55f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21f6d expref: 11 pid: 8411 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129579.501844:0:8411:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008fb0f800/0x40a459093b06b55f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21f6d expref: 11 pid: 8411 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129579.501853:0:8411:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fb0f800, rc 0) 00000100:00100000:1.0:1746129579.501878:0:4385:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800959d6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:4385:1830948737603072:192.168.202.4@tcp:106: 00000100:00100000:2.0:1746129579.501900:0:8411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+11:1963:x1830948734372736:12345-192.168.202.4@tcp:101:cat.0 Request processed in 129us (952us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129579.501905:0:8411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16709 00000100:00100000:1.0:1746129579.501938:0:4385:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130fc9480 going to sleep for 11 seconds 00000100:00100000:3.0:1746129579.502104:0:20577:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734372992 00000100:00100000:3.0:1746129579.502110:0:20577:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734372992 00000100:00100000:3.0:1746129579.502144:0:20577:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16711 00000100:00100000:3.0:1746129579.502149:0:20577:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+11:1963:x1830948734372992:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129579.502156:0:20577:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129579.502164:0:20577:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a77f7600/0x40a459093b06b56d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21f7b expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129579.502180:0:20577:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129579.502182:0:20577:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129579.502187:0:20577:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a77f7600/0x40a459093b06b56d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21f7b expref: 12 pid: 20577 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129579.502198:0:20577:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a77f7600/0x40a459093b06b56d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21f7b expref: 12 pid: 20577 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129579.502205:0:20577:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a77f7600, rc 0) 00000100:00100000:3.0:1746129579.502222:0:20577:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+12:1963:x1830948734372992:12345-192.168.202.4@tcp:101:cat.0 Request processed in 73us (1151us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129579.502227:0:20577:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16711 00000100:00100000:0.0:1746129579.502710:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129579.502731:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734373248 00000100:00100000:0.0:1746129579.502734:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734373248 00002000:00100000:0.0:1746129579.502759:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ef:0x0] (3010560->3145727) req@ffff880094028700 x1830948734373248/t0(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:320/0 lens 488/0 e 0 to 0 dl 1746129590 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129579.502768:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094028700 with x1830948734373248 ext(3010560->3145727) 00010000:00010000:0.0:1746129579.502775:0:25745:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009efb2a00/0x40a459093b06b520 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [3010560->3145727] (req 3010560->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21f3c expref: 23 pid: 22480 timeout: 934 lvb_type: 0 00010000:00010000:0.0:1746129579.502785:0:25745:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009efb2a00/0x40a459093b06b520 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [3010560->3145727] (req 3010560->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21f3c expref: 23 pid: 22480 timeout: 934 lvb_type: 0 00002000:00010000:0.0:1746129579.502791:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094028700 00000100:00100000:0.0:1746129579.502801:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2504 00000100:00100000:0.0:1746129579.502805:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094028700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+23:1963:x1830948734373248:12345-192.168.202.4@tcp:4:multiop.0 00000100:00100000:3.0:1746129579.503333:0:22480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22480:1830948737602944:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129579.503356:0:22480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b4020e00/0x40a459093b06b558 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21f74 expref: 35 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129579.503962:0:22480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4020e00, rc 0) 00000100:00100000:3.0:1746129579.505113:0:22480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094029880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ada2ffba-8920-4ecb-8068-68caa9806978+35:32599:x1830948734372864:12345-192.168.202.4@tcp:101:cat.0 Request processed in 7361us (7591us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129579.505123:0:22480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16708 00000100:00100000:0.0:1746129579.510338:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094028700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+25:1963:x1830948734373248:12345-192.168.202.4@tcp:4:multiop.0 Request processed in 7518us (7615us total) trans 21474841414 rc 0/0 00000100:00100000:0.0:1746129579.510350:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2504 00002000:00100000:0.0:1746129579.510364:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ef:0x0] (3010560->3145727) req@ffff880094028700 x1830948734373248/t21474841414(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:320/0 lens 488/448 e 0 to 0 dl 1746129590 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129579.510373:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094028700 with x1830948734373248 ext(3010560->3145727) 00010000:00010000:0.0:1746129579.510383:0:25745:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009efb2a00/0x40a459093b06b520 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [3010560->3145727] (req 3010560->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21f3c expref: 25 pid: 22480 timeout: 934 lvb_type: 0 00010000:00010000:0.0:1746129579.510396:0:25745:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009efb2a00/0x40a459093b06b520 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [3010560->3145727] (req 3010560->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21f3c expref: 25 pid: 22480 timeout: 934 lvb_type: 0 00002000:00010000:0.0:1746129579.510403:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094028700 00002000:00010000:1.0:1746129579.510907:0:4385:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb mtime: 1746129579 -> 1746129580 00002000:00010000:1.0:1746129579.510912:0:4385:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb atime: 1746129579 -> 1746129580 00002000:00010000:1.0:1746129579.510914:0:4385:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb ctime: 1746129579 -> 1746129580 00000100:00100000:1.0:1746129579.510930:0:4385:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800959d6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:4385:1830948737603072:192.168.202.4@tcp:106: 00010000:00010000:1.0:1746129579.510962:0:4385:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091545000/0x40a459093b06b566 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21f82 expref: 24 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129579.510973:0:4385:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091545000/0x40a459093b06b566 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21f82 expref: 24 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129579.511007:0:4385:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091545000, rc 0) 00000100:00100000:1.0:1746129579.511034:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+23:1963:x1830948734373120:12345-192.168.202.4@tcp:101:cat.0 Request processed in 9239us (10050us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129579.511041:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16710 00000100:00100000:2.0:1746129579.515846:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129579.518840:0:7086:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734373376 00000100:00100000:3.0:1746129579.518853:0:7086:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734373376 00010000:00010000:3.0:1746129579.518887:0:7086:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009efb2a00/0x40a459093b06b520 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [3010560->3145727] (req 3010560->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21f3c expref: 23 pid: 22480 timeout: 934 lvb_type: 0 00000100:00100000:3.0:1746129579.518915:0:7086:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8639 00000100:00100000:3.0:1746129579.518923:0:7086:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c07a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+23:1960:x1830948734373376:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129579.518935:0:7086:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129579.518955:0:7086:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009efb2a00/0x40a459093b06b520 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [3010560->3145727] (req 3010560->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21f3c expref: 23 pid: 22480 timeout: 934 lvb_type: 0 00010000:00010000:3.0:1746129579.518966:0:7086:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009efb2a00/0x40a459093b06b520 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [3010560->3145727] (req 3010560->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21f3c expref: 23 pid: 22480 timeout: 934 lvb_type: 0 00010000:00010000:3.0:1746129579.518985:0:7086:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009efb2a00/0x40a459093b06b520 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [3010560->3145727] (req 3010560->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21f3c expref: 23 pid: 22480 timeout: 934 lvb_type: 0 00010000:00010000:3.0:1746129579.519010:0:7086:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129579.519013:0:7086:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129579.519019:0:7086:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b4020e00/0x40a459093b06b558 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21f74 expref: 34 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129579.519026:0:7086:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4020e00/0x40a459093b06b558 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21f74 expref: 34 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129579.519055:0:7086:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800b4020e00/0x40a459093b06b558 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21f74 expref: 34 pid: 22480 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129579.519065:0:7086:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7086:1830948737603200:192.168.202.4@tcp:105: 00000100:00100000:3.0:1746129579.519146:0:7086:0:(client.c:2553:ptlrpc_set_wait()) set ffff880135a550c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746129579.523021:0:7086:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7086:1830948737603200:192.168.202.4@tcp:105: 00010000:00010000:3.0:1746129579.523044:0:7086:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129579.524545:0:7086:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c07a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+22:1960:x1830948734373376:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 5618us (8702us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129579.524556:0:7086:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8639 00000100:00100000:0.0:1746129579.530874:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129579.530910:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129579.530985:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129579.531018:0:31519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734373760 00000100:00100000:0.0:1746129579.531026:0:31519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734373760 00002000:00100000:0.0:1746129579.531062:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3ef:0x0] (2097152->3145727) req@ffff880094028a80 x1830948734373760/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:320/0 lens 488/0 e 0 to 0 dl 1746129590 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129579.531071:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094028a80 with x1830948734373760 ext(2097152->3145727) 00002000:00010000:0.0:1746129579.531076:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094028a80 00000100:00100000:0.0:1746129579.531089:0:31519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734373888 00000100:00100000:0.0:1746129579.531091:0:31519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734373888 00002000:00100000:0.0:1746129579.531101:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff880094029f80 x1830948734373888/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:320/0 lens 488/0 e 0 to 0 dl 1746129590 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129579.531108:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094029f80 with x1830948734373888 ext(1048576->2097151) 00002000:00010000:0.0:1746129579.531111:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094029f80 00000100:00100000:0.0:1746129579.531133:0:31519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734374016 00000100:00100000:0.0:1746129579.531135:0:31519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734374016 00002000:00100000:0.0:1746129579.531144:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f4:0x0] (1048576->2097151) req@ffff880094028000 x1830948734374016/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:320/0 lens 488/0 e 0 to 0 dl 1746129590 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129579.531150:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094028000 with x1830948734374016 ext(1048576->2097151) 00002000:00010000:0.0:1746129579.531153:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094028000 00000100:00100000:0.0:1746129579.531164:0:31519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8109 00000100:00100000:0.0:1746129579.531170:0:31519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094028a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ada2ffba-8920-4ecb-8068-68caa9806978+35:1961:x1830948734373760:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:2.0:1746129579.531433:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8110 00000100:00100000:2.0:1746129579.531440:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094029f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+13:1962:x1830948734373888:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129579.532616:0:31521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8111 00000100:00100000:0.0:1746129579.532624:0:31521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094028000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+14:1962:x1830948734374016:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:1.0:1746129579.552583:0:31519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094028a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ada2ffba-8920-4ecb-8068-68caa9806978+35:1961:x1830948734373760:12345-192.168.202.4@tcp:3:cat.0 Request processed in 21405us (21709us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129579.552594:0:31519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8109 00002000:00100000:1.0:1746129579.552603:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3ef:0x0] (2097152->3145727) req@ffff880094028a80 x1830948734373760/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:320/0 lens 488/440 e 0 to 0 dl 1746129590 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129579.552612:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094028a80 with x1830948734373760 ext(2097152->3145727) 00002000:00010000:1.0:1746129579.552617:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094028a80 00000100:00100000:2.0:1746129579.554129:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094029f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+14:1962:x1830948734373888:12345-192.168.202.4@tcp:3:cat.0 Request processed in 22686us (23214us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129579.554137:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8110 00002000:00100000:2.0:1746129579.554144:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff880094029f80 x1830948734373888/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:320/0 lens 488/440 e 0 to 0 dl 1746129590 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129579.554152:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094029f80 with x1830948734373888 ext(1048576->2097151) 00002000:00010000:2.0:1746129579.554156:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094029f80 00000100:00100000:0.0:1746129579.559657:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129579.560463:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734374272 00000100:00100000:1.0:1746129579.560471:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734374272 00000100:00100000:1.0:1746129579.560517:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16712 00000100:00100000:1.0:1746129579.560524:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094028380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ada2ffba-8920-4ecb-8068-68caa9806978+23:32599:x1830948734374272:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129579.560539:0:4385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129579.560553:0:4385:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091545400/0x40a459093b06b574 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21f89 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129579.560581:0:4385:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012cc34000/0x40a459093b06b551 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2654207) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21f66 expref: 13 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129579.560588:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129579.560589:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129579.560593:0:4385:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091545400/0x40a459093b06b574 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21f89 expref: 24 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129579.560614:0:4385:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012cc34000/0x40a459093b06b551 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2654207) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21f66 expref: 13 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129579.560623:0:4385:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012cc34000/0x40a459093b06b551 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2654207) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21f66 expref: 13 pid: 22480 timeout: 934 lvb_type: 0 00000100:00100000:1.0:1746129579.560633:0:4385:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800959d6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:4385:1830948737603328:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129579.560692:0:4385:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130fc9f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746129579.561340:0:31521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094028000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+12:1962:x1830948734374016:12345-192.168.202.4@tcp:3:cat.0 Request processed in 28715us (30353us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129579.561348:0:31521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8111 00002000:00100000:2.0:1746129579.561356:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f4:0x0] (1048576->2097151) req@ffff880094028000 x1830948734374016/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:320/0 lens 488/440 e 0 to 0 dl 1746129590 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129579.561364:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094028000 with x1830948734374016 ext(1048576->2097151) 00002000:00010000:2.0:1746129579.561368:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094028000 00000100:00100000:1.0:1746129579.564658:0:4385:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800959d6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:4385:1830948737603328:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129579.564684:0:4385:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091545400/0x40a459093b06b574 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21f89 expref: 24 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129579.564699:0:4385:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091545400, rc 0) 00000100:00100000:1.0:1746129579.564743:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094028380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ada2ffba-8920-4ecb-8068-68caa9806978+24:32599:x1830948734374272:12345-192.168.202.4@tcp:101:cat.0 Request processed in 4219us (5093us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129579.564750:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16712 00000100:00100000:0.0:1746129579.564998:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129579.565202:0:31521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734374400 00000100:00100000:3.0:1746129579.565208:0:31521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734374400 00002000:00100000:3.0:1746129579.565247:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f5:0x0] (2097152->2654207) req@ffff88009c7d8000 x1830948734374400/t0(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:320/0 lens 488/0 e 0 to 0 dl 1746129590 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129579.565256:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7d8000 with x1830948734374400 ext(2097152->2654207) 00010000:00010000:3.0:1746129579.565261:0:31521:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012cc34000/0x40a459093b06b551 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2654207) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21f66 expref: 12 pid: 22480 timeout: 934 lvb_type: 0 00010000:00010000:3.0:1746129579.565271:0:31521:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012cc34000/0x40a459093b06b551 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2654207) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21f66 expref: 12 pid: 22480 timeout: 934 lvb_type: 0 00002000:00010000:3.0:1746129579.565277:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c7d8000 00000100:00100000:3.0:1746129579.565309:0:31521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2505 00000100:00100000:3.0:1746129579.565315:0:31521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+12:1963:x1830948734374400:12345-192.168.202.4@tcp:4:cat.0 00000100:00100000:2.0:1746129579.571454:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129579.571709:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734374528 00000100:00100000:1.0:1746129579.571716:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734374528 00000100:00100000:1.0:1746129579.571760:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16713 00000100:00100000:1.0:1746129579.571766:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c079880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+22:32609:x1830948734374528:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129579.571780:0:4385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129579.571794:0:4385:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091545600/0x40a459093b06b57b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21f90 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129579.571814:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129579.571815:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129579.571821:0:4385:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091545600/0x40a459093b06b57b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21f90 expref: 23 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129579.571833:0:4385:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091545600/0x40a459093b06b57b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21f90 expref: 23 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129579.571841:0:4385:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091545600, rc 0) 00000100:00100000:1.0:1746129579.571887:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c079880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+23:32609:x1830948734374528:12345-192.168.202.4@tcp:101:cat.0 Request processed in 120us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129579.571893:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16713 00000100:00100000:2.0:1746129579.573509:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129579.574634:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734374656 00000100:00100000:3.0:1746129579.574642:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734374656 00000100:00100000:3.0:1746129579.574689:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11334 00000100:00100000:3.0:1746129579.574697:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c079f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:068dab75-d300-4ead-a742-d14572ad1e50+12:32610:x1830948734374656:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:3.0:1746129579.574714:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129579.574728:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8d5400/0x40a459093b06b582 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21f97 expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129579.574774:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8d4c00/0x40a459093b06b589 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129579.574787:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8d4c00/0x40a459093b06b589 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129579.574796:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8d4c00/0x40a459093b06b589 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129579.574806:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8d5600/0x40a459093b06b590 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129579.574811:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8d5600/0x40a459093b06b590 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129579.574815:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8d5600/0x40a459093b06b590 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129579.574899:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8d4200/0x40a459093b06b597 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129579.574906:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8d4200/0x40a459093b06b597 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129579.574912:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8d4200/0x40a459093b06b597 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00200000:3.0:1746129579.574936:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00000004:00200000:3.0:1746129579.574939:0:14549:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746129579.574949:0:14549:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8d4200/0x40a459093b06b597 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129579.574956:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8d4200/0x40a459093b06b597 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129579.574962:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8d4c00/0x40a459093b06b589 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129579.574970:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8d4c00/0x40a459093b06b589 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129579.574975:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8d4c00/0x40a459093b06b589 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129579.574980:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f8d4c00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:3.0:1746129579.574983:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8d4c00/0x40a459093b06b589 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129579.574988:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8d4c00/0x40a459093b06b589 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129579.574996:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880132ef8f00) 00010000:00010000:3.0:1746129579.574999:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129579.575002:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8d4c00/0x40a459093b06b589 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129579.575007:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8d4c00/0x40a459093b06b589 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129579.575028:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8d5600/0x40a459093b06b590 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129579.575209:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8d5600/0x40a459093b06b590 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129579.575214:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8d5600/0x40a459093b06b590 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129579.575217:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f8d5600 already unused, calling callback (ffffffffa136e690) 00010000:00010000:3.0:1746129579.575219:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8d5600/0x40a459093b06b590 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129579.575227:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8d5600/0x40a459093b06b590 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129579.575232:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800938dd600) 00010000:00010000:3.0:1746129579.575234:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129579.575246:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8d5600/0x40a459093b06b590 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129579.575250:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8d5600/0x40a459093b06b590 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129579.575270:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8d5400/0x40a459093b06b582 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21f97 expref: 14 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129579.575278:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8d4200/0x40a459093b06b597 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21f97 expref: 13 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129579.575284:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:3.0:1746129579.575285:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746129579.575287:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f8d4200, rc 0) 00000100:00100000:3.0:1746129579.575641:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c079f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:068dab75-d300-4ead-a742-d14572ad1e50+13:32610:x1830948734374656:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 943us (2133us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129579.575647:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11334 00000100:00100000:3.0:1746129579.577582:0:31521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+14:1963:x1830948734374400:12345-192.168.202.4@tcp:4:cat.0 Request processed in 12263us (12581us total) trans 17179874174 rc 0/0 00000100:00100000:3.0:1746129579.577591:0:31521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2505 00002000:00100000:3.0:1746129579.577599:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f5:0x0] (2097152->2654207) req@ffff88009c7d8000 x1830948734374400/t17179874174(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:320/0 lens 488/448 e 0 to 0 dl 1746129590 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129579.577613:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7d8000 with x1830948734374400 ext(2097152->2654207) 00010000:00010000:3.0:1746129579.577621:0:31521:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012cc34000/0x40a459093b06b551 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2654207) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21f66 expref: 14 pid: 22480 timeout: 934 lvb_type: 0 00010000:00010000:3.0:1746129579.577633:0:31521:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012cc34000/0x40a459093b06b551 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2654207) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21f66 expref: 14 pid: 22480 timeout: 934 lvb_type: 0 00002000:00010000:3.0:1746129579.577638:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c7d8000 00000100:00100000:0.0:1746129579.578850:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129579.578985:0:31521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734374912 00000100:00100000:3.0:1746129579.578991:0:31521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734374912 00002000:00100000:3.0:1746129579.579019:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3ef:0x0] (2097152->3145727) req@ffff88009c7db100 x1830948734374912/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:320/0 lens 488/0 e 0 to 0 dl 1746129590 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129579.579027:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7db100 with x1830948734374912 ext(2097152->3145727) 00002000:00010000:3.0:1746129579.579030:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c7db100 00000100:00100000:3.0:1746129579.579054:0:31521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8112 00000100:00100000:3.0:1746129579.579061:0:31521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+23:1962:x1830948734374912:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129579.580504:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129579.581272:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129579.582275:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734375040 00000100:00100000:1.0:1746129579.582284:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734375040 00000100:00100000:1.0:1746129579.582345:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734375168 00000100:00100000:1.0:1746129579.582348:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734375168 00000100:00100000:1.0:1746129579.582365:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16714 00000100:00100000:1.0:1746129579.582372:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:068dab75-d300-4ead-a742-d14572ad1e50+6:1963:x1830948734375040:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:1.0:1746129579.582388:0:4385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129579.582402:0:4385:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091545e00/0x40a459093b06b59e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21f9e expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129579.582425:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129579.582427:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129579.582433:0:4385:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091545e00/0x40a459093b06b59e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21f9e expref: 7 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129579.582446:0:4385:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091545e00/0x40a459093b06b59e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21f9e expref: 7 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129579.582455:0:4385:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091545e00, rc 0) 00000100:00100000:1.0:1746129579.582490:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:068dab75-d300-4ead-a742-d14572ad1e50+7:1963:x1830948734375040:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 119us (1988us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129579.582495:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16714 00000100:00100000:1.0:1746129579.582514:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16715 00000100:00100000:1.0:1746129579.582518:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:068dab75-d300-4ead-a742-d14572ad1e50+7:1963:x1830948734375168:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:1.0:1746129579.582525:0:4385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129579.582533:0:4385:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091545a00/0x40a459093b06b5a5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21fa5 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129579.582563:0:4385:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800959d6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:4385:1830948737603456:192.168.202.4@tcp:106: 00000100:00100000:1.0:1746129579.582610:0:4385:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130fc9f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746129579.583322:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129579.584863:0:7086:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734375424 00000100:00100000:2.0:1746129579.584869:0:7086:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734375424 00010000:00010000:2.0:1746129579.584893:0:7086:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012cc34000/0x40a459093b06b551 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2654207) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21f66 expref: 14 pid: 22480 timeout: 934 lvb_type: 0 00000100:00100000:2.0:1746129579.584917:0:7086:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8640 00000100:00100000:2.0:1746129579.584921:0:7086:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+14:1960:x1830948734375424:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129579.584930:0:7086:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746129579.584942:0:7086:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f5:0x0] updating lvb mtime from disk: 1746129579 -> 1746129580 00002000:00010000:2.0:1746129579.584944:0:7086:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f5:0x0] updating lvb ctime from disk: 1746129579 -> 1746129580 00010000:00010000:2.0:1746129579.584948:0:7086:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012cc34000/0x40a459093b06b551 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2654207) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21f66 expref: 14 pid: 22480 timeout: 934 lvb_type: 0 00010000:00010000:2.0:1746129579.584955:0:7086:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012cc34000/0x40a459093b06b551 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2654207) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21f66 expref: 14 pid: 22480 timeout: 934 lvb_type: 0 00010000:00010000:2.0:1746129579.584968:0:7086:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012cc34000/0x40a459093b06b551 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2654207) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21f66 expref: 14 pid: 22480 timeout: 934 lvb_type: 0 00010000:00010000:2.0:1746129579.584980:0:7086:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129579.584982:0:7086:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129579.584986:0:7086:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091545400/0x40a459093b06b574 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21f89 expref: 23 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129579.584991:0:7086:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091545400/0x40a459093b06b574 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21f89 expref: 23 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129579.585007:0:7086:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091545400/0x40a459093b06b574 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21f89 expref: 23 pid: 4385 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129579.585013:0:7086:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c078380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7086:1830948737603584:192.168.202.4@tcp:105: 00000100:00100000:2.0:1746129579.585067:0:7086:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132f363c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129579.589262:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129579.589365:0:22480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734375296 00000100:00100000:3.0:1746129579.589373:0:22480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734375296 00000100:00100000:3.0:1746129579.589404:0:22480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16716 00000100:00100000:3.0:1746129579.589410:0:22480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:068dab75-d300-4ead-a742-d14572ad1e50+7:1963:x1830948734375296:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:3.0:1746129579.589423:0:22480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129579.589436:0:22480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f8d5400/0x40a459093b06b5ac lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21fac expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129579.589454:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129579.589456:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129579.589463:0:22480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f8d5400/0x40a459093b06b5ac lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21fac expref: 8 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129579.589474:0:22480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f8d5400/0x40a459093b06b5ac lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21fac expref: 8 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129579.589482:0:22480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f8d5400, rc 0) 00000100:00100000:3.0:1746129579.589526:0:22480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:068dab75-d300-4ead-a742-d14572ad1e50+8:1963:x1830948734375296:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 116us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129579.589531:0:22480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16716 00000100:00100000:1.0:1746129579.595371:0:4385:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800959d6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:4385:1830948737603456:192.168.202.4@tcp:106: 00010000:00010000:1.0:1746129579.595399:0:4385:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091545a00/0x40a459093b06b5a5 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21fa5 expref: 8 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129579.595411:0:4385:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091545a00/0x40a459093b06b5a5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21fa5 expref: 8 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129579.595438:0:4385:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091545a00, rc 0) 00000100:00100000:1.0:1746129579.595477:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:068dab75-d300-4ead-a742-d14572ad1e50+7:1963:x1830948734375168:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 12957us (14205us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129579.595485:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16715 00000100:00100000:2.0:1746129579.595967:0:7086:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c078380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7086:1830948737603584:192.168.202.4@tcp:105: 00010000:00010000:2.0:1746129579.595989:0:7086:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129579.596009:0:7086:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+13:1960:x1830948734375424:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 11086us (12688us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129579.596016:0:7086:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8640 00000100:00100000:3.0:1746129579.598409:0:31521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+23:1962:x1830948734374912:12345-192.168.202.4@tcp:3:cat.0 Request processed in 19342us (19553us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129579.598420:0:31521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8112 00002000:00100000:3.0:1746129579.598430:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3ef:0x0] (2097152->3145727) req@ffff88009c7db100 x1830948734374912/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:320/0 lens 488/440 e 0 to 0 dl 1746129590 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129579.598439:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7db100 with x1830948734374912 ext(2097152->3145727) 00002000:00010000:3.0:1746129579.598443:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c7db100 00000100:00100000:1.0:1746129579.598839:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129579.598898:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734375680 00000100:00100000:3.0:1746129579.598904:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734375680 00000100:00100000:3.0:1746129579.598933:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11335 00000100:00100000:3.0:1746129579.598938:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:068dab75-d300-4ead-a742-d14572ad1e50+13:32610:x1830948734375680:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:3.0:1746129579.598953:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129579.598967:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8d4000/0x40a459093b06b5b3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21fb3 expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129579.599045:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8d5600/0x40a459093b06b5ba lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129579.599058:0:14549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8d4200/0x40a459093b06b597 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21f97 expref: 14 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129579.599064:0:14549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8d5600/0x40a459093b06b5ba lrc: 4/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129579.599089:0:14549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8d4200/0x40a459093b06b597 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21f97 expref: 14 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129579.599099:0:14549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8d4200/0x40a459093b06b597 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21f97 expref: 14 pid: 14549 timeout: 934 lvb_type: 0 00000100:00100000:3.0:1746129579.599109:0:14549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830948737603712:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129579.599176:0:14549:0:(client.c:2553:ptlrpc_set_wait()) set ffff880135a550c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746129579.603669:0:14549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830948737603712:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129579.603694:0:14549:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8d5600/0x40a459093b06b5ba lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000100:00100000:0.0:1746129579.603889:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129579.604814:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129579.604874:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734375936 00000100:00100000:1.0:1746129579.604880:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734375936 00000100:00100000:1.0:1746129579.604909:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16717 00000100:00100000:1.0:1746129579.604914:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+13:32609:x1830948734375936:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129579.604927:0:4385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129579.604939:0:4385:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091545200/0x40a459093b06b5c1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21fba expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129579.604957:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129579.604959:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129579.604964:0:4385:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091545200/0x40a459093b06b5c1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21fba expref: 14 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129579.604976:0:4385:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091545200/0x40a459093b06b5c1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21fba expref: 14 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129579.604983:0:4385:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091545200, rc 0) 00000100:00100000:1.0:1746129579.605013:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+14:32609:x1830948734375936:12345-192.168.202.4@tcp:101:cat.0 Request processed in 98us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129579.605017:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16717 00000100:00100000:2.0:1746129579.605175:0:7086:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734375808 00000100:00100000:2.0:1746129579.605179:0:7086:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734375808 00010000:00010000:2.0:1746129579.605194:0:7086:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8d4200/0x40a459093b06b597 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21f97 expref: 15 pid: 14549 timeout: 934 lvb_type: 0 00000100:00100000:2.0:1746129579.605218:0:7086:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8641 00000100:00100000:2.0:1746129579.605222:0:7086:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:068dab75-d300-4ead-a742-d14572ad1e50+15:1961:x1830948734375808:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129579.605230:0:7086:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129579.605244:0:7086:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8d4200/0x40a459093b06b597 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21f97 expref: 15 pid: 14549 timeout: 934 lvb_type: 0 00010000:00010000:2.0:1746129579.605254:0:7086:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8d4200/0x40a459093b06b597 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21f97 expref: 15 pid: 14549 timeout: 934 lvb_type: 0 00010000:00010000:2.0:1746129579.605269:0:7086:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8d4200/0x40a459093b06b597 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21f97 expref: 15 pid: 14549 timeout: 934 lvb_type: 0 00010000:00010000:2.0:1746129579.605283:0:7086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:2.0:1746129579.605287:0:7086:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8d5600/0x40a459093b06b5ba lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129579.605310:0:7086:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8d5600/0x40a459093b06b5ba lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129579.605316:0:7086:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8d5600/0x40a459093b06b5ba lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129579.605341:0:7086:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129579.605357:0:7086:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:068dab75-d300-4ead-a742-d14572ad1e50+14:1961:x1830948734375808:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 134us (1469us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129579.605362:0:7086:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8641 00010000:00010000:3.0:1746129579.605419:0:14549:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8d5600/0x40a459093b06b5ba lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129579.605425:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8d5600/0x40a459093b06b5ba lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00200000:3.0:1746129579.605439:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:3.0:1746129579.605543:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8d4000/0x40a459093b06b5b3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21fb3 expref: 15 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129579.605556:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8d5600/0x40a459093b06b5ba lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21fb3 expref: 14 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129579.605561:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:3.0:1746129579.605563:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746129579.605565:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f8d5600, rc 0) 00000100:00100000:3.0:1746129579.605586:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:068dab75-d300-4ead-a742-d14572ad1e50+14:32610:x1830948734375680:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 6648us (6748us total) trans 8589945455 rc 0/0 00000100:00100000:3.0:1746129579.605592:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11335 00000100:00100000:0.0:1746129579.605877:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129579.605920:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129579.605933:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734376320 00000100:00100000:0.0:1746129579.605936:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734376320 00002000:00100000:0.0:1746129579.605958:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->4194303) req@ffff8800900f6300 x1830948734376320/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:320/0 lens 504/0 e 0 to 0 dl 1746129590 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129579.605966:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800900f6300 with x1830948734376320 ext(3145728->4194303) 00002000:00010000:0.0:1746129579.605970:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800900f6300 00000100:00100000:0.0:1746129579.605979:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734376448 00000100:00100000:0.0:1746129579.605980:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734376448 00002000:00100000:0.0:1746129579.605989:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f5:0x0] (2097152->3145727) req@ffff8800900f7800 x1830948734376448/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:320/0 lens 488/0 e 0 to 0 dl 1746129590 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129579.605995:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800900f7800 with x1830948734376448 ext(2097152->3145727) 00002000:00010000:0.0:1746129579.605997:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800900f7800 00000100:00100000:0.0:1746129579.606012:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8113 00000100:00100000:0.0:1746129579.606016:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+35:1962:x1830948734376320:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:1.0:1746129579.606359:0:31519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8114 00000100:00100000:1.0:1746129579.606367:0:31519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ada2ffba-8920-4ecb-8068-68caa9806978+24:1962:x1830948734376448:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:1.0:1746129579.607383:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129579.608496:0:21725:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734376576 00000100:00100000:3.0:1746129579.608501:0:21725:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734376576 00002000:00100000:3.0:1746129579.608523:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f5:0x0] (3145728->4194303) req@ffff8800959d5180 x1830948734376576/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:320/0 lens 488/0 e 0 to 0 dl 1746129590 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129579.608529:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800959d5180 with x1830948734376576 ext(3145728->4194303) 00002000:00010000:3.0:1746129579.608532:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800959d5180 00000100:00100000:3.0:1746129579.608544:0:21725:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8115 00000100:00100000:3.0:1746129579.608548:0:21725:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ada2ffba-8920-4ecb-8068-68caa9806978+26:1962:x1830948734376576:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129579.610895:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129579.610914:0:11014:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734376832 00000100:00100000:0.0:1746129579.610920:0:11014:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734376832 00000100:00100000:0.0:1746129579.610952:0:11014:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16718 00000100:00100000:0.0:1746129579.610958:0:11014:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:068dab75-d300-4ead-a742-d14572ad1e50+7:1962:x1830948734376832:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:0.0:1746129579.610975:0:11014:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129579.610988:0:11014:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012cc34400/0x40a459093b06b5cf lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21fc1 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129579.611028:0:11014:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900f5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11014:1830948737603840:192.168.202.4@tcp:106: 00000100:00100000:0.0:1746129579.611082:0:11014:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa3819c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129579.614873:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129579.617663:0:8416:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734377088 00000100:00100000:1.0:1746129579.617672:0:8416:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734377088 00002000:00100000:1.0:1746129579.617705:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3f5:0x0] (2097152->3145727) req@ffff8800900f4700 x1830948734377088/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:320/0 lens 488/0 e 0 to 0 dl 1746129590 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129579.617713:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800900f4700 with x1830948734377088 ext(2097152->3145727) 00002000:00010000:1.0:1746129579.617717:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800900f4700 00000100:00100000:1.0:1746129579.617746:0:8416:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8116 00000100:00100000:1.0:1746129579.617753:0:8416:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+14:1960:x1830948734377088:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129579.620431:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129579.620524:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734377344 00000100:00100000:3.0:1746129579.620531:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734377344 00000100:00100000:3.0:1746129579.620565:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11336 00000100:00100000:3.0:1746129579.620571:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+14:32612:x1830948734377344:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:3.0:1746129579.620591:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129579.620617:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9209600/0x40a459093b06b5d6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21fc8 expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129579.620690:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9208400/0x40a459093b06b5dd lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129579.620706:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9208400/0x40a459093b06b5dd lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129579.620715:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9208400/0x40a459093b06b5dd lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00200000:3.0:1746129579.620725:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:3.0:1746129579.620816:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9209600/0x40a459093b06b5d6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21fc8 expref: 17 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129579.620833:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9208400/0x40a459093b06b5dd lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21fc8 expref: 16 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129579.620841:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:3.0:1746129579.620843:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746129579.620846:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a9208400, rc 0) 00000100:00100000:3.0:1746129579.620876:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+16:32612:x1830948734377344:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 304us (451us total) trans 8589945456 rc 0/0 00000100:00100000:3.0:1746129579.620882:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11336 00000100:00100000:2.0:1746129579.621810:0:11014:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900f5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11014:1830948737603840:192.168.202.4@tcp:106: 00010000:00010000:2.0:1746129579.621833:0:11014:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012cc34400/0x40a459093b06b5cf lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21fc1 expref: 8 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129579.621843:0:11014:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012cc34400/0x40a459093b06b5cf lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21fc1 expref: 8 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129579.621864:0:11014:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cc34400, rc 0) 00000100:00100000:2.0:1746129579.621891:0:11014:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:068dab75-d300-4ead-a742-d14572ad1e50+7:1962:x1830948734376832:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 10932us (11001us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129579.621897:0:11014:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16718 00000100:00100000:1.0:1746129579.622344:0:31519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ada2ffba-8920-4ecb-8068-68caa9806978+26:1962:x1830948734376448:12345-192.168.202.4@tcp:3:cat.0 Request processed in 15977us (16422us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129579.622351:0:31519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8114 00002000:00100000:1.0:1746129579.622358:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f5:0x0] (2097152->3145727) req@ffff8800900f7800 x1830948734376448/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:320/0 lens 488/440 e 0 to 0 dl 1746129590 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129579.622366:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800900f7800 with x1830948734376448 ext(2097152->3145727) 00002000:00010000:1.0:1746129579.622370:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800900f7800 00000100:00100000:1.0:1746129579.626119:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+35:1962:x1830948734376320:12345-192.168.202.4@tcp:3:cat.0 Request processed in 20091us (20232us total) trans 0 rc 831488/831488 00000100:00100000:1.0:1746129579.626130:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8113 00002000:00100000:1.0:1746129579.626141:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->4194303) req@ffff8800900f6300 x1830948734376320/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:320/0 lens 504/440 e 0 to 0 dl 1746129590 ref 1 fl Complete:/200/0 rc 831488/831488 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129579.626150:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800900f6300 with x1830948734376320 ext(3145728->4194303) 00002000:00010000:1.0:1746129579.626155:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800900f6300 00000100:00100000:3.0:1746129579.628425:0:21725:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ada2ffba-8920-4ecb-8068-68caa9806978+24:1962:x1830948734376576:12345-192.168.202.4@tcp:3:cat.0 Request processed in 19869us (21037us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129579.628434:0:21725:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8115 00002000:00100000:3.0:1746129579.628441:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f5:0x0] (3145728->4194303) req@ffff8800959d5180 x1830948734376576/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:320/0 lens 488/440 e 0 to 0 dl 1746129590 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129579.628449:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800959d5180 with x1830948734376576 ext(3145728->4194303) 00002000:00010000:3.0:1746129579.628453:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800959d5180 00000100:00100000:1.0:1746129579.634212:0:8416:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+14:1960:x1830948734377088:12345-192.168.202.4@tcp:3:cat.0 Request processed in 16451us (19338us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129579.634222:0:8416:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8116 00002000:00100000:1.0:1746129579.634233:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3f5:0x0] (2097152->3145727) req@ffff8800900f4700 x1830948734377088/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:320/0 lens 488/440 e 0 to 0 dl 1746129590 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129579.634253:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800900f4700 with x1830948734377088 ext(2097152->3145727) 00002000:00010000:1.0:1746129579.634258:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800900f4700 00000100:00100000:0.0:1746129579.641208:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129579.642611:0:2271:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734377600 00000100:00100000:2.0:1746129579.642622:0:2271:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734377600 00000100:00100000:2.0:1746129579.642694:0:2271:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11337 00000100:00100000:2.0:1746129579.642703:0:2271:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:068dab75-d300-4ead-a742-d14572ad1e50+14:32610:x1830948734377600:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:2.0:1746129579.642733:0:2271:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129579.642736:0:2271:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746129579.642767:0:2271:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8d5600/0x40a459093b06b5ba lrc: 0/0,0 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21fb3 expref: 14 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129579.642797:0:2271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:2.0:1746129579.642803:0:2271:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746129579.642816:0:2271:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094275c00/0x40a459093b06b5eb lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21fcf expref: -99 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129579.642916:0:2271:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880094274600/0x40a459093b06b5f2 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129579.642930:0:2271:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9208400/0x40a459093b06b5dd lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21fc8 expref: 15 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129579.642938:0:2271:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094274600/0x40a459093b06b5f2 lrc: 4/0,1 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:2.0:1746129579.642979:0:2271:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9208400/0x40a459093b06b5dd lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21fc8 expref: 15 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129579.642996:0:2271:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9208400/0x40a459093b06b5dd lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21fc8 expref: 15 pid: 14549 timeout: 934 lvb_type: 0 00000100:00100000:2.0:1746129579.643008:0:2271:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c078380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:2271:1830948737603968:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129579.643097:0:2271:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132f363c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746129579.647029:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129579.647091:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129579.647152:0:11014:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734377728 00000100:00100000:0.0:1746129579.647161:0:11014:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734377728 00000100:00100000:0.0:1746129579.647220:0:11014:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16719 00000100:00100000:0.0:1746129579.647228:0:11014:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c078a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+23:32609:x1830948734377728:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129579.647258:0:11014:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129579.647277:0:11014:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008fba4c00/0x40a459093b06b5f9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21fd6 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129579.647332:0:11014:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a77f6a00/0x40a459093b06b4f6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3960832->4177919) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21f2e expref: 34 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129579.647340:0:11014:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129579.647342:0:11014:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129579.647346:0:11014:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008fba4c00/0x40a459093b06b5f9 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21fd6 expref: 24 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129579.647379:0:11014:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a77f6a00/0x40a459093b06b4f6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3960832->4177919) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21f2e expref: 34 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129579.647394:0:11014:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a77f6a00/0x40a459093b06b4f6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3960832->4177919) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21f2e expref: 34 pid: 22480 timeout: 934 lvb_type: 0 00000100:00100000:0.0:1746129579.647405:0:11014:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900f6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11014:1830948737604096:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129579.647496:0:11014:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa381900 going to sleep for 11 seconds 00000100:00100000:3.0:1746129579.647929:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734377856 00000100:00100000:3.0:1746129579.647938:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734377856 00010000:00010000:3.0:1746129579.647974:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9208400/0x40a459093b06b5dd lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21fc8 expref: 16 pid: 14549 timeout: 934 lvb_type: 0 00000100:00100000:3.0:1746129579.648004:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8642 00000100:00100000:3.0:1746129579.648010:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c079180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+16:1961:x1830948734377856:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129579.648024:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129579.648028:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9208400/0x40a459093b06b5dd lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21fc8 expref: 16 pid: 14549 timeout: 934 lvb_type: 0 00010000:00010000:3.0:1746129579.648038:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9208400/0x40a459093b06b5dd lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21fc8 expref: 16 pid: 14549 timeout: 934 lvb_type: 0 00010000:00010000:3.0:1746129579.648055:0:7085:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:3.0:1746129579.648060:0:7085:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880094274600/0x40a459093b06b5f2 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129579.648069:0:7085:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094274600/0x40a459093b06b5f2 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT flags: 0x50290000000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129579.648074:0:7085:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094274600/0x40a459093b06b5f2 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT flags: 0x50290000000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129579.648089:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129579.648134:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c079180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+16:1961:x1830948734377856:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 124us (1043us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129579.648140:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8642 00010000:00010000:3.0:1746129579.648187:0:2271:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9208400/0x40a459093b06b5dd lrc: 0/0,0 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21fc8 expref: 15 pid: 14549 timeout: 934 lvb_type: 0 00000100:00100000:3.0:1746129579.648204:0:2271:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c078380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:2271:1830948737603968:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129579.648221:0:2271:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880094274600/0x40a459093b06b5f2 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129579.648228:0:2271:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880094274600/0x40a459093b06b5f2 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129579.648232:0:2271:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094274600/0x40a459093b06b5f2 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129579.648257:0:2271:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880094274600/0x40a459093b06b5f2 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129579.648263:0:2271:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094274600/0x40a459093b06b5f2 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210400000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129579.648268:0:2271:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094274600/0x40a459093b06b5f2 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129579.648273:0:2271:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094274600 already unused, calling callback (ffffffffa136e690) 00010000:00010000:3.0:1746129579.648276:0:2271:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094274600/0x40a459093b06b5f2 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129579.648282:0:2271:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094274600/0x40a459093b06b5f2 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40218400000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129579.648289:0:2271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:3.0:1746129579.648324:0:2271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746129579.648327:0:2271:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094274600/0x40a459093b06b5f2 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129579.648332:0:2271:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094274600/0x40a459093b06b5f2 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 2271 initiator: MDT0 00010000:00010000:3.0:1746129579.648361:0:2271:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094275c00/0x40a459093b06b5eb lrc: 1/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x1/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21fcf expref: 14 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129579.648367:0:2271:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094275c00/0x40a459093b06b5eb lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x1/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21fcf expref: 14 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129579.648374:0:2271:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094275c00, rc 0) 00000100:00100000:3.0:1746129579.648392:0:2271:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:068dab75-d300-4ead-a742-d14572ad1e50+13:32610:x1830948734377600:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 5691us (7197us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129579.648398:0:2271:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11337 00000100:00100000:2.0:1746129579.656654:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129579.656907:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129579.656986:0:11014:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900f6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11014:1830948737604096:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129579.657018:0:11014:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008fba4c00/0x40a459093b06b5f9 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21fd6 expref: 24 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129579.657036:0:11014:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fba4c00, rc 0) 00000100:00100000:1.0:1746129579.657268:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734377984 00000100:00100000:1.0:1746129579.657275:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734377984 00000100:00100000:1.0:1746129579.657350:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16720 00000100:00100000:1.0:1746129579.657357:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c078e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ada2ffba-8920-4ecb-8068-68caa9806978+35:1962:x1830948734377984:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129579.657373:0:4385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129579.657387:0:4385:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091544800/0x40a459093b06b600 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21fdd expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129579.657430:0:4385:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800959d7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:4385:1830948737604224:192.168.202.4@tcp:106: 00000100:00100000:1.0:1746129579.657898:0:14551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734378240 00000100:00100000:1.0:1746129579.657901:0:14551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734378240 00000100:00100000:1.0:1746129579.657935:0:14551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4832 00000100:00100000:1.0:1746129579.657941:0:14551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c079c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:068dab75-d300-4ead-a742-d14572ad1e50+13:32610:x1830948734378240:12345-192.168.202.4@tcp:35:lfs.0 00000100:00100000:1.0:1746129579.658129:0:14551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c079c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:068dab75-d300-4ead-a742-d14572ad1e50+14:32610:x1830948734378240:12345-192.168.202.4@tcp:35:lfs.0 Request processed in 188us (1222us total) trans 8589945457 rc 0/0 00000100:00100000:1.0:1746129579.658136:0:14551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4832 00000100:00100000:1.0:1746129579.658181:0:4385:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130fc9f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746129579.658480:0:11014:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c078a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+24:32609:x1830948734377728:12345-192.168.202.4@tcp:101:cat.0 Request processed in 11251us (11459us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129579.658486:0:11014:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16719 00000100:00100000:2.0:1746129579.658672:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129579.658875:0:8416:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734378368 00000100:00100000:1.0:1746129579.658880:0:8416:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734378368 00002000:00100000:1.0:1746129579.658906:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3ef:0x0] (3960832->4177919) req@ffff88009c07bb80 x1830948734378368/t0(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:320/0 lens 488/0 e 0 to 0 dl 1746129590 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129579.658916:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c07bb80 with x1830948734378368 ext(3960832->4177919) 00010000:00010000:1.0:1746129579.658923:0:8416:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a77f6a00/0x40a459093b06b4f6 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3960832->4177919) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21f2e expref: 37 pid: 22480 timeout: 934 lvb_type: 0 00010000:00010000:1.0:1746129579.658935:0:8416:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a77f6a00/0x40a459093b06b4f6 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3960832->4177919) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21f2e expref: 37 pid: 22480 timeout: 934 lvb_type: 0 00002000:00010000:1.0:1746129579.658942:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009c07bb80 00000100:00100000:1.0:1746129579.658955:0:8416:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2506 00000100:00100000:1.0:1746129579.658960:0:8416:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c07bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ada2ffba-8920-4ecb-8068-68caa9806978+37:1960:x1830948734378368:12345-192.168.202.4@tcp:4:cat.0 00000100:00100000:1.0:1746129579.663594:0:4385:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800959d7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:4385:1830948737604224:192.168.202.4@tcp:106: 00010000:00010000:1.0:1746129579.663634:0:4385:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091544800/0x40a459093b06b600 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21fdd expref: 38 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129579.663650:0:4385:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091544800/0x40a459093b06b600 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21fdd expref: 38 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129579.663662:0:4385:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091544800, rc 0) 00000100:00100000:1.0:1746129579.663718:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c078e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ada2ffba-8920-4ecb-8068-68caa9806978+37:1962:x1830948734377984:12345-192.168.202.4@tcp:101:cat.0 Request processed in 6360us (7074us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129579.663727:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16720 00000100:00100000:2.0:1746129579.665015:0:8416:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c07bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ada2ffba-8920-4ecb-8068-68caa9806978+37:1960:x1830948734378368:12345-192.168.202.4@tcp:4:cat.0 Request processed in 6050us (6338us total) trans 21474841415 rc 0/0 00000100:00100000:2.0:1746129579.665025:0:8416:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2506 00002000:00100000:2.0:1746129579.665037:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3ef:0x0] (3960832->4177919) req@ffff88009c07bb80 x1830948734378368/t21474841415(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:320/0 lens 488/448 e 0 to 0 dl 1746129590 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129579.665045:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c07bb80 with x1830948734378368 ext(3960832->4177919) 00010000:00010000:2.0:1746129579.665054:0:8416:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a77f6a00/0x40a459093b06b4f6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3960832->4177919) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21f2e expref: 37 pid: 22480 timeout: 934 lvb_type: 0 00010000:00010000:2.0:1746129579.665070:0:8416:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a77f6a00/0x40a459093b06b4f6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3960832->4177919) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21f2e expref: 37 pid: 22480 timeout: 934 lvb_type: 0 00002000:00010000:2.0:1746129579.665076:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009c07bb80 00000100:00100000:0.0:1746129579.671532:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129579.671780:0:7086:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734378496 00000100:00100000:2.0:1746129579.671789:0:7086:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734378496 00010000:00010000:2.0:1746129579.671833:0:7086:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a77f6a00/0x40a459093b06b4f6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3960832->4177919) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21f2e expref: 37 pid: 22480 timeout: 934 lvb_type: 0 00000100:00100000:0.0:1746129579.672396:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129579.672501:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734378624 00000100:00100000:1.0:1746129579.672512:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734378624 00000100:00100000:2.0:1746129579.672516:0:7086:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8643 00000100:00100000:2.0:1746129579.672527:0:7086:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6ce3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ada2ffba-8920-4ecb-8068-68caa9806978+38:1960:x1830948734378496:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129579.672541:0:7086:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746129579.672559:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16721 00000100:00100000:1.0:1746129579.672566:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ada2ffba-8920-4ecb-8068-68caa9806978+38:32599:x1830948734378624:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129579.672567:0:7086:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a77f6a00/0x40a459093b06b4f6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3960832->4177919) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21f2e expref: 38 pid: 22480 timeout: 934 lvb_type: 0 00010000:00010000:1.0:1746129579.672580:0:4385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129579.672581:0:7086:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a77f6a00/0x40a459093b06b4f6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3960832->4177919) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21f2e expref: 38 pid: 22480 timeout: 934 lvb_type: 0 00010000:00010000:1.0:1746129579.672593:0:4385:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091544a00/0x40a459093b06b607 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21fe4 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129579.672606:0:7086:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a77f6a00/0x40a459093b06b4f6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 7 type: EXT [3145728->18446744073709551615] (req 3960832->4177919) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21f2e expref: 39 pid: 22480 timeout: 934 lvb_type: 0 00010000:00010000:1.0:1746129579.672613:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129579.672615:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129579.672621:0:4385:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091544a00/0x40a459093b06b607 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->5148671) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21fe4 expref: 38 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129579.672632:0:4385:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091544a00/0x40a459093b06b607 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->5148671) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21fe4 expref: 38 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129579.672639:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129579.672640:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129579.672643:0:4385:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008fba4c00/0x40a459093b06b5f9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21fd6 expref: 23 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129579.672649:0:4385:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008fba4c00/0x40a459093b06b5f9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21fd6 expref: 23 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129579.672670:0:4385:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008fba4c00/0x40a459093b06b5f9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21fd6 expref: 23 pid: 11014 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129579.672679:0:4385:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800959d7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:4385:1830948737604352:192.168.202.4@tcp:105: 00010000:00010000:2.0:1746129579.672750:0:7086:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129579.672993:0:7086:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6ce3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ada2ffba-8920-4ecb-8068-68caa9806978+38:1960:x1830948734378496:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 467us (1471us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129579.673000:0:7086:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8643 00000100:00100000:1.0:1746129579.673010:0:4385:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130fc9f00 going to sleep for 11 seconds 00000100:00100000:1.0:1746129579.679202:0:4385:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800959d7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:4385:1830948737604352:192.168.202.4@tcp:105: 00010000:00010000:1.0:1746129579.679223:0:4385:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091544a00, rc 0) 00000100:00100000:1.0:1746129579.679338:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ada2ffba-8920-4ecb-8068-68caa9806978+37:32599:x1830948734378624:12345-192.168.202.4@tcp:101:cat.0 Request processed in 6771us (6942us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129579.679348:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16721 00000100:00100000:0.0:1746129579.682132:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129579.682170:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129579.682243:0:21725:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734378880 00000100:00100000:3.0:1746129579.682254:0:21725:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734378880 00002000:00100000:3.0:1746129579.682443:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->4194303) req@ffff8800900f5500 x1830948734378880/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:320/0 lens 488/0 e 0 to 0 dl 1746129590 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129579.682453:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800900f5500 with x1830948734378880 ext(3145728->4194303) 00002000:00010000:3.0:1746129579.682459:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800900f5500 00000100:00100000:3.0:1746129579.682489:0:21725:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734379136 00000100:00100000:3.0:1746129579.682492:0:21725:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734379136 00002000:00100000:3.0:1746129579.682506:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f5:0x0] (3145728->4194303) req@ffff8800900f4380 x1830948734379136/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:320/0 lens 488/0 e 0 to 0 dl 1746129590 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129579.682512:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800900f4380 with x1830948734379136 ext(3145728->4194303) 00002000:00010000:3.0:1746129579.682515:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800900f4380 00000100:00100000:2.0:1746129579.682515:0:8416:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8117 00000100:00100000:2.0:1746129579.682524:0:8416:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+24:1960:x1830948734378880:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:3.0:1746129579.682527:0:21725:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8118 00000100:00100000:3.0:1746129579.682532:0:21725:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+14:1960:x1830948734379136:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129579.689895:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129579.689987:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734379392 00000100:00100000:1.0:1746129579.689998:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734379392 00002000:00100000:1.0:1746129579.690047:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ef:0x0] (4194304->5148671) req@ffff8800900f7100 x1830948734379392/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:320/0 lens 488/0 e 0 to 0 dl 1746129590 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129579.690059:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800900f7100 with x1830948734379392 ext(4194304->5148671) 00002000:00010000:1.0:1746129579.690064:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800900f7100 00000100:00100000:1.0:1746129579.690087:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8119 00000100:00100000:1.0:1746129579.690096:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+37:1962:x1830948734379392:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:2.0:1746129579.692632:0:8416:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+24:1960:x1830948734378880:12345-192.168.202.4@tcp:3:cat.0 Request processed in 10099us (10496us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129579.692646:0:8416:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8117 00002000:00100000:2.0:1746129579.692659:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->4194303) req@ffff8800900f5500 x1830948734378880/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:320/0 lens 488/440 e 0 to 0 dl 1746129590 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129579.692668:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800900f5500 with x1830948734378880 ext(3145728->4194303) 00002000:00010000:2.0:1746129579.692673:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800900f5500 00000100:00100000:3.0:1746129579.697348:0:21725:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+14:1960:x1830948734379136:12345-192.168.202.4@tcp:3:cat.0 Request processed in 14802us (15163us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129579.697360:0:21725:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8118 00002000:00100000:3.0:1746129579.697373:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f5:0x0] (3145728->4194303) req@ffff8800900f4380 x1830948734379136/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:320/0 lens 488/440 e 0 to 0 dl 1746129590 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129579.697383:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800900f4380 with x1830948734379136 ext(3145728->4194303) 00002000:00010000:3.0:1746129579.697389:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800900f4380 00000100:00100000:1.0:1746129579.699986:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+37:1962:x1830948734379392:12345-192.168.202.4@tcp:3:cat.0 Request processed in 9880us (10093us total) trans 0 rc 954368/954368 00000100:00100000:1.0:1746129579.699997:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8119 00002000:00100000:1.0:1746129579.700009:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ef:0x0] (4194304->5148671) req@ffff8800900f7100 x1830948734379392/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:320/0 lens 488/440 e 0 to 0 dl 1746129590 ref 1 fl Complete:/200/0 rc 954368/954368 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129579.700019:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800900f7100 with x1830948734379392 ext(4194304->5148671) 00002000:00010000:1.0:1746129579.700025:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800900f7100 00000100:00100000:0.0:1746129579.710426:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129579.710461:0:2271:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734379648 00000100:00100000:0.0:1746129579.710470:0:2271:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734379648 00000100:00100000:0.0:1746129579.710517:0:2271:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11338 00000100:00100000:0.0:1746129579.710525:0:2271:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ada2ffba-8920-4ecb-8068-68caa9806978+296:32615:x1830948734379648:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:0.0:1746129579.710550:0:2271:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129579.710571:0:2271:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fba4a00/0x40a459093b06b60e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21feb expref: -99 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129579.710672:0:2271:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fba5000/0x40a459093b06b615 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129579.710686:0:2271:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fba5000/0x40a459093b06b615 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 2271 initiator: MDT0 00010000:00010000:0.0:1746129579.710699:0:2271:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fba5000/0x40a459093b06b615 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 2271 initiator: MDT0 00000004:00200000:0.0:1746129579.710709:0:2271:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:0.0:1746129579.710811:0:2271:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fba4a00/0x40a459093b06b60e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21feb expref: 299 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129579.710831:0:2271:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fba5000/0x40a459093b06b615 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21feb expref: 298 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129579.710839:0:2271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:0.0:1746129579.710841:0:2271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746129579.710844:0:2271:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fba5000, rc 0) 00000100:00100000:0.0:1746129579.710889:0:2271:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ada2ffba-8920-4ecb-8068-68caa9806978+298:32615:x1830948734379648:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 365us (474us total) trans 8589945458 rc 0/0 00000100:00100000:0.0:1746129579.710894:0:2271:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11338 00000100:00100000:2.0:1746129579.719612:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129579.721255:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734379904 00000100:00100000:1.0:1746129579.721269:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734379904 00002000:00100000:1.0:1746129579.721347:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ef:0x0] (4194304->5148671) req@ffff88009c07a300 x1830948734379904/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:320/0 lens 488/0 e 0 to 0 dl 1746129590 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129579.721358:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c07a300 with x1830948734379904 ext(4194304->5148671) 00002000:00010000:1.0:1746129579.721365:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c07a300 00000100:00100000:1.0:1746129579.721388:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8120 00000100:00100000:1.0:1746129579.721396:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c07a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+24:1961:x1830948734379904:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129579.728554:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129579.728646:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734380032 00000100:00100000:0.0:1746129579.728655:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734380032 00000100:00100000:0.0:1746129579.728710:0:11014:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16722 00000100:00100000:0.0:1746129579.728718:0:11014:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ada2ffba-8920-4ecb-8068-68caa9806978+37:32615:x1830948734380032:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:0.0:1746129579.728742:0:11014:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129579.728761:0:11014:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008fba4600/0x40a459093b06b623 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21ff2 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129579.728794:0:11014:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091b4fc00/0x40a459093b06afc4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21b29 expref: 25 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129579.728803:0:11014:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880136b1c400/0x40a459093b06b088 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21bd1 expref: 6 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129579.728810:0:11014:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b1b23000/0x40a459093b06afee lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21b4c expref: 38 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129579.728817:0:11014:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129579.728819:0:11014:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129579.728822:0:11014:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008fba4600/0x40a459093b06b623 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [1036288->1048575] (req 1036288->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21ff2 expref: 38 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129579.728857:0:11014:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b1b23000/0x40a459093b06afee lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21b4c expref: 38 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129579.728871:0:11014:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b1b23000/0x40a459093b06afee lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21b4c expref: 38 pid: 4385 timeout: 935 lvb_type: 1 00000100:00100000:0.0:1746129579.728883:0:11014:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009507d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11014:1830948737604480:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129579.728979:0:11014:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880136b1c400/0x40a459093b06b088 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21bd1 expref: 6 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129579.728991:0:11014:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880136b1c400/0x40a459093b06b088 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21bd1 expref: 6 pid: 8410 timeout: 935 lvb_type: 1 00000100:00100000:0.0:1746129579.728999:0:11014:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009507f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11014:1830948737604608:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129579.729025:0:11014:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091b4fc00/0x40a459093b06afc4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21b29 expref: 25 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129579.729032:0:11014:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091b4fc00/0x40a459093b06afc4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21b29 expref: 25 pid: 4385 timeout: 935 lvb_type: 1 00000100:00100000:0.0:1746129579.729039:0:11014:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009507d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11014:1830948737604736:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129579.729053:0:11014:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa381d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746129579.736754:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c07a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+24:1961:x1830948734379904:12345-192.168.202.4@tcp:3:cat.0 Request processed in 15347us (17138us total) trans 0 rc 954368/954368 00000100:00100000:1.0:1746129579.736765:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8120 00002000:00100000:1.0:1746129579.736777:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ef:0x0] (4194304->5148671) req@ffff88009c07a300 x1830948734379904/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:320/0 lens 488/440 e 0 to 0 dl 1746129590 ref 1 fl Complete:/200/0 rc 954368/954368 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129579.736787:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c07a300 with x1830948734379904 ext(4194304->5148671) 00002000:00010000:1.0:1746129579.736793:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c07a300 00000100:00100000:0.0:1746129579.745187:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129579.745218:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129579.745252:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129579.745320:0:11014:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009507d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11014:1830948737604480:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129579.745332:0:11014:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009507f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11014:1830948737604608:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129579.745340:0:11014:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009507d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11014:1830948737604736:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129579.745373:0:11014:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008fba4600/0x40a459093b06b623 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [1036288->1048575] (req 1036288->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21ff2 expref: 38 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129579.745393:0:11014:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fba4600, rc 0) 00000100:00100000:0.0:1746129579.745443:0:11014:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ada2ffba-8920-4ecb-8068-68caa9806978+38:32615:x1830948734380032:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 16725us (16897us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129579.745453:0:11014:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16722 00000100:00100000:2.0:1746129579.746275:0:7086:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734380288 00000100:00100000:2.0:1746129579.746285:0:7086:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734380288 00000100:00100000:3.0:1746129579.746318:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734380160 00000100:00100000:3.0:1746129579.746323:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734380160 00000100:00100000:3.0:1746129579.746335:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734380416 00000100:00100000:3.0:1746129579.746337:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734380416 00010000:00010000:2.0:1746129579.746342:0:7086:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880136b1c400/0x40a459093b06b088 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21bd1 expref: 7 pid: 8410 timeout: 935 lvb_type: 1 00010000:00010000:3.0:1746129579.746354:0:7087:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091b4fc00/0x40a459093b06afc4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21b29 expref: 24 pid: 4385 timeout: 935 lvb_type: 1 00000100:00100000:2.0:1746129579.746371:0:7086:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8644 00000100:00100000:2.0:1746129579.746378:0:7086:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009507d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:068dab75-d300-4ead-a742-d14572ad1e50+7:1962:x1830948734380288:12345-192.168.202.4@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746129579.746382:0:7087:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8645 00000100:00100000:3.0:1746129579.746388:0:7087:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009507fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+24:1962:x1830948734380416:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129579.746393:0:7086:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129579.746395:0:7087:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129579.746414:0:7087:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091b4fc00/0x40a459093b06afc4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21b29 expref: 24 pid: 4385 timeout: 935 lvb_type: 1 00010000:00010000:2.0:1746129579.746415:0:7086:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880136b1c400/0x40a459093b06b088 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21bd1 expref: 7 pid: 8410 timeout: 935 lvb_type: 1 00010000:00010000:2.0:1746129579.746427:0:7086:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880136b1c400/0x40a459093b06b088 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21bd1 expref: 7 pid: 8410 timeout: 935 lvb_type: 1 00010000:00010000:3.0:1746129579.746446:0:7087:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091b4fc00/0x40a459093b06afc4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21b29 expref: 24 pid: 4385 timeout: 935 lvb_type: 1 00010000:00010000:2.0:1746129579.746470:0:7086:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136b1c400/0x40a459093b06b088 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21bd1 expref: 7 pid: 8410 timeout: 935 lvb_type: 1 00010000:00010000:3.0:1746129579.746476:0:7087:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091b4fc00/0x40a459093b06afc4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21b29 expref: 24 pid: 4385 timeout: 935 lvb_type: 1 00010000:00010000:2.0:1746129579.746482:0:7086:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746129579.746485:0:7087:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129579.746512:0:7087:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009507fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+23:1962:x1830948734380416:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 125us (1260us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129579.746512:0:7086:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009507d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:068dab75-d300-4ead-a742-d14572ad1e50+6:1962:x1830948734380288:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 135us (1336us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129579.746518:0:7087:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8645 00000100:00100000:2.0:1746129579.746521:0:7086:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8644 00010000:00010000:3.0:1746129579.746775:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b1b23000/0x40a459093b06afee lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21b4c expref: 38 pid: 4385 timeout: 935 lvb_type: 1 00000100:00100000:3.0:1746129579.746803:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8646 00000100:00100000:3.0:1746129579.746808:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009507c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ada2ffba-8920-4ecb-8068-68caa9806978+38:1962:x1830948734380160:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129579.746816:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129579.746823:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b1b23000/0x40a459093b06afee lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21b4c expref: 38 pid: 4385 timeout: 935 lvb_type: 1 00010000:00010000:3.0:1746129579.746830:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b1b23000/0x40a459093b06afee lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21b4c expref: 38 pid: 4385 timeout: 935 lvb_type: 1 00010000:00010000:3.0:1746129579.746839:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b1b23000/0x40a459093b06afee lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21b4c expref: 38 pid: 4385 timeout: 935 lvb_type: 1 00010000:00010000:3.0:1746129579.746846:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129579.746847:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129579.746853:0:7085:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008fba4600/0x40a459093b06b623 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1036288->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21ff2 expref: 37 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129579.746859:0:7085:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008fba4600/0x40a459093b06b623 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1036288->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21ff2 expref: 37 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129579.746886:0:7085:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008fba4600/0x40a459093b06b623 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1036288->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21ff2 expref: 37 pid: 11014 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129579.746900:0:7085:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7085:1830948737604864:192.168.202.4@tcp:105: 00000100:00100000:3.0:1746129579.746943:0:7085:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a6ce8a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746129579.753966:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129579.754077:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129579.754108:0:11014:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734380544 00000100:00100000:0.0:1746129579.754117:0:11014:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734380544 00000100:00100000:0.0:1746129579.754161:0:11014:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16723 00000100:00100000:0.0:1746129579.754170:0:11014:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009507d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+23:1960:x1830948734380544:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129579.754188:0:11014:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129579.754208:0:11014:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c668400/0x40a459093b06b62a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f21ff9 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129579.754283:0:11014:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009507d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11014:1830948737604992:192.168.202.4@tcp:106: 00000100:00100000:0.0:1746129579.754396:0:11014:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa381d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746129579.754421:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734380800 00000100:00100000:0.0:1746129579.754424:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734380800 00002000:00100000:0.0:1746129579.754456:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ec:0x0] (1036288->1040383) req@ffff88009507f480 x1830948734380800/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:320/0 lens 488/0 e 0 to 0 dl 1746129590 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129579.754466:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009507f480 with x1830948734380800 ext(1036288->1040383) 00002000:00010000:0.0:1746129579.754471:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009507f480 00000100:00100000:0.0:1746129579.754486:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8121 00000100:00100000:0.0:1746129579.754492:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009507f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+38:1963:x1830948734380800:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:0.0:1746129579.754652:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009507f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+38:1963:x1830948734380800:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 158us (573us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746129579.754659:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8121 00002000:00100000:0.0:1746129579.754665:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ec:0x0] (1036288->1040383) req@ffff88009507f480 x1830948734380800/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:320/0 lens 488/4536 e 0 to 0 dl 1746129590 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129579.754673:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009507f480 with x1830948734380800 ext(1036288->1040383) 00002000:00010000:0.0:1746129579.754676:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009507f480 00000100:00100000:3.0:1746129579.756027:0:7085:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7085:1830948737604864:192.168.202.4@tcp:105: 00010000:00010000:3.0:1746129579.756047:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129579.756078:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009507c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ada2ffba-8920-4ecb-8068-68caa9806978+37:1962:x1830948734380160:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 9269us (10859us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129579.756087:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8646 00000100:00100000:0.0:1746129579.766428:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129579.766461:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734380928 00000100:00100000:0.0:1746129579.766470:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734380928 00000100:00100000:0.0:1746129579.766538:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16724 00000100:00100000:0.0:1746129579.766547:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009507ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ada2ffba-8920-4ecb-8068-68caa9806978+24:32615:x1830948734380928:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:0.0:1746129579.766565:0:4385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129579.766584:0:4385:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008fba5800/0x40a459093b06b631 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f22000 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129579.766614:0:4385:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fc59400/0x40a459093b06b4a2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21efd expref: 25 pid: 8411 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129579.766623:0:4385:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008fb0f800/0x40a459093b06b55f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21f6d expref: 13 pid: 8411 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129579.766630:0:4385:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012cc34a00/0x40a459093b06b527 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21f43 expref: 7 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129579.766636:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129579.766638:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129579.766640:0:4385:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fba5800/0x40a459093b06b631 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [1048576->1343487] (req 1048576->1343487) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22000 expref: 25 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129579.766676:0:4385:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012cc34a00/0x40a459093b06b527 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21f43 expref: 7 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129579.766691:0:4385:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012cc34a00/0x40a459093b06b527 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21f43 expref: 7 pid: 11014 timeout: 935 lvb_type: 1 00000100:00100000:0.0:1746129579.766704:0:4385:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009507f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:4385:1830948737605120:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129579.766803:0:4385:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008fb0f800/0x40a459093b06b55f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21f6d expref: 13 pid: 8411 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129579.766812:0:4385:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008fb0f800/0x40a459093b06b55f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21f6d expref: 13 pid: 8411 timeout: 935 lvb_type: 1 00000100:00100000:0.0:1746129579.766820:0:4385:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009507dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:4385:1830948737605248:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129579.766845:0:4385:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fc59400/0x40a459093b06b4a2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21efd expref: 25 pid: 8411 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129579.766854:0:4385:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fc59400/0x40a459093b06b4a2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21efd expref: 25 pid: 8411 timeout: 935 lvb_type: 0 00000100:00100000:0.0:1746129579.766860:0:4385:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009507ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:4385:1830948737605376:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129579.766878:0:4385:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa381300 going to sleep for 11 seconds 00002000:00010000:0.0:1746129579.766964:0:11014:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3ec:0x0] updating lvb mtime: 1746129577 -> 1746129580 00002000:00010000:0.0:1746129579.766968:0:11014:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3ec:0x0] updating lvb atime: 1746129571 -> 1746129580 00002000:00010000:0.0:1746129579.766970:0:11014:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3ec:0x0] updating lvb ctime: 1746129577 -> 1746129580 00000100:00100000:0.0:1746129579.766992:0:11014:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009507d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11014:1830948737604992:192.168.202.4@tcp:106: 00010000:00010000:0.0:1746129579.767024:0:11014:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c668400/0x40a459093b06b62a lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21ff9 expref: 24 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129579.767034:0:11014:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c668400/0x40a459093b06b62a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21ff9 expref: 24 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129579.767049:0:11014:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c668400, rc 0) 00000100:00100000:0.0:1746129579.767073:0:11014:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009507d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+23:1960:x1830948734380544:12345-192.168.202.4@tcp:101:cat.0 Request processed in 12904us (13118us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129579.767078:0:11014:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16723 00000100:00100000:0.0:1746129579.772126:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129579.772150:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129579.772165:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129579.772190:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129579.772256:0:4385:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009507f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:4385:1830948737605120:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129579.772269:0:4385:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009507dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:4385:1830948737605248:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129579.772278:0:4385:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009507ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:4385:1830948737605376:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129579.772330:0:4385:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008fba5800/0x40a459093b06b631 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [1048576->1343487] (req 1048576->1343487) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22000 expref: 25 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129579.772351:0:4385:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fba5800, rc 0) 00000100:00100000:0.0:1746129579.772401:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009507ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ada2ffba-8920-4ecb-8068-68caa9806978+25:32615:x1830948734380928:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 5854us (5982us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129579.772410:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16724 00000100:00100000:0.0:1746129579.772439:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734381184 00000100:00100000:0.0:1746129579.772445:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734381184 00000100:00100000:0.0:1746129579.772472:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734381312 00000100:00100000:0.0:1746129579.772474:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734381312 00000100:00100000:0.0:1746129579.772487:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16725 00000100:00100000:0.0:1746129579.772493:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009507d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+23:1961:x1830948734381184:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129579.772507:0:4385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129579.772522:0:4385:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095eec600/0x40a459093b06b638 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f22007 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129579.772570:0:4385:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013577f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:4385:1830948737605504:192.168.202.4@tcp:106: 00000100:00100000:0.0:1746129579.772621:0:4385:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa381300 going to sleep for 11 seconds 00000100:00100000:0.0:1746129579.772637:0:8411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16726 00000100:00100000:0.0:1746129579.772643:0:8411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013577c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+14:1961:x1830948734381312:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129579.772651:0:8411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129579.772660:0:8411:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008fba4000/0x40a459093b06b63f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2200e expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129579.772673:0:8411:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129579.772682:0:8411:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008fba4000/0x40a459093b06b63f lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2200e expref: 15 pid: 8411 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129579.772692:0:8411:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008fba4000/0x40a459093b06b63f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2200e expref: 15 pid: 8411 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129579.772701:0:8411:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fba4000, rc 0) 00000100:00100000:0.0:1746129579.772715:0:8411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013577c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+14:1961:x1830948734381312:12345-192.168.202.4@tcp:101:cat.0 Request processed in 72us (525us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129579.772724:0:8411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16726 00000100:00100000:0.0:1746129579.772840:0:15749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734381440 00000100:00100000:0.0:1746129579.772844:0:15749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734381440 00010000:00010000:0.0:1746129579.772858:0:15749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008fb0f800/0x40a459093b06b55f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21f6d expref: 14 pid: 8411 timeout: 935 lvb_type: 1 00000100:00100000:0.0:1746129579.772873:0:15749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734381056 00000100:00100000:0.0:1746129579.772875:0:15749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734381056 00010000:00010000:0.0:1746129579.772884:0:15749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012cc34a00/0x40a459093b06b527 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21f43 expref: 8 pid: 11014 timeout: 935 lvb_type: 1 00000100:00100000:0.0:1746129579.772898:0:15749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8647 00000100:00100000:0.0:1746129579.772903:0:15749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009507ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+14:1961:x1830948734381440:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129579.772911:0:15749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129579.772934:0:15749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008fb0f800/0x40a459093b06b55f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21f6d expref: 14 pid: 8411 timeout: 935 lvb_type: 1 00010000:00010000:0.0:1746129579.772943:0:15749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008fb0f800/0x40a459093b06b55f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21f6d expref: 14 pid: 8411 timeout: 935 lvb_type: 1 00010000:00010000:0.0:1746129579.772962:0:15749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008fb0f800/0x40a459093b06b55f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21f6d expref: 14 pid: 8411 timeout: 935 lvb_type: 1 00010000:00010000:0.0:1746129579.772975:0:15749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129579.772992:0:15749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009507ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+13:1961:x1830948734381440:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 89us (842us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129579.772998:0:15749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8647 00000100:00100000:0.0:1746129579.773008:0:15749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8648 00000100:00100000:0.0:1746129579.773012:0:15749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009507e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:068dab75-d300-4ead-a742-d14572ad1e50+8:1961:x1830948734381056:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129579.773018:0:15749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129579.773024:0:15749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012cc34a00/0x40a459093b06b527 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21f43 expref: 8 pid: 11014 timeout: 935 lvb_type: 1 00010000:00010000:0.0:1746129579.773031:0:15749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012cc34a00/0x40a459093b06b527 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21f43 expref: 8 pid: 11014 timeout: 935 lvb_type: 1 00010000:00010000:0.0:1746129579.773041:0:15749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012cc34a00/0x40a459093b06b527 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21f43 expref: 8 pid: 11014 timeout: 935 lvb_type: 1 00010000:00010000:0.0:1746129579.773049:0:15749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129579.773059:0:15749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009507e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:068dab75-d300-4ead-a742-d14572ad1e50+7:1961:x1830948734381056:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 47us (894us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129579.773064:0:15749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8648 00000100:00100000:0.0:1746129579.779606:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129579.779647:0:20578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734381568 00000100:00100000:0.0:1746129579.779656:0:20578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734381568 00010000:00010000:0.0:1746129579.779713:0:20578:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fc59400/0x40a459093b06b4a2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21efd expref: 25 pid: 8411 timeout: 935 lvb_type: 0 00000100:00100000:0.0:1746129579.779745:0:20578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8649 00000100:00100000:0.0:1746129579.779754:0:20578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013577e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ada2ffba-8920-4ecb-8068-68caa9806978+25:1962:x1830948734381568:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129579.779767:0:20578:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129579.779790:0:20578:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fc59400/0x40a459093b06b4a2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21efd expref: 25 pid: 8411 timeout: 935 lvb_type: 0 00010000:00010000:0.0:1746129579.779803:0:20578:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fc59400/0x40a459093b06b4a2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21efd expref: 25 pid: 8411 timeout: 935 lvb_type: 0 00010000:00010000:0.0:1746129579.779829:0:20578:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fc59400/0x40a459093b06b4a2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21efd expref: 25 pid: 8411 timeout: 935 lvb_type: 0 00010000:00010000:0.0:1746129579.779845:0:20578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129579.779847:0:20578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129579.779855:0:20578:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008fba5800/0x40a459093b06b631 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1343487) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22000 expref: 24 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129579.779863:0:20578:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fba5800/0x40a459093b06b631 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1343487) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22000 expref: 24 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129579.779893:0:20578:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008fba5800/0x40a459093b06b631 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1343487) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22000 expref: 24 pid: 4385 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129579.780000:0:20578:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013577ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:20578:1830948737605632:192.168.202.4@tcp:105: 00000100:00100000:0.0:1746129579.780078:0:20578:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa381d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746129579.784171:0:4385:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013577f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:4385:1830948737605504:192.168.202.4@tcp:106: 00010000:00010000:1.0:1746129579.784206:0:4385:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095eec600/0x40a459093b06b638 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22007 expref: 24 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129579.784221:0:4385:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095eec600/0x40a459093b06b638 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22007 expref: 24 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129579.784230:0:4385:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095eec600, rc 0) 00000100:00100000:1.0:1746129579.784323:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009507d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+23:1961:x1830948734381184:12345-192.168.202.4@tcp:101:cat.0 Request processed in 11828us (12208us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129579.784333:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16725 00000100:00100000:1.0:1746129579.798443:0:20578:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013577ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:20578:1830948737605632:192.168.202.4@tcp:105: 00010000:00010000:1.0:1746129579.798467:0:20578:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129579.798507:0:20578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013577e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ada2ffba-8920-4ecb-8068-68caa9806978+24:1962:x1830948734381568:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 18754us (18916us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129579.798519:0:20578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8649 00000100:00100000:2.0:1746129579.808931:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129579.808967:0:21725:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734381824 00000100:00100000:2.0:1746129579.808976:0:21725:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734381824 00002000:00100000:2.0:1746129579.809024:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f3:0x0] (1339392->1343487) req@ffff88009c079180 x1830948734381824/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:320/0 lens 488/0 e 0 to 0 dl 1746129590 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129579.809035:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c079180 with x1830948734381824 ext(1339392->1343487) 00002000:00010000:2.0:1746129579.809040:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c079180 00000100:00100000:2.0:1746129579.809062:0:21725:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8122 00000100:00100000:2.0:1746129579.809070:0:21725:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c079180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ada2ffba-8920-4ecb-8068-68caa9806978+24:1963:x1830948734381824:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:2.0:1746129579.809231:0:21725:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c079180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ada2ffba-8920-4ecb-8068-68caa9806978+24:1963:x1830948734381824:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 162us (310us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129579.810560:0:21725:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8122 00002000:00100000:2.0:1746129579.810573:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f3:0x0] (1339392->1343487) req@ffff88009c079180 x1830948734381824/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:320/0 lens 488/4536 e 0 to 0 dl 1746129590 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129579.810590:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c079180 with x1830948734381824 ext(1339392->1343487) 00002000:00010000:2.0:1746129579.810595:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c079180 00000100:00100000:1.0:1746129579.830027:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129579.830059:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734381952 00000100:00100000:1.0:1746129579.830067:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734381952 00000100:00100000:1.0:1746129579.830113:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16727 00000100:00100000:1.0:1746129579.830121:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+13:32612:x1830948734381952:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:1.0:1746129579.830142:0:4385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129579.830159:0:4385:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136057c00/0x40a459093b06b646 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f22015 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129579.830189:0:4385:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008fba5800/0x40a459093b06b631 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1343487) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22000 expref: 23 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129579.830196:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129579.830198:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129579.830202:0:4385:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136057c00/0x40a459093b06b646 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1527808->2097151] (req 1527808->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22015 expref: 14 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129579.830243:0:4385:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008fba5800/0x40a459093b06b631 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1343487) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22000 expref: 23 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129579.830255:0:4385:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008fba5800/0x40a459093b06b631 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1343487) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22000 expref: 23 pid: 4385 timeout: 935 lvb_type: 0 00000100:00100000:1.0:1746129579.830275:0:4385:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800959d4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:4385:1830948737605760:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129579.830384:0:4385:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130fc9e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746129579.832983:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129579.833521:0:4385:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800959d4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:4385:1830948737605760:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129579.833551:0:4385:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880136057c00/0x40a459093b06b646 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1527808->2097151] (req 1527808->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22015 expref: 14 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129579.833569:0:4385:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136057c00, rc 0) 00000100:00100000:1.0:1746129579.833611:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+14:32612:x1830948734381952:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 3491us (3593us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129579.833621:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16727 00000100:00100000:1.0:1746129579.834208:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129579.834227:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734382208 00000100:00100000:1.0:1746129579.834246:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734382208 00000100:00100000:1.0:1746129579.834859:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16728 00000100:00100000:1.0:1746129579.834868:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ada2ffba-8920-4ecb-8068-68caa9806978+24:1960:x1830948734382208:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129579.834882:0:4385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129579.834897:0:4385:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136057e00/0x40a459093b06b64d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2201c expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129579.834943:0:4385:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800959d6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:4385:1830948737605888:192.168.202.4@tcp:106: 00000100:00100000:1.0:1746129579.834996:0:4385:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130fc9e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746129579.835442:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734382080 00000100:00100000:2.0:1746129579.835448:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734382080 00002000:00100000:2.0:1746129579.835478:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->1343487) req@ffff8800959d7800 x1830948734382080/t0(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:320/0 lens 488/0 e 0 to 0 dl 1746129590 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129579.835487:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800959d7800 with x1830948734382080 ext(1048576->1343487) 00010000:00010000:2.0:1746129579.835493:0:25745:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008fba5800/0x40a459093b06b631 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1343487) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22000 expref: 26 pid: 4385 timeout: 935 lvb_type: 0 00010000:00010000:2.0:1746129579.835506:0:25745:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008fba5800/0x40a459093b06b631 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1343487) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22000 expref: 26 pid: 4385 timeout: 935 lvb_type: 0 00002000:00010000:2.0:1746129579.835512:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800959d7800 00000100:00100000:2.0:1746129579.835526:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2507 00000100:00100000:2.0:1746129579.835531:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+26:1963:x1830948734382080:12345-192.168.202.4@tcp:4:multiop.0 00002000:00010000:0.0:1746129579.837105:0:4385:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb mtime: 1746129579 -> 1746129580 00002000:00010000:0.0:1746129579.837112:0:4385:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb ctime: 1746129579 -> 1746129580 00000100:00100000:0.0:1746129579.837129:0:4385:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800959d6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:4385:1830948737605888:192.168.202.4@tcp:106: 00010000:00010000:0.0:1746129579.837158:0:4385:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880136057e00/0x40a459093b06b64d lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2201c expref: 27 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129579.837177:0:4385:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136057e00/0x40a459093b06b64d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2201c expref: 27 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129579.837187:0:4385:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136057e00, rc 0) 00000100:00100000:0.0:1746129579.837562:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ada2ffba-8920-4ecb-8068-68caa9806978+26:1960:x1830948734382208:12345-192.168.202.4@tcp:101:cat.0 Request processed in 2694us (3354us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129579.837571:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16728 00000100:00100000:2.0:1746129579.840221:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+26:1963:x1830948734382080:12345-192.168.202.4@tcp:4:multiop.0 Request processed in 4678us (7233us total) trans 17179874175 rc 0/0 00000100:00100000:2.0:1746129579.840245:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2507 00002000:00100000:2.0:1746129579.840259:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->1343487) req@ffff8800959d7800 x1830948734382080/t17179874175(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:320/0 lens 488/448 e 0 to 0 dl 1746129590 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129579.840269:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800959d7800 with x1830948734382080 ext(1048576->1343487) 00010000:00010000:2.0:1746129579.840280:0:25745:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008fba5800/0x40a459093b06b631 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1343487) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22000 expref: 26 pid: 4385 timeout: 935 lvb_type: 0 00010000:00010000:2.0:1746129579.840312:0:25745:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008fba5800/0x40a459093b06b631 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1343487) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22000 expref: 26 pid: 4385 timeout: 935 lvb_type: 0 00002000:00010000:2.0:1746129579.840319:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800959d7800 00000100:00100000:0.0:1746129579.841755:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129579.841811:0:20578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734382336 00000100:00100000:1.0:1746129579.841820:0:20578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734382336 00010000:00010000:1.0:1746129579.841850:0:20578:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008fba5800/0x40a459093b06b631 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1343487) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22000 expref: 26 pid: 4385 timeout: 935 lvb_type: 0 00000100:00100000:1.0:1746129579.841886:0:20578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8650 00000100:00100000:1.0:1746129579.841894:0:20578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6ce3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ada2ffba-8920-4ecb-8068-68caa9806978+26:1961:x1830948734382336:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129579.842197:0:20578:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129579.842219:0:20578:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008fba5800/0x40a459093b06b631 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1343487) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22000 expref: 26 pid: 4385 timeout: 935 lvb_type: 0 00010000:00010000:1.0:1746129579.842230:0:20578:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008fba5800/0x40a459093b06b631 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1343487) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22000 expref: 26 pid: 4385 timeout: 935 lvb_type: 0 00010000:00010000:1.0:1746129579.842278:0:20578:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008fba5800/0x40a459093b06b631 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1343487) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22000 expref: 26 pid: 4385 timeout: 935 lvb_type: 0 00010000:00010000:1.0:1746129579.842291:0:20578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129579.842307:0:20578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129579.842314:0:20578:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136057c00/0x40a459093b06b646 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1527808->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22015 expref: 13 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129579.842322:0:20578:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136057c00/0x40a459093b06b646 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1527808->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22015 expref: 13 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129579.842357:0:20578:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880136057c00/0x40a459093b06b646 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1527808->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22015 expref: 13 pid: 4385 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129579.842370:0:20578:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800959d4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:20578:1830948737606016:192.168.202.4@tcp:105: 00000100:00100000:1.0:1746129579.842444:0:20578:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130fc9f00 going to sleep for 11 seconds 00000100:00100000:1.0:1746129579.844455:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129579.844663:0:20578:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800959d4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:20578:1830948737606016:192.168.202.4@tcp:105: 00010000:00010000:1.0:1746129579.844683:0:20578:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129579.844726:0:20578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6ce3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ada2ffba-8920-4ecb-8068-68caa9806978+25:1961:x1830948734382336:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 2832us (2975us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129579.844738:0:20578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8650 00000100:00100000:2.0:1746129579.844892:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734382592 00000100:00100000:2.0:1746129579.844899:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734382592 00002000:00100000:2.0:1746129579.844939:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ec:0x0] (0->1036287) req@ffff8800959d5500 x1830948734382592/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:320/0 lens 488/0 e 0 to 0 dl 1746129590 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129579.844949:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800959d5500 with x1830948734382592 ext(0->1036287) 00002000:00010000:2.0:1746129579.844953:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800959d5500 00000100:00100000:2.0:1746129579.844981:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8123 00000100:00100000:2.0:1746129579.844988:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+37:1963:x1830948734382592:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:1.0:1746129579.846404:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129579.846463:0:21725:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734382848 00000100:00100000:3.0:1746129579.846470:0:21725:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734382848 00002000:00100000:3.0:1746129579.846497:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f3:0x0] (1527808->1531903) req@ffff8800959d4700 x1830948734382848/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:320/0 lens 488/0 e 0 to 0 dl 1746129590 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129579.846506:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800959d4700 with x1830948734382848 ext(1527808->1531903) 00002000:00010000:3.0:1746129579.846510:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800959d4700 00000100:00100000:3.0:1746129579.846525:0:21725:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8124 00000100:00100000:3.0:1746129579.846529:0:21725:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+14:1962:x1830948734382848:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:3.0:1746129579.846663:0:21725:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+14:1962:x1830948734382848:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 132us (262us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129579.846669:0:21725:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8124 00002000:00100000:3.0:1746129579.846673:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f3:0x0] (1527808->1531903) req@ffff8800959d4700 x1830948734382848/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:320/0 lens 488/4536 e 0 to 0 dl 1746129590 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129579.846680:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800959d4700 with x1830948734382848 ext(1527808->1531903) 00002000:00010000:3.0:1746129579.846682:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800959d4700 00000100:00100000:0.0:1746129579.859630:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+37:1963:x1830948734382592:12345-192.168.202.4@tcp:3:cat.0 Request processed in 14631us (15170us total) trans 0 rc 1036288/1036288 00000100:00100000:0.0:1746129579.859644:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8123 00002000:00100000:0.0:1746129579.859658:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ec:0x0] (0->1036287) req@ffff8800959d5500 x1830948734382592/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:320/0 lens 488/440 e 0 to 0 dl 1746129590 ref 1 fl Complete:/200/0 rc 1036288/1036288 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129579.859668:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800959d5500 with x1830948734382592 ext(0->1036287) 00002000:00010000:0.0:1746129579.859675:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800959d5500 00000100:00100000:0.0:1746129579.862652:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129579.862717:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734382976 00000100:00100000:0.0:1746129579.862726:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734382976 00000100:00100000:0.0:1746129579.862898:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16729 00000100:00100000:0.0:1746129579.862905:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013577c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+14:32612:x1830948734382976:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:0.0:1746129579.862923:0:4385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129579.862940:0:4385:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094274e00/0x40a459093b06b654 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f22023 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129579.862974:0:4385:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095412400/0x40a459093b06b53c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21f58 expref: 24 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129579.862983:0:4385:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091545e00/0x40a459093b06b59e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21f9e expref: 6 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129579.862990:0:4385:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a77f7600/0x40a459093b06b56d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21f7b expref: 15 pid: 20577 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129579.862995:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129579.862997:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129579.863000:0:4385:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094274e00/0x40a459093b06b654 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [1048576->1335295] (req 1048576->1335295) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22023 expref: 15 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129579.863028:0:4385:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a77f7600/0x40a459093b06b56d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21f7b expref: 15 pid: 20577 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129579.863046:0:4385:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a77f7600/0x40a459093b06b56d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21f7b expref: 15 pid: 20577 timeout: 935 lvb_type: 1 00000100:00100000:0.0:1746129579.863057:0:4385:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013577f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:4385:1830948737606144:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129579.863142:0:4385:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091545e00/0x40a459093b06b59e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21f9e expref: 6 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129579.863149:0:4385:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091545e00/0x40a459093b06b59e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21f9e expref: 6 pid: 4385 timeout: 935 lvb_type: 1 00000100:00100000:0.0:1746129579.863157:0:4385:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013577c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:4385:1830948737606272:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129579.863180:0:4385:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095412400/0x40a459093b06b53c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21f58 expref: 24 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129579.863186:0:4385:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095412400/0x40a459093b06b53c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21f58 expref: 24 pid: 4385 timeout: 935 lvb_type: 0 00000100:00100000:0.0:1746129579.863193:0:4385:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013577d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:4385:1830948737606400:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129579.863209:0:4385:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa3819c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129579.866429:0:4385:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013577f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:4385:1830948737606144:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129579.867995:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129579.868045:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129579.868125:0:4385:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013577c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:4385:1830948737606272:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129579.868139:0:20577:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734383104 00000100:00100000:3.0:1746129579.868146:0:20577:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734383104 00000100:00100000:3.0:1746129579.868191:0:20577:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16730 00000100:00100000:3.0:1746129579.868197:0:20577:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ada2ffba-8920-4ecb-8068-68caa9806978+25:32621:x1830948734383104:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129579.868215:0:20577:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129579.868231:0:20577:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a9209c00/0x40a459093b06b65b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2202a expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129579.868271:0:20577:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880136057c00/0x40a459093b06b646 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1527808->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22015 expref: 15 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129579.868279:0:20577:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129579.868281:0:20577:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00000100:00100000:1.0:1746129579.868371:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129579.868390:0:20578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734383360 00000100:00100000:1.0:1746129579.868394:0:20578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734383360 00010000:00010000:1.0:1746129579.868411:0:20578:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091545e00/0x40a459093b06b59e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21f9e expref: 7 pid: 4385 timeout: 935 lvb_type: 1 00010000:00010000:3.0:1746129579.868510:0:20577:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a9209c00/0x40a459093b06b65b lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2202a expref: 26 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129579.868551:0:20577:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880136057c00/0x40a459093b06b646 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1527808->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22015 expref: 15 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129579.868563:0:20577:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880136057c00/0x40a459093b06b646 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1527808->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22015 expref: 15 pid: 4385 timeout: 935 lvb_type: 0 00000100:00100000:3.0:1746129579.868574:0:20577:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20577:1830948737606528:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129579.868626:0:4385:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013577d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:4385:1830948737606400:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129579.868670:0:20577:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5c68480 going to sleep for 11 seconds 00010000:00010000:0.0:1746129579.868720:0:4385:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094274e00/0x40a459093b06b654 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [1048576->1335295] (req 1048576->1335295) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22023 expref: 15 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129579.868731:0:4385:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094274e00, rc 0) 00000100:00100000:0.0:1746129579.868753:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013577c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+15:32612:x1830948734382976:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 5848us (6111us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129579.868759:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16729 00000100:00100000:2.0:1746129579.868801:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129579.869721:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734383232 00000100:00100000:0.0:1746129579.869728:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734383232 00010000:00010000:0.0:1746129579.869745:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a77f7600/0x40a459093b06b56d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21f7b expref: 15 pid: 20577 timeout: 935 lvb_type: 1 00000100:00100000:2.0:1746129579.869763:0:15749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734383488 00000100:00100000:2.0:1746129579.869768:0:15749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734383488 00000100:00100000:0.0:1746129579.869771:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8651 00000100:00100000:0.0:1746129579.869778:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:068dab75-d300-4ead-a742-d14572ad1e50+7:1961:x1830948734383360:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129579.869786:0:15749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095412400/0x40a459093b06b53c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21f58 expref: 27 pid: 4385 timeout: 935 lvb_type: 0 00010000:00010000:0.0:1746129579.869788:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746129579.869806:0:15749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8652 00000100:00100000:2.0:1746129579.869811:0:15749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959d4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+15:1961:x1830948734383232:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129579.869811:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091545e00/0x40a459093b06b59e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21f9e expref: 7 pid: 4385 timeout: 935 lvb_type: 1 00010000:00010000:2.0:1746129579.869818:0:15749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129579.869820:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091545e00/0x40a459093b06b59e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21f9e expref: 7 pid: 4385 timeout: 935 lvb_type: 1 00010000:00010000:2.0:1746129579.869828:0:15749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a77f7600/0x40a459093b06b56d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21f7b expref: 15 pid: 20577 timeout: 935 lvb_type: 1 00010000:00010000:0.0:1746129579.869838:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091545e00/0x40a459093b06b59e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21f9e expref: 7 pid: 4385 timeout: 935 lvb_type: 1 00010000:00010000:2.0:1746129579.869841:0:15749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a77f7600/0x40a459093b06b56d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21f7b expref: 15 pid: 20577 timeout: 935 lvb_type: 1 00010000:00010000:0.0:1746129579.869853:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746129579.869854:0:15749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a77f7600/0x40a459093b06b56d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21f7b expref: 15 pid: 20577 timeout: 935 lvb_type: 1 00010000:00010000:2.0:1746129579.869864:0:15749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129579.869876:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:068dab75-d300-4ead-a742-d14572ad1e50+6:1961:x1830948734383360:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 98us (1830us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129579.869881:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8651 00000100:00100000:2.0:1746129579.869882:0:15749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959d4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+14:1961:x1830948734383232:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 71us (1510us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129579.869888:0:15749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8652 00000100:00100000:0.0:1746129579.869895:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8653 00000100:00100000:0.0:1746129579.869899:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c07b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ada2ffba-8920-4ecb-8068-68caa9806978+27:1961:x1830948734383488:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129579.869905:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129579.869912:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095412400/0x40a459093b06b53c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21f58 expref: 27 pid: 4385 timeout: 935 lvb_type: 0 00010000:00010000:0.0:1746129579.869920:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095412400/0x40a459093b06b53c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21f58 expref: 27 pid: 4385 timeout: 935 lvb_type: 0 00010000:00010000:0.0:1746129579.869934:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095412400/0x40a459093b06b53c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21f58 expref: 27 pid: 4385 timeout: 935 lvb_type: 0 00010000:00010000:0.0:1746129579.869943:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129579.869944:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129579.869950:0:7085:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094274e00/0x40a459093b06b654 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1335295) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22023 expref: 13 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129579.869957:0:7085:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094274e00/0x40a459093b06b654 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1335295) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22023 expref: 13 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129579.869978:0:7085:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880094274e00/0x40a459093b06b654 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1335295) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22023 expref: 13 pid: 4385 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129579.869987:0:7085:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013577d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7085:1830948737606656:192.168.202.4@tcp:105: 00000100:00100000:0.0:1746129579.870018:0:7085:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa3819c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129579.872734:0:20577:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20577:1830948737606528:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129579.872766:0:20577:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a9209c00/0x40a459093b06b65b lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2202a expref: 26 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129579.872785:0:20577:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a9209c00, rc 0) 00000100:00100000:0.0:1746129579.872830:0:20577:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ada2ffba-8920-4ecb-8068-68caa9806978+26:32621:x1830948734383104:12345-192.168.202.4@tcp:101:cat.0 Request processed in 4631us (4841us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129579.872839:0:20577:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16730 00000100:00100000:0.0:1746129579.873368:0:7085:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013577d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7085:1830948737606656:192.168.202.4@tcp:105: 00010000:00010000:0.0:1746129579.873500:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129579.873525:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c07b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ada2ffba-8920-4ecb-8068-68caa9806978+25:1961:x1830948734383488:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 3624us (4725us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129579.873534:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8653 00000100:00100000:2.0:1746129579.875223:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129579.875285:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734383616 00000100:00100000:0.0:1746129579.875311:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734383616 00002000:00100000:0.0:1746129579.875351:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f3:0x0] (1527808->2097151) req@ffff88009c078380 x1830948734383616/t0(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:320/0 lens 488/0 e 0 to 0 dl 1746129590 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129579.875361:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c078380 with x1830948734383616 ext(1527808->2097151) 00010000:00010000:0.0:1746129579.875370:0:25745:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880136057c00/0x40a459093b06b646 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1527808->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22015 expref: 14 pid: 4385 timeout: 935 lvb_type: 0 00010000:00010000:0.0:1746129579.875382:0:25745:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880136057c00/0x40a459093b06b646 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1527808->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22015 expref: 14 pid: 4385 timeout: 935 lvb_type: 0 00002000:00010000:0.0:1746129579.875389:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c078380 00000100:00100000:0.0:1746129579.875414:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2508 00000100:00100000:0.0:1746129579.875420:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c078380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+14:1962:x1830948734383616:12345-192.168.202.4@tcp:4:multiop.0 00000001:00080000:1.0:1746129579.875852:0:564:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841414 is committed 00000001:00080000:1.0:1746129579.875877:0:564:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841404 is committed 00000001:00080000:1.0:1746129579.875887:0:564:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841413 is committed 00000001:00080000:1.0:1746129579.875908:0:564:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841415 is committed 00000100:00100000:3.0:1746129579.877596:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129579.877620:0:8416:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734383872 00000100:00100000:3.0:1746129579.877722:0:8416:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734383872 00002000:00100000:3.0:1746129579.877760:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3f4:0x0] (1331200->1335295) req@ffff8800947bc380 x1830948734383872/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:320/0 lens 488/0 e 0 to 0 dl 1746129590 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129579.877770:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800947bc380 with x1830948734383872 ext(1331200->1335295) 00002000:00010000:3.0:1746129579.877774:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800947bc380 00000100:00100000:3.0:1746129579.877793:0:8416:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8125 00000100:00100000:3.0:1746129579.877799:0:8416:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+16:1962:x1830948734383872:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:3.0:1746129579.878849:0:8416:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+16:1962:x1830948734383872:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 1043us (1251us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129579.878858:0:8416:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8125 00002000:00100000:3.0:1746129579.878869:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3f4:0x0] (1331200->1335295) req@ffff8800947bc380 x1830948734383872/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:320/0 lens 488/4536 e 0 to 0 dl 1746129590 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129579.878877:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800947bc380 with x1830948734383872 ext(1331200->1335295) 00002000:00010000:3.0:1746129579.878882:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800947bc380 00000100:00100000:0.0:1746129579.882399:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129579.884115:0:14551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734384128 00000100:00100000:1.0:1746129579.884130:0:14551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734384128 00000100:00100000:1.0:1746129579.884202:0:14551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4833 00000100:00100000:1.0:1746129579.884210:0:14551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013577d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+15:32612:x1830948734384128:12345-192.168.202.4@tcp:35:multiop.0 00000100:00100000:1.0:1746129579.884487:0:14551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013577d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+16:32612:x1830948734384128:12345-192.168.202.4@tcp:35:multiop.0 Request processed in 277us (2099us total) trans 8589945459 rc 0/0 00000100:00100000:1.0:1746129579.884493:0:14551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4833 00000100:00100000:2.0:1746129579.886081:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c078380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+16:1962:x1830948734383616:12345-192.168.202.4@tcp:4:multiop.0 Request processed in 10653us (10856us total) trans 17179874176 rc 0/0 00000100:00100000:2.0:1746129579.886092:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2508 00002000:00100000:2.0:1746129579.886104:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f3:0x0] (1527808->2097151) req@ffff88009c078380 x1830948734383616/t17179874176(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:320/0 lens 488/448 e 0 to 0 dl 1746129590 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129579.886114:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c078380 with x1830948734383616 ext(1527808->2097151) 00010000:00010000:2.0:1746129579.886124:0:25745:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880136057c00/0x40a459093b06b646 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1527808->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22015 expref: 16 pid: 4385 timeout: 935 lvb_type: 0 00010000:00010000:2.0:1746129579.886141:0:25745:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880136057c00/0x40a459093b06b646 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1527808->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22015 expref: 16 pid: 4385 timeout: 935 lvb_type: 0 00002000:00010000:2.0:1746129579.886149:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c078380 00000100:00100000:0.0:1746129579.890170:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129579.890274:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734384256 00000100:00100000:2.0:1746129579.890286:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734384256 00010000:00010000:2.0:1746129579.890354:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880136057c00/0x40a459093b06b646 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1527808->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22015 expref: 16 pid: 4385 timeout: 935 lvb_type: 0 00000100:00100000:2.0:1746129579.890402:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8654 00000100:00100000:2.0:1746129579.890411:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013577c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+16:1963:x1830948734384256:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129579.890428:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129579.890453:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880136057c00/0x40a459093b06b646 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1527808->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22015 expref: 16 pid: 4385 timeout: 935 lvb_type: 0 00010000:00010000:2.0:1746129579.890466:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880136057c00/0x40a459093b06b646 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1527808->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22015 expref: 16 pid: 4385 timeout: 935 lvb_type: 0 00010000:00010000:2.0:1746129579.890490:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136057c00/0x40a459093b06b646 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1527808->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22015 expref: 16 pid: 4385 timeout: 935 lvb_type: 0 00010000:00010000:2.0:1746129579.890504:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129579.890506:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129579.890513:0:7085:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a9209c00/0x40a459093b06b65b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2202a expref: 24 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129579.890522:0:7085:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a9209c00/0x40a459093b06b65b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2202a expref: 24 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129579.890553:0:7085:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a9209c00/0x40a459093b06b65b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2202a expref: 24 pid: 20577 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129579.890565:0:7085:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c07b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7085:1830948737606784:192.168.202.4@tcp:105: 00000100:00100000:2.0:1746129579.890658:0:7085:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094a84b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746129579.894157:0:7085:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c07b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7085:1830948737606784:192.168.202.4@tcp:105: 00010000:00010000:2.0:1746129579.894183:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129579.894225:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013577c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+15:1963:x1830948734384256:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 3814us (4066us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129579.894252:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8654 00000100:00100000:0.0:1746129579.896640:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129579.896713:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734384512 00000100:00100000:2.0:1746129579.896721:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734384512 00002000:00100000:2.0:1746129579.896766:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff88013577f100 x1830948734384512/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:320/0 lens 488/0 e 0 to 0 dl 1746129590 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129579.896777:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013577f100 with x1830948734384512 ext(1048576->2097151) 00002000:00010000:2.0:1746129579.896783:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013577f100 00000100:00100000:2.0:1746129579.897594:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8126 00000100:00100000:2.0:1746129579.897605:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013577f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+25:1963:x1830948734384512:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:2.0:1746129579.907444:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013577f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+25:1963:x1830948734384512:12345-192.168.202.4@tcp:3:cat.0 Request processed in 9828us (10800us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129579.907456:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8126 00002000:00100000:2.0:1746129579.907468:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff88013577f100 x1830948734384512/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:320/0 lens 488/440 e 0 to 0 dl 1746129590 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129579.907477:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013577f100 with x1830948734384512 ext(1048576->2097151) 00002000:00010000:2.0:1746129579.907483:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013577f100 00000100:00100000:0.0:1746129579.924139:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129579.924229:0:20577:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734384640 00000100:00100000:2.0:1746129579.924247:0:20577:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734384640 00000100:00100000:2.0:1746129579.924327:0:20577:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16731 00000100:00100000:2.0:1746129579.924336:0:20577:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013577dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ada2ffba-8920-4ecb-8068-68caa9806978+25:32621:x1830948734384640:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129579.924356:0:20577:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129579.924375:0:20577:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136439a00/0x40a459093b06b662 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f22031 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129579.924403:0:20577:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094274e00/0x40a459093b06b654 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1335295) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22023 expref: 14 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129579.924411:0:20577:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129579.924413:0:20577:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129579.924416:0:20577:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136439a00/0x40a459093b06b662 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22031 expref: 26 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129579.924444:0:20577:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094274e00/0x40a459093b06b654 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1335295) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22023 expref: 14 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129579.924455:0:20577:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094274e00/0x40a459093b06b654 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1335295) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22023 expref: 14 pid: 4385 timeout: 935 lvb_type: 0 00000100:00100000:2.0:1746129579.924467:0:20577:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c07b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20577:1830948737606912:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129579.924567:0:20577:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094a84b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746129579.926583:0:20577:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c07b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20577:1830948737606912:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129579.926621:0:20577:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880136439a00/0x40a459093b06b662 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22031 expref: 26 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129579.926637:0:20577:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136439a00, rc 0) 00000100:00100000:2.0:1746129579.926698:0:20577:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013577dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ada2ffba-8920-4ecb-8068-68caa9806978+26:32621:x1830948734384640:12345-192.168.202.4@tcp:101:cat.0 Request processed in 2362us (2568us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129579.926708:0:20577:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16731 00000100:00100000:0.0:1746129579.927348:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129579.927453:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734384768 00000100:00100000:2.0:1746129579.927461:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734384768 00002000:00100000:2.0:1746129579.927505:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f4:0x0] (1048576->1335295) req@ffff88013577ca80 x1830948734384768/t0(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:320/0 lens 488/0 e 0 to 0 dl 1746129590 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129579.927514:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013577ca80 with x1830948734384768 ext(1048576->1335295) 00010000:00010000:2.0:1746129579.927522:0:25745:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094274e00/0x40a459093b06b654 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1335295) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22023 expref: 15 pid: 4385 timeout: 935 lvb_type: 0 00010000:00010000:2.0:1746129579.927534:0:25745:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094274e00/0x40a459093b06b654 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1335295) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22023 expref: 15 pid: 4385 timeout: 935 lvb_type: 0 00002000:00010000:2.0:1746129579.927540:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88013577ca80 00000100:00100000:2.0:1746129579.927631:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2509 00000100:00100000:2.0:1746129579.927639:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013577ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+15:1963:x1830948734384768:12345-192.168.202.4@tcp:4:multiop.0 00000100:00100000:2.0:1746129579.933057:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013577ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+17:1963:x1830948734384768:12345-192.168.202.4@tcp:4:multiop.0 Request processed in 5407us (5704us total) trans 17179874177 rc 0/0 00000100:00100000:2.0:1746129579.933069:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2509 00002000:00100000:2.0:1746129579.933082:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f4:0x0] (1048576->1335295) req@ffff88013577ca80 x1830948734384768/t17179874177(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:320/0 lens 488/448 e 0 to 0 dl 1746129590 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129579.933091:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013577ca80 with x1830948734384768 ext(1048576->1335295) 00010000:00010000:2.0:1746129579.933102:0:25745:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094274e00/0x40a459093b06b654 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1335295) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22023 expref: 17 pid: 4385 timeout: 935 lvb_type: 0 00010000:00010000:2.0:1746129579.933125:0:25745:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094274e00/0x40a459093b06b654 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1335295) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22023 expref: 17 pid: 4385 timeout: 935 lvb_type: 0 00002000:00010000:2.0:1746129579.933133:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88013577ca80 00000100:00100000:0.0:1746129579.937248:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129579.937392:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734384896 00000100:00100000:2.0:1746129579.937402:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734384896 00010000:00010000:2.0:1746129579.937441:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094274e00/0x40a459093b06b654 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1335295) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22023 expref: 17 pid: 4385 timeout: 935 lvb_type: 0 00000100:00100000:2.0:1746129579.937481:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8655 00000100:00100000:2.0:1746129579.937488:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013577e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+17:1961:x1830948734384896:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129579.937502:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746129579.937522:0:7085:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb ctime from disk: 1746129579 -> 1746129580 00010000:00010000:2.0:1746129579.937528:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094274e00/0x40a459093b06b654 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1335295) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22023 expref: 17 pid: 4385 timeout: 935 lvb_type: 0 00010000:00010000:2.0:1746129579.937540:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094274e00/0x40a459093b06b654 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1335295) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22023 expref: 17 pid: 4385 timeout: 935 lvb_type: 0 00010000:00010000:2.0:1746129579.937564:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094274e00/0x40a459093b06b654 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1335295) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22023 expref: 17 pid: 4385 timeout: 935 lvb_type: 0 00010000:00010000:2.0:1746129579.937598:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129579.937600:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129579.937607:0:7085:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136439a00/0x40a459093b06b662 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22031 expref: 25 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129579.937620:0:7085:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136439a00/0x40a459093b06b662 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22031 expref: 25 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129579.937653:0:7085:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880136439a00/0x40a459093b06b662 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22031 expref: 25 pid: 20577 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129579.937664:0:7085:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c07b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7085:1830948737607040:192.168.202.4@tcp:105: 00000100:00100000:2.0:1746129579.937903:0:7085:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094a84b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746129579.941837:0:7085:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c07b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7085:1830948737607040:192.168.202.4@tcp:105: 00010000:00010000:2.0:1746129579.941860:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129579.941919:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013577e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+16:1961:x1830948734384896:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 4430us (4694us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129579.941929:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8655 00000100:00100000:0.0:1746129579.944959:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129579.945097:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734385152 00000100:00100000:2.0:1746129579.945110:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734385152 00002000:00100000:2.0:1746129579.945165:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f4:0x0] (1048576->2097151) req@ffff88013577e680 x1830948734385152/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:320/0 lens 488/0 e 0 to 0 dl 1746129590 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129579.945176:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013577e680 with x1830948734385152 ext(1048576->2097151) 00002000:00010000:2.0:1746129579.945183:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013577e680 00000100:00100000:2.0:1746129579.945222:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8127 00000100:00100000:2.0:1746129579.945230:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013577e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+26:1962:x1830948734385152:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:2.0:1746129579.956834:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013577e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+26:1962:x1830948734385152:12345-192.168.202.4@tcp:3:cat.0 Request processed in 11596us (11879us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129579.956849:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8127 00002000:00100000:2.0:1746129579.961627:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f4:0x0] (1048576->2097151) req@ffff88013577e680 x1830948734385152/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:320/0 lens 488/440 e 0 to 0 dl 1746129590 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129579.961645:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013577e680 with x1830948734385152 ext(1048576->2097151) 00002000:00010000:2.0:1746129579.961651:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013577e680 00000100:00100000:0.0:1746129579.970577:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129579.970720:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734385408 00000100:00100000:3.0:1746129579.970733:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734385408 00002000:00100000:3.0:1746129579.970790:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->4194303) req@ffff88013577ed80 x1830948734385408/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:320/0 lens 488/0 e 0 to 0 dl 1746129590 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129579.970990:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013577ed80 with x1830948734385408 ext(3145728->4194303) 00002000:00010000:3.0:1746129579.970996:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013577ed80 00000100:00100000:3.0:1746129579.971027:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8128 00000100:00100000:3.0:1746129579.971035:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013577ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+15:1960:x1830948734385408:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:3.0:1746129579.988655:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013577ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+15:1960:x1830948734385408:12345-192.168.202.4@tcp:3:cat.0 Request processed in 17607us (18072us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129579.991043:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8128 00002000:00100000:3.0:1746129579.991063:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->4194303) req@ffff88013577ed80 x1830948734385408/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:320/0 lens 488/440 e 0 to 0 dl 1746129590 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129579.991073:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013577ed80 with x1830948734385408 ext(3145728->4194303) 00002000:00010000:3.0:1746129579.991079:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013577ed80 00000100:00100000:0.0:1746129580.016214:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129580.016638:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734385664 00000100:00100000:2.0:1746129580.016650:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734385664 00000100:00080000:0.0:1746129580.016759:0:7097:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746129580.017341:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11339 00000100:00100000:2.0:1746129580.017351:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013577f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+16:32624:x1830948734385664:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:2.0:1746129580.017379:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129580.017398:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800946f0c00/0x40a459093b06b669 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f22038 expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129580.017567:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800946f1200/0x40a459093b06b670 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129580.017583:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800946f1200/0x40a459093b06b670 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129580.017595:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800946f1200/0x40a459093b06b670 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00200000:2.0:1746129580.017653:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:2.0:1746129580.017767:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800946f0c00/0x40a459093b06b669 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22038 expref: 19 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129580.018652:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800946f1200/0x40a459093b06b670 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22038 expref: 18 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129580.018667:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:2.0:1746129580.018669:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746129580.018673:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800946f1200, rc 0) 00000100:00100000:2.0:1746129580.018731:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013577f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+18:32624:x1830948734385664:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 1382us (2532us total) trans 8589945460 rc 0/0 00000100:00100000:2.0:1746129580.018738:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11339 00000100:00100000:0.0:1746129580.023982:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129580.024020:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129580.024058:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129580.024186:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734385792 00000100:00100000:1.0:1746129580.024195:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734385792 00000100:00100000:1.0:1746129580.024248:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734385920 00000100:00100000:1.0:1746129580.024251:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734385920 00000100:00100000:1.0:1746129580.024277:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734386048 00000100:00100000:1.0:1746129580.024279:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734386048 00000100:00100000:1.0:1746129580.024322:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16732 00000100:00100000:1.0:1746129580.024330:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009507fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+9:1963:x1830948734385792:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129580.024350:0:4385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129580.024369:0:4385:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009faa2000/0x40a459093b06b67e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2203f expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129580.024425:0:4385:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800959d5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:4385:1830948737607168:192.168.202.4@tcp:106: 00000100:00100000:3.0:1746129580.024496:0:22480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16733 00000100:00100000:3.0:1746129580.024506:0:22480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009507d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+17:1963:x1830948734385920:12345-192.168.202.4@tcp:101:cat.0 00000100:00100000:1.0:1746129580.024513:0:4385:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130fc9480 going to sleep for 11 seconds 00010000:00010000:3.0:1746129580.024514:0:22480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129580.024526:0:22480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a9209a00/0x40a459093b06b685 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f22046 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129580.024533:0:8411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16734 00000100:00100000:1.0:1746129580.024538:0:8411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009507c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+18:1962:x1830948734386048:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129580.024539:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129580.024541:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129580.024545:0:8411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129580.024549:0:22480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a9209a00/0x40a459093b06b685 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22046 expref: 18 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129580.024552:0:8411:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009faa3600/0x40a459093b06b68c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2204d expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129580.024562:0:8411:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129580.024563:0:22480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a9209a00/0x40a459093b06b685 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22046 expref: 19 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129580.024563:0:8411:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129580.024569:0:8411:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009faa3600/0x40a459093b06b68c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2204d expref: 19 pid: 8411 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129580.024573:0:22480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a9209a00, rc 0) 00010000:00010000:1.0:1746129580.024578:0:8411:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009faa3600/0x40a459093b06b68c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2204d expref: 19 pid: 8411 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129580.024585:0:8411:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009faa3600, rc 0) 00000100:00100000:3.0:1746129580.024599:0:22480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009507d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+19:1963:x1830948734385920:12345-192.168.202.4@tcp:101:cat.0 Request processed in 95us (577us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129580.024604:0:8411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009507c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+19:1962:x1830948734386048:12345-192.168.202.4@tcp:101:cat.0 Request processed in 66us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129580.024605:0:22480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16733 00000100:00100000:1.0:1746129580.024609:0:8411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16734 00000100:00080000:3.0:1746129580.024645:0:7097:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746129580.027520:0:4385:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800959d5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:4385:1830948737607168:192.168.202.4@tcp:106: 00010000:00010000:1.0:1746129580.027558:0:4385:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009faa2000/0x40a459093b06b67e lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2203f expref: 10 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129580.027572:0:4385:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009faa2000/0x40a459093b06b67e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2203f expref: 10 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129580.027595:0:4385:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009faa2000, rc 0) 00000100:00100000:1.0:1746129580.027664:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009507fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+9:1963:x1830948734385792:12345-192.168.202.4@tcp:101:cat.0 Request processed in 3332us (3689us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129580.027672:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16732 00000100:00100000:0.0:1746129580.031940:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129580.034027:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734386304 00000100:00100000:1.0:1746129580.034040:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734386304 00000100:00100000:1.0:1746129580.034101:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16735 00000100:00100000:1.0:1746129580.034109:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009507ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+18:32624:x1830948734386304:12345-192.168.202.4@tcp:101:multiop.0 00000100:00100000:0.0:1746129580.034132:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00010000:00010000:1.0:1746129580.034133:0:4385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129580.034152:0:4385:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009faa3c00/0x40a459093b06b693 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2205b expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129580.034184:0:4385:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091545400/0x40a459093b06b574 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21f89 expref: 25 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129580.034198:0:4385:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091545200/0x40a459093b06b5c1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21fba expref: 19 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129580.034205:0:4385:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f8d5400/0x40a459093b06b5ac lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21fac expref: 5 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129580.034216:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129580.034217:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129580.034221:0:4385:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009faa3c00/0x40a459093b06b693 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [4005888->4194303] (req 4005888->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2205b expref: 19 pid: 4385 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129580.034246:0:20577:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734386176 00000100:00100000:3.0:1746129580.034250:0:20577:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734386176 00010000:00010000:1.0:1746129580.034261:0:4385:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f8d5400/0x40a459093b06b5ac lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21fac expref: 5 pid: 22480 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746129580.034272:0:20577:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16736 00010000:00010000:1.0:1746129580.034273:0:4385:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f8d5400/0x40a459093b06b5ac lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21fac expref: 5 pid: 22480 timeout: 935 lvb_type: 1 00000100:00100000:3.0:1746129580.034277:0:20577:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009507e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+9:32628:x1830948734386176:12345-192.168.202.4@tcp:101:cat.0 00000100:00100000:1.0:1746129580.034285:0:4385:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800959d5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:4385:1830948737607296:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129580.034286:0:20577:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129580.034317:0:20577:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a9209600/0x40a459093b06b69a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f22054 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129580.034332:0:20577:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008fba4600/0x40a459093b06b623 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1036288->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21ff2 expref: 14 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129580.034337:0:20577:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129580.034338:0:20577:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129580.034340:0:20577:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a9209600/0x40a459093b06b69a lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22054 expref: 10 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129580.034358:0:20577:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008fba4600/0x40a459093b06b623 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1036288->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21ff2 expref: 14 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129580.034365:0:20577:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008fba4600/0x40a459093b06b623 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1036288->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21ff2 expref: 14 pid: 11014 timeout: 935 lvb_type: 0 00000100:00100000:3.0:1746129580.034373:0:20577:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20577:1830948737607424:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129580.034383:0:4385:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091545200/0x40a459093b06b5c1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21fba expref: 19 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129580.034390:0:4385:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091545200/0x40a459093b06b5c1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21fba expref: 19 pid: 4385 timeout: 935 lvb_type: 0 00000100:00100000:3.0:1746129580.034395:0:20577:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5c68540 going to sleep for 11 seconds 00000100:00100000:1.0:1746129580.034398:0:4385:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800959d4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:4385:1830948737607552:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129580.034419:0:4385:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091545400/0x40a459093b06b574 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21f89 expref: 25 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129580.034426:0:4385:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091545400/0x40a459093b06b574 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21f89 expref: 25 pid: 4385 timeout: 935 lvb_type: 0 00000100:00100000:1.0:1746129580.034439:0:4385:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800959d6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:4385:1830948737607680:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129580.034453:0:4385:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130fc9480 going to sleep for 11 seconds 00000100:00100000:1.0:1746129580.040945:0:4385:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800959d5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:4385:1830948737607296:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129580.041053:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129580.041093:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129580.041117:0:20577:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20577:1830948737607424:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129580.041149:0:20577:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a9209600/0x40a459093b06b69a lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22054 expref: 10 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129580.041169:0:20577:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a9209600, rc 0) 00000100:00100000:2.0:1746129580.041218:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734386432 00000100:00100000:2.0:1746129580.041225:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734386432 00000100:00100000:0.0:1746129580.041229:0:20577:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009507e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+10:32628:x1830948734386176:12345-192.168.202.4@tcp:101:cat.0 Request processed in 6951us (7098us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129580.041249:0:20577:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16736 00010000:00010000:2.0:1746129580.041268:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f8d5400/0x40a459093b06b5ac lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21fac expref: 6 pid: 22480 timeout: 935 lvb_type: 1 00000100:00100000:0.0:1746129580.041290:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129580.041316:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8656 00000100:00100000:2.0:1746129580.041323:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c07b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:068dab75-d300-4ead-a742-d14572ad1e50+6:1960:x1830948734386432:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129580.041335:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129580.041358:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f8d5400/0x40a459093b06b5ac lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21fac expref: 6 pid: 22480 timeout: 935 lvb_type: 1 00010000:00010000:2.0:1746129580.041368:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f8d5400/0x40a459093b06b5ac lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21fac expref: 6 pid: 22480 timeout: 935 lvb_type: 1 00010000:00010000:2.0:1746129580.041392:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f8d5400/0x40a459093b06b5ac lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21fac expref: 6 pid: 22480 timeout: 935 lvb_type: 1 00000100:00100000:0.0:1746129580.041406:0:20578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734386688 00010000:00010000:2.0:1746129580.041407:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129580.041409:0:20578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734386688 00010000:00010000:0.0:1746129580.041422:0:20578:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091545200/0x40a459093b06b5c1 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21fba expref: 20 pid: 4385 timeout: 935 lvb_type: 0 00000100:00100000:2.0:1746129580.041425:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c07b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:068dab75-d300-4ead-a742-d14572ad1e50+5:1960:x1830948734386432:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 103us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129580.041431:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8656 00000100:00100000:0.0:1746129580.041437:0:20578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8657 00000100:00100000:0.0:1746129580.041442:0:20578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6ce3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:1962:x1830948734386688:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129580.041448:0:20578:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129580.041457:0:20578:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091545200/0x40a459093b06b5c1 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21fba expref: 20 pid: 4385 timeout: 935 lvb_type: 0 00010000:00010000:0.0:1746129580.041469:0:20578:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091545200/0x40a459093b06b5c1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21fba expref: 20 pid: 4385 timeout: 935 lvb_type: 0 00010000:00010000:0.0:1746129580.041481:0:20578:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129580.041495:0:20578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6ce3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:1962:x1830948734386688:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 53us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129580.041501:0:20578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8657 00010000:00010000:1.0:1746129580.041558:0:4385:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091545200/0x40a459093b06b5c1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21fba expref: 19 pid: 4385 timeout: 935 lvb_type: 0 00000100:00100000:1.0:1746129580.041578:0:4385:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800959d4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:4385:1830948737607552:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129580.041588:0:4385:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800959d6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:4385:1830948737607680:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129580.041607:0:4385:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009faa3c00/0x40a459093b06b693 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [4005888->4194303] (req 4005888->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2205b expref: 18 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129580.041615:0:4385:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009faa3c00, rc 0) 00000100:00100000:1.0:1746129580.041636:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009507ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+18:32624:x1830948734386304:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 7529us (9708us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129580.041642:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16735 00000100:00100000:3.0:1746129580.041645:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734386560 00000100:00100000:3.0:1746129580.041649:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734386560 00002000:00100000:3.0:1746129580.041679:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ec:0x0] (1036288->1048575) req@ffff88009507ea00 x1830948734386560/t0(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:321/0 lens 12776/0 e 0 to 0 dl 1746129591 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129580.041688:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009507ea00 with x1830948734386560 ext(1036288->1048575) 00010000:00010000:3.0:1746129580.041695:0:25745:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008fba4600/0x40a459093b06b623 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1036288->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21ff2 expref: 15 pid: 11014 timeout: 935 lvb_type: 0 00010000:00010000:3.0:1746129580.041707:0:25745:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008fba4600/0x40a459093b06b623 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1036288->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21ff2 expref: 15 pid: 11014 timeout: 935 lvb_type: 0 00002000:00010000:3.0:1746129580.041714:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009507ea00 00000100:00100000:3.0:1746129580.041735:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2510 00000100:00100000:3.0:1746129580.041740:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009507ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+15:1960:x1830948734386560:12345-192.168.202.4@tcp:4:cat.0 00000100:00100000:3.0:1746129580.043158:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009507ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+17:1960:x1830948734386560:12345-192.168.202.4@tcp:4:cat.0 Request processed in 1412us (2101us total) trans 21474841416 rc 0/0 00000100:00100000:3.0:1746129580.043167:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2510 00002000:00100000:3.0:1746129580.043174:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ec:0x0] (1036288->1048575) req@ffff88009507ea00 x1830948734386560/t21474841416(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:321/0 lens 12776/448 e 0 to 0 dl 1746129591 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129580.043181:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009507ea00 with x1830948734386560 ext(1036288->1048575) 00010000:00010000:3.0:1746129580.043188:0:25745:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008fba4600/0x40a459093b06b623 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1036288->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21ff2 expref: 17 pid: 11014 timeout: 935 lvb_type: 0 00010000:00010000:3.0:1746129580.043197:0:25745:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008fba4600/0x40a459093b06b623 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1036288->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21ff2 expref: 17 pid: 11014 timeout: 935 lvb_type: 0 00002000:00010000:3.0:1746129580.043203:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009507ea00 00000100:00100000:0.0:1746129580.044565:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129580.044633:0:7086:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734386816 00000100:00100000:2.0:1746129580.044643:0:7086:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734386816 00010000:00010000:2.0:1746129580.044679:0:7086:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091545400/0x40a459093b06b574 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21f89 expref: 26 pid: 4385 timeout: 935 lvb_type: 0 00000100:00100000:2.0:1746129580.044737:0:7086:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8658 00000100:00100000:2.0:1746129580.044746:0:7086:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009507dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ada2ffba-8920-4ecb-8068-68caa9806978+26:1962:x1830948734386816:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129580.044765:0:7086:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129580.044793:0:7086:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091545400/0x40a459093b06b574 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21f89 expref: 26 pid: 4385 timeout: 935 lvb_type: 0 00010000:00010000:2.0:1746129580.044806:0:7086:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091545400/0x40a459093b06b574 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21f89 expref: 26 pid: 4385 timeout: 935 lvb_type: 0 00010000:00010000:2.0:1746129580.044830:0:7086:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091545400/0x40a459093b06b574 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21f89 expref: 26 pid: 4385 timeout: 935 lvb_type: 0 00010000:00010000:2.0:1746129580.044847:0:7086:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129580.044849:0:7086:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129580.044856:0:7086:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009faa3c00/0x40a459093b06b693 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4005888->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2205b expref: 17 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129580.044865:0:7086:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009faa3c00/0x40a459093b06b693 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4005888->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2205b expref: 17 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129580.044911:0:7086:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009faa3c00/0x40a459093b06b693 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4005888->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2205b expref: 17 pid: 4385 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129580.044925:0:7086:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c078700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7086:1830948737607808:192.168.202.4@tcp:105: 00000100:00100000:2.0:1746129580.046156:0:7086:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094a84b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746129580.048003:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129580.048009:0:7086:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c078700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7086:1830948737607808:192.168.202.4@tcp:105: 00010000:00010000:2.0:1746129580.048030:0:7086:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129580.048086:0:7086:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009507dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ada2ffba-8920-4ecb-8068-68caa9806978+25:1962:x1830948734386816:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 3340us (3527us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129580.048099:0:7086:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8658 00000100:00100000:3.0:1746129580.048490:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734387072 00000100:00100000:3.0:1746129580.048496:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734387072 00002000:00100000:3.0:1746129580.048527:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f5:0x0] (4005888->4009983) req@ffff88009507f100 x1830948734387072/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:321/0 lens 488/0 e 0 to 0 dl 1746129591 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129580.048535:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009507f100 with x1830948734387072 ext(4005888->4009983) 00002000:00010000:3.0:1746129580.048540:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009507f100 00000100:00100000:3.0:1746129580.048560:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8129 00000100:00100000:3.0:1746129580.048565:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009507f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+18:1963:x1830948734387072:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:3.0:1746129580.048694:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009507f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+18:1963:x1830948734387072:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 128us (699us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129580.048699:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8129 00002000:00100000:3.0:1746129580.048704:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f5:0x0] (4005888->4009983) req@ffff88009507f100 x1830948734387072/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:321/0 lens 488/4536 e 0 to 0 dl 1746129591 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129580.048711:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009507f100 with x1830948734387072 ext(4005888->4009983) 00002000:00010000:3.0:1746129580.048713:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009507f100 00000100:00100000:1.0:1746129580.050982:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129580.051125:0:7086:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734387200 00000100:00100000:2.0:1746129580.051136:0:7086:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734387200 00010000:00010000:2.0:1746129580.051183:0:7086:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008fba4600/0x40a459093b06b623 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1036288->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21ff2 expref: 17 pid: 11014 timeout: 935 lvb_type: 0 00000100:00100000:2.0:1746129580.051221:0:7086:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8659 00000100:00100000:2.0:1746129580.051230:0:7086:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959d6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ada2ffba-8920-4ecb-8068-68caa9806978+17:1963:x1830948734387200:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129580.051262:0:7086:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129580.051291:0:7086:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008fba4600/0x40a459093b06b623 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1036288->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21ff2 expref: 17 pid: 11014 timeout: 935 lvb_type: 0 00010000:00010000:2.0:1746129580.051333:0:7086:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008fba4600/0x40a459093b06b623 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1036288->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21ff2 expref: 17 pid: 11014 timeout: 935 lvb_type: 0 00010000:00010000:2.0:1746129580.051367:0:7086:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008fba4600/0x40a459093b06b623 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1036288->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21ff2 expref: 17 pid: 11014 timeout: 935 lvb_type: 0 00010000:00010000:2.0:1746129580.051383:0:7086:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129580.051385:0:7086:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129580.051393:0:7086:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a9209600/0x40a459093b06b69a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22054 expref: 9 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129580.051403:0:7086:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a9209600/0x40a459093b06b69a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22054 expref: 9 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129580.051446:0:7086:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a9209600/0x40a459093b06b69a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22054 expref: 9 pid: 20577 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129580.051461:0:7086:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c078700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7086:1830948737607936:192.168.202.4@tcp:105: 00000100:00100000:2.0:1746129580.051866:0:7086:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094a84b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746129580.054017:0:7086:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c078700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7086:1830948737607936:192.168.202.4@tcp:105: 00010000:00010000:2.0:1746129580.054053:0:7086:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129580.054117:0:7086:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959d6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ada2ffba-8920-4ecb-8068-68caa9806978+16:1963:x1830948734387200:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 2887us (3147us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129580.054566:0:7086:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8659 00000100:00100000:0.0:1746129580.056666:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129580.056983:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734387328 00000100:00100000:1.0:1746129580.056995:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734387328 00000100:00100000:1.0:1746129580.057422:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16737 00000100:00100000:1.0:1746129580.057431:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013577c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+10:32624:x1830948734387328:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:1.0:1746129580.057448:0:4385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129580.057466:0:4385:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009faa3200/0x40a459093b06b6a1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f22062 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129580.057500:0:4385:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091544a00/0x40a459093b06b607 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->5148671) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21fe4 expref: 15 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129580.057508:0:4385:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008fba4c00/0x40a459093b06b5f9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21fd6 expref: 11 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129580.057519:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129580.057522:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129580.057526:0:4385:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009faa3200/0x40a459093b06b6a1 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [4194304->4251647] (req 4194304->4251647) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22062 expref: 11 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129580.057562:0:4385:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008fba4c00/0x40a459093b06b5f9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21fd6 expref: 11 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129580.057576:0:4385:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008fba4c00/0x40a459093b06b5f9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21fd6 expref: 11 pid: 11014 timeout: 935 lvb_type: 0 00000100:00100000:1.0:1746129580.057590:0:4385:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800959d4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:4385:1830948737608064:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129580.057746:0:4385:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091544a00/0x40a459093b06b607 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->5148671) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21fe4 expref: 15 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129580.057756:0:4385:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091544a00/0x40a459093b06b607 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->5148671) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21fe4 expref: 15 pid: 4385 timeout: 935 lvb_type: 0 00000100:00100000:1.0:1746129580.057766:0:4385:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800959d5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:4385:1830948737608192:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129580.057796:0:4385:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130fc9480 going to sleep for 11 seconds 00000100:00100000:0.0:1746129580.065613:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129580.065664:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129580.065699:0:8416:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734387840 00000100:00100000:3.0:1746129580.065700:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734387712 00000100:00100000:3.0:1746129580.065709:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734387712 00000100:00100000:0.0:1746129580.065709:0:8416:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734387840 00002000:00100000:3.0:1746129580.065748:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff88012baeed80 x1830948734387712/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:321/0 lens 488/0 e 0 to 0 dl 1746129591 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129580.065751:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3f4:0x0] (1048576->2097151) req@ffff88013577e300 x1830948734387840/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:321/0 lens 488/0 e 0 to 0 dl 1746129591 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129580.065756:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012baeed80 with x1830948734387712 ext(1048576->2097151) 00002000:00010000:3.0:1746129580.065760:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012baeed80 00002000:00100000:0.0:1746129580.065761:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013577e300 with x1830948734387840 ext(1048576->2097151) 00002000:00010000:0.0:1746129580.065766:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013577e300 00000100:00100000:3.0:1746129580.065797:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8130 00000100:00100000:3.0:1746129580.065802:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baeed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+19:1962:x1830948734387712:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:1.0:1746129580.065890:0:4385:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800959d4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:4385:1830948737608064:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129580.065907:0:4385:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800959d5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:4385:1830948737608192:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129580.065941:0:4385:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009faa3200/0x40a459093b06b6a1 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [4194304->4251647] (req 4194304->4251647) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22062 expref: 11 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129580.065960:0:4385:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009faa3200, rc 0) 00000100:00100000:1.0:1746129580.066030:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013577c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+11:32624:x1830948734387328:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 8598us (9373us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129580.066039:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16737 00000100:00100000:1.0:1746129580.066127:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129580.066594:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129580.066658:0:8416:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734388096 00000100:00100000:0.0:1746129580.066664:0:8416:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734388096 00002000:00100000:0.0:1746129580.066705:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3ec:0x0] (0->1048575) req@ffff8800959d5880 x1830948734388096/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:321/0 lens 488/0 e 0 to 0 dl 1746129591 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129580.066712:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800959d5880 with x1830948734388096 ext(0->1048575) 00002000:00010000:0.0:1746129580.066717:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800959d5880 00000100:00100000:2.0:1746129580.066911:0:21725:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8131 00000100:00100000:2.0:1746129580.066920:0:21725:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013577e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:1962:x1830948734387840:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:3.0:1746129580.066924:0:31521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8132 00000100:00100000:3.0:1746129580.066932:0:31521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+11:1962:x1830948734388096:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:1.0:1746129580.067018:0:7086:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734388352 00000100:00100000:1.0:1746129580.067023:0:7086:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734388352 00010000:00010000:1.0:1746129580.067045:0:7086:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091544a00/0x40a459093b06b607 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->5148671) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21fe4 expref: 16 pid: 4385 timeout: 935 lvb_type: 0 00000100:00100000:1.0:1746129580.067072:0:7086:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8660 00000100:00100000:1.0:1746129580.067080:0:7086:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959d4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ada2ffba-8920-4ecb-8068-68caa9806978+16:1961:x1830948734388352:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129580.067095:0:7086:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129580.067120:0:7086:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091544a00/0x40a459093b06b607 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 4194304->5148671) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21fe4 expref: 16 pid: 4385 timeout: 935 lvb_type: 0 00010000:00010000:1.0:1746129580.067131:0:7086:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091544a00/0x40a459093b06b607 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 4194304->5148671) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21fe4 expref: 16 pid: 4385 timeout: 935 lvb_type: 0 00010000:00010000:1.0:1746129580.067162:0:7086:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091544a00/0x40a459093b06b607 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 4194304->5148671) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21fe4 expref: 16 pid: 4385 timeout: 935 lvb_type: 0 00010000:00010000:1.0:1746129580.067183:0:7086:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129580.067217:0:7086:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959d4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ada2ffba-8920-4ecb-8068-68caa9806978+15:1961:x1830948734388352:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 137us (623us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129580.067223:0:7086:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8660 00000100:00100000:0.0:1746129580.069454:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129580.070808:0:20578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734388224 00000100:00100000:1.0:1746129580.070820:0:20578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734388224 00010000:00010000:1.0:1746129580.070864:0:20578:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008fba4c00/0x40a459093b06b5f9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21fd6 expref: 13 pid: 11014 timeout: 935 lvb_type: 0 00000100:00100000:1.0:1746129580.070922:0:20578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8661 00000100:00100000:1.0:1746129580.070932:0:20578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baef100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+13:1962:x1830948734388224:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129580.070952:0:20578:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129580.070982:0:20578:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008fba4c00/0x40a459093b06b5f9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21fd6 expref: 13 pid: 11014 timeout: 935 lvb_type: 0 00010000:00010000:1.0:1746129580.070997:0:20578:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008fba4c00/0x40a459093b06b5f9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21fd6 expref: 13 pid: 11014 timeout: 935 lvb_type: 0 00010000:00010000:1.0:1746129580.071027:0:20578:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008fba4c00/0x40a459093b06b5f9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21fd6 expref: 13 pid: 11014 timeout: 935 lvb_type: 0 00010000:00010000:1.0:1746129580.071044:0:20578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129580.071048:0:20578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129580.071057:0:20578:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009faa3200/0x40a459093b06b6a1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4251647) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22062 expref: 12 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129580.071067:0:20578:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009faa3200/0x40a459093b06b6a1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4251647) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22062 expref: 12 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129580.071110:0:20578:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009faa3200/0x40a459093b06b6a1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4251647) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22062 expref: 12 pid: 4385 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129580.071126:0:20578:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800959d6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:20578:1830948737608320:192.168.202.4@tcp:105: 00000100:00100000:1.0:1746129580.071264:0:20578:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130fc9480 going to sleep for 11 seconds 00000100:00100000:1.0:1746129580.082539:0:20578:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800959d6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:20578:1830948737608320:192.168.202.4@tcp:105: 00010000:00010000:1.0:1746129580.082563:0:20578:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129580.082612:0:20578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baef100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+12:1962:x1830948734388224:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 11680us (13164us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129580.082624:0:20578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8661 00000100:00100000:0.0:1746129580.082777:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129580.082909:0:31521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+10:1962:x1830948734388096:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 15976us (16782us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129580.082918:0:31521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8132 00002000:00100000:3.0:1746129580.082929:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3ec:0x0] (0->1048575) req@ffff8800959d5880 x1830948734388096/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:321/0 lens 488/440 e 0 to 0 dl 1746129591 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129580.082939:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800959d5880 with x1830948734388096 ext(0->1048575) 00002000:00010000:3.0:1746129580.082944:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800959d5880 00000100:00100000:3.0:1746129580.082960:0:31521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734388608 00000100:00100000:3.0:1746129580.082965:0:31521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734388608 00002000:00100000:3.0:1746129580.082991:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3ef:0x0] (4247552->4251647) req@ffff88012baeea00 x1830948734388608/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:321/0 lens 488/0 e 0 to 0 dl 1746129591 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129580.082998:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012baeea00 with x1830948734388608 ext(4247552->4251647) 00002000:00010000:3.0:1746129580.083001:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012baeea00 00000100:00100000:3.0:1746129580.083012:0:31521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8133 00000100:00100000:3.0:1746129580.083018:0:31521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baeea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+10:1962:x1830948734388608:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:3.0:1746129580.083175:0:31521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baeea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+10:1962:x1830948734388608:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 157us (398us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129580.083180:0:31521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8133 00002000:00100000:3.0:1746129580.083184:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3ef:0x0] (4247552->4251647) req@ffff88012baeea00 x1830948734388608/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:321/0 lens 488/4536 e 0 to 0 dl 1746129591 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129580.083192:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012baeea00 with x1830948734388608 ext(4247552->4251647) 00002000:00010000:3.0:1746129580.083194:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012baeea00 00000100:00100000:2.0:1746129580.083478:0:21725:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013577e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:1962:x1830948734387840:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 16559us (17879us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129580.083486:0:21725:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8131 00002000:00100000:2.0:1746129580.083492:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f4:0x0] (1048576->2097151) req@ffff88013577e300 x1830948734387840/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:321/0 lens 488/440 e 0 to 0 dl 1746129591 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129580.083499:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013577e300 with x1830948734387840 ext(1048576->2097151) 00002000:00010000:2.0:1746129580.083503:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013577e300 00000100:00100000:1.0:1746129580.092095:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baeed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+18:1962:x1830948734387712:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 26280us (26420us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129580.092107:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8130 00002000:00100000:1.0:1746129580.092120:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff88012baeed80 x1830948734387712/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:321/0 lens 488/440 e 0 to 0 dl 1746129591 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129580.092130:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012baeed80 with x1830948734387712 ext(1048576->2097151) 00002000:00010000:1.0:1746129580.092136:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012baeed80 00000100:00100000:0.0:1746129580.104820:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129580.107331:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734388864 00000100:00100000:1.0:1746129580.107344:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734388864 00002000:00100000:1.0:1746129580.107401:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f5:0x0] (2097152->3145727) req@ffff88012baeca80 x1830948734388864/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:321/0 lens 488/0 e 0 to 0 dl 1746129591 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129580.107412:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012baeca80 with x1830948734388864 ext(2097152->3145727) 00002000:00010000:1.0:1746129580.107418:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012baeca80 00000100:00100000:1.0:1746129580.107447:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8134 00000100:00100000:1.0:1746129580.107455:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baeca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+18:1962:x1830948734388864:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:1.0:1746129580.117116:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baeca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+18:1962:x1830948734388864:12345-192.168.202.4@tcp:3:cat.0 Request processed in 9649us (12292us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129580.117130:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8134 00002000:00100000:1.0:1746129580.117143:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f5:0x0] (2097152->3145727) req@ffff88012baeca80 x1830948734388864/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:321/0 lens 488/440 e 0 to 0 dl 1746129591 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129580.117151:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012baeca80 with x1830948734388864 ext(2097152->3145727) 00002000:00010000:1.0:1746129580.117158:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012baeca80 00000100:00100000:1.0:1746129580.122694:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737608448:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1746129580.122767:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129580.122834:0:8414:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737608448 00000100:00100000:0.0:1746129580.122844:0:8414:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737608448 00000100:00100000:0.0:1746129580.122909:0:8414:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1746129580.122916:0:8414:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1830948737608448:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1746129580.122920:0:7097:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1746129580.122939:0:8414:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 641925120 pending 1703936 free 3852468224 avail 3831496704 00000100:00100000:0.0:1746129580.122979:0:8414:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1830948737608448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 63us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129580.122984:0:8414:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:1.0:1746129580.123001:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737608448:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1746129580.125029:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129580.125099:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734388992 00000100:00100000:1.0:1746129580.125108:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734388992 00000100:00100000:1.0:1746129580.125155:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16738 00000100:00100000:1.0:1746129580.125162:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+10:32628:x1830948734388992:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129580.125177:0:4385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129580.125194:0:4385:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c668400/0x40a459093b06b6a8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f22069 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129580.125222:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129580.125224:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129580.125241:0:4385:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c668400/0x40a459093b06b6a8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22069 expref: 11 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129580.125255:0:4385:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c668400/0x40a459093b06b6a8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22069 expref: 11 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129580.125266:0:4385:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c668400, rc 0) 00000100:00100000:1.0:1746129580.125344:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+11:32628:x1830948734388992:12345-192.168.202.4@tcp:101:cat.0 Request processed in 181us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129580.125350:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16738 00000100:00100000:0.0:1746129580.131579:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129580.131634:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129580.132026:0:21725:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734389376 00000100:00100000:1.0:1746129580.132026:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734389504 00000100:00100000:2.0:1746129580.132035:0:21725:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734389376 00000100:00100000:1.0:1746129580.132035:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734389504 00002000:00100000:2.0:1746129580.132083:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->4194303) req@ffff88012baee300 x1830948734389376/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:321/0 lens 488/0 e 0 to 0 dl 1746129591 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129580.132083:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f5:0x0] (3145728->4005887) req@ffff88012baed180 x1830948734389504/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:321/0 lens 488/0 e 0 to 0 dl 1746129591 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129580.132092:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012baee300 with x1830948734389376 ext(3145728->4194303) 00002000:00100000:1.0:1746129580.132092:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012baed180 with x1830948734389504 ext(3145728->4005887) 00002000:00010000:2.0:1746129580.132097:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012baee300 00002000:00010000:1.0:1746129580.132097:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012baed180 00000100:00100000:2.0:1746129580.132127:0:21725:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8135 00000100:00100000:2.0:1746129580.132134:0:21725:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+11:1961:x1830948734389376:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:1.0:1746129580.132136:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8136 00000100:00100000:1.0:1746129580.132140:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+18:1960:x1830948734389504:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129580.148880:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+18:1960:x1830948734389504:12345-192.168.202.4@tcp:3:cat.0 Request processed in 16725us (17232us total) trans 0 rc 860160/860160 00000100:00100000:0.0:1746129580.148893:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8136 00002000:00100000:0.0:1746129580.148905:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f5:0x0] (3145728->4005887) req@ffff88012baed180 x1830948734389504/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:321/0 lens 488/440 e 0 to 0 dl 1746129591 ref 1 fl Complete:/200/0 rc 860160/860160 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129580.148914:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012baed180 with x1830948734389504 ext(3145728->4005887) 00002000:00010000:0.0:1746129580.148920:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012baed180 00000100:00100000:2.0:1746129580.151707:0:21725:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+11:1961:x1830948734389376:12345-192.168.202.4@tcp:3:cat.0 Request processed in 19562us (20127us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129580.151719:0:21725:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8135 00002000:00100000:2.0:1746129580.151731:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->4194303) req@ffff88012baee300 x1830948734389376/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:321/0 lens 488/440 e 0 to 0 dl 1746129591 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129580.151740:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012baee300 with x1830948734389376 ext(3145728->4194303) 00002000:00010000:2.0:1746129580.151746:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012baee300 00000100:00100000:1.0:1746129580.154540:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737608576:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1746129580.154616:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129580.154980:0:8414:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737608576 00000100:00100000:0.0:1746129580.154988:0:8414:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737608576 00000100:00080000:3.0:1746129580.155643:0:7097:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746129580.156025:0:8414:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:1.0:1746129580.156035:0:8414:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1830948737608576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1746129580.156065:0:8414:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 1703936 granted 660537344 pending 11927552 free 3853516800 avail 3825205248 00000100:00100000:1.0:1746129580.156127:0:8414:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1830948737608576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (1512us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129580.156133:0:8414:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:1.0:1746129580.156181:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737608576:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1746129580.156318:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1830948737608832:0@lo:400:kworker.0 00000100:00100000:3.0:1746129580.156355:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129580.156378:0:3300:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1746129580.156383:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1830948737608960:0@lo:400:kworker.0 00000100:00100000:3.0:1746129580.156397:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129580.156417:0:2271:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737608832 00000100:00100000:3.0:1746129580.156421:0:2271:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737608832 00000100:00100000:3.0:1746129580.156449:0:2271:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737608960 00000100:00100000:3.0:1746129580.156451:0:2271:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737608960 00000100:00100000:3.0:1746129580.156464:0:2271:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1746129580.156469:0:2271:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1830948737608832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746129580.156495:0:2271:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1830948737608832:12345-0@lo:400:kworker.0 Request processed in 26us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129580.156500:0:2271:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1746129580.156509:0:2271:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1746129580.156513:0:2271:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1830948737608960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746129580.156529:0:2271:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1830948737608960:12345-0@lo:400:kworker.0 Request processed in 17us (132us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129580.156534:0:2271:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1746129580.156556:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1830948737608960:0@lo:400:kworker.0 00000100:00100000:3.0:1746129580.156563:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1830948737608832:0@lo:400:kworker.0 00000100:00080000:3.0:1746129580.156574:0:7097:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746129580.156672:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f03f6bde-e986-4df5-86c3-48805e205677:3303:1830948737608704:0@lo:400:kworker.0 00000100:00100000:2.0:1746129580.156702:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129580.156744:0:3303:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1746129580.156749:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1830948737609088:0@lo:400:kworker.0 00000100:00100000:2.0:1746129580.156766:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129580.156817:0:14543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737608704 00000100:00100000:0.0:1746129580.156821:0:14543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737608704 00000100:00100000:0.0:1746129580.156842:0:14543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1746129580.156846:0:14543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098ecc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f03f6bde-e986-4df5-86c3-48805e205677+18:3303:x1830948737608704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746129580.156879:0:14543:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098ecc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f03f6bde-e986-4df5-86c3-48805e205677+18:3303:x1830948737608704:12345-0@lo:400:kworker.0 Request processed in 33us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129580.156885:0:14543:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1746129580.157030:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f03f6bde-e986-4df5-86c3-48805e205677:3303:1830948737608704:0@lo:400:kworker.0 00000100:00100000:3.0:1746129580.157218:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737609088 00000100:00100000:3.0:1746129580.157221:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737609088 00000100:00100000:3.0:1746129580.157339:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1746129580.157344:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c078700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1830948737609088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746129580.157542:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c078700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1830948737609088:12345-0@lo:400:kworker.0 Request processed in 197us (774us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129580.157547:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1746129580.157594:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1830948737609088:0@lo:400:kworker.0 00000100:00100000:0.0:1746129580.161222:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129580.161547:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734389632 00000100:00100000:1.0:1746129580.161557:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734389632 00000100:00100000:1.0:1746129580.161606:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16739 00000100:00100000:1.0:1746129580.161614:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+11:1960:x1830948734389632:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129580.161635:0:4385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129580.161663:0:4385:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c669400/0x40a459093b06b6af lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f22070 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129580.161732:0:4385:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800959d7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:4385:1830948737609216:192.168.202.4@tcp:106: 00000100:00100000:1.0:1746129580.161844:0:4385:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130fc9480 going to sleep for 11 seconds 00000100:00100000:1.0:1746129580.163223:0:4385:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800959d7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:4385:1830948737609216:192.168.202.4@tcp:106: 00010000:00010000:1.0:1746129580.163266:0:4385:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c669400/0x40a459093b06b6af lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22070 expref: 12 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129580.163280:0:4385:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c669400/0x40a459093b06b6af lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22070 expref: 12 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129580.163571:0:4385:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c669400, rc 0) 00000100:00100000:1.0:1746129580.163861:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+11:1960:x1830948734389632:12345-192.168.202.4@tcp:101:cat.0 Request processed in 2246us (2648us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129580.163873:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16739 00000100:00100000:0.0:1746129580.168578:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129580.168934:0:21725:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734389888 00000100:00100000:2.0:1746129580.168943:0:21725:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734389888 00002000:00100000:2.0:1746129580.168990:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ef:0x0] (4251648->5148671) req@ffff88012baee680 x1830948734389888/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:321/0 lens 488/0 e 0 to 0 dl 1746129591 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129580.169000:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012baee680 with x1830948734389888 ext(4251648->5148671) 00002000:00010000:2.0:1746129580.169006:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012baee680 00000100:00100000:2.0:1746129580.169037:0:21725:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8137 00000100:00100000:2.0:1746129580.169044:0:21725:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+11:1963:x1830948734389888:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:3.0:1746129580.190993:0:21725:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+11:1963:x1830948734389888:12345-192.168.202.4@tcp:3:cat.0 Request processed in 21932us (22409us total) trans 0 rc 897024/897024 00000100:00100000:3.0:1746129580.191008:0:21725:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8137 00002000:00100000:3.0:1746129580.191023:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ef:0x0] (4251648->5148671) req@ffff88012baee680 x1830948734389888/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:321/0 lens 488/440 e 0 to 0 dl 1746129591 ref 1 fl Complete:/200/0 rc 897024/897024 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129580.191032:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012baee680 with x1830948734389888 ext(4251648->5148671) 00002000:00010000:3.0:1746129580.191038:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012baee680 00000100:00100000:1.0:1746129580.194469:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129580.194596:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734390016 00000100:00100000:2.0:1746129580.194606:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734390016 00000100:00100000:2.0:1746129580.194743:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16740 00000100:00100000:2.0:1746129580.194753:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+11:1961:x1830948734390016:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129580.194774:0:4385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129580.194795:0:4385:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800946f0800/0x40a459093b06b6b6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f22077 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129580.194854:0:4385:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c07aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:4385:1830948737609344:192.168.202.4@tcp:106: 00000100:00100000:1.0:1746129580.195360:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129580.196458:0:4385:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094a84b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746129580.196532:0:20577:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734390144 00000100:00100000:3.0:1746129580.196539:0:20577:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734390144 00000100:00100000:3.0:1746129580.196582:0:20577:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16741 00000100:00100000:3.0:1746129580.196589:0:20577:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ada2ffba-8920-4ecb-8068-68caa9806978+15:32630:x1830948734390144:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:3.0:1746129580.196602:0:20577:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129580.196616:0:20577:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f118200/0x40a459093b06b6bd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2207e expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129580.196642:0:20577:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a9209600/0x40a459093b06b69a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22054 expref: 12 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129580.196651:0:20577:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129580.196652:0:20577:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129580.196655:0:20577:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f118200/0x40a459093b06b6bd lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [946176->1048575] (req 946176->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2207e expref: 16 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129580.196680:0:20577:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a9209600/0x40a459093b06b69a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22054 expref: 12 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129580.196692:0:20577:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a9209600/0x40a459093b06b69a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22054 expref: 12 pid: 20577 timeout: 935 lvb_type: 0 00000100:00100000:3.0:1746129580.196708:0:20577:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20577:1830948737609472:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129580.196756:0:20577:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5c683c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129580.200036:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129580.200092:0:20578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734390272 00000100:00100000:1.0:1746129580.200102:0:20578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734390272 00010000:00010000:1.0:1746129580.200141:0:20578:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a9209600/0x40a459093b06b69a lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22054 expref: 13 pid: 20577 timeout: 935 lvb_type: 0 00000100:00100000:1.0:1746129580.200170:0:20578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8662 00000100:00100000:1.0:1746129580.200178:0:20578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baefb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+13:1963:x1830948734390272:12345-192.168.202.4@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746129580.200184:0:4385:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c07aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:4385:1830948737609344:192.168.202.4@tcp:106: 00010000:00010000:1.0:1746129580.200194:0:20578:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129580.200207:0:20578:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a9209600/0x40a459093b06b69a lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22054 expref: 13 pid: 20577 timeout: 935 lvb_type: 0 00010000:00010000:2.0:1746129580.200215:0:4385:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800946f0800/0x40a459093b06b6b6 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22077 expref: 13 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129580.200218:0:20578:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a9209600/0x40a459093b06b69a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22054 expref: 13 pid: 20577 timeout: 935 lvb_type: 0 00010000:00010000:2.0:1746129580.200240:0:4385:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800946f0800/0x40a459093b06b6b6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22077 expref: 13 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129580.200249:0:20578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129580.200252:0:20578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129580.200258:0:4385:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800946f0800, rc 0) 00010000:00010000:1.0:1746129580.200260:0:20578:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f118200/0x40a459093b06b6bd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 946176->1048575) gid 0 flags: 0x50080000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2207e expref: 16 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129580.200269:0:20578:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f118200/0x40a459093b06b6bd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 946176->1048575) gid 0 flags: 0x50080000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2207e expref: 16 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129580.200317:0:20578:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f118200/0x40a459093b06b6bd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 946176->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2207e expref: 16 pid: 20577 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129580.200329:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+12:1961:x1830948734390016:12345-192.168.202.4@tcp:101:cat.0 Request processed in 5577us (5871us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129580.200334:0:20578:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800959d4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:20578:1830948737609600:192.168.202.4@tcp:105: 00000100:00100000:2.0:1746129580.200336:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16740 00000100:00100000:1.0:1746129580.200384:0:20578:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130fc9480 going to sleep for 11 seconds 00010000:00010000:3.0:1746129580.201816:0:20577:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a9209600/0x40a459093b06b69a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22054 expref: 11 pid: 20577 timeout: 935 lvb_type: 0 00000100:00100000:3.0:1746129580.202394:0:20577:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20577:1830948737609472:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129580.202422:0:20577:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f118200/0x40a459093b06b6bd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 946176->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2207e expref: 16 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129580.202433:0:20577:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f118200, rc 0) 00000100:00100000:3.0:1746129580.202477:0:20577:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ada2ffba-8920-4ecb-8068-68caa9806978+16:32630:x1830948734390144:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 5887us (7117us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129580.202485:0:20577:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16741 00000100:00100000:1.0:1746129580.204091:0:20578:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800959d4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:20578:1830948737609600:192.168.202.4@tcp:105: 00010000:00010000:1.0:1746129580.204114:0:20578:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129580.204166:0:20578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baefb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+10:1963:x1830948734390272:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 3988us (4141us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129580.204176:0:20578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8662 00000100:00100000:0.0:1746129580.206145:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129580.206186:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129580.206240:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129580.206374:0:20577:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734390400 00000100:00100000:2.0:1746129580.206383:0:20577:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734390400 00000100:00100000:2.0:1746129580.206426:0:20577:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734390528 00000100:00100000:2.0:1746129580.206428:0:20577:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734390528 00000100:00100000:2.0:1746129580.206444:0:20577:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16742 00000100:00100000:2.0:1746129580.206451:0:20577:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+11:1961:x1830948734390400:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129580.206470:0:20577:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129580.206486:0:20577:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a65fe600/0x40a459093b06b6c4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f22085 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129580.206744:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16743 00000100:00100000:3.0:1746129580.206751:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c29e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+12:1961:x1830948734390528:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129580.206758:0:7148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129580.206766:0:7148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f119600/0x40a459093b06b6cb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2208c expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129580.206810:0:7148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7148:1830948737609728:192.168.202.4@tcp:106: 00000100:00100000:2.0:1746129580.207449:0:20577:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c07aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20577:1830948737609856:192.168.202.4@tcp:106: 00000100:00100000:3.0:1746129580.208506:0:7148:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5c683c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746129580.208668:0:21725:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734390784 00000100:00100000:2.0:1746129580.208675:0:21725:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734390784 00002000:00100000:2.0:1746129580.208712:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ec:0x0] (946176->950271) req@ffff88012baec380 x1830948734390784/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:321/0 lens 488/0 e 0 to 0 dl 1746129591 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129580.208722:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012baec380 with x1830948734390784 ext(946176->950271) 00000100:00100000:0.0:1746129580.208845:0:20577:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094a84b40 going to sleep for 11 seconds 00002000:00010000:2.0:1746129580.208874:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012baec380 00000100:00100000:2.0:1746129580.208893:0:21725:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8138 00000100:00100000:2.0:1746129580.208900:0:21725:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ada2ffba-8920-4ecb-8068-68caa9806978+16:1962:x1830948734390784:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:2.0:1746129580.209061:0:21725:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ada2ffba-8920-4ecb-8068-68caa9806978+16:1962:x1830948734390784:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 160us (2923us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129580.209067:0:21725:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8138 00002000:00100000:2.0:1746129580.209072:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ec:0x0] (946176->950271) req@ffff88012baec380 x1830948734390784/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:321/0 lens 488/4536 e 0 to 0 dl 1746129591 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129580.209079:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012baec380 with x1830948734390784 ext(946176->950271) 00002000:00010000:2.0:1746129580.209082:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012baec380 00000100:00100000:0.0:1746129580.209393:0:20577:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c07aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20577:1830948737609856:192.168.202.4@tcp:106: 00010000:00010000:0.0:1746129580.209427:0:20577:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a65fe600/0x40a459093b06b6c4 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22085 expref: 13 pid: 20577 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129580.209439:0:20577:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a65fe600/0x40a459093b06b6c4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22085 expref: 13 pid: 20577 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129580.209453:0:20577:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a65fe600, rc 0) 00000100:00100000:0.0:1746129580.209490:0:20577:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+12:1961:x1830948734390400:12345-192.168.202.4@tcp:101:cat.0 Request processed in 3039us (3302us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129580.209498:0:20577:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16742 00000100:00100000:2.0:1746129580.209888:0:7148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7148:1830948737609728:192.168.202.4@tcp:106: 00010000:00010000:2.0:1746129580.209903:0:7148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f119600/0x40a459093b06b6cb lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2208c expref: 11 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129580.209912:0:7148:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f119600/0x40a459093b06b6cb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2208c expref: 11 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129580.209924:0:7148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f119600, rc 0) 00000100:00100000:2.0:1746129580.209943:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c29e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+10:1961:x1830948734390528:12345-192.168.202.4@tcp:101:cat.0 Request processed in 3193us (3712us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129580.209949:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16743 00000100:00100000:0.0:1746129580.214398:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129580.214512:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734390912 00000100:00100000:2.0:1746129580.214522:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734390912 00000100:00100000:2.0:1746129580.214574:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16744 00000100:00100000:2.0:1746129580.214582:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ada2ffba-8920-4ecb-8068-68caa9806978+25:32630:x1830948734390912:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:2.0:1746129580.214601:0:7148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129580.214620:0:7148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a65fe400/0x40a459093b06b6d2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f22093 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129580.214651:0:7148:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a9209c00/0x40a459093b06b65b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2202a expref: 26 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129580.214658:0:7148:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a9209a00/0x40a459093b06b685 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22046 expref: 17 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129580.214806:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129580.214809:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129580.214813:0:7148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a65fe400/0x40a459093b06b6d2 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [1048576->1904639] (req 1048576->1904639) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22093 expref: 26 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129580.214843:0:7148:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a9209a00/0x40a459093b06b685 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22046 expref: 17 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129580.214854:0:7148:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a9209a00/0x40a459093b06b685 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22046 expref: 17 pid: 22480 timeout: 935 lvb_type: 1 00000100:00100000:2.0:1746129580.214869:0:7148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c079880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:7148:1830948737609984:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129580.215980:0:7148:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a9209c00/0x40a459093b06b65b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2202a expref: 26 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129580.215989:0:7148:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a9209c00/0x40a459093b06b65b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2202a expref: 26 pid: 20577 timeout: 935 lvb_type: 0 00000100:00100000:2.0:1746129580.216375:0:7148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c078a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:7148:1830948737610112:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129580.216435:0:7148:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094a849c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129580.220131:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129580.220203:0:20578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734391040 00000100:00100000:1.0:1746129580.220212:0:20578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734391040 00000100:00100000:2.0:1746129580.220265:0:7148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c079880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:7148:1830948737609984:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129580.220276:0:7148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c078a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:7148:1830948737610112:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129580.220504:0:20578:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a9209a00/0x40a459093b06b685 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22046 expref: 18 pid: 22480 timeout: 935 lvb_type: 1 00000100:00100000:1.0:1746129580.220543:0:20578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8663 00000100:00100000:1.0:1746129580.220551:0:20578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baedc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+18:1961:x1830948734391040:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129580.220569:0:20578:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129580.220575:0:7148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a65fe400/0x40a459093b06b6d2 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [1048576->1904639] (req 1048576->1904639) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22093 expref: 26 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129580.220592:0:20578:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a9209a00/0x40a459093b06b685 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22046 expref: 18 pid: 22480 timeout: 935 lvb_type: 1 00010000:00010000:2.0:1746129580.220594:0:7148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a65fe400, rc 0) 00010000:00010000:1.0:1746129580.220603:0:20578:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a9209a00/0x40a459093b06b685 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22046 expref: 18 pid: 22480 timeout: 935 lvb_type: 1 00010000:00010000:1.0:1746129580.220625:0:20578:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a9209a00/0x40a459093b06b685 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22046 expref: 18 pid: 22480 timeout: 935 lvb_type: 1 00000100:00100000:2.0:1746129580.220643:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ada2ffba-8920-4ecb-8068-68caa9806978+26:32630:x1830948734390912:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 6061us (6258us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129580.220650:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16744 00010000:00010000:1.0:1746129580.220659:0:20578:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129580.220678:0:20578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baedc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+17:1961:x1830948734391040:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 128us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129580.221512:0:20578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8663 00000100:00100000:0.0:1746129580.221917:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129580.222242:0:20578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734391168 00000100:00100000:1.0:1746129580.222249:0:20578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734391168 00010000:00010000:1.0:1746129580.222274:0:20578:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a9209c00/0x40a459093b06b65b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2202a expref: 26 pid: 20577 timeout: 935 lvb_type: 0 00000100:00100000:1.0:1746129580.222318:0:20578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8664 00000100:00100000:1.0:1746129580.222325:0:20578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6ce2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ada2ffba-8920-4ecb-8068-68caa9806978+26:1962:x1830948734391168:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129580.222340:0:20578:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129580.222360:0:20578:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a9209c00/0x40a459093b06b65b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2202a expref: 26 pid: 20577 timeout: 935 lvb_type: 0 00010000:00010000:1.0:1746129580.222371:0:20578:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a9209c00/0x40a459093b06b65b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2202a expref: 26 pid: 20577 timeout: 935 lvb_type: 0 00010000:00010000:1.0:1746129580.222391:0:20578:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a9209c00/0x40a459093b06b65b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2202a expref: 26 pid: 20577 timeout: 935 lvb_type: 0 00010000:00010000:1.0:1746129580.222404:0:20578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129580.222406:0:20578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129580.222413:0:20578:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a65fe400/0x40a459093b06b6d2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1904639) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22093 expref: 25 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129580.222426:0:20578:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a65fe400/0x40a459093b06b6d2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1904639) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22093 expref: 25 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129580.222460:0:20578:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a65fe400/0x40a459093b06b6d2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1904639) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22093 expref: 25 pid: 7148 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129580.222472:0:20578:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800959d4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:20578:1830948737610240:192.168.202.4@tcp:105: 00000100:00100000:1.0:1746129580.222549:0:20578:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130fc9480 going to sleep for 11 seconds 00000100:00100000:1.0:1746129580.223695:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129580.223728:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129580.223768:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129580.223848:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734391296 00000100:00100000:2.0:1746129580.223854:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734391296 00000100:00100000:2.0:1746129580.223884:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734391424 00000100:00100000:2.0:1746129580.223886:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734391424 00000100:00100000:2.0:1746129580.223897:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734391552 00000100:00100000:2.0:1746129580.223898:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734391552 00000100:00100000:2.0:1746129580.223910:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16745 00000100:00100000:2.0:1746129580.223915:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ada2ffba-8920-4ecb-8068-68caa9806978+27:1962:x1830948734391296:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129580.223931:0:7148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129580.223944:0:7148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a65fe000/0x40a459093b06b6d9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2209a expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129580.223985:0:7148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c078a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:7148:1830948737610368:192.168.202.4@tcp:106: 00000100:00100000:2.0:1746129580.224036:0:7148:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094a849c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746129580.224246:0:22480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16746 00000100:00100000:3.0:1746129580.224254:0:22480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ada2ffba-8920-4ecb-8068-68caa9806978+16:1962:x1830948734391424:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129580.224262:0:22480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129580.224272:0:22480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f118e00/0x40a459093b06b6e0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f220a1 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129580.224322:0:22480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22480:1830948737610496:192.168.202.4@tcp:106: 00000100:00100000:3.0:1746129580.224362:0:22480:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5c68e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746129580.224378:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16747 00000100:00100000:3.0:1746129580.224384:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ada2ffba-8920-4ecb-8068-68caa9806978+28:1962:x1830948734391552:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129580.224390:0:4385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129580.224396:0:4385:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f118800/0x40a459093b06b6e7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f220a8 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129580.224914:0:4385:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:4385:1830948737610624:192.168.202.4@tcp:106: 00000100:00100000:3.0:1746129580.224946:0:4385:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5c68f00 going to sleep for 11 seconds 00000100:00100000:1.0:1746129580.225989:0:20578:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800959d4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:20578:1830948737610240:192.168.202.4@tcp:105: 00010000:00010000:1.0:1746129580.226008:0:20578:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129580.226036:0:20578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6ce2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ada2ffba-8920-4ecb-8068-68caa9806978+29:1962:x1830948734391168:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 3711us (4120us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129580.226046:0:20578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8664 00000100:00100000:2.0:1746129580.227193:0:7148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c078a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:7148:1830948737610368:192.168.202.4@tcp:106: 00010000:00010000:2.0:1746129580.227222:0:7148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a65fe000/0x40a459093b06b6d9 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2209a expref: 28 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129580.227249:0:7148:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a65fe000/0x40a459093b06b6d9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2209a expref: 28 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129580.227266:0:7148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a65fe000, rc 0) 00000100:00100000:2.0:1746129580.227337:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ada2ffba-8920-4ecb-8068-68caa9806978+27:1962:x1830948734391296:12345-192.168.202.4@tcp:101:cat.0 Request processed in 3420us (3646us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129580.227345:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16745 00000100:00100000:3.0:1746129580.227563:0:22480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22480:1830948737610496:192.168.202.4@tcp:106: 00010000:00010000:3.0:1746129580.227582:0:22480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f118e00/0x40a459093b06b6e0 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f220a1 expref: 17 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129580.227590:0:22480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f118e00/0x40a459093b06b6e0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f220a1 expref: 17 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129580.227599:0:22480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f118e00, rc 0) 00000100:00100000:3.0:1746129580.227616:0:22480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ada2ffba-8920-4ecb-8068-68caa9806978+16:1962:x1830948734391424:12345-192.168.202.4@tcp:101:cat.0 Request processed in 3365us (3888us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129580.227621:0:22480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16746 00002000:00010000:3.0:1746129580.227645:0:4385:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3f5:0x0] updating lvb atime: 1746129579 -> 1746129580 00000100:00100000:3.0:1746129580.227654:0:4385:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:4385:1830948737610624:192.168.202.4@tcp:106: 00010000:00010000:3.0:1746129580.227665:0:4385:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f118800/0x40a459093b06b6e7 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f220a8 expref: 26 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129580.227672:0:4385:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f118800/0x40a459093b06b6e7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f220a8 expref: 26 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129580.227678:0:4385:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f118800, rc 0) 00000100:00100000:3.0:1746129580.227689:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ada2ffba-8920-4ecb-8068-68caa9806978+25:1962:x1830948734391552:12345-192.168.202.4@tcp:101:cat.0 Request processed in 3306us (3921us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129580.227693:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16747 00000100:00100000:0.0:1746129580.230976:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129580.231042:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734391808 00000100:00100000:2.0:1746129580.231050:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734391808 00002000:00100000:2.0:1746129580.231093:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ec:0x0] (0->946175) req@ffff88012baedf80 x1830948734391808/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:321/0 lens 488/0 e 0 to 0 dl 1746129591 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129580.231102:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012baedf80 with x1830948734391808 ext(0->946175) 00002000:00010000:2.0:1746129580.231108:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012baedf80 00000100:00100000:2.0:1746129580.231127:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8139 00000100:00100000:2.0:1746129580.231133:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+16:1961:x1830948734391808:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129580.234445:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129580.235273:0:21725:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734392064 00000100:00100000:0.0:1746129580.235282:0:21725:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734392064 00002000:00100000:0.0:1746129580.235352:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f3:0x0] (1900544->1904639) req@ffff88012baed880 x1830948734392064/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:321/0 lens 488/0 e 0 to 0 dl 1746129591 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129580.235361:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012baed880 with x1830948734392064 ext(1900544->1904639) 00002000:00010000:0.0:1746129580.235367:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012baed880 00000100:00100000:0.0:1746129580.235405:0:21725:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8140 00000100:00100000:0.0:1746129580.235413:0:21725:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ada2ffba-8920-4ecb-8068-68caa9806978+25:1962:x1830948734392064:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129580.235589:0:21725:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ada2ffba-8920-4ecb-8068-68caa9806978+25:1962:x1830948734392064:12345-192.168.202.4@tcp:3:cat.0 Request processed in 176us (1154us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746129580.235595:0:21725:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8140 00002000:00100000:0.0:1746129580.235600:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f3:0x0] (1900544->1904639) req@ffff88012baed880 x1830948734392064/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:321/0 lens 488/4536 e 0 to 0 dl 1746129591 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129580.235608:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012baed880 with x1830948734392064 ext(1900544->1904639) 00002000:00010000:0.0:1746129580.235611:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012baed880 00000100:00100000:2.0:1746129580.248919:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+16:1961:x1830948734391808:12345-192.168.202.4@tcp:3:cat.0 Request processed in 17773us (17940us total) trans 0 rc 946176/946176 00000100:00100000:2.0:1746129580.249148:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8139 00002000:00100000:2.0:1746129580.249164:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ec:0x0] (0->946175) req@ffff88012baedf80 x1830948734391808/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:321/0 lens 488/440 e 0 to 0 dl 1746129591 ref 1 fl Complete:/200/0 rc 946176/946176 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129580.249174:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012baedf80 with x1830948734391808 ext(0->946175) 00002000:00010000:2.0:1746129580.249181:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012baedf80 00000100:00100000:0.0:1746129580.256482:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129580.256592:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734392320 00000100:00100000:2.0:1746129580.256603:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734392320 00002000:00100000:2.0:1746129580.256650:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f3:0x0] (1904640->2097151) req@ffff88012baef100 x1830948734392320/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:321/0 lens 488/0 e 0 to 0 dl 1746129591 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129580.256661:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012baef100 with x1830948734392320 ext(1904640->2097151) 00002000:00010000:2.0:1746129580.256667:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012baef100 00000100:00100000:2.0:1746129580.256697:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8141 00000100:00100000:2.0:1746129580.256705:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+25:1960:x1830948734392320:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:3.0:1746129580.261612:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+25:1960:x1830948734392320:12345-192.168.202.4@tcp:3:cat.0 Request processed in 4894us (5128us total) trans 0 rc 192512/192512 00000100:00100000:3.0:1746129580.261625:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8141 00002000:00100000:3.0:1746129580.261638:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f3:0x0] (1904640->2097151) req@ffff88012baef100 x1830948734392320/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:321/0 lens 488/440 e 0 to 0 dl 1746129591 ref 1 fl Complete:/200/0 rc 192512/192512 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129580.261649:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012baef100 with x1830948734392320 ext(1904640->2097151) 00002000:00010000:3.0:1746129580.261655:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012baef100 00000100:00100000:0.0:1746129580.265917:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129580.268859:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129580.268998:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734392448 00000100:00100000:3.0:1746129580.269008:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734392448 00000100:00100000:3.0:1746129580.269057:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734392576 00000100:00100000:3.0:1746129580.269060:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734392576 00000100:00100000:3.0:1746129580.269088:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16748 00000100:00100000:3.0:1746129580.269098:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ada2ffba-8920-4ecb-8068-68caa9806978+16:1963:x1830948734392448:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129580.269119:0:4385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129580.269139:0:4385:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f118600/0x40a459093b06b6ee lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f220af expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129580.269143:0:22480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16749 00000100:00100000:2.0:1746129580.269152:0:22480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ada2ffba-8920-4ecb-8068-68caa9806978+25:1962:x1830948734392576:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129580.269162:0:22480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129580.269173:0:22480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a65fe600/0x40a459093b06b6f5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f220b6 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129580.269202:0:4385:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:4385:1830948737610752:192.168.202.4@tcp:106: 00000100:00100000:2.0:1746129580.269202:0:22480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c078a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22480:1830948737610880:192.168.202.4@tcp:106: 00000100:00100000:3.0:1746129580.269815:0:4385:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5c68f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746129580.269869:0:22480:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094a849c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746129580.273121:0:22480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c078a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22480:1830948737610880:192.168.202.4@tcp:106: 00010000:00010000:2.0:1746129580.273167:0:22480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a65fe600/0x40a459093b06b6f5 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f220b6 expref: 26 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129580.273184:0:22480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a65fe600/0x40a459093b06b6f5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f220b6 expref: 26 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129580.273202:0:22480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a65fe600, rc 0) 00000100:00100000:3.0:1746129580.273921:0:4385:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:4385:1830948737610752:192.168.202.4@tcp:106: 00010000:00010000:3.0:1746129580.273941:0:4385:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f118600/0x40a459093b06b6ee lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f220af expref: 17 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129580.273950:0:4385:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f118600/0x40a459093b06b6ee lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f220af expref: 17 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129580.273963:0:4385:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f118600, rc 0) 00000100:00100000:2.0:1746129580.274724:0:22480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ada2ffba-8920-4ecb-8068-68caa9806978+25:1962:x1830948734392576:12345-192.168.202.4@tcp:101:cat.0 Request processed in 5570us (5874us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129580.274736:0:22480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16749 00000100:00100000:3.0:1746129580.274794:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ada2ffba-8920-4ecb-8068-68caa9806978+16:1963:x1830948734392448:12345-192.168.202.4@tcp:101:cat.0 Request processed in 5698us (8887us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129580.274799:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16748 00000100:00100000:0.0:1746129580.280716:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129580.280782:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734392704 00000100:00100000:3.0:1746129580.280791:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734392704 00000100:00100000:3.0:1746129580.280841:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16750 00000100:00100000:3.0:1746129580.280849:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ada2ffba-8920-4ecb-8068-68caa9806978+25:32634:x1830948734392704:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129580.280869:0:4385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129580.280887:0:4385:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f118800/0x40a459093b06b6fc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f220bd expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129580.280917:0:4385:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009faa3c00/0x40a459093b06b693 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4005888->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2205b expref: 16 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129580.280929:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129580.280931:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129580.280934:0:4385:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f118800/0x40a459093b06b6fc lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f220bd expref: 26 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129580.280966:0:4385:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009faa3c00/0x40a459093b06b693 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4005888->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2205b expref: 16 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129580.280978:0:4385:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009faa3c00/0x40a459093b06b693 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4005888->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2205b expref: 16 pid: 4385 timeout: 935 lvb_type: 0 00000100:00100000:3.0:1746129580.280990:0:4385:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:4385:1830948737611008:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129580.281078:0:4385:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5c68f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746129580.281363:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129580.281509:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734392832 00000100:00100000:3.0:1746129580.281513:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734392832 00000100:00100000:3.0:1746129580.281721:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11340 00000100:00100000:3.0:1746129580.281726:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:068dab75-d300-4ead-a742-d14572ad1e50+14:32637:x1830948734392832:12345-192.168.202.4@tcp:101:mirror_io.0 00010000:00010000:3.0:1746129580.281741:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129580.281753:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f119000/0x40a459093b06b703 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f220c4 expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129580.281809:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f118c00/0x40a459093b06b70a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129580.281820:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f118c00/0x40a459093b06b70a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129580.281834:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f118c00/0x40a459093b06b70a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129580.281851:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f119600/0x40a459093b06b711 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129580.281856:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f119600/0x40a459093b06b711 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129580.281861:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f119600/0x40a459093b06b711 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129580.282119:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c664200/0x40a459093b06b718 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129580.282129:0:14549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fba5000/0x40a459093b06b615 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21feb expref: 297 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129580.282135:0:14549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800946f1200/0x40a459093b06b670 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22038 expref: 17 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129580.282140:0:14549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c664200/0x40a459093b06b718 lrc: 5/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129580.282159:0:14549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800946f1200/0x40a459093b06b670 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22038 expref: 17 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129580.282167:0:14549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800946f1200/0x40a459093b06b670 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22038 expref: 17 pid: 14549 timeout: 935 lvb_type: 0 00000100:00100000:3.0:1746129580.282174:0:14549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bd180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830948737611136:192.168.202.4@tcp:104: 00000100:00080000:0.0:1746129580.283082:0:7097:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1746129580.283568:0:14549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008fba5000/0x40a459093b06b615 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21feb expref: 297 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129580.283580:0:14549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fba5000/0x40a459093b06b615 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21feb expref: 297 pid: 2271 timeout: 935 lvb_type: 0 00000100:00100000:3.0:1746129580.283591:0:14549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830948737611264:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129580.283716:0:4385:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:4385:1830948737611008:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129580.283741:0:4385:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f118800/0x40a459093b06b6fc lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f220bd expref: 26 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129580.283755:0:4385:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f118800, rc 0) 00000100:00100000:2.0:1746129580.283776:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ada2ffba-8920-4ecb-8068-68caa9806978+26:32634:x1830948734392704:12345-192.168.202.4@tcp:101:cat.0 Request processed in 2928us (3071us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129580.283784:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16750 00000100:00100000:3.0:1746129580.284192:0:14549:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5c68e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746129580.284715:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129580.284869:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129580.284922:0:14549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bd180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830948737611136:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129580.284978:0:20861:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734393216 00000100:00100000:3.0:1746129580.284984:0:20861:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734393216 00000100:00100000:3.0:1746129580.285033:0:20861:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4834 00000100:00100000:3.0:1746129580.285040:0:20861:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e389c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+18:7701:x1830948734393216:12345-192.168.202.4@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1746129580.285253:0:20861:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e389c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+19:7701:x1830948734393216:12345-192.168.202.4@tcp:35:ldlm_bl.0 Request processed in 213us (384us total) trans 8589945461 rc 0/0 00000100:00100000:3.0:1746129580.285259:0:20861:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4834 00000100:00100000:3.0:1746129580.285276:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734392960 00000100:00100000:3.0:1746129580.285279:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734392960 00002000:00100000:3.0:1746129580.285321:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f5:0x0] (4005888->4194303) req@ffff88012baec700 x1830948734392960/t0(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:321/0 lens 488/0 e 0 to 0 dl 1746129591 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129580.285330:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012baec700 with x1830948734392960 ext(4005888->4194303) 00010000:00010000:3.0:1746129580.285337:0:25745:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009faa3c00/0x40a459093b06b693 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4005888->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2205b expref: 17 pid: 4385 timeout: 935 lvb_type: 0 00010000:00010000:3.0:1746129580.285348:0:25745:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009faa3c00/0x40a459093b06b693 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4005888->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2205b expref: 17 pid: 4385 timeout: 935 lvb_type: 0 00002000:00010000:3.0:1746129580.285359:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012baec700 00000100:00100000:3.0:1746129580.285373:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2511 00000100:00100000:3.0:1746129580.285379:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+17:1963:x1830948734392960:12345-192.168.202.4@tcp:4:cat.0 00000100:00100000:2.0:1746129580.286526:0:14549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830948737611264:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129580.286550:0:14549:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009c664200/0x40a459093b06b718 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000100:00100000:0.0:1746129580.286754:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129580.287018:0:14551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734393472 00000100:00100000:1.0:1746129580.287023:0:14551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734393472 00000100:00100000:1.0:1746129580.287066:0:14551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4835 00000100:00100000:1.0:1746129580.287072:0:14551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e38ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ada2ffba-8920-4ecb-8068-68caa9806978+298:27694:x1830948734393472:12345-192.168.202.4@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746129580.287265:0:14551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e38ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ada2ffba-8920-4ecb-8068-68caa9806978+299:27694:x1830948734393472:12345-192.168.202.4@tcp:35:ldlm_bl.0 Request processed in 193us (512us total) trans 8589945462 rc 0/0 00000100:00100000:1.0:1746129580.287271:0:14551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4835 00000100:00100000:0.0:1746129580.290203:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129580.291174:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+19:1963:x1830948734392960:12345-192.168.202.4@tcp:4:cat.0 Request processed in 5792us (6457us total) trans 17179874178 rc 0/0 00000100:00100000:3.0:1746129580.291185:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2511 00002000:00100000:3.0:1746129580.291196:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f5:0x0] (4005888->4194303) req@ffff88012baec700 x1830948734392960/t17179874178(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:321/0 lens 488/448 e 0 to 0 dl 1746129591 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129580.291204:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012baec700 with x1830948734392960 ext(4005888->4194303) 00010000:00010000:3.0:1746129580.291216:0:25745:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009faa3c00/0x40a459093b06b693 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4005888->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2205b expref: 19 pid: 4385 timeout: 935 lvb_type: 0 00010000:00010000:3.0:1746129580.291238:0:25745:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009faa3c00/0x40a459093b06b693 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4005888->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2205b expref: 19 pid: 4385 timeout: 935 lvb_type: 0 00002000:00010000:3.0:1746129580.291247:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012baec700 00000100:00100000:0.0:1746129580.291845:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129580.291932:0:20578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734393600 00000100:00100000:1.0:1746129580.291940:0:20578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734393600 00010000:00010000:1.0:1746129580.291968:0:20578:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800946f1200/0x40a459093b06b670 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22038 expref: 19 pid: 14549 timeout: 935 lvb_type: 0 00000100:00100000:1.0:1746129580.291999:0:20578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734393728 00000100:00100000:1.0:1746129580.292002:0:20578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734393728 00010000:00010000:1.0:1746129580.292011:0:20578:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fba5000/0x40a459093b06b615 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21feb expref: 299 pid: 2271 timeout: 935 lvb_type: 0 00000100:00100000:1.0:1746129580.292024:0:20578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8665 00000100:00100000:1.0:1746129580.292030:0:20578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e388700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+19:1962:x1830948734393600:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129580.292042:0:20578:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129580.292047:0:20578:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800946f1200/0x40a459093b06b670 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22038 expref: 19 pid: 14549 timeout: 935 lvb_type: 0 00010000:00010000:1.0:1746129580.292056:0:20578:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800946f1200/0x40a459093b06b670 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22038 expref: 19 pid: 14549 timeout: 935 lvb_type: 0 00010000:00010000:1.0:1746129580.292075:0:20578:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800946f1200/0x40a459093b06b670 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22038 expref: 19 pid: 14549 timeout: 935 lvb_type: 0 00010000:00010000:1.0:1746129580.292090:0:20578:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:1.0:1746129580.292095:0:20578:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c664200/0x40a459093b06b718 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129580.292102:0:20578:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c664200/0x40a459093b06b718 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000100:00100000:2.0:1746129580.292108:0:7086:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8666 00010000:00010000:1.0:1746129580.292113:0:20578:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c664200/0x40a459093b06b718 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000100:00100000:2.0:1746129580.292117:0:7086:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e38b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ada2ffba-8920-4ecb-8068-68caa9806978+299:1962:x1830948734393728:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129580.292122:0:20578:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746129580.292126:0:7086:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129580.292131:0:7086:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008fba5000/0x40a459093b06b615 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21feb expref: 299 pid: 2271 timeout: 935 lvb_type: 0 00010000:00010000:2.0:1746129580.292140:0:7086:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008fba5000/0x40a459093b06b615 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21feb expref: 299 pid: 2271 timeout: 935 lvb_type: 0 00000100:00100000:1.0:1746129580.292150:0:20578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e388700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+18:1962:x1830948734393600:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 119us (1956us total) trans 0 rc 0/0 00010000:00010000:2.0:1746129580.292153:0:7086:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fba5000/0x40a459093b06b615 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21feb expref: 299 pid: 2271 timeout: 935 lvb_type: 0 00000100:00100000:1.0:1746129580.292156:0:20578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8665 00010000:00010000:2.0:1746129580.292172:0:7086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:2.0:1746129580.292176:0:7086:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c664200/0x40a459093b06b718 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129580.292184:0:7086:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c664200/0x40a459093b06b718 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129580.292190:0:7086:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c664200/0x40a459093b06b718 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129580.292208:0:7086:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129580.292225:0:7086:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e38b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ada2ffba-8920-4ecb-8068-68caa9806978+298:1962:x1830948734393728:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 110us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129580.292242:0:7086:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8666 00010000:00010000:2.0:1746129580.292281:0:14549:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009c664200/0x40a459093b06b718 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129580.292288:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c664200/0x40a459093b06b718 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00200000:2.0:1746129580.292345:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00000004:00200000:2.0:1746129580.292348:0:14549:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746129580.292364:0:14549:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009c664200/0x40a459093b06b718 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129580.292373:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c664200/0x40a459093b06b718 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129580.292381:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f118c00/0x40a459093b06b70a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129580.292526:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f118c00/0x40a459093b06b70a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129580.292534:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f118c00/0x40a459093b06b70a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129580.292540:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f118c00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746129580.292544:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f118c00/0x40a459093b06b70a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129580.292550:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f118c00/0x40a459093b06b70a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129580.292558:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880132ef8f00) 00010000:00010000:2.0:1746129580.292561:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129580.292564:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f118c00/0x40a459093b06b70a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129580.292569:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f118c00/0x40a459093b06b70a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129580.292578:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f119600/0x40a459093b06b711 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129580.292583:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f119600/0x40a459093b06b711 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129580.292588:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f119600/0x40a459093b06b711 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129580.292591:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f119600 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746129580.292593:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f119600/0x40a459093b06b711 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129580.292597:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f119600/0x40a459093b06b711 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129580.292605:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800938dd600) 00010000:00010000:2.0:1746129580.292607:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129580.292609:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f119600/0x40a459093b06b711 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129580.292612:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f119600/0x40a459093b06b711 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129580.292639:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f119000/0x40a459093b06b703 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f220c4 expref: 16 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129580.292649:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c664200/0x40a459093b06b718 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f220c4 expref: 15 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129580.292654:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:2.0:1746129580.292656:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746129580.292657:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c664200, rc 0) 00000100:00100000:2.0:1746129580.292973:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:068dab75-d300-4ead-a742-d14572ad1e50+15:32637:x1830948734392832:12345-192.168.202.4@tcp:101:mirror_io.0 Request processed in 11245us (11608us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129580.292980:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11340 00000100:00100000:0.0:1746129580.297942:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129580.297988:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129580.298034:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734393984 00000100:00100000:2.0:1746129580.298044:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734393984 00000100:00100000:3.0:1746129580.298060:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734393856 00000100:00100000:3.0:1746129580.298063:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734393856 00000100:00100000:2.0:1746129580.298091:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16751 00010000:00010000:3.0:1746129580.298092:0:7087:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009faa3c00/0x40a459093b06b693 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4005888->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2205b expref: 19 pid: 4385 timeout: 935 lvb_type: 0 00000100:00100000:2.0:1746129580.298098:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e389880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:068dab75-d300-4ead-a742-d14572ad1e50+6:1962:x1830948734393984:12345-192.168.202.4@tcp:101:mirror_io.0 00010000:00010000:2.0:1746129580.298115:0:4385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746129580.298121:0:7087:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8667 00000100:00100000:3.0:1746129580.298125:0:7087:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e389f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+19:1963:x1830948734393856:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129580.298136:0:4385:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a65ffe00/0x40a459093b06b71f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f220cb expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129580.298138:0:7087:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129580.298162:0:7087:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009faa3c00/0x40a459093b06b693 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4005888->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2205b expref: 19 pid: 4385 timeout: 935 lvb_type: 0 00010000:00010000:3.0:1746129580.298173:0:7087:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009faa3c00/0x40a459093b06b693 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4005888->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2205b expref: 19 pid: 4385 timeout: 935 lvb_type: 0 00000100:00100000:2.0:1746129580.298191:0:4385:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c078a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:4385:1830948737611392:192.168.202.4@tcp:106: 00010000:00010000:3.0:1746129580.298192:0:7087:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009faa3c00/0x40a459093b06b693 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4005888->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2205b expref: 19 pid: 4385 timeout: 935 lvb_type: 0 00010000:00010000:3.0:1746129580.298212:0:7087:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129580.298214:0:7087:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129580.298221:0:7087:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f118800/0x40a459093b06b6fc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f220bd expref: 25 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129580.298228:0:7087:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f118800/0x40a459093b06b6fc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f220bd expref: 25 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129580.298264:0:7087:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f118800/0x40a459093b06b6fc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f220bd expref: 25 pid: 4385 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129580.298272:0:7087:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bf480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7087:1830948737611520:192.168.202.4@tcp:105: 00000100:00100000:2.0:1746129580.298317:0:4385:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094a849c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746129580.298321:0:7087:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5c68a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746129580.307664:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129580.307834:0:22480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734394112 00000100:00100000:2.0:1746129580.307845:0:22480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734394112 00000100:00100000:0.0:1746129580.307910:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129580.307937:0:22480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734394368 00000100:00100000:2.0:1746129580.307940:0:22480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734394368 00000100:00100000:0.0:1746129580.307953:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16752 00000100:00100000:0.0:1746129580.307962:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e38aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:068dab75-d300-4ead-a742-d14572ad1e50+5:1962:x1830948734394112:12345-192.168.202.4@tcp:101:mirror_io.0 00010000:00010000:0.0:1746129580.307984:0:7148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129580.308004:0:7148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c460800/0x40a459093b06b726 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f220d2 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129580.308017:0:22480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16753 00000100:00100000:2.0:1746129580.308023:0:22480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e389500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:068dab75-d300-4ead-a742-d14572ad1e50+8:1962:x1830948734394368:12345-192.168.202.4@tcp:101:mirror_io.0 00010000:00010000:2.0:1746129580.308031:0:22480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129580.308041:0:22480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a65ff400/0x40a459093b06b72d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f220e0 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129580.308064:0:22480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c079880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22480:1830948737611776:192.168.202.4@tcp:106: 00000100:00100000:0.0:1746129580.308064:0:7148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e38bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:7148:1830948737611648:192.168.202.4@tcp:106: 00000100:00100000:0.0:1746129580.308249:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129580.308260:0:22480:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094a846c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129580.308261:0:7148:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa381000 going to sleep for 11 seconds 00000100:00100000:1.0:1746129580.308310:0:11014:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734394240 00000100:00100000:1.0:1746129580.308314:0:11014:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734394240 00000100:00100000:0.0:1746129580.308327:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129580.308341:0:11014:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734394496 00000100:00100000:1.0:1746129580.308343:0:11014:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734394496 00000100:00100000:0.0:1746129580.308358:0:20577:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16754 00000100:00100000:1.0:1746129580.308363:0:11014:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16755 00000100:00100000:0.0:1746129580.308363:0:20577:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e388e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:068dab75-d300-4ead-a742-d14572ad1e50+8:1962:x1830948734394240:12345-192.168.202.4@tcp:101:mirror_io.0 00000100:00100000:1.0:1746129580.308367:0:11014:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e389180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:068dab75-d300-4ead-a742-d14572ad1e50+8:1962:x1830948734394496:12345-192.168.202.4@tcp:101:mirror_io.0 00010000:00010000:0.0:1746129580.308369:0:20577:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129580.308372:0:11014:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129580.308377:0:20577:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c460200/0x40a459093b06b734 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f220d9 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129580.308378:0:11014:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090a19a00/0x40a459093b06b73b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f220e7 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129580.308388:0:11014:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129580.308388:0:20577:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129580.308390:0:11014:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129580.308390:0:20577:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129580.308398:0:11014:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090a19a00/0x40a459093b06b73b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f220e7 expref: 10 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129580.308398:0:20577:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c460200/0x40a459093b06b734 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f220d9 expref: 10 pid: 20577 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129580.308413:0:11014:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090a19a00/0x40a459093b06b73b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f220e7 expref: 10 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129580.308413:0:20577:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c460200/0x40a459093b06b734 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f220d9 expref: 10 pid: 20577 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129580.308422:0:11014:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090a19a00, rc 0) 00010000:00010000:0.0:1746129580.308422:0:20577:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c460200, rc 0) 00000100:00100000:0.0:1746129580.308442:0:20577:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e388e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:068dab75-d300-4ead-a742-d14572ad1e50+10:1962:x1830948734394240:12345-192.168.202.4@tcp:101:mirror_io.0 Request processed in 79us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129580.308447:0:20577:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16754 00000100:00100000:1.0:1746129580.308521:0:11014:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e389180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:068dab75-d300-4ead-a742-d14572ad1e50+9:1962:x1830948734394496:12345-192.168.202.4@tcp:101:mirror_io.0 Request processed in 153us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129580.308527:0:11014:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16755 00000100:00100000:2.0:1746129580.308622:0:4385:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c078a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:4385:1830948737611392:192.168.202.4@tcp:106: 00010000:00010000:2.0:1746129580.308649:0:4385:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a65ffe00/0x40a459093b06b71f lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f220cb expref: 9 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129580.308658:0:4385:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a65ffe00/0x40a459093b06b71f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f220cb expref: 9 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129580.308680:0:4385:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a65ffe00, rc 0) 00000100:00100000:1.0:1746129580.308687:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129580.308699:0:7087:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bf480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7087:1830948737611520:192.168.202.4@tcp:105: 00010000:00010000:3.0:1746129580.308713:0:7087:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129580.308751:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e389880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:068dab75-d300-4ead-a742-d14572ad1e50+8:1962:x1830948734393984:12345-192.168.202.4@tcp:101:mirror_io.0 Request processed in 10653us (10760us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129580.308757:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16751 00000100:00100000:3.0:1746129580.308828:0:7087:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e389f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+18:1963:x1830948734393856:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 10700us (10893us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129580.308838:0:7087:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8667 00000100:00100000:3.0:1746129580.308863:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734394752 00000100:00100000:3.0:1746129580.308866:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734394752 00002000:00100000:3.0:1746129580.308890:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f5:0x0] (2097152->3145727) req@ffff8800959d6300 x1830948734394752/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:321/0 lens 488/0 e 0 to 0 dl 1746129591 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129580.308899:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800959d6300 with x1830948734394752 ext(2097152->3145727) 00002000:00010000:3.0:1746129580.308903:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800959d6300 00000100:00100000:3.0:1746129580.308915:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8142 00000100:00100000:3.0:1746129580.308919:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+26:1962:x1830948734394752:12345-192.168.202.4@tcp:3:cat.0 00002000:00010000:1.0:1746129580.310011:0:7148:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb atime: 1746129580 -> 1746129581 00000100:00100000:1.0:1746129580.310026:0:7148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e38bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:7148:1830948737611648:192.168.202.4@tcp:106: 00010000:00010000:1.0:1746129580.310044:0:7148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c460800/0x40a459093b06b726 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f220d2 expref: 8 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129580.310053:0:7148:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c460800/0x40a459093b06b726 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f220d2 expref: 8 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129580.310063:0:7148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c460800, rc 0) 00000100:00100000:1.0:1746129580.310088:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e38aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:068dab75-d300-4ead-a742-d14572ad1e50+7:1962:x1830948734394112:12345-192.168.202.4@tcp:101:mirror_io.0 Request processed in 2129us (2435us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129580.310093:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16752 00000100:00100000:2.0:1746129580.310214:0:22480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c079880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22480:1830948737611776:192.168.202.4@tcp:106: 00010000:00010000:2.0:1746129580.310227:0:22480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a65ff400/0x40a459093b06b72d lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f220e0 expref: 7 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129580.310246:0:22480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a65ff400/0x40a459093b06b72d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f220e0 expref: 7 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129580.310253:0:22480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a65ff400, rc 0) 00000100:00100000:2.0:1746129580.310272:0:22480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e389500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:068dab75-d300-4ead-a742-d14572ad1e50+6:1962:x1830948734394368:12345-192.168.202.4@tcp:101:mirror_io.0 Request processed in 2250us (2363us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129580.310277:0:22480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16753 00000100:00100000:1.0:1746129580.314684:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129580.316190:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734395008 00000100:00100000:2.0:1746129580.316206:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734395008 00000100:00100000:2.0:1746129580.316274:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11341 00000100:00100000:2.0:1746129580.316285:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:068dab75-d300-4ead-a742-d14572ad1e50+15:32637:x1830948734395008:12345-192.168.202.4@tcp:101:mirror_io.0 00010000:00010000:2.0:1746129580.316330:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129580.316353:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a65fe200/0x40a459093b06b742 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f220ee expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129580.316467:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a65fe800/0x40a459093b06b749 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129580.316484:0:14549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c664200/0x40a459093b06b718 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f220c4 expref: 16 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129580.316491:0:14549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a65fe800/0x40a459093b06b749 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129580.316530:0:14549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009c664200/0x40a459093b06b718 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f220c4 expref: 16 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129580.316542:0:14549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c664200/0x40a459093b06b718 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f220c4 expref: 16 pid: 14549 timeout: 935 lvb_type: 0 00000100:00100000:2.0:1746129580.316554:0:14549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c079880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830948737611904:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129580.316654:0:14549:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094a849c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746129580.318622:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129580.318649:0:16908:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734395264 00000100:00100000:0.0:1746129580.318659:0:16908:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734395264 00000100:00100000:0.0:1746129580.318714:0:16908:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11342 00000100:00100000:0.0:1746129580.318723:0:16908:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+18:32639:x1830948734395264:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:0.0:1746129580.318746:0:16908:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129580.318763:0:16908:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa3400/0x40a459093b06b750 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f220f5 expref: -99 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129580.318858:0:16908:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c460800/0x40a459093b06b757 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129580.318870:0:16908:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c460800/0x40a459093b06b757 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129580.318879:0:16908:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009c460800/0x40a459093b06b757 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00000100:00100000:3.0:1746129580.322351:0:14549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c079880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830948737611904:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129580.322383:0:14549:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a65fe800/0x40a459093b06b749 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000100:00100000:3.0:1746129580.322857:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+26:1962:x1830948734394752:12345-192.168.202.4@tcp:3:cat.0 Request processed in 13934us (14166us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129580.322867:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8142 00002000:00100000:3.0:1746129580.322877:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f5:0x0] (2097152->3145727) req@ffff8800959d6300 x1830948734394752/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:321/0 lens 488/440 e 0 to 0 dl 1746129591 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129580.322886:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800959d6300 with x1830948734394752 ext(2097152->3145727) 00002000:00010000:3.0:1746129580.322892:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800959d6300 00000100:00100000:1.0:1746129580.323318:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129580.325024:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734395392 00000100:00100000:3.0:1746129580.325038:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734395392 00010000:00010000:3.0:1746129580.325082:0:7087:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c664200/0x40a459093b06b718 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f220c4 expref: 17 pid: 14549 timeout: 935 lvb_type: 0 00000100:00100000:3.0:1746129580.325134:0:7087:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8668 00000100:00100000:3.0:1746129580.325142:0:7087:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:068dab75-d300-4ead-a742-d14572ad1e50+17:1960:x1830948734395392:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129580.325158:0:7087:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129580.325163:0:7087:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009c664200/0x40a459093b06b718 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f220c4 expref: 17 pid: 14549 timeout: 935 lvb_type: 0 00010000:00010000:3.0:1746129580.325174:0:7087:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009c664200/0x40a459093b06b718 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f220c4 expref: 17 pid: 14549 timeout: 935 lvb_type: 0 00010000:00010000:3.0:1746129580.325194:0:7087:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c664200/0x40a459093b06b718 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f220c4 expref: 17 pid: 14549 timeout: 935 lvb_type: 0 00010000:00010000:3.0:1746129580.325224:0:7087:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:3.0:1746129580.325237:0:7087:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a65fe800/0x40a459093b06b749 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129580.325248:0:7087:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a65fe800/0x40a459093b06b749 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129580.325255:0:7087:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a65fe800/0x40a459093b06b749 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129580.325262:0:7087:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c460800/0x40a459093b06b757 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129580.325267:0:7087:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c460800/0x40a459093b06b757 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129580.325271:0:7087:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c460800/0x40a459093b06b757 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129580.325323:0:7087:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129580.325376:0:7087:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:068dab75-d300-4ead-a742-d14572ad1e50+16:1960:x1830948734395392:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 235us (2059us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129580.325385:0:7087:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8668 00010000:00010000:3.0:1746129580.325410:0:14549:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a65fe800/0x40a459093b06b749 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129580.325416:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a65fe800/0x40a459093b06b749 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00200000:3.0:1746129580.325434:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:1.0:1746129580.325543:0:16908:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009c460800/0x40a459093b06b757 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129580.325550:0:16908:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c460800/0x40a459093b06b757 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00000004:00200000:1.0:1746129580.325565:0:16908:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:1.0:1746129580.325659:0:16908:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa3400/0x40a459093b06b750 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f220f5 expref: 21 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129580.325687:0:16908:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c460800/0x40a459093b06b757 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f220f5 expref: 20 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129580.325693:0:16908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:1.0:1746129580.325696:0:16908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746129580.325699:0:16908:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c460800, rc 0) 00000100:00100000:1.0:1746129580.325731:0:16908:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:32639:x1830948734395264:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 7010us (7118us total) trans 8589945464 rc 0/0 00000100:00100000:1.0:1746129580.325736:0:16908:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11342 00010000:00010000:3.0:1746129580.325813:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a65fe200/0x40a459093b06b742 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f220ee expref: 17 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129580.325824:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a65fe800/0x40a459093b06b749 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f220ee expref: 16 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129580.325829:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:3.0:1746129580.325831:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746129580.325833:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a65fe800, rc 0) 00000100:00100000:3.0:1746129580.325849:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:068dab75-d300-4ead-a742-d14572ad1e50+16:32637:x1830948734395008:12345-192.168.202.4@tcp:101:mirror_io.0 Request processed in 9567us (11177us total) trans 8589945463 rc 0/0 00000100:00100000:3.0:1746129580.325854:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11341 00000100:00100000:0.0:1746129580.329266:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129580.329377:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129580.329405:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734395776 00000100:00100000:2.0:1746129580.329421:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734395776 00000100:00100000:3.0:1746129580.329440:0:22480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734395520 00000100:00100000:3.0:1746129580.329445:0:22480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734395520 00000100:00100000:3.0:1746129580.329473:0:22480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16756 00000100:00100000:2.0:1746129580.329473:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11343 00000100:00100000:3.0:1746129580.329480:0:22480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e388a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ada2ffba-8920-4ecb-8068-68caa9806978+16:32634:x1830948734395520:12345-192.168.202.4@tcp:101:cat.0 00000100:00100000:2.0:1746129580.329481:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e38b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:068dab75-d300-4ead-a742-d14572ad1e50+16:32637:x1830948734395776:12345-192.168.202.4@tcp:101:mirror_io.0 00010000:00010000:3.0:1746129580.329498:0:22480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129580.329500:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129580.329502:0:14549:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746129580.329515:0:22480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f229a00/0x40a459093b06b76c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f220fc expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129580.329527:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a65fe800/0x40a459093b06b749 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f220ee expref: 16 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129580.329547:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:2.0:1746129580.329551:0:14549:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746129580.329552:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129580.329554:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129580.329561:0:22480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f229a00/0x40a459093b06b76c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f220fc expref: 17 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129580.329567:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a65fe000/0x40a459093b06b773 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f22103 expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129580.329574:0:22480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f229a00/0x40a459093b06b76c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f220fc expref: 17 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129580.329583:0:22480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f229a00, rc 0) 00000100:00100000:3.0:1746129580.329632:0:22480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e388a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ada2ffba-8920-4ecb-8068-68caa9806978+17:32634:x1830948734395520:12345-192.168.202.4@tcp:101:cat.0 Request processed in 152us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129580.329638:0:22480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16756 00010000:00010000:2.0:1746129580.329661:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a65fea00/0x40a459093b06b77a lrc: 3/0,1 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129580.329682:0:14549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c460800/0x40a459093b06b757 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f220f5 expref: 19 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129580.329689:0:14549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a65fea00/0x40a459093b06b77a lrc: 4/0,1 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129580.329727:0:14549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009c460800/0x40a459093b06b757 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f220f5 expref: 19 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129580.329740:0:14549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c460800/0x40a459093b06b757 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f220f5 expref: 19 pid: 16908 timeout: 935 lvb_type: 0 00000100:00100000:2.0:1746129580.329751:0:14549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c078a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830948737612032:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129580.329819:0:14549:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094a84000 going to sleep for 11 seconds 00000100:00100000:2.0:1746129580.331509:0:14549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c078a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830948737612032:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129580.331530:0:14549:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a65fea00/0x40a459093b06b77a lrc: 3/0,1 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000100:00100000:0.0:1746129580.332052:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129580.332100:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734395904 00000100:00100000:2.0:1746129580.332106:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734395904 00010000:00010000:2.0:1746129580.332131:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c460800/0x40a459093b06b757 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f220f5 expref: 20 pid: 16908 timeout: 935 lvb_type: 0 00000100:00100000:2.0:1746129580.332169:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8669 00000100:00100000:2.0:1746129580.332175:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e38a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:1962:x1830948734395904:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129580.332188:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129580.332193:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009c460800/0x40a459093b06b757 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f220f5 expref: 20 pid: 16908 timeout: 935 lvb_type: 0 00010000:00010000:2.0:1746129580.332201:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009c460800/0x40a459093b06b757 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f220f5 expref: 20 pid: 16908 timeout: 935 lvb_type: 0 00010000:00010000:2.0:1746129580.332218:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c460800/0x40a459093b06b757 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f220f5 expref: 20 pid: 16908 timeout: 935 lvb_type: 0 00010000:00010000:2.0:1746129580.332244:0:7085:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:2.0:1746129580.332249:0:7085:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a65fea00/0x40a459093b06b77a lrc: 3/0,1 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129580.332256:0:7085:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a65fea00/0x40a459093b06b77a lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129580.332261:0:7085:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a65fea00/0x40a459093b06b77a lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129580.332286:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746129580.332446:0:14549:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a65fea00/0x40a459093b06b77a lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129580.332452:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a65fea00/0x40a459093b06b77a lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129580.332468:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a65fea00/0x40a459093b06b77a lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129580.332478:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a65fea00/0x40a459093b06b77a lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129580.332483:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a65fea00/0x40a459093b06b77a lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129580.332489:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a65fea00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:0.0:1746129580.332492:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a65fea00/0x40a459093b06b77a lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129580.332498:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a65fea00/0x40a459093b06b77a lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129580.332505:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:0.0:1746129580.332507:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746129580.332509:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a65fea00/0x40a459093b06b77a lrc: 2/0,0 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129580.332513:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a65fea00/0x40a459093b06b77a lrc: 0/0,0 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129580.332559:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a65fe000/0x40a459093b06b773 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x1/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22103 expref: 16 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129580.332566:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a65fe000/0x40a459093b06b773 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x1/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22103 expref: 16 pid: 14549 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129580.333709:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e38a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+19:1962:x1830948734395904:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 1526us (1651us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129580.333718:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8669 00010000:00010000:0.0:1746129580.333791:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a65fe000, rc 0) 00000100:00100000:0.0:1746129580.333819:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e38b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:068dab75-d300-4ead-a742-d14572ad1e50+15:32637:x1830948734395776:12345-192.168.202.4@tcp:101:mirror_io.0 Request processed in 4340us (4442us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129580.333825:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11343 00000100:00100000:0.0:1746129580.334162:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129580.334240:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734396416 00000100:00100000:3.0:1746129580.334247:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734396416 00002000:00100000:3.0:1746129580.334335:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f5:0x0] (3145728->4194303) req@ffff88012e38b480 x1830948734396416/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:321/0 lens 488/0 e 0 to 0 dl 1746129591 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129580.334345:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e38b480 with x1830948734396416 ext(3145728->4194303) 00002000:00010000:3.0:1746129580.334349:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e38b480 00000100:00100000:0.0:1746129580.334360:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129580.334424:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734396288 00000100:00100000:3.0:1746129580.334427:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734396288 00002000:00100000:3.0:1746129580.334442:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->4194303) req@ffff88012e388380 x1830948734396288/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:321/0 lens 488/0 e 0 to 0 dl 1746129591 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129580.334448:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e388380 with x1830948734396288 ext(3145728->4194303) 00002000:00010000:3.0:1746129580.334452:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e388380 00000100:00100000:2.0:1746129580.334454:0:31521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8143 00000100:00100000:2.0:1746129580.334461:0:31521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e38b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ada2ffba-8920-4ecb-8068-68caa9806978+26:1963:x1830948734396416:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:3.0:1746129580.334466:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8144 00000100:00100000:3.0:1746129580.334471:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e388380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+17:1962:x1830948734396288:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129580.340957:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129580.341147:0:20861:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734396672 00000100:00100000:3.0:1746129580.341157:0:20861:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734396672 00000100:00100000:3.0:1746129580.341219:0:20861:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4836 00000100:00100000:3.0:1746129580.341228:0:20861:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e38bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:068dab75-d300-4ead-a742-d14572ad1e50+15:32637:x1830948734396672:12345-192.168.202.4@tcp:35:mirror_io.0 00000100:00100000:3.0:1746129580.341508:0:20861:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e38bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:068dab75-d300-4ead-a742-d14572ad1e50+16:32637:x1830948734396672:12345-192.168.202.4@tcp:35:mirror_io.0 Request processed in 280us (562us total) trans 8589945465 rc 0/0 00000100:00100000:3.0:1746129580.341515:0:20861:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4836 00000100:00100000:2.0:1746129580.345794:0:31521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e38b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ada2ffba-8920-4ecb-8068-68caa9806978+26:1963:x1830948734396416:12345-192.168.202.4@tcp:3:cat.0 Request processed in 11320us (11619us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129580.345807:0:31521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8143 00002000:00100000:2.0:1746129580.345821:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f5:0x0] (3145728->4194303) req@ffff88012e38b480 x1830948734396416/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:321/0 lens 488/440 e 0 to 0 dl 1746129591 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129580.345831:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e38b480 with x1830948734396416 ext(3145728->4194303) 00002000:00010000:2.0:1746129580.345837:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e38b480 00000100:00100000:2.0:1746129580.351324:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e388380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+17:1962:x1830948734396288:12345-192.168.202.4@tcp:3:cat.0 Request processed in 16838us (16950us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129580.351337:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8144 00002000:00100000:2.0:1746129580.351351:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->4194303) req@ffff88012e388380 x1830948734396288/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:321/0 lens 488/440 e 0 to 0 dl 1746129591 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129580.351361:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e388380 with x1830948734396288 ext(3145728->4194303) 00002000:00010000:2.0:1746129580.351367:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e388380 00000100:00100000:0.0:1746129580.360577:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129580.360792:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734396800 00000100:00100000:1.0:1746129580.360803:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734396800 00000100:00100000:1.0:1746129580.360864:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16757 00000100:00100000:1.0:1746129580.360872:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b551880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ada2ffba-8920-4ecb-8068-68caa9806978+17:1961:x1830948734396800:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129580.360893:0:7148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129580.360911:0:7148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090a18e00/0x40a459093b06b781 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2210a expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129580.360967:0:7148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800959d7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7148:1830948737612160:192.168.202.4@tcp:106: 00000100:00100000:1.0:1746129580.364119:0:7148:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130fc9180 going to sleep for 11 seconds 00000100:00100000:0.0:1746129580.367694:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129580.367916:0:7148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800959d7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7148:1830948737612160:192.168.202.4@tcp:106: 00000100:00100000:3.0:1746129580.367925:0:22480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734396928 00000100:00100000:3.0:1746129580.367932:0:22480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734396928 00010000:00010000:1.0:1746129580.367954:0:7148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090a18e00/0x40a459093b06b781 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2210a expref: 18 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129580.367968:0:7148:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090a18e00/0x40a459093b06b781 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2210a expref: 18 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129580.367984:0:7148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090a18e00, rc 0) 00000100:00100000:3.0:1746129580.367987:0:22480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16758 00000100:00100000:3.0:1746129580.367994:0:22480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b550a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+10:32639:x1830948734396928:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:3.0:1746129580.368007:0:22480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129580.368021:0:22480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f228600/0x40a459093b06b788 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f22111 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129580.368050:0:22480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f118200/0x40a459093b06b6bd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 946176->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2207e expref: 17 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129580.368057:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129580.368059:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00000100:00100000:1.0:1746129580.368059:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b551880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ada2ffba-8920-4ecb-8068-68caa9806978+17:1961:x1830948734396800:12345-192.168.202.4@tcp:101:cat.0 Request processed in 7187us (7493us total) trans 0 rc 301/301 00010000:00010000:3.0:1746129580.368063:0:22480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f228600/0x40a459093b06b788 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [1015808->1048575] (req 1015808->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22111 expref: 11 pid: 22480 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129580.368065:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16757 00010000:00010000:3.0:1746129580.368093:0:22480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f118200/0x40a459093b06b6bd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 946176->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2207e expref: 16 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129580.368110:0:22480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f118200/0x40a459093b06b6bd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 946176->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2207e expref: 16 pid: 20577 timeout: 935 lvb_type: 0 00000100:00100000:3.0:1746129580.368121:0:22480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22480:1830948737612288:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129580.368183:0:22480:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5c68a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746129580.370753:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129580.370804:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129580.370905:0:22480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22480:1830948737612288:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129580.370938:0:22480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f228600/0x40a459093b06b788 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [1015808->1048575] (req 1015808->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22111 expref: 11 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129580.370957:0:22480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f228600, rc 0) 00000100:00100000:3.0:1746129580.371001:0:22480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b550a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+11:32639:x1830948734396928:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 3007us (3318us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129580.371010:0:22480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16758 00000100:00100000:3.0:1746129580.371035:0:22480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734397184 00000100:00100000:3.0:1746129580.371040:0:22480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734397184 00000100:00100000:2.0:1746129580.371438:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734397056 00000100:00100000:2.0:1746129580.371442:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734397056 00002000:00100000:2.0:1746129580.371473:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ec:0x0] (946176->1048575) req@ffff88012b550000 x1830948734397056/t0(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:321/0 lens 488/0 e 0 to 0 dl 1746129591 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129580.371482:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b550000 with x1830948734397056 ext(946176->1048575) 00010000:00010000:2.0:1746129580.371493:0:25745:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f118200/0x40a459093b06b6bd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 946176->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2207e expref: 18 pid: 20577 timeout: 935 lvb_type: 0 00010000:00010000:2.0:1746129580.371505:0:25745:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f118200/0x40a459093b06b6bd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 946176->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2207e expref: 18 pid: 20577 timeout: 935 lvb_type: 0 00002000:00010000:2.0:1746129580.371512:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b550000 00000100:00100000:2.0:1746129580.371532:0:31521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2512 00000100:00100000:2.0:1746129580.371539:0:31521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b550000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ada2ffba-8920-4ecb-8068-68caa9806978+18:1962:x1830948734397056:12345-192.168.202.4@tcp:4:cat.0 00000100:00100000:3.0:1746129580.371960:0:22480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16759 00000100:00100000:3.0:1746129580.371967:0:22480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b552300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ada2ffba-8920-4ecb-8068-68caa9806978+19:32634:x1830948734397184:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129580.371975:0:22480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129580.371990:0:22480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f229e00/0x40a459093b06b78f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f22118 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129580.372009:0:22480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009faa3200/0x40a459093b06b6a1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 4194304->4251647) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22062 expref: 10 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129580.372021:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129580.372023:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129580.372025:0:22480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f229e00/0x40a459093b06b78f lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 7 type: EXT [4194304->5148671] (req 4194304->5148671) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22118 expref: 20 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129580.372052:0:22480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009faa3200/0x40a459093b06b6a1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 4194304->4251647) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22062 expref: 10 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129580.372062:0:22480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009faa3200/0x40a459093b06b6a1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 4194304->4251647) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22062 expref: 10 pid: 4385 timeout: 935 lvb_type: 0 00000100:00100000:3.0:1746129580.372073:0:22480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22480:1830948737612416:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129580.372119:0:22480:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5c68a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746129580.375548:0:22480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22480:1830948737612416:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129580.375581:0:22480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f229e00/0x40a459093b06b78f lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 7 type: EXT [4194304->5148671] (req 4194304->5148671) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22118 expref: 21 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129580.375598:0:22480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f229e00, rc 0) 00000100:00100000:3.0:1746129580.375653:0:22480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b552300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ada2ffba-8920-4ecb-8068-68caa9806978+21:32634:x1830948734397184:12345-192.168.202.4@tcp:101:cat.0 Request processed in 3685us (4910us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129580.375663:0:22480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16759 00000100:00100000:3.0:1746129580.376046:0:31521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b550000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ada2ffba-8920-4ecb-8068-68caa9806978+20:1962:x1830948734397056:12345-192.168.202.4@tcp:4:cat.0 Request processed in 4506us (5240us total) trans 21474841417 rc 0/0 00000100:00100000:3.0:1746129580.376055:0:31521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2512 00002000:00100000:3.0:1746129580.376065:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3ec:0x0] (946176->1048575) req@ffff88012b550000 x1830948734397056/t21474841417(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:321/0 lens 488/448 e 0 to 0 dl 1746129591 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129580.376074:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b550000 with x1830948734397056 ext(946176->1048575) 00010000:00010000:3.0:1746129580.376083:0:31521:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f118200/0x40a459093b06b6bd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 946176->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2207e expref: 20 pid: 20577 timeout: 935 lvb_type: 0 00010000:00010000:3.0:1746129580.376094:0:31521:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f118200/0x40a459093b06b6bd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 946176->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2207e expref: 20 pid: 20577 timeout: 935 lvb_type: 0 00002000:00010000:3.0:1746129580.376100:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b550000 00000100:00100000:0.0:1746129580.376439:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129580.376500:0:31521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734397312 00000100:00100000:3.0:1746129580.376507:0:31521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734397312 00002000:00100000:3.0:1746129580.376535:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3ef:0x0] (4194304->4251647) req@ffff88012b551f80 x1830948734397312/t0(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:321/0 lens 488/0 e 0 to 0 dl 1746129591 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129580.376543:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b551f80 with x1830948734397312 ext(4194304->4251647) 00010000:00010000:3.0:1746129580.376547:0:31521:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009faa3200/0x40a459093b06b6a1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 4194304->4251647) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22062 expref: 11 pid: 4385 timeout: 935 lvb_type: 0 00010000:00010000:3.0:1746129580.376554:0:31521:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009faa3200/0x40a459093b06b6a1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 4194304->4251647) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22062 expref: 11 pid: 4385 timeout: 935 lvb_type: 0 00002000:00010000:3.0:1746129580.376560:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b551f80 00000100:00100000:3.0:1746129580.376584:0:31521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2513 00000100:00100000:3.0:1746129580.376589:0:31521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b551f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+11:1960:x1830948734397312:12345-192.168.202.4@tcp:4:multiop.0 00000100:00100000:0.0:1746129580.378267:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129580.378500:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734397568 00000100:00100000:2.0:1746129580.378508:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734397568 00000100:00100000:2.0:1746129580.378559:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11344 00000100:00100000:2.0:1746129580.378566:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b551500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ada2ffba-8920-4ecb-8068-68caa9806978+298:32642:x1830948734397568:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:2.0:1746129580.378588:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129580.378607:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c030200/0x40a459093b06b796 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2211f expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129580.378711:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c031e00/0x40a459093b06b79d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129580.378725:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c031e00/0x40a459093b06b79d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129580.378736:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c031e00/0x40a459093b06b79d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00200000:2.0:1746129580.378746:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:2.0:1746129580.378836:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c030200/0x40a459093b06b796 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2211f expref: 301 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129580.378854:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c031e00/0x40a459093b06b79d lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2211f expref: 300 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129580.378861:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:2.0:1746129580.378863:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746129580.378866:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c031e00, rc 0) 00000100:00100000:2.0:1746129580.378903:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b551500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ada2ffba-8920-4ecb-8068-68caa9806978+300:32642:x1830948734397568:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 337us (644us total) trans 8589945466 rc 0/0 00000100:00100000:2.0:1746129580.378909:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11344 00000100:00100000:3.0:1746129580.379887:0:31521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b551f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+13:1960:x1830948734397312:12345-192.168.202.4@tcp:4:multiop.0 Request processed in 3294us (3445us total) trans 21474841418 rc 0/0 00000100:00100000:3.0:1746129580.379900:0:31521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2513 00002000:00100000:3.0:1746129580.379909:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3ef:0x0] (4194304->4251647) req@ffff88012b551f80 x1830948734397312/t21474841418(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:321/0 lens 488/448 e 0 to 0 dl 1746129591 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129580.379918:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b551f80 with x1830948734397312 ext(4194304->4251647) 00010000:00010000:3.0:1746129580.379926:0:31521:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009faa3200/0x40a459093b06b6a1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 4194304->4251647) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22062 expref: 13 pid: 4385 timeout: 935 lvb_type: 0 00010000:00010000:3.0:1746129580.379936:0:31521:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009faa3200/0x40a459093b06b6a1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 4194304->4251647) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22062 expref: 13 pid: 4385 timeout: 935 lvb_type: 0 00002000:00010000:3.0:1746129580.379942:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b551f80 00000100:00100000:0.0:1746129580.385166:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129580.386194:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734397696 00000100:00100000:2.0:1746129580.386206:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734397696 00010000:00010000:2.0:1746129580.386258:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f118200/0x40a459093b06b6bd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 946176->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2207e expref: 20 pid: 20577 timeout: 935 lvb_type: 0 00000100:00100000:2.0:1746129580.386316:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8670 00000100:00100000:2.0:1746129580.386325:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b552a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ada2ffba-8920-4ecb-8068-68caa9806978+20:1962:x1830948734397696:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129580.386341:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129580.386365:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f118200/0x40a459093b06b6bd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 946176->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2207e expref: 20 pid: 20577 timeout: 935 lvb_type: 0 00010000:00010000:2.0:1746129580.386377:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f118200/0x40a459093b06b6bd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 946176->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2207e expref: 20 pid: 20577 timeout: 935 lvb_type: 0 00010000:00010000:2.0:1746129580.386399:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f118200/0x40a459093b06b6bd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 946176->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2207e expref: 20 pid: 20577 timeout: 935 lvb_type: 0 00010000:00010000:2.0:1746129580.386432:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129580.386434:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129580.386442:0:7085:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f228600/0x40a459093b06b788 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1015808->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22111 expref: 12 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129580.386449:0:7085:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f228600/0x40a459093b06b788 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1015808->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22111 expref: 12 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129580.386482:0:7085:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f228600/0x40a459093b06b788 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1015808->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22111 expref: 12 pid: 22480 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129580.386624:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129580.386638:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734397824 00000100:00100000:3.0:1746129580.386642:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734397824 00010000:00010000:3.0:1746129580.386656:0:7087:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009faa3200/0x40a459093b06b6a1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 4194304->4251647) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22062 expref: 13 pid: 4385 timeout: 935 lvb_type: 0 00000100:00100000:3.0:1746129580.386672:0:7087:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8671 00000100:00100000:3.0:1746129580.386676:0:7087:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6ce2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+13:1961:x1830948734397824:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129580.386682:0:7087:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129580.386691:0:7087:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009faa3200/0x40a459093b06b6a1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 8 type: EXT [4194304->18446744073709551615] (req 4194304->4251647) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22062 expref: 13 pid: 4385 timeout: 935 lvb_type: 0 00010000:00010000:3.0:1746129580.386699:0:7087:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009faa3200/0x40a459093b06b6a1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 8 type: EXT [4194304->18446744073709551615] (req 4194304->4251647) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22062 expref: 13 pid: 4385 timeout: 935 lvb_type: 0 00010000:00010000:3.0:1746129580.386716:0:7087:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009faa3200/0x40a459093b06b6a1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 8 type: EXT [4194304->18446744073709551615] (req 4194304->4251647) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22062 expref: 13 pid: 4385 timeout: 935 lvb_type: 0 00010000:00010000:3.0:1746129580.386728:0:7087:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129580.386730:0:7087:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129580.386733:0:7087:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f229e00/0x40a459093b06b78f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 4194304->5148671) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22118 expref: 19 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129580.386741:0:7087:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f229e00/0x40a459093b06b78f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 4194304->5148671) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22118 expref: 19 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129580.386762:0:7087:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f229e00/0x40a459093b06b78f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 4194304->5148671) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22118 expref: 19 pid: 22480 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129580.386771:0:7087:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bf480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7087:1830948737612672:192.168.202.4@tcp:105: 00000100:00100000:3.0:1746129580.386855:0:7087:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5c68a80 going to sleep for 11 seconds 00000100:00100000:2.0:1746129580.387409:0:7085:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c078a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7085:1830948737612544:192.168.202.4@tcp:105: 00000100:00100000:2.0:1746129580.388085:0:7085:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094a84000 going to sleep for 11 seconds 00000100:00100000:0.0:1746129580.393759:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129580.394248:0:22480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734397952 00000100:00100000:3.0:1746129580.394258:0:22480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734397952 00000100:00100000:3.0:1746129580.394603:0:22480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16760 00000100:00100000:3.0:1746129580.394612:0:22480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b550380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ada2ffba-8920-4ecb-8068-68caa9806978+20:32642:x1830948734397952:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:3.0:1746129580.394631:0:22480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129580.394651:0:22480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095ff0c00/0x40a459093b06b7ab lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f22126 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129580.394680:0:22480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f228600/0x40a459093b06b788 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1015808->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22111 expref: 12 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129580.394693:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129580.394694:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129580.394697:0:22480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095ff0c00/0x40a459093b06b7ab lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [581632->786431] (req 581632->786431) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22126 expref: 21 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129580.394726:0:22480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f228600/0x40a459093b06b788 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1015808->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22111 expref: 12 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129580.394736:0:22480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f228600/0x40a459093b06b788 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1015808->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22111 expref: 12 pid: 22480 timeout: 935 lvb_type: 0 00000100:00100000:3.0:1746129580.394747:0:22480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22480:1830948737612800:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129580.394825:0:22480:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5c683c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746129580.394862:0:7087:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bf480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7087:1830948737612672:192.168.202.4@tcp:105: 00010000:00010000:3.0:1746129580.394880:0:7087:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129580.394905:0:7087:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6ce2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+12:1961:x1830948734397824:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 8228us (8282us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129580.394928:0:7087:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8671 00000100:00100000:2.0:1746129580.395818:0:7085:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c078a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7085:1830948737612544:192.168.202.4@tcp:105: 00000100:00100000:0.0:1746129580.395823:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00010000:00010000:2.0:1746129580.395832:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129580.395853:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129580.395860:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b552a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ada2ffba-8920-4ecb-8068-68caa9806978+21:1962:x1830948734397696:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 9536us (10706us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129580.395867:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8670 00000100:00100000:2.0:1746129580.395922:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734398336 00000100:00100000:2.0:1746129580.395927:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734398336 00002000:00100000:2.0:1746129580.396125:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ec:0x0] (1015808->1019903) req@ffff88012b553b80 x1830948734398336/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:321/0 lens 488/0 e 0 to 0 dl 1746129591 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129580.396135:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b553b80 with x1830948734398336 ext(1015808->1019903) 00010000:00010000:2.0:1746129580.396143:0:25745:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f228600/0x40a459093b06b788 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1015808->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22111 expref: 12 pid: 22480 timeout: 935 lvb_type: 0 00010000:00010000:2.0:1746129580.396154:0:25745:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f228600/0x40a459093b06b788 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1015808->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22111 expref: 12 pid: 22480 timeout: 935 lvb_type: 0 00002000:00010000:2.0:1746129580.396161:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b553b80 00000100:00100000:2.0:1746129580.396179:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734398464 00000100:00100000:2.0:1746129580.396181:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734398464 00000100:00100000:0.0:1746129580.396192:0:31519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2514 00002000:00100000:2.0:1746129580.396193:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ef:0x0] (4194304->5148671) req@ffff88012b553480 x1830948734398464/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:321/0 lens 488/0 e 0 to 0 dl 1746129591 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129580.396199:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b553480 with x1830948734398464 ext(4194304->5148671) 00000100:00100000:0.0:1746129580.396199:0:31519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b553b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+12:1963:x1830948734398336:12345-192.168.202.4@tcp:3:multiop.0 00002000:00010000:2.0:1746129580.396202:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b553480 00000100:00100000:2.0:1746129580.396439:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8145 00000100:00100000:2.0:1746129580.396445:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b553480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+21:1961:x1830948734398464:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:0.0:1746129580.396844:0:31519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b553b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+12:1963:x1830948734398336:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 640us (1016us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746129580.396850:0:31519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2514 00002000:00100000:0.0:1746129580.397212:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3ec:0x0] (1015808->1019903) req@ffff88012b553b80 x1830948734398336/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:321/0 lens 488/4536 e 0 to 0 dl 1746129591 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129580.397223:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b553b80 with x1830948734398336 ext(1015808->1019903) 00010000:00010000:0.0:1746129580.397236:0:31519:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f228600/0x40a459093b06b788 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1015808->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22111 expref: 12 pid: 22480 timeout: 935 lvb_type: 0 00010000:00010000:0.0:1746129580.397246:0:31519:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f228600/0x40a459093b06b788 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1015808->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22111 expref: 12 pid: 22480 timeout: 935 lvb_type: 0 00002000:00010000:0.0:1746129580.397256:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b553b80 00000100:00100000:3.0:1746129580.398851:0:22480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22480:1830948737612800:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129580.398882:0:22480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095ff0c00/0x40a459093b06b7ab lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [581632->786431] (req 581632->786431) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22126 expref: 22 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129580.398900:0:22480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095ff0c00, rc 0) 00000100:00100000:0.0:1746129580.401447:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129580.401489:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129580.401569:0:22480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b550380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ada2ffba-8920-4ecb-8068-68caa9806978+22:32642:x1830948734397952:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 6954us (7819us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129580.401580:0:22480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16760 00000100:00100000:3.0:1746129580.401607:0:22480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734398848 00000100:00100000:3.0:1746129580.401615:0:22480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734398848 00000100:00100000:3.0:1746129580.401647:0:22480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16761 00000100:00100000:3.0:1746129580.401654:0:22480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b551c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+18:32639:x1830948734398848:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:3.0:1746129580.401672:0:22480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129580.401690:0:22480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a6cf6200/0x40a459093b06b7b2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2212d expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129580.401719:0:22480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a65fe400/0x40a459093b06b6d2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1904639) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22093 expref: 25 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129580.401726:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129580.401728:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129580.401731:0:22480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6cf6200/0x40a459093b06b7b2 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->1531903] (req 1048576->1531903) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2212d expref: 19 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129580.401765:0:22480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a65fe400/0x40a459093b06b6d2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1904639) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22093 expref: 25 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129580.401775:0:22480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a65fe400/0x40a459093b06b6d2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1904639) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22093 expref: 25 pid: 7148 timeout: 935 lvb_type: 0 00000100:00100000:3.0:1746129580.401786:0:22480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22480:1830948737612928:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129580.401838:0:31519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734398720 00000100:00100000:1.0:1746129580.401843:0:31519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734398720 00000100:00100000:3.0:1746129580.401846:0:22480:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5c683c0 going to sleep for 11 seconds 00002000:00100000:1.0:1746129580.402009:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3ec:0x0] (1015808->1048575) req@ffff88012b551180 x1830948734398720/t0(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:321/0 lens 488/0 e 0 to 0 dl 1746129591 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129580.402017:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b551180 with x1830948734398720 ext(1015808->1048575) 00010000:00010000:1.0:1746129580.402025:0:31519:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f228600/0x40a459093b06b788 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1015808->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22111 expref: 12 pid: 22480 timeout: 935 lvb_type: 0 00010000:00010000:1.0:1746129580.402035:0:31519:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f228600/0x40a459093b06b788 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1015808->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22111 expref: 12 pid: 22480 timeout: 935 lvb_type: 0 00002000:00010000:1.0:1746129580.402040:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b551180 00000100:00100000:1.0:1746129580.402055:0:31519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2515 00000100:00100000:1.0:1746129580.402060:0:31519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b551180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+12:1961:x1830948734398720:12345-192.168.202.4@tcp:4:multiop.0 00000100:00100000:0.0:1746129580.407840:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129580.407860:0:22480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22480:1830948737612928:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129580.407864:0:21725:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734398976 00000100:00100000:2.0:1746129580.407871:0:21725:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734398976 00010000:00010000:3.0:1746129580.407895:0:22480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a6cf6200/0x40a459093b06b7b2 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->1531903] (req 1048576->1531903) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2212d expref: 19 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129580.407914:0:22480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6cf6200, rc 0) 00000100:00100000:3.0:1746129580.407971:0:22480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b551c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+19:32639:x1830948734398848:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 6317us (6481us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129580.407981:0:22480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16761 00002000:00100000:2.0:1746129580.408138:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->1904639) req@ffff88012b550700 x1830948734398976/t0(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:321/0 lens 488/0 e 0 to 0 dl 1746129591 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129580.408153:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b550700 with x1830948734398976 ext(1048576->1904639) 00010000:00010000:2.0:1746129580.408159:0:21725:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a65fe400/0x40a459093b06b6d2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1904639) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22093 expref: 26 pid: 7148 timeout: 935 lvb_type: 0 00010000:00010000:2.0:1746129580.408169:0:21725:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a65fe400/0x40a459093b06b6d2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1904639) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22093 expref: 26 pid: 7148 timeout: 935 lvb_type: 0 00002000:00010000:2.0:1746129580.408176:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b550700 00000100:00100000:2.0:1746129580.408192:0:21725:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2516 00000100:00100000:2.0:1746129580.408199:0:21725:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b550700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ada2ffba-8920-4ecb-8068-68caa9806978+26:1962:x1830948734398976:12345-192.168.202.4@tcp:4:multiop.0 00000100:00100000:0.0:1746129580.412202:0:31519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b551180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+14:1961:x1830948734398720:12345-192.168.202.4@tcp:4:multiop.0 Request processed in 10126us (10751us total) trans 21474841419 rc 0/0 00000100:00100000:0.0:1746129580.412216:0:31519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2515 00002000:00100000:0.0:1746129580.412243:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3ec:0x0] (1015808->1048575) req@ffff88012b551180 x1830948734398720/t21474841419(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:321/0 lens 488/448 e 0 to 0 dl 1746129591 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129580.412253:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b551180 with x1830948734398720 ext(1015808->1048575) 00010000:00010000:0.0:1746129580.412264:0:31519:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f228600/0x40a459093b06b788 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1015808->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22111 expref: 14 pid: 22480 timeout: 935 lvb_type: 0 00010000:00010000:0.0:1746129580.412277:0:31519:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f228600/0x40a459093b06b788 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1015808->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22111 expref: 14 pid: 22480 timeout: 935 lvb_type: 0 00002000:00010000:0.0:1746129580.412284:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b551180 00000100:00100000:2.0:1746129580.413989:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b553480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+20:1961:x1830948734398464:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 17532us (18123us total) trans 0 rc 954368/954368 00000100:00100000:2.0:1746129580.414002:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8145 00002000:00100000:2.0:1746129580.414013:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ef:0x0] (4194304->5148671) req@ffff88012b553480 x1830948734398464/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:321/0 lens 488/440 e 0 to 0 dl 1746129591 ref 1 fl Complete:/200/0 rc 954368/954368 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129580.414023:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b553480 with x1830948734398464 ext(4194304->5148671) 00002000:00010000:2.0:1746129580.414028:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b553480 00000100:00100000:0.0:1746129580.418753:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129580.418841:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734399104 00000100:00100000:2.0:1746129580.418853:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734399104 00010000:00010000:2.0:1746129580.418895:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f228600/0x40a459093b06b788 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1015808->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22111 expref: 14 pid: 22480 timeout: 935 lvb_type: 0 00000100:00100000:2.0:1746129580.420397:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8672 00000100:00100000:2.0:1746129580.420411:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b552d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+14:1963:x1830948734399104:12345-192.168.202.4@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746129580.420955:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129580.421470:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129580.421526:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734399360 00000100:00100000:3.0:1746129580.421533:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734399360 00000100:00100000:3.0:1746129580.421562:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734399232 00000100:00100000:3.0:1746129580.421564:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734399232 00000100:00100000:3.0:1746129580.421577:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16762 00000100:00100000:3.0:1746129580.421581:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b552680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ada2ffba-8920-4ecb-8068-68caa9806978+28:1962:x1830948734399360:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129580.421599:0:7148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129580.421617:0:7148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a6cf6800/0x40a459093b06b7b9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2213b expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129580.421668:0:7148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:7148:1830948737613056:192.168.202.4@tcp:106: 00000100:00100000:3.0:1746129580.421735:0:7148:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5c683c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746129580.421755:0:22480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16763 00000100:00100000:3.0:1746129580.421760:0:22480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b550e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ada2ffba-8920-4ecb-8068-68caa9806978+20:1962:x1830948734399232:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129580.421767:0:22480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129580.421780:0:22480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a6cf7000/0x40a459093b06b7c0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f22134 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129580.421806:0:22480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22480:1830948737613184:192.168.202.4@tcp:106: 00000100:00100000:3.0:1746129580.421827:0:22480:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5c68a80 going to sleep for 11 seconds 00010000:00010000:2.0:1746129580.422359:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746129580.423795:0:7085:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ec:0x0] updating lvb mtime from disk: 1746129580 -> 1746129581 00002000:00010000:3.0:1746129580.423802:0:7085:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ec:0x0] updating lvb ctime from disk: 1746129580 -> 1746129581 00010000:00010000:3.0:1746129580.423815:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f228600/0x40a459093b06b788 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1015808->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22111 expref: 14 pid: 22480 timeout: 935 lvb_type: 0 00010000:00010000:3.0:1746129580.423833:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f228600/0x40a459093b06b788 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1015808->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22111 expref: 14 pid: 22480 timeout: 935 lvb_type: 0 00010000:00010000:3.0:1746129580.423862:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129580.423864:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129580.423871:0:7085:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880095ff0c00/0x40a459093b06b7ab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 581632->786431) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22126 expref: 21 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129580.423879:0:7085:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095ff0c00/0x40a459093b06b7ab lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 581632->786431) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22126 expref: 21 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129580.423915:0:7085:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880095ff0c00/0x40a459093b06b7ab lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 581632->786431) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22126 expref: 21 pid: 22480 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129580.423926:0:7085:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bd880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7085:1830948737613312:192.168.202.4@tcp:105: 00000100:00100000:3.0:1746129580.424007:0:7085:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5c68780 going to sleep for 11 seconds 00000100:00100000:3.0:1746129580.430545:0:7148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:7148:1830948737613056:192.168.202.4@tcp:106: 00010000:00010000:3.0:1746129580.430589:0:7148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a6cf6800/0x40a459093b06b7b9 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2213b expref: 29 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129580.430608:0:7148:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a6cf6800/0x40a459093b06b7b9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2213b expref: 29 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129580.430625:0:7148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6cf6800, rc 0) 00000100:00100000:3.0:1746129580.430669:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b552680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ada2ffba-8920-4ecb-8068-68caa9806978+28:1962:x1830948734399360:12345-192.168.202.4@tcp:101:cat.0 Request processed in 9085us (9714us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129580.430677:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16762 00010000:00010000:3.0:1746129580.432745:0:22480:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.202.4@tcp) returned -22 from glimpse AST (req@ffff8800947bf480 x1830948737613184) - normal race ns: filter-lustre-OST0000_UUID lock: ffff88009f228600/0x40a459093b06b788 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1015808->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22111 expref: 14 pid: 22480 timeout: 935 lvb_type: 0 00010000:00010000:3.0:1746129580.432781:0:22480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f228600/0x40a459093b06b788 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1015808->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22111 expref: 14 pid: 22480 timeout: 935 lvb_type: 0 00000100:00100000:3.0:1746129580.432793:0:22480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22480:1830948737613184:192.168.202.4@tcp:106: 00010000:00010000:3.0:1746129580.432820:0:22480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a6cf7000/0x40a459093b06b7c0 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22134 expref: 21 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129580.432830:0:22480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a6cf7000/0x40a459093b06b7c0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22134 expref: 21 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129580.432837:0:22480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6cf7000, rc 0) 00000100:00100000:3.0:1746129580.432890:0:22480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b550e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ada2ffba-8920-4ecb-8068-68caa9806978+20:1962:x1830948734399232:12345-192.168.202.4@tcp:101:cat.0 Request processed in 11128us (11418us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129580.432898:0:22480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16763 00000100:00100000:3.0:1746129580.434616:0:7085:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bd880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7085:1830948737613312:192.168.202.4@tcp:105: 00010000:00010000:3.0:1746129580.434632:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129580.437031:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b552d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+13:1963:x1830948734399104:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 16608us (18271us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129580.437047:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8672 00000100:00100000:1.0:1746129580.437328:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129580.437359:0:31519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734399616 00000100:00100000:1.0:1746129580.437369:0:31519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734399616 00002000:00100000:1.0:1746129580.437414:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3ec:0x0] (581632->585727) req@ffff8800959d7100 x1830948734399616/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:321/0 lens 488/0 e 0 to 0 dl 1746129591 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129580.437424:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800959d7100 with x1830948734399616 ext(581632->585727) 00002000:00010000:1.0:1746129580.437430:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800959d7100 00000100:00100000:1.0:1746129580.437450:0:31519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8146 00000100:00100000:1.0:1746129580.437457:0:31519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ada2ffba-8920-4ecb-8068-68caa9806978+20:1962:x1830948734399616:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:1.0:1746129580.437653:0:31519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ada2ffba-8920-4ecb-8068-68caa9806978+20:1962:x1830948734399616:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 196us (325us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746129580.437663:0:31519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8146 00002000:00100000:1.0:1746129580.437667:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3ec:0x0] (581632->585727) req@ffff8800959d7100 x1830948734399616/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:321/0 lens 488/4536 e 0 to 0 dl 1746129591 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129580.437674:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800959d7100 with x1830948734399616 ext(581632->585727) 00002000:00010000:1.0:1746129580.437677:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800959d7100 00000100:00100000:1.0:1746129580.437780:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129580.437851:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129580.438975:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734399744 00000100:00100000:2.0:1746129580.438988:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734399744 00000100:00100000:2.0:1746129580.440792:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734400000 00000100:00100000:2.0:1746129580.440807:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734400000 00000100:00100000:2.0:1746129580.440873:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16764 00000100:00100000:2.0:1746129580.440885:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ada2ffba-8920-4ecb-8068-68caa9806978+28:1963:x1830948734399744:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129580.440909:0:7148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129580.440931:0:7148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c030600/0x40a459093b06b7c7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f22142 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129580.440998:0:7148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c078a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:7148:1830948737613440:192.168.202.4@tcp:106: 00000100:00100000:0.0:1746129580.441177:0:11014:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16765 00000100:00100000:0.0:1746129580.441184:0:11014:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+19:1963:x1830948734400000:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129580.441191:0:11014:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129580.441197:0:11014:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800946f1200/0x40a459093b06b7ce lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f22150 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129580.441220:0:11014:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b552a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11014:1830948737613568:192.168.202.4@tcp:106: 00000100:00100000:1.0:1746129580.441323:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129580.441355:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129580.441381:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129580.441481:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734400256 00000100:00100000:3.0:1746129580.441485:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734400256 00000100:00100000:3.0:1746129580.441503:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734399872 00000100:00100000:3.0:1746129580.441505:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734399872 00000100:00100000:3.0:1746129580.441523:0:8412:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734400128 00000100:00100000:3.0:1746129580.441525:0:8412:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734400128 00000100:00100000:3.0:1746129580.441538:0:8412:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16766 00000100:00100000:3.0:1746129580.441543:0:8412:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093edf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:1963:x1830948734400256:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129580.441549:0:8412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129580.441556:0:8412:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091b63800/0x40a459093b06b7d5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2215e expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129580.441568:0:8412:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129580.441570:0:8412:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129580.441579:0:8412:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091b63800/0x40a459093b06b7d5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2215e expref: 22 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129580.441593:0:8412:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091b63800/0x40a459093b06b7d5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2215e expref: 22 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129580.441602:0:8412:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091b63800, rc 0) 00000100:00100000:3.0:1746129580.441631:0:8412:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093edf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+22:1963:x1830948734400256:12345-192.168.202.4@tcp:101:cat.0 Request processed in 87us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129580.441637:0:8412:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16766 00000100:00100000:3.0:1746129580.441658:0:8412:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16767 00000100:00100000:3.0:1746129580.441662:0:8412:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ede300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+14:1963:x1830948734399872:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129580.441671:0:8412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129580.441680:0:8412:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091b63e00/0x40a459093b06b7dc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f22149 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129580.441703:0:8412:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8412:1830948737613696:192.168.202.4@tcp:106: 00000100:00100000:3.0:1746129580.441734:0:8412:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5c68780 going to sleep for 11 seconds 00000100:00100000:3.0:1746129580.441753:0:8410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16768 00000100:00100000:3.0:1746129580.441757:0:8410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093edfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+15:1963:x1830948734400128:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129580.441762:0:8410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129580.441766:0:8410:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091b62200/0x40a459093b06b7e3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f22157 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129580.441775:0:8410:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129580.441776:0:8410:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129580.441780:0:8410:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091b62200/0x40a459093b06b7e3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22157 expref: 16 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129580.441789:0:8410:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091b62200/0x40a459093b06b7e3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22157 expref: 16 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129580.441794:0:8410:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091b62200, rc 0) 00000100:00100000:3.0:1746129580.441806:0:8410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093edfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+16:1963:x1830948734400128:12345-192.168.202.4@tcp:101:cat.0 Request processed in 49us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129580.441811:0:8410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16768 00000100:00100000:2.0:1746129580.442225:0:7148:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094a849c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129580.442665:0:11014:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa381900 going to sleep for 11 seconds 00002000:00010000:2.0:1746129580.444889:0:8412:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3ec:0x0] updating lvb atime: 1746129580 -> 1746129581 00000100:00100000:2.0:1746129580.444920:0:8412:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8412:1830948737613696:192.168.202.4@tcp:106: 00010000:00010000:2.0:1746129580.444954:0:8412:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091b63e00/0x40a459093b06b7dc lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22149 expref: 15 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129580.444967:0:8412:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091b63e00/0x40a459093b06b7dc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22149 expref: 15 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129580.444995:0:8412:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091b63e00, rc 0) 00000100:00100000:2.0:1746129580.445051:0:8412:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ede300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+14:1963:x1830948734399872:12345-192.168.202.4@tcp:101:cat.0 Request processed in 3386us (3693us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129580.445060:0:8412:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16767 00002000:00010000:2.0:1746129580.445705:0:7148:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb mtime: 1746129580 -> 1746129581 00002000:00010000:2.0:1746129580.445710:0:7148:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb ctime: 1746129580 -> 1746129581 00000100:00100000:2.0:1746129580.445723:0:7148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c078a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:7148:1830948737613440:192.168.202.4@tcp:106: 00010000:00010000:2.0:1746129580.445745:0:7148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c030600/0x40a459093b06b7c7 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22142 expref: 30 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129580.445755:0:7148:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c030600/0x40a459093b06b7c7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22142 expref: 30 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129580.445762:0:7148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c030600, rc 0) 00000100:00100000:2.0:1746129580.447422:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ada2ffba-8920-4ecb-8068-68caa9806978+29:1963:x1830948734399744:12345-192.168.202.4@tcp:101:cat.0 Request processed in 6526us (9628us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129580.447434:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16764 00000100:00100000:3.0:1746129580.447546:0:21725:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b550700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ada2ffba-8920-4ecb-8068-68caa9806978+28:1962:x1830948734398976:12345-192.168.202.4@tcp:4:multiop.0 Request processed in 39347us (39718us total) trans 17179874179 rc 0/0 00000100:00100000:3.0:1746129580.447560:0:21725:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2516 00002000:00100000:3.0:1746129580.447573:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->1904639) req@ffff88012b550700 x1830948734398976/t17179874179(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:321/0 lens 488/448 e 0 to 0 dl 1746129591 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129580.447582:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b550700 with x1830948734398976 ext(1048576->1904639) 00010000:00010000:3.0:1746129580.447593:0:21725:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a65fe400/0x40a459093b06b6d2 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1904639) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22093 expref: 28 pid: 7148 timeout: 935 lvb_type: 0 00010000:00010000:3.0:1746129580.447608:0:21725:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a65fe400/0x40a459093b06b6d2 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1904639) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22093 expref: 28 pid: 7148 timeout: 935 lvb_type: 0 00002000:00010000:3.0:1746129580.447614:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b550700 00000100:00100000:0.0:1746129580.448340:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129580.448497:0:21725:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734400512 00000100:00100000:3.0:1746129580.448505:0:21725:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734400512 00002000:00100000:3.0:1746129580.448543:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ec:0x0] (782336->786431) req@ffff88013575f480 x1830948734400512/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:321/0 lens 488/0 e 0 to 0 dl 1746129591 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129580.448550:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013575f480 with x1830948734400512 ext(782336->786431) 00002000:00010000:3.0:1746129580.448554:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013575f480 00000100:00100000:3.0:1746129580.448570:0:21725:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8147 00000100:00100000:3.0:1746129580.448575:0:21725:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013575f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ada2ffba-8920-4ecb-8068-68caa9806978+20:1962:x1830948734400512:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:3.0:1746129580.448760:0:21725:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013575f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ada2ffba-8920-4ecb-8068-68caa9806978+20:1962:x1830948734400512:12345-192.168.202.4@tcp:3:cat.0 Request processed in 184us (423us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129580.448765:0:21725:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8147 00002000:00100000:3.0:1746129580.448770:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ec:0x0] (782336->786431) req@ffff88013575f480 x1830948734400512/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:321/0 lens 488/4536 e 0 to 0 dl 1746129591 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129580.448782:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013575f480 with x1830948734400512 ext(782336->786431) 00002000:00010000:3.0:1746129580.448785:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013575f480 00000100:00100000:0.0:1746129580.451813:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129580.452615:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734400640 00000100:00100000:3.0:1746129580.452626:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734400640 00010000:00010000:3.0:1746129580.452667:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a65fe400/0x40a459093b06b6d2 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1904639) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22093 expref: 28 pid: 7148 timeout: 935 lvb_type: 0 00000100:00100000:3.0:1746129580.452695:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8673 00000100:00100000:3.0:1746129580.452702:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013575ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ada2ffba-8920-4ecb-8068-68caa9806978+28:1960:x1830948734400640:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129580.452716:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129580.452740:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a65fe400/0x40a459093b06b6d2 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1904639) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22093 expref: 28 pid: 7148 timeout: 935 lvb_type: 0 00010000:00010000:3.0:1746129580.452754:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a65fe400/0x40a459093b06b6d2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1904639) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22093 expref: 28 pid: 7148 timeout: 935 lvb_type: 0 00010000:00010000:3.0:1746129580.452781:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129580.452782:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129580.452790:0:7085:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a6cf6200/0x40a459093b06b7b2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1531903) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2212d expref: 21 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129580.452798:0:7085:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6cf6200/0x40a459093b06b7b2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1531903) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2212d expref: 21 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129580.452833:0:7085:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a6cf6200/0x40a459093b06b7b2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1531903) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2212d expref: 21 pid: 22480 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129580.452850:0:7085:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bf480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7085:1830948737613824:192.168.202.4@tcp:105: 00000100:00100000:3.0:1746129580.452939:0:7085:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5c68a80 going to sleep for 11 seconds 00010000:00010000:1.0:1746129580.453346:0:11014:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a65fe400/0x40a459093b06b6d2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1904639) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22093 expref: 28 pid: 7148 timeout: 935 lvb_type: 0 00000100:00100000:1.0:1746129580.453367:0:11014:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b552a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11014:1830948737613568:192.168.202.4@tcp:106: 00010000:00010000:1.0:1746129580.453392:0:11014:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800946f1200/0x40a459093b06b7ce lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22150 expref: 21 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129580.453402:0:11014:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800946f1200/0x40a459093b06b7ce lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22150 expref: 21 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129580.453408:0:11014:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800946f1200, rc 0) 00000100:00100000:1.0:1746129580.453435:0:11014:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:1963:x1830948734400000:12345-192.168.202.4@tcp:101:cat.0 Request processed in 12251us (15582us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129580.453441:0:11014:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16765 00000100:00100000:3.0:1746129580.457605:0:7085:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bf480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7085:1830948737613824:192.168.202.4@tcp:105: 00010000:00010000:3.0:1746129580.457634:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129580.457699:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013575ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ada2ffba-8920-4ecb-8068-68caa9806978+27:1960:x1830948734400640:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 4995us (5895us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129580.457711:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8673 00000100:00100000:0.0:1746129580.464112:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129580.464175:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129580.464250:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734401024 00000100:00100000:2.0:1746129580.464261:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734401024 00002000:00100000:2.0:1746129580.464336:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f3:0x0] (1527808->1531903) req@ffff88013575f800 x1830948734401024/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:321/0 lens 488/0 e 0 to 0 dl 1746129591 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129580.464347:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013575f800 with x1830948734401024 ext(1527808->1531903) 00002000:00010000:2.0:1746129580.464352:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013575f800 00000100:00100000:1.0:1746129580.465037:0:11014:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734400896 00000100:00100000:1.0:1746129580.465042:0:11014:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734400896 00000100:00100000:1.0:1746129580.465086:0:11014:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16769 00000100:00100000:1.0:1746129580.465094:0:11014:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013575c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+14:32645:x1830948734400896:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129580.465107:0:11014:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129580.465126:0:11014:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c40a400/0x40a459093b06b7ea lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f22165 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129580.465157:0:11014:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095ff0c00/0x40a459093b06b7ab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 581632->786431) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22126 expref: 19 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129580.465165:0:11014:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129580.465167:0:11014:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129580.465170:0:11014:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c40a400/0x40a459093b06b7ea lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22165 expref: 15 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129580.465201:0:11014:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095ff0c00/0x40a459093b06b7ab lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 581632->786431) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22126 expref: 19 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129580.465213:0:11014:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095ff0c00/0x40a459093b06b7ab lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 581632->786431) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22126 expref: 19 pid: 22480 timeout: 935 lvb_type: 0 00000100:00100000:1.0:1746129580.465225:0:11014:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093edd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11014:1830948737613952:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129580.465324:0:11014:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130fc9a80 going to sleep for 11 seconds 00000100:00100000:2.0:1746129580.465387:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8148 00000100:00100000:2.0:1746129580.465393:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013575f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:1963:x1830948734401024:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:2.0:1746129580.465537:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013575f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:1963:x1830948734401024:12345-192.168.202.4@tcp:3:cat.0 Request processed in 143us (1360us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129580.465544:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8148 00002000:00100000:2.0:1746129580.465549:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f3:0x0] (1527808->1531903) req@ffff88013575f800 x1830948734401024/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:321/0 lens 488/4536 e 0 to 0 dl 1746129591 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129580.465563:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013575f800 with x1830948734401024 ext(1527808->1531903) 00002000:00010000:2.0:1746129580.465567:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013575f800 00000100:00100000:1.0:1746129580.468633:0:11014:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093edd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11014:1830948737613952:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129580.468666:0:11014:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c40a400/0x40a459093b06b7ea lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22165 expref: 15 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129580.468691:0:11014:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c40a400, rc 0) 00000100:00100000:1.0:1746129580.469890:0:11014:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013575c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+15:32645:x1830948734400896:12345-192.168.202.4@tcp:101:cat.0 Request processed in 4789us (5782us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129580.469901:0:11014:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16769 00000100:00100000:1.0:1746129580.471165:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129580.471733:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129580.471856:0:21725:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734401152 00000100:00100000:3.0:1746129580.471865:0:21725:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734401152 00002000:00100000:3.0:1746129580.471914:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ec:0x0] (581632->786431) req@ffff880093edd880 x1830948734401152/t0(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:321/0 lens 488/0 e 0 to 0 dl 1746129591 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129580.471923:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093edd880 with x1830948734401152 ext(581632->786431) 00010000:00010000:3.0:1746129580.471932:0:21725:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880095ff0c00/0x40a459093b06b7ab lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 581632->786431) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22126 expref: 20 pid: 22480 timeout: 935 lvb_type: 0 00010000:00010000:3.0:1746129580.471946:0:21725:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880095ff0c00/0x40a459093b06b7ab lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 581632->786431) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22126 expref: 20 pid: 22480 timeout: 935 lvb_type: 0 00002000:00010000:3.0:1746129580.471953:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093edd880 00000100:00100000:2.0:1746129580.472047:0:20861:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734401408 00000100:00100000:2.0:1746129580.472051:0:20861:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734401408 00000100:00100000:2.0:1746129580.472081:0:20861:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4837 00000100:00100000:2.0:1746129580.472089:0:20861:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094cc8450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+19:32639:x1830948734401408:12345-192.168.202.4@tcp:35:multiop.0 00000100:00100000:3.0:1746129580.472699:0:21725:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2517 00000100:00100000:3.0:1746129580.472706:0:21725:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093edd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ada2ffba-8920-4ecb-8068-68caa9806978+20:1963:x1830948734401152:12345-192.168.202.4@tcp:4:cat.0 00000100:00100000:2.0:1746129580.473002:0:20861:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094cc8450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:32639:x1830948734401408:12345-192.168.202.4@tcp:35:multiop.0 Request processed in 913us (1268us total) trans 8589945467 rc 0/0 00000100:00100000:2.0:1746129580.473010:0:20861:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4837 00000100:00100000:3.0:1746129580.477522:0:21725:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093edd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ada2ffba-8920-4ecb-8068-68caa9806978+22:1963:x1830948734401152:12345-192.168.202.4@tcp:4:cat.0 Request processed in 4805us (6350us total) trans 21474841420 rc 0/0 00000100:00100000:3.0:1746129580.477539:0:21725:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2517 00002000:00100000:3.0:1746129580.477550:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ec:0x0] (581632->786431) req@ffff880093edd880 x1830948734401152/t21474841420(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:321/0 lens 488/448 e 0 to 0 dl 1746129591 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129580.477560:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093edd880 with x1830948734401152 ext(581632->786431) 00010000:00010000:3.0:1746129580.477571:0:21725:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880095ff0c00/0x40a459093b06b7ab lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 581632->786431) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22126 expref: 22 pid: 22480 timeout: 935 lvb_type: 0 00010000:00010000:3.0:1746129580.477587:0:21725:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880095ff0c00/0x40a459093b06b7ab lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 581632->786431) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22126 expref: 22 pid: 22480 timeout: 935 lvb_type: 0 00002000:00010000:3.0:1746129580.477595:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093edd880 00000100:00100000:0.0:1746129580.481128:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129580.481242:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734401536 00000100:00100000:3.0:1746129580.481251:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734401536 00010000:00010000:3.0:1746129580.481405:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095ff0c00/0x40a459093b06b7ab lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 581632->786431) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22126 expref: 22 pid: 22480 timeout: 935 lvb_type: 0 00000100:00100000:3.0:1746129580.481521:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8674 00000100:00100000:3.0:1746129580.481530:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013575e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ada2ffba-8920-4ecb-8068-68caa9806978+22:1963:x1830948734401536:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129580.481544:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129580.481568:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095ff0c00/0x40a459093b06b7ab lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 581632->786431) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22126 expref: 22 pid: 22480 timeout: 935 lvb_type: 0 00010000:00010000:3.0:1746129580.481580:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095ff0c00/0x40a459093b06b7ab lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 581632->786431) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22126 expref: 22 pid: 22480 timeout: 935 lvb_type: 0 00010000:00010000:3.0:1746129580.481610:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095ff0c00/0x40a459093b06b7ab lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 581632->786431) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22126 expref: 22 pid: 22480 timeout: 935 lvb_type: 0 00010000:00010000:3.0:1746129580.481637:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129580.481640:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129580.481649:0:7085:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c40a400/0x40a459093b06b7ea lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22165 expref: 14 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129580.481657:0:7085:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c40a400/0x40a459093b06b7ea lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22165 expref: 14 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129580.481694:0:7085:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009c40a400/0x40a459093b06b7ea lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22165 expref: 14 pid: 11014 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129580.481706:0:7085:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bf480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7085:1830948737614080:192.168.202.4@tcp:105: 00000100:00100000:3.0:1746129580.482900:0:7085:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5c68a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746129580.487789:0:7085:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bf480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7085:1830948737614080:192.168.202.4@tcp:105: 00010000:00010000:3.0:1746129580.487819:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129580.492704:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013575e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ada2ffba-8920-4ecb-8068-68caa9806978+21:1963:x1830948734401536:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 11162us (11854us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129580.492719:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8674 00000100:00100000:0.0:1746129580.493131:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129580.493210:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129580.493284:0:21725:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734401920 00000100:00100000:3.0:1746129580.493347:0:21725:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734401920 00002000:00100000:3.0:1746129580.493391:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f3:0x0] (1531904->2097151) req@ffff88013575df80 x1830948734401920/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:321/0 lens 488/0 e 0 to 0 dl 1746129591 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129580.493408:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013575df80 with x1830948734401920 ext(1531904->2097151) 00002000:00010000:3.0:1746129580.493414:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013575df80 00000100:00100000:3.0:1746129580.493680:0:21725:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734402048 00000100:00100000:3.0:1746129580.493684:0:21725:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734402048 00002000:00100000:3.0:1746129580.493701:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ec:0x0] (0->1048575) req@ffff88013575f100 x1830948734402048/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:321/0 lens 488/0 e 0 to 0 dl 1746129591 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129580.493707:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013575f100 with x1830948734402048 ext(0->1048575) 00002000:00010000:3.0:1746129580.493710:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013575f100 00000100:00100000:2.0:1746129580.493752:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8149 00000100:00100000:2.0:1746129580.493762:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013575df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:1963:x1830948734401920:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:3.0:1746129580.494098:0:31521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8150 00000100:00100000:3.0:1746129580.494104:0:31521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013575f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+15:1963:x1830948734402048:12345-192.168.202.4@tcp:3:cat.0 00010000:00010000:2.0:1746129580.500501:0:7088:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1746129580.509328:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013575df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:1963:x1830948734401920:12345-192.168.202.4@tcp:3:cat.0 Request processed in 14394us (15024us total) trans 0 rc 565248/565248 00000100:00100000:2.0:1746129580.510110:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8149 00002000:00100000:2.0:1746129580.510133:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f3:0x0] (1531904->2097151) req@ffff88013575df80 x1830948734401920/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:321/0 lens 488/440 e 0 to 0 dl 1746129591 ref 1 fl Complete:/200/0 rc 565248/565248 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129580.510144:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013575df80 with x1830948734401920 ext(1531904->2097151) 00002000:00010000:2.0:1746129580.510152:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013575df80 00000100:00100000:3.0:1746129580.521550:0:31521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013575f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+15:1963:x1830948734402048:12345-192.168.202.4@tcp:3:cat.0 Request processed in 27432us (28326us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129580.521562:0:31521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8150 00002000:00100000:3.0:1746129580.521575:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3ec:0x0] (0->1048575) req@ffff88013575f100 x1830948734402048/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:321/0 lens 488/440 e 0 to 0 dl 1746129591 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129580.521585:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013575f100 with x1830948734402048 ext(0->1048575) 00002000:00010000:3.0:1746129580.521592:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013575f100 00000100:00100000:0.0:1746129580.552809:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129580.552915:0:31521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734402304 00000100:00100000:3.0:1746129580.552924:0:31521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734402304 00002000:00100000:3.0:1746129580.552975:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f5:0x0] (2097152->3145727) req@ffff88013575ed80 x1830948734402304/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:321/0 lens 488/0 e 0 to 0 dl 1746129591 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129580.552985:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013575ed80 with x1830948734402304 ext(2097152->3145727) 00002000:00010000:3.0:1746129580.552991:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013575ed80 00000100:00100000:3.0:1746129580.553051:0:31521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8151 00000100:00100000:3.0:1746129580.553059:0:31521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013575ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:1963:x1830948734402304:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:2.0:1746129580.558031:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129580.558117:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734402560 00000100:00100000:3.0:1746129580.558127:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734402560 00002000:00100000:3.0:1746129580.558178:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f5:0x0] (3145728->4194303) req@ffff88009c079c00 x1830948734402560/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:321/0 lens 488/0 e 0 to 0 dl 1746129591 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129580.558187:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c079c00 with x1830948734402560 ext(3145728->4194303) 00002000:00010000:3.0:1746129580.558194:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c079c00 00000100:00100000:3.0:1746129580.558218:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8152 00000100:00100000:3.0:1746129580.558225:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c079c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+22:1962:x1830948734402560:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:3.0:1746129580.575257:0:31521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013575ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+22:1963:x1830948734402304:12345-192.168.202.4@tcp:3:cat.0 Request processed in 22183us (22444us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129580.575270:0:31521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8151 00002000:00100000:3.0:1746129580.575284:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f5:0x0] (2097152->3145727) req@ffff88013575ed80 x1830948734402304/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:321/0 lens 488/440 e 0 to 0 dl 1746129591 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129580.575318:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013575ed80 with x1830948734402304 ext(2097152->3145727) 00002000:00010000:3.0:1746129580.575325:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013575ed80 00000100:00100000:3.0:1746129580.576271:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c079c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:1962:x1830948734402560:12345-192.168.202.4@tcp:3:cat.0 Request processed in 18042us (18246us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129580.576279:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8152 00002000:00100000:3.0:1746129580.576285:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f5:0x0] (3145728->4194303) req@ffff88009c079c00 x1830948734402560/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:321/0 lens 488/440 e 0 to 0 dl 1746129591 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129580.576306:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c079c00 with x1830948734402560 ext(3145728->4194303) 00002000:00010000:3.0:1746129580.576310:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c079c00 00000100:00100000:0.0:1746129580.590701:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129580.590830:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734402816 00000100:00100000:3.0:1746129580.590841:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734402816 00002000:00100000:3.0:1746129580.590891:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ef:0x0] (4194304->5148671) req@ffff88013575ea00 x1830948734402816/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:321/0 lens 488/0 e 0 to 0 dl 1746129591 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129580.590901:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013575ea00 with x1830948734402816 ext(4194304->5148671) 00002000:00010000:3.0:1746129580.590907:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013575ea00 00000100:00100000:3.0:1746129580.592155:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8153 00000100:00100000:3.0:1746129580.592167:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013575ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+15:1963:x1830948734402816:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:2.0:1746129580.608465:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129580.608570:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734403072 00000100:00100000:3.0:1746129580.608578:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734403072 00000100:00100000:3.0:1746129580.608629:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11345 00000100:00100000:3.0:1746129580.608636:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c078a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:32651:x1830948734403072:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:3.0:1746129580.608656:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129580.608670:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a60b2400/0x40a459093b06b7f1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2216c expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129580.608745:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a60b3600/0x40a459093b06b7f8 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129580.608758:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a60b3600/0x40a459093b06b7f8 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129580.608767:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a60b3600/0x40a459093b06b7f8 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00200000:3.0:1746129580.608775:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:3.0:1746129580.608865:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a60b2400/0x40a459093b06b7f1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2216c expref: 23 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129580.608886:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a60b3600/0x40a459093b06b7f8 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2216c expref: 22 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129580.608893:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:3.0:1746129580.608895:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746129580.608898:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a60b3600, rc 0) 00000100:00100000:3.0:1746129580.608935:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c078a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+22:32651:x1830948734403072:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 299us (475us total) trans 8589945468 rc 0/0 00000100:00100000:3.0:1746129580.608941:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11345 00000100:00100000:2.0:1746129580.609757:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013575ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+15:1963:x1830948734402816:12345-192.168.202.4@tcp:3:cat.0 Request processed in 17592us (19067us total) trans 0 rc 954368/954368 00000100:00100000:2.0:1746129580.609767:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8153 00002000:00100000:2.0:1746129580.609775:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ef:0x0] (4194304->5148671) req@ffff88013575ea00 x1830948734402816/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:321/0 lens 488/440 e 0 to 0 dl 1746129591 ref 1 fl Complete:/200/0 rc 954368/954368 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129580.609783:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013575ea00 with x1830948734402816 ext(4194304->5148671) 00002000:00010000:2.0:1746129580.609787:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013575ea00 00000100:00100000:0.0:1746129580.682946:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129580.683010:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129580.683120:0:11014:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734403200 00000100:00100000:1.0:1746129580.683130:0:11014:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734403200 00000100:00100000:2.0:1746129580.683162:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734403328 00000100:00100000:2.0:1746129580.683166:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734403328 00000100:00100000:1.0:1746129580.683243:0:11014:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16770 00000100:00100000:2.0:1746129580.683248:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16771 00000100:00100000:1.0:1746129580.683251:0:11014:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013575fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ada2ffba-8920-4ecb-8068-68caa9806978+21:1963:x1830948734403200:12345-192.168.202.4@tcp:101:cat.0 00000100:00100000:2.0:1746129580.683253:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013575c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ada2ffba-8920-4ecb-8068-68caa9806978+27:1962:x1830948734403328:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129580.683271:0:7148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129580.683271:0:11014:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129580.683289:0:7148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091b63200/0x40a459093b06b806 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2217a expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129580.683289:0:11014:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c40b600/0x40a459093b06b80d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f22173 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129580.683342:0:11014:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129580.683343:0:11014:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129580.683351:0:11014:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c40b600/0x40a459093b06b80d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22173 expref: 22 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129580.683365:0:11014:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c40b600/0x40a459093b06b80d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22173 expref: 22 pid: 11014 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746129580.683370:0:7148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c078e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:7148:1830948737614208:192.168.202.4@tcp:106: 00010000:00010000:1.0:1746129580.683375:0:11014:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c40b600, rc 0) 00000100:00100000:1.0:1746129580.683614:0:11014:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013575fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ada2ffba-8920-4ecb-8068-68caa9806978+22:1963:x1830948734403200:12345-192.168.202.4@tcp:101:cat.0 Request processed in 363us (679us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129580.683620:0:11014:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16770 00000100:00100000:2.0:1746129580.683936:0:7148:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094a84b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746129580.685257:0:7148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c078e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:7148:1830948737614208:192.168.202.4@tcp:106: 00010000:00010000:2.0:1746129580.685287:0:7148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091b63200/0x40a459093b06b806 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2217a expref: 28 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129580.685556:0:7148:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091b63200/0x40a459093b06b806 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2217a expref: 28 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129580.685578:0:7148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091b63200, rc 0) 00000100:00100000:2.0:1746129580.686021:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013575c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ada2ffba-8920-4ecb-8068-68caa9806978+27:1962:x1830948734403328:12345-192.168.202.4@tcp:101:cat.0 Request processed in 2764us (3007us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129580.686031:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16771 00000100:00100000:0.0:1746129580.693988:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129580.694075:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734403584 00000100:00100000:2.0:1746129580.694089:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734403584 00002000:00100000:2.0:1746129580.694146:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ec:0x0] (0->1048575) req@ffff88013575d880 x1830948734403584/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:321/0 lens 488/0 e 0 to 0 dl 1746129591 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129580.694155:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013575d880 with x1830948734403584 ext(0->1048575) 00002000:00010000:2.0:1746129580.694161:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013575d880 00000100:00100000:2.0:1746129580.694209:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8154 00000100:00100000:2.0:1746129580.694219:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013575d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+22:1961:x1830948734403584:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:2.0:1746129580.704867:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013575d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+22:1961:x1830948734403584:12345-192.168.202.4@tcp:3:cat.0 Request processed in 10642us (10885us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129580.704878:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8154 00002000:00100000:2.0:1746129580.704888:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ec:0x0] (0->1048575) req@ffff88013575d880 x1830948734403584/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:321/0 lens 488/440 e 0 to 0 dl 1746129591 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129580.704897:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013575d880 with x1830948734403584 ext(0->1048575) 00002000:00010000:2.0:1746129580.704902:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013575d880 00000100:00100000:0.0:1746129580.710486:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129580.710547:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129580.710636:0:11014:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734403712 00000100:00100000:2.0:1746129580.710637:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734403840 00000100:00100000:2.0:1746129580.710645:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734403840 00000100:00100000:1.0:1746129580.710645:0:11014:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734403712 00000100:00100000:1.0:1746129580.710744:0:11014:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16772 00000100:00100000:2.0:1746129580.710812:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16773 00000100:00100000:1.0:1746129580.710815:0:11014:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013575c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ada2ffba-8920-4ecb-8068-68caa9806978+27:32657:x1830948734403712:12345-192.168.202.4@tcp:101:cat.0 00000100:00100000:2.0:1746129580.710819:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013575ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ada2ffba-8920-4ecb-8068-68caa9806978+22:32656:x1830948734403840:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:2.0:1746129580.710834:0:7148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129580.710834:0:11014:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129580.710851:0:7148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091b63600/0x40a459093b06b814 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f22188 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129580.710852:0:11014:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090a19800/0x40a459093b06b81b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f22181 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129580.710880:0:7148:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c40a400/0x40a459093b06b7ea lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22165 expref: 14 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129580.710880:0:11014:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a6cf6200/0x40a459093b06b7b2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1531903) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2212d expref: 19 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129580.710887:0:7148:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c40b600/0x40a459093b06b80d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22173 expref: 23 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129580.710887:0:11014:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129580.710889:0:11014:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129580.710893:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129580.710893:0:11014:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090a19800/0x40a459093b06b81b lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22181 expref: 28 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129580.710894:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129580.710897:0:7148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091b63600/0x40a459093b06b814 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [86016->495615] (req 86016->495615) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22188 expref: 23 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129580.710923:0:7148:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c40b600/0x40a459093b06b80d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22173 expref: 23 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129580.710923:0:11014:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a6cf6200/0x40a459093b06b7b2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1531903) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2212d expref: 19 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129580.710934:0:7148:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c40b600/0x40a459093b06b80d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22173 expref: 23 pid: 11014 timeout: 936 lvb_type: 1 00010000:00010000:1.0:1746129580.710934:0:11014:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a6cf6200/0x40a459093b06b7b2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1531903) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2212d expref: 19 pid: 22480 timeout: 936 lvb_type: 0 00000100:00100000:2.0:1746129580.710945:0:7148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c078e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7148:1830948737614464:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129580.710946:0:11014:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ede680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11014:1830948737614336:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129580.711183:0:7148:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c40a400/0x40a459093b06b7ea lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22165 expref: 14 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129580.711191:0:7148:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c40a400/0x40a459093b06b7ea lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22165 expref: 14 pid: 11014 timeout: 936 lvb_type: 0 00000100:00100000:2.0:1746129580.711199:0:7148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c079880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7148:1830948737614592:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129580.711594:0:11014:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130fc9e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746129580.711685:0:7148:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094a84b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746129580.715611:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129580.715639:0:7148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c078e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7148:1830948737614464:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129580.715648:0:7148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c079880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7148:1830948737614592:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129580.715678:0:7148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091b63600/0x40a459093b06b814 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [86016->495615] (req 86016->495615) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22188 expref: 23 pid: 7148 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129580.715687:0:11014:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ede680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11014:1830948737614336:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129580.715693:0:7148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091b63600, rc 0) 00010000:00010000:1.0:1746129580.715704:0:11014:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090a19800/0x40a459093b06b81b lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22181 expref: 28 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129580.715721:0:11014:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090a19800, rc 0) 00000100:00100000:2.0:1746129580.715735:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013575ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ada2ffba-8920-4ecb-8068-68caa9806978+23:32656:x1830948734403840:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 4918us (5188us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129580.715740:0:11014:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013575c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ada2ffba-8920-4ecb-8068-68caa9806978+28:32657:x1830948734403712:12345-192.168.202.4@tcp:101:cat.0 Request processed in 4928us (5264us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129580.715743:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16773 00000100:00100000:1.0:1746129580.715747:0:11014:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16772 00000100:00100000:3.0:1746129580.715855:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734403968 00000100:00100000:3.0:1746129580.715862:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734403968 00002000:00100000:3.0:1746129580.715898:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->1531903) req@ffff88013575d500 x1830948734403968/t0(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:321/0 lens 488/0 e 0 to 0 dl 1746129591 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129580.715907:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013575d500 with x1830948734403968 ext(1048576->1531903) 00010000:00010000:3.0:1746129580.715914:0:25745:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a6cf6200/0x40a459093b06b7b2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1531903) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2212d expref: 20 pid: 22480 timeout: 936 lvb_type: 0 00010000:00010000:3.0:1746129580.715923:0:25745:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a6cf6200/0x40a459093b06b7b2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1531903) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2212d expref: 20 pid: 22480 timeout: 936 lvb_type: 0 00002000:00010000:3.0:1746129580.715929:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88013575d500 00000100:00100000:3.0:1746129580.715946:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2518 00000100:00100000:3.0:1746129580.715952:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013575d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:1962:x1830948734403968:12345-192.168.202.4@tcp:4:cat.0 00000100:00100000:0.0:1746129580.716505:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129580.716545:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129580.716613:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734404224 00000100:00100000:2.0:1746129580.716616:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734404224 00010000:00010000:2.0:1746129580.716633:0:7087:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c40a400/0x40a459093b06b7ea lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22165 expref: 15 pid: 11014 timeout: 936 lvb_type: 0 00000100:00100000:2.0:1746129580.716650:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734404096 00000100:00100000:2.0:1746129580.716652:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734404096 00010000:00010000:2.0:1746129580.716660:0:7087:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c40b600/0x40a459093b06b80d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22173 expref: 23 pid: 11014 timeout: 936 lvb_type: 1 00000100:00100000:2.0:1746129580.716912:0:7087:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8675 00000100:00100000:2.0:1746129580.716919:0:7087:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013575d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+15:1960:x1830948734404224:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129580.716928:0:7087:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129580.716948:0:7087:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c40a400/0x40a459093b06b7ea lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22165 expref: 15 pid: 11014 timeout: 936 lvb_type: 0 00010000:00010000:2.0:1746129580.716963:0:7087:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c40a400/0x40a459093b06b7ea lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22165 expref: 15 pid: 11014 timeout: 936 lvb_type: 0 00010000:00010000:2.0:1746129580.716985:0:7087:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c40a400/0x40a459093b06b7ea lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22165 expref: 15 pid: 11014 timeout: 936 lvb_type: 0 00010000:00010000:2.0:1746129580.717003:0:7087:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129580.717024:0:7087:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013575d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+14:1960:x1830948734404224:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 106us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129580.717030:0:7087:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8675 00000100:00100000:2.0:1746129580.717040:0:7087:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8676 00000100:00100000:2.0:1746129580.717045:0:7087:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800903a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ada2ffba-8920-4ecb-8068-68caa9806978+23:1960:x1830948734404096:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129580.717052:0:7087:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129580.717058:0:7087:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c40b600/0x40a459093b06b80d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22173 expref: 23 pid: 11014 timeout: 936 lvb_type: 1 00010000:00010000:2.0:1746129580.717067:0:7087:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c40b600/0x40a459093b06b80d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22173 expref: 23 pid: 11014 timeout: 936 lvb_type: 1 00010000:00010000:2.0:1746129580.717078:0:7087:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c40b600/0x40a459093b06b80d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22173 expref: 23 pid: 11014 timeout: 936 lvb_type: 1 00010000:00010000:2.0:1746129580.717086:0:7087:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129580.717088:0:7087:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129580.717095:0:7087:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091b63600/0x40a459093b06b814 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 86016->495615) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22188 expref: 22 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129580.717109:0:7087:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091b63600/0x40a459093b06b814 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 86016->495615) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22188 expref: 22 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129580.717136:0:7087:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091b63600/0x40a459093b06b814 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 86016->495615) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22188 expref: 22 pid: 7148 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129580.717147:0:7087:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c079880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7087:1830948737614720:192.168.202.4@tcp:105: 00000100:00100000:2.0:1746129580.717193:0:7087:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094a84b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746129580.721820:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129580.721960:0:7087:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c079880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7087:1830948737614720:192.168.202.4@tcp:105: 00010000:00010000:2.0:1746129580.721978:0:7087:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129580.722024:0:7087:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800903a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ada2ffba-8920-4ecb-8068-68caa9806978+22:1960:x1830948734404096:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 4977us (5477us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129580.722034:0:7087:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8676 00000100:00100000:1.0:1746129580.722861:0:31521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734404480 00000100:00100000:1.0:1746129580.722868:0:31521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734404480 00002000:00100000:1.0:1746129580.722906:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3ec:0x0] (86016->90111) req@ffff8800903a2d80 x1830948734404480/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:321/0 lens 488/0 e 0 to 0 dl 1746129591 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129580.722916:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800903a2d80 with x1830948734404480 ext(86016->90111) 00002000:00010000:1.0:1746129580.722921:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800903a2d80 00000100:00100000:1.0:1746129580.723408:0:31521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8155 00000100:00100000:1.0:1746129580.723416:0:31521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800903a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ada2ffba-8920-4ecb-8068-68caa9806978+22:1963:x1830948734404480:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:1.0:1746129580.723539:0:31521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800903a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ada2ffba-8920-4ecb-8068-68caa9806978+22:1963:x1830948734404480:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 124us (1731us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746129580.723544:0:31521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8155 00002000:00100000:1.0:1746129580.723549:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3ec:0x0] (86016->90111) req@ffff8800903a2d80 x1830948734404480/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:321/0 lens 488/4536 e 0 to 0 dl 1746129591 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129580.723556:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800903a2d80 with x1830948734404480 ext(86016->90111) 00002000:00010000:1.0:1746129580.723559:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800903a2d80 00000100:00100000:3.0:1746129580.723665:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013575d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+22:1962:x1830948734403968:12345-192.168.202.4@tcp:4:cat.0 Request processed in 7711us (8063us total) trans 17179874180 rc 0/0 00000100:00100000:3.0:1746129580.723676:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2518 00002000:00100000:3.0:1746129580.723681:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->1531903) req@ffff88013575d500 x1830948734403968/t17179874180(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:321/0 lens 488/448 e 0 to 0 dl 1746129591 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129580.723687:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013575d500 with x1830948734403968 ext(1048576->1531903) 00010000:00010000:3.0:1746129580.723695:0:25745:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a6cf6200/0x40a459093b06b7b2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1531903) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2212d expref: 22 pid: 22480 timeout: 936 lvb_type: 0 00010000:00010000:3.0:1746129580.723708:0:25745:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a6cf6200/0x40a459093b06b7b2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1531903) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2212d expref: 22 pid: 22480 timeout: 936 lvb_type: 0 00002000:00010000:3.0:1746129580.723715:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88013575d500 00000100:00100000:0.0:1746129580.731246:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129580.731626:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734404608 00000100:00100000:2.0:1746129580.731636:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734404608 00010000:00010000:2.0:1746129580.731788:0:7087:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6cf6200/0x40a459093b06b7b2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1531903) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2212d expref: 22 pid: 22480 timeout: 936 lvb_type: 0 00000100:00100000:2.0:1746129580.731831:0:7087:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8677 00000100:00100000:2.0:1746129580.731841:0:7087:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800903a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+22:1963:x1830948734404608:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129580.731859:0:7087:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129580.731883:0:7087:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a6cf6200/0x40a459093b06b7b2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1531903) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2212d expref: 22 pid: 22480 timeout: 936 lvb_type: 0 00010000:00010000:2.0:1746129580.731982:0:7087:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a6cf6200/0x40a459093b06b7b2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1531903) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2212d expref: 22 pid: 22480 timeout: 936 lvb_type: 0 00010000:00010000:2.0:1746129580.732011:0:7087:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a6cf6200/0x40a459093b06b7b2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1531903) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2212d expref: 22 pid: 22480 timeout: 936 lvb_type: 0 00010000:00010000:2.0:1746129580.732043:0:7087:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129580.732045:0:7087:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129580.732052:0:7087:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880090a19800/0x40a459093b06b81b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22181 expref: 27 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129580.732061:0:7087:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090a19800/0x40a459093b06b81b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22181 expref: 27 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129580.732093:0:7087:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880090a19800/0x40a459093b06b81b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22181 expref: 27 pid: 11014 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129580.732104:0:7087:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c079880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7087:1830948737614848:192.168.202.4@tcp:105: 00000100:00100000:2.0:1746129580.732457:0:7087:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094a84b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746129580.734178:0:7087:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c079880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7087:1830948737614848:192.168.202.4@tcp:105: 00010000:00010000:2.0:1746129580.734199:0:7087:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129580.734252:0:7087:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800903a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:1963:x1830948734404608:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 2412us (3027us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129580.734262:0:7087:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8677 00000100:00100000:0.0:1746129580.735847:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129580.735955:0:21725:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734404864 00000100:00100000:3.0:1746129580.735963:0:21725:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734404864 00002000:00100000:3.0:1746129580.736007:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ec:0x0] (491520->495615) req@ffff8800903a3100 x1830948734404864/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:321/0 lens 488/0 e 0 to 0 dl 1746129591 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129580.736016:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800903a3100 with x1830948734404864 ext(491520->495615) 00002000:00010000:3.0:1746129580.736021:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800903a3100 00000100:00100000:3.0:1746129580.736052:0:21725:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8156 00000100:00100000:3.0:1746129580.736058:0:21725:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800903a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ada2ffba-8920-4ecb-8068-68caa9806978+22:1962:x1830948734404864:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:2.0:1746129580.738847:0:21725:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800903a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ada2ffba-8920-4ecb-8068-68caa9806978+22:1962:x1830948734404864:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 2770us (2990us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129580.738862:0:21725:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8156 00002000:00100000:2.0:1746129580.738876:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ec:0x0] (491520->495615) req@ffff8800903a3100 x1830948734404864/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:321/0 lens 488/4536 e 0 to 0 dl 1746129591 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129580.738885:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800903a3100 with x1830948734404864 ext(491520->495615) 00002000:00010000:2.0:1746129580.738891:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800903a3100 00000100:00100000:3.0:1746129580.739124:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129580.739193:0:21725:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734405120 00000100:00100000:2.0:1746129580.739204:0:21725:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734405120 00002000:00100000:2.0:1746129580.739244:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff8800947bf480 x1830948734405120/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:321/0 lens 488/0 e 0 to 0 dl 1746129591 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129580.739250:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800947bf480 with x1830948734405120 ext(1048576->2097151) 00002000:00010000:2.0:1746129580.739253:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800947bf480 00000100:00100000:2.0:1746129580.739282:0:21725:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8157 00000100:00100000:2.0:1746129580.739288:0:21725:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ada2ffba-8920-4ecb-8068-68caa9806978+28:1961:x1830948734405120:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:0.0:1746129580.748153:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129580.749964:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734405248 00000100:00100000:2.0:1746129580.749977:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734405248 00000100:00100000:2.0:1746129580.750041:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16774 00000100:00100000:2.0:1746129580.750049:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800903a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+14:32651:x1830948734405248:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:2.0:1746129580.750069:0:7148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129580.750087:0:7148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fc59e00/0x40a459093b06b822 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2218f expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129580.750116:0:7148:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f229e00/0x40a459093b06b78f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 4194304->5148671) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22118 expref: 21 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129580.750129:0:7148:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091b62200/0x40a459093b06b7e3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22157 expref: 15 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129580.750136:0:7148:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c668400/0x40a459093b06b6a8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 8 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22069 expref: 15 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129580.750141:0:7148:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f229a00/0x40a459093b06b76c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 8 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f220fc expref: 21 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129580.750147:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746129580.750148:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746129580.750151:0:7148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fc59e00/0x40a459093b06b822 lrc: 7/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 8 type: EXT [3166208->4141055] (req 3166208->4141055) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2218f expref: 15 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129580.750183:0:7148:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f229a00/0x40a459093b06b76c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 8 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f220fc expref: 21 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129580.750194:0:7148:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f229a00/0x40a459093b06b76c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 8 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f220fc expref: 21 pid: 22480 timeout: 936 lvb_type: 0 00000100:00100000:2.0:1746129580.750204:0:7148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c079880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7148:1830948737614976:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129580.750334:0:7148:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c668400/0x40a459093b06b6a8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 8 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22069 expref: 15 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129580.750342:0:7148:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c668400/0x40a459093b06b6a8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 8 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22069 expref: 15 pid: 4385 timeout: 936 lvb_type: 0 00000100:00100000:2.0:1746129580.750350:0:7148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c078e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7148:1830948737615104:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129580.750383:0:7148:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091b62200/0x40a459093b06b7e3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22157 expref: 15 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129580.750389:0:7148:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091b62200/0x40a459093b06b7e3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22157 expref: 15 pid: 8410 timeout: 936 lvb_type: 1 00000100:00100000:2.0:1746129580.750396:0:7148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c07aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7148:1830948737615232:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129580.750415:0:7148:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f229e00/0x40a459093b06b78f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 4194304->5148671) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22118 expref: 21 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129580.750422:0:7148:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f229e00/0x40a459093b06b78f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 4194304->5148671) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22118 expref: 21 pid: 22480 timeout: 936 lvb_type: 0 00000100:00100000:2.0:1746129580.750433:0:7148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c07b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7148:1830948737615360:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129580.750564:0:7148:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094a84c00 going to sleep for 11 seconds 00000100:00100000:3.0:1746129580.750836:0:21725:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ada2ffba-8920-4ecb-8068-68caa9806978+28:1961:x1830948734405120:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 11546us (11711us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129580.750845:0:21725:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8157 00002000:00100000:3.0:1746129580.750853:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff8800947bf480 x1830948734405120/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:321/0 lens 488/440 e 0 to 0 dl 1746129591 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129580.750863:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800947bf480 with x1830948734405120 ext(1048576->2097151) 00002000:00010000:3.0:1746129580.750868:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800947bf480 00000100:00100000:0.0:1746129580.752335:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129580.752370:0:11014:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734405376 00000100:00100000:1.0:1746129580.752377:0:11014:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734405376 00000100:00100000:1.0:1746129580.752412:0:11014:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16775 00000100:00100000:1.0:1746129580.752419:0:11014:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800903a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+16:1962:x1830948734405376:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129580.752435:0:11014:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746129580.752448:0:7148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c079880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7148:1830948737614976:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129580.752450:0:11014:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090a18200/0x40a459093b06b829 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f22196 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129580.752458:0:7148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c078e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7148:1830948737615104:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129580.752464:0:7148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c07aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7148:1830948737615232:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129580.752471:0:7148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c07b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7148:1830948737615360:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129580.752497:0:11014:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ede680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11014:1830948737615488:192.168.202.4@tcp:106: 00010000:00010000:2.0:1746129580.752500:0:7148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fc59e00/0x40a459093b06b822 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 8 type: EXT [3166208->4141055] (req 3166208->4141055) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2218f expref: 17 pid: 7148 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129580.752562:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129580.752563:0:11014:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130fc9e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746129580.752578:0:20577:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734405504 00000100:00100000:0.0:1746129580.752581:0:20577:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734405504 00000100:00100000:1.0:1746129580.752601:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129580.752603:0:20577:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16776 00000100:00100000:0.0:1746129580.752608:0:20577:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800903a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:1963:x1830948734405504:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129580.752615:0:20577:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746129580.752621:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734405632 00000100:00100000:3.0:1746129580.752625:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734405632 00010000:00010000:0.0:1746129580.752626:0:20577:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ec95400/0x40a459093b06b830 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2219d expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129580.752639:0:20577:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129580.752641:0:20577:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129580.752645:0:7087:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f229a00/0x40a459093b06b76c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 8 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f220fc expref: 22 pid: 22480 timeout: 936 lvb_type: 0 00010000:00010000:0.0:1746129580.752649:0:20577:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ec95400/0x40a459093b06b830 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2219d expref: 22 pid: 20577 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129580.752663:0:20577:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012ec95400/0x40a459093b06b830 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2219d expref: 22 pid: 20577 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746129580.752664:0:7087:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8678 00000100:00100000:3.0:1746129580.752669:0:7087:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6ce2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ada2ffba-8920-4ecb-8068-68caa9806978+22:1963:x1830948734405632:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129580.752671:0:20577:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ec95400, rc 0) 00010000:00010000:3.0:1746129580.752678:0:7087:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746129580.752691:0:20577:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800903a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+22:1963:x1830948734405504:12345-192.168.202.4@tcp:101:cat.0 Request processed in 83us (129us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129580.752696:0:20577:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16776 00010000:00010000:2.0:1746129580.752719:0:7148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fc59e00, rc 0) 00000100:00100000:2.0:1746129580.752740:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800903a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+17:32651:x1830948734405248:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 2692us (4599us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129580.752746:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16774 00010000:00010000:3.0:1746129580.752756:0:7087:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f229a00/0x40a459093b06b76c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 9 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f220fc expref: 22 pid: 22480 timeout: 936 lvb_type: 0 00010000:00010000:3.0:1746129580.752768:0:7087:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f229a00/0x40a459093b06b76c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 9 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f220fc expref: 22 pid: 22480 timeout: 936 lvb_type: 0 00010000:00010000:3.0:1746129580.752786:0:7087:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f229a00/0x40a459093b06b76c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 9 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f220fc expref: 22 pid: 22480 timeout: 936 lvb_type: 0 00010000:00010000:3.0:1746129580.752812:0:7087:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129580.752831:0:7087:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6ce2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ada2ffba-8920-4ecb-8068-68caa9806978+21:1963:x1830948734405632:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 162us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129580.752837:0:7087:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8678 00000100:00100000:0.0:1746129580.757072:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129580.757260:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734405760 00000100:00100000:1.0:1746129580.757267:0:11014:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ede680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11014:1830948737615488:192.168.202.4@tcp:106: 00000100:00100000:3.0:1746129580.757268:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734405760 00010000:00010000:3.0:1746129580.757322:0:7087:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c668400/0x40a459093b06b6a8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22069 expref: 17 pid: 4385 timeout: 936 lvb_type: 0 00010000:00010000:1.0:1746129580.757327:0:11014:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090a18200/0x40a459093b06b829 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22196 expref: 17 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129580.757340:0:11014:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090a18200/0x40a459093b06b829 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22196 expref: 17 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129580.757356:0:11014:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090a18200, rc 0) 00000100:00100000:3.0:1746129580.757408:0:7087:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8679 00000100:00100000:1.0:1746129580.757409:0:11014:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800903a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+16:1962:x1830948734405376:12345-192.168.202.4@tcp:101:cat.0 Request processed in 4989us (5079us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129580.757415:0:7087:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800903a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+16:1963:x1830948734405760:12345-192.168.202.4@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746129580.757416:0:11014:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16775 00010000:00010000:3.0:1746129580.757430:0:7087:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129580.757442:0:7087:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c668400/0x40a459093b06b6a8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 8 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22069 expref: 15 pid: 4385 timeout: 936 lvb_type: 0 00010000:00010000:3.0:1746129580.757451:0:7087:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c668400/0x40a459093b06b6a8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 8 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22069 expref: 15 pid: 4385 timeout: 936 lvb_type: 0 00010000:00010000:3.0:1746129580.757469:0:7087:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c668400/0x40a459093b06b6a8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 8 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22069 expref: 15 pid: 4385 timeout: 936 lvb_type: 0 00010000:00010000:3.0:1746129580.757494:0:7087:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129580.757837:0:7087:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800903a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+14:1963:x1830948734405760:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 421us (777us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129580.757843:0:7087:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8679 00000100:00100000:2.0:1746129580.760090:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129580.760135:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129580.760167:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129580.760273:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129580.760343:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734406144 00000100:00100000:2.0:1746129580.760353:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734406144 00000100:00100000:2.0:1746129580.760395:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734406272 00000100:00100000:2.0:1746129580.760397:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734406272 00000100:00100000:2.0:1746129580.760414:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16777 00000100:00100000:2.0:1746129580.760421:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c078e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+14:32661:x1830948734406144:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129580.760442:0:7148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129580.760460:0:7148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091b62400/0x40a459093b06b837 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f221a4 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129580.760493:0:7148:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091b63600/0x40a459093b06b814 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 86016->495615) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22188 expref: 21 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129580.760502:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129580.760504:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129580.760507:0:7148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091b62400/0x40a459093b06b837 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f221a4 expref: 15 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129580.760540:0:7148:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091b63600/0x40a459093b06b814 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 86016->495615) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22188 expref: 21 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129580.760553:0:7148:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091b63600/0x40a459093b06b814 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 86016->495615) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22188 expref: 21 pid: 7148 timeout: 936 lvb_type: 0 00000100:00100000:2.0:1746129580.760565:0:7148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c07b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7148:1830948737615616:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129580.760641:0:7148:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094a84c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746129580.760722:0:8412:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16778 00000100:00100000:2.0:1746129580.760726:0:8412:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c079880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ada2ffba-8920-4ecb-8068-68caa9806978+21:32657:x1830948734406272:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129580.760733:0:8412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129580.760740:0:8412:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f8d4200/0x40a459093b06b83e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f221ab expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129580.760750:0:8412:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129580.760754:0:8412:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fc59e00/0x40a459093b06b822 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 7 type: EXT [3166208->4141055] (req 3166208->4141055) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2218f expref: 15 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129580.760759:0:8412:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129580.760761:0:8412:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f8d4200/0x40a459093b06b83e lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f221ab expref: 22 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129580.760780:0:8412:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fc59e00/0x40a459093b06b822 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 7 type: EXT [3166208->4141055] (req 3166208->4141055) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2218f expref: 15 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129580.760789:0:8412:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f8d4200/0x40a459093b06b83e lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f221ab expref: 22 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129580.760803:0:8412:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f8d4200, rc 0) 00000100:00100000:2.0:1746129580.760824:0:8412:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c079880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ada2ffba-8920-4ecb-8068-68caa9806978+22:32657:x1830948734406272:12345-192.168.202.4@tcp:101:cat.0 Request processed in 97us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129580.760829:0:8412:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16778 00000100:00100000:3.0:1746129580.760939:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734405888 00000100:00100000:3.0:1746129580.760943:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734405888 00010000:00010000:3.0:1746129580.760959:0:7087:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091b62200/0x40a459093b06b7e3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22157 expref: 16 pid: 8410 timeout: 936 lvb_type: 1 00000100:00100000:3.0:1746129580.760974:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734406016 00000100:00100000:3.0:1746129580.760976:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734406016 00010000:00010000:3.0:1746129580.760982:0:7087:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f229e00/0x40a459093b06b78f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 4194304->5148671) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22118 expref: 22 pid: 22480 timeout: 936 lvb_type: 0 00000100:00100000:3.0:1746129580.760996:0:7087:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8680 00000100:00100000:3.0:1746129580.761000:0:7087:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c07b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+16:1960:x1830948734405888:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129580.761009:0:7087:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129580.761028:0:7087:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091b62200/0x40a459093b06b7e3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22157 expref: 16 pid: 8410 timeout: 936 lvb_type: 1 00010000:00010000:3.0:1746129580.761036:0:7087:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091b62200/0x40a459093b06b7e3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22157 expref: 16 pid: 8410 timeout: 936 lvb_type: 1 00010000:00010000:3.0:1746129580.761054:0:7087:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091b62200/0x40a459093b06b7e3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22157 expref: 16 pid: 8410 timeout: 936 lvb_type: 1 00010000:00010000:3.0:1746129580.761075:0:7087:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129580.761096:0:7087:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c07b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+15:1960:x1830948734405888:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 94us (1019us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129580.761102:0:7087:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8680 00000100:00100000:3.0:1746129580.761113:0:7087:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8681 00000100:00100000:3.0:1746129580.761117:0:7087:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c07aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ada2ffba-8920-4ecb-8068-68caa9806978+22:1962:x1830948734406016:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129580.761123:0:7087:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129580.761129:0:7087:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f229e00/0x40a459093b06b78f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 4194304->5148671) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22118 expref: 22 pid: 22480 timeout: 936 lvb_type: 0 00010000:00010000:3.0:1746129580.761137:0:7087:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f229e00/0x40a459093b06b78f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 4194304->5148671) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22118 expref: 22 pid: 22480 timeout: 936 lvb_type: 0 00010000:00010000:3.0:1746129580.761153:0:7087:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f229e00/0x40a459093b06b78f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 4194304->5148671) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22118 expref: 22 pid: 22480 timeout: 936 lvb_type: 0 00010000:00010000:3.0:1746129580.761160:0:7087:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129580.761161:0:7087:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129580.761167:0:7087:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fc59e00/0x40a459093b06b822 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [3166208->18446744073709551615] (req 3166208->4141055) gid 0 flags: 0x60080000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2218f expref: 14 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129580.761174:0:7087:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fc59e00/0x40a459093b06b822 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [3166208->18446744073709551615] (req 3166208->4141055) gid 0 flags: 0x60080000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2218f expref: 14 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129580.761190:0:7087:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009fc59e00/0x40a459093b06b822 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [3166208->18446744073709551615] (req 3166208->4141055) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2218f expref: 14 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129580.761196:0:7087:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fc59e00/0x40a459093b06b822 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [3166208->18446744073709551615] (req 3166208->4141055) gid 0 flags: 0x70000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2218f expref: 14 pid: 7148 timeout: 936 lvb_type: 0 00000100:00100000:3.0:1746129580.761203:0:7087:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7087:1830948737615872:192.168.202.4@tcp:105: 00000100:00100000:3.0:1746129580.761221:0:7087:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5c68540 going to sleep for 11 seconds 00000100:00100000:2.0:1746129580.762350:0:7148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c07b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7148:1830948737615616:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129580.762370:0:7148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091b62400/0x40a459093b06b837 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f221a4 expref: 14 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129580.762381:0:7148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091b62400, rc 0) 00000100:00100000:2.0:1746129580.762405:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c078e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+14:32661:x1830948734406144:12345-192.168.202.4@tcp:101:cat.0 Request processed in 1985us (2237us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129580.762412:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16777 00000100:00100000:0.0:1746129580.762742:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129580.762839:0:21725:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734406400 00000100:00100000:3.0:1746129580.762844:0:21725:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734406400 00002000:00100000:3.0:1746129580.762875:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ec:0x0] (86016->495615) req@ffff8800903a1c00 x1830948734406400/t0(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:321/0 lens 488/0 e 0 to 0 dl 1746129591 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129580.762884:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800903a1c00 with x1830948734406400 ext(86016->495615) 00010000:00010000:3.0:1746129580.762891:0:21725:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091b63600/0x40a459093b06b814 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 86016->495615) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22188 expref: 22 pid: 7148 timeout: 936 lvb_type: 0 00010000:00010000:3.0:1746129580.762901:0:21725:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091b63600/0x40a459093b06b814 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 86016->495615) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22188 expref: 22 pid: 7148 timeout: 936 lvb_type: 0 00002000:00010000:3.0:1746129580.762907:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800903a1c00 00000100:00100000:2.0:1746129580.763142:0:7087:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7087:1830948737615872:192.168.202.4@tcp:105: 00010000:00010000:2.0:1746129580.763157:0:7087:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129580.763179:0:7087:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c07aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ada2ffba-8920-4ecb-8068-68caa9806978+22:1962:x1830948734406016:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 2061us (3043us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129580.763186:0:7087:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8681 00000100:00100000:0.0:1746129580.763501:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129580.764182:0:21725:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734406656 00000100:00100000:3.0:1746129580.764187:0:21725:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734406656 00002000:00100000:3.0:1746129580.764214:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ef:0x0] (3166208->3170303) req@ffff8800903a1f80 x1830948734406656/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:321/0 lens 488/0 e 0 to 0 dl 1746129591 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129580.764223:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800903a1f80 with x1830948734406656 ext(3166208->3170303) 00010000:00010000:3.0:1746129580.764241:0:21725:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fc59e00/0x40a459093b06b822 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [3166208->18446744073709551615] (req 3166208->4141055) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2218f expref: 14 pid: 7148 timeout: 936 lvb_type: 0 00010000:00010000:3.0:1746129580.764252:0:21725:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fc59e00/0x40a459093b06b822 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [3166208->18446744073709551615] (req 3166208->4141055) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2218f expref: 14 pid: 7148 timeout: 936 lvb_type: 0 00002000:00010000:3.0:1746129580.764259:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800903a1f80 00000100:00100000:3.0:1746129580.764288:0:21725:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2519 00000100:00100000:3.0:1746129580.764307:0:21725:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800903a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ada2ffba-8920-4ecb-8068-68caa9806978+21:1962:x1830948734406400:12345-192.168.202.4@tcp:4:cat.0 00000100:00100000:2.0:1746129580.764415:0:31519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2520 00000100:00100000:2.0:1746129580.764423:0:31519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800903a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+14:1963:x1830948734406656:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:2.0:1746129580.764571:0:31519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800903a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+14:1963:x1830948734406656:12345-192.168.202.4@tcp:3:cat.0 Request processed in 149us (1070us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129580.764578:0:31519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2520 00002000:00100000:2.0:1746129580.764583:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3ef:0x0] (3166208->3170303) req@ffff8800903a1f80 x1830948734406656/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:321/0 lens 488/4536 e 0 to 0 dl 1746129591 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129580.764591:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800903a1f80 with x1830948734406656 ext(3166208->3170303) 00010000:00010000:2.0:1746129580.764596:0:31519:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fc59e00/0x40a459093b06b822 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [3166208->18446744073709551615] (req 3166208->4141055) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2218f expref: 14 pid: 7148 timeout: 936 lvb_type: 0 00010000:00010000:2.0:1746129580.764604:0:31519:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fc59e00/0x40a459093b06b822 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [3166208->18446744073709551615] (req 3166208->4141055) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2218f expref: 14 pid: 7148 timeout: 936 lvb_type: 0 00002000:00010000:2.0:1746129580.764610:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800903a1f80 00000100:00100000:0.0:1746129580.774518:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129580.774608:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734406912 00000100:00100000:1.0:1746129580.774618:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734406912 00002000:00100000:1.0:1746129580.774675:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ef:0x0] (4136960->4141055) req@ffff8800903a1880 x1830948734406912/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:321/0 lens 488/0 e 0 to 0 dl 1746129591 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129580.774686:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800903a1880 with x1830948734406912 ext(4136960->4141055) 00010000:00010000:1.0:1746129580.774696:0:25745:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fc59e00/0x40a459093b06b822 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [3166208->18446744073709551615] (req 3166208->4141055) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2218f expref: 14 pid: 7148 timeout: 936 lvb_type: 0 00010000:00010000:1.0:1746129580.774713:0:25745:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fc59e00/0x40a459093b06b822 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [3166208->18446744073709551615] (req 3166208->4141055) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2218f expref: 14 pid: 7148 timeout: 936 lvb_type: 0 00002000:00010000:1.0:1746129580.774720:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800903a1880 00000100:00100000:1.0:1746129580.774756:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2521 00000100:00100000:1.0:1746129580.774763:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800903a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+14:1960:x1830948734406912:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:1.0:1746129580.774966:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800903a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+14:1960:x1830948734406912:12345-192.168.202.4@tcp:3:cat.0 Request processed in 202us (456us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746129580.774973:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2521 00002000:00100000:1.0:1746129580.774979:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ef:0x0] (4136960->4141055) req@ffff8800903a1880 x1830948734406912/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:321/0 lens 488/4536 e 0 to 0 dl 1746129591 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129580.774985:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800903a1880 with x1830948734406912 ext(4136960->4141055) 00010000:00010000:1.0:1746129580.774990:0:25745:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fc59e00/0x40a459093b06b822 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [3166208->18446744073709551615] (req 3166208->4141055) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2218f expref: 14 pid: 7148 timeout: 936 lvb_type: 0 00010000:00010000:1.0:1746129580.774998:0:25745:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fc59e00/0x40a459093b06b822 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [3166208->18446744073709551615] (req 3166208->4141055) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2218f expref: 14 pid: 7148 timeout: 936 lvb_type: 0 00002000:00010000:1.0:1746129580.775003:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800903a1880 00000100:00100000:0.0:1746129580.779674:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129580.779769:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734407168 00000100:00100000:1.0:1746129580.779779:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734407168 00002000:00100000:1.0:1746129580.779826:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ef:0x0] (3166208->4141055) req@ffff8800903a1180 x1830948734407168/t0(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:321/0 lens 488/0 e 0 to 0 dl 1746129591 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129580.779836:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800903a1180 with x1830948734407168 ext(3166208->4141055) 00010000:00010000:1.0:1746129580.779846:0:25745:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fc59e00/0x40a459093b06b822 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [3166208->18446744073709551615] (req 3166208->4141055) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2218f expref: 14 pid: 7148 timeout: 936 lvb_type: 0 00010000:00010000:1.0:1746129580.779857:0:25745:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fc59e00/0x40a459093b06b822 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [3166208->18446744073709551615] (req 3166208->4141055) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2218f expref: 14 pid: 7148 timeout: 936 lvb_type: 0 00002000:00010000:1.0:1746129580.779864:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800903a1180 00000100:00100000:1.0:1746129580.779886:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2522 00000100:00100000:1.0:1746129580.779893:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800903a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+14:1960:x1830948734407168:12345-192.168.202.4@tcp:4:cat.0 00000100:00100000:3.0:1746129580.781561:0:21725:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800903a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ada2ffba-8920-4ecb-8068-68caa9806978+23:1962:x1830948734406400:12345-192.168.202.4@tcp:4:cat.0 Request processed in 17257us (18811us total) trans 21474841421 rc 0/0 00000100:00100000:3.0:1746129580.781576:0:21725:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2519 00002000:00100000:3.0:1746129580.781589:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ec:0x0] (86016->495615) req@ffff8800903a1c00 x1830948734406400/t21474841421(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:321/0 lens 488/448 e 0 to 0 dl 1746129591 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129580.781597:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800903a1c00 with x1830948734406400 ext(86016->495615) 00010000:00010000:3.0:1746129580.781606:0:21725:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091b63600/0x40a459093b06b814 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 86016->495615) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22188 expref: 23 pid: 7148 timeout: 936 lvb_type: 0 00010000:00010000:3.0:1746129580.781617:0:21725:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091b63600/0x40a459093b06b814 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 86016->495615) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22188 expref: 23 pid: 7148 timeout: 936 lvb_type: 0 00002000:00010000:3.0:1746129580.781623:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800903a1c00 00000100:00100000:0.0:1746129580.783966:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129580.784549:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734407296 00000100:00100000:3.0:1746129580.784559:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734407296 00010000:00010000:3.0:1746129580.784592:0:7087:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091b63600/0x40a459093b06b814 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 86016->495615) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22188 expref: 23 pid: 7148 timeout: 936 lvb_type: 0 00000100:00100000:3.0:1746129580.784629:0:7087:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8682 00000100:00100000:3.0:1746129580.784636:0:7087:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800903a2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ada2ffba-8920-4ecb-8068-68caa9806978+23:1961:x1830948734407296:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129580.784646:0:7087:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129580.784663:0:7087:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091b63600/0x40a459093b06b814 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 86016->495615) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22188 expref: 23 pid: 7148 timeout: 936 lvb_type: 0 00010000:00010000:3.0:1746129580.784673:0:7087:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091b63600/0x40a459093b06b814 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 86016->495615) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22188 expref: 23 pid: 7148 timeout: 936 lvb_type: 0 00010000:00010000:3.0:1746129580.784694:0:7087:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091b63600/0x40a459093b06b814 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 86016->495615) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22188 expref: 23 pid: 7148 timeout: 936 lvb_type: 0 00010000:00010000:3.0:1746129580.784711:0:7087:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129580.784713:0:7087:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129580.784719:0:7087:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091b62400/0x40a459093b06b837 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f221a4 expref: 15 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129580.784730:0:7087:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091b62400/0x40a459093b06b837 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f221a4 expref: 15 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129580.784758:0:7087:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091b62400/0x40a459093b06b837 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f221a4 expref: 15 pid: 7148 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129580.784769:0:7087:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bc000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7087:1830948737616000:192.168.202.4@tcp:105: 00000100:00100000:3.0:1746129580.785658:0:7087:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5c68480 going to sleep for 11 seconds 00000100:00100000:3.0:1746129580.788411:0:7087:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bc000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7087:1830948737616000:192.168.202.4@tcp:105: 00010000:00010000:3.0:1746129580.788436:0:7087:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129580.788481:0:7087:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800903a2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ada2ffba-8920-4ecb-8068-68caa9806978+22:1961:x1830948734407296:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 3843us (4523us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129580.788493:0:7087:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8682 00000100:00100000:0.0:1746129580.791093:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129580.791211:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129580.791309:0:31521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734407552 00000100:00100000:3.0:1746129580.791314:0:21725:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734407808 00000100:00100000:3.0:1746129580.791318:0:21725:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734407808 00000100:00100000:2.0:1746129580.791318:0:31521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734407552 00002000:00100000:3.0:1746129580.791357:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff8800903a0380 x1830948734407808/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:321/0 lens 488/0 e 0 to 0 dl 1746129591 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129580.791357:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3ec:0x0] (0->1048575) req@ffff8800903a0000 x1830948734407552/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:321/0 lens 488/0 e 0 to 0 dl 1746129591 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129580.791367:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800903a0380 with x1830948734407808 ext(1048576->2097151) 00002000:00100000:2.0:1746129580.791367:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800903a0000 with x1830948734407552 ext(0->1048575) 00002000:00010000:2.0:1746129580.791372:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800903a0000 00000100:00100000:2.0:1746129580.791392:0:31521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8158 00000100:00100000:2.0:1746129580.791399:0:31521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800903a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+16:1963:x1830948734407552:12345-192.168.202.4@tcp:3:cat.0 00002000:00010000:3.0:1746129580.791501:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800903a0380 00000100:00100000:3.0:1746129580.791515:0:21725:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8159 00000100:00100000:3.0:1746129580.791520:0:21725:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800903a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+22:1962:x1830948734407808:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:2.0:1746129580.799066:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800903a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+18:1960:x1830948734407168:12345-192.168.202.4@tcp:4:cat.0 Request processed in 19159us (19388us total) trans 21474841422 rc 0/0 00000100:00100000:2.0:1746129580.799081:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2522 00002000:00100000:2.0:1746129580.799094:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ef:0x0] (3166208->4141055) req@ffff8800903a1180 x1830948734407168/t21474841422(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:321/0 lens 488/448 e 0 to 0 dl 1746129591 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129580.799104:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800903a1180 with x1830948734407168 ext(3166208->4141055) 00010000:00010000:2.0:1746129580.799115:0:25745:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fc59e00/0x40a459093b06b822 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [3166208->18446744073709551615] (req 3166208->4141055) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2218f expref: 18 pid: 7148 timeout: 936 lvb_type: 0 00010000:00010000:2.0:1746129580.799132:0:25745:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fc59e00/0x40a459093b06b822 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [3166208->18446744073709551615] (req 3166208->4141055) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2218f expref: 18 pid: 7148 timeout: 936 lvb_type: 0 00002000:00010000:2.0:1746129580.799139:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800903a1180 00000100:00100000:3.0:1746129580.802718:0:21725:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800903a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+22:1962:x1830948734407808:12345-192.168.202.4@tcp:3:cat.0 Request processed in 11186us (11496us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129580.802733:0:21725:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8159 00002000:00100000:3.0:1746129580.802744:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff8800903a0380 x1830948734407808/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:321/0 lens 488/440 e 0 to 0 dl 1746129591 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129580.802754:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800903a0380 with x1830948734407808 ext(1048576->2097151) 00002000:00010000:3.0:1746129580.802759:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800903a0380 00000100:00100000:0.0:1746129580.803906:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129580.803990:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734407936 00000100:00100000:3.0:1746129580.803998:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734407936 00010000:00010000:3.0:1746129580.804029:0:7087:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fc59e00/0x40a459093b06b822 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [3166208->18446744073709551615] (req 3166208->4141055) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2218f expref: 18 pid: 7148 timeout: 936 lvb_type: 0 00000100:00100000:1.0:1746129580.804583:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8683 00000100:00100000:1.0:1746129580.804592:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800903a0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+18:1963:x1830948734407936:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129580.804606:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746129580.804628:0:7085:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb mtime from disk: 1746129580 -> 1746129581 00002000:00010000:1.0:1746129580.804631:0:7085:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb ctime from disk: 1746129580 -> 1746129581 00010000:00010000:1.0:1746129580.804636:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fc59e00/0x40a459093b06b822 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [3166208->18446744073709551615] (req 3166208->4141055) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2218f expref: 18 pid: 7148 timeout: 936 lvb_type: 0 00010000:00010000:1.0:1746129580.804652:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fc59e00/0x40a459093b06b822 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [3166208->18446744073709551615] (req 3166208->4141055) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2218f expref: 18 pid: 7148 timeout: 936 lvb_type: 0 00010000:00010000:1.0:1746129580.804675:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fc59e00/0x40a459093b06b822 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [3166208->18446744073709551615] (req 3166208->4141055) gid 0 flags: 0x44801000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2218f expref: 18 pid: 7148 timeout: 936 lvb_type: 0 00010000:00010000:1.0:1746129580.804703:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129580.804705:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129580.804712:0:7085:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f8d4200/0x40a459093b06b83e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f221ab expref: 21 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129580.804719:0:7085:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f8d4200/0x40a459093b06b83e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f221ab expref: 21 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129580.804748:0:7085:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f8d4200/0x40a459093b06b83e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f221ab expref: 21 pid: 8412 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129580.804756:0:7085:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ede680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7085:1830948737616128:192.168.202.4@tcp:105: 00000100:00100000:1.0:1746129580.804826:0:7085:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130fc9a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746129580.805602:0:31521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800903a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+16:1963:x1830948734407552:12345-192.168.202.4@tcp:3:cat.0 Request processed in 14202us (14519us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129580.805610:0:31521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8158 00002000:00100000:3.0:1746129580.805618:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3ec:0x0] (0->1048575) req@ffff8800903a0000 x1830948734407552/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:321/0 lens 488/440 e 0 to 0 dl 1746129591 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129580.805625:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800903a0000 with x1830948734407552 ext(0->1048575) 00002000:00010000:3.0:1746129580.805629:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800903a0000 00000100:00100000:1.0:1746129580.806772:0:7085:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ede680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7085:1830948737616128:192.168.202.4@tcp:105: 00010000:00010000:1.0:1746129580.806790:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129580.806929:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800903a0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+15:1963:x1830948734407936:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 2336us (3024us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129580.806936:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8683 00000100:00100000:0.0:1746129580.809840:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129580.810077:0:31521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734408192 00000100:00100000:3.0:1746129580.810086:0:31521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734408192 00002000:00100000:3.0:1746129580.810134:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->4194303) req@ffff8800903a0e00 x1830948734408192/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:321/0 lens 488/0 e 0 to 0 dl 1746129591 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129580.810143:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800903a0e00 with x1830948734408192 ext(3145728->4194303) 00002000:00010000:3.0:1746129580.810148:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800903a0e00 00000100:00100000:3.0:1746129580.810179:0:31521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8160 00000100:00100000:3.0:1746129580.810187:0:31521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800903a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ada2ffba-8920-4ecb-8068-68caa9806978+22:1962:x1830948734408192:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129580.816478:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129580.817852:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734408320 00000100:00100000:2.0:1746129580.817863:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734408320 00000100:00100000:2.0:1746129580.817924:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16779 00000100:00100000:2.0:1746129580.817933:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800903a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+15:32661:x1830948734408320:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129580.817948:0:7148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129580.817962:0:7148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cdfc200/0x40a459093b06b845 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f221b2 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129580.817984:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129580.817985:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129580.817991:0:7148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cdfc200/0x40a459093b06b845 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f221b2 expref: 16 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129580.818003:0:7148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009cdfc200/0x40a459093b06b845 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f221b2 expref: 16 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129580.818012:0:7148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cdfc200, rc 0) 00000100:00100000:2.0:1746129580.818057:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800903a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+16:32661:x1830948734408320:12345-192.168.202.4@tcp:101:cat.0 Request processed in 126us (1592us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129580.818063:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16779 00000100:00100000:3.0:1746129580.818816:0:31521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800903a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ada2ffba-8920-4ecb-8068-68caa9806978+22:1962:x1830948734408192:12345-192.168.202.4@tcp:3:cat.0 Request processed in 8624us (8980us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129580.818825:0:31521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8160 00002000:00100000:3.0:1746129580.818836:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->4194303) req@ffff8800903a0e00 x1830948734408192/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:321/0 lens 488/440 e 0 to 0 dl 1746129591 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129580.818845:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800903a0e00 with x1830948734408192 ext(3145728->4194303) 00002000:00010000:3.0:1746129580.818851:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800903a0e00 00000100:00100000:0.0:1746129580.823354:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129580.823433:0:31521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734408576 00000100:00100000:3.0:1746129580.823447:0:31521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734408576 00000100:00100000:1.0:1746129580.823487:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00002000:00100000:3.0:1746129580.823495:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->4194303) req@ffff88009f37d500 x1830948734408576/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:321/0 lens 488/0 e 0 to 0 dl 1746129591 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129580.823505:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f37d500 with x1830948734408576 ext(3145728->4194303) 00002000:00010000:3.0:1746129580.823510:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f37d500 00000100:00100000:0.0:1746129580.823567:0:21725:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8161 00000100:00100000:0.0:1746129580.823576:0:21725:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f37d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+16:1962:x1830948734408576:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:2.0:1746129580.823581:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734408704 00000100:00100000:2.0:1746129580.823585:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734408704 00000100:00100000:2.0:1746129580.823608:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16780 00000100:00100000:2.0:1746129580.823612:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ede680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ada2ffba-8920-4ecb-8068-68caa9806978+22:1961:x1830948734408704:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129580.823620:0:7148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129580.823638:0:7148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cdfc800/0x40a459093b06b84c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f221b9 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129580.823658:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129580.823659:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129580.823667:0:7148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cdfc800/0x40a459093b06b84c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f221b9 expref: 23 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129580.823681:0:7148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009cdfc800/0x40a459093b06b84c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f221b9 expref: 23 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129580.823691:0:7148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cdfc800, rc 0) 00000100:00100000:2.0:1746129580.823736:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ede680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ada2ffba-8920-4ecb-8068-68caa9806978+23:1961:x1830948734408704:12345-192.168.202.4@tcp:101:cat.0 Request processed in 124us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129580.823741:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16780 00000100:00100000:0.0:1746129580.829951:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129580.830783:0:21725:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f37d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+16:1962:x1830948734408576:12345-192.168.202.4@tcp:3:cat.0 Request processed in 7205us (7436us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129580.830794:0:21725:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8161 00002000:00100000:1.0:1746129580.830805:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->4194303) req@ffff88009f37d500 x1830948734408576/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:321/0 lens 488/440 e 0 to 0 dl 1746129591 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129580.830815:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f37d500 with x1830948734408576 ext(3145728->4194303) 00002000:00010000:1.0:1746129580.830821:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f37d500 00000100:00100000:1.0:1746129580.830843:0:21725:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734408960 00000100:00100000:1.0:1746129580.830849:0:21725:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734408960 00002000:00100000:1.0:1746129580.830878:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ef:0x0] (4194304->5148671) req@ffff88009f37e300 x1830948734408960/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:321/0 lens 488/0 e 0 to 0 dl 1746129591 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129580.830885:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f37e300 with x1830948734408960 ext(4194304->5148671) 00002000:00010000:1.0:1746129580.830888:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f37e300 00000100:00100000:3.0:1746129580.831730:0:31521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8162 00000100:00100000:3.0:1746129580.831748:0:31521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f37e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ada2ffba-8920-4ecb-8068-68caa9806978+23:1960:x1830948734408960:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:3.0:1746129580.838569:0:31521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f37e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ada2ffba-8920-4ecb-8068-68caa9806978+23:1960:x1830948734408960:12345-192.168.202.4@tcp:3:cat.0 Request processed in 6818us (8617us total) trans 0 rc 954368/954368 00000100:00100000:3.0:1746129580.838579:0:31521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8162 00002000:00100000:3.0:1746129580.838591:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3ef:0x0] (4194304->5148671) req@ffff88009f37e300 x1830948734408960/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:321/0 lens 488/440 e 0 to 0 dl 1746129591 ref 1 fl Complete:/200/0 rc 954368/954368 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129580.838600:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f37e300 with x1830948734408960 ext(4194304->5148671) 00002000:00010000:3.0:1746129580.838606:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f37e300 00000100:00100000:0.0:1746129580.842410:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129580.842462:0:31521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734409216 00000100:00100000:3.0:1746129580.842472:0:31521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734409216 00002000:00100000:3.0:1746129580.842521:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3ef:0x0] (4194304->5148671) req@ffff88009f37df80 x1830948734409216/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:321/0 lens 488/0 e 0 to 0 dl 1746129591 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129580.842530:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f37df80 with x1830948734409216 ext(4194304->5148671) 00002000:00010000:3.0:1746129580.842536:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f37df80 00000100:00100000:3.0:1746129580.842652:0:31521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8163 00000100:00100000:3.0:1746129580.842660:0:31521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f37df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+16:1961:x1830948734409216:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129580.852778:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129580.853412:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734409344 00000100:00100000:2.0:1746129580.853422:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734409344 00000100:00100000:2.0:1746129580.853484:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11346 00000100:00100000:2.0:1746129580.853492:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f37c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:068dab75-d300-4ead-a742-d14572ad1e50+16:32665:x1830948734409344:12345-192.168.202.4@tcp:101:mirror_io.0 00010000:00010000:2.0:1746129580.853518:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129580.853540:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cdfca00/0x40a459093b06b853 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f221c0 expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129580.853606:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cdfd800/0x40a459093b06b85a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129580.853623:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cdfd800/0x40a459093b06b85a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129580.853634:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cdfd800/0x40a459093b06b85a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129580.853646:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cdfc400/0x40a459093b06b861 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129580.853650:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cdfc400/0x40a459093b06b861 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129580.853655:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cdfc400/0x40a459093b06b861 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129580.853757:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c63ec00/0x40a459093b06b868 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129580.853767:0:14549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c031e00/0x40a459093b06b79d lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2211f expref: 299 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129580.853774:0:14549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a60b3600/0x40a459093b06b7f8 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2216c expref: 21 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129580.853780:0:14549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c63ec00/0x40a459093b06b868 lrc: 5/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129580.853813:0:14549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a60b3600/0x40a459093b06b7f8 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2216c expref: 21 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129580.853825:0:14549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a60b3600/0x40a459093b06b7f8 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2216c expref: 21 pid: 14549 timeout: 936 lvb_type: 0 00000100:00100000:2.0:1746129580.853842:0:14549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e389c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830948737616256:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129580.854270:0:31521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f37df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+16:1961:x1830948734409216:12345-192.168.202.4@tcp:3:cat.0 Request processed in 11607us (11866us total) trans 0 rc 954368/954368 00000100:00100000:3.0:1746129580.854280:0:31521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8163 00002000:00100000:3.0:1746129580.854290:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3ef:0x0] (4194304->5148671) req@ffff88009f37df80 x1830948734409216/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:321/0 lens 488/440 e 0 to 0 dl 1746129591 ref 1 fl Complete:/200/0 rc 954368/954368 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129580.854321:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f37df80 with x1830948734409216 ext(4194304->5148671) 00002000:00010000:3.0:1746129580.854325:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f37df80 00010000:00010000:2.0:1746129580.854776:0:14549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012c031e00/0x40a459093b06b79d lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2211f expref: 299 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129580.854788:0:14549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c031e00/0x40a459093b06b79d lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2211f expref: 299 pid: 14549 timeout: 936 lvb_type: 0 00000100:00100000:2.0:1746129580.856269:0:14549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e38ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830948737616384:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129580.858499:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129580.858804:0:20861:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734409600 00000100:00100000:3.0:1746129580.858814:0:20861:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734409600 00000100:00100000:3.0:1746129580.858863:0:20861:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4838 00000100:00100000:3.0:1746129580.858871:0:20861:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f37c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+22:27693:x1830948734409600:12345-192.168.202.4@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1746129580.859130:0:20861:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f37c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+23:27693:x1830948734409600:12345-192.168.202.4@tcp:35:ldlm_bl.0 Request processed in 259us (638us total) trans 8589945469 rc 0/0 00000100:00100000:3.0:1746129580.859137:0:20861:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4838 00000100:00100000:2.0:1746129580.859309:0:14549:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094a84b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746129580.859338:0:14549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e389c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830948737616256:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129580.864972:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129580.865052:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734409728 00000100:00100000:1.0:1746129580.865061:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734409728 00000100:00100000:0.0:1746129580.865066:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00010000:00010000:1.0:1746129580.865101:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a60b3600/0x40a459093b06b7f8 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2216c expref: 23 pid: 14549 timeout: 936 lvb_type: 0 00000100:00100000:1.0:1746129580.865126:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734409856 00000100:00100000:1.0:1746129580.865128:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734409856 00010000:00010000:1.0:1746129580.865137:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c031e00/0x40a459093b06b79d lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2211f expref: 300 pid: 14549 timeout: 936 lvb_type: 0 00000100:00100000:1.0:1746129580.865152:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8684 00000100:00100000:1.0:1746129580.865158:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f37fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+23:1960:x1830948734409728:12345-192.168.202.4@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746129580.865173:0:14549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e38ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830948737616384:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129580.865173:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129580.865178:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a60b3600/0x40a459093b06b7f8 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2216c expref: 23 pid: 14549 timeout: 936 lvb_type: 0 00010000:00010000:1.0:1746129580.865187:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a60b3600/0x40a459093b06b7f8 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2216c expref: 23 pid: 14549 timeout: 936 lvb_type: 0 00010000:00010000:1.0:1746129580.865208:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a60b3600/0x40a459093b06b7f8 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2216c expref: 23 pid: 14549 timeout: 936 lvb_type: 0 00010000:00010000:2.0:1746129580.865210:0:14549:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009c63ec00/0x40a459093b06b868 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 15 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129580.865235:0:7085:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:1.0:1746129580.865241:0:7085:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c63ec00/0x40a459093b06b868 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129580.865254:0:7085:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c63ec00/0x40a459093b06b868 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129580.865259:0:7085:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c63ec00/0x40a459093b06b868 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129580.865263:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129580.865274:0:7087:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8685 00000100:00100000:3.0:1746129580.865328:0:7087:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6ce2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ada2ffba-8920-4ecb-8068-68caa9806978+300:1962:x1830948734409856:12345-192.168.202.4@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746129580.865328:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f37fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+22:1960:x1830948734409728:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 169us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129580.865335:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8684 00010000:00010000:3.0:1746129580.865359:0:7087:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129580.865370:0:7087:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012c031e00/0x40a459093b06b79d lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2211f expref: 300 pid: 14549 timeout: 936 lvb_type: 0 00010000:00010000:3.0:1746129580.865384:0:7087:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012c031e00/0x40a459093b06b79d lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2211f expref: 300 pid: 14549 timeout: 936 lvb_type: 0 00010000:00010000:3.0:1746129580.865403:0:7087:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c031e00/0x40a459093b06b79d lrc: 0/0,0 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2211f expref: 300 pid: 14549 timeout: 936 lvb_type: 0 00010000:00010000:3.0:1746129580.865435:0:7087:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:3.0:1746129580.865439:0:7087:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c63ec00/0x40a459093b06b868 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129580.865448:0:7087:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c63ec00/0x40a459093b06b868 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129580.865454:0:7087:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c63ec00/0x40a459093b06b868 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129580.865479:0:7087:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746129580.865497:0:14549:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009c63ec00/0x40a459093b06b868 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129580.865504:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c63ec00/0x40a459093b06b868 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000100:00100000:3.0:1746129580.865532:0:7087:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6ce2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ada2ffba-8920-4ecb-8068-68caa9806978+299:1962:x1830948734409856:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 247us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129580.865538:0:7087:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8685 00000004:00200000:2.0:1746129580.865550:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00000004:00200000:2.0:1746129580.865554:0:14549:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746129580.865571:0:14549:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009c63ec00/0x40a459093b06b868 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129580.865582:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c63ec00/0x40a459093b06b868 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129580.865595:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cdfd800/0x40a459093b06b85a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129580.865602:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cdfd800/0x40a459093b06b85a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129580.865607:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009cdfd800/0x40a459093b06b85a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129580.865611:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009cdfd800 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746129580.865614:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cdfd800/0x40a459093b06b85a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129580.865619:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cdfd800/0x40a459093b06b85a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129580.865627:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880132ef8f00) 00010000:00010000:2.0:1746129580.865629:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129580.865631:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009cdfd800/0x40a459093b06b85a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129580.865635:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cdfd800/0x40a459093b06b85a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129580.865737:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cdfc400/0x40a459093b06b861 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129580.865745:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cdfc400/0x40a459093b06b861 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129580.865749:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009cdfc400/0x40a459093b06b861 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129580.865754:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009cdfc400 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746129580.865758:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cdfc400/0x40a459093b06b861 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129580.865763:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cdfc400/0x40a459093b06b861 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129580.865771:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f9f3800) 00010000:00010000:2.0:1746129580.865773:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129580.865775:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009cdfc400/0x40a459093b06b861 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129580.865779:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cdfc400/0x40a459093b06b861 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129580.865812:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cdfca00/0x40a459093b06b853 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f221c0 expref: 18 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129580.865821:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c63ec00/0x40a459093b06b868 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f221c0 expref: 17 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129580.865826:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:2.0:1746129580.865828:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746129580.865829:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c63ec00, rc 0) 00000100:00100000:2.0:1746129580.865864:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f37c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:068dab75-d300-4ead-a742-d14572ad1e50+17:32665:x1830948734409344:12345-192.168.202.4@tcp:101:mirror_io.0 Request processed in 12373us (13097us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129580.865871:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11346 00000100:00100000:0.0:1746129580.870944:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129580.870987:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129580.871019:0:11014:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734409984 00000100:00100000:0.0:1746129580.871027:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129580.871028:0:11014:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734409984 00000100:00100000:1.0:1746129580.871066:0:11014:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734410112 00000100:00100000:1.0:1746129580.871068:0:11014:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734410112 00000100:00100000:1.0:1746129580.871079:0:11014:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734410240 00000100:00100000:1.0:1746129580.871081:0:11014:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734410240 00000100:00100000:1.0:1746129580.871097:0:11014:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16781 00000100:00100000:1.0:1746129580.871103:0:11014:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f37f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:068dab75-d300-4ead-a742-d14572ad1e50+7:1962:x1830948734409984:12345-192.168.202.4@tcp:101:mirror_io.0 00000100:00100000:2.0:1746129580.871118:0:8412:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16782 00010000:00010000:1.0:1746129580.871122:0:11014:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746129580.871125:0:8412:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f37d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:068dab75-d300-4ead-a742-d14572ad1e50+7:1963:x1830948734410112:12345-192.168.202.4@tcp:101:mirror_io.0 00010000:00010000:2.0:1746129580.871133:0:8412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129580.871140:0:11014:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c144200/0x40a459093b06b86f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f221c7 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129580.871142:0:8412:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c63f200/0x40a459093b06b876 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f221ce expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129580.871162:0:8412:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129580.871162:0:11014:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129580.871164:0:8412:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129580.871164:0:11014:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129580.871172:0:8412:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c63f200/0x40a459093b06b876 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f221ce expref: 8 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129580.871172:0:11014:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c144200/0x40a459093b06b86f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f221c7 expref: 8 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129580.871187:0:8412:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c63f200/0x40a459093b06b876 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f221ce expref: 8 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129580.871187:0:11014:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c144200/0x40a459093b06b86f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f221c7 expref: 8 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129580.871197:0:8412:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c63f200, rc 0) 00010000:00010000:1.0:1746129580.871198:0:11014:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c144200, rc 0) 00000100:00100000:1.0:1746129580.871252:0:11014:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f37f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:068dab75-d300-4ead-a742-d14572ad1e50+8:1962:x1830948734409984:12345-192.168.202.4@tcp:101:mirror_io.0 Request processed in 149us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129580.871255:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16783 00000100:00100000:1.0:1746129580.871258:0:11014:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16781 00000100:00100000:0.0:1746129580.871261:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f37d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:068dab75-d300-4ead-a742-d14572ad1e50+8:1962:x1830948734410240:12345-192.168.202.4@tcp:101:mirror_io.0 00010000:00010000:0.0:1746129580.871267:0:7149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129580.871273:0:7149:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e301800/0x40a459093b06b87d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f221d5 expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129580.871283:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129580.871284:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129580.871288:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e301800/0x40a459093b06b87d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f221d5 expref: 8 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129580.871320:0:7149:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012e301800/0x40a459093b06b87d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f221d5 expref: 8 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129580.871331:0:7149:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e301800, rc 0) 00000100:00100000:2.0:1746129580.871930:0:8412:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f37d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:068dab75-d300-4ead-a742-d14572ad1e50+8:1963:x1830948734410112:12345-192.168.202.4@tcp:101:mirror_io.0 Request processed in 804us (940us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129580.871936:0:8412:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16782 00000100:00100000:3.0:1746129580.872163:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f37d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:068dab75-d300-4ead-a742-d14572ad1e50+8:1962:x1830948734410240:12345-192.168.202.4@tcp:101:mirror_io.0 Request processed in 900us (1132us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129580.872168:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16783 00000100:00100000:0.0:1746129580.877781:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129580.877985:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734410496 00000100:00100000:2.0:1746129580.877998:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734410496 00000100:00100000:2.0:1746129580.878322:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11347 00000100:00100000:2.0:1746129580.878340:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f37e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:068dab75-d300-4ead-a742-d14572ad1e50+17:32665:x1830948734410496:12345-192.168.202.4@tcp:101:mirror_io.0 00010000:00010000:2.0:1746129580.878359:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129580.878376:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c63f800/0x40a459093b06b884 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f221dc expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129580.878452:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c63ee00/0x40a459093b06b88b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129580.878465:0:14549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c63ec00/0x40a459093b06b868 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f221c0 expref: 18 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129580.878470:0:14549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c63ee00/0x40a459093b06b88b lrc: 4/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129580.878498:0:14549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009c63ec00/0x40a459093b06b868 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f221c0 expref: 18 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129580.878508:0:14549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c63ec00/0x40a459093b06b868 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f221c0 expref: 18 pid: 14549 timeout: 936 lvb_type: 0 00000100:00100000:2.0:1746129580.878518:0:14549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e38ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830948737616512:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129580.878628:0:14549:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094a84b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746129580.883074:0:14549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e38ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830948737616512:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129580.883096:0:14549:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009c63ee00/0x40a459093b06b88b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000100:00100000:0.0:1746129580.883874:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129580.883941:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734410624 00000100:00100000:3.0:1746129580.883947:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734410624 00010000:00010000:3.0:1746129580.883974:0:7087:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c63ec00/0x40a459093b06b868 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f221c0 expref: 19 pid: 14549 timeout: 936 lvb_type: 0 00000100:00100000:3.0:1746129580.884010:0:7087:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8686 00000100:00100000:3.0:1746129580.884016:0:7087:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f37fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:068dab75-d300-4ead-a742-d14572ad1e50+19:1962:x1830948734410624:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129580.884027:0:7087:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129580.884032:0:7087:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009c63ec00/0x40a459093b06b868 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f221c0 expref: 19 pid: 14549 timeout: 936 lvb_type: 0 00010000:00010000:3.0:1746129580.884041:0:7087:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009c63ec00/0x40a459093b06b868 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f221c0 expref: 19 pid: 14549 timeout: 936 lvb_type: 0 00010000:00010000:3.0:1746129580.884058:0:7087:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c63ec00/0x40a459093b06b868 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f221c0 expref: 19 pid: 14549 timeout: 936 lvb_type: 0 00010000:00010000:3.0:1746129580.884956:0:7087:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:3.0:1746129580.884962:0:7087:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c63ee00/0x40a459093b06b88b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129580.884973:0:7087:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c63ee00/0x40a459093b06b88b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129580.884979:0:7087:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c63ee00/0x40a459093b06b88b lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129580.885063:0:7087:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746129580.885072:0:14549:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009c63ee00/0x40a459093b06b88b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129580.885077:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c63ee00/0x40a459093b06b88b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00200000:0.0:1746129580.885092:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00000100:00100000:3.0:1746129580.885163:0:7087:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f37fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:068dab75-d300-4ead-a742-d14572ad1e50+19:1962:x1830948734410624:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 1145us (1294us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129580.885170:0:7087:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8686 00010000:00010000:0.0:1746129580.885202:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c63f800/0x40a459093b06b884 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f221dc expref: 19 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129580.885239:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c63ee00/0x40a459093b06b88b lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f221dc expref: 18 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129580.885244:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:0.0:1746129580.885246:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746129580.885248:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c63ee00, rc 0) 00000100:00100000:0.0:1746129580.885270:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f37e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:068dab75-d300-4ead-a742-d14572ad1e50+18:32665:x1830948734410496:12345-192.168.202.4@tcp:101:mirror_io.0 Request processed in 6938us (7723us total) trans 8589945470 rc 0/0 00000100:00100000:0.0:1746129580.885275:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11347 00000100:00100000:0.0:1746129580.887816:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129580.887838:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734410880 00000100:00100000:2.0:1746129580.887846:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734410880 00000100:00100000:2.0:1746129580.887924:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11348 00000100:00100000:2.0:1746129580.887930:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013145ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:068dab75-d300-4ead-a742-d14572ad1e50+18:32665:x1830948734410880:12345-192.168.202.4@tcp:101:mirror_io.0 00010000:00010000:2.0:1746129580.887947:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129580.887950:0:14549:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746129580.887978:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c63ee00/0x40a459093b06b88b lrc: 0/0,0 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f221dc expref: 18 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129580.888001:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:2.0:1746129580.888004:0:14549:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746129580.888013:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c63fc00/0x40a459093b06b899 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f221e3 expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129580.888213:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c63ec00/0x40a459093b06b8a0 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129580.888235:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c63ec00/0x40a459093b06b8a0 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129580.888243:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c63ec00/0x40a459093b06b8a0 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129580.888253:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c63ec00/0x40a459093b06b8a0 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129580.888257:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c63ec00/0x40a459093b06b8a0 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129580.888262:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c63ec00/0x40a459093b06b8a0 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129580.888266:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c63ec00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746129580.888269:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c63ec00/0x40a459093b06b8a0 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129580.888274:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c63ec00/0x40a459093b06b8a0 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129580.888280:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:2.0:1746129580.888282:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746129580.888285:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c63ec00/0x40a459093b06b8a0 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129580.888315:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c63ec00/0x40a459093b06b8a0 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129580.888334:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c63fc00/0x40a459093b06b899 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x1/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f221e3 expref: 18 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129580.888345:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c63fc00/0x40a459093b06b899 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x1/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f221e3 expref: 18 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129580.888351:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c63fc00, rc 0) 00000100:00100000:2.0:1746129580.888385:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013145ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:068dab75-d300-4ead-a742-d14572ad1e50+17:32665:x1830948734410880:12345-192.168.202.4@tcp:101:mirror_io.0 Request processed in 454us (574us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129580.888390:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11348 00000100:00100000:0.0:1746129580.890921:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129580.890999:0:14551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734411136 00000100:00100000:2.0:1746129580.891007:0:14551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734411136 00000100:00100000:2.0:1746129580.891056:0:14551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4839 00000100:00100000:2.0:1746129580.891064:0:14551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013145f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:068dab75-d300-4ead-a742-d14572ad1e50+17:32665:x1830948734411136:12345-192.168.202.4@tcp:35:mirror_io.0 00000100:00100000:2.0:1746129580.891265:0:14551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013145f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:068dab75-d300-4ead-a742-d14572ad1e50+18:32665:x1830948734411136:12345-192.168.202.4@tcp:35:mirror_io.0 Request processed in 201us (349us total) trans 8589945471 rc 0/0 00000100:00100000:2.0:1746129580.891272:0:14551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4839 00000100:00100000:0.0:1746129580.958555:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129580.958653:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734411264 00000100:00100000:3.0:1746129580.958660:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734411264 00000100:00100000:3.0:1746129580.958712:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16784 00000100:00100000:3.0:1746129580.958720:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013145e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ada2ffba-8920-4ecb-8068-68caa9806978+28:32666:x1830948734411264:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:3.0:1746129580.958734:0:7149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129580.958749:0:7149:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f845e00/0x40a459093b06b8a7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f221ea expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129580.958772:0:7149:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880090a19800/0x40a459093b06b81b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22181 expref: 29 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129580.958779:0:7149:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c63f200/0x40a459093b06b876 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f221ce expref: 7 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129580.958785:0:7149:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ec95400/0x40a459093b06b830 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2219d expref: 21 pid: 20577 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129580.958791:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129580.958793:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129580.958796:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f845e00/0x40a459093b06b8a7 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [1564672->2097151] (req 1564672->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f221ea expref: 29 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129580.958820:0:7149:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012ec95400/0x40a459093b06b830 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2219d expref: 21 pid: 20577 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129580.958830:0:7149:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012ec95400/0x40a459093b06b830 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2219d expref: 21 pid: 20577 timeout: 936 lvb_type: 1 00000100:00100000:3.0:1746129580.958840:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7149:1830948737616640:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129580.958924:0:7149:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c63f200/0x40a459093b06b876 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f221ce expref: 7 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129580.958932:0:7149:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c63f200/0x40a459093b06b876 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f221ce expref: 7 pid: 8412 timeout: 936 lvb_type: 1 00000100:00100000:3.0:1746129580.958939:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7149:1830948737616768:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129580.959038:0:7149:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880090a19800/0x40a459093b06b81b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22181 expref: 29 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129580.959047:0:7149:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880090a19800/0x40a459093b06b81b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22181 expref: 29 pid: 11014 timeout: 936 lvb_type: 0 00000100:00100000:3.0:1746129580.959055:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7149:1830948737616896:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129580.959074:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5c68540 going to sleep for 11 seconds 00000100:00100000:0.0:1746129580.962936:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129580.963785:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7149:1830948737616640:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129580.963795:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7149:1830948737616768:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129580.963802:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7149:1830948737616896:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129580.963828:0:7149:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f845e00/0x40a459093b06b8a7 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [1564672->2097151] (req 1564672->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f221ea expref: 29 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129580.963842:0:7149:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f845e00, rc 0) 00000100:00100000:3.0:1746129580.963892:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013145e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ada2ffba-8920-4ecb-8068-68caa9806978+29:32666:x1830948734411264:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 5173us (5343us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129580.963903:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16784 00000100:00100000:2.0:1746129580.964241:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734411520 00000100:00100000:2.0:1746129580.964247:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734411520 00010000:00010000:2.0:1746129580.964271:0:7087:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012ec95400/0x40a459093b06b830 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2219d expref: 22 pid: 20577 timeout: 936 lvb_type: 1 00000100:00100000:2.0:1746129580.964290:0:7087:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8687 00000100:00100000:2.0:1746129580.964310:0:7087:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013145d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+22:1960:x1830948734411520:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129580.964321:0:7087:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129580.964338:0:7087:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012ec95400/0x40a459093b06b830 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2219d expref: 22 pid: 20577 timeout: 936 lvb_type: 1 00010000:00010000:2.0:1746129580.964350:0:7087:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012ec95400/0x40a459093b06b830 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2219d expref: 22 pid: 20577 timeout: 936 lvb_type: 1 00010000:00010000:2.0:1746129580.964370:0:7087:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ec95400/0x40a459093b06b830 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2219d expref: 22 pid: 20577 timeout: 936 lvb_type: 1 00010000:00010000:2.0:1746129580.964384:0:7087:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129580.964404:0:7087:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013145d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:1960:x1830948734411520:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 95us (1475us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129580.964409:0:7087:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8687 00000100:00100000:1.0:1746129580.967092:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129580.967178:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129580.967255:0:7086:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734411392 00000100:00100000:0.0:1746129580.967264:0:7086:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734411392 00010000:00010000:0.0:1746129580.967315:0:7086:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c63f200/0x40a459093b06b876 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f221ce expref: 8 pid: 8412 timeout: 936 lvb_type: 1 00000100:00100000:0.0:1746129580.967344:0:7086:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734411648 00000100:00100000:0.0:1746129580.967346:0:7086:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734411648 00010000:00010000:0.0:1746129580.967360:0:7086:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090a19800/0x40a459093b06b81b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22181 expref: 29 pid: 11014 timeout: 936 lvb_type: 0 00000100:00100000:0.0:1746129580.967387:0:7086:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8688 00000100:00100000:0.0:1746129580.967394:0:7086:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093edc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:068dab75-d300-4ead-a742-d14572ad1e50+8:1962:x1830948734411392:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129580.967407:0:7086:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129580.967429:0:7086:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c63f200/0x40a459093b06b876 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f221ce expref: 8 pid: 8412 timeout: 936 lvb_type: 1 00010000:00010000:0.0:1746129580.967439:0:7086:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c63f200/0x40a459093b06b876 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f221ce expref: 8 pid: 8412 timeout: 936 lvb_type: 1 00010000:00010000:0.0:1746129580.967460:0:7086:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c63f200/0x40a459093b06b876 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f221ce expref: 8 pid: 8412 timeout: 936 lvb_type: 1 00010000:00010000:0.0:1746129580.967478:0:7086:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129580.967519:0:7086:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093edc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:068dab75-d300-4ead-a742-d14572ad1e50+7:1962:x1830948734411392:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 125us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129580.967525:0:7086:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8688 00000100:00100000:0.0:1746129580.967541:0:7086:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8689 00000100:00100000:0.0:1746129580.967545:0:7086:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093eded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ada2ffba-8920-4ecb-8068-68caa9806978+29:1963:x1830948734411648:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129580.967554:0:7086:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129580.967560:0:7086:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090a19800/0x40a459093b06b81b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22181 expref: 29 pid: 11014 timeout: 936 lvb_type: 0 00010000:00010000:0.0:1746129580.967570:0:7086:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090a19800/0x40a459093b06b81b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22181 expref: 29 pid: 11014 timeout: 936 lvb_type: 0 00010000:00010000:0.0:1746129580.967581:0:7086:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090a19800/0x40a459093b06b81b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22181 expref: 29 pid: 11014 timeout: 936 lvb_type: 0 00010000:00010000:0.0:1746129580.967589:0:7086:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129580.967591:0:7086:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129580.967597:0:7086:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f845e00/0x40a459093b06b8a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1564672->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f221ea expref: 28 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129580.967604:0:7086:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f845e00/0x40a459093b06b8a7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1564672->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f221ea expref: 28 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129580.967635:0:7086:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f845e00/0x40a459093b06b8a7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1564672->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f221ea expref: 28 pid: 7149 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129580.967647:0:7086:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013145dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7086:1830948737617024:192.168.202.4@tcp:105: 00000100:00100000:0.0:1746129580.967703:0:7086:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa381180 going to sleep for 11 seconds 00000100:00100000:0.0:1746129580.972585:0:7086:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013145dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7086:1830948737617024:192.168.202.4@tcp:105: 00010000:00010000:0.0:1746129580.972607:0:7086:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129580.972652:0:7086:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093eded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ada2ffba-8920-4ecb-8068-68caa9806978+28:1963:x1830948734411648:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 5105us (5473us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129580.972662:0:7086:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8689 00000100:00100000:2.0:1746129580.972814:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129580.972852:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129580.972938:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734411776 00000100:00100000:3.0:1746129580.972945:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734411776 00000100:00100000:3.0:1746129580.972971:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16785 00000100:00100000:3.0:1746129580.972977:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e38ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ada2ffba-8920-4ecb-8068-68caa9806978+28:1960:x1830948734411776:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129580.972991:0:7149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129580.973005:0:7149:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f845400/0x40a459093b06b8ae lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f221f1 expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129580.973043:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7149:1830948737617152:192.168.202.4@tcp:106: 00000100:00100000:3.0:1746129580.973106:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5c68540 going to sleep for 11 seconds 00000100:00100000:0.0:1746129580.973311:0:31521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734412032 00000100:00100000:0.0:1746129580.973315:0:31521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734412032 00002000:00100000:0.0:1746129580.973453:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f3:0x0] (1564672->1568767) req@ffff88012e389c00 x1830948734412032/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:321/0 lens 488/0 e 0 to 0 dl 1746129591 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129580.973462:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e389c00 with x1830948734412032 ext(1564672->1568767) 00002000:00010000:0.0:1746129580.973466:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e389c00 00000100:00100000:0.0:1746129580.973492:0:31521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8164 00000100:00100000:0.0:1746129580.973498:0:31521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e389c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ada2ffba-8920-4ecb-8068-68caa9806978+30:1962:x1830948734412032:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:0.0:1746129580.973614:0:31521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e389c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ada2ffba-8920-4ecb-8068-68caa9806978+30:1962:x1830948734412032:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 116us (759us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746129580.973619:0:31521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8164 00002000:00100000:0.0:1746129580.973624:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f3:0x0] (1564672->1568767) req@ffff88012e389c00 x1830948734412032/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:321/0 lens 488/4536 e 0 to 0 dl 1746129591 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129580.973630:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e389c00 with x1830948734412032 ext(1564672->1568767) 00002000:00010000:0.0:1746129580.973632:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e389c00 00000100:00100000:3.0:1746129580.975573:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7149:1830948737617152:192.168.202.4@tcp:106: 00010000:00010000:3.0:1746129580.975596:0:7149:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f845400/0x40a459093b06b8ae lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f221f1 expref: 29 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129580.975606:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f845400/0x40a459093b06b8ae lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f221f1 expref: 29 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129580.975627:0:7149:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f845400, rc 0) 00000100:00100000:3.0:1746129580.976016:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e38ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ada2ffba-8920-4ecb-8068-68caa9806978+28:1960:x1830948734411776:12345-192.168.202.4@tcp:101:cat.0 Request processed in 3037us (3203us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129580.976023:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16785 00000100:00100000:0.0:1746129580.979668:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129580.979710:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129580.980335:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734412416 00000100:00100000:2.0:1746129580.980344:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734412416 00002000:00100000:2.0:1746129580.980380:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ec:0x0] (0->1048575) req@ffff88013145dc00 x1830948734412416/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:321/0 lens 488/0 e 0 to 0 dl 1746129591 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129580.980388:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013145dc00 with x1830948734412416 ext(0->1048575) 00002000:00010000:2.0:1746129580.980393:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013145dc00 00000100:00100000:2.0:1746129580.980413:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8165 00000100:00100000:2.0:1746129580.980421:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013145dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+23:1961:x1830948734412416:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:1.0:1746129580.980498:0:31521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734412544 00000100:00100000:1.0:1746129580.980502:0:31521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734412544 00002000:00100000:1.0:1746129580.980518:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->1564671) req@ffff88013145ed80 x1830948734412544/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:321/0 lens 488/0 e 0 to 0 dl 1746129591 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129580.980535:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013145ed80 with x1830948734412544 ext(1048576->1564671) 00002000:00010000:1.0:1746129580.980538:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013145ed80 00000100:00100000:1.0:1746129580.980549:0:31521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8166 00000100:00100000:1.0:1746129580.980554:0:31521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013145ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ada2ffba-8920-4ecb-8068-68caa9806978+28:1961:x1830948734412544:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129580.981690:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129580.981822:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734412672 00000100:00100000:3.0:1746129580.981828:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734412672 00000100:00100000:3.0:1746129580.981861:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16786 00000100:00100000:3.0:1746129580.981867:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013145c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ada2ffba-8920-4ecb-8068-68caa9806978+30:32666:x1830948734412672:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:3.0:1746129580.981878:0:7149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129580.981892:0:7149:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f845a00/0x40a459093b06b8b5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f221f8 expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129580.981912:0:7149:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880136439a00/0x40a459093b06b662 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22031 expref: 31 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129580.981920:0:7149:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c460200/0x40a459093b06b734 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f220d9 expref: 6 pid: 20577 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129580.981926:0:7149:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009faa3600/0x40a459093b06b68c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2204d expref: 20 pid: 8411 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129580.981933:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129580.981934:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129580.981937:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f845a00/0x40a459093b06b8b5 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [1048576->1323007] (req 1048576->1323007) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f221f8 expref: 31 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129580.981961:0:7149:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009faa3600/0x40a459093b06b68c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2204d expref: 20 pid: 8411 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129580.981971:0:7149:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009faa3600/0x40a459093b06b68c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2204d expref: 20 pid: 8411 timeout: 936 lvb_type: 1 00000100:00100000:3.0:1746129580.981981:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7149:1830948737617280:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129580.982719:0:7149:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c460200/0x40a459093b06b734 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f220d9 expref: 6 pid: 20577 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129580.982733:0:7149:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c460200/0x40a459093b06b734 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f220d9 expref: 6 pid: 20577 timeout: 936 lvb_type: 1 00000100:00100000:3.0:1746129580.982741:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7149:1830948737617408:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129580.982781:0:7149:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880136439a00/0x40a459093b06b662 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22031 expref: 31 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129580.982788:0:7149:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880136439a00/0x40a459093b06b662 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22031 expref: 31 pid: 20577 timeout: 936 lvb_type: 0 00000100:00100000:3.0:1746129580.982795:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7149:1830948737617536:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129580.982812:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5c68540 going to sleep for 11 seconds 00000100:00100000:0.0:1746129580.989409:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129580.989437:0:7086:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734412800 00000100:00100000:0.0:1746129580.989445:0:7086:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734412800 00010000:00010000:0.0:1746129580.989484:0:7086:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c460200/0x40a459093b06b734 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f220d9 expref: 7 pid: 20577 timeout: 936 lvb_type: 1 00000100:00100000:0.0:1746129580.989517:0:7086:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8690 00000100:00100000:0.0:1746129580.989525:0:7086:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013145d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:068dab75-d300-4ead-a742-d14572ad1e50+7:1961:x1830948734412800:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129580.989537:0:7086:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129580.989565:0:7086:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c460200/0x40a459093b06b734 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f220d9 expref: 7 pid: 20577 timeout: 936 lvb_type: 1 00010000:00010000:0.0:1746129580.989577:0:7086:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c460200/0x40a459093b06b734 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f220d9 expref: 7 pid: 20577 timeout: 936 lvb_type: 1 00010000:00010000:0.0:1746129580.989604:0:7086:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129580.989645:0:7086:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013145d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:068dab75-d300-4ead-a742-d14572ad1e50+7:1961:x1830948734412800:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 121us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129580.989651:0:7086:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8690 00000100:00100000:0.0:1746129580.989776:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129580.989787:0:7086:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734412928 00000100:00100000:0.0:1746129580.989789:0:7086:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734412928 00010000:00010000:0.0:1746129580.989800:0:7086:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009faa3600/0x40a459093b06b68c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2204d expref: 21 pid: 8411 timeout: 936 lvb_type: 1 00000100:00100000:0.0:1746129580.989830:0:7086:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8691 00000100:00100000:0.0:1746129580.989835:0:7086:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013145f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:1963:x1830948734412928:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129580.989842:0:7086:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129580.989849:0:7086:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009faa3600/0x40a459093b06b68c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2204d expref: 21 pid: 8411 timeout: 936 lvb_type: 1 00010000:00010000:0.0:1746129580.989861:0:7086:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009faa3600/0x40a459093b06b68c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2204d expref: 21 pid: 8411 timeout: 936 lvb_type: 1 00010000:00010000:0.0:1746129580.989871:0:7086:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129580.989888:0:7086:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013145f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:1963:x1830948734412928:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 53us (112us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129580.989893:0:7086:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8691 00000100:00100000:1.0:1746129580.990142:0:31521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013145ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ada2ffba-8920-4ecb-8068-68caa9806978+30:1961:x1830948734412544:12345-192.168.202.4@tcp:3:cat.0 Request processed in 9586us (10431us total) trans 0 rc 516096/516096 00000100:00100000:1.0:1746129580.990150:0:31521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8166 00002000:00100000:1.0:1746129580.990159:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->1564671) req@ffff88013145ed80 x1830948734412544/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:321/0 lens 488/440 e 0 to 0 dl 1746129591 ref 1 fl Complete:/200/0 rc 516096/516096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129580.990168:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013145ed80 with x1830948734412544 ext(1048576->1564671) 00002000:00010000:1.0:1746129580.990172:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013145ed80 00010000:00010000:3.0:1746129580.990282:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009faa3600/0x40a459093b06b68c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2204d expref: 20 pid: 8411 timeout: 936 lvb_type: 1 00000100:00100000:3.0:1746129580.990317:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7149:1830948737617280:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129580.990328:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c460200/0x40a459093b06b734 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f220d9 expref: 6 pid: 20577 timeout: 936 lvb_type: 1 00000100:00100000:3.0:1746129580.990335:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7149:1830948737617408:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129580.990343:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7149:1830948737617536:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129580.990367:0:7149:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f845a00/0x40a459093b06b8b5 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->1323007] (req 1048576->1323007) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f221f8 expref: 29 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129580.990380:0:7149:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f845a00, rc 0) 00000100:00100000:3.0:1746129580.990399:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013145c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ada2ffba-8920-4ecb-8068-68caa9806978+29:32666:x1830948734412672:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 8533us (8712us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129580.990405:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16786 00000100:00100000:2.0:1746129580.991671:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129580.991756:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734413056 00000100:00100000:1.0:1746129580.991762:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734413056 00010000:00010000:1.0:1746129580.991783:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880136439a00/0x40a459093b06b662 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22031 expref: 29 pid: 20577 timeout: 936 lvb_type: 0 00000100:00100000:1.0:1746129580.991814:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8692 00000100:00100000:1.0:1746129580.991820:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6ce1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ada2ffba-8920-4ecb-8068-68caa9806978+29:1963:x1830948734413056:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129580.991830:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129580.991844:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880136439a00/0x40a459093b06b662 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22031 expref: 29 pid: 20577 timeout: 936 lvb_type: 0 00010000:00010000:1.0:1746129580.991855:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880136439a00/0x40a459093b06b662 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22031 expref: 29 pid: 20577 timeout: 936 lvb_type: 0 00010000:00010000:1.0:1746129580.991872:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136439a00/0x40a459093b06b662 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22031 expref: 29 pid: 20577 timeout: 936 lvb_type: 0 00010000:00010000:1.0:1746129580.991888:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129580.991890:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129580.991897:0:7085:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f845a00/0x40a459093b06b8b5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1323007) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f221f8 expref: 28 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129580.991906:0:7085:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f845a00/0x40a459093b06b8b5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1323007) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f221f8 expref: 28 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129580.992264:0:7085:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f845a00/0x40a459093b06b8b5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1323007) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f221f8 expref: 28 pid: 7149 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129580.992276:0:7085:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b552d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7085:1830948737617664:192.168.202.4@tcp:105: 00000100:00100000:1.0:1746129580.992504:0:7085:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130fc9180 going to sleep for 11 seconds 00000100:00100000:3.0:1746129580.993342:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013145dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+23:1961:x1830948734412416:12345-192.168.202.4@tcp:3:cat.0 Request processed in 12919us (13677us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129580.993352:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8165 00002000:00100000:3.0:1746129580.993361:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ec:0x0] (0->1048575) req@ffff88013145dc00 x1830948734412416/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:321/0 lens 488/440 e 0 to 0 dl 1746129591 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129580.993369:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013145dc00 with x1830948734412416 ext(0->1048575) 00002000:00010000:3.0:1746129580.993374:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013145dc00 00000100:00100000:1.0:1746129580.996682:0:7085:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b552d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7085:1830948737617664:192.168.202.4@tcp:105: 00010000:00010000:1.0:1746129580.996708:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129580.996769:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6ce1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ada2ffba-8920-4ecb-8068-68caa9806978+28:1963:x1830948734413056:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 4946us (5099us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129580.996782:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8692 00000100:00100000:0.0:1746129580.997944:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129580.998035:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734413312 00000100:00100000:3.0:1746129580.998044:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734413312 00002000:00100000:3.0:1746129580.998091:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f4:0x0] (1105920->2097151) req@ffff88013145ca80 x1830948734413312/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:321/0 lens 488/0 e 0 to 0 dl 1746129591 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129580.998101:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013145ca80 with x1830948734413312 ext(1105920->2097151) 00002000:00010000:3.0:1746129580.998106:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013145ca80 00000100:00100000:3.0:1746129580.998136:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8167 00000100:00100000:3.0:1746129580.998144:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013145ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+28:1960:x1830948734413312:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:2.0:1746129581.000149:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129581.000246:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734413568 00000100:00100000:3.0:1746129581.000254:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734413568 00000100:00100000:3.0:1746129581.000315:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11349 00000100:00100000:3.0:1746129581.000326:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e38bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+22:32673:x1830948734413568:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:3.0:1746129581.000346:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129581.000363:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f844a00/0x40a459093b06b8bc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f221ff expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129581.000462:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f845000/0x40a459093b06b8c3 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129581.000477:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f845000/0x40a459093b06b8c3 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129581.000489:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f845000/0x40a459093b06b8c3 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00200000:3.0:1746129581.000499:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:3.0:1746129581.000626:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f844a00/0x40a459093b06b8bc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f221ff expref: 25 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129581.000645:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f845000/0x40a459093b06b8c3 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f221ff expref: 24 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129581.000653:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:3.0:1746129581.000656:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746129581.000659:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f845000, rc 0) 00000100:00100000:3.0:1746129581.000688:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e38bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+24:32673:x1830948734413568:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 363us (548us total) trans 8589945472 rc 0/0 00000100:00100000:3.0:1746129581.000694:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11349 00000100:00100000:3.0:1746129581.007283:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013145ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+28:1960:x1830948734413312:12345-192.168.202.4@tcp:3:cat.0 Request processed in 9127us (9330us total) trans 0 rc 991232/991232 00000100:00100000:3.0:1746129581.007316:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8167 00002000:00100000:3.0:1746129581.007330:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f4:0x0] (1105920->2097151) req@ffff88013145ca80 x1830948734413312/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:321/0 lens 488/440 e 0 to 0 dl 1746129591 ref 1 fl Complete:/200/0 rc 991232/991232 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129581.007340:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013145ca80 with x1830948734413312 ext(1105920->2097151) 00002000:00010000:3.0:1746129581.007346:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013145ca80 00000100:00100000:3.0:1746129581.007524:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129581.007893:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734413696 00000100:00100000:0.0:1746129581.008005:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734413696 00000100:00080000:2.0:1746129581.008168:0:7097:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746129581.008384:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16787 00000100:00100000:0.0:1746129581.008393:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+16:32673:x1830948734413696:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:0.0:1746129581.008409:0:7149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129581.008427:0:7149:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a6caee00/0x40a459093b06b8d1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f22206 expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129581.008456:0:7149:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fc59200/0x40a459093b06b344 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21df3 expref: 17 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129581.008464:0:7149:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090a18600/0x40a459093b06b3c2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21e55 expref: 7 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129581.008472:0:7149:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091798c00/0x40a459093b06b352 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21e01 expref: 22 pid: 31503 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129581.008478:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129581.008480:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129581.008483:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6caee00/0x40a459093b06b8d1 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [1904640->1998847] (req 1904640->1998847) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22206 expref: 17 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129581.008513:0:7149:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091798c00/0x40a459093b06b352 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21e01 expref: 22 pid: 31503 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129581.008525:0:7149:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091798c00/0x40a459093b06b352 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21e01 expref: 22 pid: 31503 timeout: 936 lvb_type: 1 00000100:00100000:0.0:1746129581.008537:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013145e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7149:1830948737617792:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129581.009180:0:7149:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090a18600/0x40a459093b06b3c2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21e55 expref: 7 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129581.009189:0:7149:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090a18600/0x40a459093b06b3c2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21e55 expref: 7 pid: 8410 timeout: 936 lvb_type: 1 00000100:00100000:0.0:1746129581.009197:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013145fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7149:1830948737617920:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129581.009240:0:7149:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fc59200/0x40a459093b06b344 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21df3 expref: 17 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129581.009248:0:7149:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fc59200/0x40a459093b06b344 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21df3 expref: 17 pid: 8412 timeout: 936 lvb_type: 0 00000100:00100000:0.0:1746129581.009260:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013145ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7149:1830948737618048:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129581.009278:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa381300 going to sleep for 11 seconds 00000100:00100000:0.0:1746129581.012900:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129581.012991:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129581.013187:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734414080 00000100:00100000:1.0:1746129581.013196:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734414080 00010000:00010000:1.0:1746129581.013263:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090a18600/0x40a459093b06b3c2 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21e55 expref: 8 pid: 8410 timeout: 936 lvb_type: 1 00000100:00100000:3.0:1746129581.013264:0:20861:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734413952 00000100:00100000:3.0:1746129581.013269:0:20861:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734413952 00000100:00100000:1.0:1746129581.013312:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8693 00000100:00100000:3.0:1746129581.013315:0:20861:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4840 00000100:00100000:1.0:1746129581.013320:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013145d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:068dab75-d300-4ead-a742-d14572ad1e50+8:1961:x1830948734414080:12345-192.168.202.4@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746129581.013322:0:20861:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013145f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:ada2ffba-8920-4ecb-8068-68caa9806978+299:32666:x1830948734413952:12345-192.168.202.4@tcp:35:multiop.0 00010000:00010000:1.0:1746129581.013334:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129581.013357:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090a18600/0x40a459093b06b3c2 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21e55 expref: 8 pid: 8410 timeout: 936 lvb_type: 1 00010000:00010000:1.0:1746129581.013369:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090a18600/0x40a459093b06b3c2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21e55 expref: 8 pid: 8410 timeout: 936 lvb_type: 1 00010000:00010000:1.0:1746129581.013395:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129581.013439:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013145d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:068dab75-d300-4ead-a742-d14572ad1e50+8:1961:x1830948734414080:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 120us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129581.013446:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8693 00000100:00080000:2.0:1746129581.013675:0:7097:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1746129581.013681:0:7097:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746129581.014050:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013145e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7149:1830948737617792:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129581.014313:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090a18600/0x40a459093b06b3c2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21e55 expref: 7 pid: 8410 timeout: 936 lvb_type: 1 00000100:00100000:1.0:1746129581.014333:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013145fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7149:1830948737617920:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129581.014345:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013145ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7149:1830948737618048:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129581.014441:0:7149:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a6caee00/0x40a459093b06b8d1 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [1904640->1998847] (req 1904640->1998847) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22206 expref: 17 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129581.014451:0:7149:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6caee00, rc 0) 00000100:00100000:1.0:1746129581.014472:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+17:32673:x1830948734413696:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 6081us (6948us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129581.014479:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16787 00000100:00100000:3.0:1746129581.014816:0:20861:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013145f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:ada2ffba-8920-4ecb-8068-68caa9806978+300:32666:x1830948734413952:12345-192.168.202.4@tcp:35:multiop.0 Request processed in 1493us (1925us total) trans 8589945473 rc 0/0 00000100:00100000:3.0:1746129581.014825:0:20861:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4840 00000100:00100000:0.0:1746129581.015078:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129581.015116:0:7086:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734414208 00000100:00100000:0.0:1746129581.015121:0:7086:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734414208 00010000:00010000:0.0:1746129581.015146:0:7086:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fc59200/0x40a459093b06b344 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21df3 expref: 17 pid: 8412 timeout: 936 lvb_type: 0 00000100:00100000:0.0:1746129581.015167:0:7086:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8694 00000100:00100000:0.0:1746129581.015173:0:7086:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013145d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+17:1961:x1830948734414208:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129581.015184:0:7086:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129581.015203:0:7086:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fc59200/0x40a459093b06b344 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21df3 expref: 17 pid: 8412 timeout: 936 lvb_type: 0 00010000:00010000:0.0:1746129581.015213:0:7086:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fc59200/0x40a459093b06b344 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21df3 expref: 17 pid: 8412 timeout: 936 lvb_type: 0 00010000:00010000:0.0:1746129581.015247:0:7086:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fc59200/0x40a459093b06b344 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21df3 expref: 17 pid: 8412 timeout: 936 lvb_type: 0 00010000:00010000:0.0:1746129581.015261:0:7086:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129581.015555:0:7086:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013145d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+16:1961:x1830948734414208:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 382us (1262us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129581.015561:0:7086:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8694 00000100:00100000:0.0:1746129581.015614:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129581.015710:0:7086:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734414336 00000100:00100000:1.0:1746129581.015718:0:7086:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734414336 00010000:00010000:1.0:1746129581.015752:0:7086:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091798c00/0x40a459093b06b352 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21e01 expref: 23 pid: 31503 timeout: 936 lvb_type: 1 00000100:00100000:1.0:1746129581.015819:0:7086:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8695 00000100:00100000:1.0:1746129581.015825:0:7086:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013145f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ada2ffba-8920-4ecb-8068-68caa9806978+23:1963:x1830948734414336:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129581.015832:0:7086:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129581.015842:0:7086:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091798c00/0x40a459093b06b352 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21e01 expref: 23 pid: 31503 timeout: 936 lvb_type: 1 00010000:00010000:1.0:1746129581.015850:0:7086:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091798c00/0x40a459093b06b352 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21e01 expref: 23 pid: 31503 timeout: 936 lvb_type: 1 00010000:00010000:1.0:1746129581.015861:0:7086:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091798c00/0x40a459093b06b352 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21e01 expref: 23 pid: 31503 timeout: 936 lvb_type: 1 00010000:00010000:1.0:1746129581.015872:0:7086:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129581.015874:0:7086:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129581.015880:0:7086:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a6caee00/0x40a459093b06b8d1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1904640->1998847) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22206 expref: 15 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129581.015887:0:7086:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6caee00/0x40a459093b06b8d1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1904640->1998847) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22206 expref: 15 pid: 7149 timeout: 0 lvb_type: 0 00000100:00080000:3.0:1746129581.015908:0:7097:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1746129581.015916:0:7086:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a6caee00/0x40a459093b06b8d1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1904640->1998847) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22206 expref: 15 pid: 7149 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129581.016433:0:7086:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b552d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7086:1830948737618176:192.168.202.4@tcp:105: 00000100:00100000:1.0:1746129581.017319:0:7086:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130fc9780 going to sleep for 11 seconds 00000100:00100000:0.0:1746129581.019785:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129581.019937:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129581.020073:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734414464 00000100:00100000:1.0:1746129581.020084:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734414464 00000100:00100000:1.0:1746129581.020139:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16788 00000100:00100000:1.0:1746129581.020147:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013145ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ada2ffba-8920-4ecb-8068-68caa9806978+23:1961:x1830948734414464:12345-192.168.202.4@tcp:101:cat.0 00000100:00100000:3.0:1746129581.020152:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734414720 00000100:00100000:3.0:1746129581.020157:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734414720 00010000:00010000:1.0:1746129581.020169:0:7149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00100000:3.0:1746129581.020188:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ee:0x0] (1904640->1908735) req@ffff88013145fb80 x1830948734414720/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:322/0 lens 488/0 e 0 to 0 dl 1746129592 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00010000:00010000:1.0:1746129581.020189:0:7149:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fe41600/0x40a459093b06b8d8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2220d expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00002000:00100000:3.0:1746129581.020197:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013145fb80 with x1830948734414720 ext(1904640->1908735) 00002000:00010000:3.0:1746129581.020202:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013145fb80 00000100:00100000:3.0:1746129581.020218:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8168 00000100:00100000:3.0:1746129581.020233:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013145fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+16:1963:x1830948734414720:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:1.0:1746129581.020260:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b552a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7149:1830948737618304:192.168.202.4@tcp:106: 00000100:00100000:2.0:1746129581.020277:0:7086:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b552d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7086:1830948737618176:192.168.202.4@tcp:105: 00010000:00010000:2.0:1746129581.020318:0:7086:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129581.020344:0:7086:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013145f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ada2ffba-8920-4ecb-8068-68caa9806978+24:1963:x1830948734414336:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 4518us (4727us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129581.020353:0:7086:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8695 00000100:00100000:1.0:1746129581.020356:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130fc90c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746129581.021128:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013145fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+16:1963:x1830948734414720:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 902us (1188us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129581.021135:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8168 00002000:00100000:3.0:1746129581.021141:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ee:0x0] (1904640->1908735) req@ffff88013145fb80 x1830948734414720/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:322/0 lens 488/4536 e 0 to 0 dl 1746129592 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129581.021150:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013145fb80 with x1830948734414720 ext(1904640->1908735) 00002000:00010000:3.0:1746129581.021263:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013145fb80 00002000:00010000:1.0:1746129581.022149:0:7149:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb mtime: 1746129579 -> 1746129581 00002000:00010000:1.0:1746129581.022153:0:7149:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb atime: 1746129579 -> 1746129581 00002000:00010000:1.0:1746129581.022156:0:7149:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb ctime: 1746129579 -> 1746129581 00000100:00100000:1.0:1746129581.022176:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b552a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7149:1830948737618304:192.168.202.4@tcp:106: 00010000:00010000:1.0:1746129581.022205:0:7149:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fe41600/0x40a459093b06b8d8 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2220d expref: 23 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129581.022217:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fe41600/0x40a459093b06b8d8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2220d expref: 23 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129581.022240:0:7149:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe41600, rc 0) 00000100:00100000:1.0:1746129581.022663:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013145ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ada2ffba-8920-4ecb-8068-68caa9806978+22:1961:x1830948734414464:12345-192.168.202.4@tcp:101:cat.0 Request processed in 2514us (2886us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129581.022670:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16788 00000100:00100000:0.0:1746129581.025157:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129581.025589:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129581.025667:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734414976 00000100:00100000:3.0:1746129581.025676:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734414976 00002000:00100000:3.0:1746129581.025722:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ee:0x0] (1994752->1998847) req@ffff88013145e300 x1830948734414976/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:322/0 lens 488/0 e 0 to 0 dl 1746129592 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129581.025732:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013145e300 with x1830948734414976 ext(1994752->1998847) 00002000:00010000:3.0:1746129581.025738:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013145e300 00000100:00100000:3.0:1746129581.025760:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8169 00000100:00100000:3.0:1746129581.025766:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013145e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+16:1962:x1830948734414976:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:1.0:1746129581.025862:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734415104 00000100:00100000:1.0:1746129581.025866:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734415104 00000100:00100000:1.0:1746129581.025898:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16789 00000100:00100000:1.0:1746129581.025903:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a77b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ada2ffba-8920-4ecb-8068-68caa9806978+22:1960:x1830948734415104:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129581.025914:0:7149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129581.025931:0:7149:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fe41000/0x40a459093b06b8df lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f22214 expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129581.025982:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b552a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7149:1830948737618432:192.168.202.4@tcp:106: 00000100:00100000:1.0:1746129581.026064:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130fc90c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746129581.026886:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013145e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+16:1962:x1830948734414976:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 1116us (1743us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129581.026895:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8169 00002000:00100000:3.0:1746129581.026903:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ee:0x0] (1994752->1998847) req@ffff88013145e300 x1830948734414976/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:322/0 lens 488/4536 e 0 to 0 dl 1746129592 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129581.026910:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013145e300 with x1830948734414976 ext(1994752->1998847) 00002000:00010000:3.0:1746129581.026914:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013145e300 00000100:00100000:1.0:1746129581.027505:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b552a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7149:1830948737618432:192.168.202.4@tcp:106: 00010000:00010000:1.0:1746129581.027539:0:7149:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fe41000/0x40a459093b06b8df lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22214 expref: 23 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129581.027559:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fe41000/0x40a459093b06b8df lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22214 expref: 23 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129581.027570:0:7149:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe41000, rc 0) 00000100:00100000:1.0:1746129581.027598:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a77b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ada2ffba-8920-4ecb-8068-68caa9806978+22:1960:x1830948734415104:12345-192.168.202.4@tcp:101:cat.0 Request processed in 1694us (2009us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129581.027604:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16789 00000100:00100000:0.0:1746129581.031637:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129581.031747:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734415232 00000100:00100000:1.0:1746129581.031757:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734415232 00000100:00100000:1.0:1746129581.031805:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16790 00000100:00100000:1.0:1746129581.031812:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c29e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ada2ffba-8920-4ecb-8068-68caa9806978+22:1963:x1830948734415232:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129581.031832:0:7149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129581.031850:0:7149:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fe40800/0x40a459093b06b8e6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2221b expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129581.031911:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b552a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7149:1830948737618560:192.168.202.4@tcp:106: 00000100:00100000:1.0:1746129581.032012:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130fc90c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746129581.034191:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b552a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7149:1830948737618560:192.168.202.4@tcp:106: 00010000:00010000:1.0:1746129581.034241:0:7149:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fe40800/0x40a459093b06b8e6 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2221b expref: 23 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129581.034256:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fe40800/0x40a459093b06b8e6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2221b expref: 23 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129581.034290:0:7149:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe40800, rc 0) 00000100:00100000:1.0:1746129581.034360:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c29e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ada2ffba-8920-4ecb-8068-68caa9806978+22:1963:x1830948734415232:12345-192.168.202.4@tcp:101:cat.0 Request processed in 2547us (2734us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129581.034369:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16790 00000100:00100000:0.0:1746129581.093087:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129581.093150:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129581.093265:0:8412:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734415488 00000100:00100000:2.0:1746129581.093276:0:8412:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734415488 00000100:00100000:2.0:1746129581.093374:0:8412:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734415360 00000100:00100000:2.0:1746129581.093377:0:8412:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734415360 00000100:00100000:2.0:1746129581.093397:0:8412:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16791 00000100:00100000:2.0:1746129581.093404:0:8412:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a77b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:1961:x1830948734415488:12345-192.168.202.4@tcp:101:cat.0 00000100:00100000:1.0:1746129581.093418:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16792 00010000:00010000:2.0:1746129581.093419:0:8412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129581.093434:0:8412:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c63f200/0x40a459093b06b8ed lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f22229 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129581.093435:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a77b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:1961:x1830948734415360:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129581.093449:0:7149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129581.093463:0:7149:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fe41800/0x40a459093b06b8f4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f22222 expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129581.093481:0:8412:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e388700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8412:1830948737618688:192.168.202.4@tcp:106: 00000100:00100000:1.0:1746129581.093504:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b551880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7149:1830948737618816:192.168.202.4@tcp:106: 00000100:00100000:2.0:1746129581.093814:0:8412:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094a84b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746129581.093830:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130fc90c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746129581.095954:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b551880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7149:1830948737618816:192.168.202.4@tcp:106: 00010000:00010000:1.0:1746129581.095981:0:7149:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fe41800/0x40a459093b06b8f4 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22222 expref: 23 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129581.095994:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fe41800/0x40a459093b06b8f4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22222 expref: 23 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129581.097134:0:7149:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe41800, rc 0) 00000100:00100000:1.0:1746129581.097308:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a77b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+22:1961:x1830948734415360:12345-192.168.202.4@tcp:101:cat.0 Request processed in 3864us (4144us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129581.097316:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16792 00002000:00010000:2.0:1746129581.097541:0:8412:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb mtime: 1746129580 -> 1746129581 00002000:00010000:2.0:1746129581.097544:0:8412:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb atime: 1746129580 -> 1746129581 00002000:00010000:2.0:1746129581.097546:0:8412:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb ctime: 1746129580 -> 1746129581 00000100:00100000:2.0:1746129581.097559:0:8412:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e388700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8412:1830948737618688:192.168.202.4@tcp:106: 00010000:00010000:2.0:1746129581.097577:0:8412:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c63f200/0x40a459093b06b8ed lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22229 expref: 21 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129581.097587:0:8412:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c63f200/0x40a459093b06b8ed lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22229 expref: 21 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129581.097612:0:8412:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c63f200, rc 0) 00000100:00100000:2.0:1746129581.097634:0:8412:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a77b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:1961:x1830948734415488:12345-192.168.202.4@tcp:101:cat.0 Request processed in 4230us (4566us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129581.097639:0:8412:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16791 00000100:00100000:0.0:1746129581.102511:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129581.103163:0:8412:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734415616 00000100:00100000:2.0:1746129581.103173:0:8412:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734415616 00000100:00100000:2.0:1746129581.103440:0:8412:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16793 00000100:00100000:2.0:1746129581.103449:0:8412:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a77b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:32679:x1830948734415616:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129581.103469:0:8412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129581.103487:0:8412:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c63e200/0x40a459093b06b8fb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f22230 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129581.103517:0:8412:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f845e00/0x40a459093b06b8a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1564672->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f221ea expref: 27 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129581.103524:0:8412:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129581.103526:0:8412:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129581.103529:0:8412:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c63e200/0x40a459093b06b8fb lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22230 expref: 21 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129581.103556:0:8412:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f845e00/0x40a459093b06b8a7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1564672->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f221ea expref: 27 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129581.103567:0:8412:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f845e00/0x40a459093b06b8a7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1564672->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f221ea expref: 27 pid: 7149 timeout: 936 lvb_type: 0 00000100:00100000:2.0:1746129581.103584:0:8412:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e388700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8412:1830948737618944:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129581.103669:0:8412:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094a84b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746129581.106595:0:8412:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e388700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8412:1830948737618944:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129581.106629:0:8412:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c63e200/0x40a459093b06b8fb lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22230 expref: 21 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129581.106644:0:8412:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c63e200, rc 0) 00000100:00100000:2.0:1746129581.106697:0:8412:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a77b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:32679:x1830948734415616:12345-192.168.202.4@tcp:101:cat.0 Request processed in 3248us (4194us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129581.106706:0:8412:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16793 00000100:00100000:0.0:1746129581.107266:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129581.107561:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734415744 00000100:00100000:3.0:1746129581.107570:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734415744 00002000:00100000:3.0:1746129581.107631:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f3:0x0] (1564672->2097151) req@ffff8800a77b0000 x1830948734415744/t0(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:322/0 lens 488/0 e 0 to 0 dl 1746129592 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129581.107640:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a77b0000 with x1830948734415744 ext(1564672->2097151) 00010000:00010000:3.0:1746129581.107648:0:25745:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f845e00/0x40a459093b06b8a7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1564672->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f221ea expref: 28 pid: 7149 timeout: 936 lvb_type: 0 00010000:00010000:3.0:1746129581.107661:0:25745:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f845e00/0x40a459093b06b8a7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1564672->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f221ea expref: 28 pid: 7149 timeout: 936 lvb_type: 0 00002000:00010000:3.0:1746129581.107668:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a77b0000 00000100:00100000:3.0:1746129581.107698:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2523 00000100:00100000:3.0:1746129581.107705:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a77b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+28:1962:x1830948734415744:12345-192.168.202.4@tcp:4:cat.0 00000100:00080000:0.0:1746129581.107758:0:7097:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746129581.114603:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a77b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+30:1962:x1830948734415744:12345-192.168.202.4@tcp:4:cat.0 Request processed in 6886us (7326us total) trans 17179874181 rc 0/0 00000100:00100000:3.0:1746129581.114616:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2523 00002000:00100000:3.0:1746129581.114627:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f3:0x0] (1564672->2097151) req@ffff8800a77b0000 x1830948734415744/t17179874181(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:322/0 lens 488/448 e 0 to 0 dl 1746129592 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129581.114636:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a77b0000 with x1830948734415744 ext(1564672->2097151) 00010000:00010000:3.0:1746129581.114646:0:25745:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f845e00/0x40a459093b06b8a7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1564672->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f221ea expref: 30 pid: 7149 timeout: 936 lvb_type: 0 00010000:00010000:3.0:1746129581.114659:0:25745:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f845e00/0x40a459093b06b8a7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1564672->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f221ea expref: 30 pid: 7149 timeout: 936 lvb_type: 0 00002000:00010000:3.0:1746129581.114666:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a77b0000 00000100:00100000:0.0:1746129581.118274:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129581.118490:0:7086:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734415872 00000100:00100000:2.0:1746129581.118500:0:7086:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734415872 00010000:00010000:2.0:1746129581.118538:0:7086:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f845e00/0x40a459093b06b8a7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1564672->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f221ea expref: 30 pid: 7149 timeout: 936 lvb_type: 0 00000100:00100000:2.0:1746129581.118580:0:7086:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8696 00000100:00100000:2.0:1746129581.118588:0:7086:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a77b3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ada2ffba-8920-4ecb-8068-68caa9806978+30:1963:x1830948734415872:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129581.118602:0:7086:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129581.118625:0:7086:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f845e00/0x40a459093b06b8a7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1564672->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f221ea expref: 30 pid: 7149 timeout: 936 lvb_type: 0 00010000:00010000:2.0:1746129581.118637:0:7086:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f845e00/0x40a459093b06b8a7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1564672->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f221ea expref: 30 pid: 7149 timeout: 936 lvb_type: 0 00010000:00010000:2.0:1746129581.118664:0:7086:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f845e00/0x40a459093b06b8a7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1564672->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f221ea expref: 30 pid: 7149 timeout: 936 lvb_type: 0 00010000:00010000:2.0:1746129581.118827:0:7086:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129581.118829:0:7086:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129581.118837:0:7086:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c63e200/0x40a459093b06b8fb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22230 expref: 20 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129581.118846:0:7086:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c63e200/0x40a459093b06b8fb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22230 expref: 20 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129581.118878:0:7086:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009c63e200/0x40a459093b06b8fb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22230 expref: 20 pid: 8412 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129581.118889:0:7086:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e388700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7086:1830948737619072:192.168.202.4@tcp:105: 00000100:00100000:2.0:1746129581.119393:0:7086:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094a84b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746129581.121430:0:7086:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e388700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7086:1830948737619072:192.168.202.4@tcp:105: 00010000:00010000:2.0:1746129581.121450:0:7086:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129581.121514:0:7086:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a77b3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ada2ffba-8920-4ecb-8068-68caa9806978+29:1963:x1830948734415872:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 2926us (3249us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129581.121524:0:7086:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8696 00000100:00100000:0.0:1746129581.127743:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129581.127882:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734416128 00000100:00100000:3.0:1746129581.127892:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734416128 00002000:00100000:3.0:1746129581.127937:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff8800a77b2680 x1830948734416128/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:322/0 lens 488/0 e 0 to 0 dl 1746129592 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129581.127945:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a77b2680 with x1830948734416128 ext(1048576->2097151) 00002000:00010000:3.0:1746129581.127950:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a77b2680 00000100:00100000:3.0:1746129581.127979:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8170 00000100:00100000:3.0:1746129581.127985:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a77b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:1962:x1830948734416128:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129581.141148:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129581.141411:0:16908:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734416384 00000100:00100000:1.0:1746129581.141421:0:16908:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734416384 00000100:00100000:1.0:1746129581.141478:0:16908:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11350 00000100:00100000:1.0:1746129581.141486:0:16908:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a77b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ada2ffba-8920-4ecb-8068-68caa9806978+300:32681:x1830948734416384:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:1.0:1746129581.141511:0:16908:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129581.141530:0:16908:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe40e00/0x40a459093b06b902 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f22237 expref: -99 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129581.141631:0:16908:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe40c00/0x40a459093b06b909 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129581.141645:0:16908:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe40c00/0x40a459093b06b909 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129581.141655:0:16908:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe40c00/0x40a459093b06b909 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00000004:00200000:1.0:1746129581.141665:0:16908:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00000100:00100000:3.0:1746129581.141686:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a77b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:1962:x1830948734416128:12345-192.168.202.4@tcp:3:cat.0 Request processed in 13700us (13953us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129581.141695:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8170 00002000:00100000:3.0:1746129581.141704:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff8800a77b2680 x1830948734416128/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:322/0 lens 488/440 e 0 to 0 dl 1746129592 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129581.141712:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a77b2680 with x1830948734416128 ext(1048576->2097151) 00002000:00010000:3.0:1746129581.141716:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a77b2680 00010000:00010000:1.0:1746129581.141782:0:16908:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe40e00/0x40a459093b06b902 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22237 expref: 303 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129581.141811:0:16908:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe40c00/0x40a459093b06b909 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22237 expref: 302 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129581.141820:0:16908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:1.0:1746129581.141823:0:16908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746129581.141826:0:16908:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe40c00, rc 0) 00000100:00100000:1.0:1746129581.141859:0:16908:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a77b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ada2ffba-8920-4ecb-8068-68caa9806978+302:32681:x1830948734416384:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 374us (724us total) trans 8589945474 rc 0/0 00000100:00100000:1.0:1746129581.141865:0:16908:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11350 00000100:00100000:0.0:1746129581.153671:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129581.153837:0:8412:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734416512 00000100:00100000:2.0:1746129581.153849:0:8412:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734416512 00000100:00100000:2.0:1746129581.153929:0:8412:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16794 00000100:00100000:2.0:1746129581.153941:0:8412:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a77b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:32679:x1830948734416512:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129581.153967:0:8412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129581.153989:0:8412:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c63fe00/0x40a459093b06b917 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2223e expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129581.154027:0:8412:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f845a00/0x40a459093b06b8b5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1323007) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f221f8 expref: 28 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129581.154035:0:8412:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129581.154037:0:8412:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129581.154041:0:8412:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c63fe00/0x40a459093b06b917 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2223e expref: 22 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129581.154079:0:8412:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f845a00/0x40a459093b06b8b5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1323007) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f221f8 expref: 28 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129581.154093:0:8412:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f845a00/0x40a459093b06b8b5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1323007) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f221f8 expref: 28 pid: 7149 timeout: 936 lvb_type: 0 00000100:00100000:2.0:1746129581.154107:0:8412:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e388700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8412:1830948737619200:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129581.159181:0:8412:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094a84b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746129581.159889:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129581.159967:0:8412:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e388700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8412:1830948737619200:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129581.159997:0:8412:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c63fe00/0x40a459093b06b917 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2223e expref: 22 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129581.160016:0:8412:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c63fe00, rc 0) 00000100:00100000:2.0:1746129581.160058:0:8412:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a77b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+22:32679:x1830948734416512:12345-192.168.202.4@tcp:101:cat.0 Request processed in 6121us (6402us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129581.160067:0:8412:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16794 00000100:00100000:3.0:1746129581.160435:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734416640 00000100:00100000:3.0:1746129581.160442:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734416640 00002000:00100000:3.0:1746129581.160481:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f4:0x0] (1048576->1323007) req@ffff8800a77b1180 x1830948734416640/t0(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:322/0 lens 488/0 e 0 to 0 dl 1746129592 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129581.160489:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a77b1180 with x1830948734416640 ext(1048576->1323007) 00010000:00010000:3.0:1746129581.160496:0:25745:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f845a00/0x40a459093b06b8b5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1323007) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f221f8 expref: 29 pid: 7149 timeout: 936 lvb_type: 0 00010000:00010000:3.0:1746129581.160508:0:25745:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f845a00/0x40a459093b06b8b5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1323007) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f221f8 expref: 29 pid: 7149 timeout: 936 lvb_type: 0 00002000:00010000:3.0:1746129581.160514:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a77b1180 00000100:00100000:3.0:1746129581.160545:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2524 00000100:00100000:3.0:1746129581.160552:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a77b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+29:1960:x1830948734416640:12345-192.168.202.4@tcp:4:cat.0 00000100:00100000:0.0:1746129581.162409:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129581.162444:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129581.162484:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129581.165141:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a77b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+31:1960:x1830948734416640:12345-192.168.202.4@tcp:4:cat.0 Request processed in 4579us (5246us total) trans 17179874182 rc 0/0 00000100:00100000:0.0:1746129581.165154:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2524 00002000:00100000:0.0:1746129581.165167:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f4:0x0] (1048576->1323007) req@ffff8800a77b1180 x1830948734416640/t17179874182(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:322/0 lens 488/448 e 0 to 0 dl 1746129592 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129581.165176:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a77b1180 with x1830948734416640 ext(1048576->1323007) 00010000:00010000:0.0:1746129581.165187:0:25745:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f845a00/0x40a459093b06b8b5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1323007) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f221f8 expref: 31 pid: 7149 timeout: 936 lvb_type: 0 00010000:00010000:0.0:1746129581.165202:0:25745:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f845a00/0x40a459093b06b8b5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1323007) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f221f8 expref: 31 pid: 7149 timeout: 936 lvb_type: 0 00002000:00010000:0.0:1746129581.165214:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a77b1180 00000100:00100000:3.0:1746129581.165784:0:20577:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734416768 00000100:00100000:3.0:1746129581.165793:0:20577:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734416768 00000100:00100000:3.0:1746129581.165826:0:20577:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734416896 00000100:00100000:3.0:1746129581.165829:0:20577:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734416896 00000100:00100000:3.0:1746129581.165842:0:20577:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734417024 00000100:00100000:3.0:1746129581.165844:0:20577:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734417024 00000100:00100000:3.0:1746129581.165866:0:20577:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16795 00000100:00100000:3.0:1746129581.165872:0:20577:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a77b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ada2ffba-8920-4ecb-8068-68caa9806978+32:1963:x1830948734416768:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129581.165886:0:20577:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129581.165901:0:20577:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f845e00/0x40a459093b06b91e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f22245 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129581.165921:0:20577:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129581.165922:0:20577:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129581.165930:0:20577:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f845e00/0x40a459093b06b91e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22245 expref: 33 pid: 20577 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129581.165944:0:20577:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f845e00/0x40a459093b06b91e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22245 expref: 33 pid: 20577 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129581.165955:0:20577:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f845e00, rc 0) 00000100:00100000:3.0:1746129581.165980:0:20577:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a77b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ada2ffba-8920-4ecb-8068-68caa9806978+33:1963:x1830948734416768:12345-192.168.202.4@tcp:101:cat.0 Request processed in 108us (3578us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129581.165985:0:20577:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16795 00000100:00100000:3.0:1746129581.165994:0:20577:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16796 00000100:00100000:3.0:1746129581.165998:0:20577:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a77b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ada2ffba-8920-4ecb-8068-68caa9806978+32:1962:x1830948734416896:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129581.166004:0:20577:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129581.166008:0:20577:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f845800/0x40a459093b06b925 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2224c expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129581.166048:0:20577:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20577:1830948737619328:192.168.202.4@tcp:106: 00000100:00100000:3.0:1746129581.166093:0:20577:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5c68780 going to sleep for 11 seconds 00000100:00100000:3.0:1746129581.166114:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16797 00000100:00100000:3.0:1746129581.166119:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a77b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ada2ffba-8920-4ecb-8068-68caa9806978+22:1963:x1830948734417024:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129581.166127:0:7148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129581.166136:0:7148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f844a00/0x40a459093b06b92c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f22253 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129581.166160:0:7148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7148:1830948737619456:192.168.202.4@tcp:106: 00000100:00100000:3.0:1746129581.166180:0:7148:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5c683c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746129581.169256:0:7148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7148:1830948737619456:192.168.202.4@tcp:106: 00000100:00100000:3.0:1746129581.169313:0:20577:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20577:1830948737619328:192.168.202.4@tcp:106: 00010000:00010000:2.0:1746129581.169318:0:7148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f844a00/0x40a459093b06b92c lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22253 expref: 23 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129581.169332:0:7148:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f844a00/0x40a459093b06b92c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22253 expref: 23 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129581.169334:0:20577:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f845800/0x40a459093b06b925 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2224c expref: 33 pid: 20577 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129581.169345:0:20577:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f845800/0x40a459093b06b925 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2224c expref: 33 pid: 20577 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129581.169349:0:7148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f844a00, rc 0) 00010000:00010000:3.0:1746129581.169358:0:20577:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f845800, rc 0) 00000100:00100000:2.0:1746129581.169402:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a77b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ada2ffba-8920-4ecb-8068-68caa9806978+22:1963:x1830948734417024:12345-192.168.202.4@tcp:101:cat.0 Request processed in 3281us (6919us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129581.169412:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16797 00000100:00100000:3.0:1746129581.169439:0:20577:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a77b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ada2ffba-8920-4ecb-8068-68caa9806978+32:1962:x1830948734416896:12345-192.168.202.4@tcp:101:cat.0 Request processed in 3439us (6993us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129581.169445:0:20577:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16796 00000100:00100000:0.0:1746129581.170978:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129581.171681:0:7086:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734417152 00000100:00100000:2.0:1746129581.171691:0:7086:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734417152 00010000:00010000:2.0:1746129581.171733:0:7086:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f845a00/0x40a459093b06b8b5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1323007) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f221f8 expref: 32 pid: 7149 timeout: 936 lvb_type: 0 00000100:00100000:2.0:1746129581.171787:0:7086:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8697 00000100:00100000:2.0:1746129581.171796:0:7086:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a77b0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ada2ffba-8920-4ecb-8068-68caa9806978+32:1961:x1830948734417152:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129581.171814:0:7086:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129581.171840:0:7086:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f845a00/0x40a459093b06b8b5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1323007) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f221f8 expref: 32 pid: 7149 timeout: 936 lvb_type: 0 00010000:00010000:2.0:1746129581.171853:0:7086:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f845a00/0x40a459093b06b8b5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1323007) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f221f8 expref: 32 pid: 7149 timeout: 936 lvb_type: 0 00010000:00010000:2.0:1746129581.171883:0:7086:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f845a00/0x40a459093b06b8b5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1323007) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f221f8 expref: 32 pid: 7149 timeout: 936 lvb_type: 0 00010000:00010000:2.0:1746129581.171899:0:7086:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129581.171901:0:7086:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129581.171908:0:7086:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c63fe00/0x40a459093b06b917 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2223e expref: 21 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129581.171917:0:7086:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c63fe00/0x40a459093b06b917 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2223e expref: 21 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129581.171957:0:7086:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009c63fe00/0x40a459093b06b917 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2223e expref: 21 pid: 8412 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129581.171972:0:7086:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e388700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7086:1830948737619584:192.168.202.4@tcp:105: 00000100:00100000:2.0:1746129581.173679:0:7086:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094a84b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746129581.183091:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129581.183246:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734417408 00000100:00100000:2.0:1746129581.183256:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734417408 00002000:00100000:2.0:1746129581.183469:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff88012cda5500 x1830948734417408/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:322/0 lens 488/0 e 0 to 0 dl 1746129592 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129581.183478:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cda5500 with x1830948734417408 ext(1048576->2097151) 00002000:00010000:2.0:1746129581.183483:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012cda5500 00000100:00100000:3.0:1746129581.184260:0:7086:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e388700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7086:1830948737619584:192.168.202.4@tcp:105: 00010000:00010000:3.0:1746129581.184281:0:7086:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129581.184347:0:7086:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a77b0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ada2ffba-8920-4ecb-8068-68caa9806978+32:1961:x1830948734417152:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 12553us (13373us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129581.184357:0:7086:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8697 00000100:00100000:1.0:1746129581.184758:0:31521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8171 00000100:00100000:1.0:1746129581.184768:0:31521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cda5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ada2ffba-8920-4ecb-8068-68caa9806978+31:1960:x1830948734417408:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129581.189567:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129581.189651:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734417792 00000100:00100000:2.0:1746129581.189661:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734417792 00002000:00100000:2.0:1746129581.189707:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ee:0x0] (1048576->2097151) req@ffff88012cda4380 x1830948734417792/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:322/0 lens 504/0 e 0 to 0 dl 1746129592 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129581.189723:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cda4380 with x1830948734417792 ext(1048576->2097151) 00002000:00010000:2.0:1746129581.189729:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012cda4380 00000100:00100000:2.0:1746129581.189761:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8172 00000100:00100000:2.0:1746129581.189768:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cda4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+16:1962:x1830948734417792:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:1.0:1746129581.190713:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129581.191207:0:21725:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734417920 00000100:00100000:0.0:1746129581.191213:0:21725:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734417920 00002000:00100000:0.0:1746129581.191252:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f4:0x0] (1048576->2097151) req@ffff88012b551880 x1830948734417920/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:322/0 lens 488/0 e 0 to 0 dl 1746129592 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129581.191261:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b551880 with x1830948734417920 ext(1048576->2097151) 00002000:00010000:0.0:1746129581.191265:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b551880 00000100:00100000:0.0:1746129581.191311:0:21725:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8173 00000100:00100000:0.0:1746129581.191318:0:21725:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b551880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+22:1962:x1830948734417920:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:1.0:1746129581.196960:0:31521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cda5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ada2ffba-8920-4ecb-8068-68caa9806978+31:1960:x1830948734417408:12345-192.168.202.4@tcp:3:cat.0 Request processed in 12181us (13868us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129581.196973:0:31521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8171 00002000:00100000:1.0:1746129581.196985:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff88012cda5500 x1830948734417408/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:322/0 lens 488/440 e 0 to 0 dl 1746129592 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129581.196995:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cda5500 with x1830948734417408 ext(1048576->2097151) 00002000:00010000:1.0:1746129581.197001:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012cda5500 00000100:00100000:2.0:1746129581.209283:0:21725:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b551880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+22:1962:x1830948734417920:12345-192.168.202.4@tcp:3:cat.0 Request processed in 17953us (18561us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129581.211258:0:21725:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8173 00002000:00100000:2.0:1746129581.211278:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f4:0x0] (1048576->2097151) req@ffff88012b551880 x1830948734417920/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:322/0 lens 488/440 e 0 to 0 dl 1746129592 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129581.211289:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b551880 with x1830948734417920 ext(1048576->2097151) 00002000:00010000:2.0:1746129581.211308:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b551880 00000100:00100000:1.0:1746129581.221629:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129581.221903:0:20577:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734418048 00000100:00100000:3.0:1746129581.221913:0:20577:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734418048 00000100:00100000:3.0:1746129581.221969:0:20577:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16798 00000100:00100000:3.0:1746129581.221978:0:20577:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b550a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ada2ffba-8920-4ecb-8068-68caa9806978+31:32684:x1830948734418048:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129581.221997:0:20577:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129581.222015:0:20577:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095eec000/0x40a459093b06b933 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2225a expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129581.222041:0:20577:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129581.222043:0:20577:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129581.222050:0:20577:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095eec000/0x40a459093b06b933 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2225a expref: 32 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129581.222064:0:20577:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095eec000/0x40a459093b06b933 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2225a expref: 32 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129581.222075:0:20577:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095eec000, rc 0) 00000100:00100000:3.0:1746129581.222119:0:20577:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b550a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ada2ffba-8920-4ecb-8068-68caa9806978+32:32684:x1830948734418048:12345-192.168.202.4@tcp:101:cat.0 Request processed in 142us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129581.222125:0:20577:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16798 00000100:00100000:3.0:1746129581.223218:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cda4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+16:1962:x1830948734417792:12345-192.168.202.4@tcp:3:cat.0 Request processed in 33446us (33660us total) trans 0 rc 954368/954368 00000100:00100000:3.0:1746129581.223344:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8172 00002000:00100000:3.0:1746129581.223355:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ee:0x0] (1048576->2097151) req@ffff88012cda4380 x1830948734417792/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:322/0 lens 504/440 e 0 to 0 dl 1746129592 ref 1 fl Complete:/200/0 rc 954368/954368 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129581.223366:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cda4380 with x1830948734417792 ext(1048576->2097151) 00002000:00010000:3.0:1746129581.223371:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012cda4380 00000100:00100000:0.0:1746129581.227793:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129581.227902:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734418304 00000100:00100000:3.0:1746129581.227912:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734418304 00002000:00100000:3.0:1746129581.227961:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f4:0x0] (1048576->2097151) req@ffff88012cda4a80 x1830948734418304/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:322/0 lens 488/0 e 0 to 0 dl 1746129592 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129581.227981:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cda4a80 with x1830948734418304 ext(1048576->2097151) 00002000:00010000:3.0:1746129581.227986:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012cda4a80 00000100:00100000:3.0:1746129581.228023:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8174 00000100:00100000:3.0:1746129581.228031:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cda4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+32:1961:x1830948734418304:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:3.0:1746129581.239351:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cda4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+32:1961:x1830948734418304:12345-192.168.202.4@tcp:3:cat.0 Request processed in 11307us (11555us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129581.239365:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8174 00002000:00100000:3.0:1746129581.239377:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f4:0x0] (1048576->2097151) req@ffff88012cda4a80 x1830948734418304/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:322/0 lens 488/440 e 0 to 0 dl 1746129592 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129581.239387:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cda4a80 with x1830948734418304 ext(1048576->2097151) 00002000:00010000:3.0:1746129581.239393:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012cda4a80 00000100:00100000:0.0:1746129581.247060:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129581.247320:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734418432 00000100:00100000:3.0:1746129581.247329:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734418432 00000100:00100000:3.0:1746129581.248152:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16799 00000100:00100000:3.0:1746129581.248164:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cda7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ada2ffba-8920-4ecb-8068-68caa9806978+22:32684:x1830948734418432:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129581.248184:0:7148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129581.248203:0:7148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095eec800/0x40a459093b06b93a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f22261 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129581.248245:0:7148:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a6caee00/0x40a459093b06b8d1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1904640->1998847) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22206 expref: 15 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129581.248252:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129581.248254:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129581.248257:0:7148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095eec800/0x40a459093b06b93a lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22261 expref: 23 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129581.248324:0:7148:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a6caee00/0x40a459093b06b8d1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1904640->1998847) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22206 expref: 15 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129581.248337:0:7148:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a6caee00/0x40a459093b06b8d1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1904640->1998847) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22206 expref: 15 pid: 7149 timeout: 936 lvb_type: 0 00000100:00100000:3.0:1746129581.248349:0:7148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7148:1830948737619712:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129581.248551:0:7148:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5c68780 going to sleep for 11 seconds 00000100:00100000:3.0:1746129581.254208:0:7148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7148:1830948737619712:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129581.254258:0:7148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095eec800/0x40a459093b06b93a lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22261 expref: 23 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129581.254278:0:7148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095eec800, rc 0) 00000100:00100000:3.0:1746129581.254359:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cda7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ada2ffba-8920-4ecb-8068-68caa9806978+23:32684:x1830948734418432:12345-192.168.202.4@tcp:101:cat.0 Request processed in 6198us (7306us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129581.254368:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16799 00000100:00100000:0.0:1746129581.258243:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129581.258762:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734418560 00000100:00100000:3.0:1746129581.258774:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734418560 00002000:00100000:3.0:1746129581.258822:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ee:0x0] (1904640->1998847) req@ffff88012cda4700 x1830948734418560/t0(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:322/0 lens 488/0 e 0 to 0 dl 1746129592 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129581.258832:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cda4700 with x1830948734418560 ext(1904640->1998847) 00010000:00010000:3.0:1746129581.258842:0:25745:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a6caee00/0x40a459093b06b8d1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1904640->1998847) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22206 expref: 16 pid: 7149 timeout: 936 lvb_type: 0 00010000:00010000:3.0:1746129581.258854:0:25745:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a6caee00/0x40a459093b06b8d1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1904640->1998847) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22206 expref: 16 pid: 7149 timeout: 936 lvb_type: 0 00002000:00010000:3.0:1746129581.258861:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012cda4700 00000100:00100000:3.0:1746129581.258896:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2525 00000100:00100000:3.0:1746129581.258903:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cda4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+16:1962:x1830948734418560:12345-192.168.202.4@tcp:4:cat.0 00000100:00100000:3.0:1746129581.267209:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cda4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+18:1962:x1830948734418560:12345-192.168.202.4@tcp:4:cat.0 Request processed in 8293us (8974us total) trans 21474841423 rc 0/0 00000100:00100000:3.0:1746129581.267230:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2525 00002000:00100000:3.0:1746129581.267243:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ee:0x0] (1904640->1998847) req@ffff88012cda4700 x1830948734418560/t21474841423(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:322/0 lens 488/448 e 0 to 0 dl 1746129592 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129581.267252:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cda4700 with x1830948734418560 ext(1904640->1998847) 00010000:00010000:3.0:1746129581.267265:0:25745:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a6caee00/0x40a459093b06b8d1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1904640->1998847) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22206 expref: 18 pid: 7149 timeout: 936 lvb_type: 0 00010000:00010000:3.0:1746129581.267281:0:25745:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a6caee00/0x40a459093b06b8d1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1904640->1998847) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22206 expref: 18 pid: 7149 timeout: 936 lvb_type: 0 00002000:00010000:3.0:1746129581.267287:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012cda4700 00000100:00100000:0.0:1746129581.277760:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129581.277987:0:7086:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734418688 00000100:00100000:3.0:1746129581.277999:0:7086:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734418688 00010000:00010000:3.0:1746129581.278046:0:7086:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6caee00/0x40a459093b06b8d1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1904640->1998847) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22206 expref: 18 pid: 7149 timeout: 936 lvb_type: 0 00000100:00100000:3.0:1746129581.278100:0:7086:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8698 00000100:00100000:3.0:1746129581.278109:0:7086:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cda5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+18:1963:x1830948734418688:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129581.278124:0:7086:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129581.278151:0:7086:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a6caee00/0x40a459093b06b8d1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1904640->1998847) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22206 expref: 18 pid: 7149 timeout: 936 lvb_type: 0 00010000:00010000:3.0:1746129581.278164:0:7086:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a6caee00/0x40a459093b06b8d1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1904640->1998847) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22206 expref: 18 pid: 7149 timeout: 936 lvb_type: 0 00010000:00010000:3.0:1746129581.278202:0:7086:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a6caee00/0x40a459093b06b8d1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1904640->1998847) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22206 expref: 18 pid: 7149 timeout: 936 lvb_type: 0 00010000:00010000:3.0:1746129581.278252:0:7086:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129581.278255:0:7086:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129581.278264:0:7086:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880095eec800/0x40a459093b06b93a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22261 expref: 22 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129581.278274:0:7086:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095eec800/0x40a459093b06b93a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22261 expref: 22 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129581.278870:0:7086:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880095eec800/0x40a459093b06b93a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22261 expref: 22 pid: 7148 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129581.278894:0:7086:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7086:1830948737619840:192.168.202.4@tcp:105: 00000100:00100000:3.0:1746129581.279034:0:7086:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5c68780 going to sleep for 11 seconds 00000100:00100000:0.0:1746129581.290539:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129581.290610:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734418816 00000100:00100000:3.0:1746129581.290619:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734418816 00000100:00100000:3.0:1746129581.290681:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16800 00000100:00100000:3.0:1746129581.290689:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cda4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+18:32687:x1830948734418816:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:3.0:1746129581.290709:0:7148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129581.290725:0:7148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880132edde00/0x40a459093b06b941 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f22268 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129581.290754:0:7148:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095eec800/0x40a459093b06b93a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22261 expref: 22 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129581.290762:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129581.290763:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129581.290767:0:7148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880132edde00/0x40a459093b06b941 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [1204224->1347583] (req 1204224->1347583) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22268 expref: 19 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129581.290795:0:7148:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095eec800/0x40a459093b06b93a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22261 expref: 22 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129581.290805:0:7148:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095eec800/0x40a459093b06b93a lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22261 expref: 22 pid: 7148 timeout: 936 lvb_type: 0 00000100:00100000:3.0:1746129581.290816:0:7148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7148:1830948737619968:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129581.292440:0:7148:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5c68900 going to sleep for 11 seconds 00000100:00100000:0.0:1746129581.294720:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129581.294839:0:7086:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7086:1830948737619840:192.168.202.4@tcp:105: 00010000:00010000:3.0:1746129581.294863:0:7086:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129581.294905:0:7086:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cda5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+19:1963:x1830948734418688:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 16798us (17157us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129581.294915:0:7086:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8698 00000100:00100000:2.0:1746129581.295032:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734419072 00000100:00100000:2.0:1746129581.295040:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734419072 00002000:00100000:2.0:1746129581.295080:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ee:0x0] (1048576->2097151) req@ffff88012cda6680 x1830948734419072/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:322/0 lens 488/0 e 0 to 0 dl 1746129592 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129581.295090:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cda6680 with x1830948734419072 ext(1048576->2097151) 00010000:00010000:2.0:1746129581.295100:0:25745:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880095eec800/0x40a459093b06b93a lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22261 expref: 23 pid: 7148 timeout: 936 lvb_type: 0 00010000:00010000:2.0:1746129581.295114:0:25745:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880095eec800/0x40a459093b06b93a lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22261 expref: 23 pid: 7148 timeout: 936 lvb_type: 0 00002000:00010000:2.0:1746129581.295120:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012cda6680 00000100:00100000:2.0:1746129581.295149:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2526 00000100:00100000:2.0:1746129581.295157:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cda6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+23:1963:x1830948734419072:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:3.0:1746129581.295510:0:7148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7148:1830948737619968:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129581.295529:0:7148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880132edde00/0x40a459093b06b941 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1204224->1347583] (req 1204224->1347583) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22268 expref: 18 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129581.295545:0:7148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132edde00, rc 0) 00000100:00100000:3.0:1746129581.295770:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cda4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+18:32687:x1830948734418816:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 5081us (5241us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129581.295778:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16800 00000100:00100000:2.0:1746129581.305489:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cda6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+23:1963:x1830948734419072:12345-192.168.202.4@tcp:3:cat.0 Request processed in 10321us (10766us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129581.305501:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2526 00002000:00100000:2.0:1746129581.305512:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ee:0x0] (1048576->2097151) req@ffff88012cda6680 x1830948734419072/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:322/0 lens 488/440 e 0 to 0 dl 1746129592 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129581.305522:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cda6680 with x1830948734419072 ext(1048576->2097151) 00010000:00010000:2.0:1746129581.305532:0:25745:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880095eec800/0x40a459093b06b93a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22261 expref: 23 pid: 7148 timeout: 936 lvb_type: 0 00010000:00010000:2.0:1746129581.305545:0:25745:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880095eec800/0x40a459093b06b93a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22261 expref: 23 pid: 7148 timeout: 936 lvb_type: 0 00002000:00010000:2.0:1746129581.305552:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012cda6680 00000100:00100000:0.0:1746129581.318022:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129581.318105:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734419200 00000100:00100000:3.0:1746129581.318117:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734419200 00000100:00100000:3.0:1746129581.318182:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16801 00000100:00100000:3.0:1746129581.318191:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cda7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ada2ffba-8920-4ecb-8068-68caa9806978+23:1963:x1830948734419200:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129581.318211:0:7148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129581.318241:0:7148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880132edc800/0x40a459093b06b948 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2226f expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129581.318266:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129581.318278:0:7148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880132edc800/0x40a459093b06b948 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2226f expref: 24 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129581.318333:0:7148:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880132edc800/0x40a459093b06b948 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2226f expref: 24 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129581.318363:0:7148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132edc800, rc 0) 00000100:00100000:3.0:1746129581.318419:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cda7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ada2ffba-8920-4ecb-8068-68caa9806978+23:1963:x1830948734419200:12345-192.168.202.4@tcp:101:cat.0 Request processed in 230us (408us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129581.318424:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16801 00000100:00100000:0.0:1746129581.321053:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129581.321882:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129581.322027:0:7086:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734419456 00000100:00100000:2.0:1746129581.322037:0:7086:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734419456 00010000:00010000:2.0:1746129581.322077:0:7086:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095eec800/0x40a459093b06b93a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22261 expref: 23 pid: 7148 timeout: 936 lvb_type: 0 00000100:00100000:2.0:1746129581.322108:0:7086:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8699 00000100:00100000:2.0:1746129581.322115:0:7086:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6ce1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ada2ffba-8920-4ecb-8068-68caa9806978+23:1960:x1830948734419456:12345-192.168.202.4@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746129581.322118:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734419328 00000100:00100000:3.0:1746129581.322123:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734419328 00010000:00010000:2.0:1746129581.322130:0:7086:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129581.322154:0:7086:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095eec800/0x40a459093b06b93a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22261 expref: 24 pid: 7148 timeout: 936 lvb_type: 0 00010000:00010000:2.0:1746129581.322171:0:7086:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095eec800/0x40a459093b06b93a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22261 expref: 24 pid: 7148 timeout: 936 lvb_type: 0 00010000:00010000:2.0:1746129581.322194:0:7086:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095eec800/0x40a459093b06b93a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22261 expref: 24 pid: 7148 timeout: 936 lvb_type: 0 00000100:00100000:3.0:1746129581.323329:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16802 00000100:00100000:3.0:1746129581.323338:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cda5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ada2ffba-8920-4ecb-8068-68caa9806978+23:1962:x1830948734419328:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129581.323355:0:7148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129581.323369:0:7148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880132edc000/0x40a459093b06b94f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f22276 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129581.323389:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129581.323398:0:7148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880132edc000/0x40a459093b06b94f lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22276 expref: 24 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129581.323407:0:7148:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880132edc000/0x40a459093b06b94f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22276 expref: 24 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129581.323416:0:7148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132edc000, rc 0) 00000100:00100000:3.0:1746129581.323473:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cda5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ada2ffba-8920-4ecb-8068-68caa9806978+23:1962:x1830948734419328:12345-192.168.202.4@tcp:101:cat.0 Request processed in 137us (2431us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129581.323482:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16802 00010000:00010000:2.0:1746129581.323587:0:7086:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129581.323590:0:7086:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129581.323598:0:7086:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880132edde00/0x40a459093b06b941 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1204224->1347583) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22268 expref: 17 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129581.323607:0:7086:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880132edde00/0x40a459093b06b941 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1204224->1347583) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22268 expref: 17 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129581.323643:0:7086:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880132edde00/0x40a459093b06b941 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1204224->1347583) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22268 expref: 17 pid: 7148 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129581.323655:0:7086:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e38b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7086:1830948737620096:192.168.202.4@tcp:105: 00000100:00100000:2.0:1746129581.323720:0:7086:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094a84d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746129581.324866:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129581.325237:0:20577:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734419584 00000100:00100000:1.0:1746129581.325246:0:20577:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734419584 00000100:00100000:2.0:1746129581.325510:0:7086:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e38b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7086:1830948737620096:192.168.202.4@tcp:105: 00010000:00010000:2.0:1746129581.325529:0:7086:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129581.325564:0:7086:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6ce1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ada2ffba-8920-4ecb-8068-68caa9806978+23:1960:x1830948734419456:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 3449us (3683us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129581.325574:0:7086:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8699 00000100:00100000:1.0:1746129581.325618:0:20577:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16803 00000100:00100000:1.0:1746129581.325626:0:20577:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cda7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ada2ffba-8920-4ecb-8068-68caa9806978+22:32681:x1830948734419584:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:1.0:1746129581.325639:0:20577:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129581.325651:0:20577:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fe41a00/0x40a459093b06b956 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2227d expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129581.325673:0:20577:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880132edde00/0x40a459093b06b941 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1204224->1347583) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22268 expref: 17 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129581.325680:0:20577:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129581.325682:0:20577:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129581.325684:0:20577:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fe41a00/0x40a459093b06b956 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1875968->2097151] (req 1875968->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2227d expref: 23 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129581.325711:0:20577:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880132edde00/0x40a459093b06b941 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1204224->1347583) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22268 expref: 17 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129581.325723:0:20577:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880132edde00/0x40a459093b06b941 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1204224->1347583) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22268 expref: 17 pid: 7148 timeout: 936 lvb_type: 0 00000100:00100000:1.0:1746129581.325734:0:20577:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b552300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20577:1830948737620224:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129581.325792:0:20577:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130fc90c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129581.326207:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129581.326612:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129581.326677:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734419712 00000100:00100000:3.0:1746129581.326682:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734419712 00000100:00100000:2.0:1746129581.326691:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734419968 00000100:00100000:2.0:1746129581.326696:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734419968 00000100:00100000:3.0:1746129581.326708:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16804 00000100:00100000:3.0:1746129581.326713:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cda6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ada2ffba-8920-4ecb-8068-68caa9806978+24:1960:x1830948734419712:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129581.326721:0:7148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00100000:2.0:1746129581.326723:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ee:0x0] (1204224->1208319) req@ffff88012cda4e00 x1830948734419968/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:322/0 lens 488/0 e 0 to 0 dl 1746129592 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00010000:00010000:3.0:1746129581.326729:0:7148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880132edda00/0x40a459093b06b95d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f22284 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00002000:00100000:2.0:1746129581.326733:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cda4e00 with x1830948734419968 ext(1204224->1208319) 00010000:00010000:2.0:1746129581.326740:0:25745:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880132edde00/0x40a459093b06b941 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1204224->1347583) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22268 expref: 18 pid: 7148 timeout: 936 lvb_type: 0 00010000:00010000:2.0:1746129581.326749:0:25745:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880132edde00/0x40a459093b06b941 lrc: 6/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1204224->1347583) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22268 expref: 18 pid: 7148 timeout: 936 lvb_type: 0 00002000:00010000:2.0:1746129581.326753:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012cda4e00 00000100:00100000:3.0:1746129581.326762:0:7148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7148:1830948737620352:192.168.202.4@tcp:106: 00000100:00100000:3.0:1746129581.326802:0:7148:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5c68900 going to sleep for 11 seconds 00000100:00100000:2.0:1746129581.326844:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2527 00000100:00100000:2.0:1746129581.326851:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cda4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+18:1962:x1830948734419968:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:2.0:1746129581.327005:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cda4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+18:1962:x1830948734419968:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 154us (393us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129581.327011:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2527 00002000:00100000:2.0:1746129581.327016:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ee:0x0] (1204224->1208319) req@ffff88012cda4e00 x1830948734419968/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:322/0 lens 488/4536 e 0 to 0 dl 1746129592 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129581.327022:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cda4e00 with x1830948734419968 ext(1204224->1208319) 00010000:00010000:2.0:1746129581.327027:0:25745:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880132edde00/0x40a459093b06b941 lrc: 6/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1204224->1347583) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22268 expref: 18 pid: 7148 timeout: 936 lvb_type: 0 00010000:00010000:2.0:1746129581.327036:0:25745:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880132edde00/0x40a459093b06b941 lrc: 6/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1204224->1347583) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22268 expref: 18 pid: 7148 timeout: 936 lvb_type: 0 00002000:00010000:2.0:1746129581.327042:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012cda4e00 00000100:00100000:1.0:1746129581.328487:0:20577:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b552300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20577:1830948737620224:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129581.328579:0:20577:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fe41a00/0x40a459093b06b956 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [1875968->2097151] (req 1875968->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2227d expref: 25 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129581.328592:0:20577:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe41a00, rc 0) 00000100:00100000:1.0:1746129581.328619:0:20577:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cda7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ada2ffba-8920-4ecb-8068-68caa9806978+25:32681:x1830948734419584:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 2995us (3759us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129581.328625:0:20577:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16803 00002000:00010000:3.0:1746129581.328965:0:7148:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb mtime: 1746129581 -> 1746129582 00002000:00010000:3.0:1746129581.328969:0:7148:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb ctime: 1746129581 -> 1746129582 00000100:00100000:3.0:1746129581.328988:0:7148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7148:1830948737620352:192.168.202.4@tcp:106: 00010000:00010000:3.0:1746129581.329009:0:7148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880132edda00/0x40a459093b06b95d lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22284 expref: 24 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129581.329018:0:7148:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880132edda00/0x40a459093b06b95d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22284 expref: 24 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129581.329027:0:7148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132edda00, rc 0) 00000100:00100000:3.0:1746129581.329043:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cda6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ada2ffba-8920-4ecb-8068-68caa9806978+23:1960:x1830948734419712:12345-192.168.202.4@tcp:101:cat.0 Request processed in 2330us (2837us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129581.329047:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16804 00000100:00100000:0.0:1746129581.331010:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129581.331083:0:21725:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734420224 00000100:00100000:1.0:1746129581.331093:0:21725:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734420224 00002000:00100000:1.0:1746129581.331142:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ee:0x0] (1343488->1347583) req@ffff88012cda5f80 x1830948734420224/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:322/0 lens 488/0 e 0 to 0 dl 1746129592 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129581.331152:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cda5f80 with x1830948734420224 ext(1343488->1347583) 00010000:00010000:1.0:1746129581.331161:0:21725:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880132edde00/0x40a459093b06b941 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1204224->1347583) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22268 expref: 18 pid: 7148 timeout: 936 lvb_type: 0 00010000:00010000:1.0:1746129581.331180:0:21725:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880132edde00/0x40a459093b06b941 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1204224->1347583) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22268 expref: 18 pid: 7148 timeout: 936 lvb_type: 0 00002000:00010000:1.0:1746129581.331187:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012cda5f80 00000100:00100000:1.0:1746129581.331516:0:21725:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2528 00000100:00100000:1.0:1746129581.331524:0:21725:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cda5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+18:1960:x1830948734420224:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:1.0:1746129581.331701:0:21725:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cda5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+18:1960:x1830948734420224:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 177us (700us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746129581.331707:0:21725:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2528 00002000:00100000:1.0:1746129581.331712:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ee:0x0] (1343488->1347583) req@ffff88012cda5f80 x1830948734420224/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:322/0 lens 488/4536 e 0 to 0 dl 1746129592 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129581.331718:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cda5f80 with x1830948734420224 ext(1343488->1347583) 00010000:00010000:1.0:1746129581.331723:0:21725:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880132edde00/0x40a459093b06b941 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1204224->1347583) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22268 expref: 18 pid: 7148 timeout: 936 lvb_type: 0 00010000:00010000:1.0:1746129581.331731:0:21725:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880132edde00/0x40a459093b06b941 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1204224->1347583) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22268 expref: 18 pid: 7148 timeout: 936 lvb_type: 0 00002000:00010000:1.0:1746129581.331736:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012cda5f80 00000100:00100000:0.0:1746129581.333742:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129581.333822:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734420480 00000100:00100000:2.0:1746129581.333831:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734420480 00002000:00100000:2.0:1746129581.333873:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ee:0x0] (1204224->1347583) req@ffff88008f44bb80 x1830948734420480/t0(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:322/0 lens 488/0 e 0 to 0 dl 1746129592 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129581.333882:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f44bb80 with x1830948734420480 ext(1204224->1347583) 00010000:00010000:2.0:1746129581.333890:0:25745:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880132edde00/0x40a459093b06b941 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1204224->1347583) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22268 expref: 18 pid: 7148 timeout: 936 lvb_type: 0 00010000:00010000:2.0:1746129581.333902:0:25745:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880132edde00/0x40a459093b06b941 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1204224->1347583) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22268 expref: 18 pid: 7148 timeout: 936 lvb_type: 0 00002000:00010000:2.0:1746129581.333908:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008f44bb80 00000100:00100000:2.0:1746129581.334010:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2529 00000100:00100000:2.0:1746129581.334018:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f44bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+18:1963:x1830948734420480:12345-192.168.202.4@tcp:4:multiop.0 00000100:00100000:2.0:1746129581.341329:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f44bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:1963:x1830948734420480:12345-192.168.202.4@tcp:4:multiop.0 Request processed in 7300us (7582us total) trans 21474841424 rc 0/0 00000100:00100000:2.0:1746129581.341341:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2529 00002000:00100000:2.0:1746129581.341355:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ee:0x0] (1204224->1347583) req@ffff88008f44bb80 x1830948734420480/t21474841424(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:322/0 lens 488/448 e 0 to 0 dl 1746129592 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129581.341364:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f44bb80 with x1830948734420480 ext(1204224->1347583) 00010000:00010000:2.0:1746129581.341374:0:25745:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880132edde00/0x40a459093b06b941 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1204224->1347583) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22268 expref: 20 pid: 7148 timeout: 936 lvb_type: 0 00010000:00010000:2.0:1746129581.341389:0:25745:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880132edde00/0x40a459093b06b941 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1204224->1347583) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22268 expref: 20 pid: 7148 timeout: 936 lvb_type: 0 00002000:00010000:2.0:1746129581.341400:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008f44bb80 00000100:00100000:0.0:1746129581.344396:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129581.344531:0:7086:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734420608 00000100:00100000:2.0:1746129581.344540:0:7086:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734420608 00010000:00010000:2.0:1746129581.344579:0:7086:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880132edde00/0x40a459093b06b941 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1204224->1347583) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22268 expref: 20 pid: 7148 timeout: 936 lvb_type: 0 00000100:00100000:2.0:1746129581.344607:0:7086:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8700 00000100:00100000:2.0:1746129581.344615:0:7086:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f44b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:1961:x1830948734420608:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129581.344629:0:7086:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129581.344650:0:7086:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880132edde00/0x40a459093b06b941 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1204224->1347583) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22268 expref: 20 pid: 7148 timeout: 936 lvb_type: 0 00010000:00010000:2.0:1746129581.344661:0:7086:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880132edde00/0x40a459093b06b941 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1204224->1347583) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22268 expref: 20 pid: 7148 timeout: 936 lvb_type: 0 00010000:00010000:2.0:1746129581.344683:0:7086:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880132edde00/0x40a459093b06b941 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1204224->1347583) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22268 expref: 20 pid: 7148 timeout: 936 lvb_type: 0 00010000:00010000:2.0:1746129581.344716:0:7086:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129581.344718:0:7086:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129581.344725:0:7086:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fe41a00/0x40a459093b06b956 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1875968->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2227d expref: 22 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129581.344733:0:7086:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fe41a00/0x40a459093b06b956 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1875968->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2227d expref: 22 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129581.344771:0:7086:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009fe41a00/0x40a459093b06b956 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1875968->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2227d expref: 22 pid: 20577 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129581.344783:0:7086:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e38b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7086:1830948737620480:192.168.202.4@tcp:105: 00000100:00100000:2.0:1746129581.345838:0:7086:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094a84c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746129581.348028:0:7086:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e38b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7086:1830948737620480:192.168.202.4@tcp:105: 00010000:00010000:2.0:1746129581.348058:0:7086:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129581.348115:0:7086:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f44b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+19:1961:x1830948734420608:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 3499us (3726us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129581.348127:0:7086:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8700 00000100:00100000:0.0:1746129581.348600:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129581.348632:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734420864 00000100:00100000:2.0:1746129581.348638:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734420864 00002000:00100000:2.0:1746129581.348677:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ee:0x0] (1875968->1880063) req@ffff88008f448000 x1830948734420864/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:322/0 lens 488/0 e 0 to 0 dl 1746129592 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129581.348686:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f448000 with x1830948734420864 ext(1875968->1880063) 00002000:00010000:2.0:1746129581.348690:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f448000 00000100:00100000:2.0:1746129581.348711:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8175 00000100:00100000:2.0:1746129581.348716:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f448000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+23:1962:x1830948734420864:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:2.0:1746129581.348875:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f448000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+23:1962:x1830948734420864:12345-192.168.202.4@tcp:3:cat.0 Request processed in 158us (276us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129581.348880:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8175 00002000:00100000:2.0:1746129581.348885:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ee:0x0] (1875968->1880063) req@ffff88008f448000 x1830948734420864/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:322/0 lens 488/4536 e 0 to 0 dl 1746129592 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129581.348897:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f448000 with x1830948734420864 ext(1875968->1880063) 00002000:00010000:2.0:1746129581.348900:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f448000 00000100:00100000:0.0:1746129581.353565:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129581.353736:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734420992 00000100:00100000:3.0:1746129581.353746:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734420992 00000100:00100000:3.0:1746129581.353805:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16805 00000100:00100000:3.0:1746129581.353814:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f448a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ada2ffba-8920-4ecb-8068-68caa9806978+23:32681:x1830948734420992:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:3.0:1746129581.353835:0:7148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129581.353853:0:7148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880132edc600/0x40a459093b06b964 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2228b expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129581.353883:0:7148:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f8d4200/0x40a459093b06b83e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f221ab expref: 24 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129581.353892:0:7148:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012e301800/0x40a459093b06b87d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f221d5 expref: 6 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129581.353899:0:7148:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cdfc200/0x40a459093b06b845 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f221b2 expref: 18 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129581.353905:0:7148:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b4020e00/0x40a459093b06b558 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f21f74 expref: 24 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129581.353912:0:7148:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091545600/0x40a459093b06b57b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21f90 expref: 18 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129581.353918:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746129581.353921:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746129581.353923:0:7148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880132edc600/0x40a459093b06b964 lrc: 8/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 7 type: EXT [2097152->2789375] (req 2097152->2789375) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2228b expref: 24 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129581.353956:0:7148:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091545600/0x40a459093b06b57b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21f90 expref: 18 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129581.353969:0:7148:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091545600/0x40a459093b06b57b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21f90 expref: 18 pid: 4385 timeout: 936 lvb_type: 0 00000100:00100000:3.0:1746129581.353987:0:7148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7148:1830948737620608:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129581.354093:0:7148:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b4020e00/0x40a459093b06b558 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21f74 expref: 24 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129581.354101:0:7148:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b4020e00/0x40a459093b06b558 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21f74 expref: 24 pid: 22480 timeout: 936 lvb_type: 0 00000100:00100000:3.0:1746129581.354109:0:7148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7148:1830948737620736:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129581.354136:0:7148:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009cdfc200/0x40a459093b06b845 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f221b2 expref: 18 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129581.354143:0:7148:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009cdfc200/0x40a459093b06b845 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f221b2 expref: 18 pid: 7148 timeout: 936 lvb_type: 0 00000100:00100000:3.0:1746129581.354150:0:7148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7148:1830948737620864:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129581.354171:0:7148:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012e301800/0x40a459093b06b87d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f221d5 expref: 6 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129581.354178:0:7148:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012e301800/0x40a459093b06b87d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f221d5 expref: 6 pid: 7149 timeout: 936 lvb_type: 1 00000100:00100000:3.0:1746129581.354190:0:7148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7148:1830948737620992:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129581.354209:0:7148:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f8d4200/0x40a459093b06b83e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f221ab expref: 24 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129581.354217:0:7148:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f8d4200/0x40a459093b06b83e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f221ab expref: 24 pid: 8412 timeout: 936 lvb_type: 0 00000100:00100000:3.0:1746129581.354232:0:7148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7148:1830948737621120:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129581.354248:0:7148:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5c68900 going to sleep for 11 seconds 00000100:00100000:3.0:1746129581.356115:0:7148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7148:1830948737620608:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129581.356127:0:7148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7148:1830948737620736:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129581.356133:0:7148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7148:1830948737620864:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129581.356140:0:7148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7148:1830948737620992:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129581.356147:0:7148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7148:1830948737621120:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129581.356182:0:7148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880132edc600/0x40a459093b06b964 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 7 type: EXT [2097152->2789375] (req 2097152->2789375) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2228b expref: 24 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129581.356200:0:7148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132edc600, rc 0) 00000100:00100000:3.0:1746129581.356250:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f448a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ada2ffba-8920-4ecb-8068-68caa9806978+24:32681:x1830948734420992:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 2437us (2696us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129581.356259:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16805 00000100:00100000:0.0:1746129581.360574:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129581.360621:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129581.360656:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129581.360723:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734421248 00000100:00100000:1.0:1746129581.360732:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734421248 00010000:00010000:1.0:1746129581.360772:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4020e00/0x40a459093b06b558 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21f74 expref: 24 pid: 22480 timeout: 936 lvb_type: 0 00000100:00100000:1.0:1746129581.360802:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734421504 00000100:00100000:1.0:1746129581.360805:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734421504 00010000:00010000:1.0:1746129581.360814:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009cdfc200/0x40a459093b06b845 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f221b2 expref: 19 pid: 7148 timeout: 936 lvb_type: 0 00000100:00100000:1.0:1746129581.360825:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734421120 00000100:00100000:1.0:1746129581.360827:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734421120 00010000:00010000:1.0:1746129581.360833:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091545600/0x40a459093b06b57b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21f90 expref: 20 pid: 4385 timeout: 936 lvb_type: 0 00000100:00100000:1.0:1746129581.360849:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8701 00000100:00100000:3.0:1746129581.360856:0:20578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8702 00000100:00100000:1.0:1746129581.360856:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f44b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ada2ffba-8920-4ecb-8068-68caa9806978+24:1963:x1830948734421248:12345-192.168.202.4@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746129581.360864:0:20578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f44aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:1963:x1830948734421504:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129581.360871:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129581.360872:0:20578:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129581.360893:0:20578:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009cdfc200/0x40a459093b06b845 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f221b2 expref: 20 pid: 7148 timeout: 936 lvb_type: 0 00010000:00010000:1.0:1746129581.360893:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b4020e00/0x40a459093b06b558 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 10 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21f74 expref: 24 pid: 22480 timeout: 936 lvb_type: 0 00010000:00010000:3.0:1746129581.360905:0:20578:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009cdfc200/0x40a459093b06b845 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f221b2 expref: 20 pid: 7148 timeout: 936 lvb_type: 0 00000100:00100000:2.0:1746129581.361017:0:7087:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8703 00000100:00100000:2.0:1746129581.361025:0:7087:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f449880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:1963:x1830948734421120:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129581.361033:0:7087:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129581.361082:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b4020e00/0x40a459093b06b558 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 10 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21f74 expref: 24 pid: 22480 timeout: 936 lvb_type: 0 00010000:00010000:3.0:1746129581.361104:0:20578:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cdfc200/0x40a459093b06b845 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f221b2 expref: 20 pid: 7148 timeout: 936 lvb_type: 0 00010000:00010000:1.0:1746129581.361110:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b4020e00/0x40a459093b06b558 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 11 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f21f74 expref: 24 pid: 22480 timeout: 936 lvb_type: 0 00010000:00010000:3.0:1746129581.361129:0:20578:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746129581.361129:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129581.361169:0:20578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f44aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+19:1963:x1830948734421504:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 306us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129581.361169:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f44b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ada2ffba-8920-4ecb-8068-68caa9806978+23:1963:x1830948734421248:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 314us (606us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129581.361175:0:20578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8702 00000100:00100000:1.0:1746129581.361178:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8701 00010000:00010000:2.0:1746129581.361647:0:7087:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091545600/0x40a459093b06b57b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21f90 expref: 18 pid: 4385 timeout: 936 lvb_type: 0 00010000:00010000:2.0:1746129581.361655:0:7087:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091545600/0x40a459093b06b57b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21f90 expref: 18 pid: 4385 timeout: 936 lvb_type: 0 00010000:00010000:2.0:1746129581.361666:0:7087:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091545600/0x40a459093b06b57b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21f90 expref: 18 pid: 4385 timeout: 936 lvb_type: 0 00010000:00010000:2.0:1746129581.361681:0:7087:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129581.361700:0:7087:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f449880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+17:1963:x1830948734421120:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 676us (1042us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129581.361705:0:7087:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8703 00000100:00100000:3.0:1746129581.361870:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129581.362189:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129581.362275:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734421376 00000100:00100000:2.0:1746129581.362281:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734421376 00010000:00010000:2.0:1746129581.362316:0:7087:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012e301800/0x40a459093b06b87d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f221d5 expref: 7 pid: 7149 timeout: 936 lvb_type: 1 00000100:00100000:2.0:1746129581.362332:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734421632 00000100:00100000:2.0:1746129581.362334:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734421632 00010000:00010000:2.0:1746129581.362343:0:7087:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f8d4200/0x40a459093b06b83e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f221ab expref: 23 pid: 8412 timeout: 936 lvb_type: 0 00000100:00100000:2.0:1746129581.362467:0:7087:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8704 00000100:00100000:2.0:1746129581.362474:0:7087:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947bd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:068dab75-d300-4ead-a742-d14572ad1e50+7:1963:x1830948734421376:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129581.362485:0:7087:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129581.362496:0:7087:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012e301800/0x40a459093b06b87d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f221d5 expref: 7 pid: 7149 timeout: 936 lvb_type: 1 00010000:00010000:2.0:1746129581.362504:0:7087:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012e301800/0x40a459093b06b87d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f221d5 expref: 7 pid: 7149 timeout: 936 lvb_type: 1 00010000:00010000:2.0:1746129581.362516:0:7087:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e301800/0x40a459093b06b87d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f221d5 expref: 7 pid: 7149 timeout: 936 lvb_type: 1 00010000:00010000:2.0:1746129581.362526:0:7087:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129581.362547:0:7087:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947bd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:068dab75-d300-4ead-a742-d14572ad1e50+6:1963:x1830948734421376:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 74us (676us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129581.362552:0:7087:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8704 00000100:00100000:2.0:1746129581.362563:0:7087:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8705 00000100:00100000:2.0:1746129581.362568:0:7087:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947bf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ada2ffba-8920-4ecb-8068-68caa9806978+23:1963:x1830948734421632:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129581.362576:0:7087:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129581.362583:0:7087:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f8d4200/0x40a459093b06b83e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f221ab expref: 23 pid: 8412 timeout: 936 lvb_type: 0 00010000:00010000:2.0:1746129581.362591:0:7087:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f8d4200/0x40a459093b06b83e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f221ab expref: 23 pid: 8412 timeout: 936 lvb_type: 0 00010000:00010000:2.0:1746129581.362606:0:7087:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f8d4200/0x40a459093b06b83e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f221ab expref: 23 pid: 8412 timeout: 936 lvb_type: 0 00010000:00010000:2.0:1746129581.362613:0:7087:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129581.362615:0:7087:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129581.362621:0:7087:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880132edc600/0x40a459093b06b964 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2789375) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2228b expref: 22 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129581.362629:0:7087:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880132edc600/0x40a459093b06b964 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2789375) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2228b expref: 22 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129581.362660:0:7087:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880132edc600/0x40a459093b06b964 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2789375) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2228b expref: 22 pid: 7148 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129581.363579:0:7087:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e38b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7087:1830948737621248:192.168.202.4@tcp:105: 00000100:00100000:2.0:1746129581.364097:0:7087:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094a84c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746129581.366005:0:7087:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e38b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7087:1830948737621248:192.168.202.4@tcp:105: 00010000:00010000:2.0:1746129581.366026:0:7087:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129581.366090:0:7087:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947bf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ada2ffba-8920-4ecb-8068-68caa9806978+22:1963:x1830948734421632:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 3520us (3899us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129581.366100:0:7087:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8705 00000100:00100000:0.0:1746129581.370928:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129581.370991:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734421888 00000100:00100000:2.0:1746129581.371000:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734421888 00002000:00100000:2.0:1746129581.371035:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ef:0x0] (2785280->2789375) req@ffff88008f448700 x1830948734421888/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:322/0 lens 488/0 e 0 to 0 dl 1746129592 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129581.371045:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f448700 with x1830948734421888 ext(2785280->2789375) 00002000:00010000:2.0:1746129581.371049:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f448700 00000100:00100000:2.0:1746129581.371072:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8176 00000100:00100000:2.0:1746129581.371077:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f448700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+22:1962:x1830948734421888:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:2.0:1746129581.371240:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f448700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+22:1962:x1830948734421888:12345-192.168.202.4@tcp:3:cat.0 Request processed in 161us (322us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129581.371247:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8176 00002000:00100000:2.0:1746129581.371252:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ef:0x0] (2785280->2789375) req@ffff88008f448700 x1830948734421888/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:322/0 lens 488/4536 e 0 to 0 dl 1746129592 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129581.371258:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f448700 with x1830948734421888 ext(2785280->2789375) 00002000:00010000:2.0:1746129581.371261:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f448700 00000100:00100000:0.0:1746129581.384274:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129581.384376:0:16908:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734422016 00000100:00100000:1.0:1746129581.384388:0:16908:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734422016 00000100:00100000:1.0:1746129581.384452:0:16908:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11351 00000100:00100000:1.0:1746129581.384460:0:16908:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f44b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:068dab75-d300-4ead-a742-d14572ad1e50+18:32692:x1830948734422016:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:1.0:1746129581.384480:0:16908:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129581.384495:0:16908:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe40a00/0x40a459093b06b96b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f22292 expref: -99 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129581.384545:0:16908:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe41400/0x40a459093b06b972 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129581.384555:0:16908:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe41400/0x40a459093b06b972 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129581.384565:0:16908:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe41400/0x40a459093b06b972 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129581.384575:0:16908:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe41200/0x40a459093b06b979 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129581.384581:0:16908:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe41200/0x40a459093b06b979 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129581.384586:0:16908:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe41200/0x40a459093b06b979 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129581.384679:0:16908:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe40600/0x40a459093b06b980 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129581.384689:0:16908:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f845000/0x40a459093b06b8c3 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f221ff expref: 23 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129581.384696:0:16908:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe40c00/0x40a459093b06b909 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22237 expref: 301 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129581.384702:0:16908:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe40600/0x40a459093b06b980 lrc: 5/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129581.384729:0:16908:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe40c00/0x40a459093b06b909 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22237 expref: 301 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129581.384738:0:16908:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe40c00/0x40a459093b06b909 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22237 expref: 301 pid: 16908 timeout: 936 lvb_type: 0 00000100:00100000:1.0:1746129581.384748:0:16908:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b552300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16908:1830948737621376:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129581.384854:0:16908:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f845000/0x40a459093b06b8c3 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f221ff expref: 23 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129581.384862:0:16908:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f845000/0x40a459093b06b8c3 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f221ff expref: 23 pid: 14549 timeout: 936 lvb_type: 0 00000100:00100000:1.0:1746129581.384870:0:16908:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b550380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16908:1830948737621504:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129581.384887:0:16908:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130fc9e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746129581.387773:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129581.387850:0:16908:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b552300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16908:1830948737621376:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129581.387862:0:16908:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b550380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16908:1830948737621504:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129581.387881:0:16908:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe40600/0x40a459093b06b980 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00000100:00100000:0.0:1746129581.388692:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129581.388713:0:20861:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734422272 00000100:00100000:3.0:1746129581.388719:0:20861:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734422272 00000100:00100000:3.0:1746129581.388765:0:20861:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4841 00000100:00100000:3.0:1746129581.388771:0:20861:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f449f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+24:27233:x1830948734422272:12345-192.168.202.4@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1746129581.388981:0:20861:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f449f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+25:27233:x1830948734422272:12345-192.168.202.4@tcp:35:ldlm_bl.0 Request processed in 209us (1213us total) trans 8589945475 rc 0/0 00000100:00100000:3.0:1746129581.388988:0:20861:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4841 00000100:00100000:2.0:1746129581.389214:0:14551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734422528 00000100:00100000:2.0:1746129581.389218:0:14551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734422528 00000100:00100000:2.0:1746129581.389243:0:14551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4842 00000100:00100000:2.0:1746129581.389247:0:14551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f44ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ada2ffba-8920-4ecb-8068-68caa9806978+302:15417:x1830948734422528:12345-192.168.202.4@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1746129581.389336:0:14551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f44ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ada2ffba-8920-4ecb-8068-68caa9806978+303:15417:x1830948734422528:12345-192.168.202.4@tcp:35:ldlm_bl.0 Request processed in 88us (646us total) trans 8589945476 rc 0/0 00000100:00100000:2.0:1746129581.389342:0:14551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4842 00000100:00100000:0.0:1746129581.394111:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129581.397995:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734422656 00000100:00100000:2.0:1746129581.398006:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734422656 00010000:00010000:2.0:1746129581.398041:0:7087:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe40c00/0x40a459093b06b909 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22237 expref: 303 pid: 16908 timeout: 936 lvb_type: 0 00000100:00100000:2.0:1746129581.399836:0:7087:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8706 00000100:00100000:2.0:1746129581.399850:0:7087:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6ce1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ada2ffba-8920-4ecb-8068-68caa9806978+303:1962:x1830948734422656:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129581.399865:0:7087:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129581.399873:0:7087:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe40c00/0x40a459093b06b909 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22237 expref: 303 pid: 16908 timeout: 936 lvb_type: 0 00010000:00010000:2.0:1746129581.399885:0:7087:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe40c00/0x40a459093b06b909 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22237 expref: 303 pid: 16908 timeout: 936 lvb_type: 0 00010000:00010000:2.0:1746129581.399901:0:7087:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe40c00/0x40a459093b06b909 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22237 expref: 303 pid: 16908 timeout: 936 lvb_type: 0 00010000:00010000:2.0:1746129581.399913:0:7087:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:2.0:1746129581.399917:0:7087:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe40600/0x40a459093b06b980 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129581.399924:0:7087:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe40600/0x40a459093b06b980 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129581.399928:0:7087:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe40600/0x40a459093b06b980 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129581.399932:0:7087:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129581.399983:0:7087:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6ce1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ada2ffba-8920-4ecb-8068-68caa9806978+302:1962:x1830948734422656:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 137us (5879us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129581.399988:0:7087:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8706 00000100:00100000:1.0:1746129581.400560:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129581.400992:0:15749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734422784 00000100:00100000:2.0:1746129581.400999:0:15749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734422784 00010000:00010000:2.0:1746129581.401016:0:15749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f845000/0x40a459093b06b8c3 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f221ff expref: 25 pid: 14549 timeout: 936 lvb_type: 0 00000100:00100000:2.0:1746129581.401050:0:15749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8707 00000100:00100000:2.0:1746129581.401056:0:15749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b550380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+25:1963:x1830948734422784:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129581.401063:0:15749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129581.401067:0:15749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f845000/0x40a459093b06b8c3 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f221ff expref: 25 pid: 14549 timeout: 936 lvb_type: 0 00010000:00010000:2.0:1746129581.401076:0:15749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f845000/0x40a459093b06b8c3 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f221ff expref: 25 pid: 14549 timeout: 936 lvb_type: 0 00010000:00010000:2.0:1746129581.401088:0:15749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f845000/0x40a459093b06b8c3 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f221ff expref: 25 pid: 14549 timeout: 936 lvb_type: 0 00010000:00010000:2.0:1746129581.401096:0:15749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:2.0:1746129581.401100:0:15749:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe40600/0x40a459093b06b980 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129581.401105:0:15749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe40600/0x40a459093b06b980 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129581.401111:0:15749:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe40600/0x40a459093b06b980 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129581.402109:0:15749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129581.402153:0:15749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b550380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+24:1963:x1830948734422784:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 1095us (1592us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129581.402160:0:15749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8707 00010000:00010000:1.0:1746129581.402499:0:16908:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe40600/0x40a459093b06b980 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129581.402509:0:16908:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe40600/0x40a459093b06b980 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00000004:00200000:1.0:1746129581.402544:0:16908:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00000004:00200000:1.0:1746129581.402547:0:16908:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746129581.402561:0:16908:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe40600/0x40a459093b06b980 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129581.402571:0:16908:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe40600/0x40a459093b06b980 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129581.402578:0:16908:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe41400/0x40a459093b06b972 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129581.402584:0:16908:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe41400/0x40a459093b06b972 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129581.402588:0:16908:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe41400/0x40a459093b06b972 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129581.402593:0:16908:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fe41400 already unused, calling callback (ffffffffa136e690) 00010000:00010000:1.0:1746129581.402597:0:16908:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe41400/0x40a459093b06b972 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129581.402603:0:16908:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe41400/0x40a459093b06b972 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129581.402612:0:16908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880132ef8f00) 00010000:00010000:1.0:1746129581.402615:0:16908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129581.402617:0:16908:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe41400/0x40a459093b06b972 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129581.402622:0:16908:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe41400/0x40a459093b06b972 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129581.402649:0:16908:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe41200/0x40a459093b06b979 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129581.402654:0:16908:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe41200/0x40a459093b06b979 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129581.402658:0:16908:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe41200/0x40a459093b06b979 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129581.402662:0:16908:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fe41200 already unused, calling callback (ffffffffa136e690) 00010000:00010000:1.0:1746129581.402664:0:16908:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe41200/0x40a459093b06b979 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129581.402668:0:16908:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe41200/0x40a459093b06b979 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129581.402674:0:16908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009cffed00) 00010000:00010000:1.0:1746129581.402676:0:16908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129581.402679:0:16908:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe41200/0x40a459093b06b979 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129581.402682:0:16908:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe41200/0x40a459093b06b979 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129581.402710:0:16908:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe40a00/0x40a459093b06b96b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22292 expref: 20 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129581.402720:0:16908:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe40600/0x40a459093b06b980 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22292 expref: 19 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129581.402725:0:16908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:1.0:1746129581.402728:0:16908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746129581.402730:0:16908:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe40600, rc 0) 00000100:00100000:1.0:1746129581.402755:0:16908:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f44b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:068dab75-d300-4ead-a742-d14572ad1e50+19:32692:x1830948734422016:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 18297us (18493us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129581.402761:0:16908:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11351 00000100:00100000:0.0:1746129581.410519:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129581.410570:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129581.410595:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129581.410622:0:22480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734422912 00000100:00100000:0.0:1746129581.410631:0:22480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734422912 00000100:00100000:0.0:1746129581.410692:0:22480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734423040 00000100:00100000:0.0:1746129581.410694:0:22480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734423040 00000100:00100000:3.0:1746129581.410704:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734423296 00000100:00100000:3.0:1746129581.410709:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734423296 00000100:00100000:0.0:1746129581.410711:0:22480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16806 00000100:00100000:0.0:1746129581.410717:0:22480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f44b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:068dab75-d300-4ead-a742-d14572ad1e50+7:1962:x1830948734422912:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:0.0:1746129581.410737:0:22480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746129581.410738:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16807 00000100:00100000:3.0:1746129581.410743:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f44b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:068dab75-d300-4ead-a742-d14572ad1e50+7:1962:x1830948734423040:12345-192.168.202.4@tcp:101:lfs.0 00000100:00100000:2.0:1746129581.410744:0:8412:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16808 00010000:00010000:3.0:1746129581.410748:0:7149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746129581.410754:0:8412:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f44aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:068dab75-d300-4ead-a742-d14572ad1e50+6:1962:x1830948734423296:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:3.0:1746129581.410756:0:7149:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095eecc00/0x40a459093b06b98e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f222a0 expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129581.410756:0:22480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b4e0fc00/0x40a459093b06b987 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f22299 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129581.410765:0:8412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129581.410777:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129581.410777:0:8412:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800955d2c00/0x40a459093b06b995 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f222ae expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129581.410777:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129581.410779:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129581.410779:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129581.410788:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095eecc00/0x40a459093b06b98e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f222a0 expref: 9 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129581.410788:0:22480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b4e0fc00/0x40a459093b06b987 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22299 expref: 9 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129581.410802:0:7149:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095eecc00/0x40a459093b06b98e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f222a0 expref: 9 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129581.410812:0:7149:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095eecc00, rc 0) 00000100:00100000:2.0:1746129581.410819:0:8412:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e38b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8412:1830948737621632:192.168.202.4@tcp:106: 00000100:00100000:3.0:1746129581.410859:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f44b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:068dab75-d300-4ead-a742-d14572ad1e50+9:1962:x1830948734423040:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 116us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129581.410865:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16807 00000100:00100000:2.0:1746129581.410879:0:8412:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094a84c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746129581.411002:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129581.411033:0:20577:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734423168 00000100:00100000:2.0:1746129581.411036:0:20577:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734423168 00000100:00100000:2.0:1746129581.411060:0:20577:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16809 00000100:00100000:2.0:1746129581.411064:0:20577:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b552300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:068dab75-d300-4ead-a742-d14572ad1e50+8:1962:x1830948734423168:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:2.0:1746129581.411069:0:20577:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129581.411075:0:20577:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800955d3600/0x40a459093b06b99c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f222a7 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129581.411096:0:20577:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e389f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20577:1830948737621760:192.168.202.4@tcp:106: 00010000:00010000:0.0:1746129581.411115:0:22480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b4e0fc00/0x40a459093b06b987 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22299 expref: 8 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129581.411125:0:22480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4e0fc00, rc 0) 00000100:00100000:2.0:1746129581.411129:0:20577:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b5354cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129581.411143:0:22480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f44b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:068dab75-d300-4ead-a742-d14572ad1e50+8:1962:x1830948734422912:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 426us (635us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129581.411148:0:22480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16806 00000100:00080000:0.0:1746129581.411164:0:7097:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:2.0:1746129581.412707:0:8412:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb mtime: 1746129581 -> 1746129582 00002000:00010000:2.0:1746129581.412715:0:8412:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb atime: 1746129580 -> 1746129582 00002000:00010000:2.0:1746129581.412717:0:8412:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb ctime: 1746129581 -> 1746129582 00000100:00100000:2.0:1746129581.412742:0:8412:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e38b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8412:1830948737621632:192.168.202.4@tcp:106: 00002000:00010000:3.0:1746129581.412744:0:20577:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb atime: 1746129581 -> 1746129582 00000100:00100000:3.0:1746129581.412756:0:20577:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e389f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20577:1830948737621760:192.168.202.4@tcp:106: 00010000:00010000:2.0:1746129581.412770:0:8412:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800955d2c00/0x40a459093b06b995 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f222ae expref: 9 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129581.412772:0:20577:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800955d3600/0x40a459093b06b99c lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f222a7 expref: 9 pid: 20577 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129581.412781:0:20577:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800955d3600/0x40a459093b06b99c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f222a7 expref: 9 pid: 20577 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129581.412782:0:8412:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800955d2c00/0x40a459093b06b995 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f222ae expref: 9 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129581.412799:0:8412:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800955d2c00, rc 0) 00010000:00010000:3.0:1746129581.412801:0:20577:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800955d3600, rc 0) 00000100:00100000:3.0:1746129581.412834:0:20577:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b552300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:068dab75-d300-4ead-a742-d14572ad1e50+7:1962:x1830948734423168:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 1769us (1832us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129581.412835:0:8412:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f44aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:068dab75-d300-4ead-a742-d14572ad1e50+7:1962:x1830948734423296:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 2082us (2237us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129581.412841:0:8412:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16808 00000100:00100000:3.0:1746129581.412908:0:20577:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16809 00000100:00100000:0.0:1746129581.414455:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129581.414606:0:16908:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734423552 00000100:00100000:1.0:1746129581.414613:0:16908:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734423552 00000100:00100000:1.0:1746129581.414666:0:16908:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11352 00000100:00100000:1.0:1746129581.414673:0:16908:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f449880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:068dab75-d300-4ead-a742-d14572ad1e50+19:32692:x1830948734423552:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:1.0:1746129581.414691:0:16908:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129581.414706:0:16908:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe41c00/0x40a459093b06b9a3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f222b5 expref: -99 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129581.414801:0:16908:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe40e00/0x40a459093b06b9aa lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129581.414814:0:16908:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe40600/0x40a459093b06b980 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22292 expref: 20 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129581.414820:0:16908:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe40e00/0x40a459093b06b9aa lrc: 4/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129581.414848:0:16908:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe40600/0x40a459093b06b980 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22292 expref: 20 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129581.414858:0:16908:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe40600/0x40a459093b06b980 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22292 expref: 20 pid: 16908 timeout: 936 lvb_type: 0 00000100:00100000:1.0:1746129581.414869:0:16908:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b551c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16908:1830948737621888:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129581.414943:0:16908:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130fc9e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746129581.416349:0:16908:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b551c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16908:1830948737621888:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129581.416376:0:16908:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe40e00/0x40a459093b06b9aa lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00000100:00100000:0.0:1746129581.417110:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129581.417170:0:15749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734423680 00000100:00100000:2.0:1746129581.417178:0:15749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734423680 00010000:00010000:2.0:1746129581.417214:0:15749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe40600/0x40a459093b06b980 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22292 expref: 21 pid: 16908 timeout: 936 lvb_type: 0 00000100:00100000:2.0:1746129581.417263:0:15749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8708 00000100:00100000:2.0:1746129581.417270:0:15749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:068dab75-d300-4ead-a742-d14572ad1e50+21:1962:x1830948734423680:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129581.417282:0:15749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129581.417289:0:15749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe40600/0x40a459093b06b980 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22292 expref: 21 pid: 16908 timeout: 936 lvb_type: 0 00010000:00010000:2.0:1746129581.417321:0:15749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe40600/0x40a459093b06b980 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22292 expref: 21 pid: 16908 timeout: 936 lvb_type: 0 00010000:00010000:2.0:1746129581.417342:0:15749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe40600/0x40a459093b06b980 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22292 expref: 21 pid: 16908 timeout: 936 lvb_type: 0 00010000:00010000:2.0:1746129581.417356:0:15749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:2.0:1746129581.417360:0:15749:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe40e00/0x40a459093b06b9aa lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129581.417370:0:15749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe40e00/0x40a459093b06b9aa lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129581.417377:0:15749:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe40e00/0x40a459093b06b9aa lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129581.417405:0:15749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746129581.417422:0:16908:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe40e00/0x40a459093b06b9aa lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129581.417429:0:16908:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe40e00/0x40a459093b06b9aa lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00000100:00100000:2.0:1746129581.417444:0:15749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:068dab75-d300-4ead-a742-d14572ad1e50+20:1962:x1830948734423680:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 174us (336us total) trans 0 rc 0/0 00000004:00200000:1.0:1746129581.417448:0:16908:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00000100:00100000:2.0:1746129581.417450:0:15749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8708 00010000:00010000:1.0:1746129581.417785:0:16908:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe41c00/0x40a459093b06b9a3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f222b5 expref: 21 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129581.417802:0:16908:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe40e00/0x40a459093b06b9aa lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f222b5 expref: 20 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129581.417808:0:16908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:1.0:1746129581.417811:0:16908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746129581.417813:0:16908:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe40e00, rc 0) 00000100:00100000:1.0:1746129581.417838:0:16908:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f449880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:068dab75-d300-4ead-a742-d14572ad1e50+20:32692:x1830948734423552:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 3166us (3387us total) trans 8589945477 rc 0/0 00000100:00100000:1.0:1746129581.417844:0:16908:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11352 00000100:00100000:0.0:1746129581.421479:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129581.421545:0:20577:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734423808 00000100:00100000:3.0:1746129581.421555:0:20577:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734423808 00000100:00100000:3.0:1746129581.421617:0:20577:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16810 00000100:00100000:3.0:1746129581.421626:0:20577:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:068dab75-d300-4ead-a742-d14572ad1e50+6:1963:x1830948734423808:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:3.0:1746129581.421646:0:20577:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129581.421666:0:20577:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095eeca00/0x40a459093b06b9b8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f222bc expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129581.421724:0:20577:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20577:1830948737622016:192.168.202.4@tcp:106: 00000100:00100000:3.0:1746129581.421830:0:20577:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5c68e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746129581.422196:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129581.422595:0:8412:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734423936 00000100:00100000:3.0:1746129581.422599:0:8412:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734423936 00000100:00100000:3.0:1746129581.422623:0:8412:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16811 00000100:00100000:3.0:1746129581.422629:0:8412:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:068dab75-d300-4ead-a742-d14572ad1e50+8:1963:x1830948734423936:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:3.0:1746129581.422637:0:8412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129581.422646:0:8412:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880132edd400/0x40a459093b06b9bf lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f222c3 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129581.422674:0:8412:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8412:1830948737622144:192.168.202.4@tcp:106: 00000100:00100000:3.0:1746129581.422724:0:8412:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5c68780 going to sleep for 11 seconds 00000100:00100000:3.0:1746129581.423919:0:20577:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20577:1830948737622016:192.168.202.4@tcp:106: 00000100:00100000:2.0:1746129581.423919:0:8412:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8412:1830948737622144:192.168.202.4@tcp:106: 00010000:00010000:3.0:1746129581.423950:0:20577:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095eeca00/0x40a459093b06b9b8 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f222bc expref: 9 pid: 20577 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129581.423950:0:8412:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880132edd400/0x40a459093b06b9bf lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f222c3 expref: 9 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129581.423961:0:20577:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095eeca00/0x40a459093b06b9b8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f222bc expref: 9 pid: 20577 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129581.423961:0:8412:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880132edd400/0x40a459093b06b9bf lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f222c3 expref: 9 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129581.423971:0:8412:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132edd400, rc 0) 00010000:00010000:3.0:1746129581.423985:0:20577:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095eeca00, rc 0) 00000100:00100000:2.0:1746129581.424012:0:8412:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:068dab75-d300-4ead-a742-d14572ad1e50+7:1963:x1830948734423936:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 1379us (1812us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129581.424021:0:8412:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16811 00000100:00100000:3.0:1746129581.424053:0:20577:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:068dab75-d300-4ead-a742-d14572ad1e50+6:1963:x1830948734423808:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 2427us (2583us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129581.424058:0:20577:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16810 00000100:00100000:1.0:1746129581.428545:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129581.428671:0:16908:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734424192 00000100:00100000:2.0:1746129581.428681:0:16908:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734424192 00000100:00100000:2.0:1746129581.428737:0:16908:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11353 00000100:00100000:2.0:1746129581.428744:0:16908:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b551c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:068dab75-d300-4ead-a742-d14572ad1e50+20:32692:x1830948734424192:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:2.0:1746129581.428767:0:16908:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129581.428770:0:16908:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746129581.428797:0:16908:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe40e00/0x40a459093b06b9aa lrc: 0/0,0 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f222b5 expref: 20 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129581.428816:0:16908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:2.0:1746129581.428821:0:16908:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746129581.428832:0:16908:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800955d2200/0x40a459093b06b9c6 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f222ca expref: -99 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129581.428929:0:16908:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800955d3200/0x40a459093b06b9cd lrc: 3/0,1 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129581.428942:0:16908:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800955d3200/0x40a459093b06b9cd lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129581.428951:0:16908:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800955d3200/0x40a459093b06b9cd lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00000004:00200000:2.0:1746129581.428962:0:16908:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:2.0:1746129581.429076:0:16908:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800955d2200/0x40a459093b06b9c6 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x1/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f222ca expref: 22 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129581.429089:0:16908:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800955d3200/0x40a459093b06b9cd lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f222ca expref: 21 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129581.429095:0:16908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:2.0:1746129581.429098:0:16908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746129581.429099:0:16908:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800955d3200, rc 0) 00000100:00100000:2.0:1746129581.429163:0:16908:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b551c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:068dab75-d300-4ead-a742-d14572ad1e50+21:32692:x1830948734424192:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 420us (630us total) trans 8589945478 rc 0/0 00000100:00100000:2.0:1746129581.429170:0:16908:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11353 00000100:00100000:0.0:1746129581.433508:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129581.433550:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129581.433570:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129581.433599:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129581.433613:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129581.433643:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129581.433743:0:8412:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734424320 00000100:00100000:2.0:1746129581.433753:0:8412:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734424320 00000100:00100000:2.0:1746129581.433798:0:8412:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734424448 00000100:00100000:2.0:1746129581.433800:0:8412:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734424448 00000100:00100000:2.0:1746129581.433812:0:8412:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734424704 00000100:00100000:3.0:1746129581.433822:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734424960 00000100:00100000:3.0:1746129581.433825:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734424960 00000100:00100000:1.0:1746129581.433825:0:11014:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734424576 00000100:00100000:1.0:1746129581.433828:0:11014:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734424576 00000100:00100000:3.0:1746129581.433842:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734424832 00000100:00100000:3.0:1746129581.433844:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734424832 00000100:00100000:1.0:1746129581.433929:0:11014:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16812 00000100:00100000:3.0:1746129581.433935:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16813 00000100:00100000:1.0:1746129581.433937:0:11014:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:068dab75-d300-4ead-a742-d14572ad1e50+7:1963:x1830948734424320:12345-192.168.202.4@tcp:1:lfs.0 00000100:00100000:3.0:1746129581.433939:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:068dab75-d300-4ead-a742-d14572ad1e50+10:1963:x1830948734424448:12345-192.168.202.4@tcp:1:lfs.0 00010000:00010000:3.0:1746129581.433982:0:7149:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880132edd000/0x40a459093b06b9e2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129581.433982:0:11014:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009fe41600/0x40a459093b06b9db lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129581.433999:0:7149:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c63e200/0x40a459093b06b8fb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22230 expref: 21 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129581.433999:0:11014:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091b62400/0x40a459093b06b837 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f221a4 expref: 16 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129581.434006:0:7149:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b4e0fc00/0x40a459093b06b987 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22299 expref: 10 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129581.434007:0:11014:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c144200/0x40a459093b06b86f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f221c7 expref: 7 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129581.434014:0:7149:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f845e00/0x40a459093b06b91e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22245 expref: 31 pid: 20577 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129581.434014:0:11014:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cdfc800/0x40a459093b06b84c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f221b9 expref: 21 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129581.434019:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129581.434019:0:11014:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129581.434021:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129581.434021:0:11014:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129581.434023:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880132edd000/0x40a459093b06b9e2 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129581.434023:0:11014:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fe41600/0x40a459093b06b9db lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129581.434053:0:7149:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f845e00/0x40a459093b06b91e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22245 expref: 31 pid: 20577 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129581.434053:0:11014:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009cdfc800/0x40a459093b06b84c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f221b9 expref: 21 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129581.434064:0:7149:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f845e00/0x40a459093b06b91e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22245 expref: 31 pid: 20577 timeout: 936 lvb_type: 1 00010000:00010000:1.0:1746129581.434064:0:11014:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009cdfc800/0x40a459093b06b84c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f221b9 expref: 21 pid: 7148 timeout: 936 lvb_type: 1 00000100:00100000:3.0:1746129581.434077:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7149:1830948737622272:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129581.434077:0:11014:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b552680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11014:1830948737622400:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129581.434097:0:8412:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734424704 00000100:00100000:2.0:1746129581.434116:0:8412:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16814 00000100:00100000:2.0:1746129581.434120:0:8412:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:068dab75-d300-4ead-a742-d14572ad1e50+10:1963:x1830948734424960:12345-192.168.202.4@tcp:1:lfs.0 00010000:00010000:2.0:1746129581.434136:0:8412:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800955d2c00/0x40a459093b06b9e9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129581.434145:0:8412:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f118800/0x40a459093b06b6fc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f220bd expref: 31 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129581.434152:0:8412:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091b63800/0x40a459093b06b7d5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2215e expref: 21 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129581.434156:0:7149:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b4e0fc00/0x40a459093b06b987 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22299 expref: 10 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129581.434160:0:8412:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880090a19a00/0x40a459093b06b73b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f220e7 expref: 10 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129581.434163:0:7149:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b4e0fc00/0x40a459093b06b987 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22299 expref: 10 pid: 22480 timeout: 936 lvb_type: 1 00010000:00010000:2.0:1746129581.434166:0:8412:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129581.434167:0:8412:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129581.434169:0:8412:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800955d2c00/0x40a459093b06b9e9 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129581.434170:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7149:1830948737622528:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129581.434183:0:8412:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880090a19a00/0x40a459093b06b73b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f220e7 expref: 10 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129581.434190:0:8412:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880090a19a00/0x40a459093b06b73b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f220e7 expref: 10 pid: 11014 timeout: 936 lvb_type: 1 00010000:00010000:3.0:1746129581.434191:0:7149:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c63e200/0x40a459093b06b8fb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22230 expref: 21 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129581.434198:0:7149:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c63e200/0x40a459093b06b8fb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22230 expref: 21 pid: 8412 timeout: 936 lvb_type: 0 00000100:00100000:2.0:1746129581.434203:0:8412:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e38b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8412:1830948737622656:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129581.434210:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7149:1830948737622784:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129581.434238:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5c68e40 going to sleep for 11 seconds 00010000:00010000:2.0:1746129581.434240:0:8412:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091b63800/0x40a459093b06b7d5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2215e expref: 21 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129581.434246:0:8412:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091b63800/0x40a459093b06b7d5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2215e expref: 21 pid: 8412 timeout: 936 lvb_type: 1 00000100:00100000:2.0:1746129581.434254:0:8412:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e38a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8412:1830948737622912:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129581.434259:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16815 00000100:00100000:3.0:1746129581.434265:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:068dab75-d300-4ead-a742-d14572ad1e50+10:1963:x1830948734424576:12345-192.168.202.4@tcp:1:lfs.0 00010000:00010000:3.0:1746129581.434281:0:4385:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880095eeca00/0x40a459093b06b9f0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129581.434286:0:8412:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f118800/0x40a459093b06b6fc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f220bd expref: 31 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129581.434290:0:4385:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c63fe00/0x40a459093b06b917 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2223e expref: 21 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129581.434307:0:8412:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f118800/0x40a459093b06b6fc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f220bd expref: 31 pid: 4385 timeout: 936 lvb_type: 0 00010000:00010000:3.0:1746129581.434314:0:4385:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095eecc00/0x40a459093b06b98e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f222a0 expref: 10 pid: 7149 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746129581.434315:0:8412:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e389f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8412:1830948737623040:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129581.434320:0:4385:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095eec000/0x40a459093b06b933 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2225a expref: 31 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129581.434325:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129581.434327:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129581.434329:0:4385:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095eeca00/0x40a459093b06b9f0 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129581.434333:0:8412:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094a84c00 going to sleep for 11 seconds 00010000:00010000:3.0:1746129581.434343:0:4385:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095eec000/0x40a459093b06b933 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2225a expref: 31 pid: 20577 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129581.434348:0:31503:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16816 00010000:00010000:3.0:1746129581.434350:0:4385:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095eec000/0x40a459093b06b933 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2225a expref: 31 pid: 20577 timeout: 936 lvb_type: 0 00000100:00100000:2.0:1746129581.434353:0:31503:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:068dab75-d300-4ead-a742-d14572ad1e50+8:1963:x1830948734424832:12345-192.168.202.4@tcp:1:lfs.0 00000100:00100000:3.0:1746129581.434357:0:4385:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:4385:1830948737623168:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129581.434367:0:31503:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008f447600/0x40a459093b06b9f7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129581.434379:0:4385:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095eecc00/0x40a459093b06b98e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f222a0 expref: 10 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129581.434386:0:4385:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095eecc00/0x40a459093b06b98e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f222a0 expref: 10 pid: 7149 timeout: 936 lvb_type: 1 00000100:00100000:3.0:1746129581.434393:0:4385:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:4385:1830948737623296:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129581.434417:0:4385:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c63fe00/0x40a459093b06b917 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2223e expref: 21 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129581.434424:0:4385:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c63fe00/0x40a459093b06b917 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2223e expref: 21 pid: 8412 timeout: 936 lvb_type: 0 00000100:00100000:3.0:1746129581.434431:0:4385:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:4385:1830948737623424:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129581.434444:0:4385:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5c68f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746129581.434459:0:20577:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16817 00000100:00100000:3.0:1746129581.434464:0:20577:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:068dab75-d300-4ead-a742-d14572ad1e50+8:1963:x1830948734424704:12345-192.168.202.4@tcp:1:lfs.0 00010000:00010000:1.0:1746129581.434464:0:11014:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c144200/0x40a459093b06b86f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f221c7 expref: 8 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129581.434476:0:11014:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c144200/0x40a459093b06b86f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f221c7 expref: 8 pid: 11014 timeout: 936 lvb_type: 1 00010000:00010000:3.0:1746129581.434477:0:20577:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012bf7a000/0x40a459093b06b9fe lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129581.434484:0:11014:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b550e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11014:1830948737623552:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129581.434486:0:20577:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fe41a00/0x40a459093b06b956 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1875968->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2227d expref: 21 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129581.434495:0:20577:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129581.434496:0:20577:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129581.434498:0:20577:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012bf7a000/0x40a459093b06b9fe lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129581.434500:0:11014:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091b62400/0x40a459093b06b837 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f221a4 expref: 16 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129581.434507:0:11014:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091b62400/0x40a459093b06b837 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f221a4 expref: 16 pid: 7148 timeout: 936 lvb_type: 0 00010000:00010000:3.0:1746129581.434511:0:20577:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fe41a00/0x40a459093b06b956 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1875968->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2227d expref: 21 pid: 20577 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129581.434515:0:11014:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b552a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11014:1830948737623680:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129581.434518:0:20577:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fe41a00/0x40a459093b06b956 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1875968->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2227d expref: 21 pid: 20577 timeout: 936 lvb_type: 0 00000100:00100000:3.0:1746129581.434524:0:20577:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800903a1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20577:1830948737623808:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129581.434524:0:11014:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130fc9e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746129581.434535:0:20577:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5c68780 going to sleep for 11 seconds 00010000:00010000:2.0:1746129581.434677:0:31503:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880132edc600/0x40a459093b06b964 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2789375) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2228b expref: 21 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129581.434687:0:31503:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129581.434688:0:31503:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129581.434690:0:31503:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f447600/0x40a459093b06b9f7 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129581.434707:0:31503:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880132edc600/0x40a459093b06b964 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2789375) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2228b expref: 21 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129581.434714:0:31503:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880132edc600/0x40a459093b06b964 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2789375) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2228b expref: 21 pid: 7148 timeout: 936 lvb_type: 0 00000100:00100000:2.0:1746129581.434722:0:31503:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e388700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:31503:1830948737623936:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129581.434740:0:31503:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b5354cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129581.441792:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129581.441820:0:8412:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e38b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8412:1830948737622656:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129581.441827:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129581.441833:0:8412:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e38a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8412:1830948737622912:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129581.441842:0:8412:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e389f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8412:1830948737623040:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129581.441845:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129581.441870:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734425088 00010000:00010000:2.0:1746129581.441873:0:8412:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800955d2c00/0x40a459093b06b9e9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129581.441876:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734425088 00000100:00100000:2.0:1746129581.441895:0:15749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734425472 00000100:00100000:2.0:1746129581.441897:0:15749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734425472 00010000:00010000:2.0:1746129581.441917:0:15749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f118800/0x40a459093b06b6fc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f220bd expref: 32 pid: 4385 timeout: 936 lvb_type: 0 00010000:00010000:0.0:1746129581.441917:0:9823:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b4e0fc00/0x40a459093b06b987 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22299 expref: 11 pid: 22480 timeout: 936 lvb_type: 1 00000100:00100000:2.0:1746129581.441940:0:15749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734425984 00000100:00100000:2.0:1746129581.441942:0:15749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734425984 00000100:00100000:3.0:1746129581.442041:0:4385:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:4385:1830948737623168:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129581.442050:0:4385:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:4385:1830948737623296:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129581.442056:0:4385:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:4385:1830948737623424:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129581.442077:0:4385:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880095eeca00/0x40a459093b06b9f0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129581.442099:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7149:1830948737622272:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129581.442106:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7149:1830948737622528:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129581.442111:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7149:1830948737622784:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129581.442125:0:7149:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880132edd000/0x40a459093b06b9e2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129581.442664:0:15749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c63e200/0x40a459093b06b8fb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22230 expref: 22 pid: 8412 timeout: 936 lvb_type: 0 00000100:00100000:0.0:1746129581.443105:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8709 00000100:00100000:2.0:1746129581.443271:0:15749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8710 00000100:00100000:1.0:1746129581.443277:0:7087:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8711 00000100:00100000:2.0:1746129581.443280:0:15749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:068dab75-d300-4ead-a742-d14572ad1e50+11:1962:x1830948734425088:12345-192.168.202.4@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746129581.443289:0:7087:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+22:1961:x1830948734425984:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129581.443305:0:15749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129581.443308:0:7087:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129581.443328:0:15749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b4e0fc00/0x40a459093b06b987 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22299 expref: 11 pid: 22480 timeout: 936 lvb_type: 1 00010000:00010000:1.0:1746129581.443328:0:7087:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c63e200/0x40a459093b06b8fb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22230 expref: 22 pid: 8412 timeout: 936 lvb_type: 0 00010000:00010000:1.0:1746129581.443339:0:7087:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c63e200/0x40a459093b06b8fb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22230 expref: 22 pid: 8412 timeout: 936 lvb_type: 0 00010000:00010000:2.0:1746129581.443644:0:15749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b4e0fc00/0x40a459093b06b987 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22299 expref: 11 pid: 22480 timeout: 936 lvb_type: 1 00010000:00010000:2.0:1746129581.443666:0:15749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b4e0fc00/0x40a459093b06b987 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22299 expref: 11 pid: 22480 timeout: 936 lvb_type: 1 00010000:00010000:2.0:1746129581.443690:0:15749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129581.443747:0:15749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:068dab75-d300-4ead-a742-d14572ad1e50+10:1962:x1830948734425088:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 469us (1968us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129581.443752:0:15749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8710 00000100:00100000:3.0:1746129581.443850:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129581.443935:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3e6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ada2ffba-8920-4ecb-8068-68caa9806978+32:1960:x1830948734425472:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129581.443944:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129581.443961:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f118800/0x40a459093b06b6fc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f220bd expref: 32 pid: 4385 timeout: 936 lvb_type: 0 00000100:00100000:3.0:1746129581.443966:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00010000:00010000:0.0:1746129581.443969:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f118800/0x40a459093b06b6fc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f220bd expref: 32 pid: 4385 timeout: 936 lvb_type: 0 00000100:00100000:3.0:1746129581.443979:0:7086:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734425344 00010000:00010000:0.0:1746129581.443982:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f118800/0x40a459093b06b6fc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f220bd expref: 32 pid: 4385 timeout: 936 lvb_type: 0 00000100:00100000:3.0:1746129581.443984:0:7086:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734425344 00010000:00010000:0.0:1746129581.443995:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746129581.443999:0:7086:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f845e00/0x40a459093b06b91e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22245 expref: 32 pid: 20577 timeout: 936 lvb_type: 1 00000100:00100000:3.0:1746129581.444012:0:7086:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734425728 00000100:00100000:3.0:1746129581.444013:0:7086:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734425728 00000100:00100000:0.0:1746129581.444013:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3e6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ada2ffba-8920-4ecb-8068-68caa9806978+32:1960:x1830948734425472:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 902us (2185us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129581.444019:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8709 00010000:00010000:3.0:1746129581.444021:0:7086:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091b63800/0x40a459093b06b7d5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2215e expref: 23 pid: 8412 timeout: 936 lvb_type: 1 00000100:00100000:0.0:1746129581.444030:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8712 00000100:00100000:0.0:1746129581.444034:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800903a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ada2ffba-8920-4ecb-8068-68caa9806978+31:1962:x1830948734425344:12345-192.168.202.4@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746129581.444039:0:7086:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8713 00010000:00010000:0.0:1746129581.444040:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746129581.444043:0:7086:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6ce0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+23:1962:x1830948734425728:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129581.444046:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f845e00/0x40a459093b06b91e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22245 expref: 31 pid: 20577 timeout: 936 lvb_type: 1 00010000:00010000:3.0:1746129581.444049:0:7086:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129581.444054:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f845e00/0x40a459093b06b91e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22245 expref: 31 pid: 20577 timeout: 936 lvb_type: 1 00010000:00010000:3.0:1746129581.444056:0:7086:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091b63800/0x40a459093b06b7d5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2215e expref: 23 pid: 8412 timeout: 936 lvb_type: 1 00010000:00010000:3.0:1746129581.444063:0:7086:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091b63800/0x40a459093b06b7d5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2215e expref: 23 pid: 8412 timeout: 936 lvb_type: 1 00010000:00010000:0.0:1746129581.444068:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f845e00/0x40a459093b06b91e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22245 expref: 31 pid: 20577 timeout: 936 lvb_type: 1 00010000:00010000:3.0:1746129581.444072:0:7086:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091b63800/0x40a459093b06b7d5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2215e expref: 23 pid: 8412 timeout: 936 lvb_type: 1 00010000:00010000:0.0:1746129581.444075:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746129581.444083:0:7086:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129581.444087:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800903a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ada2ffba-8920-4ecb-8068-68caa9806978+30:1962:x1830948734425344:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 53us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129581.444092:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8712 00000100:00100000:3.0:1746129581.444093:0:7086:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6ce0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+22:1962:x1830948734425728:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 50us (126us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129581.444098:0:7086:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8713 00000100:00100000:3.0:1746129581.444156:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129581.444165:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734425216 00000100:00100000:0.0:1746129581.444168:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734425216 00000100:00100000:3.0:1746129581.444170:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129581.444178:0:20578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734425600 00010000:00010000:0.0:1746129581.444179:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090a19a00/0x40a459093b06b73b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f220e7 expref: 10 pid: 11014 timeout: 936 lvb_type: 1 00000100:00100000:3.0:1746129581.444180:0:20578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734425600 00010000:00010000:3.0:1746129581.444188:0:20578:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095eec000/0x40a459093b06b933 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2225a expref: 30 pid: 20577 timeout: 936 lvb_type: 0 00000100:00100000:0.0:1746129581.444192:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8714 00000100:00100000:0.0:1746129581.444196:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800903a2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:068dab75-d300-4ead-a742-d14572ad1e50+10:1962:x1830948734425216:12345-192.168.202.4@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746129581.444200:0:20578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8715 00000100:00100000:3.0:1746129581.444203:0:20578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800903a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ada2ffba-8920-4ecb-8068-68caa9806978+30:1962:x1830948734425600:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129581.444203:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129581.444210:0:20578:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129581.444210:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090a19a00/0x40a459093b06b73b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f220e7 expref: 10 pid: 11014 timeout: 936 lvb_type: 1 00010000:00010000:3.0:1746129581.444217:0:20578:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095eec000/0x40a459093b06b933 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2225a expref: 30 pid: 20577 timeout: 936 lvb_type: 0 00010000:00010000:0.0:1746129581.444217:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090a19a00/0x40a459093b06b73b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f220e7 expref: 10 pid: 11014 timeout: 936 lvb_type: 1 00010000:00010000:3.0:1746129581.444237:0:20578:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095eec000/0x40a459093b06b933 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2225a expref: 30 pid: 20577 timeout: 936 lvb_type: 0 00010000:00010000:0.0:1746129581.444240:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090a19a00/0x40a459093b06b73b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f220e7 expref: 10 pid: 11014 timeout: 936 lvb_type: 1 00010000:00010000:3.0:1746129581.444245:0:20578:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095eec000/0x40a459093b06b933 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2225a expref: 30 pid: 20577 timeout: 936 lvb_type: 0 00010000:00010000:0.0:1746129581.444248:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129581.444250:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129581.444252:0:20578:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746129581.444254:0:7085:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800955d2c00/0x40a459093b06b9e9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129581.444261:0:7085:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800955d2c00/0x40a459093b06b9e9 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129581.444264:0:20578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800903a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ada2ffba-8920-4ecb-8068-68caa9806978+29:1962:x1830948734425600:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 60us (93us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129581.444269:0:20578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8715 00010000:00010000:0.0:1746129581.444281:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129581.444308:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800903a2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:068dab75-d300-4ead-a742-d14572ad1e50+9:1962:x1830948734425216:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 95us (135us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129581.444313:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8714 00000100:00100000:3.0:1746129581.444320:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129581.444326:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734425856 00000100:00100000:0.0:1746129581.444328:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734425856 00000100:00100000:3.0:1746129581.444333:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129581.444340:0:7086:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734426240 00000100:00100000:3.0:1746129581.444342:0:7086:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734426240 00010000:00010000:3.0:1746129581.444352:0:7086:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009cdfc800/0x40a459093b06b84c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f221b9 expref: 22 pid: 7148 timeout: 936 lvb_type: 1 00000100:00100000:3.0:1746129581.444364:0:7086:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8716 00000100:00100000:3.0:1746129581.444368:0:7086:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800903a2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ada2ffba-8920-4ecb-8068-68caa9806978+22:1961:x1830948734426240:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129581.444374:0:7086:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129581.444387:0:7086:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009cdfc800/0x40a459093b06b84c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f221b9 expref: 22 pid: 7148 timeout: 936 lvb_type: 1 00010000:00010000:3.0:1746129581.444395:0:7086:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009cdfc800/0x40a459093b06b84c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f221b9 expref: 22 pid: 7148 timeout: 936 lvb_type: 1 00010000:00010000:3.0:1746129581.444407:0:7086:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746129581.444409:0:7087:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c63e200/0x40a459093b06b8fb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22230 expref: 21 pid: 8412 timeout: 936 lvb_type: 0 00000100:00100000:3.0:1746129581.444425:0:7086:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800903a2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ada2ffba-8920-4ecb-8068-68caa9806978+22:1961:x1830948734426240:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 56us (91us total) trans 0 rc 0/0 00010000:00010000:1.0:1746129581.444426:0:7087:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129581.444427:0:7087:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746129581.444430:0:7086:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8716 00010000:00010000:1.0:1746129581.444430:0:7087:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880132edd000/0x40a459093b06b9e2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129581.444435:0:7087:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880132edd000/0x40a459093b06b9e2 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129581.444468:0:11014:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cdfc800/0x40a459093b06b84c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f221b9 expref: 21 pid: 7148 timeout: 936 lvb_type: 1 00000100:00100000:1.0:1746129581.444478:0:11014:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b552680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11014:1830948737622400:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129581.444502:0:7087:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129581.444518:0:7087:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:1961:x1830948734425984:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 1235us (2672us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129581.444524:0:7087:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8711 00010000:00010000:0.0:1746129581.444584:0:9823:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095eecc00/0x40a459093b06b98e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f222a0 expref: 9 pid: 7149 timeout: 936 lvb_type: 1 00000100:00100000:0.0:1746129581.445341:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8717 00000100:00100000:0.0:1746129581.445348:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800903a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:068dab75-d300-4ead-a742-d14572ad1e50+9:1962:x1830948734425856:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129581.445356:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129581.445366:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095eecc00/0x40a459093b06b98e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f222a0 expref: 9 pid: 7149 timeout: 936 lvb_type: 1 00010000:00010000:0.0:1746129581.445374:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095eecc00/0x40a459093b06b98e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f222a0 expref: 9 pid: 7149 timeout: 936 lvb_type: 1 00010000:00010000:0.0:1746129581.445384:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095eecc00/0x40a459093b06b98e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f222a0 expref: 9 pid: 7149 timeout: 936 lvb_type: 1 00010000:00010000:0.0:1746129581.445397:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129581.445416:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800903a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:068dab75-d300-4ead-a742-d14572ad1e50+8:1962:x1830948734425856:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 69us (1095us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129581.445421:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8717 00010000:00010000:0.0:1746129581.445456:0:8412:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800955d2c00/0x40a459093b06b9e9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129581.445464:0:8412:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800955d2c00/0x40a459093b06b9e9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129581.445485:0:8412:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800955d2c00/0x40a459093b06b9e9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129581.445492:0:8412:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800955d2c00/0x40a459093b06b9e9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129581.445499:0:8412:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800955d2c00/0x40a459093b06b9e9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129581.446160:0:7149:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880132edd000/0x40a459093b06b9e2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129581.446169:0:7149:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880132edd000/0x40a459093b06b9e2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129581.446185:0:7149:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880132edd000/0x40a459093b06b9e2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129581.446191:0:7149:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880132edd000/0x40a459093b06b9e2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129581.446197:0:7149:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880132edd000/0x40a459093b06b9e2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129581.446202:0:7149:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880132edd000 already unused, calling callback (ffffffffa086ed70) 00010000:00010000:3.0:1746129581.446206:0:7149:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880132edd000/0x40a459093b06b9e2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129581.446213:0:7149:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880132edd000/0x40a459093b06b9e2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129581.446238:0:7149:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880132edd000/0x40a459093b06b9e2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129581.446244:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880132edd000/0x40a459093b06b9e2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129581.446309:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:068dab75-d300-4ead-a742-d14572ad1e50+7:1963:x1830948734424448:12345-192.168.202.4@tcp:1:lfs.0 Request processed in 12368us (12757us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129581.446316:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16813 00000100:00100000:3.0:1746129581.446662:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00010000:00010000:0.0:1746129581.446839:0:8412:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800955d2c00 already unused, calling callback (ffffffffa086ed70) 00010000:00010000:0.0:1746129581.446842:0:8412:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800955d2c00/0x40a459093b06b9e9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129581.446848:0:8412:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800955d2c00/0x40a459093b06b9e9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129581.446861:0:8412:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800955d2c00/0x40a459093b06b9e9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129581.446867:0:8412:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800955d2c00/0x40a459093b06b9e9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129581.446898:0:8412:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:068dab75-d300-4ead-a742-d14572ad1e50+6:1963:x1830948734424960:12345-192.168.202.4@tcp:1:lfs.0 Request processed in 12778us (13299us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129581.446903:0:8412:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16814 00000100:00100000:3.0:1746129581.447544:0:20577:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800903a1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20577:1830948737623808:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129581.447545:0:11014:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b550e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11014:1830948737623552:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129581.447553:0:11014:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b552a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11014:1830948737623680:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129581.447567:0:20577:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012bf7a000/0x40a459093b06b9fe lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129581.447569:0:11014:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009fe41600/0x40a459093b06b9db lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129581.447762:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129581.447776:0:31503:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e388700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:31503:1830948737623936:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129581.447790:0:31503:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88008f447600/0x40a459093b06b9f7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129581.447807:0:15749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734426112 00000100:00100000:2.0:1746129581.447813:0:15749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734426112 00010000:00010000:2.0:1746129581.447835:0:15749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c63fe00/0x40a459093b06b917 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2223e expref: 20 pid: 8412 timeout: 936 lvb_type: 0 00000100:00100000:1.0:1746129581.448444:0:21725:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734426496 00000100:00100000:1.0:1746129581.448448:0:21725:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734426496 00000100:00100000:3.0:1746129581.448652:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00002000:00100000:1.0:1746129581.448674:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ee:0x0] (1875968->2097151) req@ffff8800903a1500 x1830948734426496/t0(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:322/0 lens 488/0 e 0 to 0 dl 1746129592 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129581.448689:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800903a1500 with x1830948734426496 ext(1875968->2097151) 00010000:00010000:1.0:1746129581.448696:0:21725:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fe41a00/0x40a459093b06b956 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1875968->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2227d expref: 21 pid: 20577 timeout: 936 lvb_type: 0 00010000:00010000:1.0:1746129581.448705:0:21725:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fe41a00/0x40a459093b06b956 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1875968->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2227d expref: 21 pid: 20577 timeout: 936 lvb_type: 0 00002000:00010000:1.0:1746129581.448712:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800903a1500 00000100:00100000:1.0:1746129581.448731:0:21725:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2530 00000100:00100000:1.0:1746129581.448737:0:21725:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800903a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ada2ffba-8920-4ecb-8068-68caa9806978+21:1963:x1830948734426496:12345-192.168.202.4@tcp:4:cat.0 00000100:00100000:2.0:1746129581.449834:0:15749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734426368 00000100:00100000:2.0:1746129581.449843:0:15749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734426368 00010000:00010000:2.0:1746129581.449868:0:15749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c144200/0x40a459093b06b86f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f221c7 expref: 9 pid: 11014 timeout: 936 lvb_type: 1 00000100:00100000:0.0:1746129581.449926:0:7087:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8718 00000100:00100000:0.0:1746129581.449943:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8719 00000100:00100000:0.0:1746129581.449949:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800903a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:068dab75-d300-4ead-a742-d14572ad1e50+9:1963:x1830948734426368:12345-192.168.202.4@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746129581.449957:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00010000:00010000:0.0:1746129581.449961:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129581.449980:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c144200/0x40a459093b06b86f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f221c7 expref: 9 pid: 11014 timeout: 936 lvb_type: 1 00010000:00010000:0.0:1746129581.449991:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c144200/0x40a459093b06b86f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f221c7 expref: 9 pid: 11014 timeout: 936 lvb_type: 1 00010000:00010000:0.0:1746129581.450013:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c144200/0x40a459093b06b86f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f221c7 expref: 9 pid: 11014 timeout: 936 lvb_type: 1 00010000:00010000:0.0:1746129581.450027:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129581.450054:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800903a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:068dab75-d300-4ead-a742-d14572ad1e50+8:1963:x1830948734426368:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 106us (1402us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129581.450064:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8719 00000100:00100000:0.0:1746129581.450110:0:7087:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800903a0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:1961:x1830948734426112:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129581.450117:0:7087:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129581.450134:0:7087:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c63fe00/0x40a459093b06b917 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2223e expref: 20 pid: 8412 timeout: 936 lvb_type: 0 00010000:00010000:0.0:1746129581.450142:0:7087:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c63fe00/0x40a459093b06b917 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2223e expref: 20 pid: 8412 timeout: 936 lvb_type: 0 00010000:00010000:0.0:1746129581.450155:0:7087:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c63fe00/0x40a459093b06b917 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2223e expref: 20 pid: 8412 timeout: 936 lvb_type: 0 00010000:00010000:0.0:1746129581.450165:0:7087:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129581.450167:0:7087:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129581.450172:0:7087:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880095eeca00/0x40a459093b06b9f0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129581.450180:0:7087:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095eeca00/0x40a459093b06b9f0 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129581.450209:0:7087:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129581.450238:0:7087:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800903a0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+19:1961:x1830948734426112:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 304us (3576us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129581.450244:0:7087:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8718 00000100:00100000:1.0:1746129581.450315:0:31521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734426624 00000100:00100000:1.0:1746129581.450319:0:31521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734426624 00002000:00100000:1.0:1746129581.450347:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3ef:0x0] (2097152->2789375) req@ffff8800947bc000 x1830948734426624/t0(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:322/0 lens 488/0 e 0 to 0 dl 1746129592 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129581.450355:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800947bc000 with x1830948734426624 ext(2097152->2789375) 00010000:00010000:1.0:1746129581.450360:0:31521:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880132edc600/0x40a459093b06b964 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2789375) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2228b expref: 23 pid: 7148 timeout: 936 lvb_type: 0 00010000:00010000:1.0:1746129581.450397:0:31521:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880132edc600/0x40a459093b06b964 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2789375) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2228b expref: 23 pid: 7148 timeout: 936 lvb_type: 0 00002000:00010000:1.0:1746129581.450404:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800947bc000 00000100:00100000:1.0:1746129581.450422:0:31521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2531 00000100:00100000:1.0:1746129581.450428:0:31521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ada2ffba-8920-4ecb-8068-68caa9806978+23:1963:x1830948734426624:12345-192.168.202.4@tcp:4:cat.0 00000100:00100000:3.0:1746129581.450507:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00010000:00010000:3.0:1746129581.450523:0:4385:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880095eeca00/0x40a459093b06b9f0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129581.450526:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734426752 00000100:00100000:0.0:1746129581.450529:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734426752 00010000:00010000:3.0:1746129581.450530:0:4385:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095eeca00/0x40a459093b06b9f0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129581.450545:0:7087:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091b62400/0x40a459093b06b837 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f221a4 expref: 17 pid: 7148 timeout: 936 lvb_type: 0 00010000:00010000:3.0:1746129581.450548:0:4385:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880095eeca00/0x40a459093b06b9f0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129581.450555:0:4385:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880095eeca00/0x40a459093b06b9f0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129581.450561:0:4385:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880095eeca00/0x40a459093b06b9f0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129581.450568:0:4385:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095eeca00 already unused, calling callback (ffffffffa086ed70) 00000100:00100000:0.0:1746129581.450570:0:7087:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8720 00010000:00010000:3.0:1746129581.450571:0:4385:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880095eeca00/0x40a459093b06b9f0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129581.450576:0:7087:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6ce1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+17:1962:x1830948734426752:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129581.450578:0:4385:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880095eeca00/0x40a459093b06b9f0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129581.450583:0:7087:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129581.450587:0:4385:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880095eeca00/0x40a459093b06b9f0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129581.450591:0:7087:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091b62400/0x40a459093b06b837 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f221a4 expref: 17 pid: 7148 timeout: 936 lvb_type: 0 00010000:00010000:0.0:1746129581.450598:0:7087:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091b62400/0x40a459093b06b837 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f221a4 expref: 17 pid: 7148 timeout: 936 lvb_type: 0 00010000:00010000:3.0:1746129581.450604:0:4385:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095eeca00/0x40a459093b06b9f0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129581.450620:0:7087:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091b62400/0x40a459093b06b837 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f221a4 expref: 17 pid: 7148 timeout: 936 lvb_type: 0 00010000:00010000:0.0:1746129581.450629:0:7087:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129581.450630:0:7087:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129581.450633:0:7087:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fe41600/0x40a459093b06b9db lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129581.450639:0:7087:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fe41600/0x40a459093b06b9db lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129581.450645:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:068dab75-d300-4ead-a742-d14572ad1e50+5:1963:x1830948734424576:12345-192.168.202.4@tcp:1:lfs.0 Request processed in 16380us (17030us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129581.450653:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16815 00010000:00010000:0.0:1746129581.450653:0:7087:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129581.450669:0:7087:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6ce1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+16:1962:x1830948734426752:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 94us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129581.450675:0:7087:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8720 00010000:00010000:2.0:1746129581.452158:0:11014:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009fe41600/0x40a459093b06b9db lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129581.452171:0:11014:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fe41600/0x40a459093b06b9db lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129581.452196:0:11014:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009fe41600/0x40a459093b06b9db lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129581.452202:0:11014:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009fe41600/0x40a459093b06b9db lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129581.452209:0:11014:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009fe41600/0x40a459093b06b9db lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129581.452214:0:11014:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fe41600 already unused, calling callback (ffffffffa086ed70) 00010000:00010000:2.0:1746129581.452217:0:11014:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009fe41600/0x40a459093b06b9db lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129581.452233:0:11014:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009fe41600/0x40a459093b06b9db lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129581.452251:0:11014:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009fe41600/0x40a459093b06b9db lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129581.452257:0:11014:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fe41600/0x40a459093b06b9db lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129581.452549:0:11014:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:068dab75-d300-4ead-a742-d14572ad1e50+7:1963:x1830948734424320:12345-192.168.202.4@tcp:1:lfs.0 Request processed in 18608us (19048us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129581.452558:0:11014:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16812 00000100:00100000:0.0:1746129581.454896:0:21725:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800903a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ada2ffba-8920-4ecb-8068-68caa9806978+25:1963:x1830948734426496:12345-192.168.202.4@tcp:4:cat.0 Request processed in 6146us (7120us total) trans 21474841425 rc 0/0 00000100:00100000:0.0:1746129581.454909:0:21725:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2530 00002000:00100000:0.0:1746129581.454922:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ee:0x0] (1875968->2097151) req@ffff8800903a1500 x1830948734426496/t21474841425(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:322/0 lens 488/448 e 0 to 0 dl 1746129592 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129581.454932:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800903a1500 with x1830948734426496 ext(1875968->2097151) 00010000:00010000:0.0:1746129581.454942:0:21725:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fe41a00/0x40a459093b06b956 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1875968->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2227d expref: 25 pid: 20577 timeout: 936 lvb_type: 0 00010000:00010000:0.0:1746129581.454955:0:21725:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fe41a00/0x40a459093b06b956 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1875968->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2227d expref: 25 pid: 20577 timeout: 936 lvb_type: 0 00002000:00010000:0.0:1746129581.455096:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800903a1500 00000100:00100000:0.0:1746129581.458920:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129581.459959:0:15749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734426880 00000100:00100000:2.0:1746129581.459970:0:15749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734426880 00010000:00010000:2.0:1746129581.460011:0:15749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fe41a00/0x40a459093b06b956 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1875968->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2227d expref: 25 pid: 20577 timeout: 936 lvb_type: 0 00000100:00100000:2.0:1746129581.460041:0:15749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8721 00000100:00100000:2.0:1746129581.460048:0:15749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3e7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ada2ffba-8920-4ecb-8068-68caa9806978+25:1960:x1830948734426880:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129581.460061:0:15749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129581.460085:0:15749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fe41a00/0x40a459093b06b956 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1875968->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2227d expref: 25 pid: 20577 timeout: 936 lvb_type: 0 00010000:00010000:2.0:1746129581.460097:0:15749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fe41a00/0x40a459093b06b956 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1875968->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2227d expref: 25 pid: 20577 timeout: 936 lvb_type: 0 00010000:00010000:2.0:1746129581.460119:0:15749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fe41a00/0x40a459093b06b956 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1875968->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2227d expref: 25 pid: 20577 timeout: 936 lvb_type: 0 00010000:00010000:2.0:1746129581.460142:0:15749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129581.460144:0:15749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129581.460148:0:15749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012bf7a000/0x40a459093b06b9fe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129581.460155:0:15749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012bf7a000/0x40a459093b06b9fe lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129581.460194:0:15749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129581.460254:0:15749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3e7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ada2ffba-8920-4ecb-8068-68caa9806978+24:1960:x1830948734426880:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 206us (1345us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129581.460261:0:15749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8721 00010000:00010000:3.0:1746129581.460340:0:20577:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012bf7a000/0x40a459093b06b9fe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129581.460349:0:20577:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012bf7a000/0x40a459093b06b9fe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129581.460370:0:20577:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012bf7a000/0x40a459093b06b9fe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129581.460377:0:20577:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012bf7a000/0x40a459093b06b9fe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129581.460383:0:20577:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012bf7a000/0x40a459093b06b9fe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129581.460388:0:20577:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012bf7a000 already unused, calling callback (ffffffffa086ed70) 00010000:00010000:3.0:1746129581.460391:0:20577:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012bf7a000/0x40a459093b06b9fe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129581.460398:0:20577:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012bf7a000/0x40a459093b06b9fe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129581.460408:0:20577:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012bf7a000/0x40a459093b06b9fe lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129581.460413:0:20577:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012bf7a000/0x40a459093b06b9fe lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129581.460458:0:20577:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:068dab75-d300-4ead-a742-d14572ad1e50+6:1963:x1830948734424704:12345-192.168.202.4@tcp:1:lfs.0 Request processed in 25994us (26886us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129581.460466:0:20577:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16817 00000100:00100000:1.0:1746129581.466538:0:31521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ada2ffba-8920-4ecb-8068-68caa9806978+24:1963:x1830948734426624:12345-192.168.202.4@tcp:4:cat.0 Request processed in 16096us (16567us total) trans 21474841426 rc 0/0 00000100:00100000:1.0:1746129581.466551:0:31521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2531 00002000:00100000:1.0:1746129581.466564:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3ef:0x0] (2097152->2789375) req@ffff8800947bc000 x1830948734426624/t21474841426(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:322/0 lens 488/448 e 0 to 0 dl 1746129592 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129581.466574:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800947bc000 with x1830948734426624 ext(2097152->2789375) 00010000:00010000:1.0:1746129581.466586:0:31521:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880132edc600/0x40a459093b06b964 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2789375) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2228b expref: 24 pid: 7148 timeout: 936 lvb_type: 0 00010000:00010000:1.0:1746129581.466603:0:31521:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880132edc600/0x40a459093b06b964 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2789375) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2228b expref: 24 pid: 7148 timeout: 936 lvb_type: 0 00002000:00010000:1.0:1746129581.466613:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800947bc000 00000100:00100000:0.0:1746129581.472022:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129581.472085:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734427008 00000100:00100000:2.0:1746129581.472094:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734427008 00010000:00010000:2.0:1746129581.472126:0:7087:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880132edc600/0x40a459093b06b964 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2789375) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2228b expref: 24 pid: 7148 timeout: 936 lvb_type: 0 00000100:00100000:2.0:1746129581.472165:0:7087:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8722 00000100:00100000:2.0:1746129581.472171:0:7087:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ada2ffba-8920-4ecb-8068-68caa9806978+24:1961:x1830948734427008:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129581.472182:0:7087:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129581.472199:0:7087:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880132edc600/0x40a459093b06b964 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2789375) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2228b expref: 24 pid: 7148 timeout: 936 lvb_type: 0 00010000:00010000:2.0:1746129581.472209:0:7087:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880132edc600/0x40a459093b06b964 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2789375) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2228b expref: 24 pid: 7148 timeout: 936 lvb_type: 0 00010000:00010000:2.0:1746129581.472246:0:7087:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880132edc600/0x40a459093b06b964 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2789375) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2228b expref: 24 pid: 7148 timeout: 936 lvb_type: 0 00010000:00010000:2.0:1746129581.472273:0:7087:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129581.472274:0:7087:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129581.472278:0:7087:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f447600/0x40a459093b06b9f7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129581.472285:0:7087:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f447600/0x40a459093b06b9f7 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129581.472317:0:7087:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746129581.472331:0:31503:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88008f447600/0x40a459093b06b9f7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129581.472336:0:31503:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f447600/0x40a459093b06b9f7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129581.472351:0:31503:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008f447600/0x40a459093b06b9f7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129581.472357:0:31503:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008f447600/0x40a459093b06b9f7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129581.472364:0:31503:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008f447600/0x40a459093b06b9f7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129581.472373:0:31503:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f447600 already unused, calling callback (ffffffffa086ed70) 00010000:00010000:2.0:1746129581.472376:0:31503:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008f447600/0x40a459093b06b9f7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129581.472381:0:31503:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008f447600/0x40a459093b06b9f7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129581.472389:0:31503:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008f447600/0x40a459093b06b9f7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129581.472393:0:31503:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f447600/0x40a459093b06b9f7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129581.472453:0:31503:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:068dab75-d300-4ead-a742-d14572ad1e50+5:1963:x1830948734424832:12345-192.168.202.4@tcp:1:lfs.0 Request processed in 38100us (38809us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129581.472461:0:31503:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16816 00000100:00100000:2.0:1746129581.472484:0:7087:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ada2ffba-8920-4ecb-8068-68caa9806978+23:1961:x1830948734427008:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 314us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129581.472489:0:7087:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8722 00000100:00100000:0.0:1746129581.475258:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129581.475365:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734427264 00000100:00100000:2.0:1746129581.475374:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734427264 00000100:00100000:2.0:1746129581.475422:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11354 00000100:00100000:2.0:1746129581.475428:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:068dab75-d300-4ead-a742-d14572ad1e50+21:32692:x1830948734427264:12345-192.168.202.4@tcp:36:lfs.0 00010000:00010000:2.0:1746129581.475465:0:14549:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1746129581.475483:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fba5600/0x40a459093b06b21e lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21cf7 expref: 21 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129581.475499:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095287e00/0x40a459093b06b1fb lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21ce2 expref: 20 pid: 14547 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129581.475509:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:2.0:1746129581.475512:0:14549:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746129581.475532:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880095d0dc00/0x40a459093b06ba05 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129581.475541:0:14549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f725600/0x40a459093b06a624 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21579 expref: 301 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129581.475548:0:14549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880090078000/0x40a459093b06a62b lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21587 expref: 301 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129581.475553:0:14549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b637800/0x40a459093b06a640 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21595 expref: 23 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129581.475559:0:14549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3a4a00/0x40a459093b06a7f2 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21698 expref: 23 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129581.475565:0:14549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f891000/0x40a459093b06a996 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2179b expref: 301 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129581.475570:0:14549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f93ee00/0x40a459093b06aa1b lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f217f6 expref: 301 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129581.475576:0:14549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cdfc000/0x40a459093b06ac05 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f21907 expref: 23 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129581.475586:0:14549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095d0dc00/0x40a459093b06ba05 lrc: 10/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129581.475608:0:14549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009cdfc000/0x40a459093b06ac05 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21907 expref: 23 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129581.475618:0:14549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cdfc000/0x40a459093b06ac05 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21907 expref: 23 pid: 16908 timeout: 936 lvb_type: 0 00000100:00100000:2.0:1746129581.475628:0:14549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e388700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830948737624064:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129581.476259:0:14549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008f93ee00/0x40a459093b06aa1b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f217f6 expref: 301 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129581.476269:0:14549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f93ee00/0x40a459093b06aa1b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f217f6 expref: 301 pid: 16908 timeout: 936 lvb_type: 0 00000100:00100000:2.0:1746129581.476277:0:14549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e389f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830948737624192:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129581.476535:0:14549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012f891000/0x40a459093b06a996 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2179b expref: 301 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129581.476543:0:14549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f891000/0x40a459093b06a996 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2179b expref: 301 pid: 16908 timeout: 936 lvb_type: 0 00000100:00100000:2.0:1746129581.476550:0:14549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e38a680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830948737624320:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129581.476586:0:14549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3a4a00/0x40a459093b06a7f2 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21698 expref: 23 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129581.476597:0:14549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3a4a00/0x40a459093b06a7f2 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21698 expref: 23 pid: 16908 timeout: 936 lvb_type: 0 00000100:00100000:2.0:1746129581.476603:0:14549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e38b800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830948737624448:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129581.476631:0:14549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012b637800/0x40a459093b06a640 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21595 expref: 23 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129581.476638:0:14549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b637800/0x40a459093b06a640 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21595 expref: 23 pid: 2271 timeout: 936 lvb_type: 0 00000100:00100000:2.0:1746129581.476644:0:14549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e388e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830948737624576:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129581.476645:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00010000:00010000:2.0:1746129581.476668:0:14549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880090078000/0x40a459093b06a62b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21587 expref: 301 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129581.476675:0:14549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880090078000/0x40a459093b06a62b lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21587 expref: 301 pid: 2271 timeout: 936 lvb_type: 0 00000100:00100000:2.0:1746129581.476682:0:14549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e389180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830948737624704:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129581.476705:0:14549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f725600/0x40a459093b06a624 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21579 expref: 301 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129581.476711:0:14549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f725600/0x40a459093b06a624 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21579 expref: 301 pid: 15096 timeout: 936 lvb_type: 0 00000100:00100000:2.0:1746129581.476718:0:14549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e389880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830948737624832:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129581.476740:0:14549:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b5354cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129581.476741:0:15749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734427392 00000100:00100000:0.0:1746129581.476747:0:15749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734427392 00000100:00100000:2.0:1746129581.476761:0:14549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e388700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830948737624064:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129581.476777:0:15749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cdfc000/0x40a459093b06ac05 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21907 expref: 24 pid: 16908 timeout: 936 lvb_type: 0 00000100:00100000:0.0:1746129581.476811:0:15749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8723 00000100:00100000:0.0:1746129581.476819:0:15749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+24:1963:x1830948734427392:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129581.476831:0:15749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129581.476837:0:15749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009cdfc000/0x40a459093b06ac05 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21907 expref: 24 pid: 16908 timeout: 936 lvb_type: 0 00010000:00010000:0.0:1746129581.477050:0:15749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009cdfc000/0x40a459093b06ac05 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21907 expref: 24 pid: 16908 timeout: 936 lvb_type: 0 00010000:00010000:0.0:1746129581.477244:0:15749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cdfc000/0x40a459093b06ac05 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21907 expref: 24 pid: 16908 timeout: 936 lvb_type: 0 00010000:00010000:0.0:1746129581.477278:0:15749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:0.0:1746129581.477284:0:15749:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880095d0dc00/0x40a459093b06ba05 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129581.477323:0:15749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129581.477360:0:15749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+23:1963:x1830948734427392:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 542us (717us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129581.477367:0:15749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8723 00000100:00100000:2.0:1746129581.478572:0:14549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e389f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830948737624192:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129581.479894:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129581.480057:0:15749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734427520 00000100:00100000:2.0:1746129581.480065:0:15749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734427520 00010000:00010000:2.0:1746129581.480106:0:15749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f93ee00/0x40a459093b06aa1b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f217f6 expref: 302 pid: 16908 timeout: 936 lvb_type: 0 00000100:00100000:2.0:1746129581.480135:0:15749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8724 00000100:00100000:2.0:1746129581.480142:0:15749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ada2ffba-8920-4ecb-8068-68caa9806978+302:1963:x1830948734427520:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129581.480155:0:15749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129581.480160:0:15749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008f93ee00/0x40a459093b06aa1b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f217f6 expref: 302 pid: 16908 timeout: 936 lvb_type: 0 00010000:00010000:2.0:1746129581.480169:0:15749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008f93ee00/0x40a459093b06aa1b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f217f6 expref: 302 pid: 16908 timeout: 936 lvb_type: 0 00010000:00010000:2.0:1746129581.480190:0:15749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f93ee00/0x40a459093b06aa1b lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f217f6 expref: 302 pid: 16908 timeout: 936 lvb_type: 0 00010000:00010000:2.0:1746129581.480204:0:15749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:2.0:1746129581.480208:0:15749:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880095d0dc00/0x40a459093b06ba05 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129581.480218:0:15749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129581.480389:0:15749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ada2ffba-8920-4ecb-8068-68caa9806978+301:1963:x1830948734427520:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 247us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129581.480399:0:15749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8724 00000100:00100000:3.0:1746129581.480427:0:14549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e38a680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830948737624320:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129581.480776:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129581.480867:0:20861:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734427776 00000100:00100000:2.0:1746129581.480871:0:20861:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734427776 00000100:00100000:2.0:1746129581.480901:0:20861:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4843 00000100:00100000:2.0:1746129581.480906:0:20861:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094cc9c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:ada2ffba-8920-4ecb-8068-68caa9806978+301:27233:x1830948734427776:12345-192.168.202.4@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1746129581.480914:0:14549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e38b800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830948737624448:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129581.480928:0:14549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e388e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830948737624576:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129581.480933:0:14549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e389180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830948737624704:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129581.481143:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129581.481165:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129581.481186:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129581.481198:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734428160 00000100:00100000:3.0:1746129581.481202:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734428160 00010000:00010000:3.0:1746129581.481229:0:7087:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b637800/0x40a459093b06a640 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21595 expref: 23 pid: 2271 timeout: 936 lvb_type: 0 00000100:00100000:3.0:1746129581.481247:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734428288 00000100:00100000:3.0:1746129581.481248:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734428288 00010000:00010000:3.0:1746129581.481257:0:7087:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090078000/0x40a459093b06a62b lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21587 expref: 303 pid: 2271 timeout: 936 lvb_type: 0 00000100:00100000:3.0:1746129581.481269:0:7087:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8725 00000100:00100000:3.0:1746129581.481273:0:7087:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3e6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+23:1963:x1830948734428160:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129581.481280:0:7087:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129581.481284:0:7087:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012b637800/0x40a459093b06a640 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21595 expref: 23 pid: 2271 timeout: 936 lvb_type: 0 00010000:00010000:3.0:1746129581.481291:0:7087:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012b637800/0x40a459093b06a640 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21595 expref: 23 pid: 2271 timeout: 936 lvb_type: 0 00010000:00010000:3.0:1746129581.481320:0:7087:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b637800/0x40a459093b06a640 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21595 expref: 23 pid: 2271 timeout: 936 lvb_type: 0 00010000:00010000:3.0:1746129581.481334:0:7087:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:3.0:1746129581.481337:0:7087:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880095d0dc00/0x40a459093b06ba05 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00000100:00100000:2.0:1746129581.481337:0:20861:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094cc9c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:ada2ffba-8920-4ecb-8068-68caa9806978+303:27233:x1830948734427776:12345-192.168.202.4@tcp:35:ldlm_bl.0 Request processed in 431us (562us total) trans 8589945479 rc 0/0 00010000:00010000:3.0:1746129581.481343:0:7087:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129581.481343:0:20861:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4843 00000100:00100000:3.0:1746129581.481362:0:7087:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3e6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+22:1963:x1830948734428160:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 89us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129581.481367:0:7087:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8725 00000100:00100000:3.0:1746129581.481376:0:7087:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8726 00000100:00100000:2.0:1746129581.481376:0:20861:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734428032 00000100:00100000:2.0:1746129581.481378:0:20861:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734428032 00000100:00100000:3.0:1746129581.481380:0:7087:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ada2ffba-8920-4ecb-8068-68caa9806978+302:1963:x1830948734428288:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129581.481386:0:7087:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129581.481389:0:7087:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880090078000/0x40a459093b06a62b lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21587 expref: 302 pid: 2271 timeout: 936 lvb_type: 0 00000100:00100000:2.0:1746129581.481390:0:20861:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4844 00000100:00100000:2.0:1746129581.481393:0:20861:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+22:27693:x1830948734428032:12345-192.168.202.4@tcp:35:ldlm_bl.0 00010000:00010000:3.0:1746129581.481397:0:7087:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880090078000/0x40a459093b06a62b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21587 expref: 302 pid: 2271 timeout: 936 lvb_type: 0 00010000:00010000:3.0:1746129581.481407:0:7087:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090078000/0x40a459093b06a62b lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21587 expref: 302 pid: 2271 timeout: 936 lvb_type: 0 00010000:00010000:3.0:1746129581.481418:0:7087:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:3.0:1746129581.481421:0:7087:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880095d0dc00/0x40a459093b06ba05 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129581.481426:0:7087:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129581.481439:0:7087:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ada2ffba-8920-4ecb-8068-68caa9806978+301:1963:x1830948734428288:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 59us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129581.481444:0:7087:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8726 00000100:00100000:2.0:1746129581.481452:0:20861:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+23:27693:x1830948734428032:12345-192.168.202.4@tcp:35:ldlm_bl.0 Request processed in 58us (309us total) trans 8589945480 rc 0/0 00000100:00100000:2.0:1746129581.481457:0:20861:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4844 00000100:00100000:0.0:1746129581.482900:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129581.482997:0:14549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e389880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830948737624832:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129581.483044:0:14549:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880095d0dc00/0x40a459093b06ba05 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000100:00100000:1.0:1746129581.483050:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734428416 00000100:00100000:1.0:1746129581.483055:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734428416 00010000:00010000:1.0:1746129581.483078:0:9823:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f725600/0x40a459093b06a624 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21579 expref: 301 pid: 15096 timeout: 936 lvb_type: 0 00000100:00100000:1.0:1746129581.483104:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8727 00000100:00100000:1.0:1746129581.483110:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6ce0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ada2ffba-8920-4ecb-8068-68caa9806978+301:1960:x1830948734428416:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129581.483123:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129581.483128:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f725600/0x40a459093b06a624 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21579 expref: 301 pid: 15096 timeout: 936 lvb_type: 0 00010000:00010000:1.0:1746129581.483140:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f725600/0x40a459093b06a624 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21579 expref: 301 pid: 15096 timeout: 936 lvb_type: 0 00010000:00010000:1.0:1746129581.483162:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f725600/0x40a459093b06a624 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21579 expref: 301 pid: 15096 timeout: 936 lvb_type: 0 00010000:00010000:1.0:1746129581.483179:0:9823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:1.0:1746129581.483182:0:9823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880095d0dc00/0x40a459093b06ba05 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129581.483189:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129581.483218:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6ce0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ada2ffba-8920-4ecb-8068-68caa9806978+300:1960:x1830948734428416:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 107us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129581.483234:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8727 00000100:00100000:0.0:1746129581.484291:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129581.484344:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734428544 00000100:00100000:1.0:1746129581.484348:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734428544 00010000:00010000:1.0:1746129581.484369:0:9823:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f891000/0x40a459093b06a996 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2179b expref: 300 pid: 16908 timeout: 936 lvb_type: 0 00000100:00100000:0.0:1746129581.484377:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129581.484407:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734428672 00000100:00100000:1.0:1746129581.484409:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734428672 00010000:00010000:1.0:1746129581.484421:0:9823:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3a4a00/0x40a459093b06a7f2 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21698 expref: 23 pid: 16908 timeout: 936 lvb_type: 0 00000100:00100000:1.0:1746129581.484436:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8728 00000100:00100000:1.0:1746129581.484443:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3e7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ada2ffba-8920-4ecb-8068-68caa9806978+300:1961:x1830948734428544:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129581.484451:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129581.484455:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012f891000/0x40a459093b06a996 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2179b expref: 300 pid: 16908 timeout: 936 lvb_type: 0 00010000:00010000:1.0:1746129581.484464:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012f891000/0x40a459093b06a996 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2179b expref: 300 pid: 16908 timeout: 936 lvb_type: 0 00010000:00010000:1.0:1746129581.484479:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f891000/0x40a459093b06a996 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2179b expref: 300 pid: 16908 timeout: 936 lvb_type: 0 00010000:00010000:1.0:1746129581.484491:0:9823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:1.0:1746129581.484495:0:9823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880095d0dc00/0x40a459093b06ba05 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129581.484501:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129581.484525:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3e7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ada2ffba-8920-4ecb-8068-68caa9806978+299:1961:x1830948734428544:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 82us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129581.484532:0:7087:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8729 00000100:00100000:1.0:1746129581.484543:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8728 00000100:00100000:3.0:1746129581.484601:0:7087:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+23:1963:x1830948734428672:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129581.484609:0:7087:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129581.484613:0:7087:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3a4a00/0x40a459093b06a7f2 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21698 expref: 23 pid: 16908 timeout: 936 lvb_type: 0 00010000:00010000:3.0:1746129581.484623:0:7087:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3a4a00/0x40a459093b06a7f2 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21698 expref: 23 pid: 16908 timeout: 936 lvb_type: 0 00010000:00010000:3.0:1746129581.484639:0:7087:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3a4a00/0x40a459093b06a7f2 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f21698 expref: 23 pid: 16908 timeout: 936 lvb_type: 0 00010000:00010000:3.0:1746129581.484648:0:7087:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:3.0:1746129581.484651:0:7087:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880095d0dc00/0x40a459093b06ba05 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129581.484658:0:7087:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095d0dc00/0x40a459093b06ba05 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129581.484664:0:7087:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095d0dc00/0x40a459093b06ba05 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129581.484691:0:7087:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129581.484723:0:7087:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+22:1963:x1830948734428672:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 184us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129581.484729:0:7087:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8729 00010000:00010000:0.0:1746129581.484825:0:14549:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880095d0dc00/0x40a459093b06ba05 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129581.484832:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095d0dc00/0x40a459093b06ba05 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000040:00080000:1.0:1746129581.486094:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3490, 88 off293848 00000004:00080000:1.0:1746129581.486103:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 836802808326ns, next at 776349687452ns, rc = 0 00000040:00080000:1.0:1746129581.486160:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3500, 88 off294640 00000004:00080000:1.0:1746129581.486165:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 836802871190ns, next at 776375382381ns, rc = 0 00000040:00080000:1.0:1746129581.486177:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3501, 88 off294728 00000004:00080000:1.0:1746129581.486180:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 836802885781ns, next at 776375382381ns, rc = 0 00000040:00080000:1.0:1746129581.486186:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3491, 88 off293936 00000004:00080000:1.0:1746129581.486188:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 836802894300ns, next at 776349687452ns, rc = 0 00000040:00080000:1.0:1746129581.486195:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3492, 88 off294024 00000004:00080000:1.0:1746129581.486198:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 836802903887ns, next at 776349687452ns, rc = 0 00000040:00080000:1.0:1746129581.486205:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3502, 88 off294816 00000004:00080000:1.0:1746129581.486209:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 836802915090ns, next at 776375382381ns, rc = 0 00000040:00080000:1.0:1746129581.486249:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3504, 88 off295000 00000004:00080000:1.0:1746129581.486253:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 836802959289ns, next at 776375382381ns, rc = 0 00000040:00080000:1.0:1746129581.486261:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3505, 88 off295088 00000004:00080000:1.0:1746129581.486264:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 836802970260ns, next at 776375382381ns, rc = 0 00000040:00080000:1.0:1746129581.486270:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3493, 88 off294112 00000004:00080000:1.0:1746129581.486272:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 836802978457ns, next at 776349687452ns, rc = 0 00000040:00080000:1.0:1746129581.486290:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3506, 88 off295176 00000004:00080000:1.0:1746129581.486311:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 836803016977ns, next at 776375382381ns, rc = 0 00000040:00080000:1.0:1746129581.486320:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3494, 88 off294200 00000004:00080000:1.0:1746129581.486322:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 836803028280ns, next at 776349687452ns, rc = 0 00000040:00080000:1.0:1746129581.486328:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3507, 88 off295264 00000004:00080000:1.0:1746129581.486331:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 836803036917ns, next at 776375382381ns, rc = 0 00000040:00080000:1.0:1746129581.486336:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3495, 88 off294288 00000004:00080000:1.0:1746129581.486339:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 836803044757ns, next at 776349687452ns, rc = 0 00000040:00080000:1.0:1746129581.486344:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3496, 88 off294376 00000004:00080000:1.0:1746129581.486346:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 836803052734ns, next at 776349687452ns, rc = 0 00000040:00080000:1.0:1746129581.486352:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3497, 88 off294464 00000004:00080000:1.0:1746129581.486354:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 836803059807ns, next at 776349687452ns, rc = 0 00000040:00080000:1.0:1746129581.486358:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3498, 88 off294552 00000004:00080000:1.0:1746129581.486360:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 836803066181ns, next at 776349687452ns, rc = 0 00000040:00080000:1.0:1746129581.486365:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3508, 88 off295352 00000004:00080000:1.0:1746129581.486367:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 836803072805ns, next at 776375382381ns, rc = 0 00010000:00010000:2.0:1746129581.502887:0:7089:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00010000:1.0:1746129581.509135:0:14549:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009f3e7480 reply state ffff88008f45d000 transno 8589945481 ns: mdt-lustre-MDT0000_UUID lock: ffff880095d0dc00/0x40a459093b06ba05 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000100:00100000:1.0:1746129581.509169:0:14549:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1746129581.509341:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:068dab75-d300-4ead-a742-d14572ad1e50+21:32692:x1830948734427264:12345-192.168.202.4@tcp:36:lfs.0 Request processed in 33907us (34085us total) trans 8589945481 rc 0/0 00000100:00100000:1.0:1746129581.509351:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11354 00000001:00080000:1.0:1746129581.509386:0:14619:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945470 is committed 00000001:00080000:1.0:1746129581.509399:0:14619:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945458 is committed 00000001:00080000:1.0:1746129581.509414:0:14619:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945481 is committed 00000004:00080000:1.0:1746129581.509418:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2677 committed 00000004:00080000:1.0:1746129581.509424:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2668 committed 00000004:00080000:1.0:1746129581.509430:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2667 committed 00000004:00080000:1.0:1746129581.509432:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2666 committed 00000004:00080000:1.0:1746129581.509433:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2665 committed 00000004:00080000:1.0:1746129581.509435:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2676 committed 00000004:00080000:1.0:1746129581.509436:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2664 committed 00000004:00080000:1.0:1746129581.509438:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2675 committed 00000004:00080000:1.0:1746129581.509439:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2663 committed 00000004:00080000:1.0:1746129581.509441:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2674 committed 00000004:00080000:1.0:1746129581.509442:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2673 committed 00000004:00080000:1.0:1746129581.509444:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2672 committed 00000004:00080000:1.0:1746129581.509445:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2662 committed 00000004:00080000:1.0:1746129581.509447:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2661 committed 00000004:00080000:1.0:1746129581.509449:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2671 committed 00000004:00080000:1.0:1746129581.509451:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2670 committed 00000004:00080000:1.0:1746129581.509452:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2660 committed 00000001:00080000:1.0:1746129581.509463:0:14619:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945474 is committed 00000001:00080000:1.0:1746129581.509468:0:14619:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945464 is committed 00000001:00080000:1.0:1746129581.509498:0:14619:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945480 is committed 00000001:00080000:1.0:1746129581.509503:0:14619:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945479 is committed 00000100:00100000:0.0:1746129581.509672:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f3e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737625344:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129581.509721:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129581.509758:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800903a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737625856:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129581.509773:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129581.509791:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b550380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737626368:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129581.509829:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f3e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1830948737624960:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129581.509852:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129581.509865:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800903a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1830948737625472:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129581.509878:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129581.509889:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b552a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1830948737625984:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129581.509901:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129581.509912:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b552d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1830948737626496:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129581.509924:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129581.509942:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f3e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737625088:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129581.509958:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129581.509970:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800903a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737625600:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129581.509983:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129581.509992:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b550e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737626112:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129581.510003:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129581.510013:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012baece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737626624:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129581.510026:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129581.510038:0:3300:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:3.0:1746129581.510042:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f3e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737625216:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129581.510054:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129581.510064:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800903a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737625728:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129581.510076:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129581.510084:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b552680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737626240:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129581.510095:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129581.510101:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012baedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737626752:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129581.510117:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129581.510137:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737625344 00000100:00100000:3.0:1746129581.510144:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737625344 00000100:00100000:3.0:1746129581.510171:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737625856 00000100:00100000:3.0:1746129581.510173:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737625856 00000100:00100000:3.0:1746129581.510180:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737624960 00000100:00100000:3.0:1746129581.510182:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737624960 00000100:00100000:3.0:1746129581.510187:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737625472 00000100:00100000:3.0:1746129581.510189:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737625472 00000100:00100000:3.0:1746129581.510195:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737625984 00000100:00100000:3.0:1746129581.510197:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737625984 00000100:00100000:3.0:1746129581.510205:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737626496 00000100:00100000:3.0:1746129581.510206:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737626496 00000100:00100000:3.0:1746129581.510212:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737625088 00000100:00100000:3.0:1746129581.510213:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737625088 00000100:00100000:3.0:1746129581.510230:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737625600 00000100:00100000:3.0:1746129581.510231:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737625600 00000100:00100000:3.0:1746129581.510237:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737626112 00000100:00100000:3.0:1746129581.510239:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737626112 00000100:00100000:3.0:1746129581.510245:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737626624 00000100:00100000:3.0:1746129581.510247:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737626624 00000100:00100000:3.0:1746129581.510253:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737625216 00000100:00100000:3.0:1746129581.510254:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737625216 00000100:00100000:3.0:1746129581.510259:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737625728 00000100:00100000:3.0:1746129581.510261:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737625728 00000100:00100000:3.0:1746129581.510265:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737626240 00000100:00100000:3.0:1746129581.510266:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737626240 00000100:00100000:3.0:1746129581.510271:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737626752 00000100:00100000:3.0:1746129581.510272:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737626752 00000100:00100000:3.0:1746129581.510280:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16818 00000100:00100000:3.0:1746129581.510285:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800903a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+12:3302:x1830948737625344:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746129581.510491:0:4385:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746129581.510494:0:4385:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb mtime from disk: 1746129523 -> 1746129523 00002000:00010000:3.0:1746129581.510496:0:4385:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb atime from disk: 1746129523 -> 1746129523 00002000:00010000:3.0:1746129581.510498:0:4385:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb ctime from disk: 1746129524 -> 1746129524 00002000:00010000:3.0:1746129581.510500:0:4385:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1746129581.510523:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800903a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+13:3302:x1830948737625344:12345-0@lo:2:osp-syn-1-0.0 Request processed in 238us (801us total) trans 17179874183 rc 0/0 00000100:00100000:3.0:1746129581.510528:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16818 00000100:00100000:3.0:1746129581.510539:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16819 00000100:00100000:3.0:1746129581.510543:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800903a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+12:3302:x1830948737625856:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129581.510626:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800903a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+13:3302:x1830948737625856:12345-0@lo:2:osp-syn-1-0.0 Request processed in 81us (851us total) trans 17179874184 rc 0/0 00000100:00100000:3.0:1746129581.510631:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16819 00000100:00100000:3.0:1746129581.510641:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16820 00000100:00100000:3.0:1746129581.510645:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+12:3303:x1830948737624960:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129581.510733:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+13:3303:x1830948737624960:12345-0@lo:2:osp-syn-1-0.0 Request processed in 87us (880us total) trans 17179874185 rc 0/0 00000100:00100000:3.0:1746129581.510741:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16820 00000100:00100000:3.0:1746129581.510749:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16821 00000100:00100000:3.0:1746129581.510754:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+12:3303:x1830948737625472:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129581.510831:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+13:3303:x1830948737625472:12345-0@lo:2:osp-syn-1-0.0 Request processed in 77us (951us total) trans 17179874186 rc 0/0 00000100:00100000:3.0:1746129581.510836:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16821 00000100:00100000:3.0:1746129581.510845:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16822 00000100:00100000:3.0:1746129581.510849:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+10:3303:x1830948737625984:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129581.510960:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+11:3303:x1830948737625984:12345-0@lo:2:osp-syn-0-0.0 Request processed in 110us (1056us total) trans 21474841427 rc 0/0 00000100:00100000:3.0:1746129581.510965:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16822 00000100:00100000:3.0:1746129581.510975:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16823 00000100:00100000:3.0:1746129581.510979:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+10:3303:x1830948737626496:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129581.511057:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+11:3303:x1830948737626496:12345-0@lo:2:osp-syn-0-0.0 Request processed in 77us (1131us total) trans 21474841428 rc 0/0 00000100:00100000:3.0:1746129581.511062:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16823 00000100:00100000:3.0:1746129581.511073:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16824 00000100:00100000:3.0:1746129581.511077:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+12:3300:x1830948737625088:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129581.511158:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+13:3300:x1830948737625088:12345-0@lo:2:osp-syn-1-0.0 Request processed in 80us (1198us total) trans 17179874187 rc 0/0 00000100:00100000:3.0:1746129581.511162:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16824 00000100:00100000:3.0:1746129581.511172:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16825 00000100:00100000:3.0:1746129581.511177:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013575c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+12:3300:x1830948737625600:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129581.511272:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013575c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+13:3300:x1830948737625600:12345-0@lo:2:osp-syn-1-0.0 Request processed in 95us (1287us total) trans 17179874188 rc 0/0 00000100:00100000:3.0:1746129581.511277:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16825 00000100:00100000:3.0:1746129581.511315:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16826 00000100:00100000:3.0:1746129581.511321:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013575fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+10:3300:x1830948737626112:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129581.511408:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013575fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+11:3300:x1830948737626112:12345-0@lo:2:osp-syn-0-0.0 Request processed in 86us (1402us total) trans 21474841429 rc 0/0 00000100:00100000:3.0:1746129581.511413:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16826 00000100:00100000:3.0:1746129581.511423:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16827 00000100:00100000:3.0:1746129581.511427:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013575c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+10:3300:x1830948737626624:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129581.511505:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013575c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+11:3300:x1830948737626624:12345-0@lo:2:osp-syn-0-0.0 Request processed in 78us (1478us total) trans 21474841430 rc 0/0 00000100:00100000:3.0:1746129581.511511:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16827 00000100:00100000:3.0:1746129581.511521:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16828 00000100:00100000:3.0:1746129581.511525:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013575c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+12:3300:x1830948737625216:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129581.511605:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013575c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+13:3300:x1830948737625216:12345-0@lo:2:osp-syn-1-0.0 Request processed in 80us (1549us total) trans 17179874189 rc 0/0 00000100:00100000:3.0:1746129581.511610:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16828 00000100:00100000:3.0:1746129581.511619:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16829 00000100:00100000:3.0:1746129581.511624:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013575ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+12:3300:x1830948737625728:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129581.511701:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013575ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+13:3300:x1830948737625728:12345-0@lo:2:osp-syn-1-0.0 Request processed in 77us (1623us total) trans 17179874190 rc 0/0 00000100:00100000:3.0:1746129581.511706:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16829 00000100:00100000:3.0:1746129581.511716:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16830 00000100:00100000:3.0:1746129581.511720:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013575ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+10:3300:x1830948737626240:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129581.511801:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013575ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+11:3300:x1830948737626240:12345-0@lo:2:osp-syn-0-0.0 Request processed in 80us (1704us total) trans 21474841431 rc 0/0 00000100:00100000:3.0:1746129581.511806:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16830 00000100:00100000:3.0:1746129581.511816:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16831 00000100:00100000:3.0:1746129581.511821:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c29e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+10:3300:x1830948737626752:12345-0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1746129581.512193:0:3286:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880095d0dc00/0x40a459093b06ba05 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129581.512205:0:3286:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095d0dc00/0x40a459093b06ba05 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129581.512211:0:3286:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095d0dc00/0x40a459093b06ba05 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129581.512216:0:3286:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095d0dc00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746129581.512233:0:3286:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095d0dc00/0x40a459093b06ba05 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129581.512240:0:3286:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095d0dc00/0x40a459093b06ba05 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129581.512255:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:2.0:1746129581.512258:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746129581.512263:0:3286:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095d0dc00/0x40a459093b06ba05 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129581.512268:0:3286:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095d0dc00/0x40a459093b06ba05 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00000100:00100000:0.0:1746129581.513179:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129581.513271:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012baefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737626880:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129581.513284:0:11014:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737626368 00000100:00100000:2.0:1746129581.513311:0:11014:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737626368 00000100:00100000:0.0:1746129581.513314:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129581.513349:0:11014:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737626880 00000100:00100000:2.0:1746129581.513351:0:11014:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737626880 00000004:00080000:0.0:1746129581.513364:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f3e6d80/2, rc 0, transno 17179874183 00000100:00100000:2.0:1746129581.513370:0:11014:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16832 00000100:00100000:0.0:1746129581.513370:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f3e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737625344:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129581.513376:0:11014:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+13:3302:x1830948737626368:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129581.513379:0:22481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16833 00000004:00080000:0.0:1746129581.513380:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800903a3480/2, rc 0, transno 17179874184 00000100:00100000:0.0:1746129581.513383:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800903a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737625856:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129581.513389:0:22481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+13:3302:x1830948737626880:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129581.513596:0:22481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+15:3302:x1830948737626880:12345-0@lo:2:osp-syn-0-0.0 Request processed in 209us (280us total) trans 21474841433 rc 0/0 00000100:00100000:2.0:1746129581.513597:0:11014:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+15:3302:x1830948737626368:12345-0@lo:2:osp-syn-0-0.0 Request processed in 221us (421us total) trans 21474841434 rc 0/0 00000100:00100000:0.0:1746129581.513602:0:22481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16833 00000100:00100000:2.0:1746129581.513605:0:11014:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16832 00000004:00080000:1.0:1746129581.513682:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b550380/2, rc 0, transno 21474841434 00000100:00100000:1.0:1746129581.513691:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b550380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737626368:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746129581.513700:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012baefb80/2, rc 0, transno 21474841433 00000100:00100000:1.0:1746129581.513703:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012baefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737626880:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129581.513807:0:3302:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1746129581.513815:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fc2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737627008:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129581.513839:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129581.513848:0:11014:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737627008 00000100:00100000:2.0:1746129581.513851:0:11014:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737627008 00000100:00100000:2.0:1746129581.513861:0:11014:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16834 00000100:00100000:2.0:1746129581.513864:0:11014:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+14:3302:x1830948737627008:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129581.513980:0:11014:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+15:3302:x1830948737627008:12345-0@lo:2:osp-syn-0-0.0 Request processed in 114us (140us total) trans 21474841435 rc 0/0 00000100:00100000:2.0:1746129581.513984:0:11014:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16834 00000004:00080000:1.0:1746129581.514005:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fc2c700/2, rc 0, transno 21474841435 00000100:00100000:1.0:1746129581.514010:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fc2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737627008:0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746129581.514059:0:4385:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746129581.514063:0:4385:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1746129581.514065:0:4385:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746129581.514067:0:4385:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1746129581.514069:0:4385:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1746129581.514100:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c29e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+14:3300:x1830948737626752:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2278us (3981us total) trans 21474841432 rc 0/0 00000100:00100000:3.0:1746129581.514107:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16831 00000100:00100000:1.0:1746129581.514654:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129581.514792:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734428800 00000100:00100000:0.0:1746129581.514798:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734428800 00000100:00100000:0.0:1746129581.514830:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11355 00000100:00100000:0.0:1746129581.514836:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:068dab75-d300-4ead-a742-d14572ad1e50+7:32692:x1830948734428800:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:0.0:1746129581.514853:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129581.514869:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fba5000/0x40a459093b06ba0c lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f222d1 expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129581.514920:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fba5000/0x40a459093b06ba0c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f222d1 expref: 8 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129581.514933:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fba5000/0x40a459093b06ba0c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f222d1 expref: 8 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129581.514951:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:0.0:1746129581.514954:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746129581.514957:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fba5000, rc 0) 00000100:00100000:0.0:1746129581.514992:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:068dab75-d300-4ead-a742-d14572ad1e50+8:32692:x1830948734428800:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 155us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129581.514997:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11355 00000004:00080000:3.0:1746129581.515113:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f3e6680/2, rc 0, transno 17179874189 00000100:00100000:3.0:1746129581.515119:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f3e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737625216:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746129581.515136:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800903a2300/2, rc 0, transno 17179874190 00000100:00100000:3.0:1746129581.515139:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800903a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737625728:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746129581.515150:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b552680/2, rc 0, transno 21474841431 00000100:00100000:3.0:1746129581.515153:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b552680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737626240:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746129581.515161:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012baedc00/2, rc 0, transno 21474841432 00000100:00100000:3.0:1746129581.515163:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012baedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737626752:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746129581.515172:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f3e6a00/2, rc 0, transno 17179874187 00000100:00100000:3.0:1746129581.515175:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f3e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737625088:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746129581.515186:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800903a2680/2, rc 0, transno 17179874188 00000100:00100000:3.0:1746129581.515188:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800903a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737625600:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746129581.515196:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b550e00/2, rc 0, transno 21474841429 00000100:00100000:3.0:1746129581.515199:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b550e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737626112:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746129581.515206:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012baece00/2, rc 0, transno 21474841430 00000100:00100000:3.0:1746129581.515208:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012baece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737626624:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746129581.515330:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f3e5f80/2, rc 0, transno 17179874185 00000100:00100000:3.0:1746129581.515334:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f3e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1830948737624960:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746129581.515344:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800903a3b80/2, rc 0, transno 17179874186 00000100:00100000:3.0:1746129581.515346:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800903a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1830948737625472:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746129581.515354:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b552a00/2, rc 0, transno 21474841427 00000100:00100000:3.0:1746129581.515356:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b552a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1830948737625984:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746129581.515364:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b552d80/2, rc 0, transno 21474841428 00000100:00100000:3.0:1746129581.515367:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b552d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1830948737626496:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129581.520866:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129581.520942:0:16908:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734428928 00000100:00100000:1.0:1746129581.520956:0:16908:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734428928 00000100:00100000:1.0:1746129581.521018:0:16908:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11356 00000100:00100000:1.0:1746129581.521026:0:16908:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:068dab75-d300-4ead-a742-d14572ad1e50+8:32692:x1830948734428928:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:1.0:1746129581.521046:0:16908:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129581.521065:0:16908:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095801000/0x40a459093b06ba13 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f222d8 expref: -99 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129581.521150:0:16908:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095800c00/0x40a459093b06ba1a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129581.521163:0:16908:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095800c00/0x40a459093b06ba1a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129581.521174:0:16908:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095800c00/0x40a459093b06ba1a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00000004:00200000:1.0:1746129581.521202:0:16908:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00000004:00200000:1.0:1746129581.521207:0:16908:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746129581.521232:0:16908:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880095800c00/0x40a459093b06ba1a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129581.521257:0:16908:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095801000/0x40a459093b06ba13 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f222d8 expref: 10 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129581.522844:0:16908:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095800c00/0x40a459093b06ba1a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f222d8 expref: 9 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129581.522863:0:16908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:1.0:1746129581.522866:0:16908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746129581.522870:0:16908:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095800c00, rc 0) 00000100:00100000:1.0:1746129581.522944:0:16908:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:068dab75-d300-4ead-a742-d14572ad1e50+9:32692:x1830948734428928:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 1912us (2083us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129581.522952:0:16908:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11356 00000100:00100000:0.0:1746129581.525504:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129581.525539:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129581.525604:0:8411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734429056 00000100:00100000:2.0:1746129581.525615:0:8411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734429056 00000100:00100000:0.0:1746129581.525620:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129581.525656:0:8411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734429312 00000100:00100000:2.0:1746129581.525658:0:8411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734429312 00000100:00100000:0.0:1746129581.525663:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734429568 00000100:00100000:0.0:1746129581.525666:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734429568 00000100:00100000:2.0:1746129581.525678:0:8411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16835 00000100:00100000:2.0:1746129581.525685:0:8411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:068dab75-d300-4ead-a742-d14572ad1e50+6:1963:x1830948734429056:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:2.0:1746129581.525704:0:8411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746129581.525721:0:8410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16836 00010000:00010000:2.0:1746129581.525725:0:8411:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009129f000/0x40a459093b06ba21 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f222df expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129581.525728:0:8410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:068dab75-d300-4ead-a742-d14572ad1e50+5:1963:x1830948734429312:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:3.0:1746129581.525737:0:8410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129581.525749:0:8410:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f385600/0x40a459093b06ba28 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f222ed expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746129581.525754:0:8411:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3ec:0x0] initial LVB size: 1048576, mtime: 0x6813d2ad, atime: 0x6813d2ad, ctime: 0x6813d2ad, blocks: 0x819 00002000:00010000:3.0:1746129581.525764:0:8410:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3f4:0x0] initial LVB size: 2097152, mtime: 0x6813d2ad, atime: 0x6813d2ad, ctime: 0x6813d2ad, blocks: 0x821 00010000:00010000:3.0:1746129581.525773:0:8410:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129581.525773:0:8411:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129581.525775:0:8410:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129581.525775:0:8411:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129581.525783:0:8410:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f385600/0x40a459093b06ba28 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f222ed expref: 6 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129581.525784:0:8411:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009129f000/0x40a459093b06ba21 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f222df expref: 7 pid: 8411 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129581.525798:0:8410:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f385600/0x40a459093b06ba28 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f222ed expref: 6 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129581.525798:0:8411:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009129f000/0x40a459093b06ba21 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f222df expref: 7 pid: 8411 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129581.525808:0:8410:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f385600, rc 0) 00010000:00010000:2.0:1746129581.525808:0:8411:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009129f000, rc 0) 00000100:00100000:2.0:1746129581.525866:0:8411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:068dab75-d300-4ead-a742-d14572ad1e50+7:1963:x1830948734429056:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 182us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129581.525872:0:8411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16835 00000100:00100000:0.0:1746129581.525958:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16837 00000100:00100000:0.0:1746129581.525964:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:068dab75-d300-4ead-a742-d14572ad1e50+6:1963:x1830948734429568:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:0.0:1746129581.526009:0:7149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129581.526018:0:7149:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008fba5600/0x40a459093b06ba2f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f222fb expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746129581.526030:0:7149:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3ef:0x0] initial LVB size: 5146336, mtime: 0x6813d2ae, atime: 0x6813d2ac, ctime: 0x6813d2ae, blocks: 0x1791 00010000:00010000:0.0:1746129581.526037:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129581.526039:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129581.526048:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008fba5600/0x40a459093b06ba2f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f222fb expref: 7 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129581.526058:0:7149:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008fba5600/0x40a459093b06ba2f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f222fb expref: 7 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129581.526069:0:7149:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fba5600, rc 0) 00000100:00100000:0.0:1746129581.526088:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:068dab75-d300-4ead-a742-d14572ad1e50+7:1963:x1830948734429568:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 125us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129581.526093:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16837 00000100:00100000:3.0:1746129581.526140:0:8410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:068dab75-d300-4ead-a742-d14572ad1e50+6:1963:x1830948734429312:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 411us (598us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129581.526144:0:8410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16836 00000100:00100000:2.0:1746129581.526964:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129581.527285:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734429184 00000100:00100000:3.0:1746129581.527290:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734429184 00000100:00100000:3.0:1746129581.527345:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16838 00000100:00100000:3.0:1746129581.527351:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e38aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:068dab75-d300-4ead-a742-d14572ad1e50+6:1962:x1830948734429184:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:3.0:1746129581.527360:0:7148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746129581.527438:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129581.527496:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129581.527553:0:8410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734429440 00000100:00100000:0.0:1746129581.527557:0:8410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734429440 00000100:00100000:0.0:1746129581.527571:0:8410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734429696 00000100:00100000:0.0:1746129581.527572:0:8410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734429696 00000100:00100000:0.0:1746129581.527582:0:8410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16839 00000100:00100000:0.0:1746129581.527586:0:8410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e389500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:068dab75-d300-4ead-a742-d14572ad1e50+7:1962:x1830948734429440:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:0.0:1746129581.527593:0:8410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129581.527603:0:8410:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008fba5200/0x40a459093b06ba36 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f222f4 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746129581.527620:0:8410:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3ee:0x0] initial LVB size: 2097152, mtime: 0x6813d2ae, atime: 0x6813d2ad, ctime: 0x6813d2ae, blocks: 0x81f 00010000:00010000:0.0:1746129581.527632:0:8410:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129581.527634:0:8410:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129581.527639:0:8410:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008fba5200/0x40a459093b06ba36 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f222f4 expref: 8 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129581.527663:0:8410:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008fba5200/0x40a459093b06ba36 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f222f4 expref: 8 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129581.527672:0:8410:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fba5200, rc 0) 00000100:00100000:0.0:1746129581.527697:0:8410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e389500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:068dab75-d300-4ead-a742-d14572ad1e50+8:1962:x1830948734429440:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 110us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129581.527706:0:8410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16839 00000100:00100000:0.0:1746129581.527718:0:8410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16840 00000100:00100000:0.0:1746129581.527723:0:8410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e388a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:068dab75-d300-4ead-a742-d14572ad1e50+7:1962:x1830948734429696:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:0.0:1746129581.527728:0:8410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129581.527736:0:8410:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008fba4800/0x40a459093b06ba3d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f22302 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746129581.527751:0:8410:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3f5:0x0] initial LVB size: 4194304, mtime: 0x6813d2ac, atime: 0x6813d2ac, ctime: 0x6813d2ac, blocks: 0x1029 00010000:00010000:3.0:1746129581.527951:0:7148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f384a00/0x40a459093b06ba44 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f222e6 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746129581.527971:0:7148:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3f3:0x0] initial LVB size: 2097152, mtime: 0x6813d2ad, atime: 0x6813d2ad, ctime: 0x6813d2ad, blocks: 0x821 00010000:00010000:3.0:1746129581.527982:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129581.527983:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129581.527988:0:7148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f384a00/0x40a459093b06ba44 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f222e6 expref: 8 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129581.527998:0:7148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f384a00/0x40a459093b06ba44 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f222e6 expref: 8 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129581.528010:0:7148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f384a00, rc 0) 00000100:00100000:3.0:1746129581.528031:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e38aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:068dab75-d300-4ead-a742-d14572ad1e50+8:1962:x1830948734429184:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 680us (1069us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129581.528036:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16838 00010000:00010000:0.0:1746129581.528361:0:8410:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129581.528363:0:8410:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129581.528367:0:8410:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fba4800/0x40a459093b06ba3d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22302 expref: 8 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129581.528378:0:8410:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008fba4800/0x40a459093b06ba3d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22302 expref: 8 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129581.528385:0:8410:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fba4800, rc 0) 00000100:00100000:0.0:1746129581.528401:0:8410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e388a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:068dab75-d300-4ead-a742-d14572ad1e50+8:1962:x1830948734429696:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 678us (905us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129581.528407:0:8410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16840 00000100:00100000:0.0:1746129581.538347:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129581.538381:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129581.538410:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129581.538441:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129581.538454:0:31521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734430080 00000100:00100000:1.0:1746129581.538466:0:31521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734430080 00000100:00100000:2.0:1746129581.538477:0:21725:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734430336 00000100:00100000:2.0:1746129581.538481:0:21725:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734430336 00000100:00100000:3.0:1746129581.538486:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734430208 00000100:00100000:3.0:1746129581.538489:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734430208 00000100:00100000:2.0:1746129581.538530:0:21725:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8177 00000100:00100000:2.0:1746129581.538538:0:21725:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:068dab75-d300-4ead-a742-d14572ad1e50+10:1960:x1830948734430336:12345-192.168.202.4@tcp:3:lfs.0 00000100:00100000:1.0:1746129581.538539:0:31521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8178 00000100:00100000:3.0:1746129581.538545:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8179 00000100:00100000:1.0:1746129581.538545:0:31521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:068dab75-d300-4ead-a742-d14572ad1e50+10:1960:x1830948734430080:12345-192.168.202.4@tcp:3:lfs.0 00000100:00100000:3.0:1746129581.538550:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:068dab75-d300-4ead-a742-d14572ad1e50+10:1960:x1830948734430208:12345-192.168.202.4@tcp:3:lfs.0 00010000:00010000:3.0:1746129581.538573:0:25745:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009f384600/0x40a459093b06ba52 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25745 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129581.538574:0:21725:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009129fc00/0x40a459093b06ba59 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129581.538574:0:31521:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012ec72000/0x40a459093b06ba4b lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129581.538586:0:25745:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129581.538586:0:21725:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129581.538586:0:31521:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129581.538587:0:25745:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129581.538587:0:21725:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129581.538587:0:31521:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129581.538591:0:25745:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f384600/0x40a459093b06ba52 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25745 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129581.538591:0:21725:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009129fc00/0x40a459093b06ba59 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129581.538591:0:31521:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ec72000/0x40a459093b06ba4b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129581.538603:0:25745:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f384600/0x40a459093b06ba52 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25745 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129581.538603:0:21725:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009129fc00/0x40a459093b06ba59 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129581.538603:0:31521:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ec72000/0x40a459093b06ba4b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31521 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129581.539204:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129581.539226:0:8416:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734430592 00000100:00100000:1.0:1746129581.539230:0:8416:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734430592 00000100:00100000:0.0:1746129581.539242:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129581.539255:0:8416:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734430848 00000100:00100000:1.0:1746129581.539257:0:8416:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734430848 00000100:00100000:1.0:1746129581.539268:0:8416:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734430720 00000100:00100000:1.0:1746129581.539270:0:8416:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734430720 00000100:00100000:1.0:1746129581.539283:0:8416:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8180 00000100:00100000:1.0:1746129581.539289:0:8416:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:068dab75-d300-4ead-a742-d14572ad1e50+10:1960:x1830948734430592:12345-192.168.202.4@tcp:3:lfs.0 00000100:00100000:2.0:1746129581.539318:0:31518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8181 00000100:00100000:2.0:1746129581.539324:0:31518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:068dab75-d300-4ead-a742-d14572ad1e50+10:1960:x1830948734430848:12345-192.168.202.4@tcp:3:lfs.0 00010000:00010000:1.0:1746129581.539329:0:8416:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880094274e00/0x40a459093b06ba60 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8416 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129581.539336:0:8416:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129581.539338:0:8416:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129581.539339:0:31518:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009129ea00/0x40a459093b06ba67 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129581.539340:0:8416:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094274e00/0x40a459093b06ba60 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8416 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129581.539346:0:31518:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129581.539348:0:31518:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129581.539348:0:8416:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094274e00/0x40a459093b06ba60 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8416 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129581.539350:0:31518:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009129ea00/0x40a459093b06ba67 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129581.539358:0:31518:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009129ea00/0x40a459093b06ba67 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31518 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129581.539925:0:31523:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8182 00000100:00100000:0.0:1746129581.539933:0:31523:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:068dab75-d300-4ead-a742-d14572ad1e50+10:1960:x1830948734430720:12345-192.168.202.4@tcp:3:lfs.0 00010000:00010000:0.0:1746129581.539949:0:31523:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88008fba5400/0x40a459093b06ba6e lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129581.539956:0:31523:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129581.539957:0:31523:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129581.539959:0:31523:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fba5400/0x40a459093b06ba6e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129581.539967:0:31523:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008fba5400/0x40a459093b06ba6e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129581.549790:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129581.550331:0:31522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734431360 00000100:00100000:3.0:1746129581.550341:0:31522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734431360 00000100:00100000:3.0:1746129581.550409:0:31522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8183 00000100:00100000:3.0:1746129581.550417:0:31522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:068dab75-d300-4ead-a742-d14572ad1e50+14:1960:x1830948734431360:12345-192.168.202.4@tcp:3:lfs.0 00010000:00010000:3.0:1746129581.550455:0:31522:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800952f7a00/0x40a459093b06ba75 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31522 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129581.550469:0:31522:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129581.550471:0:31522:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129581.550477:0:31522:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800952f7a00/0x40a459093b06ba75 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31522 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129581.550495:0:31522:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800952f7a00/0x40a459093b06ba75 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31522 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129581.550954:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129581.551416:0:31520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734431488 00000100:00100000:2.0:1746129581.551422:0:31520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734431488 00000100:00100000:2.0:1746129581.551458:0:31520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8184 00000100:00100000:2.0:1746129581.551465:0:31520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:068dab75-d300-4ead-a742-d14572ad1e50+14:1960:x1830948734431488:12345-192.168.202.4@tcp:3:lfs.0 00010000:00010000:2.0:1746129581.551490:0:31520:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880095801600/0x40a459093b06ba7c lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129581.551500:0:31520:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129581.551502:0:31520:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129581.551506:0:31520:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095801600/0x40a459093b06ba7c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129581.551519:0:31520:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095801600/0x40a459093b06ba7c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129581.558250:0:8416:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880094274e00/0x40a459093b06ba60 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8416 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129581.558267:0:8416:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880094274e00/0x40a459093b06ba60 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8416 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129581.558275:0:8416:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880094274e00/0x40a459093b06ba60 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8416 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129581.558282:0:8416:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094274e00 already unused, calling callback (ffffffffa086ed70) 00010000:00010000:1.0:1746129581.558285:0:8416:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880094274e00/0x40a459093b06ba60 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8416 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129581.558316:0:8416:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880094274e00/0x40a459093b06ba60 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8416 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129581.558337:0:8416:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880094274e00/0x40a459093b06ba60 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8416 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129581.558343:0:8416:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094274e00/0x40a459093b06ba60 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8416 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129581.558435:0:8416:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:068dab75-d300-4ead-a742-d14572ad1e50+14:1960:x1830948734430592:12345-192.168.202.4@tcp:3:lfs.0 Request processed in 19139us (19991us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129581.558444:0:8416:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8180 00010000:00010000:3.0:1746129581.565441:0:25745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009f384600/0x40a459093b06ba52 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25745 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129581.565459:0:25745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009f384600/0x40a459093b06ba52 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25745 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129581.565466:0:25745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009f384600/0x40a459093b06ba52 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25745 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129581.565472:0:25745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f384600 already unused, calling callback (ffffffffa086ed70) 00010000:00010000:3.0:1746129581.565476:0:25745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f384600/0x40a459093b06ba52 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25745 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129581.565482:0:25745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f384600/0x40a459093b06ba52 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25745 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129581.565498:0:25745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009f384600/0x40a459093b06ba52 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25745 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129581.565503:0:25745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f384600/0x40a459093b06ba52 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25745 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129581.565571:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:068dab75-d300-4ead-a742-d14572ad1e50+14:1960:x1830948734430208:12345-192.168.202.4@tcp:3:lfs.0 Request processed in 27016us (27155us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129581.565583:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8179 00010000:00010000:2.0:1746129581.575574:0:21725:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009129fc00/0x40a459093b06ba59 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129581.575588:0:21725:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009129fc00/0x40a459093b06ba59 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129581.575596:0:21725:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009129fc00/0x40a459093b06ba59 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129581.575601:0:21725:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009129fc00 already unused, calling callback (ffffffffa086ed70) 00010000:00010000:2.0:1746129581.575605:0:21725:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009129fc00/0x40a459093b06ba59 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129581.575612:0:21725:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009129fc00/0x40a459093b06ba59 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129581.575628:0:21725:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009129fc00/0x40a459093b06ba59 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129581.575638:0:21725:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009129fc00/0x40a459093b06ba59 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21725 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129581.576337:0:21725:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:068dab75-d300-4ead-a742-d14572ad1e50+12:1960:x1830948734430336:12345-192.168.202.4@tcp:3:lfs.0 Request processed in 37796us (37950us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129581.576345:0:21725:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8177 00010000:00010000:3.0:1746129581.585535:0:31518:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009129ea00/0x40a459093b06ba67 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129581.585550:0:31518:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009129ea00/0x40a459093b06ba67 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129581.585558:0:31518:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009129ea00/0x40a459093b06ba67 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129581.585564:0:31518:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009129ea00 already unused, calling callback (ffffffffa086ed70) 00010000:00010000:3.0:1746129581.585568:0:31518:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009129ea00/0x40a459093b06ba67 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129581.585574:0:31518:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009129ea00/0x40a459093b06ba67 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129581.585591:0:31518:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009129ea00/0x40a459093b06ba67 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129581.585597:0:31518:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009129ea00/0x40a459093b06ba67 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31518 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129581.585692:0:31518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:068dab75-d300-4ead-a742-d14572ad1e50+12:1960:x1830948734430848:12345-192.168.202.4@tcp:3:lfs.0 Request processed in 46364us (46484us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129581.585700:0:31518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8181 00010000:00010000:2.0:1746129581.590364:0:31523:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88008fba5400/0x40a459093b06ba6e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129581.590378:0:31523:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008fba5400/0x40a459093b06ba6e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129581.590386:0:31523:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008fba5400/0x40a459093b06ba6e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129581.590392:0:31523:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008fba5400 already unused, calling callback (ffffffffa086ed70) 00010000:00010000:2.0:1746129581.590396:0:31523:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008fba5400/0x40a459093b06ba6e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129581.590402:0:31523:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008fba5400/0x40a459093b06ba6e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129581.590417:0:31523:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008fba5400/0x40a459093b06ba6e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129581.590422:0:31523:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008fba5400/0x40a459093b06ba6e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31523 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129581.590498:0:31523:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:068dab75-d300-4ead-a742-d14572ad1e50+10:1960:x1830948734430720:12345-192.168.202.4@tcp:3:lfs.0 Request processed in 50563us (51251us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129581.590506:0:31523:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8182 00010000:00010000:3.0:1746129581.598813:0:31521:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012ec72000/0x40a459093b06ba4b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129581.598827:0:31521:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012ec72000/0x40a459093b06ba4b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129581.598835:0:31521:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012ec72000/0x40a459093b06ba4b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129581.598840:0:31521:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ec72000 already unused, calling callback (ffffffffa086ed70) 00010000:00010000:3.0:1746129581.598843:0:31521:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012ec72000/0x40a459093b06ba4b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129581.598850:0:31521:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012ec72000/0x40a459093b06ba4b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129581.598866:0:31521:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012ec72000/0x40a459093b06ba4b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129581.598871:0:31521:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ec72000/0x40a459093b06ba4b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31521 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129581.600068:0:31521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:068dab75-d300-4ead-a742-d14572ad1e50+10:1960:x1830948734430080:12345-192.168.202.4@tcp:3:lfs.0 Request processed in 61518us (61770us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129581.600077:0:31521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8178 00010000:00010000:3.0:1746129581.604935:0:31522:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800952f7a00/0x40a459093b06ba75 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31522 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129581.604949:0:31522:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800952f7a00/0x40a459093b06ba75 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31522 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129581.604961:0:31522:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800952f7a00/0x40a459093b06ba75 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31522 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129581.604966:0:31522:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800952f7a00 already unused, calling callback (ffffffffa086ed70) 00010000:00010000:3.0:1746129581.604970:0:31522:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800952f7a00/0x40a459093b06ba75 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31522 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129581.604975:0:31522:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800952f7a00/0x40a459093b06ba75 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31522 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129581.604989:0:31522:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800952f7a00/0x40a459093b06ba75 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31522 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129581.604994:0:31522:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800952f7a00/0x40a459093b06ba75 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31522 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129581.605066:0:31522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:068dab75-d300-4ead-a742-d14572ad1e50+8:1960:x1830948734431360:12345-192.168.202.4@tcp:3:lfs.0 Request processed in 54645us (55284us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129581.605075:0:31522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8183 00010000:00010000:2.0:1746129581.607902:0:31520:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880095801600/0x40a459093b06ba7c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129581.607917:0:31520:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880095801600/0x40a459093b06ba7c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129581.607924:0:31520:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880095801600/0x40a459093b06ba7c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129581.607930:0:31520:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095801600 already unused, calling callback (ffffffffa086ed70) 00010000:00010000:2.0:1746129581.607934:0:31520:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880095801600/0x40a459093b06ba7c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129581.607940:0:31520:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880095801600/0x40a459093b06ba7c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129581.607955:0:31520:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880095801600/0x40a459093b06ba7c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129581.607961:0:31520:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095801600/0x40a459093b06ba7c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31520 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129581.608030:0:31520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:068dab75-d300-4ead-a742-d14572ad1e50+8:1960:x1830948734431488:12345-192.168.202.4@tcp:3:lfs.0 Request processed in 56562us (57075us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129581.608039:0:31520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8184 00000100:00100000:0.0:1746129581.614517:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129581.614987:0:16908:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734431744 00000100:00100000:1.0:1746129581.615000:0:16908:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734431744 00000100:00100000:1.0:1746129581.615067:0:16908:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11357 00000100:00100000:1.0:1746129581.615076:0:16908:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:068dab75-d300-4ead-a742-d14572ad1e50+9:32692:x1830948734431744:12345-192.168.202.4@tcp:36:lfs.0 00010000:00010000:1.0:1746129581.615131:0:16908:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129581.615159:0:16908:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095800c00/0x40a459093b06ba1a lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f222d8 expref: 9 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129581.615189:0:16908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:1.0:1746129581.615194:0:16908:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746129581.615245:0:16908:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab4800/0x40a459093b06ba83 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129581.615258:0:16908:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab4800/0x40a459093b06ba83 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129581.615267:0:16908:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab4800/0x40a459093b06ba83 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00000004:00010000:1.0:1746129581.615518:0:16908:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009fc2f480 reply state ffff8800955c4000 transno 8589945482 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab4800/0x40a459093b06ba83 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00000100:00100000:1.0:1746129581.615529:0:16908:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1746129581.615622:0:16908:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:068dab75-d300-4ead-a742-d14572ad1e50+10:32692:x1830948734431744:12345-192.168.202.4@tcp:36:lfs.0 Request processed in 546us (1109us total) trans 8589945482 rc 0/0 00000100:00100000:1.0:1746129581.615628:0:16908:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11357 00000100:00100000:0.0:1746129581.618734:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129581.618813:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129581.618843:0:8410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734431872 00000100:00100000:0.0:1746129581.618851:0:8410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734431872 00000100:00100000:0.0:1746129581.618902:0:8410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734432000 00000100:00100000:0.0:1746129581.618905:0:8410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734432000 00000100:00100000:0.0:1746129581.618921:0:8410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16841 00000100:00100000:0.0:1746129581.618930:0:8410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:068dab75-d300-4ead-a742-d14572ad1e50+8:1963:x1830948734431872:12345-192.168.202.4@tcp:2:lfs.0 00000100:00100000:2.0:1746129581.618996:0:8411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16842 00000100:00100000:2.0:1746129581.619014:0:8411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:068dab75-d300-4ead-a742-d14572ad1e50+8:1962:x1830948734432000:12345-192.168.202.4@tcp:2:lfs.0 00002000:00010000:0.0:1746129581.619126:0:8410:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3ec:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746129581.619129:0:8410:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ec:0x0] updating lvb mtime from disk: 1746129581 -> 1746129582 00002000:00010000:0.0:1746129581.619131:0:8410:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3ec:0x0] updating lvb atime from disk: 1746129581 -> 1746129582 00002000:00010000:0.0:1746129581.619133:0:8410:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ec:0x0] updating lvb ctime from disk: 1746129581 -> 1746129582 00002000:00010000:0.0:1746129581.619136:0:8410:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3ec:0x0] updating lvb blocks from disk: 2073 -> 2073 00002000:00010000:2.0:1746129581.619171:0:8411:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746129581.619174:0:8411:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb mtime from disk: 1746129581 -> 1746129582 00002000:00010000:2.0:1746129581.619176:0:8411:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb atime from disk: 1746129581 -> 1746129582 00002000:00010000:2.0:1746129581.619178:0:8411:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb ctime from disk: 1746129581 -> 1746129582 00002000:00010000:2.0:1746129581.619180:0:8411:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746129581.619180:0:8410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:068dab75-d300-4ead-a742-d14572ad1e50+9:1963:x1830948734431872:12345-192.168.202.4@tcp:2:lfs.0 Request processed in 251us (456us total) trans 21474841436 rc 0/0 00000100:00100000:0.0:1746129581.619187:0:8410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16841 00000100:00100000:2.0:1746129581.619237:0:8411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:068dab75-d300-4ead-a742-d14572ad1e50+9:1962:x1830948734432000:12345-192.168.202.4@tcp:2:lfs.0 Request processed in 230us (422us total) trans 17179874191 rc 0/0 00000100:00100000:2.0:1746129581.619244:0:8411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16842 00010000:00010000:3.0:1746129581.619340:0:3287:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab4800/0x40a459093b06ba83 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129581.619350:0:3287:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab4800/0x40a459093b06ba83 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129581.619357:0:3287:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab4800/0x40a459093b06ba83 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129581.619366:0:3287:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fab4800 already unused, calling callback (ffffffffa136e690) 00010000:00010000:3.0:1746129581.619370:0:3287:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab4800/0x40a459093b06ba83 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129581.619378:0:3287:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab4800/0x40a459093b06ba83 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129581.619394:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:3.0:1746129581.619396:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129581.619400:0:3287:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab4800/0x40a459093b06ba83 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129581.619405:0:3287:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab4800/0x40a459093b06ba83 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16908 initiator: MDT0 00000100:00100000:0.0:1746129581.620400:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129581.620440:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129581.620495:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734432128 00000100:00100000:2.0:1746129581.620500:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734432128 00000100:00100000:2.0:1746129581.620533:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734432256 00000100:00100000:2.0:1746129581.620535:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734432256 00000100:00100000:2.0:1746129581.620549:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16843 00000100:00100000:1.0:1746129581.620558:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16844 00000100:00100000:2.0:1746129581.620561:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131454000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:068dab75-d300-4ead-a742-d14572ad1e50+9:1962:x1830948734432128:12345-192.168.202.4@tcp:2:lfs.0 00000100:00100000:1.0:1746129581.620567:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131454380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:068dab75-d300-4ead-a742-d14572ad1e50+9:1962:x1830948734432256:12345-192.168.202.4@tcp:2:lfs.0 00002000:00010000:2.0:1746129581.620679:0:4385:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746129581.620679:0:7149:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746129581.620682:0:4385:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb mtime from disk: 1746129581 -> 1746129582 00002000:00010000:1.0:1746129581.620682:0:7149:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb mtime from disk: 1746129582 -> 1746129582 00002000:00010000:1.0:1746129581.620684:0:7149:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb atime from disk: 1746129581 -> 1746129582 00002000:00010000:1.0:1746129581.620686:0:7149:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb ctime from disk: 1746129582 -> 1746129582 00002000:00010000:2.0:1746129581.620687:0:4385:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb atime from disk: 1746129581 -> 1746129582 00002000:00010000:1.0:1746129581.620688:0:7149:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb blocks from disk: 2079 -> 2079 00002000:00010000:2.0:1746129581.620689:0:4385:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb ctime from disk: 1746129581 -> 1746129582 00002000:00010000:2.0:1746129581.620691:0:4385:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746129581.620725:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131454380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:068dab75-d300-4ead-a742-d14572ad1e50+10:1962:x1830948734432256:12345-192.168.202.4@tcp:2:lfs.0 Request processed in 159us (284us total) trans 21474841437 rc 0/0 00000100:00100000:1.0:1746129581.620731:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16844 00000100:00100000:2.0:1746129581.620743:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131454000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:068dab75-d300-4ead-a742-d14572ad1e50+10:1962:x1830948734432128:12345-192.168.202.4@tcp:2:lfs.0 Request processed in 186us (343us total) trans 17179874192 rc 0/0 00000100:00100000:2.0:1746129581.620749:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16843 00000100:00100000:2.0:1746129581.620844:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129581.620879:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129581.621030:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734432384 00000100:00100000:3.0:1746129581.621034:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734432384 00000100:00100000:3.0:1746129581.621055:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734432512 00000100:00100000:3.0:1746129581.621057:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734432512 00000100:00100000:3.0:1746129581.621080:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16845 00000100:00100000:3.0:1746129581.621085:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e38ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:068dab75-d300-4ead-a742-d14572ad1e50+10:1962:x1830948734432384:12345-192.168.202.4@tcp:2:lfs.0 00002000:00010000:3.0:1746129581.621164:0:4385:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb size from disk: 5146336 -> 5146336 00002000:00010000:3.0:1746129581.621167:0:4385:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb mtime from disk: 1746129582 -> 1746129582 00002000:00010000:3.0:1746129581.621169:0:4385:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb atime from disk: 1746129580 -> 1746129582 00002000:00010000:3.0:1746129581.621170:0:4385:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb ctime from disk: 1746129582 -> 1746129582 00002000:00010000:3.0:1746129581.621172:0:4385:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb blocks from disk: 6033 -> 6033 00000100:00100000:3.0:1746129581.621193:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e38ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:068dab75-d300-4ead-a742-d14572ad1e50+11:1962:x1830948734432384:12345-192.168.202.4@tcp:2:lfs.0 Request processed in 108us (350us total) trans 21474841438 rc 0/0 00000100:00100000:3.0:1746129581.621199:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16845 00000100:00100000:0.0:1746129581.621215:0:8410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16846 00000100:00100000:0.0:1746129581.621233:0:8410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e389880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:068dab75-d300-4ead-a742-d14572ad1e50+10:1962:x1830948734432512:12345-192.168.202.4@tcp:2:lfs.0 00002000:00010000:1.0:1746129581.621502:0:8410:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3f5:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746129581.621505:0:8410:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f5:0x0] updating lvb mtime from disk: 1746129580 -> 1746129582 00002000:00010000:1.0:1746129581.621507:0:8410:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f5:0x0] updating lvb atime from disk: 1746129580 -> 1746129582 00002000:00010000:1.0:1746129581.621509:0:8410:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f5:0x0] updating lvb ctime from disk: 1746129580 -> 1746129582 00002000:00010000:1.0:1746129581.621511:0:8410:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f5:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:1.0:1746129581.621541:0:8410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e389880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:068dab75-d300-4ead-a742-d14572ad1e50+11:1962:x1830948734432512:12345-192.168.202.4@tcp:2:lfs.0 Request processed in 309us (661us total) trans 17179874193 rc 0/0 00000100:00100000:1.0:1746129581.621546:0:8410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16846 00000100:00100000:0.0:1746129581.623255:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129581.623332:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734432768 00000100:00100000:2.0:1746129581.623339:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734432768 00000100:00100000:2.0:1746129581.623388:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4845 00000100:00100000:2.0:1746129581.623395:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131454700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:068dab75-d300-4ead-a742-d14572ad1e50+9:32692:x1830948734432768:12345-192.168.202.4@tcp:35:lfs.0 00000004:00010000:2.0:1746129581.623447:0:14550:0:(mdt_open.c:2471:mdt_close_resync_done()) ### [0x200000403:0x368:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800955d3200/0x40a459093b06b9cd lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f222ca expref: 9 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129581.623492:0:14550:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880095801600/0x40a459093b06ba8a lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746129581.623504:0:14550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fba5000/0x40a459093b06ba0c lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f222d1 expref: 9 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129581.623511:0:14550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095801600/0x40a459093b06ba8a lrc: 4/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746129581.623541:0:14550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008fba5000/0x40a459093b06ba0c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f222d1 expref: 9 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129581.623552:0:14550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fba5000/0x40a459093b06ba0c lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f222d1 expref: 9 pid: 14549 timeout: 936 lvb_type: 0 00000100:00100000:2.0:1746129581.623566:0:14550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e389180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:14550:1830948737627136:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129581.623673:0:14550:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa23bcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746129581.625465:0:14550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e389180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:14550:1830948737627136:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129581.625492:0:14550:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880095801600/0x40a459093b06ba8a lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00000100:00100000:1.0:1746129581.625695:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129581.625779:0:15749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734432896 00000100:00100000:3.0:1746129581.625784:0:15749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734432896 00010000:00010000:3.0:1746129581.625815:0:15749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fba5000/0x40a459093b06ba0c lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f222d1 expref: 10 pid: 14549 timeout: 936 lvb_type: 0 00000100:00100000:3.0:1746129581.625914:0:15749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8730 00000100:00100000:3.0:1746129581.625922:0:15749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:068dab75-d300-4ead-a742-d14572ad1e50+10:1963:x1830948734432896:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129581.625935:0:15749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129581.625941:0:15749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008fba5000/0x40a459093b06ba0c lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f222d1 expref: 10 pid: 14549 timeout: 936 lvb_type: 0 00010000:00010000:3.0:1746129581.625951:0:15749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008fba5000/0x40a459093b06ba0c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f222d1 expref: 10 pid: 14549 timeout: 936 lvb_type: 0 00010000:00010000:3.0:1746129581.626008:0:15749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fba5000/0x40a459093b06ba0c lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f222d1 expref: 10 pid: 14549 timeout: 936 lvb_type: 0 00010000:00010000:3.0:1746129581.626032:0:15749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:3.0:1746129581.626037:0:15749:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880095801600/0x40a459093b06ba8a lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746129581.626045:0:15749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095801600/0x40a459093b06ba8a lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746129581.626051:0:15749:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095801600/0x40a459093b06ba8a lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746129581.626077:0:15749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129581.626124:0:15749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:068dab75-d300-4ead-a742-d14572ad1e50+9:1963:x1830948734432896:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 202us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129581.626134:0:15749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8730 00010000:00010000:0.0:1746129581.626231:0:14550:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880095801600/0x40a459093b06ba8a lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00010000:00010000:0.0:1746129581.626241:0:14550:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095801600/0x40a459093b06ba8a lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00000040:00080000:0.0:1746129581.626896:0:14550:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3499, 88 off294640 00000004:00080000:0.0:1746129581.626901:0:14550:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 836943607080ns, next at 776349687452ns, rc = 0 00000040:00080000:0.0:1746129581.626944:0:14550:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3509, 88 off295440 00000004:00080000:0.0:1746129581.626947:0:14550:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 836943653406ns, next at 776375382381ns, rc = 0 00000040:00080000:0.0:1746129581.626965:0:14550:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3510, 88 off295528 00000004:00080000:0.0:1746129581.626969:0:14550:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 836943674697ns, next at 776375382381ns, rc = 0 00000040:00080000:0.0:1746129581.626976:0:14550:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3500, 88 off294728 00000004:00080000:0.0:1746129581.626979:0:14550:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 836943684700ns, next at 776349687452ns, rc = 0 00000040:00080000:0.0:1746129581.626984:0:14550:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3501, 88 off294816 00000004:00080000:0.0:1746129581.626986:0:14550:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 836943692575ns, next at 776349687452ns, rc = 0 00000040:00080000:0.0:1746129581.626995:0:14550:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3511, 88 off295616 00000004:00080000:0.0:1746129581.626998:0:14550:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 836943703803ns, next at 776375382381ns, rc = 0 00000040:00080000:0.0:1746129581.627088:0:14550:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3512, 88 off295704 00000004:00080000:0.0:1746129581.627093:0:14550:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 836943798683ns, next at 776375382381ns, rc = 0 00000040:00080000:0.0:1746129581.627112:0:14550:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3513, 88 off295792 00000004:00080000:0.0:1746129581.627118:0:14550:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 836943824108ns, next at 776375382381ns, rc = 0 00000040:00080000:0.0:1746129581.627149:0:14550:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3503, 88 off295000 00000004:00080000:0.0:1746129581.627152:0:14550:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 836943857846ns, next at 776349687452ns, rc = 0 00000040:00080000:0.0:1746129581.627171:0:14550:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3514, 88 off295880 00000004:00080000:0.0:1746129581.627212:0:14550:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 836943918325ns, next at 776375382381ns, rc = 0 00000040:00080000:0.0:1746129581.627237:0:14550:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3504, 88 off295088 00000004:00080000:0.0:1746129581.627240:0:14550:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 836943946143ns, next at 776349687452ns, rc = 0 00000040:00080000:0.0:1746129581.627248:0:14550:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3515, 88 off295968 00000004:00080000:0.0:1746129581.627250:0:14550:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 836943956625ns, next at 776375382381ns, rc = 0 00000040:00080000:0.0:1746129581.627257:0:14550:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3505, 88 off295176 00000004:00080000:0.0:1746129581.627259:0:14550:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 836943965328ns, next at 776349687452ns, rc = 0 00000040:00080000:0.0:1746129581.627266:0:14550:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3506, 88 off295264 00000004:00080000:0.0:1746129581.627268:0:14550:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 836943974553ns, next at 776349687452ns, rc = 0 00000040:00080000:0.0:1746129581.627275:0:14550:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3507, 88 off295352 00000004:00080000:0.0:1746129581.627278:0:14550:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 836943984220ns, next at 776349687452ns, rc = 0 00000040:00080000:0.0:1746129581.627285:0:14550:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3508, 88 off295440 00000004:00080000:0.0:1746129581.627287:0:14550:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 836943993673ns, next at 776349687452ns, rc = 0 00000040:00080000:0.0:1746129581.627310:0:14550:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3516, 88 off296056 00000004:00080000:0.0:1746129581.627312:0:14550:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 836944018565ns, next at 776375382381ns, rc = 0 00000004:00010000:0.0:1746129581.644800:0:14550:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880131454700 reply state ffff8800935b4800 transno 8589945483 ns: mdt-lustre-MDT0000_UUID lock: ffff880095801600/0x40a459093b06ba8a lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00000001:00080000:1.0:1746129581.644809:0:14619:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945483 is committed 00000100:00100000:0.0:1746129581.644815:0:14550:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000004:00080000:1.0:1746129581.644816:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2685 committed 00010000:00010000:0.0:1746129581.644827:0:14550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:0.0:1746129581.644830:0:14550:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746129581.644843:0:14550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800955d3200/0x40a459093b06b9cd lrc: 0/0,0 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f222ca expref: 8 pid: 16908 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1746129581.644865:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2677 committed 00000004:00080000:1.0:1746129581.644873:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2676 committed 00000004:00080000:1.0:1746129581.644874:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2675 committed 00000004:00080000:1.0:1746129581.644875:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2674 committed 00000004:00080000:1.0:1746129581.644877:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2684 committed 00000004:00080000:1.0:1746129581.644878:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2673 committed 00000004:00080000:1.0:1746129581.644879:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2683 committed 00000004:00080000:1.0:1746129581.644881:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2672 committed 00000004:00080000:1.0:1746129581.644882:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2682 committed 00000004:00080000:1.0:1746129581.644883:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2681 committed 00000004:00080000:1.0:1746129581.644884:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2680 committed 00000004:00080000:1.0:1746129581.644885:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2671 committed 00000004:00080000:1.0:1746129581.644887:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2670 committed 00000004:00080000:1.0:1746129581.644888:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2679 committed 00000004:00080000:1.0:1746129581.644889:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2678 committed 00000004:00080000:1.0:1746129581.644891:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2669 committed 00010000:00080000:0.0:1746129581.644956:0:14550:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1746129581.645028:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131454700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:068dab75-d300-4ead-a742-d14572ad1e50+7:32692:x1830948734432768:12345-192.168.202.4@tcp:35:lfs.0 Request processed in 21631us (21778us total) trans 8589945483 rc 0/0 00000100:00100000:0.0:1746129581.645039:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4845 00000100:00100000:3.0:1746129581.645246:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013575c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737627264:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129581.645318:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129581.645334:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013575c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737627520:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129581.645344:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e388e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737627776:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129581.645355:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129581.645362:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013575fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737627392:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129581.645373:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013575c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737628032:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129581.645377:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129581.645385:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129581.645386:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e38b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737627904:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129581.645395:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013575d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737628544:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129581.645398:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129581.645406:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129581.645408:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013575e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737628416:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129581.645420:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129581.645420:0:3302:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1746129581.645424:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e389180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737627648:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129581.645437:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129581.645445:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013575ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737628160:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129581.645448:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737627264 00000100:00100000:3.0:1746129581.645455:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737627264 00000100:00100000:0.0:1746129581.645456:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129581.645482:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737627520 00000100:00100000:3.0:1746129581.645484:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737627520 00000100:00100000:3.0:1746129581.645494:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737627392 00000100:00100000:3.0:1746129581.645495:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737627392 00000100:00100000:3.0:1746129581.645503:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737628032 00000100:00100000:3.0:1746129581.645505:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737628032 00000100:00100000:3.0:1746129581.645510:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737627904 00000100:00100000:3.0:1746129581.645511:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737627904 00000100:00100000:3.0:1746129581.645517:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737628544 00000100:00100000:3.0:1746129581.645519:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737628544 00000100:00100000:3.0:1746129581.645524:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737628416 00000100:00100000:3.0:1746129581.645526:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737628416 00000100:00100000:3.0:1746129581.645531:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737627648 00000100:00100000:3.0:1746129581.645532:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737627648 00000100:00100000:3.0:1746129581.645537:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737628160 00000100:00100000:3.0:1746129581.645538:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737628160 00000100:00100000:3.0:1746129581.645547:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16847 00000100:00100000:3.0:1746129581.645552:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cda7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+20:3300:x1830948737627264:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746129581.645709:0:4385:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3ec:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:3.0:1746129581.645712:0:4385:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ec:0x0] updating lvb mtime from disk: 1746129582 -> 1746129582 00002000:00010000:3.0:1746129581.645715:0:4385:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3ec:0x0] updating lvb atime from disk: 1746129582 -> 1746129582 00002000:00010000:3.0:1746129581.645716:0:4385:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ec:0x0] updating lvb ctime from disk: 1746129582 -> 1746129582 00002000:00010000:3.0:1746129581.645718:0:4385:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3ec:0x0] updating lvb blocks from disk: 2073 -> 2073 00000100:00100000:3.0:1746129581.645736:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cda7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+21:3300:x1830948737627264:12345-0@lo:2:osp-syn-0-0.0 Request processed in 185us (419us total) trans 21474841439 rc 0/0 00000100:00100000:3.0:1746129581.645741:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16847 00000100:00100000:3.0:1746129581.645753:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16848 00000100:00100000:3.0:1746129581.645759:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131454a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+20:3302:x1830948737627520:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746129581.645824:0:4385:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb size from disk: 5146336 -> 5146336 00002000:00010000:3.0:1746129581.645827:0:4385:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb mtime from disk: 1746129582 -> 1746129582 00002000:00010000:3.0:1746129581.645829:0:4385:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb atime from disk: 1746129582 -> 1746129582 00002000:00010000:3.0:1746129581.645830:0:4385:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb ctime from disk: 1746129582 -> 1746129582 00002000:00010000:3.0:1746129581.645832:0:4385:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb blocks from disk: 6033 -> 6033 00000100:00100000:3.0:1746129581.645866:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131454a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+21:3302:x1830948737627520:12345-0@lo:2:osp-syn-0-0.0 Request processed in 109us (510us total) trans 21474841440 rc 0/0 00000100:00100000:3.0:1746129581.645872:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16848 00000100:00100000:3.0:1746129581.645881:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16849 00000100:00100000:3.0:1746129581.645885:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cda4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+20:3301:x1830948737627392:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746129581.645949:0:4385:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746129581.645951:0:4385:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb mtime from disk: 1746129582 -> 1746129582 00002000:00010000:3.0:1746129581.645953:0:4385:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb atime from disk: 1746129582 -> 1746129582 00002000:00010000:3.0:1746129581.645955:0:4385:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb ctime from disk: 1746129582 -> 1746129582 00002000:00010000:3.0:1746129581.645957:0:4385:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:3.0:1746129581.645977:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cda4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+21:3301:x1830948737627392:12345-0@lo:2:osp-syn-0-0.0 Request processed in 92us (599us total) trans 21474841441 rc 0/0 00000100:00100000:3.0:1746129581.645982:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16849 00000100:00100000:1.0:1746129581.645990:0:8410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16850 00000100:00100000:3.0:1746129581.645992:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16851 00000100:00100000:1.0:1746129581.645995:0:8410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131454e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+20:3302:x1830948737628032:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129581.645996:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cda7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+14:3301:x1830948737627904:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746129581.646082:0:4385:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3f5:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746129581.646085:0:4385:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f5:0x0] updating lvb mtime from disk: 1746129582 -> 1746129582 00000100:00100000:1.0:1746129581.646085:0:8410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131454e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+21:3302:x1830948737628032:12345-0@lo:2:osp-syn-0-0.0 Request processed in 90us (698us total) trans 21474841442 rc 0/0 00002000:00010000:3.0:1746129581.646086:0:4385:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f5:0x0] updating lvb atime from disk: 1746129582 -> 1746129582 00002000:00010000:3.0:1746129581.646088:0:4385:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f5:0x0] updating lvb ctime from disk: 1746129582 -> 1746129582 00002000:00010000:3.0:1746129581.646090:0:4385:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f5:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:1.0:1746129581.646090:0:8410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16850 00000100:00100000:1.0:1746129581.646099:0:8410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16852 00000100:00100000:1.0:1746129581.646103:0:8410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131455180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+20:3302:x1830948737628544:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129581.646104:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cda7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+15:3301:x1830948737627904:12345-0@lo:2:osp-syn-1-0.0 Request processed in 108us (705us total) trans 17179874194 rc 0/0 00000100:00100000:3.0:1746129581.646108:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16851 00000100:00100000:3.0:1746129581.646116:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16853 00000100:00100000:3.0:1746129581.646120:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cda5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+20:3301:x1830948737628416:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746129581.646167:0:4385:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746129581.646170:0:4385:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1746129581.646172:0:4385:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746129581.646173:0:4385:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb ctime from disk: 0 -> 0 00000100:00100000:1.0:1746129581.646173:0:8410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131455180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+22:3302:x1830948737628544:12345-0@lo:2:osp-syn-0-0.0 Request processed in 70us (766us total) trans 21474841443 rc 0/0 00002000:00010000:3.0:1746129581.646175:0:4385:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1746129581.646178:0:8410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16852 00000100:00100000:3.0:1746129581.646188:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cda5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+21:3301:x1830948737628416:12345-0@lo:2:osp-syn-0-0.0 Request processed in 68us (767us total) trans 21474841444 rc 0/0 00000100:00100000:1.0:1746129581.646188:0:8410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16854 00000100:00100000:3.0:1746129581.646192:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16853 00000100:00100000:1.0:1746129581.646192:0:8410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131455500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+14:3302:x1830948737627648:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129581.646200:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16855 00000100:00100000:3.0:1746129581.646205:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131455880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+20:3302:x1830948737628160:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746129581.646273:0:8410:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746129581.646276:0:8410:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb mtime from disk: 1746129582 -> 1746129582 00002000:00010000:1.0:1746129581.646278:0:8410:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb atime from disk: 1746129582 -> 1746129582 00002000:00010000:1.0:1746129581.646280:0:8410:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb ctime from disk: 1746129582 -> 1746129582 00000100:00100000:3.0:1746129581.646282:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131455880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+21:3302:x1830948737628160:12345-0@lo:2:osp-syn-0-0.0 Request processed in 77us (825us total) trans 21474841445 rc 0/0 00002000:00010000:1.0:1746129581.646282:0:8410:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:3.0:1746129581.646287:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16855 00000100:00100000:1.0:1746129581.646311:0:8410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131455500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+15:3302:x1830948737627648:12345-0@lo:2:osp-syn-1-0.0 Request processed in 119us (873us total) trans 17179874195 rc 0/0 00000100:00100000:1.0:1746129581.646316:0:8410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16854 00000004:00080000:3.0:1746129581.646346:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013575fb80/2, rc 0, transno 21474841441 00000100:00100000:3.0:1746129581.646354:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013575fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737627392:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746129581.646363:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e38b800/2, rc 0, transno 17179874194 00000100:00100000:3.0:1746129581.646367:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e38b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737627904:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746129581.646373:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013575e300/2, rc 0, transno 21474841444 00000100:00100000:3.0:1746129581.646375:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013575e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737628416:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129581.646390:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746129581.646391:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e389180/2, rc 0, transno 17179874195 00000100:00100000:0.0:1746129581.646393:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e389180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737627648:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129581.646399:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013575ce00/2, rc 0, transno 21474841445 00000100:00100000:0.0:1746129581.646402:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013575ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737628160:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129581.646404:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013575ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737628288:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129581.646407:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013575c000/2, rc 0, transno 21474841440 00000100:00100000:0.0:1746129581.646409:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013575c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737627520:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129581.646415:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013575c700/2, rc 0, transno 21474841442 00000100:00100000:0.0:1746129581.646417:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013575c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737628032:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129581.646422:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746129581.646423:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013575d180/2, rc 0, transno 21474841443 00000100:00100000:0.0:1746129581.646425:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013575d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737628544:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746129581.646434:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013575c380/2, rc 0, transno 21474841439 00000100:00100000:3.0:1746129581.646437:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013575c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737627264:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129581.646470:0:22480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737627776 00000100:00100000:1.0:1746129581.646473:0:22480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737627776 00000100:00100000:1.0:1746129581.646491:0:22480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737628288 00000100:00100000:1.0:1746129581.646493:0:22480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737628288 00000100:00100000:1.0:1746129581.646503:0:22480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16856 00000100:00100000:1.0:1746129581.646507:0:22480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cda7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+15:3300:x1830948737627776:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746129581.646581:0:22480:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746129581.646583:0:22480:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb mtime from disk: 1746129582 -> 1746129582 00002000:00010000:1.0:1746129581.646585:0:22480:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb atime from disk: 1746129582 -> 1746129582 00002000:00010000:1.0:1746129581.646586:0:22480:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb ctime from disk: 1746129582 -> 1746129582 00002000:00010000:1.0:1746129581.646588:0:22480:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746129581.646609:0:22480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cda7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+16:3300:x1830948737627776:12345-0@lo:2:osp-syn-1-0.0 Request processed in 102us (219us total) trans 17179874196 rc 0/0 00000100:00100000:1.0:1746129581.646614:0:22480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16856 00000100:00100000:1.0:1746129581.646623:0:22480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16857 00000100:00100000:1.0:1746129581.646627:0:22480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cda6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+21:3300:x1830948737628288:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129581.646698:0:22480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cda6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+22:3300:x1830948737628288:12345-0@lo:2:osp-syn-0-0.0 Request processed in 70us (274us total) trans 21474841446 rc 0/0 00000100:00100000:1.0:1746129581.646705:0:22480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16857 00010000:00010000:2.0:1746129581.646944:0:3286:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880095801600/0x40a459093b06ba8a lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746129581.646953:0:3286:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095801600/0x40a459093b06ba8a lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746129581.646959:0:3286:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095801600/0x40a459093b06ba8a lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746129581.646964:0:3286:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095801600 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746129581.646969:0:3286:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095801600/0x40a459093b06ba8a lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746129581.646975:0:3286:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095801600/0x40a459093b06ba8a lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746129581.646991:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff8800900d1200) 00010000:00010000:2.0:1746129581.646993:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746129581.646996:0:3286:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095801600/0x40a459093b06ba8a lrc: 2/0,0 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746129581.647001:0:3286:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095801600/0x40a459093b06ba8a lrc: 0/0,0 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14550 initiator: MDT0 00000100:00100000:0.0:1746129581.647080:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e38a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1830948737628672:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129581.647103:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129581.647118:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f44b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1830948737629184:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129581.647132:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129581.647144:0:3303:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1746129581.647148:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f448a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1830948737629056:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129581.647210:0:31503:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737628672 00000100:00100000:2.0:1746129581.647214:0:31503:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737628672 00000100:00100000:2.0:1746129581.647238:0:31503:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737629184 00000100:00100000:2.0:1746129581.647240:0:31503:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737629184 00000100:00100000:2.0:1746129581.647250:0:31503:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16858 00000100:00100000:2.0:1746129581.647254:0:31503:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131455c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+17:3303:x1830948737628672:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129581.647262:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129581.647283:0:8411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737629056 00000100:00100000:0.0:1746129581.647286:0:8411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737629056 00000100:00100000:0.0:1746129581.647315:0:8411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16859 00000100:00100000:0.0:1746129581.647319:0:8411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131455f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+18:3303:x1830948737629184:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746129581.647349:0:31503:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746129581.647351:0:31503:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb mtime from disk: 1746129523 -> 1746129523 00002000:00010000:2.0:1746129581.647354:0:31503:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb atime from disk: 1746129523 -> 1746129523 00002000:00010000:2.0:1746129581.647356:0:31503:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb ctime from disk: 1746129524 -> 1746129524 00002000:00010000:2.0:1746129581.647358:0:31503:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1746129581.647381:0:31503:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131455c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+20:3303:x1830948737628672:12345-0@lo:2:osp-syn-1-0.0 Request processed in 127us (278us total) trans 17179874197 rc 0/0 00000100:00100000:2.0:1746129581.647387:0:31503:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16858 00000100:00100000:0.0:1746129581.647394:0:8411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131455f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+19:3303:x1830948737629184:12345-0@lo:2:osp-syn-1-0.0 Request processed in 75us (261us total) trans 17179874198 rc 0/0 00000100:00100000:0.0:1746129581.647398:0:8411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16859 00000100:00100000:0.0:1746129581.647406:0:8411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16860 00000100:00100000:0.0:1746129581.647410:0:8411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131456300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+18:3303:x1830948737629056:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129581.647926:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e388700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737628928:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129581.647949:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129581.647962:0:3301:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1746129581.647966:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e389f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737628800:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129581.647979:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129581.647987:0:3301:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1746129581.647992:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b550a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737629312:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129581.647997:0:20577:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737628928 00000100:00100000:3.0:1746129581.648001:0:20577:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737628928 00000100:00100000:2.0:1746129581.648005:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129581.648016:0:20577:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737628800 00000100:00100000:3.0:1746129581.648018:0:20577:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737628800 00000100:00100000:2.0:1746129581.648021:0:8412:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737629312 00000100:00100000:2.0:1746129581.648024:0:8412:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737629312 00000100:00100000:3.0:1746129581.648029:0:20577:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16861 00000100:00100000:3.0:1746129581.648034:0:20577:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f44b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+20:3301:x1830948737628928:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129581.648040:0:8412:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16862 00000100:00100000:2.0:1746129581.648044:0:8412:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f44aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+20:3301:x1830948737628800:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129581.648061:0:11014:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16863 00000100:00100000:3.0:1746129581.648067:0:11014:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f449f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+22:3301:x1830948737629312:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746129581.648166:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e388e00/2, rc 0, transno 17179874196 00000100:00100000:3.0:1746129581.648170:0:11014:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f449f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+23:3301:x1830948737629312:12345-0@lo:2:osp-syn-0-0.0 Request processed in 103us (163us total) trans 21474841447 rc 0/0 00000100:00100000:2.0:1746129581.648171:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e388e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737627776:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129581.648176:0:11014:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16863 00000004:00080000:2.0:1746129581.648179:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013575ca80/2, rc 0, transno 21474841446 00000100:00100000:2.0:1746129581.648182:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013575ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737628288:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746129581.648195:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b550a80/2, rc 0, transno 21474841447 00000100:00100000:2.0:1746129581.648197:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b550a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737629312:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129581.648267:0:8411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131456300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+23:3303:x1830948737629056:12345-0@lo:2:osp-syn-1-0.0 Request processed in 856us (1003us total) trans 17179874199 rc 0/0 00000100:00100000:0.0:1746129581.648273:0:8411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16860 00000004:00080000:0.0:1746129581.648311:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f448a80/2, rc 0, transno 17179874199 00000100:00100000:0.0:1746129581.648314:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f448a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1830948737629056:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129581.648321:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e38a680/2, rc 0, transno 17179874197 00000100:00100000:0.0:1746129581.648324:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e38a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1830948737628672:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129581.648329:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f44b480/2, rc 0, transno 17179874198 00000100:00100000:0.0:1746129581.648332:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f44b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1830948737629184:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129581.648401:0:8412:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f44aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+22:3301:x1830948737628800:12345-0@lo:2:osp-syn-1-0.0 Request processed in 355us (419us total) trans 17179874201 rc 0/0 00000100:00100000:2.0:1746129581.648406:0:8412:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16862 00000100:00100000:3.0:1746129581.648423:0:20577:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f44b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+21:3301:x1830948737628928:12345-0@lo:2:osp-syn-1-0.0 Request processed in 388us (471us total) trans 17179874200 rc 0/0 00000004:00080000:2.0:1746129581.648425:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e389f80/2, rc 0, transno 17179874201 00000100:00100000:2.0:1746129581.648428:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e389f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737628800:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129581.648430:0:20577:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16861 00000004:00080000:2.0:1746129581.648434:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e388700/2, rc 0, transno 17179874200 00000100:00100000:2.0:1746129581.648436:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e388700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737628928:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129581.648468:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129581.648507:0:16908:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734433024 00000100:00100000:1.0:1746129581.648511:0:16908:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734433024 00000100:00100000:1.0:1746129581.648536:0:16908:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11358 00000100:00100000:1.0:1746129581.648541:0:16908:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131456680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:068dab75-d300-4ead-a742-d14572ad1e50+6:32692:x1830948734433024:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:1.0:1746129581.648562:0:16908:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129581.648580:0:16908:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab4600/0x40a459093b06ba91 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f22309 expref: -99 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129581.648628:0:16908:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab4600/0x40a459093b06ba91 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22309 expref: 7 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129581.648640:0:16908:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab4600/0x40a459093b06ba91 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22309 expref: 7 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129581.648656:0:16908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009cffe100) 00010000:00010000:1.0:1746129581.648658:0:16908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746129581.648660:0:16908:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fab4600, rc 0) 00000100:00100000:1.0:1746129581.648697:0:16908:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131456680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:068dab75-d300-4ead-a742-d14572ad1e50+7:32692:x1830948734433024:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 155us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129581.648702:0:16908:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11358 00000100:00100000:0.0:1746129581.650805:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129581.650855:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734433280 00000100:00100000:2.0:1746129581.650863:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734433280 00000100:00100000:2.0:1746129581.650947:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4846 00000100:00100000:2.0:1746129581.650956:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131456a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:068dab75-d300-4ead-a742-d14572ad1e50+7:32692:x1830948734433280:12345-192.168.202.4@tcp:35:lfs.0 00000100:00100000:2.0:1746129581.651468:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131456a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:068dab75-d300-4ead-a742-d14572ad1e50+8:32692:x1830948734433280:12345-192.168.202.4@tcp:35:lfs.0 Request processed in 512us (672us total) trans 8589945484 rc 0/0 00000100:00100000:2.0:1746129581.651475:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4846 00000100:00100000:0.0:1746129581.675239:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129581.675336:0:16908:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734433536 00000100:00100000:1.0:1746129581.675347:0:16908:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734433536 00000100:00100000:1.0:1746129581.675409:0:16908:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11359 00000100:00100000:1.0:1746129581.675418:0:16908:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131456d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+6:32703:x1830948734433536:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129581.675447:0:16908:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129581.675464:0:16908:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab4a00/0x40a459093b06ba98 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f22310 expref: -99 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129581.675579:0:16908:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab4c00/0x40a459093b06ba9f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129581.675591:0:16908:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab4c00/0x40a459093b06ba9f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129581.675601:0:16908:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab4c00/0x40a459093b06ba9f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129581.675613:0:16908:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab5c00/0x40a459093b06baa6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129581.675618:0:16908:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab5c00/0x40a459093b06baa6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129581.675624:0:16908:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab5c00/0x40a459093b06baa6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129581.677235:0:16908:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab4e00/0x40a459093b06baad lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129581.677248:0:16908:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab4e00/0x40a459093b06baad lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129581.677257:0:16908:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab4e00/0x40a459093b06baad lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00000004:00200000:1.0:1746129581.677268:0:16908:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:1.0:1746129581.677387:0:16908:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab4c00/0x40a459093b06ba9f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129581.677393:0:16908:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab4c00/0x40a459093b06ba9f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129581.677402:0:16908:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab4c00/0x40a459093b06ba9f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129581.677408:0:16908:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fab4c00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:1.0:1746129581.677411:0:16908:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab4c00/0x40a459093b06ba9f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129581.677417:0:16908:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab4c00/0x40a459093b06ba9f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129581.677428:0:16908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880132ef8f00) 00010000:00010000:1.0:1746129581.677430:0:16908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129581.677434:0:16908:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab4c00/0x40a459093b06ba9f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129581.677439:0:16908:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab4c00/0x40a459093b06ba9f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16908 initiator: MDT0 00000100:00100000:0.0:1746129581.677521:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129581.677550:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734433792 00000100:00100000:0.0:1746129581.677556:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734433792 00000100:00100000:0.0:1746129581.677612:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11360 00000100:00100000:0.0:1746129581.677621:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131457100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ada2ffba-8920-4ecb-8068-68caa9806978+288:32700:x1830948734433792:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:0.0:1746129581.677637:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129581.677646:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1c0200/0x40a459093b06babb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f22317 expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129581.677715:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1c0a00/0x40a459093b06bac2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129581.677722:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1c0a00/0x40a459093b06bac2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129581.677727:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1c0a00/0x40a459093b06bac2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129581.677734:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1c0400/0x40a459093b06bac9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129581.677739:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1c0400/0x40a459093b06bac9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129581.677744:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1c0400/0x40a459093b06bac9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129581.677792:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1c1a00/0x40a459093b06bad0 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129581.677797:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1c1a00/0x40a459093b06bad0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129581.677802:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1c1a00/0x40a459093b06bad0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00200000:0.0:1746129581.677806:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:0.0:1746129581.677836:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1c0a00/0x40a459093b06bac2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129581.677840:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1c0a00/0x40a459093b06bac2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129581.677845:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1c0a00/0x40a459093b06bac2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129581.677848:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e1c0a00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:0.0:1746129581.677850:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1c0a00/0x40a459093b06bac2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129581.677854:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1c0a00/0x40a459093b06bac2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129581.677859:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880132ef8f00) 00010000:00010000:0.0:1746129581.677861:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129581.677863:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1c0a00/0x40a459093b06bac2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129581.677866:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1c0a00/0x40a459093b06bac2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129581.677881:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1c0400/0x40a459093b06bac9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129581.677885:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1c0400/0x40a459093b06bac9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129581.677890:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1c0400/0x40a459093b06bac9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129581.677893:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e1c0400 already unused, calling callback (ffffffffa136e690) 00010000:00010000:0.0:1746129581.677894:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1c0400/0x40a459093b06bac9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129581.677898:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1c0400/0x40a459093b06bac9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129581.677902:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009cffee00) 00010000:00010000:0.0:1746129581.677903:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129581.677905:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1c0400/0x40a459093b06bac9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129581.677908:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1c0400/0x40a459093b06bac9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129581.677933:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1c0200/0x40a459093b06babb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22317 expref: 291 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129581.677942:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1c1a00/0x40a459093b06bad0 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22317 expref: 290 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129581.677947:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009cffe100) 00010000:00010000:0.0:1746129581.677949:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746129581.677951:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e1c1a00, rc 0) 00000100:00100000:0.0:1746129581.677991:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131457100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ada2ffba-8920-4ecb-8068-68caa9806978+290:32700:x1830948734433792:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 373us (475us total) trans 8589945486 rc 0/0 00000100:00100000:0.0:1746129581.677997:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11360 00010000:00010000:1.0:1746129581.678660:0:16908:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab5c00/0x40a459093b06baa6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129581.678670:0:16908:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab5c00/0x40a459093b06baa6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129581.678674:0:16908:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab5c00/0x40a459093b06baa6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129581.678679:0:16908:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fab5c00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:1.0:1746129581.678681:0:16908:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab5c00/0x40a459093b06baa6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129581.678687:0:16908:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab5c00/0x40a459093b06baa6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129581.678698:0:16908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009cffee00) 00010000:00010000:1.0:1746129581.678701:0:16908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129581.678703:0:16908:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab5c00/0x40a459093b06baa6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129581.678707:0:16908:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab5c00/0x40a459093b06baa6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129581.678740:0:16908:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab4a00/0x40a459093b06ba98 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22310 expref: 9 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129581.678750:0:16908:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab4e00/0x40a459093b06baad lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22310 expref: 8 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129581.678755:0:16908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009cffe100) 00010000:00010000:1.0:1746129581.678757:0:16908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746129581.678759:0:16908:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fab4e00, rc 0) 00000100:00100000:1.0:1746129581.680520:0:16908:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131456d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+8:32703:x1830948734433536:12345-192.168.202.4@tcp:101:cat.0 Request processed in 3384us (3572us total) trans 8589945485 rc 0/0 00000100:00100000:1.0:1746129581.680532:0:16908:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11359 00000100:00100000:0.0:1746129581.681881:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129581.681957:0:16908:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734434048 00000100:00100000:1.0:1746129581.681966:0:16908:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734434048 00000100:00100000:1.0:1746129581.682000:0:16908:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11361 00000100:00100000:1.0:1746129581.682006:0:16908:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131457480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ada2ffba-8920-4ecb-8068-68caa9806978+290:32700:x1830948734434048:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:1.0:1746129581.682027:0:16908:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129581.682030:0:16908:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1746129581.682056:0:16908:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1c1a00/0x40a459093b06bad0 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22317 expref: 290 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129581.682075:0:16908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009cffe100) 00010000:00010000:1.0:1746129581.682079:0:16908:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746129581.682089:0:16908:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab5a00/0x40a459093b06bade lrc: 2/0,0 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2231e expref: -99 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129581.682139:0:16908:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab4400/0x40a459093b06bae5 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129581.682152:0:16908:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab4600/0x40a459093b06ba91 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22309 expref: 7 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129581.682158:0:16908:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab4e00/0x40a459093b06baad lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22310 expref: 7 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129581.682163:0:16908:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab4400/0x40a459093b06bae5 lrc: 5/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129581.682192:0:16908:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab4e00/0x40a459093b06baad lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22310 expref: 7 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129581.682204:0:16908:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab4e00/0x40a459093b06baad lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22310 expref: 7 pid: 16908 timeout: 936 lvb_type: 0 00000100:00100000:1.0:1746129581.682215:0:16908:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800959d4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16908:1830948737629440:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129581.683375:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129581.683386:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129581.683401:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734434432 00000100:00100000:0.0:1746129581.683406:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734434432 00000100:00100000:0.0:1746129581.683441:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11362 00000100:00100000:0.0:1746129581.683447:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f44ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+8:32698:x1830948734434432:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:0.0:1746129581.683467:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129581.683478:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1c1800/0x40a459093b06baec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2232c expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129581.683560:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1c0200/0x40a459093b06baf3 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129581.683569:0:14549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1c0200/0x40a459093b06baf3 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129581.683576:0:14549:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1c0200/0x40a459093b06baf3 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129581.683649:0:16908:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab4600/0x40a459093b06ba91 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22309 expref: 7 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129581.683659:0:16908:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab4600/0x40a459093b06ba91 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22309 expref: 7 pid: 16908 timeout: 937 lvb_type: 0 00000100:00100000:1.0:1746129581.683668:0:16908:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800959d4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16908:1830948737629568:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129581.683719:0:20577:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734434176 00000100:00100000:3.0:1746129581.683723:0:20577:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734434176 00000100:00100000:1.0:1746129581.683723:0:16908:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a91c5780 going to sleep for 11 seconds 00000100:00100000:3.0:1746129581.683750:0:20577:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16864 00000100:00100000:3.0:1746129581.683755:0:20577:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131457800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+16:32703:x1830948734434176:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129581.683871:0:20577:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129581.683882:0:20577:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f384600/0x40a459093b06bafa lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f22325 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129581.683897:0:20577:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129581.683898:0:20577:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129581.684160:0:20577:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f384600/0x40a459093b06bafa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22325 expref: 17 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129581.684176:0:20577:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f384600/0x40a459093b06bafa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22325 expref: 17 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129581.684185:0:20577:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f384600, rc 0) 00000100:00100000:3.0:1746129581.684231:0:20577:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131457800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+17:32703:x1830948734434176:12345-192.168.202.4@tcp:101:cat.0 Request processed in 474us (858us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129581.684237:0:20577:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16864 00000100:00100000:2.0:1746129581.684545:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129581.684561:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734434688 00000100:00100000:2.0:1746129581.684565:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734434688 00000100:00100000:2.0:1746129581.684590:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11363 00000100:00100000:2.0:1746129581.684594:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a77b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ada2ffba-8920-4ecb-8068-68caa9806978+291:32704:x1830948734434688:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129581.684602:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129581.684610:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c031a00/0x40a459093b06bb01 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f22333 expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129581.684687:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094bb3e00/0x40a459093b06bb08 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746129581.684696:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094bb3e00/0x40a459093b06bb08 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746129581.684706:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094bb3e00/0x40a459093b06bb08 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746129581.684717:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094bb3400/0x40a459093b06bb0f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746129581.684723:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094bb3400/0x40a459093b06bb0f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746129581.684727:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094bb3400/0x40a459093b06bb0f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746129581.684817:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d104c00/0x40a459093b06bb16 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746129581.684823:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d104c00/0x40a459093b06bb16 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x10/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00000100:00100000:1.0:1746129581.684825:0:16908:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800959d4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16908:1830948737629440:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129581.684828:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d104c00/0x40a459093b06bb16 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x10/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000004:00200000:2.0:1746129581.684835:0:14548:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:2.0:1746129581.684913:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d104c00/0x40a459093b06bb16 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x10/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746129581.684919:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d104c00/0x40a459093b06bb16 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x10/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746129581.684925:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d104c00/0x40a459093b06bb16 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x10/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746129581.684931:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009d104c00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746129581.684934:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d104c00/0x40a459093b06bb16 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x10/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746129581.684941:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d104c00/0x40a459093b06bb16 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x10/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746129581.684950:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009cffe100) 00010000:00010000:2.0:1746129581.684952:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:2.0:1746129581.684955:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d104c00/0x40a459093b06bb16 lrc: 2/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x10/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746129581.684960:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d104c00/0x40a459093b06bb16 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x10/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746129581.684974:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094bb3e00/0x40a459093b06bb08 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746129581.684979:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094bb3e00/0x40a459093b06bb08 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746129581.684983:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094bb3e00/0x40a459093b06bb08 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746129581.684987:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094bb3e00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746129581.684988:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094bb3e00/0x40a459093b06bb08 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746129581.684993:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094bb3e00/0x40a459093b06bb08 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746129581.686252:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880132ef8f00) 00010000:00010000:2.0:1746129581.686257:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129581.686262:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094bb3e00/0x40a459093b06bb08 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00000100:00100000:3.0:1746129581.686407:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129581.686463:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129581.686492:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129581.686512:0:2271:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734435072 00000100:00100000:3.0:1746129581.686517:0:2271:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734435072 00000100:00100000:3.0:1746129581.686546:0:2271:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11364 00000100:00100000:3.0:1746129581.686552:0:2271:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+10:32703:x1830948734435072:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129581.686564:0:2271:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129581.686574:0:2271:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0b5800/0x40a459093b06bb24 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2233a expref: -99 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129581.686612:0:2271:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab4400/0x40a459093b06bae5 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129581.686619:0:2271:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0b5800/0x40a459093b06bb24 lrc: 4/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2233a expref: 11 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129581.686633:0:2271:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab4400/0x40a459093b06bae5 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129581.686643:0:2271:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0b5800/0x40a459093b06bb24 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2233a expref: 11 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129581.686653:0:2271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009cffe100) 00010000:00010000:3.0:1746129581.686655:0:2271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746129581.686657:0:2271:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab4400/0x40a459093b06bae5 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129581.686662:0:2271:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e0b5800, rc 0) 00000100:00100000:3.0:1746129581.686696:0:2271:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+11:32703:x1830948734435072:12345-192.168.202.4@tcp:101:cat.0 Request processed in 144us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129581.686701:0:2271:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11364 00010000:00010000:2.0:1746129581.686813:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094bb3e00/0x40a459093b06bb08 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746129581.686827:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094bb3400/0x40a459093b06bb0f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746129581.686832:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094bb3400/0x40a459093b06bb0f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746129581.686837:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094bb3400/0x40a459093b06bb0f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746129581.686842:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094bb3400 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746129581.686844:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094bb3400/0x40a459093b06bb0f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00000100:00100000:0.0:1746129581.686846:0:15749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734434816 00010000:00010000:2.0:1746129581.686848:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094bb3400/0x40a459093b06bb0f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00000100:00100000:0.0:1746129581.686850:0:15749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734434816 00010000:00010000:2.0:1746129581.686855:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f9f3800) 00010000:00010000:2.0:1746129581.686857:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129581.686859:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094bb3400/0x40a459093b06bb0f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746129581.686864:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094bb3400/0x40a459093b06bb0f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746129581.686866:0:15749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab4e00/0x40a459093b06baad lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22310 expref: 11 pid: 16908 timeout: 936 lvb_type: 0 00000100:00100000:0.0:1746129581.686881:0:15749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734434944 00000100:00100000:0.0:1746129581.686884:0:15749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734434944 00010000:00010000:0.0:1746129581.686891:0:15749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab4600/0x40a459093b06ba91 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22309 expref: 8 pid: 16908 timeout: 937 lvb_type: 0 00000100:00100000:0.0:1746129581.686901:0:15749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8731 00010000:00010000:2.0:1746129581.686903:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c031a00/0x40a459093b06bb01 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22333 expref: 293 pid: 14548 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129581.686906:0:15749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b552300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+11:1963:x1830948734434816:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129581.686910:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c031a00/0x40a459093b06bb01 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22333 expref: 293 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129581.686913:0:15749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129581.686916:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c031a00, rc 0) 00010000:00010000:0.0:1746129581.686917:0:15749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab4e00/0x40a459093b06baad lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22310 expref: 11 pid: 16908 timeout: 936 lvb_type: 0 00010000:00010000:0.0:1746129581.686926:0:15749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab4e00/0x40a459093b06baad lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22310 expref: 11 pid: 16908 timeout: 936 lvb_type: 0 00000100:00100000:2.0:1746129581.686938:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a77b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ada2ffba-8920-4ecb-8068-68caa9806978+292:32704:x1830948734434688:12345-192.168.202.4@tcp:101:cat.0 Request processed in 2343us (2393us total) trans 8589945487 rc 301/301 00010000:00010000:0.0:1746129581.686938:0:15749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab4e00/0x40a459093b06baad lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22310 expref: 11 pid: 16908 timeout: 936 lvb_type: 0 00000100:00100000:2.0:1746129581.686944:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11363 00010000:00010000:0.0:1746129581.686951:0:15749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009cffe100) 00010000:00010000:0.0:1746129581.686954:0:15749:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1c0200/0x40a459093b06baf3 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129581.686960:0:15749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1c0200/0x40a459093b06baf3 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129581.686965:0:15749:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1c0200/0x40a459093b06baf3 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129581.686970:0:15749:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab4400/0x40a459093b06bae5 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129581.686974:0:15749:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab4400/0x40a459093b06bae5 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129581.686994:0:15749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129581.687008:0:15749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b552300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+10:1963:x1830948734434816:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 103us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129581.687014:0:15749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8731 00000100:00100000:0.0:1746129581.687024:0:15749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8732 00000100:00100000:0.0:1746129581.687028:0:15749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3e4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:068dab75-d300-4ead-a742-d14572ad1e50+8:1962:x1830948734434944:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129581.687034:0:15749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129581.687038:0:15749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab4600/0x40a459093b06ba91 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22309 expref: 8 pid: 16908 timeout: 937 lvb_type: 0 00010000:00010000:0.0:1746129581.687045:0:15749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab4600/0x40a459093b06ba91 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22309 expref: 8 pid: 16908 timeout: 937 lvb_type: 0 00010000:00010000:0.0:1746129581.687053:0:15749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009cffe100) 00010000:00010000:0.0:1746129581.687056:0:15749:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab4400/0x40a459093b06bae5 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129581.687062:0:15749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab4400/0x40a459093b06bae5 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40290400000020 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129581.687066:0:15749:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab4400/0x40a459093b06bae5 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40290400000020 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129581.687072:0:15749:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0b5800/0x40a459093b06bb24 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2233a expref: 9 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129581.687079:0:15749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129581.687089:0:15749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3e4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:068dab75-d300-4ead-a742-d14572ad1e50+8:1962:x1830948734434944:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 61us (626us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129581.687095:0:15749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8732 00010000:00010000:0.0:1746129581.687190:0:14549:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1c0200/0x40a459093b06baf3 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129581.687195:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1c0200/0x40a459093b06baf3 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00200000:0.0:1746129581.687208:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:1.0:1746129581.687352:0:16908:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab4600/0x40a459093b06ba91 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22309 expref: 7 pid: 16908 timeout: 937 lvb_type: 0 00000100:00100000:1.0:1746129581.687365:0:16908:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800959d4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16908:1830948737629568:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129581.687388:0:16908:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab4400/0x40a459093b06bae5 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129581.687394:0:16908:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab4400/0x40a459093b06bae5 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129581.687398:0:16908:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab4400/0x40a459093b06bae5 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129581.687583:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1c1800/0x40a459093b06baec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2232c expref: 11 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129581.687594:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1c0200/0x40a459093b06baf3 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2232c expref: 10 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129581.687599:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009cffe100) 00010000:00010000:0.0:1746129581.687602:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746129581.687603:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e1c0200, rc 0) 00000100:00100000:0.0:1746129581.687636:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f44ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+10:32698:x1830948734434432:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 4188us (4250us total) trans 8589945488 rc 0/0 00000100:00100000:0.0:1746129581.687641:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11362 00000040:00080000:1.0:1746129581.687985:0:16908:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3509, 88 off295528 00000004:00080000:1.0:1746129581.687991:0:16908:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 837004696675ns, next at 776349687452ns, rc = 0 00000040:00080000:1.0:1746129581.688033:0:16908:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3517, 88 off296144 00000004:00080000:1.0:1746129581.688036:0:16908:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 837004742578ns, next at 776375382381ns, rc = 0 00000040:00080000:1.0:1746129581.688065:0:16908:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3518, 88 off296232 00000004:00080000:1.0:1746129581.688069:0:16908:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 837004774831ns, next at 776375382381ns, rc = 0 00000040:00080000:1.0:1746129581.688099:0:16908:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3510, 88 off295616 00000004:00080000:1.0:1746129581.688103:0:16908:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 837004809011ns, next at 776349687452ns, rc = 0 00000040:00080000:1.0:1746129581.688323:0:16908:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3511, 88 off295704 00000004:00080000:1.0:1746129581.688327:0:16908:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 837005033563ns, next at 776349687452ns, rc = 0 00000040:00080000:1.0:1746129581.688553:0:16908:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3519, 88 off296320 00000004:00080000:1.0:1746129581.688557:0:16908:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 837005263431ns, next at 776375382381ns, rc = 0 00000040:00080000:1.0:1746129581.688569:0:16908:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3520, 88 off296408 00000004:00080000:1.0:1746129581.688572:0:16908:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 837005277909ns, next at 776375382381ns, rc = 0 00000040:00080000:1.0:1746129581.688578:0:16908:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3521, 88 off296496 00000004:00080000:1.0:1746129581.688580:0:16908:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 837005286608ns, next at 776375382381ns, rc = 0 00000040:00080000:1.0:1746129581.688587:0:16908:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3512, 88 off295792 00000004:00080000:1.0:1746129581.688590:0:16908:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 837005296333ns, next at 776349687452ns, rc = 0 00000040:00080000:1.0:1746129581.688599:0:16908:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3522, 88 off296584 00000004:00080000:1.0:1746129581.688602:0:16908:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 837005307816ns, next at 776375382381ns, rc = 0 00000040:00080000:1.0:1746129581.688608:0:16908:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3513, 88 off295880 00000004:00080000:1.0:1746129581.688610:0:16908:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 837005316246ns, next at 776349687452ns, rc = 0 00000040:00080000:1.0:1746129581.689431:0:16908:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3523, 88 off296672 00000004:00080000:1.0:1746129581.689438:0:16908:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 837006143456ns, next at 776375382381ns, rc = 0 00000040:00080000:1.0:1746129581.689453:0:16908:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3514, 88 off295968 00000004:00080000:1.0:1746129581.689456:0:16908:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 837006161974ns, next at 776349687452ns, rc = 0 00000040:00080000:1.0:1746129581.689471:0:16908:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3515, 88 off296056 00000004:00080000:1.0:1746129581.689474:0:16908:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 837006180524ns, next at 776349687452ns, rc = 0 00000040:00080000:1.0:1746129581.689486:0:16908:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3516, 88 off296144 00000004:00080000:1.0:1746129581.689489:0:16908:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 837006195539ns, next at 776349687452ns, rc = 0 00000040:00080000:1.0:1746129581.689496:0:16908:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3517, 88 off296232 00000004:00080000:1.0:1746129581.689499:0:16908:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 837006204941ns, next at 776349687452ns, rc = 0 00000040:00080000:1.0:1746129581.689509:0:16908:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3524, 88 off296760 00000004:00080000:1.0:1746129581.689511:0:16908:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 837006217592ns, next at 776375382381ns, rc = 0 00000100:00100000:0.0:1746129581.689826:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129581.689855:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734435200 00000100:00100000:0.0:1746129581.689864:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734435200 00000100:00100000:0.0:1746129581.689912:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11365 00000100:00100000:0.0:1746129581.689920:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131457b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ada2ffba-8920-4ecb-8068-68caa9806978+293:32704:x1830948734435200:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129581.689935:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129581.689952:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1c1200/0x40a459093b06bb32 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f22341 expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129581.690030:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800955d3200/0x40a459093b06bb39 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129581.690044:0:14549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1c0200/0x40a459093b06baf3 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2232c expref: 9 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129581.690050:0:14549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800955d3200/0x40a459093b06bb39 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129581.690093:0:14549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1c0200/0x40a459093b06baf3 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2232c expref: 9 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129581.690104:0:14549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1c0200/0x40a459093b06baf3 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2232c expref: 9 pid: 14549 timeout: 937 lvb_type: 0 00000100:00100000:0.0:1746129581.690116:0:14549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129bc0000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830948737629696:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129581.690197:0:14549:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa23b9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746129581.694686:0:14549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129bc0000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830948737629696:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129581.694715:0:14549:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800955d3200/0x40a459093b06bb39 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000100:00100000:1.0:1746129581.696962:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129581.697463:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734435328 00000100:00100000:0.0:1746129581.697475:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734435328 00010000:00010000:0.0:1746129581.697789:0:9823:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1c0200/0x40a459093b06baf3 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2232c expref: 10 pid: 14549 timeout: 937 lvb_type: 0 00000100:00100000:0.0:1746129581.697819:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8733 00000100:00100000:0.0:1746129581.697827:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+10:1962:x1830948734435328:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129581.697842:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129581.697850:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1c0200/0x40a459093b06baf3 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2232c expref: 10 pid: 14549 timeout: 937 lvb_type: 0 00010000:00010000:0.0:1746129581.697868:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1c0200/0x40a459093b06baf3 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2232c expref: 10 pid: 14549 timeout: 937 lvb_type: 0 00010000:00010000:0.0:1746129581.697893:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1c0200/0x40a459093b06baf3 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2232c expref: 10 pid: 14549 timeout: 937 lvb_type: 0 00010000:00010000:0.0:1746129581.697909:0:9823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009cffe100) 00010000:00010000:0.0:1746129581.697915:0:9823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800955d3200/0x40a459093b06bb39 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129581.697923:0:9823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800955d3200/0x40a459093b06bb39 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129581.697929:0:9823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0b5800/0x40a459093b06bb24 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2233a expref: 9 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129581.697935:0:9823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff8800955d3200/0x40a459093b06bb39 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129581.697940:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129581.698567:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+9:1962:x1830948734435328:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 739us (1610us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129581.698574:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8733 00010000:00010000:1.0:1746129581.715477:0:16908:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab4400/0x40a459093b06bae5 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2231e expref: 295 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129581.715494:0:16908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009cffe100) 00010000:00010000:1.0:1746129581.715498:0:16908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1746129581.715501:0:16908:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800955d3200/0x40a459093b06bb39 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129581.715510:0:16908:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800955d3200/0x40a459093b06bb39 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129581.715514:0:16908:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800955d3200/0x40a459093b06bb39 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129581.715521:0:16908:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0b5800/0x40a459093b06bb24 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2233a expref: 8 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129581.715526:0:16908:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0b5800/0x40a459093b06bb24 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2233a expref: 8 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129581.715531:0:16908:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0b5800/0x40a459093b06bb24 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2233a expref: 8 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129581.715571:0:16908:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0b5800/0x40a459093b06bb24 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2233a expref: 8 pid: 2271 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129581.715585:0:16908:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800959d4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16908:1830948737629824:192.168.202.4@tcp:105: 00000100:00100000:1.0:1746129581.715686:0:16908:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a91c5540 going to sleep for 11 seconds 00010000:00010000:0.0:1746129581.715698:0:14549:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800955d3200/0x40a459093b06bb39 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000001:00080000:1.0:1746129581.715704:0:14619:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945488 is committed 00010000:00010000:0.0:1746129581.715705:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800955d3200/0x40a459093b06bb39 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000001:00080000:1.0:1746129581.715712:0:14619:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945486 is committed 00000001:00080000:1.0:1746129581.715717:0:14619:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945489 is committed 00000004:00080000:1.0:1746129581.715721:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2693 committed 00000004:00080000:1.0:1746129581.715728:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2686 committed 00000004:00080000:1.0:1746129581.715734:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2685 committed 00000004:00080000:1.0:1746129581.715735:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2684 committed 00000004:00080000:1.0:1746129581.715736:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2683 committed 00000004:00080000:1.0:1746129581.715738:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2692 committed 00000004:00080000:1.0:1746129581.715739:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2682 committed 00000004:00080000:1.0:1746129581.715740:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2691 committed 00000004:00080000:1.0:1746129581.715742:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2681 committed 00000004:00080000:1.0:1746129581.715743:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2690 committed 00000004:00080000:1.0:1746129581.715744:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2689 committed 00000004:00080000:1.0:1746129581.715745:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2688 committed 00000004:00080000:1.0:1746129581.715746:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2680 committed 00000004:00080000:1.0:1746129581.715747:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2679 committed 00000004:00200000:0.0:1746129581.715747:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00000004:00080000:1.0:1746129581.715749:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2687 committed 00000004:00080000:1.0:1746129581.715750:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2686 committed 00000004:00080000:1.0:1746129581.715751:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2678 committed 00000004:00200000:0.0:1746129581.715752:0:14549:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000001:00080000:1.0:1746129581.715764:0:14619:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945484 is committed 00000004:00010000:0.0:1746129581.715768:0:14549:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800955d3200/0x40a459093b06bb39 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129581.715967:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1c1200/0x40a459093b06bb32 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22341 expref: 293 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129581.715984:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800955d3200/0x40a459093b06bb39 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22341 expref: 292 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129581.715990:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009cffe100) 00010000:00010000:0.0:1746129581.715992:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1746129581.715994:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800955d3200, rc 0) 00000100:00100000:0.0:1746129581.716243:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131457b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ada2ffba-8920-4ecb-8068-68caa9806978+292:32704:x1830948734435200:12345-192.168.202.4@tcp:101:cat.0 Request processed in 26320us (26418us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129581.716253:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11365 00000100:00100000:0.0:1746129581.716286:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f3e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1830948737630208:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129581.716345:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129581.716370:0:3303:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1746129581.716375:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a77b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1830948737630080:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129581.716392:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129581.716508:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a77b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737629952:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129581.716585:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f3e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737630336:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129581.716615:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f3e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737630592:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129581.716638:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129581.716735:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a77b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1830948737630720:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129581.716780:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129581.716861:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a77b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737630848:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129581.716862:0:8410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737630208 00000100:00100000:1.0:1746129581.716869:0:8410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737630208 00000100:00100000:2.0:1746129581.716877:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129581.716886:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800903a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737631360:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129581.716898:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129581.716899:0:8410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737630080 00000100:00100000:1.0:1746129581.716901:0:8410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737630080 00000100:00100000:2.0:1746129581.716907:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a77b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737631872:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129581.716912:0:8410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737630592 00000100:00100000:1.0:1746129581.716914:0:8410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737630592 00000100:00100000:2.0:1746129581.716919:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129581.716924:0:8410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737630336 00000100:00100000:1.0:1746129581.716926:0:8410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737630336 00000100:00100000:2.0:1746129581.716930:0:3300:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1746129581.716934:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f3e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737630464:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129581.716936:0:8410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737630848 00000100:00100000:1.0:1746129581.716937:0:8410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737630848 00000100:00100000:1.0:1746129581.716946:0:8410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737631360 00000100:00100000:2.0:1746129581.716947:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129581.716948:0:8410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737631360 00000100:00100000:1.0:1746129581.716953:0:8410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737631872 00000100:00100000:2.0:1746129581.716954:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f3e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737630976:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129581.716955:0:8410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737631872 00000100:00100000:1.0:1746129581.716961:0:8410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737630464 00000100:00100000:1.0:1746129581.716963:0:8410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737630464 00000100:00100000:2.0:1746129581.716965:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129581.716968:0:8410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737630976 00000100:00100000:1.0:1746129581.716970:0:8410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737630976 00000100:00100000:2.0:1746129581.716972:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a77b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737631488:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129581.716978:0:8410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16865 00000100:00100000:2.0:1746129581.716983:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129581.716983:0:8410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129bc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+28:3303:x1830948737630208:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129581.716997:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737631488 00000100:00100000:2.0:1746129581.716999:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737631488 00000100:00100000:2.0:1746129581.717011:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16866 00000100:00100000:2.0:1746129581.717014:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129bc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+24:3303:x1830948737630080:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746129581.717153:0:7149:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746129581.717153:0:8410:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3ec:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:1.0:1746129581.717156:0:8410:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ec:0x0] updating lvb mtime from disk: 1746129582 -> 1746129582 00002000:00010000:2.0:1746129581.717157:0:7149:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb mtime from disk: 1746129582 -> 1746129582 00002000:00010000:2.0:1746129581.717159:0:7149:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb atime from disk: 1746129582 -> 1746129582 00002000:00010000:1.0:1746129581.717159:0:8410:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3ec:0x0] updating lvb atime from disk: 1746129582 -> 1746129582 00002000:00010000:2.0:1746129581.717161:0:7149:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb ctime from disk: 1746129582 -> 1746129582 00002000:00010000:1.0:1746129581.717161:0:8410:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ec:0x0] updating lvb ctime from disk: 1746129582 -> 1746129582 00002000:00010000:2.0:1746129581.717162:0:7149:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb blocks from disk: 2081 -> 2081 00002000:00010000:1.0:1746129581.717162:0:8410:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3ec:0x0] updating lvb blocks from disk: 2073 -> 2073 00000100:00100000:2.0:1746129581.717183:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129bc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+25:3303:x1830948737630080:12345-0@lo:2:osp-syn-1-0.0 Request processed in 167us (789us total) trans 17179874202 rc 0/0 00000100:00100000:1.0:1746129581.717183:0:8410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129bc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+29:3303:x1830948737630208:12345-0@lo:2:osp-syn-0-0.0 Request processed in 199us (838us total) trans 21474841448 rc 0/0 00000100:00100000:1.0:1746129581.717188:0:8410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16865 00000100:00100000:2.0:1746129581.717190:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16866 00000100:00100000:2.0:1746129581.717198:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16867 00000100:00100000:1.0:1746129581.717200:0:8410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16868 00000100:00100000:2.0:1746129581.717202:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+28:3302:x1830948737630592:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129581.717204:0:8410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c079880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+28:3300:x1830948737630336:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129581.717791:0:20577:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16869 00000100:00100000:3.0:1746129581.717798:0:20577:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c078e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+24:3300:x1830948737630848:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746129581.717891:0:20577:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746129581.717894:0:20577:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb mtime from disk: 1746129523 -> 1746129523 00002000:00010000:3.0:1746129581.717896:0:20577:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb atime from disk: 1746129523 -> 1746129523 00002000:00010000:3.0:1746129581.717898:0:20577:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb ctime from disk: 1746129524 -> 1746129524 00002000:00010000:3.0:1746129581.717900:0:20577:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1746129581.718024:0:8412:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16870 00000100:00100000:0.0:1746129581.718031:0:8412:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c07b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+28:3300:x1830948737631360:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129581.718515:0:22481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16871 00000100:00100000:2.0:1746129581.718522:0:22481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c07aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+25:3300:x1830948737631872:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129581.718528:0:22480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16872 00000100:00100000:1.0:1746129581.718534:0:22480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c07b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+28:3300:x1830948737630464:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746129581.718701:0:8412:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746129581.718703:0:8412:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1746129581.718704:0:8412:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746129581.718707:0:8412:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746129581.718709:0:8412:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1746129581.718885:0:22481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c07aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+26:3300:x1830948737631872:12345-0@lo:2:osp-syn-1-0.0 Request processed in 363us (1963us total) trans 17179874204 rc 0/0 00000100:00100000:3.0:1746129581.718890:0:20577:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c078e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+26:3300:x1830948737630848:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1094us (2012us total) trans 17179874203 rc 0/0 00000100:00100000:2.0:1746129581.718891:0:22481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16871 00000100:00100000:3.0:1746129581.718895:0:20577:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16869 00000100:00100000:2.0:1746129581.718904:0:22481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16873 00000100:00100000:3.0:1746129581.718907:0:20577:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16874 00000100:00100000:2.0:1746129581.718909:0:22481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+29:3300:x1830948737630976:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129581.718912:0:20577:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+24:3300:x1830948737631488:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129581.718983:0:20577:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+25:3300:x1830948737631488:12345-0@lo:2:osp-syn-1-0.0 Request processed in 71us (1998us total) trans 17179874205 rc 0/0 00000100:00100000:2.0:1746129581.718983:0:22481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+30:3300:x1830948737630976:12345-0@lo:2:osp-syn-0-0.0 Request processed in 74us (2016us total) trans 21474841450 rc 0/0 00000100:00100000:2.0:1746129581.718988:0:22481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16873 00000100:00100000:3.0:1746129581.718990:0:20577:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16874 00000100:00100000:2.0:1746129581.719006:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129581.719109:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+30:3302:x1830948737630592:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1906us (2470us total) trans 21474841451 rc 0/0 00000100:00100000:2.0:1746129581.719114:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16867 00000100:00100000:2.0:1746129581.719123:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737629952 00000100:00100000:2.0:1746129581.719129:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737629952 00000100:00100000:0.0:1746129581.719170:0:8412:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c07b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+29:3300:x1830948737631360:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1140us (2270us total) trans 21474841449 rc 0/0 00000100:00100000:0.0:1746129581.719175:0:8412:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16870 00000100:00100000:0.0:1746129581.719184:0:8412:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16875 00000100:00100000:0.0:1746129581.719189:0:8412:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c29dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+25:3301:x1830948737629952:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746129581.719272:0:8412:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746129581.719275:0:8412:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb mtime from disk: 1746129582 -> 1746129582 00002000:00010000:0.0:1746129581.719276:0:8412:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb atime from disk: 1746129582 -> 1746129582 00002000:00010000:0.0:1746129581.719278:0:8412:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb ctime from disk: 1746129582 -> 1746129582 00002000:00010000:0.0:1746129581.719280:0:8412:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746129581.719317:0:8412:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c29dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+26:3301:x1830948737629952:12345-0@lo:2:osp-syn-1-0.0 Request processed in 128us (310us total) trans 17179874206 rc 0/0 00000100:00100000:0.0:1746129581.719322:0:8412:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16875 00002000:00010000:2.0:1746129581.719732:0:22480:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb size from disk: 5146336 -> 5146336 00002000:00010000:2.0:1746129581.719736:0:22480:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb mtime from disk: 1746129582 -> 1746129582 00002000:00010000:2.0:1746129581.719738:0:22480:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb atime from disk: 1746129582 -> 1746129582 00002000:00010000:2.0:1746129581.719740:0:22480:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb ctime from disk: 1746129582 -> 1746129582 00002000:00010000:2.0:1746129581.719742:0:22480:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb blocks from disk: 6033 -> 6033 00000100:00100000:2.0:1746129581.719762:0:22480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c07b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+29:3300:x1830948737630464:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1228us (2813us total) trans 21474841452 rc 0/0 00000100:00100000:2.0:1746129581.719767:0:22480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16872 00000004:00080000:2.0:1746129581.719798:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a77b1f80/2, rc 0, transno 17179874206 00000100:00100000:2.0:1746129581.719804:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a77b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737629952:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746129581.719823:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f3e5500/2, rc 0, transno 21474841452 00000100:00100000:2.0:1746129581.719830:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f3e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737630464:0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746129581.719830:0:8410:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746129581.719832:0:8410:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb mtime from disk: 1746129582 -> 1746129582 00002000:00010000:1.0:1746129581.719834:0:8410:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb atime from disk: 1746129582 -> 1746129582 00002000:00010000:1.0:1746129581.719836:0:8410:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb ctime from disk: 1746129582 -> 1746129582 00000004:00080000:2.0:1746129581.719837:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f3e4700/2, rc 0, transno 21474841450 00002000:00010000:1.0:1746129581.719838:0:8410:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:2.0:1746129581.719840:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f3e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737630976:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746129581.719846:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a77b0e00/2, rc 0, transno 17179874205 00000100:00100000:2.0:1746129581.719849:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a77b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737631488:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746129581.719857:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a77b3800/2, rc 0, transno 17179874203 00000100:00100000:2.0:1746129581.719860:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a77b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737630848:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129581.719861:0:8410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c079880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+29:3300:x1830948737630336:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2657us (3081us total) trans 21474841453 rc 0/0 00000100:00100000:1.0:1746129581.719866:0:8410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16868 00000004:00080000:2.0:1746129581.719867:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800903a0a80/2, rc 0, transno 21474841449 00000100:00100000:2.0:1746129581.719869:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800903a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737631360:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746129581.719875:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a77b0700/2, rc 0, transno 17179874204 00000100:00100000:2.0:1746129581.719877:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a77b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737631872:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746129581.719884:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f3e5880/2, rc 0, transno 21474841453 00000100:00100000:2.0:1746129581.719886:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f3e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737630336:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746129581.719903:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f3e4380/2, rc 0, transno 21474841451 00000100:00100000:2.0:1746129581.719906:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f3e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737630592:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129581.719913:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f3e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737631104:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129581.719938:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129581.719950:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800903a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737631616:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129581.719963:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129581.719977:0:22480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737631104 00000100:00100000:2.0:1746129581.719980:0:22480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737631104 00000100:00100000:1.0:1746129581.719983:0:8410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737631616 00000100:00100000:1.0:1746129581.719985:0:8410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737631616 00000100:00100000:2.0:1746129581.719993:0:22480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16876 00000100:00100000:2.0:1746129581.719997:0:22480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+30:3302:x1830948737631104:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129581.719997:0:8410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16877 00000100:00100000:1.0:1746129581.720001:0:8410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+30:3302:x1830948737631616:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129581.720079:0:8410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+32:3302:x1830948737631616:12345-0@lo:2:osp-syn-0-0.0 Request processed in 77us (114us total) trans 21474841454 rc 0/0 00000100:00100000:2.0:1746129581.720082:0:22480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+32:3302:x1830948737631104:12345-0@lo:2:osp-syn-0-0.0 Request processed in 85us (143us total) trans 21474841455 rc 0/0 00000100:00100000:1.0:1746129581.720084:0:8410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16877 00000100:00100000:2.0:1746129581.720086:0:22480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16876 00000004:00080000:2.0:1746129581.720101:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f3e6300/2, rc 0, transno 21474841455 00000100:00100000:2.0:1746129581.720104:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f3e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737631104:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746129581.720110:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800903a0700/2, rc 0, transno 21474841454 00000100:00100000:3.0:1746129581.720372:0:3300:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1746129581.720378:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737632000:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129581.720389:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129581.720399:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129581.720405:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a77b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1830948737631232:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129581.720413:0:31503:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737630720 00000100:00100000:3.0:1746129581.720416:0:31503:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737630720 00000100:00100000:0.0:1746129581.720422:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129581.720429:0:31503:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737632000 00000100:00100000:3.0:1746129581.720431:0:31503:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737632000 00000100:00100000:0.0:1746129581.720431:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a77b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1830948737631744:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129581.720438:0:31503:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737631232 00000100:00100000:3.0:1746129581.720440:0:31503:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737631232 00000100:00100000:0.0:1746129581.720442:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129581.720448:0:31503:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737631744 00000100:00100000:3.0:1746129581.720449:0:31503:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737631744 00000100:00100000:3.0:1746129581.720458:0:31503:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16878 00000004:00080000:0.0:1746129581.720461:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a77b0a80/2, rc 0, transno 17179874202 00000100:00100000:3.0:1746129581.720463:0:31503:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129bc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+28:3303:x1830948737630720:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129581.720465:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a77b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1830948737630080:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129581.720473:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f3e4a80/2, rc 0, transno 21474841448 00000100:00100000:0.0:1746129581.720476:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f3e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1830948737630208:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129581.720490:0:8411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16879 00000100:00100000:0.0:1746129581.720496:0:8411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+31:3300:x1830948737632000:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746129581.720554:0:31503:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3f5:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746129581.720557:0:31503:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f5:0x0] updating lvb mtime from disk: 1746129582 -> 1746129582 00002000:00010000:3.0:1746129581.720558:0:31503:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f5:0x0] updating lvb atime from disk: 1746129582 -> 1746129582 00002000:00010000:3.0:1746129581.720560:0:31503:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f5:0x0] updating lvb ctime from disk: 1746129582 -> 1746129582 00002000:00010000:3.0:1746129581.720562:0:31503:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f5:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:0.0:1746129581.720567:0:8411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+32:3300:x1830948737632000:12345-0@lo:2:osp-syn-0-0.0 Request processed in 71us (167us total) trans 21474841456 rc 0/0 00000100:00100000:0.0:1746129581.720572:0:8411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16879 00000100:00100000:3.0:1746129581.720578:0:31503:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129bc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+29:3303:x1830948737630720:12345-0@lo:2:osp-syn-1-0.0 Request processed in 116us (190us total) trans 17179874207 rc 0/0 00000100:00100000:0.0:1746129581.720581:0:8411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16880 00000100:00100000:3.0:1746129581.720583:0:31503:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16878 00000100:00100000:0.0:1746129581.720585:0:8411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129bc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+29:3303:x1830948737631232:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129581.720590:0:31503:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16881 00000100:00100000:3.0:1746129581.720594:0:31503:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129bc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+28:3303:x1830948737631744:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129581.720656:0:31503:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129bc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+30:3303:x1830948737631744:12345-0@lo:2:osp-syn-1-0.0 Request processed in 63us (213us total) trans 17179874209 rc 0/0 00000100:00100000:0.0:1746129581.720656:0:8411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129bc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+30:3303:x1830948737631232:12345-0@lo:2:osp-syn-1-0.0 Request processed in 70us (232us total) trans 17179874208 rc 0/0 00000100:00100000:0.0:1746129581.720661:0:8411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16880 00000100:00100000:3.0:1746129581.720663:0:31503:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16881 00000004:00080000:0.0:1746129581.720679:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800947bdc00/2, rc 0, transno 21474841456 00000100:00100000:0.0:1746129581.720682:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737632000:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129581.720701:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a77b3480/2, rc 0, transno 17179874207 00000100:00100000:0.0:1746129581.720704:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a77b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1830948737630720:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129581.720710:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a77b1500/2, rc 0, transno 17179874208 00000100:00100000:0.0:1746129581.720712:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a77b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1830948737631232:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129581.720717:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a77b3100/2, rc 0, transno 17179874209 00000100:00100000:0.0:1746129581.720719:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a77b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1830948737631744:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129581.720824:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800903a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737631616:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129581.721248:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129581.721290:0:16908:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800959d4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16908:1830948737629824:192.168.202.4@tcp:105: 00010000:00010000:2.0:1746129581.721350:0:16908:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab5a00/0x40a459093b06bade lrc: 0/0,0 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2231e expref: 291 pid: 16908 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1746129581.721368:0:16908:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab4400/0x40a459093b06bae5 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2231e expref: 290 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129581.721397:0:16908:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fab4400, rc 0) 00000100:00100000:0.0:1746129581.721566:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734435456 00000100:00100000:0.0:1746129581.721591:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734435456 00000100:00100000:0.0:1746129581.721618:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11366 00000100:00100000:0.0:1746129581.721623:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ada2ffba-8920-4ecb-8068-68caa9806978+291:32704:x1830948734435456:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129581.721636:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129581.721648:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec79c00/0x40a459093b06bb40 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f22348 expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129581.721687:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec79c00/0x40a459093b06bb40 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22348 expref: 292 pid: 14549 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129581.721784:0:16908:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131457480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ada2ffba-8920-4ecb-8068-68caa9806978+292:32700:x1830948734434048:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 39776us (39908us total) trans 8589945489 rc 0/0 00000100:00100000:2.0:1746129581.721790:0:16908:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11361 00010000:00010000:0.0:1746129581.722010:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec79c00/0x40a459093b06bb40 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22348 expref: 291 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129581.722027:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009cffe100) 00010000:00010000:0.0:1746129581.722030:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746129581.722033:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ec79c00, rc 0) 00000100:00100000:1.0:1746129581.722049:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129581.722175:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734435584 00000100:00100000:2.0:1746129581.722179:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734435584 00000100:00100000:2.0:1746129581.722201:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4847 00000100:00100000:2.0:1746129581.722205:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+7:32703:x1830948734435584:12345-192.168.202.4@tcp:49:cat.0 00000100:00100000:0.0:1746129581.722269:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ada2ffba-8920-4ecb-8068-68caa9806978+291:32704:x1830948734435456:12345-192.168.202.4@tcp:101:cat.0 Request processed in 644us (1022us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129581.722274:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11366 00000100:00100000:2.0:1746129581.722609:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+7:32703:x1830948734435584:12345-192.168.202.4@tcp:49:cat.0 Request processed in 402us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129581.722615:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4847 00000100:00100000:0.0:1746129581.724880:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129581.724920:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129581.724968:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129581.724998:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734435840 00000100:00100000:1.0:1746129581.725001:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734435712 00000100:00100000:1.0:1746129581.725006:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734435712 00000100:00100000:0.0:1746129581.725006:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734435840 00000100:00100000:1.0:1746129581.725042:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734435968 00000100:00100000:1.0:1746129581.725044:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734435968 00000100:00100000:1.0:1746129581.725057:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16882 00000100:00100000:0.0:1746129581.725057:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 805 00000100:00100000:1.0:1746129581.725064:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129bc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ada2ffba-8920-4ecb-8068-68caa9806978+24:32700:x1830948734435712:12345-192.168.202.4@tcp:101:multiop.0 00000100:00100000:0.0:1746129581.725064:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6ce0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ada2ffba-8920-4ecb-8068-68caa9806978+291:1962:x1830948734435840:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129581.725077:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129581.725079:0:4385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129581.725095:0:4385:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f229e00/0x40a459093b06bb47 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2234f expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129581.725099:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec79c00/0x40a459093b06bb40 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22348 expref: 291 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129581.725114:0:9823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009cffe100) 00010000:00010000:0.0:1746129581.725118:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746129581.725119:0:4385:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009129f000/0x40a459093b06ba21 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f222df expref: 10 pid: 8411 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129581.725127:0:4385:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f384600/0x40a459093b06bafa lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22325 expref: 16 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129581.725137:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129581.725139:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129581.725141:0:4385:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f229e00/0x40a459093b06bb47 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [1007616->1028095] (req 1007616->1028095) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2234f expref: 25 pid: 4385 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129581.725155:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6ce0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ada2ffba-8920-4ecb-8068-68caa9806978+290:1962:x1830948734435840:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 92us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129581.725161:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 805 00010000:00010000:1.0:1746129581.725167:0:4385:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f384600/0x40a459093b06bafa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22325 expref: 16 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129581.725177:0:4385:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f384600/0x40a459093b06bafa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22325 expref: 16 pid: 20577 timeout: 937 lvb_type: 0 00000100:00100000:1.0:1746129581.725187:0:4385:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fc2c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:4385:1830948737632128:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129581.725211:0:8412:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16883 00000100:00100000:0.0:1746129581.725231:0:8412:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129bc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ada2ffba-8920-4ecb-8068-68caa9806978+25:1962:x1830948734435968:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129581.725237:0:8412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129581.725242:0:8412:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ec79800/0x40a459093b06bb4e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f22356 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129581.725253:0:8412:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129581.725258:0:4385:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009129f000/0x40a459093b06ba21 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f222df expref: 10 pid: 8411 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129581.725265:0:4385:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009129f000/0x40a459093b06ba21 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f222df expref: 10 pid: 8411 timeout: 937 lvb_type: 1 00000100:00100000:1.0:1746129581.725277:0:4385:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fc2ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:4385:1830948737632256:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129581.725323:0:4385:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a91c5000 going to sleep for 11 seconds 00010000:00010000:0.0:1746129581.725570:0:8412:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ec79800/0x40a459093b06bb4e lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22356 expref: 26 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129581.725580:0:8412:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ec79800/0x40a459093b06bb4e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22356 expref: 26 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129581.725588:0:8412:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ec79800, rc 0) 00000100:00100000:0.0:1746129581.725861:0:8412:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129bc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ada2ffba-8920-4ecb-8068-68caa9806978+25:1962:x1830948734435968:12345-192.168.202.4@tcp:101:cat.0 Request processed in 644us (940us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129581.725867:0:8412:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16883 00000100:00100000:0.0:1746129581.726378:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129581.726403:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129581.726434:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129581.726553:0:8410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734436096 00000100:00100000:3.0:1746129581.726558:0:8410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734436096 00000100:00100000:3.0:1746129581.726581:0:8410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734436224 00000100:00100000:3.0:1746129581.726583:0:8410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734436224 00000100:00100000:3.0:1746129581.726604:0:8410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734436480 00000100:00100000:3.0:1746129581.726607:0:8410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734436480 00000100:00100000:3.0:1746129581.726620:0:8410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16884 00000100:00100000:3.0:1746129581.726625:0:8410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129bc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ada2ffba-8920-4ecb-8068-68caa9806978+30:1963:x1830948734436096:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129581.726634:0:8410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129581.726646:0:8410:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095f6ca00/0x40a459093b06bb55 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2235d expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129581.726659:0:8410:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129581.726661:0:8410:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129581.726668:0:8410:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095f6ca00/0x40a459093b06bb55 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2235d expref: 31 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129581.726681:0:8410:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095f6ca00/0x40a459093b06bb55 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2235d expref: 31 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129581.726689:0:8410:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f6ca00, rc 0) 00000100:00100000:3.0:1746129581.726711:0:8410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129bc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ada2ffba-8920-4ecb-8068-68caa9806978+31:1963:x1830948734436096:12345-192.168.202.4@tcp:101:cat.0 Request processed in 86us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129581.726716:0:8410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16884 00000100:00100000:3.0:1746129581.726726:0:8410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16885 00000100:00100000:3.0:1746129581.726730:0:8410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129bc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ada2ffba-8920-4ecb-8068-68caa9806978+30:1962:x1830948734436224:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129581.726735:0:8410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129581.726741:0:8410:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c3d4a00/0x40a459093b06bb5c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f22364 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129581.726749:0:8410:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129581.726751:0:8410:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129581.726754:0:8410:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c3d4a00/0x40a459093b06bb5c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22364 expref: 31 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129581.726762:0:8410:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c3d4a00/0x40a459093b06bb5c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22364 expref: 31 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129581.726769:0:8410:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c3d4a00, rc 0) 00000100:00100000:3.0:1746129581.726781:0:8410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129bc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ada2ffba-8920-4ecb-8068-68caa9806978+31:1962:x1830948734436224:12345-192.168.202.4@tcp:101:cat.0 Request processed in 50us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129581.726788:0:8410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16885 00000100:00100000:3.0:1746129581.726802:0:8410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16886 00000100:00100000:3.0:1746129581.726806:0:8410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129bc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ada2ffba-8920-4ecb-8068-68caa9806978+25:1962:x1830948734436480:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129581.726812:0:8410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129581.726818:0:8410:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f6dc00/0x40a459093b06bb63 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f22372 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129581.726827:0:8410:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129581.726829:0:8410:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746129581.727146:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129581.727167:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129581.727207:0:8411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734436608 00000100:00100000:1.0:1746129581.727210:0:8411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734436608 00000100:00100000:1.0:1746129581.727237:0:8411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734436352 00000100:00100000:1.0:1746129581.727239:0:8411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734436352 00000100:00100000:1.0:1746129581.727251:0:8411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16887 00000100:00100000:1.0:1746129581.727256:0:8411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ada2ffba-8920-4ecb-8068-68caa9806978+31:1962:x1830948734436608:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129581.727263:0:8411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129581.727271:0:8411:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095801600/0x40a459093b06bb6a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f22379 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129581.727281:0:8411:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129581.727282:0:8411:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129581.727286:0:8411:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095801600/0x40a459093b06bb6a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22379 expref: 32 pid: 8411 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129581.727321:0:8411:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095801600/0x40a459093b06bb6a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22379 expref: 32 pid: 8411 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129581.727328:0:8411:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095801600, rc 0) 00000100:00100000:1.0:1746129581.727347:0:8411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ada2ffba-8920-4ecb-8068-68caa9806978+32:1962:x1830948734436608:12345-192.168.202.4@tcp:101:cat.0 Request processed in 91us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129581.727352:0:8411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16887 00000100:00100000:1.0:1746129581.727363:0:8411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16888 00000100:00100000:1.0:1746129581.727368:0:8411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ada2ffba-8920-4ecb-8068-68caa9806978+27:1963:x1830948734436352:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129581.727373:0:8411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129581.727379:0:8411:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095800c00/0x40a459093b06bb71 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2236b expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129581.727388:0:8411:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129581.727390:0:8411:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129581.727393:0:8411:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095800c00/0x40a459093b06bb71 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2236b expref: 28 pid: 8411 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129581.727401:0:8411:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095800c00/0x40a459093b06bb71 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2236b expref: 28 pid: 8411 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129581.727408:0:8411:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095800c00, rc 0) 00000100:00100000:1.0:1746129581.727420:0:8411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ada2ffba-8920-4ecb-8068-68caa9806978+28:1963:x1830948734436352:12345-192.168.202.4@tcp:101:cat.0 Request processed in 52us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129581.727424:0:8411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16888 00010000:00010000:3.0:1746129581.727475:0:8410:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f6dc00/0x40a459093b06bb63 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22372 expref: 27 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129581.727485:0:8410:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095f6dc00/0x40a459093b06bb63 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22372 expref: 27 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129581.727491:0:8410:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f6dc00, rc 0) 00000100:00100000:3.0:1746129581.727506:0:8410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129bc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ada2ffba-8920-4ecb-8068-68caa9806978+27:1962:x1830948734436480:12345-192.168.202.4@tcp:101:cat.0 Request processed in 700us (1072us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129581.727511:0:8410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16886 00000100:00100000:1.0:1746129581.728251:0:4385:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fc2c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:4385:1830948737632128:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129581.728262:0:4385:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fc2ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:4385:1830948737632256:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129581.728289:0:4385:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f229e00/0x40a459093b06bb47 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [1007616->1028095] (req 1007616->1028095) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2234f expref: 26 pid: 4385 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129581.728465:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00010000:00010000:1.0:1746129581.728507:0:4385:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f229e00, rc 0) 00000100:00100000:1.0:1746129581.728535:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129bc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ada2ffba-8920-4ecb-8068-68caa9806978+26:32700:x1830948734435712:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 3471us (3666us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129581.728541:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16882 00000100:00100000:0.0:1746129581.728830:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129581.728931:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734436736 00000100:00100000:3.0:1746129581.728936:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734436736 00010000:00010000:3.0:1746129581.728959:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009129f000/0x40a459093b06ba21 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f222df expref: 11 pid: 8411 timeout: 937 lvb_type: 1 00000100:00100000:3.0:1746129581.728978:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8734 00000100:00100000:3.0:1746129581.728983:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129bc2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:068dab75-d300-4ead-a742-d14572ad1e50+11:1960:x1830948734436736:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129581.728999:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129581.729020:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009129f000/0x40a459093b06ba21 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f222df expref: 11 pid: 8411 timeout: 937 lvb_type: 1 00010000:00010000:3.0:1746129581.729029:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009129f000/0x40a459093b06ba21 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f222df expref: 11 pid: 8411 timeout: 937 lvb_type: 1 00010000:00010000:3.0:1746129581.729049:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009129f000/0x40a459093b06ba21 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f222df expref: 11 pid: 8411 timeout: 937 lvb_type: 1 00010000:00010000:3.0:1746129581.729058:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129581.729234:0:31520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734436992 00000100:00100000:2.0:1746129581.729238:0:31520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734436992 00002000:00100000:2.0:1746129581.729267:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3ec:0x0] (0->1048575) req@ffff880129bc2a00 x1830948734436992/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:322/0 lens 488/0 e 0 to 0 dl 1746129592 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129581.729277:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129bc2a00 with x1830948734436992 ext(0->1048575) 00010000:00010000:2.0:1746129581.729283:0:31520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f384600/0x40a459093b06bafa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22325 expref: 17 pid: 20577 timeout: 937 lvb_type: 0 00010000:00010000:2.0:1746129581.729311:0:31520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f384600/0x40a459093b06bafa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22325 expref: 17 pid: 20577 timeout: 937 lvb_type: 0 00002000:00010000:2.0:1746129581.729317:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880129bc2a00 00000100:00100000:2.0:1746129581.729331:0:31520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2532 00000100:00100000:2.0:1746129581.729335:0:31520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129bc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+17:1961:x1830948734436992:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:3.0:1746129581.730761:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129bc2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:068dab75-d300-4ead-a742-d14572ad1e50+10:1960:x1830948734436736:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 1767us (2287us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129581.730771:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8734 00000100:00100000:1.0:1746129581.731830:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129581.731858:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734437120 00000100:00100000:1.0:1746129581.731867:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734437120 00000100:00100000:1.0:1746129581.731907:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16889 00000100:00100000:1.0:1746129581.731915:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ada2ffba-8920-4ecb-8068-68caa9806978+26:32704:x1830948734437120:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129581.731935:0:4385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129581.731956:0:4385:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ec72000/0x40a459093b06bb78 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f22380 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129581.731985:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129581.731990:0:4385:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f229e00/0x40a459093b06bb47 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [1007616->1028095] (req 1007616->1028095) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2234f expref: 27 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129581.731997:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129581.732001:0:4385:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ec72000/0x40a459093b06bb78 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22380 expref: 27 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129581.732042:0:4385:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f229e00/0x40a459093b06bb47 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [1007616->1028095] (req 1007616->1028095) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2234f expref: 27 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129581.732054:0:4385:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ec72000/0x40a459093b06bb78 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22380 expref: 27 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129581.732065:0:4385:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ec72000, rc 0) 00000100:00100000:1.0:1746129581.732099:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ada2ffba-8920-4ecb-8068-68caa9806978+27:32704:x1830948734437120:12345-192.168.202.4@tcp:101:cat.0 Request processed in 186us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129581.732105:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16889 00000100:00100000:2.0:1746129581.742973:0:31520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129bc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+17:1961:x1830948734436992:12345-192.168.202.4@tcp:3:cat.0 Request processed in 13622us (14128us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129581.742986:0:31520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2532 00002000:00100000:2.0:1746129581.743002:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3ec:0x0] (0->1048575) req@ffff880129bc2a00 x1830948734436992/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:322/0 lens 488/440 e 0 to 0 dl 1746129592 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129581.743012:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129bc2a00 with x1830948734436992 ext(0->1048575) 00010000:00010000:2.0:1746129581.743023:0:31520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f384600/0x40a459093b06bafa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22325 expref: 17 pid: 20577 timeout: 937 lvb_type: 0 00010000:00010000:2.0:1746129581.743039:0:31520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f384600/0x40a459093b06bafa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22325 expref: 17 pid: 20577 timeout: 937 lvb_type: 0 00002000:00010000:2.0:1746129581.743046:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880129bc2a00 00000100:00100000:0.0:1746129581.752868:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129581.752969:0:31503:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734437248 00000100:00100000:1.0:1746129581.752979:0:31503:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734437248 00000100:00100000:1.0:1746129581.753041:0:31503:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16890 00000100:00100000:1.0:1746129581.753050:0:31503:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129bc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+19:32703:x1830948734437248:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129581.753069:0:31503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129581.753090:0:31503:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b4e0de00/0x40a459093b06bb7f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f22387 expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129581.753117:0:31503:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129581.753119:0:31503:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129581.753127:0:31503:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b4e0de00/0x40a459093b06bb7f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22387 expref: 20 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129581.753146:0:31503:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b4e0de00/0x40a459093b06bb7f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22387 expref: 20 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129581.753158:0:31503:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4e0de00, rc 0) 00000100:00100000:1.0:1746129581.753201:0:31503:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129bc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:32703:x1830948734437248:12345-192.168.202.4@tcp:101:cat.0 Request processed in 153us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129581.753207:0:31503:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16890 00000100:00100000:0.0:1746129581.754633:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129581.754773:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734437376 00000100:00100000:2.0:1746129581.754780:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734437376 00010000:00010000:2.0:1746129581.754812:0:9823:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f384600/0x40a459093b06bafa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22325 expref: 17 pid: 20577 timeout: 937 lvb_type: 0 00000100:00100000:2.0:1746129581.754852:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8735 00000100:00100000:2.0:1746129581.754859:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129bc3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+17:1962:x1830948734437376:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129581.754872:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129581.754898:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f384600/0x40a459093b06bafa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22325 expref: 17 pid: 20577 timeout: 937 lvb_type: 0 00010000:00010000:2.0:1746129581.754909:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f384600/0x40a459093b06bafa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22325 expref: 17 pid: 20577 timeout: 937 lvb_type: 0 00010000:00010000:2.0:1746129581.754931:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f384600/0x40a459093b06bafa lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22325 expref: 17 pid: 20577 timeout: 937 lvb_type: 0 00010000:00010000:2.0:1746129581.754964:0:9823:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129581.754966:0:9823:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129581.754973:0:9823:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f229e00/0x40a459093b06bb47 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1007616->1028095) gid 0 flags: 0x60080000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2234f expref: 26 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129581.754981:0:9823:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f229e00/0x40a459093b06bb47 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1007616->1028095) gid 0 flags: 0x60080000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2234f expref: 26 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129581.755019:0:9823:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f229e00/0x40a459093b06bb47 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1007616->1028095) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2234f expref: 26 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129581.755031:0:9823:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f229e00/0x40a459093b06bb47 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1007616->1028095) gid 0 flags: 0x70000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2234f expref: 26 pid: 4385 timeout: 937 lvb_type: 0 00000100:00100000:2.0:1746129581.755044:0:9823:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900f5c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9823:1830948737632512:192.168.202.4@tcp:105: 00000100:00100000:2.0:1746129581.755114:0:9823:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132dadd80 going to sleep for 11 seconds 00000100:00100000:2.0:1746129581.756275:0:9823:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900f5c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9823:1830948737632512:192.168.202.4@tcp:105: 00010000:00010000:2.0:1746129581.756326:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129581.756356:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129bc3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+16:1962:x1830948734437376:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 1497us (1728us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129581.756366:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8735 00000100:00100000:0.0:1746129581.756966:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129581.757040:0:31520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734437632 00000100:00100000:2.0:1746129581.757047:0:31520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734437632 00002000:00100000:2.0:1746129581.757086:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3ec:0x0] (1007616->1011711) req@ffff880129bc3480 x1830948734437632/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:322/0 lens 488/0 e 0 to 0 dl 1746129592 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129581.757097:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129bc3480 with x1830948734437632 ext(1007616->1011711) 00010000:00010000:2.0:1746129581.757105:0:31520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f229e00/0x40a459093b06bb47 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1007616->1028095) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2234f expref: 27 pid: 4385 timeout: 937 lvb_type: 0 00010000:00010000:2.0:1746129581.757117:0:31520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f229e00/0x40a459093b06bb47 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1007616->1028095) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2234f expref: 27 pid: 4385 timeout: 937 lvb_type: 0 00002000:00010000:2.0:1746129581.757124:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880129bc3480 00000100:00100000:2.0:1746129581.757154:0:31520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2533 00000100:00100000:2.0:1746129581.757162:0:31520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129bc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ada2ffba-8920-4ecb-8068-68caa9806978+27:1963:x1830948734437632:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:2.0:1746129581.757364:0:31520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129bc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ada2ffba-8920-4ecb-8068-68caa9806978+27:1963:x1830948734437632:12345-192.168.202.4@tcp:3:cat.0 Request processed in 203us (398us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129581.757370:0:31520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2533 00002000:00100000:2.0:1746129581.757375:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3ec:0x0] (1007616->1011711) req@ffff880129bc3480 x1830948734437632/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:322/0 lens 488/4536 e 0 to 0 dl 1746129592 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129581.757382:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129bc3480 with x1830948734437632 ext(1007616->1011711) 00010000:00010000:2.0:1746129581.757386:0:31520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f229e00/0x40a459093b06bb47 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1007616->1028095) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2234f expref: 27 pid: 4385 timeout: 937 lvb_type: 0 00010000:00010000:2.0:1746129581.757394:0:31520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f229e00/0x40a459093b06bb47 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1007616->1028095) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2234f expref: 27 pid: 4385 timeout: 937 lvb_type: 0 00002000:00010000:2.0:1746129581.757400:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880129bc3480 00000100:00100000:0.0:1746129581.758807:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129581.758845:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129581.758862:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734437760 00000100:00100000:2.0:1746129581.758870:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734437760 00000100:00100000:2.0:1746129581.758912:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16891 00000100:00100000:2.0:1746129581.758919:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129bc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+16:32698:x1830948734437760:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:2.0:1746129581.758934:0:4385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129581.758951:0:4385:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e1c0200/0x40a459093b06bb86 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2238e expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129581.758976:0:4385:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008fba5600/0x40a459093b06ba2f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f222fb expref: 9 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129581.758984:0:4385:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095f6dc00/0x40a459093b06bb63 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22372 expref: 26 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129581.758990:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129581.758991:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129581.758995:0:4385:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e1c0200/0x40a459093b06bb86 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [3772416->4194303] (req 3772416->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2238e expref: 17 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129581.759027:0:4385:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095f6dc00/0x40a459093b06bb63 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22372 expref: 26 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129581.759039:0:4385:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095f6dc00/0x40a459093b06bb63 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22372 expref: 26 pid: 8410 timeout: 937 lvb_type: 1 00000100:00100000:2.0:1746129581.759050:0:4385:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900f5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:4385:1830948737632640:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129581.759147:0:4385:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008fba5600/0x40a459093b06ba2f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f222fb expref: 9 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129581.759155:0:4385:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008fba5600/0x40a459093b06ba2f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f222fb expref: 9 pid: 7149 timeout: 937 lvb_type: 1 00000100:00100000:2.0:1746129581.759162:0:4385:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900f5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:4385:1830948737632768:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129581.759182:0:4385:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132dad240 going to sleep for 11 seconds 00000100:00100000:2.0:1746129581.759198:0:31520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734438016 00000100:00100000:2.0:1746129581.759201:0:31520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734438016 00002000:00100000:2.0:1746129581.759239:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff880129bc3b80 x1830948734438016/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:322/0 lens 488/0 e 0 to 0 dl 1746129592 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129581.759247:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129bc3b80 with x1830948734438016 ext(1048576->2097151) 00002000:00010000:2.0:1746129581.759251:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880129bc3b80 00000100:00100000:2.0:1746129581.759271:0:31520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8185 00000100:00100000:2.0:1746129581.759277:0:31520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129bc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:1960:x1830948734438016:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:0.0:1746129581.759349:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129581.759379:0:31522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734438272 00000100:00100000:3.0:1746129581.759384:0:31522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734438272 00002000:00100000:3.0:1746129581.759402:0:31522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3ec:0x0] (1024000->1028095) req@ffff880129bc0700 x1830948734438272/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:322/0 lens 488/0 e 0 to 0 dl 1746129592 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129581.759590:0:31522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129bc0700 with x1830948734438272 ext(1024000->1028095) 00010000:00010000:3.0:1746129581.759598:0:31522:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f229e00/0x40a459093b06bb47 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1007616->1028095) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2234f expref: 27 pid: 4385 timeout: 937 lvb_type: 0 00010000:00010000:3.0:1746129581.759608:0:31522:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f229e00/0x40a459093b06bb47 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1007616->1028095) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2234f expref: 27 pid: 4385 timeout: 937 lvb_type: 0 00002000:00010000:3.0:1746129581.759614:0:31522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880129bc0700 00000100:00100000:3.0:1746129581.759641:0:31522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2534 00000100:00100000:3.0:1746129581.759648:0:31522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129bc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ada2ffba-8920-4ecb-8068-68caa9806978+27:1960:x1830948734438272:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:3.0:1746129581.759786:0:31522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129bc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ada2ffba-8920-4ecb-8068-68caa9806978+27:1960:x1830948734438272:12345-192.168.202.4@tcp:3:cat.0 Request processed in 137us (435us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129581.759792:0:31522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2534 00002000:00100000:3.0:1746129581.759798:0:31522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3ec:0x0] (1024000->1028095) req@ffff880129bc0700 x1830948734438272/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:322/0 lens 488/4536 e 0 to 0 dl 1746129592 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129581.759806:0:31522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129bc0700 with x1830948734438272 ext(1024000->1028095) 00010000:00010000:3.0:1746129581.760757:0:31522:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f229e00/0x40a459093b06bb47 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1007616->1028095) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2234f expref: 27 pid: 4385 timeout: 937 lvb_type: 0 00000100:00100000:2.0:1746129581.760766:0:4385:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900f5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:4385:1830948737632640:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129581.760772:0:31522:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f229e00/0x40a459093b06bb47 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1007616->1028095) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2234f expref: 27 pid: 4385 timeout: 937 lvb_type: 0 00002000:00010000:3.0:1746129581.760779:0:31522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880129bc0700 00000100:00100000:0.0:1746129581.761980:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129581.762017:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129581.762057:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734438528 00000100:00100000:3.0:1746129581.762064:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734438528 00010000:00010000:3.0:1746129581.762094:0:9823:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008fba5600/0x40a459093b06ba2f lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f222fb expref: 10 pid: 7149 timeout: 937 lvb_type: 1 00000100:00100000:3.0:1746129581.762113:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734438400 00000100:00100000:3.0:1746129581.762116:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734438400 00010000:00010000:3.0:1746129581.762124:0:9823:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095f6dc00/0x40a459093b06bb63 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22372 expref: 27 pid: 8410 timeout: 937 lvb_type: 1 00000100:00100000:3.0:1746129581.762140:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8736 00000100:00100000:3.0:1746129581.762146:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129bc0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:068dab75-d300-4ead-a742-d14572ad1e50+10:1962:x1830948734438528:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129581.762160:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129581.762182:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008fba5600/0x40a459093b06ba2f lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f222fb expref: 10 pid: 7149 timeout: 937 lvb_type: 1 00010000:00010000:3.0:1746129581.762192:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008fba5600/0x40a459093b06ba2f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f222fb expref: 10 pid: 7149 timeout: 937 lvb_type: 1 00010000:00010000:2.0:1746129581.762228:0:4385:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008fba5600/0x40a459093b06ba2f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f222fb expref: 10 pid: 7149 timeout: 937 lvb_type: 1 00010000:00010000:3.0:1746129581.762230:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129581.762244:0:4385:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900f5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:4385:1830948737632768:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129581.762257:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129bc0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:068dab75-d300-4ead-a742-d14572ad1e50+9:1962:x1830948734438528:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 113us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129581.762263:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8736 00010000:00010000:2.0:1746129581.762273:0:4385:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012e1c0200/0x40a459093b06bb86 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [3772416->4194303] (req 3772416->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2238e expref: 17 pid: 4385 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129581.762274:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8737 00000100:00100000:3.0:1746129581.762278:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129bc0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ada2ffba-8920-4ecb-8068-68caa9806978+27:1962:x1830948734438400:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129581.762283:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129581.762284:0:4385:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e1c0200, rc 0) 00010000:00010000:3.0:1746129581.762289:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095f6dc00/0x40a459093b06bb63 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22372 expref: 27 pid: 8410 timeout: 937 lvb_type: 1 00010000:00010000:3.0:1746129581.762315:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095f6dc00/0x40a459093b06bb63 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22372 expref: 27 pid: 8410 timeout: 937 lvb_type: 1 00000100:00100000:2.0:1746129581.762320:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129bc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+17:32698:x1830948734437760:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 3402us (3519us total) trans 0 rc 0/0 00010000:00010000:3.0:1746129581.762326:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f6dc00/0x40a459093b06bb63 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22372 expref: 27 pid: 8410 timeout: 937 lvb_type: 1 00000100:00100000:2.0:1746129581.762327:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16891 00010000:00010000:3.0:1746129581.762340:0:9823:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129581.762341:0:9823:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129581.762348:0:9823:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012e1c0200/0x40a459093b06bb86 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3772416->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2238e expref: 16 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129581.762361:0:9823:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e1c0200/0x40a459093b06bb86 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3772416->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2238e expref: 16 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129581.762390:0:9823:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012e1c0200/0x40a459093b06bb86 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3772416->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2238e expref: 16 pid: 4385 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129581.762401:0:9823:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bf800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9823:1830948737632896:192.168.202.4@tcp:105: 00000100:00100000:3.0:1746129581.762470:0:9823:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5c68900 going to sleep for 11 seconds 00000100:00100000:0.0:1746129581.763250:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129581.763338:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129581.763460:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734439040 00000100:00100000:2.0:1746129581.763466:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734439040 00000100:00100000:2.0:1746129581.763504:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4848 00000100:00100000:2.0:1746129581.763510:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094cc8050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ada2ffba-8920-4ecb-8068-68caa9806978+290:32700:x1830948734439040:12345-192.168.202.4@tcp:35:multiop.0 00000100:00100000:2.0:1746129581.763741:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094cc8050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ada2ffba-8920-4ecb-8068-68caa9806978+291:32700:x1830948734439040:12345-192.168.202.4@tcp:35:multiop.0 Request processed in 230us (402us total) trans 8589945490 rc 0/0 00000100:00100000:2.0:1746129581.763746:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4848 00000100:00100000:3.0:1746129581.763855:0:31522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734438784 00000100:00100000:3.0:1746129581.763858:0:31522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734438784 00002000:00100000:3.0:1746129581.763882:0:31522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3ec:0x0] (1007616->1028095) req@ffff88012b552300 x1830948734438784/t0(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:322/0 lens 488/0 e 0 to 0 dl 1746129592 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129581.763891:0:31522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b552300 with x1830948734438784 ext(1007616->1028095) 00010000:00010000:3.0:1746129581.763898:0:31522:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f229e00/0x40a459093b06bb47 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1007616->1028095) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2234f expref: 27 pid: 4385 timeout: 937 lvb_type: 0 00010000:00010000:3.0:1746129581.763909:0:31522:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f229e00/0x40a459093b06bb47 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1007616->1028095) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2234f expref: 27 pid: 4385 timeout: 937 lvb_type: 0 00002000:00010000:3.0:1746129581.763914:0:31522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b552300 00000100:00100000:3.0:1746129581.763926:0:31522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2535 00000100:00100000:3.0:1746129581.763930:0:31522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b552300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ada2ffba-8920-4ecb-8068-68caa9806978+27:1960:x1830948734438784:12345-192.168.202.4@tcp:4:cat.0 00000100:00100000:3.0:1746129581.767906:0:31522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b552300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ada2ffba-8920-4ecb-8068-68caa9806978+29:1960:x1830948734438784:12345-192.168.202.4@tcp:4:cat.0 Request processed in 3962us (4644us total) trans 21474841457 rc 0/0 00000100:00100000:3.0:1746129581.767921:0:31522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2535 00002000:00100000:3.0:1746129581.767933:0:31522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3ec:0x0] (1007616->1028095) req@ffff88012b552300 x1830948734438784/t21474841457(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:322/0 lens 488/448 e 0 to 0 dl 1746129592 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129581.767943:0:31522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b552300 with x1830948734438784 ext(1007616->1028095) 00010000:00010000:3.0:1746129581.767953:0:31522:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f229e00/0x40a459093b06bb47 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1007616->1028095) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2234f expref: 29 pid: 4385 timeout: 937 lvb_type: 0 00010000:00010000:3.0:1746129581.767967:0:31522:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f229e00/0x40a459093b06bb47 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1007616->1028095) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2234f expref: 29 pid: 4385 timeout: 937 lvb_type: 0 00002000:00010000:3.0:1746129581.767973:0:31522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b552300 00000100:00100000:3.0:1746129581.768586:0:9823:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bf800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9823:1830948737632896:192.168.202.4@tcp:105: 00000100:00100000:0.0:1746129581.768591:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00010000:00010000:3.0:1746129581.768605:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129581.768770:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129bc0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ada2ffba-8920-4ecb-8068-68caa9806978+28:1962:x1830948734438400:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 6490us (6751us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129581.768779:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8737 00000100:00100000:2.0:1746129581.768839:0:31522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734439296 00000100:00100000:2.0:1746129581.768845:0:31522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734439296 00002000:00100000:2.0:1746129581.768877:0:31522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3ef:0x0] (3772416->3776511) req@ffff88009f3e4e00 x1830948734439296/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:322/0 lens 488/0 e 0 to 0 dl 1746129592 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129581.768885:0:31522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f3e4e00 with x1830948734439296 ext(3772416->3776511) 00002000:00010000:2.0:1746129581.768889:0:31522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f3e4e00 00000100:00100000:2.0:1746129581.769280:0:31522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8186 00000100:00100000:2.0:1746129581.769287:0:31522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+17:1962:x1830948734439296:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:2.0:1746129581.770016:0:31522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+17:1962:x1830948734439296:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 727us (1424us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129581.770023:0:31522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8186 00002000:00100000:2.0:1746129581.770029:0:31522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3ef:0x0] (3772416->3776511) req@ffff88009f3e4e00 x1830948734439296/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:322/0 lens 488/4536 e 0 to 0 dl 1746129592 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129581.770036:0:31522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f3e4e00 with x1830948734439296 ext(3772416->3776511) 00002000:00010000:2.0:1746129581.770040:0:31522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f3e4e00 00000100:00100000:0.0:1746129581.772244:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129581.773399:0:31520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129bc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:1960:x1830948734438016:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 14115us (14546us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129581.773412:0:31520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8185 00002000:00100000:2.0:1746129581.773424:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff880129bc3b80 x1830948734438016/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:322/0 lens 488/440 e 0 to 0 dl 1746129592 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129581.773433:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129bc3b80 with x1830948734438016 ext(1048576->2097151) 00002000:00010000:2.0:1746129581.773439:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880129bc3b80 00000100:00100000:3.0:1746129581.773632:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734439424 00000100:00100000:3.0:1746129581.773641:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734439424 00010000:00010000:3.0:1746129581.773672:0:9823:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f229e00/0x40a459093b06bb47 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1007616->1028095) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2234f expref: 28 pid: 4385 timeout: 937 lvb_type: 0 00000100:00100000:3.0:1746129581.773696:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8738 00000100:00100000:3.0:1746129581.773702:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3e7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ada2ffba-8920-4ecb-8068-68caa9806978+28:1962:x1830948734439424:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129581.773716:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129581.773737:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f229e00/0x40a459093b06bb47 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1007616->1028095) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2234f expref: 28 pid: 4385 timeout: 937 lvb_type: 0 00010000:00010000:3.0:1746129581.773750:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f229e00/0x40a459093b06bb47 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1007616->1028095) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2234f expref: 28 pid: 4385 timeout: 937 lvb_type: 0 00010000:00010000:3.0:1746129581.773773:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f229e00/0x40a459093b06bb47 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1007616->1028095) gid 0 flags: 0x44801000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2234f expref: 28 pid: 4385 timeout: 937 lvb_type: 0 00010000:00010000:3.0:1746129581.773802:0:9823:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129581.773804:0:9823:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129581.773811:0:9823:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ec72000/0x40a459093b06bb78 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22380 expref: 27 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129581.773818:0:9823:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ec72000/0x40a459093b06bb78 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22380 expref: 27 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129581.773852:0:9823:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012ec72000/0x40a459093b06bb78 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22380 expref: 27 pid: 4385 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129581.773864:0:9823:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bf800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9823:1830948737633024:192.168.202.4@tcp:105: 00000100:00100000:3.0:1746129581.773936:0:9823:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5c68900 going to sleep for 11 seconds 00000100:00100000:3.0:1746129581.775762:0:9823:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bf800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9823:1830948737633024:192.168.202.4@tcp:105: 00010000:00010000:3.0:1746129581.775783:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129581.775932:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3e7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ada2ffba-8920-4ecb-8068-68caa9806978+27:1962:x1830948734439424:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 2228us (3700us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129581.775941:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8738 00000100:00100000:0.0:1746129581.777394:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129581.777450:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734439680 00000100:00100000:2.0:1746129581.777459:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734439680 00000100:00100000:0.0:1746129581.777478:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129581.777610:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734439552 00000100:00100000:2.0:1746129581.777613:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734439552 00000100:00100000:2.0:1746129581.777633:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16892 00000100:00100000:2.0:1746129581.777640:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:32703:x1830948734439680:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129581.777659:0:4385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129581.777679:0:4385:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d107400/0x40a459093b06bb8d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2239c expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129581.777705:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129581.777707:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129581.777714:0:4385:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d107400/0x40a459093b06bb8d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2239c expref: 22 pid: 4385 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129581.777715:0:31503:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16893 00000100:00100000:1.0:1746129581.777723:0:31503:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+22:32698:x1830948734439552:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:2.0:1746129581.777728:0:4385:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009d107400/0x40a459093b06bb8d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2239c expref: 22 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129581.777729:0:31503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129581.777736:0:31503:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095801000/0x40a459093b06bb94 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f22395 expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129581.777737:0:4385:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d107400, rc 0) 00010000:00010000:1.0:1746129581.777750:0:31503:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008fba4800/0x40a459093b06ba3d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22302 expref: 10 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129581.777756:0:31503:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095801600/0x40a459093b06bb6a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22379 expref: 31 pid: 8411 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129581.777761:0:31503:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129581.777762:0:31503:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129581.777765:0:31503:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095801000/0x40a459093b06bb94 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [3145728->3379199] (req 3145728->3379199) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22395 expref: 23 pid: 31503 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129581.777785:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+23:32703:x1830948734439680:12345-192.168.202.4@tcp:101:cat.0 Request processed in 145us (398us total) trans 0 rc 0/0 00010000:00010000:1.0:1746129581.777791:0:31503:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095801600/0x40a459093b06bb6a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22379 expref: 31 pid: 8411 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746129581.777792:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16892 00010000:00010000:1.0:1746129581.777803:0:31503:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095801600/0x40a459093b06bb6a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22379 expref: 31 pid: 8411 timeout: 937 lvb_type: 1 00000100:00100000:1.0:1746129581.777816:0:31503:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fc2c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:31503:1830948737633152:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129581.777890:0:31503:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008fba4800/0x40a459093b06ba3d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22302 expref: 10 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129581.777899:0:31503:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008fba4800/0x40a459093b06ba3d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22302 expref: 10 pid: 8410 timeout: 937 lvb_type: 1 00000100:00100000:1.0:1746129581.777907:0:31503:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fc2d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:31503:1830948737633280:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129581.777926:0:31503:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a91c5000 going to sleep for 11 seconds 00000100:00100000:1.0:1746129581.779763:0:31503:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fc2c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:31503:1830948737633152:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129581.779778:0:31503:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fc2d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:31503:1830948737633280:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129581.779806:0:31503:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095801000/0x40a459093b06bb94 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [3145728->3379199] (req 3145728->3379199) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22395 expref: 22 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129581.779822:0:31503:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095801000, rc 0) 00000100:00100000:1.0:1746129581.779855:0:31503:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+22:32698:x1830948734439552:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 2133us (2376us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129581.779862:0:31503:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16893 00000100:00100000:0.0:1746129581.780093:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129581.780171:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129581.780249:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734439808 00000100:00100000:3.0:1746129581.780256:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734439808 00010000:00010000:3.0:1746129581.780281:0:9823:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095801600/0x40a459093b06bb6a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22379 expref: 32 pid: 8411 timeout: 937 lvb_type: 1 00000100:00100000:1.0:1746129581.780281:0:15749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734439936 00000100:00100000:1.0:1746129581.780284:0:15749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734439936 00010000:00010000:1.0:1746129581.780321:0:15749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008fba4800/0x40a459093b06ba3d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22302 expref: 11 pid: 8410 timeout: 937 lvb_type: 1 00000100:00100000:3.0:1746129581.780325:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8739 00000100:00100000:3.0:1746129581.780331:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f449f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ada2ffba-8920-4ecb-8068-68caa9806978+32:1962:x1830948734439808:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129581.780342:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746129581.780347:0:15749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8740 00000100:00100000:1.0:1746129581.780350:0:15749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6ce0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:068dab75-d300-4ead-a742-d14572ad1e50+11:1962:x1830948734439936:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129581.780357:0:15749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129581.780364:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095801600/0x40a459093b06bb6a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22379 expref: 32 pid: 8411 timeout: 937 lvb_type: 1 00010000:00010000:1.0:1746129581.780364:0:15749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008fba4800/0x40a459093b06ba3d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22302 expref: 11 pid: 8410 timeout: 937 lvb_type: 1 00010000:00010000:1.0:1746129581.780373:0:15749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008fba4800/0x40a459093b06ba3d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22302 expref: 11 pid: 8410 timeout: 937 lvb_type: 1 00010000:00010000:3.0:1746129581.780585:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095801600/0x40a459093b06bb6a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22379 expref: 32 pid: 8411 timeout: 937 lvb_type: 1 00010000:00010000:3.0:1746129581.780605:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095801600/0x40a459093b06bb6a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22379 expref: 32 pid: 8411 timeout: 937 lvb_type: 1 00010000:00010000:3.0:1746129581.780628:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129581.780651:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f449f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ada2ffba-8920-4ecb-8068-68caa9806978+31:1962:x1830948734439808:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 320us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129581.780657:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8739 00010000:00010000:1.0:1746129581.780704:0:15749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008fba4800/0x40a459093b06ba3d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22302 expref: 11 pid: 8410 timeout: 937 lvb_type: 1 00010000:00010000:1.0:1746129581.780726:0:15749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129581.780727:0:15749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129581.780732:0:15749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880095801000/0x40a459093b06bb94 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3379199) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22395 expref: 21 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129581.780739:0:15749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095801000/0x40a459093b06bb94 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3379199) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22395 expref: 21 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129581.780767:0:15749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880095801000/0x40a459093b06bb94 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3379199) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22395 expref: 21 pid: 31503 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129581.780778:0:15749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fc2d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15749:1830948737633408:192.168.202.4@tcp:105: 00000100:00100000:1.0:1746129581.780828:0:15749:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a91c5000 going to sleep for 11 seconds 00000100:00100000:0.0:1746129581.785654:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129581.785732:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129581.787015:0:15749:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fc2d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15749:1830948737633408:192.168.202.4@tcp:105: 00010000:00010000:1.0:1746129581.787037:0:15749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129581.787094:0:15749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6ce0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:068dab75-d300-4ead-a742-d14572ad1e50+10:1962:x1830948734439936:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 6741us (6922us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129581.787112:0:15749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8740 00000100:00100000:2.0:1746129581.787368:0:31520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734440192 00000100:00100000:3.0:1746129581.787371:0:31522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734440576 00000100:00100000:2.0:1746129581.787376:0:31520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734440192 00000100:00100000:3.0:1746129581.787384:0:31522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734440576 00002000:00100000:2.0:1746129581.787417:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3f4:0x0] (1048576->2097151) req@ffff88008f44aa00 x1830948734440192/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:322/0 lens 488/0 e 0 to 0 dl 1746129592 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129581.787427:0:31522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3ec:0x0] (0->1048575) req@ffff88008f44b800 x1830948734440576/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:322/0 lens 488/0 e 0 to 0 dl 1746129592 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129581.787427:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f44aa00 with x1830948734440192 ext(1048576->2097151) 00002000:00010000:2.0:1746129581.787433:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f44aa00 00002000:00100000:3.0:1746129581.787436:0:31522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f44b800 with x1830948734440576 ext(0->1048575) 00002000:00010000:3.0:1746129581.787441:0:31522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f44b800 00000100:00100000:2.0:1746129581.787452:0:31520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8187 00000100:00100000:2.0:1746129581.787458:0:31520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f44aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+22:1960:x1830948734440192:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:0.0:1746129581.787465:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129581.787480:0:31523:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734440704 00000100:00100000:3.0:1746129581.787483:0:31523:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734440704 00000100:00100000:0.0:1746129581.787485:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00002000:00100000:3.0:1746129581.787504:0:31523:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff88008f449f80 x1830948734440704/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:322/0 lens 488/0 e 0 to 0 dl 1746129592 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746129581.787506:0:21725:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734441088 00000100:00100000:2.0:1746129581.787509:0:21725:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734441088 00002000:00100000:3.0:1746129581.787511:0:31523:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f449f80 with x1830948734440704 ext(1048576->2097151) 00000100:00100000:0.0:1746129581.787511:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00002000:00010000:3.0:1746129581.787514:0:31523:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f449f80 00002000:00100000:2.0:1746129581.787523:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ee:0x0] (1048576->2097151) req@ffff880131454700 x1830948734441088/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:322/0 lens 488/0 e 0 to 0 dl 1746129592 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746129581.787528:0:31523:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734441216 00002000:00100000:2.0:1746129581.787529:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131454700 with x1830948734441088 ext(1048576->2097151) 00000100:00100000:3.0:1746129581.787530:0:31523:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734441216 00002000:00010000:2.0:1746129581.787532:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880131454700 00000100:00100000:0.0:1746129581.787534:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8188 00002000:00100000:3.0:1746129581.787541:0:31523:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f4:0x0] (1048576->2097151) req@ffff880131456a00 x1830948734441216/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:322/0 lens 488/0 e 0 to 0 dl 1746129592 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746129581.787543:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f44b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+28:1962:x1830948734440576:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:2.0:1746129581.787544:0:21725:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8189 00002000:00100000:3.0:1746129581.787546:0:31523:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131456a00 with x1830948734441216 ext(1048576->2097151) 00000100:00100000:2.0:1746129581.787548:0:21725:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f449f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ada2ffba-8920-4ecb-8068-68caa9806978+32:1962:x1830948734440704:12345-192.168.202.4@tcp:3:cat.0 00002000:00010000:3.0:1746129581.787549:0:31523:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880131456a00 00000100:00100000:3.0:1746129581.787561:0:31523:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8190 00000100:00100000:3.0:1746129581.787568:0:31523:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131454700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ada2ffba-8920-4ecb-8068-68caa9806978+28:1963:x1830948734441088:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:3.0:1746129581.787665:0:31518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8191 00000100:00100000:3.0:1746129581.787671:0:31518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131456a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ada2ffba-8920-4ecb-8068-68caa9806978+32:1963:x1830948734441216:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:1.0:1746129581.789056:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129581.789082:0:31519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734441472 00000100:00100000:2.0:1746129581.789088:0:31519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734441472 00002000:00100000:2.0:1746129581.789114:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f5:0x0] (3375104->3379199) req@ffff88009fc2d500 x1830948734441472/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:322/0 lens 488/0 e 0 to 0 dl 1746129592 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129581.789122:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc2d500 with x1830948734441472 ext(3375104->3379199) 00002000:00010000:2.0:1746129581.789127:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fc2d500 00000100:00100000:2.0:1746129581.789152:0:31519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8192 00000100:00100000:2.0:1746129581.789159:0:31519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+23:1961:x1830948734441472:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:2.0:1746129581.789268:0:31519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+23:1961:x1830948734441472:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 108us (218us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129581.789274:0:31519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8192 00002000:00100000:2.0:1746129581.789279:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f5:0x0] (3375104->3379199) req@ffff88009fc2d500 x1830948734441472/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:322/0 lens 488/4536 e 0 to 0 dl 1746129592 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129581.789284:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc2d500 with x1830948734441472 ext(3375104->3379199) 00002000:00010000:2.0:1746129581.789287:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fc2d500 00000100:00100000:2.0:1746129581.806524:0:21725:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f449f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ada2ffba-8920-4ecb-8068-68caa9806978+33:1962:x1830948734440704:12345-192.168.202.4@tcp:3:cat.0 Request processed in 18966us (19050us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129581.806535:0:21725:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8189 00002000:00100000:2.0:1746129581.806546:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff88008f449f80 x1830948734440704/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:322/0 lens 488/440 e 0 to 0 dl 1746129592 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129581.806554:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f449f80 with x1830948734440704 ext(1048576->2097151) 00002000:00010000:2.0:1746129581.806560:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f449f80 00000100:00100000:0.0:1746129581.811175:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129581.811329:0:14551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734441728 00000100:00100000:1.0:1746129581.811337:0:14551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734441728 00000100:00100000:1.0:1746129581.811390:0:14551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4849 00000100:00100000:1.0:1746129581.811397:0:14551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131454380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+7:32698:x1830948734441728:12345-192.168.202.4@tcp:35:multiop.0 00000100:00100000:2.0:1746129581.811531:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f44b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+29:1962:x1830948734440576:12345-192.168.202.4@tcp:3:cat.0 Request processed in 23988us (25797us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129581.811540:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8188 00000100:00100000:1.0:1746129581.811544:0:14551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131454380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+8:32698:x1830948734441728:12345-192.168.202.4@tcp:35:multiop.0 Request processed in 147us (375us total) trans 8589945491 rc 0/0 00002000:00100000:2.0:1746129581.811549:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ec:0x0] (0->1048575) req@ffff88008f44b800 x1830948734440576/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:322/0 lens 488/440 e 0 to 0 dl 1746129592 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746129581.811549:0:14551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4849 00002000:00100000:2.0:1746129581.811557:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f44b800 with x1830948734440576 ext(0->1048575) 00002000:00010000:2.0:1746129581.811562:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f44b800 00000100:00100000:3.0:1746129581.818945:0:31518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131456a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ada2ffba-8920-4ecb-8068-68caa9806978+31:1963:x1830948734441216:12345-192.168.202.4@tcp:3:cat.0 Request processed in 31265us (31424us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129581.818956:0:31518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8191 00002000:00100000:3.0:1746129581.818970:0:31518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3f4:0x0] (1048576->2097151) req@ffff880131456a00 x1830948734441216/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:322/0 lens 488/440 e 0 to 0 dl 1746129592 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129581.818979:0:31518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131456a00 with x1830948734441216 ext(1048576->2097151) 00002000:00010000:3.0:1746129581.818984:0:31518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880131456a00 00000100:00100000:2.0:1746129581.828637:0:31520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f44aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+22:1960:x1830948734440192:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 41169us (42984us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129581.828648:0:31520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8187 00002000:00100000:2.0:1746129581.828658:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3f4:0x0] (1048576->2097151) req@ffff88008f44aa00 x1830948734440192/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:322/0 lens 488/440 e 0 to 0 dl 1746129592 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129581.828666:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f44aa00 with x1830948734440192 ext(1048576->2097151) 00002000:00010000:2.0:1746129581.828672:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f44aa00 00000100:00100000:3.0:1746129581.835761:0:31523:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131454700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ada2ffba-8920-4ecb-8068-68caa9806978+27:1963:x1830948734441088:12345-192.168.202.4@tcp:3:cat.0 Request processed in 48180us (48261us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129581.835778:0:31523:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8190 00002000:00100000:3.0:1746129581.835790:0:31523:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3ee:0x0] (1048576->2097151) req@ffff880131454700 x1830948734441088/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:322/0 lens 488/440 e 0 to 0 dl 1746129592 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129581.835799:0:31523:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131454700 with x1830948734441088 ext(1048576->2097151) 00002000:00010000:3.0:1746129581.835806:0:31523:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880131454700 00000100:00100000:0.0:1746129581.840271:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129581.840449:0:31503:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734441984 00000100:00100000:1.0:1746129581.840455:0:31503:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734441984 00000100:00100000:0.0:1746129581.840464:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129581.840499:0:31503:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734441856 00000100:00100000:1.0:1746129581.840501:0:31503:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734441856 00000100:00100000:0.0:1746129581.840503:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129581.840514:0:31503:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734442112 00000100:00100000:1.0:1746129581.840516:0:31503:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734442112 00000100:00100000:1.0:1746129581.840530:0:31503:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16894 00000100:00100000:1.0:1746129581.840537:0:31503:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131454000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ada2ffba-8920-4ecb-8068-68caa9806978+31:1963:x1830948734441984:12345-192.168.202.4@tcp:101:cat.0 00000100:00100000:2.0:1746129581.840540:0:22480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16895 00000100:00100000:0.0:1746129581.840546:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16896 00000100:00100000:2.0:1746129581.840549:0:22480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131454a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ada2ffba-8920-4ecb-8068-68caa9806978+27:1963:x1830948734441856:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129581.840551:0:31503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746129581.840551:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131454e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+17:32703:x1830948734442112:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129581.840557:0:22480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129581.840557:0:4385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129581.840564:0:31503:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012bf7b400/0x40a459093b06bb9b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f223aa expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129581.840564:0:4385:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d307400/0x40a459093b06bba2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f223b1 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129581.840567:0:22480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012eca4c00/0x40a459093b06bba9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f223a3 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129581.840582:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129581.840583:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129581.840589:0:4385:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d307400/0x40a459093b06bba2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f223b1 expref: 18 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129581.840599:0:4385:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009d307400/0x40a459093b06bba2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f223b1 expref: 18 pid: 4385 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129581.840602:0:22480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900f5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22480:1830948737633664:192.168.202.4@tcp:106: 00000100:00100000:1.0:1746129581.840602:0:31503:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fc2c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:31503:1830948737633536:192.168.202.4@tcp:106: 00010000:00010000:0.0:1746129581.840607:0:4385:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d307400, rc 0) 00000100:00100000:0.0:1746129581.840658:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131454e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+18:32703:x1830948734442112:12345-192.168.202.4@tcp:101:cat.0 Request processed in 96us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129581.840665:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16896 00000100:00100000:2.0:1746129581.840681:0:22480:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132dade40 going to sleep for 11 seconds 00000100:00100000:1.0:1746129581.840687:0:31503:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a91c59c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746129581.842328:0:22480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900f5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22480:1830948737633664:192.168.202.4@tcp:106: 00010000:00010000:2.0:1746129581.842353:0:22480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012eca4c00/0x40a459093b06bba9 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f223a3 expref: 28 pid: 22480 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746129581.842354:0:31503:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fc2c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:31503:1830948737633536:192.168.202.4@tcp:106: 00010000:00010000:2.0:1746129581.842363:0:22480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012eca4c00/0x40a459093b06bba9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f223a3 expref: 28 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129581.842371:0:31503:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012bf7b400/0x40a459093b06bb9b lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f223aa expref: 32 pid: 31503 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129581.842380:0:22480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012eca4c00, rc 0) 00010000:00010000:1.0:1746129581.842382:0:31503:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012bf7b400/0x40a459093b06bb9b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f223aa expref: 32 pid: 31503 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746129581.842405:0:22480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131454a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ada2ffba-8920-4ecb-8068-68caa9806978+27:1963:x1830948734441856:12345-192.168.202.4@tcp:101:cat.0 Request processed in 1858us (1941us total) trans 0 rc 301/301 00010000:00010000:1.0:1746129581.842405:0:31503:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bf7b400, rc 0) 00000100:00100000:2.0:1746129581.842410:0:22480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16895 00000100:00100000:1.0:1746129581.842425:0:31503:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131454000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ada2ffba-8920-4ecb-8068-68caa9806978+31:1963:x1830948734441984:12345-192.168.202.4@tcp:101:cat.0 Request processed in 1889us (2160us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129581.842431:0:31503:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16894 00000100:00100000:0.0:1746129581.844805:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129581.844840:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129581.844921:0:31503:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734442496 00000100:00100000:1.0:1746129581.844928:0:31503:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734442496 00000100:00100000:3.0:1746129581.845027:0:31523:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734442368 00000100:00100000:3.0:1746129581.845030:0:31523:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734442368 00002000:00100000:3.0:1746129581.845058:0:31523:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3ee:0x0] (1048576->2097151) req@ffff880131455180 x1830948734442368/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:322/0 lens 488/0 e 0 to 0 dl 1746129592 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129581.845067:0:31523:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131455180 with x1830948734442368 ext(1048576->2097151) 00002000:00010000:3.0:1746129581.845071:0:31523:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880131455180 00000100:00100000:1.0:1746129581.845102:0:31503:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16897 00000100:00100000:1.0:1746129581.845109:0:31503:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131455880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ada2ffba-8920-4ecb-8068-68caa9806978+27:32704:x1830948734442496:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129581.845119:0:31503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129581.845131:0:31503:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012bf7ac00/0x40a459093b06bbb0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f223b8 expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129581.845152:0:31503:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012e1c0200/0x40a459093b06bb86 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3772416->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2238e expref: 18 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129581.845159:0:31503:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129581.845160:0:31503:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129581.845163:0:31503:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012bf7ac00/0x40a459093b06bbb0 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f223b8 expref: 28 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129581.845191:0:31503:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012e1c0200/0x40a459093b06bb86 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3772416->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2238e expref: 18 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129581.845201:0:31503:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012e1c0200/0x40a459093b06bb86 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3772416->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2238e expref: 18 pid: 4385 timeout: 937 lvb_type: 0 00000100:00100000:1.0:1746129581.845210:0:31503:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fc2c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:31503:1830948737633792:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129581.845288:0:31503:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a91c59c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746129581.845622:0:31523:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8193 00000100:00100000:3.0:1746129581.845629:0:31523:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131455180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+18:1961:x1830948734442368:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:0.0:1746129581.847204:0:31503:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fc2c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:31503:1830948737633792:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129581.847237:0:31503:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012bf7ac00/0x40a459093b06bbb0 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f223b8 expref: 28 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129581.847250:0:31503:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bf7ac00, rc 0) 00000100:00100000:0.0:1746129581.847276:0:31503:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131455880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ada2ffba-8920-4ecb-8068-68caa9806978+28:32704:x1830948734442496:12345-192.168.202.4@tcp:101:cat.0 Request processed in 2168us (2434us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129581.847283:0:31503:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16897 00000100:00100000:1.0:1746129581.853542:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129581.853635:0:31520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734442624 00000100:00100000:2.0:1746129581.853641:0:31520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734442624 00002000:00100000:2.0:1746129581.853676:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3ef:0x0] (3772416->4194303) req@ffff88009fc2d180 x1830948734442624/t0(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:322/0 lens 488/0 e 0 to 0 dl 1746129592 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129581.853686:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc2d180 with x1830948734442624 ext(3772416->4194303) 00010000:00010000:2.0:1746129581.853694:0:31520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012e1c0200/0x40a459093b06bb86 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3772416->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2238e expref: 20 pid: 4385 timeout: 937 lvb_type: 0 00010000:00010000:2.0:1746129581.853706:0:31520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012e1c0200/0x40a459093b06bb86 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3772416->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2238e expref: 20 pid: 4385 timeout: 937 lvb_type: 0 00002000:00010000:2.0:1746129581.853712:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fc2d180 00000100:00100000:2.0:1746129581.853744:0:31520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2536 00000100:00100000:2.0:1746129581.853750:0:31520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:1963:x1830948734442624:12345-192.168.202.4@tcp:4:multiop.0 00000100:00100000:3.0:1746129581.855819:0:31523:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131455180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:1961:x1830948734442368:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 10185us (11014us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129581.855829:0:31523:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8193 00002000:00100000:3.0:1746129581.855838:0:31523:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3ee:0x0] (1048576->2097151) req@ffff880131455180 x1830948734442368/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:322/0 lens 488/440 e 0 to 0 dl 1746129592 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129581.855847:0:31523:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131455180 with x1830948734442368 ext(1048576->2097151) 00002000:00010000:3.0:1746129581.855851:0:31523:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880131455180 00000100:00100000:2.0:1746129581.861924:0:31520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:1963:x1830948734442624:12345-192.168.202.4@tcp:4:multiop.0 Request processed in 8166us (8382us total) trans 21474841458 rc 0/0 00000100:00100000:2.0:1746129581.861935:0:31520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2536 00002000:00100000:2.0:1746129581.861945:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3ef:0x0] (3772416->4194303) req@ffff88009fc2d180 x1830948734442624/t21474841458(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:322/0 lens 488/448 e 0 to 0 dl 1746129592 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129581.861953:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc2d180 with x1830948734442624 ext(3772416->4194303) 00010000:00010000:2.0:1746129581.861962:0:31520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012e1c0200/0x40a459093b06bb86 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3772416->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2238e expref: 20 pid: 4385 timeout: 937 lvb_type: 0 00010000:00010000:2.0:1746129581.861975:0:31520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012e1c0200/0x40a459093b06bb86 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3772416->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2238e expref: 20 pid: 4385 timeout: 937 lvb_type: 0 00002000:00010000:2.0:1746129581.861986:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fc2d180 00000100:00100000:0.0:1746129581.862161:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129581.862400:0:31503:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734442752 00000100:00100000:1.0:1746129581.862407:0:31503:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734442752 00000100:00100000:1.0:1746129581.862447:0:31503:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16898 00000100:00100000:1.0:1746129581.862453:0:31503:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131455500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:32703:x1830948734442752:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129581.862464:0:31503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129581.862476:0:31503:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012bf7b600/0x40a459093b06bbb7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f223bf expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129581.862497:0:31503:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129581.862502:0:31503:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012bf7b600/0x40a459093b06bbb7 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f223bf expref: 21 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129581.862512:0:31503:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012bf7b600/0x40a459093b06bbb7 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f223bf expref: 21 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129581.862522:0:31503:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bf7b600, rc 0) 00000100:00100000:1.0:1746129581.862580:0:31503:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131455500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:32703:x1830948734442752:12345-192.168.202.4@tcp:101:cat.0 Request processed in 127us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129581.862585:0:31503:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16898 00000100:00100000:0.0:1746129581.865426:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129581.865526:0:15749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734442880 00000100:00100000:1.0:1746129581.865534:0:15749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734442880 00010000:00010000:1.0:1746129581.865566:0:15749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012e1c0200/0x40a459093b06bb86 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3772416->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2238e expref: 21 pid: 4385 timeout: 937 lvb_type: 0 00000100:00100000:1.0:1746129581.865596:0:15749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8741 00000100:00100000:1.0:1746129581.865601:0:15749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131455c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:1961:x1830948734442880:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129581.865613:0:15749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129581.865634:0:15749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012e1c0200/0x40a459093b06bb86 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3772416->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2238e expref: 21 pid: 4385 timeout: 937 lvb_type: 0 00010000:00010000:1.0:1746129581.865644:0:15749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012e1c0200/0x40a459093b06bb86 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3772416->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2238e expref: 21 pid: 4385 timeout: 937 lvb_type: 0 00010000:00010000:1.0:1746129581.865662:0:15749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e1c0200/0x40a459093b06bb86 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3772416->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2238e expref: 21 pid: 4385 timeout: 937 lvb_type: 0 00010000:00010000:1.0:1746129581.865686:0:15749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129581.865688:0:15749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129581.865694:0:15749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012bf7ac00/0x40a459093b06bbb0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f223b8 expref: 27 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129581.865699:0:15749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012bf7ac00/0x40a459093b06bbb0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f223b8 expref: 27 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129581.865708:0:15749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129581.865709:0:15749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129581.865711:0:15749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012bf7b600/0x40a459093b06bbb7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f223bf expref: 20 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129581.865715:0:15749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012bf7b600/0x40a459093b06bbb7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f223bf expref: 20 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129581.865739:0:15749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012bf7b600/0x40a459093b06bbb7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f223bf expref: 20 pid: 31503 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129581.865748:0:15749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fc2f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15749:1830948737633920:192.168.202.4@tcp:105: 00010000:00010000:1.0:1746129581.865826:0:15749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012bf7ac00/0x40a459093b06bbb0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f223b8 expref: 27 pid: 31503 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129581.865833:0:15749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fc2fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15749:1830948737634048:192.168.202.4@tcp:105: 00000100:00100000:1.0:1746129581.865851:0:15749:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a91c5780 going to sleep for 11 seconds 00000100:00100000:1.0:1746129581.867459:0:15749:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fc2f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15749:1830948737633920:192.168.202.4@tcp:105: 00000100:00100000:1.0:1746129581.867472:0:15749:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fc2fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15749:1830948737634048:192.168.202.4@tcp:105: 00010000:00010000:1.0:1746129581.867491:0:15749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129581.867530:0:15749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131455c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:1961:x1830948734442880:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 1927us (2112us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129581.867540:0:15749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8741 00000100:00100000:0.0:1746129581.871140:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129581.871258:0:31520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734443136 00000100:00100000:2.0:1746129581.871269:0:31520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734443136 00002000:00100000:2.0:1746129581.871347:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3ef:0x0] (2097152->3145727) req@ffff880131455f80 x1830948734443136/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:322/0 lens 488/0 e 0 to 0 dl 1746129592 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129581.871357:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131455f80 with x1830948734443136 ext(2097152->3145727) 00002000:00010000:2.0:1746129581.871363:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880131455f80 00000100:00100000:2.0:1746129581.871394:0:31520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8194 00000100:00100000:2.0:1746129581.871403:0:31520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131455f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ada2ffba-8920-4ecb-8068-68caa9806978+28:1963:x1830948734443136:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129581.874827:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129581.874858:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129581.875625:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129581.876009:0:31523:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734443520 00000100:00100000:3.0:1746129581.876017:0:31523:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734443520 00000100:00100000:0.0:1746129581.876030:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00002000:00100000:3.0:1746129581.876098:0:31523:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3ef:0x0] (2097152->3145727) req@ffff880131456300 x1830948734443520/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:322/0 lens 488/0 e 0 to 0 dl 1746129592 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129581.876107:0:31523:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131456300 with x1830948734443520 ext(2097152->3145727) 00002000:00010000:3.0:1746129581.876112:0:31523:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880131456300 00000100:00100000:3.0:1746129581.876128:0:31523:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734443648 00000100:00100000:3.0:1746129581.876130:0:31523:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734443648 00002000:00100000:3.0:1746129581.876141:0:31523:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->4194303) req@ffff880131457800 x1830948734443648/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:322/0 lens 488/0 e 0 to 0 dl 1746129592 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129581.876147:0:31523:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131457800 with x1830948734443648 ext(3145728->4194303) 00002000:00010000:3.0:1746129581.876149:0:31523:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880131457800 00000100:00100000:3.0:1746129581.876163:0:8417:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734444032 00000100:00100000:3.0:1746129581.876165:0:8417:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734444032 00002000:00100000:3.0:1746129581.876176:0:8417:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3f5:0x0] (3379200->4194303) req@ffff88009c079880 x1830948734444032/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:322/0 lens 488/0 e 0 to 0 dl 1746129592 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129581.876182:0:8417:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c079880 with x1830948734444032 ext(3379200->4194303) 00002000:00010000:3.0:1746129581.876184:0:8417:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c079880 00000100:00100000:3.0:1746129581.876208:0:8417:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734443904 00000100:00100000:3.0:1746129581.876210:0:8417:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734443904 00002000:00100000:3.0:1746129581.876228:0:8417:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3f5:0x0] (2097152->3145727) req@ffff88013145f100 x1830948734443904/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:322/0 lens 488/0 e 0 to 0 dl 1746129592 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129581.876234:0:8417:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013145f100 with x1830948734443904 ext(2097152->3145727) 00002000:00010000:3.0:1746129581.876236:0:8417:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013145f100 00000100:00100000:3.0:1746129581.876248:0:8417:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8195 00000100:00100000:3.0:1746129581.876255:0:8417:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131456300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:1963:x1830948734443520:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:1.0:1746129581.876289:0:31521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8196 00000100:00100000:1.0:1746129581.876314:0:31521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131457800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:1963:x1830948734443648:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:2.0:1746129581.876326:0:21725:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8197 00000100:00100000:2.0:1746129581.876334:0:21725:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c079880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+23:1963:x1830948734444032:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129581.877803:0:31522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8198 00000100:00100000:0.0:1746129581.877811:0:31522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013145f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+24:1963:x1830948734443904:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:2.0:1746129581.882611:0:31520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131455f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ada2ffba-8920-4ecb-8068-68caa9806978+28:1963:x1830948734443136:12345-192.168.202.4@tcp:3:cat.0 Request processed in 11202us (11474us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129581.882621:0:31520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8194 00002000:00100000:2.0:1746129581.882630:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3ef:0x0] (2097152->3145727) req@ffff880131455f80 x1830948734443136/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:322/0 lens 488/440 e 0 to 0 dl 1746129592 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129581.882639:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131455f80 with x1830948734443136 ext(2097152->3145727) 00002000:00010000:2.0:1746129581.882644:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880131455f80 00000100:00100000:0.0:1746129581.891139:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129581.891974:0:31521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131457800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+22:1963:x1830948734443648:12345-192.168.202.4@tcp:3:cat.0 Request processed in 15660us (17113us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129581.891984:0:31521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8196 00002000:00100000:1.0:1746129581.891993:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->4194303) req@ffff880131457800 x1830948734443648/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:322/0 lens 488/440 e 0 to 0 dl 1746129592 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129581.892002:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131457800 with x1830948734443648 ext(3145728->4194303) 00002000:00010000:1.0:1746129581.892007:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880131457800 00000100:00100000:2.0:1746129581.893248:0:31503:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734444288 00000100:00100000:2.0:1746129581.893255:0:31503:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734444288 00000100:00100000:2.0:1746129581.893314:0:31503:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16899 00000100:00100000:2.0:1746129581.893322:0:31503:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013145f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ada2ffba-8920-4ecb-8068-68caa9806978+31:32704:x1830948734444288:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129581.893336:0:31503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129581.893350:0:31503:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095d0c000/0x40a459093b06bbbe lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f223c6 expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129581.893372:0:31503:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095801000/0x40a459093b06bb94 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3379199) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22395 expref: 25 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129581.893379:0:31503:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129581.893381:0:31503:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129581.893383:0:31503:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095d0c000/0x40a459093b06bbbe lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f223c6 expref: 32 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129581.893408:0:31503:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095801000/0x40a459093b06bb94 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3379199) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22395 expref: 25 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129581.893418:0:31503:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095801000/0x40a459093b06bb94 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3379199) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22395 expref: 25 pid: 31503 timeout: 937 lvb_type: 0 00000100:00100000:2.0:1746129581.893429:0:31503:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900f5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:31503:1830948737634176:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129581.893786:0:31503:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132dade40 going to sleep for 11 seconds 00000100:00100000:3.0:1746129581.895597:0:8417:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131456300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:1963:x1830948734443520:12345-192.168.202.4@tcp:3:cat.0 Request processed in 19336us (20772us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129581.895608:0:8417:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8195 00002000:00100000:3.0:1746129581.895616:0:8417:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3ef:0x0] (2097152->3145727) req@ffff880131456300 x1830948734443520/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:322/0 lens 488/440 e 0 to 0 dl 1746129592 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129581.895698:0:8417:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131456300 with x1830948734443520 ext(2097152->3145727) 00002000:00010000:3.0:1746129581.895704:0:8417:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880131456300 00000100:00100000:0.0:1746129581.901523:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129581.901803:0:8417:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734444416 00000100:00100000:3.0:1746129581.901811:0:8417:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734444416 00002000:00100000:3.0:1746129581.901849:0:8417:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3f5:0x0] (3145728->3379199) req@ffff88013145d180 x1830948734444416/t0(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:322/0 lens 488/0 e 0 to 0 dl 1746129592 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129581.901856:0:8417:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013145d180 with x1830948734444416 ext(3145728->3379199) 00010000:00010000:3.0:1746129581.901865:0:8417:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095801000/0x40a459093b06bb94 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3379199) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22395 expref: 26 pid: 31503 timeout: 937 lvb_type: 0 00010000:00010000:3.0:1746129581.901880:0:8417:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095801000/0x40a459093b06bb94 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3379199) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22395 expref: 26 pid: 31503 timeout: 937 lvb_type: 0 00002000:00010000:3.0:1746129581.901887:0:8417:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88013145d180 00000100:00100000:3.0:1746129581.901917:0:8417:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2537 00000100:00100000:3.0:1746129581.901924:0:8417:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013145d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+26:1961:x1830948734444416:12345-192.168.202.4@tcp:4:cat.0 00000100:00100000:0.0:1746129581.902062:0:21725:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c079880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+25:1963:x1830948734444032:12345-192.168.202.4@tcp:3:cat.0 Request processed in 25729us (26437us total) trans 0 rc 815104/815104 00000100:00100000:0.0:1746129581.902069:0:21725:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8197 00002000:00100000:0.0:1746129581.902074:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f5:0x0] (3379200->4194303) req@ffff88009c079880 x1830948734444032/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:322/0 lens 488/440 e 0 to 0 dl 1746129592 ref 1 fl Complete:/200/0 rc 815104/815104 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129581.902079:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c079880 with x1830948734444032 ext(3379200->4194303) 00010000:00010000:0.0:1746129581.902083:0:21725:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095801000/0x40a459093b06bb94 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3379199) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22395 expref: 25 pid: 31503 timeout: 937 lvb_type: 0 00010000:00010000:0.0:1746129581.902090:0:21725:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095801000/0x40a459093b06bb94 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3379199) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22395 expref: 25 pid: 31503 timeout: 937 lvb_type: 0 00002000:00010000:0.0:1746129581.902095:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c079880 00000100:00100000:0.0:1746129581.902136:0:31503:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900f5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:31503:1830948737634176:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129581.902161:0:31503:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095d0c000/0x40a459093b06bbbe lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f223c6 expref: 32 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129581.902179:0:31503:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095d0c000, rc 0) 00000100:00100000:0.0:1746129581.902203:0:31503:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013145f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ada2ffba-8920-4ecb-8068-68caa9806978+32:32704:x1830948734444288:12345-192.168.202.4@tcp:101:cat.0 Request processed in 8882us (11073us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129581.902210:0:31503:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16899 00000100:00100000:2.0:1746129581.902469:0:31522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013145f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+24:1963:x1830948734443904:12345-192.168.202.4@tcp:3:cat.0 Request processed in 24651us (26431us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129581.902480:0:31522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8198 00002000:00100000:2.0:1746129581.902490:0:31522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f5:0x0] (2097152->3145727) req@ffff88013145f100 x1830948734443904/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:322/0 lens 488/440 e 0 to 0 dl 1746129592 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129581.902498:0:31522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013145f100 with x1830948734443904 ext(2097152->3145727) 00010000:00010000:2.0:1746129581.902507:0:31522:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095801000/0x40a459093b06bb94 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3379199) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22395 expref: 24 pid: 31503 timeout: 937 lvb_type: 0 00010000:00010000:2.0:1746129581.902518:0:31522:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095801000/0x40a459093b06bb94 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3379199) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22395 expref: 24 pid: 31503 timeout: 937 lvb_type: 0 00002000:00010000:2.0:1746129581.902525:0:31522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88013145f100 00000100:00100000:0.0:1746129581.904021:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129581.904040:0:31503:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734444544 00000100:00100000:0.0:1746129581.904047:0:31503:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734444544 00000100:00100000:0.0:1746129581.904089:0:31503:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16900 00000100:00100000:0.0:1746129581.904095:0:31503:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013145d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+24:32703:x1830948734444544:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129581.904108:0:31503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129581.904120:0:31503:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fab5000/0x40a459093b06bbc5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f223cd expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129581.904140:0:31503:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129581.904145:0:31503:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fab5000/0x40a459093b06bbc5 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f223cd expref: 25 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129581.904154:0:31503:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fab5000/0x40a459093b06bbc5 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f223cd expref: 25 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129581.904162:0:31503:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fab5000, rc 0) 00000100:00100000:0.0:1746129581.904185:0:31503:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013145d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+25:32703:x1830948734444544:12345-192.168.202.4@tcp:101:cat.0 Request processed in 90us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129581.904189:0:31503:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16900 00000100:00100000:3.0:1746129581.905788:0:8417:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013145d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+25:1961:x1830948734444416:12345-192.168.202.4@tcp:4:cat.0 Request processed in 3861us (4270us total) trans 17179874210 rc 0/0 00000100:00100000:3.0:1746129581.905796:0:8417:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2537 00002000:00100000:3.0:1746129581.905804:0:8417:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3f5:0x0] (3145728->3379199) req@ffff88013145d180 x1830948734444416/t17179874210(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:322/0 lens 488/448 e 0 to 0 dl 1746129592 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129581.905817:0:8417:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013145d180 with x1830948734444416 ext(3145728->3379199) 00010000:00010000:3.0:1746129581.905824:0:8417:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095801000/0x40a459093b06bb94 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3379199) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22395 expref: 25 pid: 31503 timeout: 937 lvb_type: 0 00010000:00010000:3.0:1746129581.905836:0:8417:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095801000/0x40a459093b06bb94 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3379199) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22395 expref: 25 pid: 31503 timeout: 937 lvb_type: 0 00002000:00010000:3.0:1746129581.905842:0:8417:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88013145d180 00000100:00100000:0.0:1746129581.916830:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129581.916893:0:15749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734444672 00000100:00100000:1.0:1746129581.916901:0:15749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734444672 00010000:00010000:1.0:1746129581.916933:0:15749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095801000/0x40a459093b06bb94 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3379199) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22395 expref: 25 pid: 31503 timeout: 937 lvb_type: 0 00000100:00100000:1.0:1746129581.916972:0:15749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8742 00000100:00100000:1.0:1746129581.916980:0:15749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013145f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+25:1962:x1830948734444672:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129581.916992:0:15749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129581.917008:0:15749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095801000/0x40a459093b06bb94 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3379199) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22395 expref: 25 pid: 31503 timeout: 937 lvb_type: 0 00010000:00010000:1.0:1746129581.917019:0:15749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095801000/0x40a459093b06bb94 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3379199) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22395 expref: 25 pid: 31503 timeout: 937 lvb_type: 0 00010000:00010000:1.0:1746129581.917038:0:15749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095801000/0x40a459093b06bb94 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3379199) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22395 expref: 25 pid: 31503 timeout: 937 lvb_type: 0 00010000:00010000:1.0:1746129581.917403:0:15749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129581.917406:0:15749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129581.917413:0:15749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880095d0c000/0x40a459093b06bbbe lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f223c6 expref: 31 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129581.917420:0:15749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095d0c000/0x40a459093b06bbbe lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f223c6 expref: 31 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129581.917427:0:15749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129581.917428:0:15749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129581.917430:0:15749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fab5000/0x40a459093b06bbc5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f223cd expref: 24 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129581.917436:0:15749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fab5000/0x40a459093b06bbc5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f223cd expref: 24 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129581.917461:0:15749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fab5000/0x40a459093b06bbc5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f223cd expref: 24 pid: 31503 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129581.917471:0:15749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fc2fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15749:1830948737634304:192.168.202.4@tcp:105: 00010000:00010000:1.0:1746129581.917547:0:15749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880095d0c000/0x40a459093b06bbbe lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f223c6 expref: 31 pid: 31503 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129581.917555:0:15749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fc2f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15749:1830948737634432:192.168.202.4@tcp:105: 00000100:00100000:1.0:1746129581.917571:0:15749:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a91c5780 going to sleep for 11 seconds 00000100:00100000:1.0:1746129581.922466:0:15749:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fc2fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15749:1830948737634304:192.168.202.4@tcp:105: 00000100:00100000:1.0:1746129581.922480:0:15749:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fc2f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15749:1830948737634432:192.168.202.4@tcp:105: 00010000:00010000:1.0:1746129581.922504:0:15749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129581.922550:0:15749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013145f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+24:1962:x1830948734444672:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 5569us (5725us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129581.922562:0:15749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8742 00000100:00100000:0.0:1746129581.926582:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129581.926658:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129581.926762:0:31522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734445184 00000100:00100000:2.0:1746129581.926773:0:31522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734445184 00002000:00100000:2.0:1746129581.926824:0:31522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f5:0x0] (2097152->3145727) req@ffff88013145e680 x1830948734445184/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:322/0 lens 488/0 e 0 to 0 dl 1746129592 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129581.926834:0:31522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013145e680 with x1830948734445184 ext(2097152->3145727) 00002000:00010000:2.0:1746129581.926840:0:31522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013145e680 00000100:00100000:2.0:1746129581.926855:0:31522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734445056 00000100:00100000:2.0:1746129581.926857:0:31522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734445056 00002000:00100000:2.0:1746129581.926868:0:31522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f5:0x0] (2097152->3145727) req@ffff88013145c380 x1830948734445056/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:322/0 lens 488/0 e 0 to 0 dl 1746129592 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129581.926874:0:31522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013145c380 with x1830948734445056 ext(2097152->3145727) 00002000:00010000:2.0:1746129581.926877:0:31522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013145c380 00000100:00100000:2.0:1746129581.926900:0:31522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8199 00000100:00100000:2.0:1746129581.926907:0:31522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013145e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ada2ffba-8920-4ecb-8068-68caa9806978+32:1960:x1830948734445184:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:1.0:1746129581.927122:0:31521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8200 00000100:00100000:1.0:1746129581.927131:0:31521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013145c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+24:1962:x1830948734445056:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129581.929090:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129581.929115:0:21725:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734445440 00000100:00100000:0.0:1746129581.929121:0:21725:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734445440 00002000:00100000:0.0:1746129581.929154:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f5:0x0] (3145728->4194303) req@ffff88013145ea00 x1830948734445440/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:322/0 lens 488/0 e 0 to 0 dl 1746129592 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129581.929162:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013145ea00 with x1830948734445440 ext(3145728->4194303) 00002000:00010000:0.0:1746129581.929167:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013145ea00 00000100:00100000:0.0:1746129581.929196:0:21725:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8201 00000100:00100000:0.0:1746129581.929202:0:21725:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013145ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+25:1963:x1830948734445440:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:3.0:1746129581.933282:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129581.933478:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129581.933614:0:31520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734445824 00000100:00100000:1.0:1746129581.933627:0:31520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734445824 00000100:00100000:2.0:1746129581.933645:0:8417:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734445952 00000100:00100000:2.0:1746129581.933648:0:8417:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734445952 00002000:00100000:2.0:1746129581.933672:0:8417:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->4194303) req@ffff88009fc2f800 x1830948734445952/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:322/0 lens 488/0 e 0 to 0 dl 1746129592 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129581.933672:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3f5:0x0] (3145728->4194303) req@ffff8800947bf800 x1830948734445824/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:322/0 lens 488/0 e 0 to 0 dl 1746129592 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129581.933682:0:8417:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc2f800 with x1830948734445952 ext(3145728->4194303) 00002000:00100000:1.0:1746129581.933682:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800947bf800 with x1830948734445824 ext(3145728->4194303) 00002000:00010000:2.0:1746129581.933688:0:8417:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fc2f800 00002000:00010000:1.0:1746129581.933688:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800947bf800 00000100:00100000:2.0:1746129581.933716:0:8417:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8202 00000100:00100000:2.0:1746129581.933724:0:8417:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ada2ffba-8920-4ecb-8068-68caa9806978+28:1962:x1830948734445952:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:1.0:1746129581.933829:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8203 00000100:00100000:1.0:1746129581.933836:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+34:1962:x1830948734445824:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:2.0:1746129581.942673:0:31522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013145e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ada2ffba-8920-4ecb-8068-68caa9806978+34:1960:x1830948734445184:12345-192.168.202.4@tcp:3:cat.0 Request processed in 15753us (16091us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129581.942686:0:31522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8199 00002000:00100000:2.0:1746129581.942699:0:31522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f5:0x0] (2097152->3145727) req@ffff88013145e680 x1830948734445184/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:322/0 lens 488/440 e 0 to 0 dl 1746129592 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129581.942707:0:31522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013145e680 with x1830948734445184 ext(2097152->3145727) 00002000:00010000:2.0:1746129581.942713:0:31522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013145e680 00000100:00100000:0.0:1746129581.952827:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129581.952957:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734446208 00000100:00100000:2.0:1746129581.952967:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734446208 00000100:00100000:2.0:1746129581.953015:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11367 00000100:00100000:2.0:1746129581.953022:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f37c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+8:32709:x1830948734446208:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:2.0:1746129581.953047:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129581.953066:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f118200/0x40a459093b06bbcc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f223d4 expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129581.953180:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f119400/0x40a459093b06bbd3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129581.953193:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f119400/0x40a459093b06bbd3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129581.953204:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f119400/0x40a459093b06bbd3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129581.953225:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f118a00/0x40a459093b06bbda lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129581.953231:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f118a00/0x40a459093b06bbda lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129581.953237:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f118a00/0x40a459093b06bbda lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129581.953389:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1c0200/0x40a459093b06bbe1 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129581.953397:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1c0200/0x40a459093b06bbe1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129581.953403:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1c0200/0x40a459093b06bbe1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00200000:2.0:1746129581.953411:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:2.0:1746129581.953496:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f119400/0x40a459093b06bbd3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129581.953501:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f119400/0x40a459093b06bbd3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129581.953508:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f119400/0x40a459093b06bbd3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129581.953513:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f119400 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746129581.953517:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f119400/0x40a459093b06bbd3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129581.953522:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f119400/0x40a459093b06bbd3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129581.953532:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880132ef8f00) 00010000:00010000:2.0:1746129581.953535:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129581.953539:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f119400/0x40a459093b06bbd3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129581.953544:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f119400/0x40a459093b06bbd3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129581.953558:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f118a00/0x40a459093b06bbda lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129581.953562:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f118a00/0x40a459093b06bbda lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129581.953566:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f118a00/0x40a459093b06bbda lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129581.953571:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f118a00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746129581.953573:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f118a00/0x40a459093b06bbda lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129581.953577:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f118a00/0x40a459093b06bbda lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129581.953582:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f250900) 00010000:00010000:2.0:1746129581.953584:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129581.953586:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f118a00/0x40a459093b06bbda lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129581.953590:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f118a00/0x40a459093b06bbda lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129581.953622:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f118200/0x40a459093b06bbcc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f223d4 expref: 11 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129581.953637:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1c0200/0x40a459093b06bbe1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f223d4 expref: 10 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129581.953643:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009cffe100) 00010000:00010000:2.0:1746129581.953645:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746129581.953647:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e1c0200, rc 0) 00000100:00100000:2.0:1746129581.953702:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f37c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+10:32709:x1830948734446208:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 680us (885us total) trans 8589945492 rc 0/0 00000100:00100000:2.0:1746129581.953708:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11367 00000100:00100000:1.0:1746129581.957475:0:31521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013145c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+26:1962:x1830948734445056:12345-192.168.202.4@tcp:3:cat.0 Request processed in 30333us (30804us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129581.957488:0:31521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8200 00002000:00100000:1.0:1746129581.957500:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f5:0x0] (2097152->3145727) req@ffff88013145c380 x1830948734445056/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:322/0 lens 488/440 e 0 to 0 dl 1746129592 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129581.957511:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013145c380 with x1830948734445056 ext(2097152->3145727) 00002000:00010000:1.0:1746129581.957517:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013145c380 00000100:00100000:3.0:1746129581.957745:0:8417:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ada2ffba-8920-4ecb-8068-68caa9806978+28:1962:x1830948734445952:12345-192.168.202.4@tcp:3:cat.0 Request processed in 24020us (24265us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129581.957752:0:8417:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8202 00002000:00100000:3.0:1746129581.957758:0:8417:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->4194303) req@ffff88009fc2f800 x1830948734445952/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:322/0 lens 488/440 e 0 to 0 dl 1746129592 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129581.957765:0:8417:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc2f800 with x1830948734445952 ext(3145728->4194303) 00002000:00010000:3.0:1746129581.957769:0:8417:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fc2f800 00000100:00100000:2.0:1746129581.968006:0:21725:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013145ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+24:1963:x1830948734445440:12345-192.168.202.4@tcp:3:cat.0 Request processed in 38791us (38909us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129581.968019:0:21725:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8201 00002000:00100000:2.0:1746129581.968030:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f5:0x0] (3145728->4194303) req@ffff88013145ea00 x1830948734445440/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:322/0 lens 488/440 e 0 to 0 dl 1746129592 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129581.968039:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013145ea00 with x1830948734445440 ext(3145728->4194303) 00002000:00010000:2.0:1746129581.968046:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013145ea00 00000100:00100000:1.0:1746129581.971064:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+32:1962:x1830948734445824:12345-192.168.202.4@tcp:3:cat.0 Request processed in 37209us (37774us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129581.971077:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8203 00002000:00100000:1.0:1746129581.971088:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f5:0x0] (3145728->4194303) req@ffff8800947bf800 x1830948734445824/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:322/0 lens 488/440 e 0 to 0 dl 1746129592 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129581.971097:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800947bf800 with x1830948734445824 ext(3145728->4194303) 00002000:00010000:1.0:1746129581.971104:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800947bf800 00000100:00100000:0.0:1746129581.981010:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129581.981708:0:22480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734446336 00000100:00100000:2.0:1746129581.981720:0:22480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734446336 00000100:00100000:2.0:1746129581.981782:0:22480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16901 00000100:00100000:2.0:1746129581.981790:0:22480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f37f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:1961:x1830948734446336:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129581.981809:0:22480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129581.981826:0:22480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f119e00/0x40a459093b06bbef lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f223db expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129581.981851:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129581.981854:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129581.981864:0:22480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f119e00/0x40a459093b06bbef lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f223db expref: 21 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129581.981880:0:22480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f119e00/0x40a459093b06bbef lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f223db expref: 21 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129581.981891:0:22480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f119e00, rc 0) 00000100:00100000:2.0:1746129581.981966:0:22480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f37f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:1961:x1830948734446336:12345-192.168.202.4@tcp:101:cat.0 Request processed in 177us (969us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129581.981972:0:22480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16901 00000100:00100000:0.0:1746129581.986412:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129581.986608:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734446592 00000100:00100000:1.0:1746129581.986617:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734446592 00002000:00100000:1.0:1746129581.986669:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ef:0x0] (4194304->5148671) req@ffff88009f37d180 x1830948734446592/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:322/0 lens 488/0 e 0 to 0 dl 1746129592 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129581.986679:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f37d180 with x1830948734446592 ext(4194304->5148671) 00002000:00010000:1.0:1746129581.986685:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f37d180 00000100:00100000:1.0:1746129581.986723:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8204 00000100:00100000:1.0:1746129581.986730:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f37d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+28:1963:x1830948734446592:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129581.995998:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129581.998611:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129581.998644:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734447104 00000100:00100000:0.0:1746129581.998653:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734447104 00000100:00100000:0.0:1746129581.998909:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11368 00000100:00100000:0.0:1746129581.998918:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f37fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ada2ffba-8920-4ecb-8068-68caa9806978+291:32711:x1830948734447104:12345-192.168.202.4@tcp:101:multiop.0 00000100:00100000:2.0:1746129581.998921:0:21725:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734446848 00000100:00100000:2.0:1746129581.998926:0:21725:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734446848 00010000:00010000:0.0:1746129581.998943:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00100000:2.0:1746129581.998960:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ef:0x0] (4194304->5148671) req@ffff88009f37d880 x1830948734446848/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:322/0 lens 488/0 e 0 to 0 dl 1746129592 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:0.0:1746129581.998962:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091b62400/0x40a459093b06bbf6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f223e2 expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00002000:00100000:2.0:1746129581.998970:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f37d880 with x1830948734446848 ext(4194304->5148671) 00002000:00010000:2.0:1746129581.998976:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f37d880 00000100:00100000:2.0:1746129581.999031:0:21725:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8205 00000100:00100000:2.0:1746129581.999037:0:21725:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f37d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:1960:x1830948734446848:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:1.0:1746129581.999671:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f37d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+28:1963:x1830948734446592:12345-192.168.202.4@tcp:3:cat.0 Request processed in 12938us (13267us total) trans 0 rc 954368/954368 00000100:00100000:1.0:1746129581.999678:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8204 00002000:00100000:1.0:1746129581.999684:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ef:0x0] (4194304->5148671) req@ffff88009f37d180 x1830948734446592/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:322/0 lens 488/440 e 0 to 0 dl 1746129592 ref 1 fl Complete:/200/0 rc 954368/954368 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129581.999692:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f37d180 with x1830948734446592 ext(4194304->5148671) 00002000:00010000:1.0:1746129581.999695:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f37d180 00010000:00010000:0.0:1746129581.999951:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009129fc00/0x40a459093b06bbfd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746129581.999967:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009129fc00/0x40a459093b06bbfd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746129581.999980:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009129fc00/0x40a459093b06bbfd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746129581.999994:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009129f000/0x40a459093b06bc04 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746129582.000000:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009129f000/0x40a459093b06bc04 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746129582.000005:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009129f000/0x40a459093b06bc04 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746129582.000127:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c030600/0x40a459093b06bc0b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746129582.000135:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c030600/0x40a459093b06bc0b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746129582.000141:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c030600/0x40a459093b06bc0b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000004:00200000:0.0:1746129582.000149:0:14548:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:0.0:1746129582.000253:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009129fc00/0x40a459093b06bbfd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746129582.000260:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009129fc00/0x40a459093b06bbfd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746129582.000265:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009129fc00/0x40a459093b06bbfd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746129582.000271:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009129fc00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:0.0:1746129582.000275:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009129fc00/0x40a459093b06bbfd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746129582.000281:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009129fc00/0x40a459093b06bbfd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746129582.000306:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880132ef8f00) 00010000:00010000:0.0:1746129582.000310:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129582.000314:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009129fc00/0x40a459093b06bbfd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746129582.000319:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009129fc00/0x40a459093b06bbfd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746129582.000336:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009129f000/0x40a459093b06bc04 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746129582.000340:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009129f000/0x40a459093b06bc04 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746129582.000345:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009129f000/0x40a459093b06bc04 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746129582.000348:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009129f000 already unused, calling callback (ffffffffa136e690) 00010000:00010000:0.0:1746129582.000350:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009129f000/0x40a459093b06bc04 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746129582.000354:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009129f000/0x40a459093b06bc04 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746129582.000360:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f469100) 00010000:00010000:0.0:1746129582.000361:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129582.000363:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009129f000/0x40a459093b06bc04 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746129582.000367:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009129f000/0x40a459093b06bc04 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746129582.000405:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091b62400/0x40a459093b06bbf6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f223e2 expref: 294 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129582.000416:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c030600/0x40a459093b06bc0b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f223e2 expref: 293 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129582.000421:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009cffe100) 00010000:00010000:0.0:1746129582.000423:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746129582.000425:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c030600, rc 0) 00000100:00100000:0.0:1746129582.000450:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f37fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ada2ffba-8920-4ecb-8068-68caa9806978+293:32711:x1830948734447104:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 1534us (1852us total) trans 8589945493 rc 0/0 00000100:00100000:0.0:1746129582.000455:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11368 00000100:00100000:0.0:1746129582.007893:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129582.010489:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734447360 00000100:00100000:3.0:1746129582.010502:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734447360 00000100:00100000:3.0:1746129582.010559:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4850 00000100:00100000:3.0:1746129582.010567:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093edf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ada2ffba-8920-4ecb-8068-68caa9806978+293:32704:x1830948734447360:12345-192.168.202.4@tcp:35:cat.0 00000100:00100000:3.0:1746129582.010801:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093edf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ada2ffba-8920-4ecb-8068-68caa9806978+294:32704:x1830948734447360:12345-192.168.202.4@tcp:35:cat.0 Request processed in 234us (2920us total) trans 8589945494 rc 0/0 00000100:00100000:3.0:1746129582.010808:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4850 00000100:00100000:2.0:1746129582.012396:0:21725:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f37d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:1960:x1830948734446848:12345-192.168.202.4@tcp:3:cat.0 Request processed in 13351us (16402us total) trans 0 rc 954368/954368 00000100:00100000:2.0:1746129582.012406:0:21725:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8205 00002000:00100000:2.0:1746129582.012417:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ef:0x0] (4194304->5148671) req@ffff88009f37d880 x1830948734446848/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:322/0 lens 488/440 e 0 to 0 dl 1746129592 ref 1 fl Complete:/200/0 rc 954368/954368 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129582.012427:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f37d880 with x1830948734446848 ext(4194304->5148671) 00002000:00010000:2.0:1746129582.012434:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f37d880 00000100:00100000:0.0:1746129582.021163:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129582.021383:0:14551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734447616 00000100:00100000:2.0:1746129582.021393:0:14551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734447616 00000100:00080000:0.0:1746129582.021517:0:7097:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746129582.021609:0:14551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4851 00000100:00100000:2.0:1746129582.021621:0:14551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093edfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+10:32703:x1830948734447616:12345-192.168.202.4@tcp:35:cat.0 00000100:00100000:2.0:1746129582.022492:0:14551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093edfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+11:32703:x1830948734447616:12345-192.168.202.4@tcp:35:cat.0 Request processed in 871us (1337us total) trans 8589945495 rc 0/0 00000100:00100000:2.0:1746129582.022499:0:14551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4851 00000100:00100000:0.0:1746129582.055129:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129582.055259:0:31503:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734447744 00000100:00100000:2.0:1746129582.055268:0:31503:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734447744 00000100:00100000:2.0:1746129582.055346:0:31503:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16902 00000100:00100000:2.0:1746129582.055355:0:31503:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ede300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ada2ffba-8920-4ecb-8068-68caa9806978+32:32711:x1830948734447744:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:2.0:1746129582.055374:0:31503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129582.055391:0:31503:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f119000/0x40a459093b06bc19 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f223e9 expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129582.055425:0:31503:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f385600/0x40a459093b06ba28 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f222ed expref: 9 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129582.055433:0:31503:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d107400/0x40a459093b06bb8d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2239c expref: 23 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129582.055440:0:31503:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c3d4a00/0x40a459093b06bb5c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22364 expref: 33 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129582.055446:0:31503:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129582.055448:0:31503:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129582.055451:0:31503:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f119000/0x40a459093b06bc19 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [1863680->2097151] (req 1863680->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f223e9 expref: 33 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129582.055484:0:31503:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c3d4a00/0x40a459093b06bb5c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22364 expref: 33 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129582.055495:0:31503:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c3d4a00/0x40a459093b06bb5c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22364 expref: 33 pid: 8410 timeout: 937 lvb_type: 1 00000100:00100000:2.0:1746129582.055507:0:31503:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900f5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:31503:1830948737634560:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129582.056102:0:31503:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009d107400/0x40a459093b06bb8d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2239c expref: 23 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129582.056112:0:31503:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009d107400/0x40a459093b06bb8d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2239c expref: 23 pid: 4385 timeout: 937 lvb_type: 0 00000100:00100000:2.0:1746129582.056121:0:31503:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900f6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:31503:1830948737634688:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129582.056151:0:31503:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f385600/0x40a459093b06ba28 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f222ed expref: 9 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129582.056159:0:31503:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f385600/0x40a459093b06ba28 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f222ed expref: 9 pid: 8410 timeout: 937 lvb_type: 1 00000100:00100000:2.0:1746129582.056166:0:31503:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900f5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:31503:1830948737634816:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129582.056184:0:31503:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132dad3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129582.059968:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129582.060076:0:31503:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900f5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:31503:1830948737634560:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129582.060090:0:31503:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900f6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:31503:1830948737634688:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129582.060098:0:31503:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900f5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:31503:1830948737634816:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129582.060144:0:31503:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f119000/0x40a459093b06bc19 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [1863680->2097151] (req 1863680->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f223e9 expref: 33 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129582.060164:0:31503:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f119000, rc 0) 00000100:00100000:2.0:1746129582.060224:0:31503:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ede300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ada2ffba-8920-4ecb-8068-68caa9806978+33:32711:x1830948734447744:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 4861us (5097us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129582.060234:0:31503:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16902 00000100:00100000:0.0:1746129582.060425:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129582.060464:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129582.060483:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734447872 00000100:00100000:0.0:1746129582.060489:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734447872 00010000:00010000:0.0:1746129582.060515:0:7087:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c3d4a00/0x40a459093b06bb5c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22364 expref: 33 pid: 8410 timeout: 937 lvb_type: 1 00000100:00100000:0.0:1746129582.060534:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734448000 00000100:00100000:0.0:1746129582.060536:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734448000 00010000:00010000:0.0:1746129582.060545:0:7087:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f385600/0x40a459093b06ba28 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f222ed expref: 10 pid: 8410 timeout: 937 lvb_type: 1 00000100:00100000:0.0:1746129582.060561:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734448128 00000100:00100000:0.0:1746129582.060563:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734448128 00010000:00010000:0.0:1746129582.060580:0:7087:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009d107400/0x40a459093b06bb8d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2239c expref: 24 pid: 4385 timeout: 937 lvb_type: 0 00000100:00100000:0.0:1746129582.060592:0:7087:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8743 00000100:00100000:0.0:1746129582.060598:0:7087:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ede680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ada2ffba-8920-4ecb-8068-68caa9806978+33:1963:x1830948734447872:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129582.060610:0:7087:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129582.060633:0:7087:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c3d4a00/0x40a459093b06bb5c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22364 expref: 33 pid: 8410 timeout: 937 lvb_type: 1 00010000:00010000:0.0:1746129582.060643:0:7087:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c3d4a00/0x40a459093b06bb5c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22364 expref: 33 pid: 8410 timeout: 937 lvb_type: 1 00010000:00010000:0.0:1746129582.060666:0:7087:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c3d4a00/0x40a459093b06bb5c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22364 expref: 33 pid: 8410 timeout: 937 lvb_type: 1 00010000:00010000:0.0:1746129582.060680:0:7087:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129582.060744:0:20578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8744 00000100:00100000:3.0:1746129582.060752:0:20578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093edc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:068dab75-d300-4ead-a742-d14572ad1e50+10:1963:x1830948734448000:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129582.060760:0:20578:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129582.060769:0:20578:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f385600/0x40a459093b06ba28 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f222ed expref: 10 pid: 8410 timeout: 937 lvb_type: 1 00010000:00010000:3.0:1746129582.060776:0:20578:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f385600/0x40a459093b06ba28 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f222ed expref: 10 pid: 8410 timeout: 937 lvb_type: 1 00010000:00010000:3.0:1746129582.060788:0:20578:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f385600/0x40a459093b06ba28 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f222ed expref: 10 pid: 8410 timeout: 937 lvb_type: 1 00010000:00010000:3.0:1746129582.060802:0:20578:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129582.060873:0:15749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8745 00000100:00100000:1.0:1746129582.060881:0:15749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093eded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+24:1963:x1830948734448128:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129582.060888:0:15749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129582.060897:0:15749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009d107400/0x40a459093b06bb8d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2239c expref: 24 pid: 4385 timeout: 937 lvb_type: 0 00010000:00010000:1.0:1746129582.060906:0:15749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009d107400/0x40a459093b06bb8d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2239c expref: 24 pid: 4385 timeout: 937 lvb_type: 0 00010000:00010000:1.0:1746129582.060918:0:15749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d107400/0x40a459093b06bb8d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2239c expref: 24 pid: 4385 timeout: 937 lvb_type: 0 00010000:00010000:1.0:1746129582.060932:0:15749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129582.060934:0:15749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129582.060940:0:15749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f119000/0x40a459093b06bc19 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1863680->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f223e9 expref: 32 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129582.060948:0:15749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f119000/0x40a459093b06bc19 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1863680->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f223e9 expref: 32 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129582.060978:0:15749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f119000/0x40a459093b06bc19 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1863680->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f223e9 expref: 32 pid: 31503 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129582.060991:0:15749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fc2fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15749:1830948737634944:192.168.202.4@tcp:105: 00000100:00080000:2.0:1746129582.061210:0:7097:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746129582.061282:0:7087:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ede680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ada2ffba-8920-4ecb-8068-68caa9806978+32:1963:x1830948734447872:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 682us (1323us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129582.061290:0:7087:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8743 00000100:00100000:3.0:1746129582.061317:0:20578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093edc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:068dab75-d300-4ead-a742-d14572ad1e50+9:1963:x1830948734448000:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 565us (891us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129582.061324:0:20578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8744 00000100:00100000:1.0:1746129582.061404:0:15749:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a91c5780 going to sleep for 11 seconds 00000100:00100000:1.0:1746129582.064723:0:15749:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fc2fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15749:1830948737634944:192.168.202.4@tcp:105: 00010000:00010000:1.0:1746129582.064750:0:15749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129582.064810:0:15749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093eded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+23:1963:x1830948734448128:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 3928us (4343us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129582.064823:0:15749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8745 00000100:00100000:0.0:1746129582.065521:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129582.065619:0:21725:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734448384 00000100:00100000:2.0:1746129582.065626:0:21725:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734448384 00002000:00100000:2.0:1746129582.065671:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f4:0x0] (1863680->1867775) req@ffff88009f326680 x1830948734448384/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:323/0 lens 488/0 e 0 to 0 dl 1746129593 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129582.065682:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f326680 with x1830948734448384 ext(1863680->1867775) 00002000:00010000:2.0:1746129582.065687:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f326680 00000100:00100000:2.0:1746129582.065706:0:21725:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8206 00000100:00100000:2.0:1746129582.065712:0:21725:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f326680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ada2ffba-8920-4ecb-8068-68caa9806978+32:1961:x1830948734448384:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:2.0:1746129582.065890:0:21725:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f326680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ada2ffba-8920-4ecb-8068-68caa9806978+32:1961:x1830948734448384:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 177us (371us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129582.065896:0:21725:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8206 00002000:00100000:2.0:1746129582.065902:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f4:0x0] (1863680->1867775) req@ffff88009f326680 x1830948734448384/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:323/0 lens 488/4536 e 0 to 0 dl 1746129593 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129582.065909:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f326680 with x1830948734448384 ext(1863680->1867775) 00002000:00010000:2.0:1746129582.065912:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f326680 00000100:00100000:0.0:1746129582.069694:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129582.069768:0:31503:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734448512 00000100:00100000:2.0:1746129582.069778:0:31503:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734448512 00000100:00100000:2.0:1746129582.069831:0:31503:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16903 00000100:00100000:2.0:1746129582.069839:0:31503:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f327b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ada2ffba-8920-4ecb-8068-68caa9806978+28:32711:x1830948734448512:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:2.0:1746129582.069858:0:31503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129582.069875:0:31503:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f118a00/0x40a459093b06bc20 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f223f0 expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129582.069904:0:31503:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008fba5200/0x40a459093b06ba36 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f222f4 expref: 8 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129582.069912:0:31503:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d307400/0x40a459093b06bba2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f223b1 expref: 20 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129582.069919:0:31503:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095800c00/0x40a459093b06bb71 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2236b expref: 29 pid: 8411 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129582.069924:0:31503:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129582.069926:0:31503:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129582.069929:0:31503:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f118a00/0x40a459093b06bc20 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [1048576->1413119] (req 1048576->1413119) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f223f0 expref: 29 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129582.069960:0:31503:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095800c00/0x40a459093b06bb71 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2236b expref: 29 pid: 8411 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129582.069971:0:31503:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095800c00/0x40a459093b06bb71 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2236b expref: 29 pid: 8411 timeout: 937 lvb_type: 1 00000100:00100000:2.0:1746129582.069988:0:31503:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900f5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:31503:1830948737635072:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129582.070282:0:31503:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009d307400/0x40a459093b06bba2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f223b1 expref: 20 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129582.070332:0:31503:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009d307400/0x40a459093b06bba2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f223b1 expref: 20 pid: 4385 timeout: 937 lvb_type: 0 00000100:00100000:2.0:1746129582.070344:0:31503:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900f6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:31503:1830948737635200:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129582.070485:0:31503:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008fba5200/0x40a459093b06ba36 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f222f4 expref: 8 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129582.070493:0:31503:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008fba5200/0x40a459093b06ba36 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f222f4 expref: 8 pid: 8410 timeout: 937 lvb_type: 1 00000100:00100000:2.0:1746129582.070500:0:31503:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900f5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:31503:1830948737635328:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129582.070516:0:31503:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132dad840 going to sleep for 11 seconds 00000100:00100000:0.0:1746129582.075063:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129582.075113:0:31503:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900f5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:31503:1830948737635072:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129582.075119:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129582.075127:0:31503:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900f6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:31503:1830948737635200:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129582.075136:0:31503:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900f5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:31503:1830948737635328:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129582.075173:0:31503:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f118a00/0x40a459093b06bc20 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [1048576->1413119] (req 1048576->1413119) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f223f0 expref: 29 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129582.075195:0:31503:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f118a00, rc 0) 00000100:00100000:2.0:1746129582.075261:0:31503:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f327b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ada2ffba-8920-4ecb-8068-68caa9806978+29:32711:x1830948734448512:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 5422us (5577us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129582.075268:0:31503:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16903 00000100:00100000:1.0:1746129582.075393:0:15749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734448768 00000100:00100000:1.0:1746129582.075401:0:15749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734448768 00010000:00010000:1.0:1746129582.075434:0:15749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008fba5200/0x40a459093b06ba36 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f222f4 expref: 9 pid: 8410 timeout: 937 lvb_type: 1 00000100:00100000:1.0:1746129582.075462:0:15749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8746 00000100:00100000:1.0:1746129582.075469:0:15749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a47c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:068dab75-d300-4ead-a742-d14572ad1e50+9:1960:x1830948734448768:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129582.075483:0:15749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129582.075506:0:15749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008fba5200/0x40a459093b06ba36 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f222f4 expref: 9 pid: 8410 timeout: 937 lvb_type: 1 00010000:00010000:1.0:1746129582.075517:0:15749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008fba5200/0x40a459093b06ba36 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f222f4 expref: 9 pid: 8410 timeout: 937 lvb_type: 1 00010000:00010000:1.0:1746129582.075541:0:15749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008fba5200/0x40a459093b06ba36 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f222f4 expref: 9 pid: 8410 timeout: 937 lvb_type: 1 00010000:00010000:1.0:1746129582.075561:0:15749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129582.075593:0:15749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a47c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:068dab75-d300-4ead-a742-d14572ad1e50+8:1960:x1830948734448768:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 124us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129582.075599:0:15749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8746 00000100:00100000:3.0:1746129582.075686:0:20578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734448640 00000100:00100000:3.0:1746129582.075690:0:20578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734448640 00010000:00010000:3.0:1746129582.075708:0:20578:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009d307400/0x40a459093b06bba2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f223b1 expref: 21 pid: 4385 timeout: 937 lvb_type: 0 00000100:00100000:3.0:1746129582.075724:0:20578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8747 00000100:00100000:3.0:1746129582.075728:0:20578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f324700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:1961:x1830948734448640:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129582.075737:0:20578:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129582.075745:0:20578:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009d307400/0x40a459093b06bba2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f223b1 expref: 21 pid: 4385 timeout: 937 lvb_type: 0 00010000:00010000:3.0:1746129582.075757:0:20578:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009d307400/0x40a459093b06bba2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f223b1 expref: 21 pid: 4385 timeout: 937 lvb_type: 0 00010000:00010000:3.0:1746129582.075768:0:20578:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d307400/0x40a459093b06bba2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f223b1 expref: 21 pid: 4385 timeout: 937 lvb_type: 0 00010000:00010000:3.0:1746129582.075782:0:20578:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129582.075800:0:20578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f324700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:1961:x1830948734448640:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 71us (749us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129582.075805:0:20578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8747 00000100:00100000:0.0:1746129582.077032:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129582.077155:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734448896 00000100:00100000:1.0:1746129582.077162:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734448896 00010000:00010000:1.0:1746129582.077184:0:7087:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095800c00/0x40a459093b06bb71 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2236b expref: 29 pid: 8411 timeout: 937 lvb_type: 1 00000100:00100000:1.0:1746129582.077229:0:7087:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8748 00000100:00100000:1.0:1746129582.077235:0:7087:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f325180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ada2ffba-8920-4ecb-8068-68caa9806978+29:1962:x1830948734448896:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129582.077246:0:7087:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129582.077259:0:7087:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095800c00/0x40a459093b06bb71 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2236b expref: 29 pid: 8411 timeout: 937 lvb_type: 1 00010000:00010000:1.0:1746129582.077270:0:7087:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095800c00/0x40a459093b06bb71 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2236b expref: 29 pid: 8411 timeout: 937 lvb_type: 1 00010000:00010000:1.0:1746129582.077285:0:7087:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095800c00/0x40a459093b06bb71 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2236b expref: 29 pid: 8411 timeout: 937 lvb_type: 1 00010000:00010000:1.0:1746129582.077501:0:7087:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129582.077503:0:7087:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129582.077510:0:7087:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f118a00/0x40a459093b06bc20 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1413119) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f223f0 expref: 28 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129582.077519:0:7087:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f118a00/0x40a459093b06bc20 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1413119) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f223f0 expref: 28 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129582.077552:0:7087:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f118a00/0x40a459093b06bc20 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1413119) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f223f0 expref: 28 pid: 31503 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129582.077565:0:7087:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fc2fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7087:1830948737635456:192.168.202.4@tcp:105: 00000100:00100000:1.0:1746129582.077860:0:7087:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a91c5780 going to sleep for 11 seconds 00000100:00100000:1.0:1746129582.079357:0:7087:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fc2fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7087:1830948737635456:192.168.202.4@tcp:105: 00010000:00010000:1.0:1746129582.079378:0:7087:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129582.079411:0:7087:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f325180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ada2ffba-8920-4ecb-8068-68caa9806978+28:1962:x1830948734448896:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 2175us (2384us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129582.079420:0:7087:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8748 00000100:00100000:0.0:1746129582.085606:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129582.085742:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734449152 00000100:00100000:1.0:1746129582.085751:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734449152 00002000:00100000:1.0:1746129582.085802:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ee:0x0] (1409024->1413119) req@ffff88009f324e00 x1830948734449152/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:323/0 lens 488/0 e 0 to 0 dl 1746129593 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129582.085813:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f324e00 with x1830948734449152 ext(1409024->1413119) 00002000:00010000:1.0:1746129582.085818:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f324e00 00000100:00100000:1.0:1746129582.085918:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8207 00000100:00100000:1.0:1746129582.085927:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f324e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+28:1960:x1830948734449152:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:1.0:1746129582.086373:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f324e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+28:1960:x1830948734449152:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 446us (778us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746129582.086380:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8207 00002000:00100000:1.0:1746129582.086387:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ee:0x0] (1409024->1413119) req@ffff88009f324e00 x1830948734449152/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:323/0 lens 488/4536 e 0 to 0 dl 1746129593 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129582.086394:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f324e00 with x1830948734449152 ext(1409024->1413119) 00002000:00010000:1.0:1746129582.086397:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f324e00 00000100:00100000:0.0:1746129582.088393:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129582.088756:0:14551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734449408 00000100:00100000:2.0:1746129582.088764:0:14551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734449408 00000100:00100000:2.0:1746129582.088864:0:14551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4852 00000100:00100000:2.0:1746129582.088872:0:14551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f324700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ada2ffba-8920-4ecb-8068-68caa9806978+294:32711:x1830948734449408:12345-192.168.202.4@tcp:35:multiop.0 00000100:00100000:2.0:1746129582.089505:0:14551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f324700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ada2ffba-8920-4ecb-8068-68caa9806978+295:32711:x1830948734449408:12345-192.168.202.4@tcp:35:multiop.0 Request processed in 632us (1118us total) trans 8589945496 rc 0/0 00000100:00100000:2.0:1746129582.089512:0:14551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4852 00000100:00100000:0.0:1746129582.091667:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129582.091802:0:31503:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734449536 00000100:00100000:2.0:1746129582.091810:0:31503:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734449536 00000100:00100000:2.0:1746129582.091864:0:31503:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16904 00000100:00100000:2.0:1746129582.091872:0:31503:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800912ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:32709:x1830948734449536:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:2.0:1746129582.091892:0:31503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129582.091911:0:31503:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f118800/0x40a459093b06bc27 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f223f7 expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129582.091940:0:31503:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f118a00/0x40a459093b06bc20 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1413119) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f223f0 expref: 27 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129582.091949:0:31503:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129582.091950:0:31503:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129582.091954:0:31503:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f118800/0x40a459093b06bc27 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1417216->2097151] (req 1417216->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f223f7 expref: 21 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129582.091986:0:31503:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f118a00/0x40a459093b06bc20 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1413119) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f223f0 expref: 27 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129582.091997:0:31503:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f118a00/0x40a459093b06bc20 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1413119) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f223f0 expref: 27 pid: 31503 timeout: 937 lvb_type: 0 00000100:00100000:2.0:1746129582.092009:0:31503:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900f5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:31503:1830948737635584:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129582.092098:0:31503:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132dad240 going to sleep for 11 seconds 00000100:00100000:2.0:1746129582.096084:0:31503:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900f5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:31503:1830948737635584:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129582.096084:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00010000:00010000:2.0:1746129582.096122:0:31503:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f118800/0x40a459093b06bc27 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1417216->2097151] (req 1417216->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f223f7 expref: 21 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129582.096142:0:31503:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f118800, rc 0) 00000100:00100000:2.0:1746129582.096189:0:31503:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800912ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:32709:x1830948734449536:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 4317us (4527us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129582.096197:0:31503:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16904 00000100:00100000:1.0:1746129582.096448:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734449664 00000100:00100000:1.0:1746129582.096455:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734449664 00002000:00100000:1.0:1746129582.096495:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ee:0x0] (1048576->1413119) req@ffff8800912af100 x1830948734449664/t0(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:323/0 lens 488/0 e 0 to 0 dl 1746129593 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129582.096503:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800912af100 with x1830948734449664 ext(1048576->1413119) 00010000:00010000:1.0:1746129582.096511:0:25745:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f118a00/0x40a459093b06bc20 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1413119) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f223f0 expref: 28 pid: 31503 timeout: 937 lvb_type: 0 00010000:00010000:1.0:1746129582.096524:0:25745:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f118a00/0x40a459093b06bc20 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1413119) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f223f0 expref: 28 pid: 31503 timeout: 937 lvb_type: 0 00002000:00010000:1.0:1746129582.096530:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800912af100 00000100:00100000:1.0:1746129582.096557:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2538 00000100:00100000:1.0:1746129582.096564:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800912af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+28:1962:x1830948734449664:12345-192.168.202.4@tcp:4:multiop.0 00000100:00100000:2.0:1746129582.107262:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800912af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+30:1962:x1830948734449664:12345-192.168.202.4@tcp:4:multiop.0 Request processed in 10686us (11172us total) trans 21474841459 rc 0/0 00000100:00100000:2.0:1746129582.107275:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2538 00002000:00100000:2.0:1746129582.107287:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ee:0x0] (1048576->1413119) req@ffff8800912af100 x1830948734449664/t21474841459(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:323/0 lens 488/448 e 0 to 0 dl 1746129593 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129582.107329:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800912af100 with x1830948734449664 ext(1048576->1413119) 00010000:00010000:2.0:1746129582.107340:0:25745:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f118a00/0x40a459093b06bc20 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1413119) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f223f0 expref: 30 pid: 31503 timeout: 937 lvb_type: 0 00010000:00010000:2.0:1746129582.107358:0:25745:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f118a00/0x40a459093b06bc20 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1413119) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f223f0 expref: 30 pid: 31503 timeout: 937 lvb_type: 0 00002000:00010000:2.0:1746129582.107365:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800912af100 00000100:00100000:0.0:1746129582.109808:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129582.110596:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734449792 00000100:00100000:1.0:1746129582.110606:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734449792 00010000:00010000:1.0:1746129582.110648:0:7087:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f118a00/0x40a459093b06bc20 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1413119) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f223f0 expref: 30 pid: 31503 timeout: 937 lvb_type: 0 00000100:00100000:1.0:1746129582.110746:0:7087:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8749 00000100:00100000:1.0:1746129582.110754:0:7087:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800912aed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ada2ffba-8920-4ecb-8068-68caa9806978+30:1960:x1830948734449792:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129582.110769:0:7087:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129582.110794:0:7087:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f118a00/0x40a459093b06bc20 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1413119) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f223f0 expref: 30 pid: 31503 timeout: 937 lvb_type: 0 00010000:00010000:1.0:1746129582.110807:0:7087:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f118a00/0x40a459093b06bc20 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1413119) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f223f0 expref: 30 pid: 31503 timeout: 937 lvb_type: 0 00010000:00010000:1.0:1746129582.110832:0:7087:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f118a00/0x40a459093b06bc20 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1413119) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f223f0 expref: 30 pid: 31503 timeout: 937 lvb_type: 0 00010000:00010000:1.0:1746129582.110863:0:7087:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129582.110864:0:7087:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129582.110870:0:7087:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f118800/0x40a459093b06bc27 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1417216->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f223f7 expref: 20 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129582.110876:0:7087:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f118800/0x40a459093b06bc27 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1417216->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f223f7 expref: 20 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129582.110907:0:7087:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f118800/0x40a459093b06bc27 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1417216->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f223f7 expref: 20 pid: 31503 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129582.110919:0:7087:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fc2fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7087:1830948737635712:192.168.202.4@tcp:105: 00000100:00100000:1.0:1746129582.111014:0:7087:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a91c59c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129582.114655:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129582.114878:0:7087:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fc2fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7087:1830948737635712:192.168.202.4@tcp:105: 00010000:00010000:1.0:1746129582.114902:0:7087:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129582.115020:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734450048 00000100:00100000:2.0:1746129582.115027:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734450048 00002000:00100000:2.0:1746129582.115186:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ee:0x0] (1417216->1421311) req@ffff8800912ac000 x1830948734450048/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:323/0 lens 488/0 e 0 to 0 dl 1746129593 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129582.115195:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800912ac000 with x1830948734450048 ext(1417216->1421311) 00002000:00010000:2.0:1746129582.115199:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800912ac000 00000100:00100000:2.0:1746129582.115272:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8208 00000100:00100000:2.0:1746129582.115279:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800912ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:1962:x1830948734450048:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:1.0:1746129582.115531:0:7087:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800912aed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ada2ffba-8920-4ecb-8068-68caa9806978+29:1960:x1830948734449792:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 4777us (5732us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129582.115540:0:7087:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8749 00000100:00100000:2.0:1746129582.115858:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800912ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:1962:x1830948734450048:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 579us (1215us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129582.115865:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8208 00002000:00100000:2.0:1746129582.115870:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ee:0x0] (1417216->1421311) req@ffff8800912ac000 x1830948734450048/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:323/0 lens 488/4536 e 0 to 0 dl 1746129593 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129582.115877:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800912ac000 with x1830948734450048 ext(1417216->1421311) 00002000:00010000:2.0:1746129582.115879:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800912ac000 00000100:00100000:0.0:1746129582.121607:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129582.121752:0:31503:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734450176 00000100:00100000:2.0:1746129582.121763:0:31503:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734450176 00000100:00100000:2.0:1746129582.121806:0:31503:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16905 00000100:00100000:2.0:1746129582.121814:0:31503:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800912af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:32709:x1830948734450176:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:2.0:1746129582.121837:0:31503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129582.121856:0:31503:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5897a00/0x40a459093b06bc2e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f223fe expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129582.121888:0:31503:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012bf7ac00/0x40a459093b06bbb0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f223b8 expref: 28 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129582.121897:0:31503:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012bf7b600/0x40a459093b06bbb7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f223bf expref: 22 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129582.121903:0:31503:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129582.121904:0:31503:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129582.121908:0:31503:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5897a00/0x40a459093b06bc2e lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [2097152->2240511] (req 2097152->2240511) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f223fe expref: 22 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129582.121940:0:31503:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012bf7b600/0x40a459093b06bbb7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f223bf expref: 22 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129582.121951:0:31503:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012bf7b600/0x40a459093b06bbb7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f223bf expref: 22 pid: 31503 timeout: 937 lvb_type: 0 00000100:00100000:2.0:1746129582.121962:0:31503:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900f5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:31503:1830948737635840:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129582.122621:0:31503:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012bf7ac00/0x40a459093b06bbb0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f223b8 expref: 28 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129582.122631:0:31503:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012bf7ac00/0x40a459093b06bbb0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f223b8 expref: 28 pid: 31503 timeout: 937 lvb_type: 0 00000100:00100000:2.0:1746129582.122645:0:31503:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900f6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:31503:1830948737635968:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129582.122666:0:31503:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132dadd80 going to sleep for 11 seconds 00000100:00100000:2.0:1746129582.127191:0:31503:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900f5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:31503:1830948737635840:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129582.128774:0:31503:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900f6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:31503:1830948737635968:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129582.128825:0:31503:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5897a00/0x40a459093b06bc2e lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [2097152->2240511] (req 2097152->2240511) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f223fe expref: 22 pid: 31503 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129582.128845:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00010000:00010000:2.0:1746129582.128856:0:31503:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5897a00, rc 0) 00000100:00100000:2.0:1746129582.128913:0:31503:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800912af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+22:32709:x1830948734450176:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 7099us (7317us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129582.128917:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734450304 00000100:00100000:2.0:1746129582.128922:0:31503:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16905 00000100:00100000:1.0:1746129582.128924:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734450304 00010000:00010000:1.0:1746129582.128952:0:7087:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012bf7b600/0x40a459093b06bbb7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f223bf expref: 22 pid: 31503 timeout: 937 lvb_type: 0 00000100:00100000:1.0:1746129582.128987:0:7087:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8750 00000100:00100000:1.0:1746129582.128993:0:7087:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800912ae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+22:1963:x1830948734450304:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129582.129009:0:7087:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129582.129031:0:7087:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012bf7b600/0x40a459093b06bbb7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f223bf expref: 22 pid: 31503 timeout: 937 lvb_type: 0 00010000:00010000:1.0:1746129582.129043:0:7087:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012bf7b600/0x40a459093b06bbb7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f223bf expref: 22 pid: 31503 timeout: 937 lvb_type: 0 00010000:00010000:1.0:1746129582.129066:0:7087:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012bf7b600/0x40a459093b06bbb7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f223bf expref: 22 pid: 31503 timeout: 937 lvb_type: 0 00010000:00010000:1.0:1746129582.129081:0:7087:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129582.129098:0:7087:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800912ae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:1963:x1830948734450304:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 105us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129582.129103:0:7087:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8750 00000100:00100000:0.0:1746129582.134651:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129582.134776:0:20578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734450432 00000100:00100000:3.0:1746129582.134785:0:20578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734450432 00010000:00010000:3.0:1746129582.134823:0:20578:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012bf7ac00/0x40a459093b06bbb0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f223b8 expref: 29 pid: 31503 timeout: 937 lvb_type: 0 00000100:00100000:3.0:1746129582.135417:0:20578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8751 00000100:00100000:3.0:1746129582.135426:0:20578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800912afb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ada2ffba-8920-4ecb-8068-68caa9806978+29:1963:x1830948734450432:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129582.135442:0:20578:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129582.135465:0:20578:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012bf7ac00/0x40a459093b06bbb0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f223b8 expref: 29 pid: 31503 timeout: 937 lvb_type: 0 00010000:00010000:3.0:1746129582.135478:0:20578:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012bf7ac00/0x40a459093b06bbb0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f223b8 expref: 29 pid: 31503 timeout: 937 lvb_type: 0 00010000:00010000:3.0:1746129582.135503:0:20578:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012bf7ac00/0x40a459093b06bbb0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f223b8 expref: 29 pid: 31503 timeout: 937 lvb_type: 0 00010000:00010000:3.0:1746129582.135537:0:20578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129582.135540:0:20578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129582.135547:0:20578:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5897a00/0x40a459093b06bc2e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2240511) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f223fe expref: 20 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129582.135555:0:20578:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5897a00/0x40a459093b06bc2e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2240511) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f223fe expref: 20 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129582.135590:0:20578:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5897a00/0x40a459093b06bc2e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2240511) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f223fe expref: 20 pid: 31503 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129582.135604:0:20578:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bd880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:20578:1830948737636096:192.168.202.4@tcp:105: 00000100:00100000:3.0:1746129582.135677:0:20578:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5c683c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746129582.139448:0:20578:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bd880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:20578:1830948737636096:192.168.202.4@tcp:105: 00010000:00010000:2.0:1746129582.139473:0:20578:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129582.139531:0:20578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800912afb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ada2ffba-8920-4ecb-8068-68caa9806978+28:1963:x1830948734450432:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 4105us (4892us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129582.139542:0:20578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8751 00000100:00100000:0.0:1746129582.139919:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129582.140264:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734450688 00000100:00100000:2.0:1746129582.140271:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734450688 00002000:00100000:2.0:1746129582.140331:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ef:0x0] (2236416->2240511) req@ffff8800912adf80 x1830948734450688/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:323/0 lens 488/0 e 0 to 0 dl 1746129593 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129582.140341:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800912adf80 with x1830948734450688 ext(2236416->2240511) 00002000:00010000:2.0:1746129582.140345:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800912adf80 00000100:00100000:2.0:1746129582.141521:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8209 00000100:00100000:2.0:1746129582.141534:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800912adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:1961:x1830948734450688:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:2.0:1746129582.141718:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800912adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:1961:x1830948734450688:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 186us (1798us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129582.141724:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8209 00002000:00100000:2.0:1746129582.141731:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ef:0x0] (2236416->2240511) req@ffff8800912adf80 x1830948734450688/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:323/0 lens 488/4536 e 0 to 0 dl 1746129593 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129582.141739:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800912adf80 with x1830948734450688 ext(2236416->2240511) 00002000:00010000:2.0:1746129582.141743:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800912adf80 00000100:00100000:0.0:1746129582.144137:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129582.144497:0:14551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734450944 00000100:00100000:2.0:1746129582.144507:0:14551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734450944 00000100:00100000:2.0:1746129582.144855:0:14551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4853 00000100:00100000:2.0:1746129582.144864:0:14551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800912ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+11:32709:x1830948734450944:12345-192.168.202.4@tcp:35:multiop.0 00000100:00100000:2.0:1746129582.145578:0:14551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800912ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+12:32709:x1830948734450944:12345-192.168.202.4@tcp:35:multiop.0 Request processed in 712us (1449us total) trans 8589945497 rc 0/0 00000100:00100000:2.0:1746129582.145587:0:14551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4853 00000100:00100000:0.0:1746129582.149706:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129582.149899:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734451200 00000100:00100000:2.0:1746129582.149909:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734451200 00000100:00100000:2.0:1746129582.150275:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11369 00000100:00100000:2.0:1746129582.150284:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800912adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ada2ffba-8920-4ecb-8068-68caa9806978+295:32717:x1830948734451200:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129582.150344:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129582.150363:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095eec000/0x40a459093b06bc35 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f22405 expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129582.150467:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095eeca00/0x40a459093b06bc3c lrc: 3/1,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746129582.150485:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095eeca00/0x40a459093b06bc3c lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746129582.150495:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095eeca00/0x40a459093b06bc3c lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000004:00200000:2.0:1746129582.150506:0:14548:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:2.0:1746129582.150630:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095eec000/0x40a459093b06bc35 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22405 expref: 298 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129582.150650:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095eeca00/0x40a459093b06bc3c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22405 expref: 297 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129582.150658:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009cffe100) 00010000:00010000:2.0:1746129582.150661:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1746129582.150664:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095eeca00, rc 0) 00000100:00100000:2.0:1746129582.150729:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800912adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ada2ffba-8920-4ecb-8068-68caa9806978+297:32717:x1830948734451200:12345-192.168.202.4@tcp:101:cat.0 Request processed in 445us (1035us total) trans 8589945498 rc 0/0 00000100:00100000:2.0:1746129582.150735:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11369 00000100:00100000:0.0:1746129582.153570:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129582.153629:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129582.153763:0:31503:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734451456 00000100:00100000:3.0:1746129582.153773:0:31503:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734451456 00000100:00100000:1.0:1746129582.153892:0:22480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734451328 00000100:00100000:1.0:1746129582.153896:0:22480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734451328 00000100:00100000:3.0:1746129582.153897:0:31503:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16906 00000100:00100000:3.0:1746129582.153905:0:31503:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800912ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ada2ffba-8920-4ecb-8068-68caa9806978+29:1962:x1830948734451456:12345-192.168.202.4@tcp:101:cat.0 00000100:00100000:1.0:1746129582.153918:0:22480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16907 00000100:00100000:1.0:1746129582.153922:0:22480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ada2ffba-8920-4ecb-8068-68caa9806978+29:1962:x1830948734451328:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129582.153925:0:31503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129582.153927:0:22480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129582.153941:0:31503:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ba38a00/0x40a459093b06bc51 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f22413 expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129582.153941:0:22480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ec79400/0x40a459093b06bc4a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2240c expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129582.153994:0:31503:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:31503:1830948737636352:192.168.202.4@tcp:106: 00000100:00100000:1.0:1746129582.153994:0:22480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fc2fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22480:1830948737636224:192.168.202.4@tcp:106: 00000100:00100000:1.0:1746129582.154071:0:22480:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a91c59c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746129582.154136:0:31503:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5c68540 going to sleep for 11 seconds 00000100:00100000:1.0:1746129582.156127:0:22480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fc2fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22480:1830948737636224:192.168.202.4@tcp:106: 00000100:00100000:3.0:1746129582.156140:0:31503:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:31503:1830948737636352:192.168.202.4@tcp:106: 00010000:00010000:3.0:1746129582.156163:0:31503:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ba38a00/0x40a459093b06bc51 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22413 expref: 31 pid: 31503 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129582.156163:0:22480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ec79400/0x40a459093b06bc4a lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2240c expref: 31 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129582.156177:0:31503:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ba38a00/0x40a459093b06bc51 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22413 expref: 31 pid: 31503 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129582.156177:0:22480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ec79400/0x40a459093b06bc4a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2240c expref: 31 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129582.156239:0:31503:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ba38a00, rc 0) 00010000:00010000:1.0:1746129582.156239:0:22480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ec79400, rc 0) 00000100:00100000:3.0:1746129582.156289:0:31503:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800912ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ada2ffba-8920-4ecb-8068-68caa9806978+29:1962:x1830948734451456:12345-192.168.202.4@tcp:101:cat.0 Request processed in 2384us (2729us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129582.156318:0:31503:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16906 00000100:00100000:1.0:1746129582.156371:0:22480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ada2ffba-8920-4ecb-8068-68caa9806978+28:1962:x1830948734451328:12345-192.168.202.4@tcp:101:cat.0 Request processed in 2446us (2740us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129582.156376:0:22480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16907 00000100:00100000:0.0:1746129582.162888:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129582.163033:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734451712 00000100:00100000:2.0:1746129582.163044:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734451712 00002000:00100000:2.0:1746129582.163095:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f4:0x0] (1048576->1863679) req@ffff880094f45c00 x1830948734451712/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:323/0 lens 488/0 e 0 to 0 dl 1746129593 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129582.163105:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094f45c00 with x1830948734451712 ext(1048576->1863679) 00002000:00010000:2.0:1746129582.163111:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094f45c00 00000100:00100000:2.0:1746129582.163146:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8210 00000100:00100000:2.0:1746129582.163153:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+32:1960:x1830948734451712:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:2.0:1746129582.170757:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+32:1960:x1830948734451712:12345-192.168.202.4@tcp:3:cat.0 Request processed in 7592us (7868us total) trans 0 rc 815104/815104 00000100:00100000:2.0:1746129582.170769:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8210 00002000:00100000:2.0:1746129582.170783:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f4:0x0] (1048576->1863679) req@ffff880094f45c00 x1830948734451712/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:323/0 lens 488/440 e 0 to 0 dl 1746129593 ref 1 fl Complete:/200/0 rc 815104/815104 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129582.170793:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094f45c00 with x1830948734451712 ext(1048576->1863679) 00002000:00010000:2.0:1746129582.170799:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094f45c00 00000100:00100000:0.0:1746129582.180528:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129582.180640:0:22480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734451840 00000100:00100000:1.0:1746129582.180650:0:22480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734451840 00000100:00100000:1.0:1746129582.181021:0:22480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16908 00000100:00100000:1.0:1746129582.181029:0:22480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ada2ffba-8920-4ecb-8068-68caa9806978+28:32717:x1830948734451840:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129582.181049:0:22480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129582.181067:0:22480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ec79c00/0x40a459093b06bc58 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2241a expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129582.181101:0:22480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f118800/0x40a459093b06bc27 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1417216->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f223f7 expref: 20 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129582.181109:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129582.181110:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129582.181114:0:22480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ec79c00/0x40a459093b06bc58 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2241a expref: 29 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129582.181145:0:22480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f118800/0x40a459093b06bc27 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1417216->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f223f7 expref: 20 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129582.181162:0:22480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f118800/0x40a459093b06bc27 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1417216->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f223f7 expref: 20 pid: 31503 timeout: 937 lvb_type: 0 00000100:00100000:1.0:1746129582.181174:0:22480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fc2fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22480:1830948737636480:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129582.181430:0:22480:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a91c59c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129582.185043:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129582.185775:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734451968 00000100:00100000:2.0:1746129582.185786:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734451968 00002000:00100000:2.0:1746129582.185832:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ee:0x0] (1417216->2097151) req@ffff880094f47b80 x1830948734451968/t0(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:323/0 lens 488/0 e 0 to 0 dl 1746129593 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129582.185842:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094f47b80 with x1830948734451968 ext(1417216->2097151) 00010000:00010000:2.0:1746129582.185852:0:25745:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f118800/0x40a459093b06bc27 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1417216->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f223f7 expref: 21 pid: 31503 timeout: 937 lvb_type: 0 00010000:00010000:2.0:1746129582.185865:0:25745:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f118800/0x40a459093b06bc27 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1417216->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f223f7 expref: 21 pid: 31503 timeout: 937 lvb_type: 0 00002000:00010000:2.0:1746129582.185872:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094f47b80 00000100:00100000:2.0:1746129582.185905:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2539 00000100:00100000:2.0:1746129582.185912:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:1963:x1830948734451968:12345-192.168.202.4@tcp:4:multiop.0 00000100:00100000:1.0:1746129582.186361:0:22480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fc2fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22480:1830948737636480:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129582.186388:0:22480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ec79c00/0x40a459093b06bc58 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2241a expref: 29 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129582.186404:0:22480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ec79c00, rc 0) 00000100:00100000:1.0:1746129582.186452:0:22480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ada2ffba-8920-4ecb-8068-68caa9806978+29:32717:x1830948734451840:12345-192.168.202.4@tcp:101:cat.0 Request processed in 5423us (5936us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129582.186459:0:22480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16908 00000100:00100000:2.0:1746129582.198931:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+23:1963:x1830948734451968:12345-192.168.202.4@tcp:4:multiop.0 Request processed in 13006us (13887us total) trans 21474841460 rc 0/0 00000100:00100000:2.0:1746129582.198944:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2539 00002000:00100000:2.0:1746129582.198960:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ee:0x0] (1417216->2097151) req@ffff880094f47b80 x1830948734451968/t21474841460(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:323/0 lens 488/448 e 0 to 0 dl 1746129593 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129582.198969:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094f47b80 with x1830948734451968 ext(1417216->2097151) 00010000:00010000:2.0:1746129582.198979:0:25745:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f118800/0x40a459093b06bc27 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1417216->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f223f7 expref: 23 pid: 31503 timeout: 937 lvb_type: 0 00010000:00010000:2.0:1746129582.198997:0:25745:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f118800/0x40a459093b06bc27 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1417216->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f223f7 expref: 23 pid: 31503 timeout: 937 lvb_type: 0 00002000:00010000:2.0:1746129582.199004:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094f47b80 00000100:00100000:0.0:1746129582.201920:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129582.202152:0:20578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734452096 00000100:00100000:2.0:1746129582.202163:0:20578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734452096 00010000:00010000:2.0:1746129582.202204:0:20578:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f118800/0x40a459093b06bc27 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1417216->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f223f7 expref: 23 pid: 31503 timeout: 937 lvb_type: 0 00000100:00100000:2.0:1746129582.202736:0:20578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8752 00000100:00100000:2.0:1746129582.202745:0:20578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f46a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+23:1962:x1830948734452096:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129582.202760:0:20578:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129582.202786:0:20578:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f118800/0x40a459093b06bc27 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1417216->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f223f7 expref: 23 pid: 31503 timeout: 937 lvb_type: 0 00010000:00010000:2.0:1746129582.202799:0:20578:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f118800/0x40a459093b06bc27 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1417216->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f223f7 expref: 23 pid: 31503 timeout: 937 lvb_type: 0 00010000:00010000:2.0:1746129582.202824:0:20578:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f118800/0x40a459093b06bc27 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1417216->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f223f7 expref: 23 pid: 31503 timeout: 937 lvb_type: 0 00010000:00010000:2.0:1746129582.202856:0:20578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129582.202858:0:20578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129582.202866:0:20578:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ec79c00/0x40a459093b06bc58 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2241a expref: 28 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129582.202875:0:20578:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ec79c00/0x40a459093b06bc58 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2241a expref: 28 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129582.202909:0:20578:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012ec79c00/0x40a459093b06bc58 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2241a expref: 28 pid: 22480 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129582.202921:0:20578:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900f6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:20578:1830948737636608:192.168.202.4@tcp:105: 00000100:00100000:2.0:1746129582.203982:0:20578:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132dade40 going to sleep for 11 seconds 00000100:00100000:2.0:1746129582.209115:0:20578:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900f6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:20578:1830948737636608:192.168.202.4@tcp:105: 00010000:00010000:2.0:1746129582.209144:0:20578:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129582.209194:0:20578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f46a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+22:1962:x1830948734452096:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 6449us (7284us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129582.209204:0:20578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8752 00000100:00100000:0.0:1746129582.210458:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129582.210881:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734452352 00000100:00100000:2.0:1746129582.210891:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734452352 00002000:00100000:2.0:1746129582.210942:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ee:0x0] (1048576->2097151) req@ffff880094f44380 x1830948734452352/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:323/0 lens 488/0 e 0 to 0 dl 1746129593 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129582.210951:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094f44380 with x1830948734452352 ext(1048576->2097151) 00002000:00010000:2.0:1746129582.210956:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094f44380 00000100:00100000:2.0:1746129582.210992:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8211 00000100:00100000:2.0:1746129582.211001:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+29:1962:x1830948734452352:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:2.0:1746129582.224886:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+29:1962:x1830948734452352:12345-192.168.202.4@tcp:3:cat.0 Request processed in 13871us (14420us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129582.224899:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8211 00002000:00100000:2.0:1746129582.224913:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ee:0x0] (1048576->2097151) req@ffff880094f44380 x1830948734452352/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:323/0 lens 488/440 e 0 to 0 dl 1746129593 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129582.224923:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094f44380 with x1830948734452352 ext(1048576->2097151) 00002000:00010000:2.0:1746129582.224930:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094f44380 00000100:00100000:0.0:1746129582.231116:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129582.234287:0:22480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734452480 00000100:00100000:1.0:1746129582.234313:0:22480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734452480 00000100:00100000:1.0:1746129582.234383:0:22480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16909 00000100:00100000:1.0:1746129582.234391:0:22480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ada2ffba-8920-4ecb-8068-68caa9806978+29:32717:x1830948734452480:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129582.234411:0:22480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129582.234429:0:22480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ec79800/0x40a459093b06bc5f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f22421 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129582.234462:0:22480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5897a00/0x40a459093b06bc2e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2240511) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f223fe expref: 21 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129582.234475:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129582.234477:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129582.234480:0:22480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ec79800/0x40a459093b06bc5f lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22421 expref: 30 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129582.234510:0:22480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5897a00/0x40a459093b06bc2e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2240511) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f223fe expref: 21 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129582.234520:0:22480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5897a00/0x40a459093b06bc2e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2240511) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f223fe expref: 21 pid: 31503 timeout: 937 lvb_type: 0 00000100:00100000:1.0:1746129582.234532:0:22480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fc2fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22480:1830948737636736:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129582.234622:0:22480:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a91c59c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746129582.243051:0:22480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fc2fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22480:1830948737636736:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129582.243088:0:22480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ec79800/0x40a459093b06bc5f lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22421 expref: 30 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129582.243108:0:22480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ec79800, rc 0) 00000100:00100000:1.0:1746129582.243168:0:22480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ada2ffba-8920-4ecb-8068-68caa9806978+30:32717:x1830948734452480:12345-192.168.202.4@tcp:101:cat.0 Request processed in 8777us (12064us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129582.243178:0:22480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16909 00000100:00100000:0.0:1746129582.247117:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129582.247278:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734452608 00000100:00100000:2.0:1746129582.247289:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734452608 00002000:00100000:2.0:1746129582.247351:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ef:0x0] (2097152->2240511) req@ffff880094f47800 x1830948734452608/t0(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:323/0 lens 488/0 e 0 to 0 dl 1746129593 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129582.247361:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094f47800 with x1830948734452608 ext(2097152->2240511) 00010000:00010000:2.0:1746129582.247370:0:25745:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5897a00/0x40a459093b06bc2e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2240511) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f223fe expref: 22 pid: 31503 timeout: 937 lvb_type: 0 00010000:00010000:2.0:1746129582.247384:0:25745:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5897a00/0x40a459093b06bc2e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2240511) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f223fe expref: 22 pid: 31503 timeout: 937 lvb_type: 0 00002000:00010000:2.0:1746129582.247391:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094f47800 00000100:00100000:2.0:1746129582.247427:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2540 00000100:00100000:2.0:1746129582.247434:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+22:1962:x1830948734452608:12345-192.168.202.4@tcp:4:multiop.0 00000100:00100000:2.0:1746129582.251033:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+24:1962:x1830948734452608:12345-192.168.202.4@tcp:4:multiop.0 Request processed in 3586us (3915us total) trans 21474841461 rc 0/0 00000100:00100000:2.0:1746129582.251049:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2540 00002000:00100000:2.0:1746129582.251062:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ef:0x0] (2097152->2240511) req@ffff880094f47800 x1830948734452608/t21474841461(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:323/0 lens 488/448 e 0 to 0 dl 1746129593 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129582.251071:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094f47800 with x1830948734452608 ext(2097152->2240511) 00010000:00010000:2.0:1746129582.251082:0:25745:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5897a00/0x40a459093b06bc2e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2240511) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f223fe expref: 24 pid: 31503 timeout: 937 lvb_type: 0 00010000:00010000:2.0:1746129582.251097:0:25745:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5897a00/0x40a459093b06bc2e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2240511) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f223fe expref: 24 pid: 31503 timeout: 937 lvb_type: 0 00002000:00010000:2.0:1746129582.251104:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094f47800 00000100:00100000:0.0:1746129582.257478:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129582.257551:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734452864 00000100:00100000:3.0:1746129582.257561:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734452864 00000100:00100000:3.0:1746129582.257625:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11370 00000100:00100000:3.0:1746129582.257633:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+12:32721:x1830948734452864:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129582.257663:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129582.257684:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f118800/0x40a459093b06bc66 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f22428 expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129582.257791:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba38a00/0x40a459093b06bc6d lrc: 3/1,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129582.257807:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba38a00/0x40a459093b06bc6d lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129582.257817:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba38a00/0x40a459093b06bc6d lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00200000:3.0:1746129582.257829:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:3.0:1746129582.257965:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f118800/0x40a459093b06bc66 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22428 expref: 15 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129582.258006:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba38a00/0x40a459093b06bc6d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22428 expref: 14 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129582.258014:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009cffe100) 00010000:00010000:3.0:1746129582.258016:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1746129582.258020:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ba38a00, rc 0) 00000100:00100000:3.0:1746129582.258081:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+14:32721:x1830948734452864:12345-192.168.202.4@tcp:101:cat.0 Request processed in 447us (617us total) trans 8589945499 rc 0/0 00000100:00100000:3.0:1746129582.258087:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11370 00000100:00100000:2.0:1746129582.262715:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129582.262778:0:20578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734452992 00000100:00100000:0.0:1746129582.262787:0:20578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734452992 00010000:00010000:0.0:1746129582.262825:0:20578:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5897a00/0x40a459093b06bc2e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2240511) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f223fe expref: 24 pid: 31503 timeout: 937 lvb_type: 0 00000100:00100000:0.0:1746129582.262984:0:20578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8753 00000100:00100000:0.0:1746129582.262993:0:20578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+24:1961:x1830948734452992:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129582.263007:0:20578:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129582.263030:0:20578:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5897a00/0x40a459093b06bc2e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2240511) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f223fe expref: 24 pid: 31503 timeout: 937 lvb_type: 0 00010000:00010000:0.0:1746129582.263042:0:20578:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5897a00/0x40a459093b06bc2e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2240511) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f223fe expref: 24 pid: 31503 timeout: 937 lvb_type: 0 00010000:00010000:0.0:1746129582.263063:0:20578:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5897a00/0x40a459093b06bc2e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2240511) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f223fe expref: 24 pid: 31503 timeout: 937 lvb_type: 0 00010000:00010000:0.0:1746129582.264808:0:20578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129582.264814:0:20578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129582.264827:0:20578:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ec79800/0x40a459093b06bc5f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22421 expref: 29 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129582.264838:0:20578:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ec79800/0x40a459093b06bc5f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22421 expref: 29 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129582.264929:0:20578:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012ec79800/0x40a459093b06bc5f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22421 expref: 29 pid: 22480 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129582.264946:0:20578:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fc2fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:20578:1830948737636864:192.168.202.4@tcp:105: 00000100:00100000:1.0:1746129582.265096:0:20578:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a91c59c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129582.271781:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129582.271828:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129582.271860:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129582.271963:0:8410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734453120 00000100:00100000:1.0:1746129582.271972:0:8410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734453120 00000100:00100000:1.0:1746129582.272014:0:8410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734453248 00000100:00100000:1.0:1746129582.272016:0:8410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734453248 00000100:00100000:1.0:1746129582.272483:0:8410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734453376 00000100:00100000:1.0:1746129582.272486:0:8410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734453376 00000100:00100000:1.0:1746129582.272584:0:8410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16910 00000100:00100000:3.0:1746129582.272594:0:31503:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16911 00000100:00100000:2.0:1746129582.272604:0:8412:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16912 00000100:00100000:2.0:1746129582.272613:0:8412:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+25:1963:x1830948734453376:12345-192.168.202.4@tcp:101:cat.0 00000100:00100000:3.0:1746129582.272617:0:31503:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c29d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+25:1962:x1830948734453248:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129582.272638:0:31503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129582.272643:0:8412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129582.272656:0:31503:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ba38e00/0x40a459093b06bc7b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f22436 expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129582.272656:0:8412:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a058f800/0x40a459093b06bc82 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2243d expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129582.272676:0:31503:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129582.272676:0:8412:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129582.272678:0:31503:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129582.272678:0:8412:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129582.272686:0:31503:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ba38e00/0x40a459093b06bc7b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22436 expref: 27 pid: 31503 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129582.272687:0:8412:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a058f800/0x40a459093b06bc82 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2243d expref: 27 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129582.272700:0:31503:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ba38e00/0x40a459093b06bc7b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22436 expref: 27 pid: 31503 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129582.272700:0:8412:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a058f800/0x40a459093b06bc82 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2243d expref: 27 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129582.272712:0:31503:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ba38e00, rc 0) 00010000:00010000:2.0:1746129582.272712:0:8412:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a058f800, rc 0) 00000100:00100000:1.0:1746129582.272750:0:8410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+23:1962:x1830948734453120:12345-192.168.202.4@tcp:101:cat.0 00000100:00100000:3.0:1746129582.272758:0:31503:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c29d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+27:1962:x1830948734453248:12345-192.168.202.4@tcp:101:cat.0 Request processed in 157us (928us total) trans 0 rc 0/0 00010000:00010000:1.0:1746129582.272761:0:8410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746129582.272766:0:31503:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16911 00010000:00010000:1.0:1746129582.272772:0:8410:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095f11a00/0x40a459093b06bc89 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2242f expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129582.272814:0:8410:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fc2c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8410:1830948737636992:192.168.202.4@tcp:106: 00000100:00100000:2.0:1746129582.272892:0:8412:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+26:1963:x1830948734453376:12345-192.168.202.4@tcp:101:cat.0 Request processed in 282us (1031us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129582.272898:0:8412:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16912 00000100:00100000:1.0:1746129582.272958:0:8410:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a91c5a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746129582.272989:0:20578:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fc2fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:20578:1830948737636864:192.168.202.4@tcp:105: 00010000:00010000:1.0:1746129582.273004:0:20578:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129582.273018:0:20578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+25:1961:x1830948734452992:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 10028us (10315us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129582.273026:0:20578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8753 00000100:00100000:0.0:1746129582.277932:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129582.278075:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734453504 00000100:00100000:3.0:1746129582.278085:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734453504 00000100:00100000:3.0:1746129582.278647:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11371 00000100:00100000:3.0:1746129582.278656:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:068dab75-d300-4ead-a742-d14572ad1e50+6:32724:x1830948734453504:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:3.0:1746129582.278683:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129582.278702:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec78c00/0x40a459093b06bc90 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f22444 expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129582.278786:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f118800/0x40a459093b06bc97 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129582.278800:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f118800/0x40a459093b06bc97 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129582.278811:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f118800/0x40a459093b06bc97 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129582.278823:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f118a00/0x40a459093b06bc9e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129582.278828:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f118a00/0x40a459093b06bc9e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129582.278833:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f118a00/0x40a459093b06bc9e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129582.278959:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094956000/0x40a459093b06bca5 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129582.278967:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094956000/0x40a459093b06bca5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129582.278973:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094956000/0x40a459093b06bca5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00200000:3.0:1746129582.279003:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00000004:00200000:3.0:1746129582.279007:0:14549:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746129582.279020:0:14549:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880094956000/0x40a459093b06bca5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129582.279029:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094956000/0x40a459093b06bca5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129582.279035:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f118800/0x40a459093b06bc97 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129582.279040:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f118800/0x40a459093b06bc97 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129582.279046:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f118800/0x40a459093b06bc97 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129582.279050:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f118800 already unused, calling callback (ffffffffa136e690) 00010000:00010000:3.0:1746129582.279054:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f118800/0x40a459093b06bc97 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129582.279059:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f118800/0x40a459093b06bc97 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129582.279070:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880132ef8f00) 00010000:00010000:3.0:1746129582.279072:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129582.279076:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f118800/0x40a459093b06bc97 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129582.279081:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f118800/0x40a459093b06bc97 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129582.279115:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f118a00/0x40a459093b06bc9e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129582.279120:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f118a00/0x40a459093b06bc9e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129582.279124:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f118a00/0x40a459093b06bc9e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129582.279127:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f118a00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:3.0:1746129582.279130:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f118a00/0x40a459093b06bc9e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129582.279134:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f118a00/0x40a459093b06bc9e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129582.279140:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880090643d00) 00010000:00010000:3.0:1746129582.279142:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129582.279144:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f118a00/0x40a459093b06bc9e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129582.279148:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f118a00/0x40a459093b06bc9e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129582.279172:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec78c00/0x40a459093b06bc90 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22444 expref: 8 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129582.279183:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094956000/0x40a459093b06bca5 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22444 expref: 7 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129582.279189:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009cffe100) 00010000:00010000:3.0:1746129582.279192:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746129582.279194:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094956000, rc 0) 00000100:00100000:3.0:1746129582.279259:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:068dab75-d300-4ead-a742-d14572ad1e50+7:32724:x1830948734453504:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 604us (1338us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129582.279266:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11371 00000100:00080000:2.0:1746129582.280042:0:7097:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746129582.281040:0:8410:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fc2c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8410:1830948737636992:192.168.202.4@tcp:106: 00010000:00010000:0.0:1746129582.281077:0:8410:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095f11a00/0x40a459093b06bc89 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2242f expref: 24 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129582.281096:0:8410:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095f11a00/0x40a459093b06bc89 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2242f expref: 24 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129582.281111:0:8410:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f11a00, rc 0) 00000100:00100000:0.0:1746129582.281152:0:8410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+23:1962:x1830948734453120:12345-192.168.202.4@tcp:101:cat.0 Request processed in 8560us (9380us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129582.281160:0:8410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16910 00000100:00100000:2.0:1746129582.281900:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129582.282048:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734453888 00000100:00100000:0.0:1746129582.282055:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734453888 00000100:00100000:0.0:1746129582.282096:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11372 00000100:00100000:0.0:1746129582.282103:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+14:32723:x1830948734453888:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:0.0:1746129582.282128:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129582.282144:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095045a00/0x40a459093b06bcac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f22452 expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129582.282255:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880095044400/0x40a459093b06bcb3 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746129582.282269:0:14548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800955d3200/0x40a459093b06bb39 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22341 expref: 296 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129582.282277:0:14548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1c0200/0x40a459093b06bbe1 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f223d4 expref: 15 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129582.282283:0:14548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c030600/0x40a459093b06bc0b lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f223e2 expref: 296 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129582.282311:0:14548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094956000/0x40a459093b06bca5 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22444 expref: 6 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129582.282317:0:14548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095044400/0x40a459093b06bcb3 lrc: 7/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746129582.282346:0:14548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094956000/0x40a459093b06bca5 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22444 expref: 6 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129582.282357:0:14548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094956000/0x40a459093b06bca5 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22444 expref: 6 pid: 14549 timeout: 937 lvb_type: 0 00000100:00100000:0.0:1746129582.282369:0:14548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094f45880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14548:1830948737637120:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129582.282427:0:14548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012c030600/0x40a459093b06bc0b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f223e2 expref: 296 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129582.282434:0:14548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c030600/0x40a459093b06bc0b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f223e2 expref: 296 pid: 14548 timeout: 937 lvb_type: 0 00000100:00100000:0.0:1746129582.282440:0:14548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094f45500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14548:1830948737637248:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129582.282462:0:14548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1c0200/0x40a459093b06bbe1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f223d4 expref: 15 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129582.282468:0:14548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1c0200/0x40a459093b06bbe1 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f223d4 expref: 15 pid: 14549 timeout: 937 lvb_type: 0 00000100:00100000:0.0:1746129582.282475:0:14548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094f46300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14548:1830948737637376:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129582.282490:0:14548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800955d3200/0x40a459093b06bb39 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22341 expref: 296 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129582.282496:0:14548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800955d3200/0x40a459093b06bb39 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22341 expref: 296 pid: 14549 timeout: 937 lvb_type: 0 00000100:00100000:0.0:1746129582.282501:0:14548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094f47480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14548:1830948737637504:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129582.282512:0:14548:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa3ef540 going to sleep for 11 seconds 00000100:00100000:2.0:1746129582.282632:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129582.282667:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129582.282691:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129582.282709:0:8412:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734453632 00000100:00100000:2.0:1746129582.282712:0:8412:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734453632 00000100:00100000:2.0:1746129582.282734:0:8412:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734454016 00000100:00100000:2.0:1746129582.282736:0:8412:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734454016 00000100:00100000:2.0:1746129582.282759:0:8412:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734454144 00000100:00100000:2.0:1746129582.282761:0:8412:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734454144 00000100:00100000:2.0:1746129582.282776:0:8412:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16913 00000100:00100000:2.0:1746129582.282781:0:8412:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:068dab75-d300-4ead-a742-d14572ad1e50+9:1963:x1830948734453632:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:2.0:1746129582.282790:0:8412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129582.282802:0:8412:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5897a00/0x40a459093b06bcba lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2244b expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129582.282817:0:8412:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129582.282820:0:8412:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129582.282829:0:8412:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5897a00/0x40a459093b06bcba lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2244b expref: 10 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129582.282842:0:8412:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5897a00/0x40a459093b06bcba lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2244b expref: 10 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129582.282852:0:8412:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5897a00, rc 0) 00000100:00100000:2.0:1746129582.282872:0:8412:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:068dab75-d300-4ead-a742-d14572ad1e50+10:1963:x1830948734453632:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 91us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129582.282877:0:8412:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16913 00000100:00100000:2.0:1746129582.282890:0:8412:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16914 00000100:00100000:2.0:1746129582.282894:0:8412:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:068dab75-d300-4ead-a742-d14572ad1e50+9:1962:x1830948734454016:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:2.0:1746129582.282901:0:8412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129582.282910:0:8412:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a058fc00/0x40a459093b06bcc1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f22459 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129582.282937:0:8412:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900f6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8412:1830948737637632:192.168.202.4@tcp:106: 00000100:00100000:2.0:1746129582.282975:0:8412:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132dade40 going to sleep for 11 seconds 00000100:00100000:1.0:1746129582.283169:0:22480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16915 00000100:00100000:1.0:1746129582.283178:0:22480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:068dab75-d300-4ead-a742-d14572ad1e50+9:1963:x1830948734454144:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:1.0:1746129582.283185:0:22480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129582.283193:0:22480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f11000/0x40a459093b06bcc8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f22460 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129582.283204:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129582.283207:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129582.283222:0:22480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f11000/0x40a459093b06bcc8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22460 expref: 10 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129582.283233:0:22480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095f11000/0x40a459093b06bcc8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22460 expref: 10 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129582.283240:0:22480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f11000, rc 0) 00000100:00100000:1.0:1746129582.283261:0:22480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:068dab75-d300-4ead-a742-d14572ad1e50+10:1963:x1830948734454144:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 85us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129582.283267:0:22480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16915 00000100:00100000:0.0:1746129582.285723:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129582.286373:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129582.286398:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734454272 00000100:00100000:1.0:1746129582.286406:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734454272 00000100:00100000:1.0:1746129582.286451:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734454400 00000100:00100000:1.0:1746129582.286453:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734454400 00000100:00100000:1.0:1746129582.286470:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16916 00000100:00100000:1.0:1746129582.286476:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:068dab75-d300-4ead-a742-d14572ad1e50+10:1962:x1830948734454272:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:1.0:1746129582.286494:0:4385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129582.286510:0:4385:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f118a00/0x40a459093b06bccf lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f22467 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129582.286534:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129582.286536:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129582.286544:0:4385:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f118a00/0x40a459093b06bccf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22467 expref: 11 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129582.286558:0:4385:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f118a00/0x40a459093b06bccf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22467 expref: 11 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129582.286574:0:4385:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f118a00, rc 0) 00000100:00100000:1.0:1746129582.286617:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:068dab75-d300-4ead-a742-d14572ad1e50+11:1962:x1830948734454272:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 140us (906us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129582.286623:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16916 00000100:00100000:1.0:1746129582.286637:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16917 00000100:00100000:1.0:1746129582.286642:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:068dab75-d300-4ead-a742-d14572ad1e50+11:1963:x1830948734454400:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:1.0:1746129582.286649:0:4385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129582.286658:0:4385:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f118800/0x40a459093b06bcd6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2246e expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129582.286669:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129582.286670:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129582.286674:0:4385:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f118800/0x40a459093b06bcd6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2246e expref: 12 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129582.286683:0:4385:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f118800/0x40a459093b06bcd6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2246e expref: 12 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129582.286689:0:4385:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f118800, rc 0) 00000100:00100000:1.0:1746129582.286704:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:068dab75-d300-4ead-a742-d14572ad1e50+12:1963:x1830948734454400:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 62us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129582.286709:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16917 00000100:00100000:0.0:1746129582.288047:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129582.288156:0:14548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094f45880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14548:1830948737637120:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129582.288360:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129582.288404:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129582.288465:0:14548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094f45500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14548:1830948737637248:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129582.288473:0:14548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094f46300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14548:1830948737637376:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129582.288481:0:14548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094f47480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14548:1830948737637504:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129582.288509:0:14548:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880095044400/0x40a459093b06bcb3 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000100:00100000:2.0:1746129582.288532:0:21725:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734454784 00000100:00100000:2.0:1746129582.288539:0:21725:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734454784 00002000:00100000:2.0:1746129582.288586:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->4194303) req@ffff880094f46680 x1830948734454784/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:323/0 lens 488/0 e 0 to 0 dl 1746129593 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129582.288601:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094f46680 with x1830948734454784 ext(3145728->4194303) 00002000:00010000:2.0:1746129582.288606:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094f46680 00000100:00100000:0.0:1746129582.288858:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129582.288896:0:21725:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734454656 00000100:00100000:2.0:1746129582.288899:0:21725:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734454656 00002000:00100000:2.0:1746129582.288913:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ef:0x0] (2097152->3145727) req@ffff880094f45f80 x1830948734454656/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:323/0 lens 488/0 e 0 to 0 dl 1746129593 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129582.288919:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094f45f80 with x1830948734454656 ext(2097152->3145727) 00002000:00010000:2.0:1746129582.288921:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094f45f80 00000100:00100000:0.0:1746129582.289079:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129582.289130:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8212 00000100:00100000:3.0:1746129582.289145:0:8417:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8213 00000100:00100000:3.0:1746129582.289152:0:8417:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ada2ffba-8920-4ecb-8068-68caa9806978+31:1962:x1830948734454656:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:3.0:1746129582.290532:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+32:1962:x1830948734454784:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:1.0:1746129582.291681:0:20578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734455168 00000100:00100000:1.0:1746129582.291691:0:20578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734455168 00010000:00010000:1.0:1746129582.291724:0:20578:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c030600/0x40a459093b06bc0b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f223e2 expref: 297 pid: 14548 timeout: 937 lvb_type: 0 00000100:00100000:1.0:1746129582.291751:0:20578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734455040 00000100:00100000:1.0:1746129582.291754:0:20578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734455040 00010000:00010000:1.0:1746129582.291766:0:20578:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094956000/0x40a459093b06bca5 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22444 expref: 7 pid: 14549 timeout: 937 lvb_type: 0 00000100:00100000:1.0:1746129582.291779:0:20578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734455296 00000100:00100000:1.0:1746129582.291781:0:20578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734455296 00010000:00010000:1.0:1746129582.291793:0:20578:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1c0200/0x40a459093b06bbe1 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f223d4 expref: 16 pid: 14549 timeout: 937 lvb_type: 0 00000100:00100000:1.0:1746129582.291806:0:20578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8754 00000100:00100000:1.0:1746129582.291813:0:20578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a47850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ada2ffba-8920-4ecb-8068-68caa9806978+297:1961:x1830948734455168:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129582.291825:0:20578:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129582.291830:0:20578:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012c030600/0x40a459093b06bc0b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f223e2 expref: 297 pid: 14548 timeout: 937 lvb_type: 0 00010000:00010000:1.0:1746129582.291840:0:20578:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012c030600/0x40a459093b06bc0b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f223e2 expref: 297 pid: 14548 timeout: 937 lvb_type: 0 00010000:00010000:1.0:1746129582.291862:0:20578:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c030600/0x40a459093b06bc0b lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f223e2 expref: 297 pid: 14548 timeout: 937 lvb_type: 0 00010000:00010000:1.0:1746129582.291884:0:20578:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009cffe100) 00010000:00010000:1.0:1746129582.291889:0:20578:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880095044400/0x40a459093b06bcb3 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746129582.291897:0:20578:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880095044400/0x40a459093b06bcb3 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746129582.291905:0:20578:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129582.291943:0:20578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a47850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ada2ffba-8920-4ecb-8068-68caa9806978+296:1961:x1830948734455168:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 130us (3538us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129582.291949:0:20578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8754 00000100:00100000:1.0:1746129582.291996:0:20578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8755 00000100:00100000:1.0:1746129582.292000:0:20578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f44a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:068dab75-d300-4ead-a742-d14572ad1e50+7:1961:x1830948734455040:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129582.292006:0:20578:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129582.292009:0:20578:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094956000/0x40a459093b06bca5 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22444 expref: 7 pid: 14549 timeout: 937 lvb_type: 0 00010000:00010000:1.0:1746129582.292016:0:20578:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094956000/0x40a459093b06bca5 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22444 expref: 7 pid: 14549 timeout: 937 lvb_type: 0 00010000:00010000:1.0:1746129582.292026:0:20578:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094956000/0x40a459093b06bca5 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22444 expref: 7 pid: 14549 timeout: 937 lvb_type: 0 00010000:00010000:1.0:1746129582.292033:0:20578:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009cffe100) 00010000:00010000:1.0:1746129582.292035:0:20578:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880095044400/0x40a459093b06bcb3 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746129582.292040:0:20578:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880095044400/0x40a459093b06bcb3 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746129582.292044:0:20578:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129582.292054:0:20578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f44a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:068dab75-d300-4ead-a742-d14572ad1e50+6:1961:x1830948734455040:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 54us (3197us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129582.292058:0:20578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8755 00000100:00100000:1.0:1746129582.292065:0:20578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8756 00000100:00100000:1.0:1746129582.292068:0:20578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f47480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+16:1961:x1830948734455296:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129582.292073:0:20578:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129582.292075:0:20578:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1c0200/0x40a459093b06bbe1 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f223d4 expref: 16 pid: 14549 timeout: 937 lvb_type: 0 00010000:00010000:1.0:1746129582.292082:0:20578:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1c0200/0x40a459093b06bbe1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f223d4 expref: 16 pid: 14549 timeout: 937 lvb_type: 0 00010000:00010000:1.0:1746129582.292090:0:20578:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1c0200/0x40a459093b06bbe1 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f223d4 expref: 16 pid: 14549 timeout: 937 lvb_type: 0 00010000:00010000:1.0:1746129582.292097:0:20578:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009cffe100) 00010000:00010000:1.0:1746129582.292099:0:20578:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880095044400/0x40a459093b06bcb3 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746129582.292103:0:20578:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880095044400/0x40a459093b06bcb3 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746129582.292107:0:20578:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129582.292114:0:20578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f47480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+15:1961:x1830948734455296:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 46us (3037us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129582.292118:0:20578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8756 00000100:00100000:1.0:1746129582.292231:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129582.292245:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734455424 00000100:00100000:1.0:1746129582.292248:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734455424 00010000:00010000:1.0:1746129582.292259:0:7087:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800955d3200/0x40a459093b06bb39 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22341 expref: 296 pid: 14549 timeout: 937 lvb_type: 0 00000100:00100000:1.0:1746129582.292272:0:7087:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8757 00000100:00100000:1.0:1746129582.292277:0:7087:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc2c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ada2ffba-8920-4ecb-8068-68caa9806978+296:1963:x1830948734455424:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129582.292282:0:7087:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129582.292285:0:7087:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800955d3200/0x40a459093b06bb39 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22341 expref: 296 pid: 14549 timeout: 937 lvb_type: 0 00010000:00010000:1.0:1746129582.292309:0:7087:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800955d3200/0x40a459093b06bb39 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22341 expref: 296 pid: 14549 timeout: 937 lvb_type: 0 00010000:00010000:1.0:1746129582.292319:0:7087:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800955d3200/0x40a459093b06bb39 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22341 expref: 296 pid: 14549 timeout: 937 lvb_type: 0 00010000:00010000:1.0:1746129582.292329:0:7087:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009cffe100) 00010000:00010000:1.0:1746129582.292331:0:7087:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880095044400/0x40a459093b06bcb3 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746129582.292338:0:7087:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095044400/0x40a459093b06bcb3 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746129582.292344:0:7087:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095044400/0x40a459093b06bcb3 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746129582.292364:0:7087:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129582.292376:0:7087:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc2c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ada2ffba-8920-4ecb-8068-68caa9806978+295:1963:x1830948734455424:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 98us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129582.292381:0:7087:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8757 00010000:00010000:1.0:1746129582.292397:0:14548:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880095044400/0x40a459093b06bcb3 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746129582.292403:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095044400/0x40a459093b06bcb3 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000004:00200000:1.0:1746129582.292426:0:14548:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:1.0:1746129582.292563:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095045a00/0x40a459093b06bcac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22452 expref: 16 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129582.292576:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095044400/0x40a459093b06bcb3 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22452 expref: 15 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129582.292583:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009cffe100) 00010000:00010000:1.0:1746129582.292585:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746129582.292588:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095044400, rc 0) 00000100:00100000:1.0:1746129582.292605:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+15:32723:x1830948734453888:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 10504us (10708us total) trans 8589945500 rc 0/0 00000100:00100000:1.0:1746129582.292612:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11372 00000100:00100000:1.0:1746129582.292668:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129582.292945:0:8412:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900f6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8412:1830948737637632:192.168.202.4@tcp:106: 00010000:00010000:2.0:1746129582.292975:0:8412:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a058fc00/0x40a459093b06bcc1 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22459 expref: 11 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129582.292984:0:8412:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a058fc00/0x40a459093b06bcc1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22459 expref: 11 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129582.292995:0:8412:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a058fc00, rc 0) 00000100:00100000:2.0:1746129582.293012:0:8412:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:068dab75-d300-4ead-a742-d14572ad1e50+10:1962:x1830948734454016:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 10118us (10345us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129582.293018:0:8412:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16914 00000100:00100000:2.0:1746129582.293053:0:21725:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734455680 00000100:00100000:2.0:1746129582.293056:0:21725:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734455680 00002000:00100000:2.0:1746129582.293078:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ec:0x0] (0->1048575) req@ffff88009fc2ce00 x1830948734455680/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:323/0 lens 488/0 e 0 to 0 dl 1746129593 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129582.293088:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc2ce00 with x1830948734455680 ext(0->1048575) 00002000:00010000:2.0:1746129582.293093:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fc2ce00 00000100:00100000:2.0:1746129582.293112:0:31521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8214 00000100:00100000:2.0:1746129582.293117:0:31521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+25:1962:x1830948734455680:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129582.303395:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129582.303489:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734455808 00000100:00100000:1.0:1746129582.303500:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734455808 00000100:00100000:1.0:1746129582.303565:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11373 00000100:00100000:1.0:1746129582.303574:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:068dab75-d300-4ead-a742-d14572ad1e50+6:32724:x1830948734455808:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:1.0:1746129582.303597:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129582.303616:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091199800/0x40a459093b06bce4 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f22475 expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129582.303680:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091199800/0x40a459093b06bce4 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22475 expref: 7 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129582.303694:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091199800/0x40a459093b06bce4 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22475 expref: 7 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129582.303716:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009cffe100) 00010000:00010000:1.0:1746129582.303720:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746129582.303723:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091199800, rc 0) 00000100:00100000:1.0:1746129582.303785:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:068dab75-d300-4ead-a742-d14572ad1e50+7:32724:x1830948734455808:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 212us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129582.303791:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11373 00000100:00100000:3.0:1746129582.312817:0:8417:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ada2ffba-8920-4ecb-8068-68caa9806978+32:1962:x1830948734454656:12345-192.168.202.4@tcp:3:cat.0 Request processed in 23654us (24445us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129582.312829:0:8417:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8213 00002000:00100000:3.0:1746129582.312842:0:8417:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3ef:0x0] (2097152->3145727) req@ffff880094f45f80 x1830948734454656/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:323/0 lens 488/440 e 0 to 0 dl 1746129593 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129582.312852:0:8417:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094f45f80 with x1830948734454656 ext(2097152->3145727) 00002000:00010000:3.0:1746129582.312859:0:8417:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094f45f80 00000100:00100000:3.0:1746129582.315489:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129582.316896:0:8412:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734455936 00000100:00100000:2.0:1746129582.316910:0:8412:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734455936 00000100:00100000:2.0:1746129582.316974:0:8412:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16918 00000100:00100000:2.0:1746129582.316982:0:8412:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+23:32723:x1830948734455936:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:2.0:1746129582.317001:0:8412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129582.317019:0:8412:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800919f0800/0x40a459093b06bceb lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2247c expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129582.317051:0:8412:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f119000/0x40a459093b06bc19 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1863680->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f223e9 expref: 31 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129582.317058:0:8412:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129582.317060:0:8412:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129582.317063:0:8412:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800919f0800/0x40a459093b06bceb lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1921024->2056191] (req 1921024->2056191) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2247c expref: 24 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129582.317096:0:8412:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f119000/0x40a459093b06bc19 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1863680->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f223e9 expref: 31 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129582.317107:0:8412:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f119000/0x40a459093b06bc19 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1863680->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f223e9 expref: 31 pid: 31503 timeout: 937 lvb_type: 0 00000100:00100000:2.0:1746129582.317118:0:8412:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900f6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8412:1830948737637760:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129582.317193:0:8412:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132dade40 going to sleep for 11 seconds 00000100:00100000:0.0:1746129582.317462:0:31521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+25:1962:x1830948734455680:12345-192.168.202.4@tcp:3:cat.0 Request processed in 24343us (24792us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129582.317471:0:31521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8214 00002000:00100000:0.0:1746129582.317481:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3ec:0x0] (0->1048575) req@ffff88009fc2ce00 x1830948734455680/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:323/0 lens 488/440 e 0 to 0 dl 1746129593 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129582.317489:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc2ce00 with x1830948734455680 ext(0->1048575) 00002000:00010000:0.0:1746129582.317494:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fc2ce00 00000100:00100000:3.0:1746129582.319154:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+30:1962:x1830948734454784:12345-192.168.202.4@tcp:3:cat.0 Request processed in 30008us (31105us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129582.319163:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8212 00002000:00100000:3.0:1746129582.319171:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->4194303) req@ffff880094f46680 x1830948734454784/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:323/0 lens 488/440 e 0 to 0 dl 1746129593 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129582.319179:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094f46680 with x1830948734454784 ext(3145728->4194303) 00002000:00010000:3.0:1746129582.319184:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094f46680 00000100:00100000:3.0:1746129582.319570:0:8412:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900f6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8412:1830948737637760:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129582.319605:0:8412:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800919f0800/0x40a459093b06bceb lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1921024->2056191] (req 1921024->2056191) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2247c expref: 24 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129582.319621:0:8412:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800919f0800, rc 0) 00000100:00100000:3.0:1746129582.319644:0:8412:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+24:32723:x1830948734455936:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 2664us (4171us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129582.319651:0:8412:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16918 00000100:00100000:0.0:1746129582.320260:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129582.320374:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734456192 00000100:00100000:2.0:1746129582.320382:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734456192 00000100:00100000:2.0:1746129582.320438:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11374 00000100:00100000:2.0:1746129582.320445:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:068dab75-d300-4ead-a742-d14572ad1e50+7:32724:x1830948734456192:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:2.0:1746129582.320462:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129582.320478:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919f1000/0x40a459093b06bcf2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f22483 expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129582.320586:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919f1200/0x40a459093b06bcf9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129582.320600:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919f1200/0x40a459093b06bcf9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129582.320611:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919f1200/0x40a459093b06bcf9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129582.320624:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919f1400/0x40a459093b06bd00 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129582.320629:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919f1400/0x40a459093b06bd00 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129582.320634:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919f1400/0x40a459093b06bd00 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129582.320740:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919f1600/0x40a459093b06bd07 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129582.320748:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919f1600/0x40a459093b06bd07 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129582.320753:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919f1600/0x40a459093b06bd07 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00200000:2.0:1746129582.320766:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:2.0:1746129582.320853:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919f1200/0x40a459093b06bcf9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129582.320860:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919f1200/0x40a459093b06bcf9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129582.320865:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919f1200/0x40a459093b06bcf9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129582.320871:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800919f1200 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746129582.320874:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919f1200/0x40a459093b06bcf9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129582.320880:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919f1200/0x40a459093b06bcf9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129582.320891:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880132ef8f00) 00010000:00010000:2.0:1746129582.320894:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129582.320897:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919f1200/0x40a459093b06bcf9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129582.320902:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919f1200/0x40a459093b06bcf9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129582.320915:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919f1400/0x40a459093b06bd00 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129582.320921:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919f1400/0x40a459093b06bd00 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129582.320925:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919f1400/0x40a459093b06bd00 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129582.320933:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800919f1400 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746129582.320935:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919f1400/0x40a459093b06bd00 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129582.320940:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919f1400/0x40a459093b06bd00 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129582.320944:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f250000) 00010000:00010000:2.0:1746129582.320946:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129582.320947:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919f1400/0x40a459093b06bd00 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129582.320951:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919f1400/0x40a459093b06bd00 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129582.320982:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919f1000/0x40a459093b06bcf2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22483 expref: 10 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129582.320991:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919f1600/0x40a459093b06bd07 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22483 expref: 9 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129582.320996:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009cffe100) 00010000:00010000:2.0:1746129582.320998:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746129582.321000:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800919f1600, rc 0) 00000100:00100000:2.0:1746129582.321039:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:068dab75-d300-4ead-a742-d14572ad1e50+9:32724:x1830948734456192:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 594us (781us total) trans 8589945501 rc 0/0 00000100:00100000:2.0:1746129582.321044:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11374 00000100:00100000:0.0:1746129582.322904:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129582.323092:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734456320 00000100:00100000:3.0:1746129582.323100:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734456320 00002000:00100000:3.0:1746129582.323139:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f4:0x0] (1863680->2097151) req@ffff880094f45880 x1830948734456320/t0(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:323/0 lens 488/0 e 0 to 0 dl 1746129593 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129582.323148:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094f45880 with x1830948734456320 ext(1863680->2097151) 00010000:00010000:3.0:1746129582.323157:0:25745:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f119000/0x40a459093b06bc19 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1863680->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f223e9 expref: 32 pid: 31503 timeout: 937 lvb_type: 0 00010000:00010000:3.0:1746129582.323171:0:25745:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f119000/0x40a459093b06bc19 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1863680->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f223e9 expref: 32 pid: 31503 timeout: 937 lvb_type: 0 00002000:00010000:3.0:1746129582.323178:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094f45880 00000100:00100000:3.0:1746129582.323196:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2541 00000100:00100000:3.0:1746129582.323203:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+32:1960:x1830948734456320:12345-192.168.202.4@tcp:4:cat.0 00000100:00100000:1.0:1746129582.332426:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+34:1960:x1830948734456320:12345-192.168.202.4@tcp:4:cat.0 Request processed in 9209us (9515us total) trans 17179874211 rc 0/0 00000100:00100000:1.0:1746129582.332442:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2541 00002000:00100000:1.0:1746129582.332456:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f4:0x0] (1863680->2097151) req@ffff880094f45880 x1830948734456320/t17179874211(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:323/0 lens 488/448 e 0 to 0 dl 1746129593 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129582.332466:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094f45880 with x1830948734456320 ext(1863680->2097151) 00010000:00010000:1.0:1746129582.332477:0:25745:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f119000/0x40a459093b06bc19 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1863680->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f223e9 expref: 34 pid: 31503 timeout: 937 lvb_type: 0 00010000:00010000:1.0:1746129582.332495:0:25745:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f119000/0x40a459093b06bc19 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1863680->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f223e9 expref: 34 pid: 31503 timeout: 937 lvb_type: 0 00002000:00010000:1.0:1746129582.332502:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094f45880 00000100:00100000:0.0:1746129582.336761:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129582.336797:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129582.336813:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129582.336837:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129582.336864:0:31503:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734456448 00000100:00100000:0.0:1746129582.336872:0:31503:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734456448 00000100:00100000:0.0:1746129582.336907:0:31503:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734456576 00000100:00100000:0.0:1746129582.336908:0:31503:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734456576 00000100:00100000:0.0:1746129582.336918:0:31503:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734456704 00000100:00100000:0.0:1746129582.336920:0:31503:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734456704 00000100:00100000:0.0:1746129582.336932:0:31503:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16919 00000100:00100000:0.0:1746129582.336939:0:31503:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c07aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ada2ffba-8920-4ecb-8068-68caa9806978+34:1960:x1830948734456448:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129582.336958:0:31503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129582.336975:0:31503:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fab5200/0x40a459093b06bd15 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2248a expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129582.337024:0:31503:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c07b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:31503:1830948737637888:192.168.202.4@tcp:106: 00000100:00100000:0.0:1746129582.337092:0:31503:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa3ef000 going to sleep for 11 seconds 00000100:00100000:2.0:1746129582.337221:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734456960 00000100:00100000:2.0:1746129582.337224:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734456960 00000100:00100000:2.0:1746129582.337252:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11375 00000100:00100000:2.0:1746129582.337256:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ada2ffba-8920-4ecb-8068-68caa9806978+295:32726:x1830948734456960:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:2.0:1746129582.337272:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129582.337282:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919f1800/0x40a459093b06bd1c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2249f expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129582.337430:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919f1a00/0x40a459093b06bd23 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129582.337442:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919f1a00/0x40a459093b06bd23 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129582.337452:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919f1a00/0x40a459093b06bd23 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129582.337465:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919f1c00/0x40a459093b06bd2a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129582.337470:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919f1c00/0x40a459093b06bd2a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129582.337475:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919f1c00/0x40a459093b06bd2a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129582.337596:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919f1e00/0x40a459093b06bd31 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129582.337603:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919f1e00/0x40a459093b06bd31 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129582.337608:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919f1e00/0x40a459093b06bd31 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00200000:2.0:1746129582.337617:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:2.0:1746129582.337697:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919f1a00/0x40a459093b06bd23 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129582.337707:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919f1a00/0x40a459093b06bd23 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129582.337712:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919f1a00/0x40a459093b06bd23 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129582.337717:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800919f1a00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746129582.337720:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919f1a00/0x40a459093b06bd23 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129582.337725:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919f1a00/0x40a459093b06bd23 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129582.337734:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880132ef8f00) 00010000:00010000:2.0:1746129582.337737:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129582.337740:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919f1a00/0x40a459093b06bd23 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129582.337744:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919f1a00/0x40a459093b06bd23 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129582.337758:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919f1c00/0x40a459093b06bd2a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129582.337762:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919f1c00/0x40a459093b06bd2a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129582.337767:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919f1c00/0x40a459093b06bd2a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129582.337770:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800919f1c00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746129582.337772:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919f1c00/0x40a459093b06bd2a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129582.337777:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919f1c00/0x40a459093b06bd2a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129582.337782:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f250500) 00010000:00010000:2.0:1746129582.337784:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129582.337786:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919f1c00/0x40a459093b06bd2a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129582.337790:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919f1c00/0x40a459093b06bd2a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746129582.337821:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919f1800/0x40a459093b06bd1c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2249f expref: 298 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129582.337832:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919f1e00/0x40a459093b06bd31 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2249f expref: 297 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129582.337838:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009cffe100) 00010000:00010000:2.0:1746129582.337839:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746129582.337841:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800919f1e00, rc 0) 00000100:00100000:2.0:1746129582.337867:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ada2ffba-8920-4ecb-8068-68caa9806978+297:32726:x1830948734456960:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 611us (1117us total) trans 8589945502 rc 0/0 00000100:00100000:2.0:1746129582.337873:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11375 00000100:00100000:2.0:1746129582.337922:0:11014:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16920 00000100:00100000:2.0:1746129582.337927:0:11014:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c078e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:068dab75-d300-4ead-a742-d14572ad1e50+10:1963:x1830948734456576:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:2.0:1746129582.337932:0:11014:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129582.337938:0:11014:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800919f0e00/0x40a459093b06bd3f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f22491 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129582.337963:0:11014:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900f5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11014:1830948737638016:192.168.202.4@tcp:106: 00000100:00100000:2.0:1746129582.337995:0:11014:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132dad840 going to sleep for 11 seconds 00000100:00100000:2.0:1746129582.338009:0:8410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16921 00000100:00100000:2.0:1746129582.338012:0:8410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c07b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+24:32721:x1830948734456704:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129582.338018:0:8410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129582.338022:0:8410:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800919f1200/0x40a459093b06bd46 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f22498 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129582.338033:0:8410:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129582.338037:0:8410:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800919f0800/0x40a459093b06bceb lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [1921024->2056191] (req 1921024->2056191) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2247c expref: 25 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129582.338042:0:8410:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746129582.338045:0:8410:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800919f1200/0x40a459093b06bd46 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22498 expref: 25 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129582.338070:0:8410:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800919f0800/0x40a459093b06bceb lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [1921024->2056191] (req 1921024->2056191) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2247c expref: 25 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129582.338078:0:8410:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800919f1200/0x40a459093b06bd46 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22498 expref: 25 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129582.338086:0:8410:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800919f1200, rc 0) 00000100:00100000:2.0:1746129582.338098:0:8410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c07b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+25:32721:x1830948734456704:12345-192.168.202.4@tcp:101:cat.0 Request processed in 86us (1261us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129582.338106:0:8410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16921 00000100:00100000:0.0:1746129582.338807:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129582.338864:0:15749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734457088 00000100:00100000:1.0:1746129582.338869:0:15749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734457088 00010000:00010000:1.0:1746129582.338886:0:15749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f119000/0x40a459093b06bc19 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1863680->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f223e9 expref: 36 pid: 31503 timeout: 937 lvb_type: 0 00000100:00100000:1.0:1746129582.338911:0:15749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8758 00000100:00100000:1.0:1746129582.338916:0:15749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7d9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ada2ffba-8920-4ecb-8068-68caa9806978+36:1961:x1830948734457088:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129582.338925:0:15749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129582.338941:0:15749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f119000/0x40a459093b06bc19 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1863680->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f223e9 expref: 36 pid: 31503 timeout: 937 lvb_type: 0 00010000:00010000:1.0:1746129582.338950:0:15749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f119000/0x40a459093b06bc19 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1863680->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f223e9 expref: 36 pid: 31503 timeout: 937 lvb_type: 0 00010000:00010000:1.0:1746129582.338962:0:15749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129582.338963:0:15749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129582.338968:0:15749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800919f0800/0x40a459093b06bceb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1921024->2056191) gid 0 flags: 0x60080000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2247c expref: 24 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129582.338974:0:15749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800919f0800/0x40a459093b06bceb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1921024->2056191) gid 0 flags: 0x60080000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2247c expref: 24 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129582.338993:0:15749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800919f0800/0x40a459093b06bceb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1921024->2056191) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2247c expref: 24 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129582.339001:0:15749:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800919f0800/0x40a459093b06bceb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1921024->2056191) gid 0 flags: 0x70000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2247c expref: 24 pid: 8412 timeout: 937 lvb_type: 0 00000100:00100000:1.0:1746129582.339009:0:15749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fc2c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15749:1830948737638272:192.168.202.4@tcp:105: 00000100:00100000:1.0:1746129582.339046:0:15749:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a91c5540 going to sleep for 11 seconds 00010000:00010000:2.0:1746129582.340151:0:31503:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.202.4@tcp) returned -22 from glimpse AST (req@ffff88009c07b480 x1830948737637888) - normal race ns: filter-lustre-OST0001_UUID lock: ffff88009f119000/0x40a459093b06bc19 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1863680->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f223e9 expref: 36 pid: 31503 timeout: 937 lvb_type: 0 00000100:00100000:2.0:1746129582.340175:0:31503:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c07b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:31503:1830948737637888:192.168.202.4@tcp:106: 00010000:00010000:2.0:1746129582.340202:0:31503:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fab5200/0x40a459093b06bd15 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 7 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2248a expref: 36 pid: 31503 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129582.340225:0:31503:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fab5200/0x40a459093b06bd15 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 7 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2248a expref: 36 pid: 31503 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129582.340235:0:31503:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fab5200, rc 0) 00000100:00100000:2.0:1746129582.340268:0:31503:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c07aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ada2ffba-8920-4ecb-8068-68caa9806978+35:1960:x1830948734456448:12345-192.168.202.4@tcp:101:cat.0 Request processed in 3328us (3468us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129582.340275:0:31503:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16919 00010000:00010000:3.0:1746129582.340386:0:11014:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.202.4@tcp) returned -22 from glimpse AST (req@ffff8800900f5880 x1830948737638016) - normal race ns: filter-lustre-OST0001_UUID lock: ffff88009f119000/0x40a459093b06bc19 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1863680->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f223e9 expref: 34 pid: 31503 timeout: 937 lvb_type: 0 00010000:00010000:3.0:1746129582.340408:0:11014:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f119000/0x40a459093b06bc19 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1863680->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f223e9 expref: 34 pid: 31503 timeout: 937 lvb_type: 0 00000100:00100000:3.0:1746129582.340425:0:11014:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900f5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11014:1830948737638016:192.168.202.4@tcp:106: 00010000:00010000:3.0:1746129582.340443:0:11014:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800919f0e00/0x40a459093b06bd3f lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22491 expref: 11 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129582.340451:0:11014:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800919f0e00/0x40a459093b06bd3f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22491 expref: 11 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129582.340457:0:11014:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800919f0e00, rc 0) 00000100:00100000:3.0:1746129582.340476:0:11014:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c078e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:068dab75-d300-4ead-a742-d14572ad1e50+10:1963:x1830948734456576:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 2550us (3662us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129582.340481:0:11014:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16920 00000100:00100000:0.0:1746129582.340873:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129582.341928:0:11014:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734457216 00000100:00100000:3.0:1746129582.341938:0:11014:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734457216 00000100:00100000:3.0:1746129582.341987:0:11014:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16922 00000100:00100000:3.0:1746129582.341994:0:11014:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ada2ffba-8920-4ecb-8068-68caa9806978+34:32726:x1830948734457216:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:3.0:1746129582.342011:0:11014:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129582.342026:0:11014:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094956e00/0x40a459093b06bd4d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f224a6 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129582.342049:0:11014:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129582.342054:0:11014:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800919f1200/0x40a459093b06bd46 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22498 expref: 24 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129582.342061:0:11014:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746129582.342064:0:11014:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094956e00/0x40a459093b06bd4d lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [2043904->2097151] (req 2043904->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f224a6 expref: 35 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129582.342095:0:11014:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800919f1200/0x40a459093b06bd46 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22498 expref: 24 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129582.342108:0:11014:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094956e00/0x40a459093b06bd4d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [2043904->2097151] (req 2043904->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f224a6 expref: 35 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129582.342116:0:11014:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094956e00, rc 0) 00000100:00100000:3.0:1746129582.342158:0:11014:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ada2ffba-8920-4ecb-8068-68caa9806978+35:32726:x1830948734457216:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 164us (1285us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129582.342164:0:11014:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16922 00000100:00100000:1.0:1746129582.342290:0:15749:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fc2c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15749:1830948737638272:192.168.202.4@tcp:105: 00010000:00010000:1.0:1746129582.342323:0:15749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129582.342345:0:15749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7d9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ada2ffba-8920-4ecb-8068-68caa9806978+34:1961:x1830948734457088:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 3428us (3539us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129582.342353:0:15749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8758 00000100:00100000:0.0:1746129582.343273:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129582.343368:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734457472 00000100:00100000:2.0:1746129582.343375:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734457472 00000100:00100000:2.0:1746129582.343406:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11376 00000100:00100000:2.0:1746129582.343412:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:068dab75-d300-4ead-a742-d14572ad1e50+9:32724:x1830948734457472:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:2.0:1746129582.343432:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129582.343446:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919f0a00/0x40a459093b06bd54 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f224ad expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129582.343536:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919f0c00/0x40a459093b06bd5b lrc: 3/0,1 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746129582.343552:0:14548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095044400/0x40a459093b06bcb3 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22452 expref: 14 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129582.343558:0:14548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919f0c00/0x40a459093b06bd5b lrc: 4/0,1 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746129582.343578:0:14548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880095044400/0x40a459093b06bcb3 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22452 expref: 14 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129582.343586:0:14548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880095044400/0x40a459093b06bcb3 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22452 expref: 14 pid: 14548 timeout: 937 lvb_type: 0 00000100:00100000:2.0:1746129582.343598:0:14548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900f6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14548:1830948737638528:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129582.343818:0:14548:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132dad900 going to sleep for 11 seconds 00000100:00100000:0.0:1746129582.345478:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129582.345549:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734457856 00000100:00100000:1.0:1746129582.345556:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734457856 00002000:00100000:1.0:1746129582.345596:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ef:0x0] (4194304->5148671) req@ffff88009f37f100 x1830948734457856/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:323/0 lens 488/0 e 0 to 0 dl 1746129593 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129582.345607:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f37f100 with x1830948734457856 ext(4194304->5148671) 00002000:00010000:1.0:1746129582.345611:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f37f100 00000100:00100000:1.0:1746129582.345640:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8215 00000100:00100000:1.0:1746129582.345647:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f37f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+30:1961:x1830948734457856:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129582.346195:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129582.346243:0:31521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734457984 00000100:00100000:2.0:1746129582.346247:0:31521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734457984 00002000:00100000:2.0:1746129582.346267:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f4:0x0] (2052096->2056191) req@ffff88009f325180 x1830948734457984/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:323/0 lens 488/0 e 0 to 0 dl 1746129593 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129582.346274:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f325180 with x1830948734457984 ext(2052096->2056191) 00010000:00010000:2.0:1746129582.346280:0:31521:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800919f0800/0x40a459093b06bceb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1921024->2056191) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2247c expref: 25 pid: 8412 timeout: 937 lvb_type: 0 00010000:00010000:2.0:1746129582.346314:0:31521:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800919f0800/0x40a459093b06bceb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1921024->2056191) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2247c expref: 25 pid: 8412 timeout: 937 lvb_type: 0 00002000:00010000:2.0:1746129582.346321:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f325180 00000100:00100000:2.0:1746129582.346918:0:31521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2542 00000100:00100000:2.0:1746129582.346927:0:31521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f325180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+25:1963:x1830948734457984:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:2.0:1746129582.347037:0:31521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f325180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+25:1963:x1830948734457984:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 111us (842us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129582.347043:0:31521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2542 00002000:00100000:2.0:1746129582.347049:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f4:0x0] (2052096->2056191) req@ffff88009f325180 x1830948734457984/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:323/0 lens 488/4536 e 0 to 0 dl 1746129593 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129582.347056:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f325180 with x1830948734457984 ext(2052096->2056191) 00010000:00010000:2.0:1746129582.347061:0:31521:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800919f0800/0x40a459093b06bceb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1921024->2056191) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2247c expref: 25 pid: 8412 timeout: 937 lvb_type: 0 00010000:00010000:2.0:1746129582.347069:0:31521:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800919f0800/0x40a459093b06bceb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1921024->2056191) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2247c expref: 25 pid: 8412 timeout: 937 lvb_type: 0 00002000:00010000:2.0:1746129582.347074:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f325180 00000100:00100000:0.0:1746129582.352985:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129582.353151:0:15749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734458112 00000100:00100000:1.0:1746129582.353160:0:15749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734458112 00010000:00010000:1.0:1746129582.353201:0:15749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095044400/0x40a459093b06bcb3 lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22452 expref: 15 pid: 14548 timeout: 937 lvb_type: 0 00000100:00100000:2.0:1746129582.353555:0:14548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900f6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14548:1830948737638528:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129582.353584:0:14548:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800919f0c00/0x40a459093b06bd5b lrc: 3/0,1 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000100:00100000:1.0:1746129582.353677:0:15749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8759 00000100:00100000:1.0:1746129582.353686:0:15749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f327b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+15:1963:x1830948734458112:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129582.353699:0:15749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129582.353706:0:15749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880095044400/0x40a459093b06bcb3 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22452 expref: 15 pid: 14548 timeout: 937 lvb_type: 0 00010000:00010000:1.0:1746129582.353716:0:15749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880095044400/0x40a459093b06bcb3 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22452 expref: 15 pid: 14548 timeout: 937 lvb_type: 0 00010000:00010000:1.0:1746129582.353739:0:15749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095044400/0x40a459093b06bcb3 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22452 expref: 15 pid: 14548 timeout: 937 lvb_type: 0 00010000:00010000:1.0:1746129582.353762:0:15749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009cffe100) 00010000:00010000:1.0:1746129582.353767:0:15749:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800919f0c00/0x40a459093b06bd5b lrc: 3/0,1 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746129582.353777:0:15749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919f0c00/0x40a459093b06bd5b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746129582.353783:0:15749:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919f0c00/0x40a459093b06bd5b lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746129582.353800:0:15749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129582.353843:0:15749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f327b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+14:1963:x1830948734458112:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 158us (867us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129582.353849:0:15749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8759 00010000:00010000:2.0:1746129582.354087:0:14548:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800919f0c00/0x40a459093b06bd5b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746129582.354094:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919f0c00/0x40a459093b06bd5b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746129582.354112:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919f0c00/0x40a459093b06bd5b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746129582.354117:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919f0c00/0x40a459093b06bd5b lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746129582.354123:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919f0c00/0x40a459093b06bd5b lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746129582.354128:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800919f0c00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746129582.354131:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919f0c00/0x40a459093b06bd5b lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746129582.354137:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919f0c00/0x40a459093b06bd5b lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746129582.354144:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009cffe100) 00010000:00010000:2.0:1746129582.354147:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746129582.354150:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919f0c00/0x40a459093b06bd5b lrc: 2/0,0 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746129582.354154:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919f0c00/0x40a459093b06bd5b lrc: 0/0,0 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746129582.354196:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919f0a00/0x40a459093b06bd54 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f224ad expref: 10 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129582.354204:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919f0a00/0x40a459093b06bd54 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f224ad expref: 10 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129582.354223:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800919f0a00, rc 0) 00000100:00100000:1.0:1746129582.354957:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f37f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+30:1961:x1830948734457856:12345-192.168.202.4@tcp:3:cat.0 Request processed in 9305us (9482us total) trans 0 rc 954368/954368 00000100:00100000:1.0:1746129582.354966:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8215 00002000:00100000:1.0:1746129582.354975:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ef:0x0] (4194304->5148671) req@ffff88009f37f100 x1830948734457856/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:323/0 lens 488/440 e 0 to 0 dl 1746129593 ref 1 fl Complete:/200/0 rc 954368/954368 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129582.354984:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f37f100 with x1830948734457856 ext(4194304->5148671) 00002000:00010000:1.0:1746129582.354989:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f37f100 00000100:00100000:2.0:1746129582.355114:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:068dab75-d300-4ead-a742-d14572ad1e50+9:32724:x1830948734457472:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 11701us (11843us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129582.355122:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11376 00000100:00100000:0.0:1746129582.355472:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129582.356128:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129582.356154:0:14551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734458496 00000100:00100000:3.0:1746129582.356163:0:14551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734458496 00000100:00100000:3.0:1746129582.356210:0:14551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4854 00000100:00100000:3.0:1746129582.356228:0:14551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934ca450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+14:32723:x1830948734458496:12345-192.168.202.4@tcp:35:multiop.0 00000100:00100000:3.0:1746129582.356506:0:14551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934ca450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+15:32723:x1830948734458496:12345-192.168.202.4@tcp:35:multiop.0 Request processed in 278us (1034us total) trans 8589945503 rc 0/0 00000100:00100000:3.0:1746129582.356513:0:14551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4854 00000100:00100000:1.0:1746129582.357984:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734458624 00000100:00100000:1.0:1746129582.357995:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734458624 00002000:00100000:1.0:1746129582.358033:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f4:0x0] (1921024->2056191) req@ffff8800912aed80 x1830948734458624/t0(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:323/0 lens 488/0 e 0 to 0 dl 1746129593 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129582.358042:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800912aed80 with x1830948734458624 ext(1921024->2056191) 00010000:00010000:1.0:1746129582.358052:0:25745:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800919f0800/0x40a459093b06bceb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1921024->2056191) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2247c expref: 25 pid: 8412 timeout: 937 lvb_type: 0 00010000:00010000:1.0:1746129582.358067:0:25745:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800919f0800/0x40a459093b06bceb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1921024->2056191) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2247c expref: 25 pid: 8412 timeout: 937 lvb_type: 0 00002000:00010000:1.0:1746129582.358074:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800912aed80 00000100:00100000:1.0:1746129582.358106:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2543 00000100:00100000:1.0:1746129582.358113:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800912aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+25:1963:x1830948734458624:12345-192.168.202.4@tcp:4:multiop.0 00000100:00100000:0.0:1746129582.362370:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129582.362429:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129582.362824:0:31503:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734458880 00000100:00100000:2.0:1746129582.362834:0:31503:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734458880 00000100:00100000:2.0:1746129582.362882:0:31503:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16923 00000100:00100000:2.0:1746129582.362889:0:31503:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800912afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ada2ffba-8920-4ecb-8068-68caa9806978+34:1961:x1830948734458880:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129582.362909:0:31503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129582.362925:0:31503:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800919f0600/0x40a459093b06bd62 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f224b4 expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129582.362984:0:31503:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900f6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:31503:1830948737638656:192.168.202.4@tcp:106: 00000100:00100000:2.0:1746129582.363062:0:31503:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132dad900 going to sleep for 11 seconds 00000100:00100000:3.0:1746129582.363196:0:14551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734459008 00000100:00100000:3.0:1746129582.363201:0:14551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734459008 00000100:00100000:3.0:1746129582.363235:0:14551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4855 00000100:00100000:3.0:1746129582.363242:0:14551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800912ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:068dab75-d300-4ead-a742-d14572ad1e50+9:32724:x1830948734459008:12345-192.168.202.4@tcp:35:lfs.0 00000100:00100000:3.0:1746129582.363456:0:14551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800912ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:068dab75-d300-4ead-a742-d14572ad1e50+10:32724:x1830948734459008:12345-192.168.202.4@tcp:35:lfs.0 Request processed in 214us (1098us total) trans 8589945504 rc 0/0 00000100:00100000:3.0:1746129582.363462:0:14551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4855 00000100:00100000:1.0:1746129582.368618:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800912aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+27:1963:x1830948734458624:12345-192.168.202.4@tcp:4:multiop.0 Request processed in 10489us (12476us total) trans 17179874212 rc 0/0 00000100:00100000:1.0:1746129582.368631:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2543 00002000:00100000:1.0:1746129582.368645:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f4:0x0] (1921024->2056191) req@ffff8800912aed80 x1830948734458624/t17179874212(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:323/0 lens 488/448 e 0 to 0 dl 1746129593 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129582.368655:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800912aed80 with x1830948734458624 ext(1921024->2056191) 00010000:00010000:1.0:1746129582.368666:0:25745:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800919f0800/0x40a459093b06bceb lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1921024->2056191) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2247c expref: 27 pid: 8412 timeout: 937 lvb_type: 0 00010000:00010000:1.0:1746129582.368681:0:25745:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800919f0800/0x40a459093b06bceb lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1921024->2056191) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2247c expref: 27 pid: 8412 timeout: 937 lvb_type: 0 00002000:00010000:1.0:1746129582.368689:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800912aed80 00002000:00010000:3.0:1746129582.369574:0:31503:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb mtime: 1746129582 -> 1746129583 00002000:00010000:3.0:1746129582.369580:0:31503:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb atime: 1746129582 -> 1746129583 00002000:00010000:3.0:1746129582.369582:0:31503:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb ctime: 1746129582 -> 1746129583 00000100:00100000:3.0:1746129582.369611:0:31503:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900f6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:31503:1830948737638656:192.168.202.4@tcp:106: 00010000:00010000:3.0:1746129582.369652:0:31503:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800919f0600/0x40a459093b06bd62 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f224b4 expref: 35 pid: 31503 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129582.369665:0:31503:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800919f0600/0x40a459093b06bd62 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f224b4 expref: 35 pid: 31503 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129582.369676:0:31503:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800919f0600, rc 0) 00000100:00100000:3.0:1746129582.369740:0:31503:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800912afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ada2ffba-8920-4ecb-8068-68caa9806978+34:1961:x1830948734458880:12345-192.168.202.4@tcp:101:cat.0 Request processed in 6851us (7310us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129582.369748:0:31503:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16923 00000100:00100000:0.0:1746129582.371872:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129582.371939:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734459136 00000100:00100000:3.0:1746129582.371947:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734459136 00010000:00010000:3.0:1746129582.371980:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800919f0800/0x40a459093b06bceb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1921024->2056191) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2247c expref: 27 pid: 8412 timeout: 937 lvb_type: 0 00000100:00100000:3.0:1746129582.372012:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8760 00000100:00100000:3.0:1746129582.372019:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800912ac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+27:1960:x1830948734459136:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129582.372035:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129582.372057:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800919f0800/0x40a459093b06bceb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1921024->2056191) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2247c expref: 27 pid: 8412 timeout: 937 lvb_type: 0 00010000:00010000:3.0:1746129582.372069:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800919f0800/0x40a459093b06bceb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1921024->2056191) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2247c expref: 27 pid: 8412 timeout: 937 lvb_type: 0 00010000:00010000:3.0:1746129582.372092:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800919f0800/0x40a459093b06bceb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1921024->2056191) gid 0 flags: 0x44801000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2247c expref: 27 pid: 8412 timeout: 937 lvb_type: 0 00010000:00010000:3.0:1746129582.372106:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129582.372108:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129582.372115:0:7085:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800919f1200/0x40a459093b06bd46 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60080000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22498 expref: 26 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129582.372123:0:7085:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800919f1200/0x40a459093b06bd46 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60080000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22498 expref: 26 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129582.372156:0:7085:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800919f1200/0x40a459093b06bd46 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22498 expref: 26 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129582.372167:0:7085:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800919f1200/0x40a459093b06bd46 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22498 expref: 26 pid: 8410 timeout: 937 lvb_type: 0 00000100:00100000:3.0:1746129582.372179:0:7085:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bd180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7085:1830948737638784:192.168.202.4@tcp:105: 00000100:00100000:3.0:1746129582.372282:0:7085:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5c683c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129582.375286:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129582.375423:0:31503:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734459392 00000100:00100000:3.0:1746129582.375431:0:31503:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734459392 00000100:00100000:3.0:1746129582.375479:0:31503:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16924 00000100:00100000:3.0:1746129582.375487:0:31503:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800912af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ada2ffba-8920-4ecb-8068-68caa9806978+34:1960:x1830948734459392:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129582.375506:0:31503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129582.375527:0:31503:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094957c00/0x40a459093b06bd69 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f224bb expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129582.375550:0:31503:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129582.375559:0:31503:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094957c00/0x40a459093b06bd69 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f224bb expref: 35 pid: 31503 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129582.375571:0:31503:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094957c00/0x40a459093b06bd69 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f224bb expref: 35 pid: 31503 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129582.375581:0:31503:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094957c00, rc 0) 00000100:00100000:3.0:1746129582.375623:0:31503:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800912af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ada2ffba-8920-4ecb-8068-68caa9806978+34:1960:x1830948734459392:12345-192.168.202.4@tcp:101:cat.0 Request processed in 137us (351us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129582.375630:0:31503:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16924 00000100:00100000:0.0:1746129582.380097:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129582.380221:0:7085:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bd180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7085:1830948737638784:192.168.202.4@tcp:105: 00010000:00010000:3.0:1746129582.380245:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129582.380319:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800912ac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+26:1960:x1830948734459136:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 8298us (8455us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129582.380330:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8760 00000100:00100000:1.0:1746129582.380424:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734459776 00000100:00100000:1.0:1746129582.380432:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734459776 00000100:00100000:0.0:1746129582.380837:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00002000:00100000:1.0:1746129582.381472:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ee:0x0] (1048576->2097151) req@ffff8800912ac700 x1830948734459776/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:323/0 lens 488/0 e 0 to 0 dl 1746129593 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129582.381488:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800912ac700 with x1830948734459776 ext(1048576->2097151) 00002000:00010000:1.0:1746129582.381493:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800912ac700 00000100:00100000:1.0:1746129582.382235:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734459904 00000100:00100000:1.0:1746129582.382243:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734459904 00002000:00100000:1.0:1746129582.382273:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f4:0x0] (1048576->2097151) req@ffff8800912ace00 x1830948734459904/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:323/0 lens 488/0 e 0 to 0 dl 1746129593 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129582.382281:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800912ace00 with x1830948734459904 ext(1048576->2097151) 00010000:00010000:1.0:1746129582.382289:0:25745:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800919f1200/0x40a459093b06bd46 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22498 expref: 26 pid: 8410 timeout: 937 lvb_type: 0 00010000:00010000:1.0:1746129582.382328:0:25745:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800919f1200/0x40a459093b06bd46 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22498 expref: 26 pid: 8410 timeout: 937 lvb_type: 0 00002000:00010000:1.0:1746129582.382335:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800912ace00 00000100:00100000:1.0:1746129582.382350:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2544 00000100:00100000:1.0:1746129582.382356:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800912ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+26:1962:x1830948734459904:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:2.0:1746129582.383504:0:31521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8216 00000100:00100000:2.0:1746129582.383517:0:31521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800912ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+25:1962:x1830948734459776:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:1.0:1746129582.401932:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800912ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+26:1962:x1830948734459904:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 19563us (21081us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129582.401944:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2544 00002000:00100000:1.0:1746129582.401957:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f4:0x0] (1048576->2097151) req@ffff8800912ace00 x1830948734459904/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:323/0 lens 488/440 e 0 to 0 dl 1746129593 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129582.401967:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800912ace00 with x1830948734459904 ext(1048576->2097151) 00010000:00010000:1.0:1746129582.401978:0:25745:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800919f1200/0x40a459093b06bd46 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22498 expref: 26 pid: 8410 timeout: 937 lvb_type: 0 00000100:00100000:2.0:1746129582.401979:0:31521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800912ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+25:1962:x1830948734459776:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 18463us (21892us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129582.401987:0:31521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8216 00002000:00100000:2.0:1746129582.401993:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3ee:0x0] (1048576->2097151) req@ffff8800912ac700 x1830948734459776/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:323/0 lens 488/440 e 0 to 0 dl 1746129593 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00010000:00010000:1.0:1746129582.401994:0:25745:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800919f1200/0x40a459093b06bd46 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22498 expref: 26 pid: 8410 timeout: 937 lvb_type: 0 00002000:00100000:2.0:1746129582.402001:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800912ac700 with x1830948734459776 ext(1048576->2097151) 00002000:00010000:1.0:1746129582.402001:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800912ace00 00002000:00010000:2.0:1746129582.402005:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800912ac700 00000100:00100000:2.0:1746129582.410998:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129582.411075:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734460032 00000100:00100000:3.0:1746129582.411086:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734460032 00010000:00010000:3.0:1746129582.411129:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800919f1200/0x40a459093b06bd46 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22498 expref: 26 pid: 8410 timeout: 937 lvb_type: 0 00000100:00100000:3.0:1746129582.411178:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8761 00000100:00100000:3.0:1746129582.411187:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a47450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+26:1960:x1830948734460032:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129582.411202:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129582.411237:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800919f1200/0x40a459093b06bd46 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22498 expref: 26 pid: 8410 timeout: 937 lvb_type: 0 00010000:00010000:3.0:1746129582.411250:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800919f1200/0x40a459093b06bd46 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22498 expref: 26 pid: 8410 timeout: 937 lvb_type: 0 00010000:00010000:3.0:1746129582.411273:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800919f1200/0x40a459093b06bd46 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22498 expref: 26 pid: 8410 timeout: 937 lvb_type: 0 00010000:00010000:3.0:1746129582.411337:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129582.411339:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129582.411347:0:7085:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094956e00/0x40a459093b06bd4d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2043904->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f224a6 expref: 33 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129582.411356:0:7085:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094956e00/0x40a459093b06bd4d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2043904->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f224a6 expref: 33 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129582.411392:0:7085:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880094956e00/0x40a459093b06bd4d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2043904->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f224a6 expref: 33 pid: 11014 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129582.411405:0:7085:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947bd180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7085:1830948737638912:192.168.202.4@tcp:105: 00000100:00100000:3.0:1746129582.411490:0:7085:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5c683c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129582.412507:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129582.412542:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129582.412600:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734460416 00000100:00100000:1.0:1746129582.412607:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734460416 00002000:00100000:1.0:1746129582.412643:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->4194303) req@ffff88012e956a00 x1830948734460416/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:323/0 lens 488/0 e 0 to 0 dl 1746129593 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129582.412653:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e956a00 with x1830948734460416 ext(3145728->4194303) 00002000:00010000:1.0:1746129582.412657:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e956a00 00000100:00100000:1.0:1746129582.412678:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734460288 00000100:00100000:1.0:1746129582.412680:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734460288 00002000:00100000:1.0:1746129582.412692:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ef:0x0] (2097152->3145727) req@ffff88012e957480 x1830948734460288/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:323/0 lens 488/0 e 0 to 0 dl 1746129593 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129582.412698:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e957480 with x1830948734460288 ext(2097152->3145727) 00002000:00010000:1.0:1746129582.412701:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e957480 00000100:00100000:1.0:1746129582.412718:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8217 00000100:00100000:1.0:1746129582.412725:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e956a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+26:1963:x1830948734460416:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:2.0:1746129582.412791:0:31521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8218 00000100:00100000:2.0:1746129582.412798:0:31521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e957480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+26:1962:x1830948734460288:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129582.414205:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129582.414243:0:21725:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734460800 00000100:00100000:0.0:1746129582.414247:0:21725:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734460800 00000100:00100000:3.0:1746129582.414268:0:7085:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947bd180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7085:1830948737638912:192.168.202.4@tcp:105: 00002000:00100000:0.0:1746129582.414268:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f4:0x0] (2043904->2047999) req@ffff88012e956d80 x1830948734460800/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:323/0 lens 488/0 e 0 to 0 dl 1746129593 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129582.414275:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e956d80 with x1830948734460800 ext(2043904->2047999) 00002000:00010000:0.0:1746129582.414279:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e956d80 00010000:00010000:3.0:1746129582.414291:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129582.414291:0:21725:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8219 00000100:00100000:0.0:1746129582.414315:0:21725:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e956d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ada2ffba-8920-4ecb-8068-68caa9806978+34:1962:x1830948734460800:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:3.0:1746129582.414363:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a47450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+25:1960:x1830948734460032:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 3176us (3371us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129582.414373:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8761 00000100:00100000:0.0:1746129582.416361:0:21725:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e956d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ada2ffba-8920-4ecb-8068-68caa9806978+34:1962:x1830948734460800:12345-192.168.202.4@tcp:3:cat.0 Request processed in 2040us (2153us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746129582.416373:0:21725:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8219 00002000:00100000:0.0:1746129582.416379:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f4:0x0] (2043904->2047999) req@ffff88012e956d80 x1830948734460800/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:323/0 lens 488/4536 e 0 to 0 dl 1746129593 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129582.416388:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e956d80 with x1830948734460800 ext(2043904->2047999) 00002000:00010000:0.0:1746129582.416392:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e956d80 00000100:00100000:0.0:1746129582.421846:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129582.422175:0:11014:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734460928 00000100:00100000:1.0:1746129582.422182:0:11014:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734460928 00000100:00100000:1.0:1746129582.422231:0:11014:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16925 00000100:00100000:1.0:1746129582.422238:0:11014:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e955180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ada2ffba-8920-4ecb-8068-68caa9806978+30:32726:x1830948734460928:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:1.0:1746129582.422253:0:11014:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129582.422266:0:11014:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f85bc00/0x40a459093b06bd70 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f224c2 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129582.422288:0:11014:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ec79c00/0x40a459093b06bc58 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2241a expref: 31 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129582.422319:0:11014:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095f11000/0x40a459093b06bcc8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22460 expref: 10 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129582.422325:0:11014:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ba38e00/0x40a459093b06bc7b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22436 expref: 28 pid: 31503 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129582.422330:0:11014:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129582.422331:0:11014:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129582.422334:0:11014:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f85bc00/0x40a459093b06bd70 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [1048576->1097727] (req 1048576->1097727) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f224c2 expref: 31 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129582.422359:0:11014:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012ba38e00/0x40a459093b06bc7b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22436 expref: 28 pid: 31503 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129582.422370:0:11014:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012ba38e00/0x40a459093b06bc7b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22436 expref: 28 pid: 31503 timeout: 937 lvb_type: 1 00000100:00100000:1.0:1746129582.422491:0:11014:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fc2c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11014:1830948737639040:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129582.423960:0:11014:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095f11000/0x40a459093b06bcc8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22460 expref: 10 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129582.423971:0:11014:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095f11000/0x40a459093b06bcc8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22460 expref: 10 pid: 22480 timeout: 937 lvb_type: 1 00000100:00100000:1.0:1746129582.423980:0:11014:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fc2c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11014:1830948737639168:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129582.424013:0:11014:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012ec79c00/0x40a459093b06bc58 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2241a expref: 31 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129582.424020:0:11014:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012ec79c00/0x40a459093b06bc58 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2241a expref: 31 pid: 22480 timeout: 937 lvb_type: 0 00000100:00100000:1.0:1746129582.424027:0:11014:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129bc0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11014:1830948737639296:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129582.424042:0:11014:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a91c5540 going to sleep for 11 seconds 00000100:00100000:1.0:1746129582.428250:0:11014:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fc2c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11014:1830948737639040:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129582.428261:0:11014:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fc2c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11014:1830948737639168:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129582.428268:0:11014:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129bc0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11014:1830948737639296:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129582.428305:0:11014:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f85bc00/0x40a459093b06bd70 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [1048576->1097727] (req 1048576->1097727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f224c2 expref: 31 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129582.428322:0:11014:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f85bc00, rc 0) 00000100:00100000:1.0:1746129582.428360:0:11014:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e955180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ada2ffba-8920-4ecb-8068-68caa9806978+31:32726:x1830948734460928:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 6122us (6522us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129582.428367:0:11014:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16925 00000100:00100000:2.0:1746129582.431617:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e956a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+27:1963:x1830948734460416:12345-192.168.202.4@tcp:3:cat.0 Request processed in 18885us (19105us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129582.431628:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8217 00002000:00100000:2.0:1746129582.431638:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->4194303) req@ffff88012e956a00 x1830948734460416/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:323/0 lens 488/440 e 0 to 0 dl 1746129593 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129582.431647:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e956a00 with x1830948734460416 ext(3145728->4194303) 00002000:00010000:2.0:1746129582.431652:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e956a00 00000100:00100000:3.0:1746129582.431791:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129582.431830:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129582.431846:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129582.431886:0:7086:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734461184 00000100:00100000:3.0:1746129582.431893:0:7086:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734461184 00010000:00010000:3.0:1746129582.431916:0:7086:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012ba38e00/0x40a459093b06bc7b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22436 expref: 27 pid: 31503 timeout: 937 lvb_type: 1 00000100:00100000:3.0:1746129582.431933:0:7086:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734461056 00000100:00100000:3.0:1746129582.431935:0:7086:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734461056 00010000:00010000:3.0:1746129582.431944:0:7086:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095f11000/0x40a459093b06bcc8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22460 expref: 11 pid: 22480 timeout: 937 lvb_type: 1 00000100:00100000:3.0:1746129582.431955:0:7086:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734461312 00000100:00100000:3.0:1746129582.431956:0:7086:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734461312 00010000:00010000:3.0:1746129582.431964:0:7086:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012ec79c00/0x40a459093b06bc58 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2241a expref: 31 pid: 22480 timeout: 937 lvb_type: 0 00000100:00100000:3.0:1746129582.431978:0:7086:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8762 00000100:00100000:3.0:1746129582.431983:0:7086:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947bd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+27:1962:x1830948734461184:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129582.431994:0:7086:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129582.432009:0:7086:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012ba38e00/0x40a459093b06bc7b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22436 expref: 27 pid: 31503 timeout: 937 lvb_type: 1 00010000:00010000:3.0:1746129582.432016:0:7086:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012ba38e00/0x40a459093b06bc7b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22436 expref: 27 pid: 31503 timeout: 937 lvb_type: 1 00010000:00010000:3.0:1746129582.432034:0:7086:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ba38e00/0x40a459093b06bc7b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22436 expref: 27 pid: 31503 timeout: 937 lvb_type: 1 00010000:00010000:3.0:1746129582.432047:0:7086:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129582.432063:0:7086:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947bd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+26:1962:x1830948734461184:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 80us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129582.432068:0:7086:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8762 00000100:00100000:3.0:1746129582.432077:0:7086:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8763 00000100:00100000:3.0:1746129582.432081:0:7086:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947bd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:068dab75-d300-4ead-a742-d14572ad1e50+11:1962:x1830948734461056:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129582.432088:0:7086:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129582.432094:0:7086:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095f11000/0x40a459093b06bcc8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22460 expref: 11 pid: 22480 timeout: 937 lvb_type: 1 00000100:00100000:0.0:1746129582.432282:0:20578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8764 00000100:00100000:0.0:1746129582.432289:0:20578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f44a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ada2ffba-8920-4ecb-8068-68caa9806978+31:1963:x1830948734461312:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129582.432309:0:20578:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129582.432863:0:7086:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095f11000/0x40a459093b06bcc8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22460 expref: 11 pid: 22480 timeout: 937 lvb_type: 1 00010000:00010000:0.0:1746129582.432938:0:20578:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012ec79c00/0x40a459093b06bc58 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2241a expref: 31 pid: 22480 timeout: 937 lvb_type: 0 00010000:00010000:0.0:1746129582.432947:0:20578:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012ec79c00/0x40a459093b06bc58 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2241a expref: 31 pid: 22480 timeout: 937 lvb_type: 0 00010000:00010000:0.0:1746129582.432958:0:20578:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ec79c00/0x40a459093b06bc58 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2241a expref: 31 pid: 22480 timeout: 937 lvb_type: 0 00010000:00010000:3.0:1746129582.433048:0:7086:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f11000/0x40a459093b06bcc8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22460 expref: 11 pid: 22480 timeout: 937 lvb_type: 1 00010000:00010000:3.0:1746129582.433057:0:7086:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129582.433058:0:7086:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129582.433064:0:7086:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f85bc00/0x40a459093b06bd70 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1097727) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f224c2 expref: 30 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129582.433070:0:7086:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f85bc00/0x40a459093b06bd70 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1097727) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f224c2 expref: 30 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129582.433097:0:7086:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f85bc00/0x40a459093b06bd70 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1097727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f224c2 expref: 30 pid: 11014 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129582.433107:0:7086:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094f47480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7086:1830948737639424:192.168.202.4@tcp:105: 00000100:00100000:3.0:1746129582.433619:0:7086:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b5354cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746129582.433914:0:31521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e957480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+24:1962:x1830948734460288:12345-192.168.202.4@tcp:3:cat.0 Request processed in 21115us (21369us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129582.433922:0:31521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8218 00002000:00100000:3.0:1746129582.433929:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3ef:0x0] (2097152->3145727) req@ffff88012e957480 x1830948734460288/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:323/0 lens 488/440 e 0 to 0 dl 1746129593 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129582.433937:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e957480 with x1830948734460288 ext(2097152->3145727) 00002000:00010000:3.0:1746129582.433940:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e957480 00010000:00010000:0.0:1746129582.434080:0:20578:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129582.434146:0:20578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f44a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ada2ffba-8920-4ecb-8068-68caa9806978+30:1963:x1830948734461312:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 1857us (2298us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129582.434152:0:20578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8764 00000100:00100000:3.0:1746129582.435649:0:7086:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094f47480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7086:1830948737639424:192.168.202.4@tcp:105: 00010000:00010000:3.0:1746129582.435661:0:7086:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129582.436283:0:7086:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947bd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:068dab75-d300-4ead-a742-d14572ad1e50+10:1962:x1830948734461056:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 4198us (4450us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129582.436291:0:7086:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8763 00000100:00100000:0.0:1746129582.437079:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129582.437129:0:31521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734461568 00000100:00100000:3.0:1746129582.437134:0:31521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734461568 00002000:00100000:3.0:1746129582.437159:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3ee:0x0] (1093632->1097727) req@ffff88012e955f80 x1830948734461568/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:323/0 lens 488/0 e 0 to 0 dl 1746129593 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129582.437168:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e955f80 with x1830948734461568 ext(1093632->1097727) 00002000:00010000:3.0:1746129582.437172:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e955f80 00000100:00100000:3.0:1746129582.437501:0:31521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8220 00000100:00100000:3.0:1746129582.437508:0:31521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e955f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ada2ffba-8920-4ecb-8068-68caa9806978+30:1963:x1830948734461568:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:3.0:1746129582.437638:0:31521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e955f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ada2ffba-8920-4ecb-8068-68caa9806978+30:1963:x1830948734461568:12345-192.168.202.4@tcp:3:cat.0 Request processed in 129us (559us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129582.437643:0:31521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8220 00002000:00100000:3.0:1746129582.437647:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3ee:0x0] (1093632->1097727) req@ffff88012e955f80 x1830948734461568/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:323/0 lens 488/4536 e 0 to 0 dl 1746129593 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129582.437653:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e955f80 with x1830948734461568 ext(1093632->1097727) 00002000:00010000:3.0:1746129582.437656:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e955f80 00000100:00100000:0.0:1746129582.442945:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129582.444127:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734461824 00000100:00100000:3.0:1746129582.444136:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734461824 00000100:00100000:3.0:1746129582.444172:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4856 00000100:00100000:3.0:1746129582.444178:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e955500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ada2ffba-8920-4ecb-8068-68caa9806978+297:32726:x1830948734461824:12345-192.168.202.4@tcp:35:multiop.0 00000100:00100000:3.0:1746129582.445451:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e955500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ada2ffba-8920-4ecb-8068-68caa9806978+298:32726:x1830948734461824:12345-192.168.202.4@tcp:35:multiop.0 Request processed in 1267us (2508us total) trans 8589945505 rc 0/0 00000100:00100000:3.0:1746129582.445460:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4856 00000100:00100000:0.0:1746129582.451965:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129582.452009:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129582.452131:0:11014:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734461952 00000100:00100000:1.0:1746129582.452144:0:11014:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734461952 00000100:00100000:1.0:1746129582.452220:0:11014:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734462080 00000100:00100000:1.0:1746129582.452222:0:11014:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734462080 00000100:00100000:3.0:1746129582.452857:0:31503:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16926 00000100:00100000:3.0:1746129582.452869:0:31503:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e954e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+25:1963:x1830948734461952:12345-192.168.202.4@tcp:101:cat.0 00000100:00100000:2.0:1746129582.452884:0:22480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16927 00010000:00010000:3.0:1746129582.452886:0:31503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746129582.452894:0:22480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e957800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+24:1963:x1830948734462080:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129582.452899:0:31503:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094957800/0x40a459093b06bd77 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f224c9 expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129582.452907:0:22480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129582.452921:0:22480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008dcd6a00/0x40a459093b06bd7e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f224d0 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129582.452940:0:31503:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094f47480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:31503:1830948737639552:192.168.202.4@tcp:106: 00000100:00100000:2.0:1746129582.452962:0:22480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900f6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22480:1830948737639680:192.168.202.4@tcp:106: 00000100:00100000:3.0:1746129582.452997:0:31503:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009518b600 going to sleep for 11 seconds 00000100:00100000:2.0:1746129582.453009:0:22480:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132dad000 going to sleep for 11 seconds 00000100:00100000:3.0:1746129582.456072:0:31503:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094f47480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:31503:1830948737639552:192.168.202.4@tcp:106: 00010000:00010000:3.0:1746129582.456101:0:31503:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094957800/0x40a459093b06bd77 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f224c9 expref: 26 pid: 31503 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129582.456113:0:31503:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094957800/0x40a459093b06bd77 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f224c9 expref: 26 pid: 31503 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129582.456141:0:31503:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094957800, rc 0) 00000100:00100000:3.0:1746129582.456177:0:31503:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e954e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+25:1963:x1830948734461952:12345-192.168.202.4@tcp:101:cat.0 Request processed in 3311us (4219us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129582.456184:0:31503:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16926 00002000:00010000:3.0:1746129582.456591:0:22480:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb mtime: 1746129582 -> 1746129583 00002000:00010000:3.0:1746129582.456594:0:22480:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb atime: 1746129582 -> 1746129583 00002000:00010000:3.0:1746129582.456596:0:22480:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb ctime: 1746129582 -> 1746129583 00000100:00100000:3.0:1746129582.456606:0:22480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900f6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22480:1830948737639680:192.168.202.4@tcp:106: 00010000:00010000:3.0:1746129582.456622:0:22480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008dcd6a00/0x40a459093b06bd7e lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f224d0 expref: 25 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129582.456630:0:22480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008dcd6a00/0x40a459093b06bd7e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f224d0 expref: 25 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129582.456635:0:22480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008dcd6a00, rc 0) 00000100:00100000:3.0:1746129582.456836:0:22480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e957800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+24:1963:x1830948734462080:12345-192.168.202.4@tcp:101:cat.0 Request processed in 3944us (4826us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129582.456841:0:22480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16927 00000100:00100000:1.0:1746129582.460470:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129582.461219:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734462336 00000100:00100000:2.0:1746129582.461227:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734462336 00002000:00100000:2.0:1746129582.461264:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ef:0x0] (4194304->5148671) req@ffff880129bc0a80 x1830948734462336/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:323/0 lens 488/0 e 0 to 0 dl 1746129593 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129582.461273:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129bc0a80 with x1830948734462336 ext(4194304->5148671) 00002000:00010000:2.0:1746129582.461278:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880129bc0a80 00000100:00100000:2.0:1746129582.461327:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8221 00000100:00100000:2.0:1746129582.461334:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129bc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+24:1960:x1830948734462336:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:2.0:1746129582.470908:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129bc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+24:1960:x1830948734462336:12345-192.168.202.4@tcp:3:cat.0 Request processed in 9567us (10437us total) trans 0 rc 954368/954368 00000100:00100000:2.0:1746129582.470917:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8221 00002000:00100000:2.0:1746129582.470926:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ef:0x0] (4194304->5148671) req@ffff880129bc0a80 x1830948734462336/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:323/0 lens 488/440 e 0 to 0 dl 1746129593 ref 1 fl Complete:/200/0 rc 954368/954368 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129582.470940:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129bc0a80 with x1830948734462336 ext(4194304->5148671) 00002000:00010000:2.0:1746129582.470945:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880129bc0a80 00000100:00100000:0.0:1746129582.479060:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129582.480203:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129582.480355:0:22480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734462592 00000100:00100000:3.0:1746129582.480367:0:22480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734462592 00000100:00100000:3.0:1746129582.480419:0:22480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734462464 00000100:00100000:3.0:1746129582.480421:0:22480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734462464 00000100:00100000:3.0:1746129582.480447:0:22480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16928 00000100:00100000:3.0:1746129582.480455:0:22480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e956680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+24:1961:x1830948734462592:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129582.480479:0:22480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129582.480498:0:22480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094956600/0x40a459093b06bd85 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f224de expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129582.480567:0:22480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094f47480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22480:1830948737639808:192.168.202.4@tcp:106: 00000100:00100000:3.0:1746129582.480651:0:22480:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009518b600 going to sleep for 11 seconds 00000100:00100000:0.0:1746129582.480816:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16929 00000100:00100000:0.0:1746129582.480823:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e956300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+25:1961:x1830948734462464:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129582.480831:0:4385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129582.480841:0:4385:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fab4600/0x40a459093b06bd8c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f224d7 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129582.480866:0:4385:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e954a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:4385:1830948737639936:192.168.202.4@tcp:106: 00000100:00100000:0.0:1746129582.480892:0:4385:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa3ef000 going to sleep for 11 seconds 00000100:00100000:3.0:1746129582.483756:0:22480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094f47480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22480:1830948737639808:192.168.202.4@tcp:106: 00010000:00010000:3.0:1746129582.483787:0:22480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094956600/0x40a459093b06bd85 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f224de expref: 25 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129582.483800:0:22480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094956600/0x40a459093b06bd85 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f224de expref: 25 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129582.483825:0:22480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094956600, rc 0) 00000100:00100000:3.0:1746129582.483888:0:22480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e956680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+24:1961:x1830948734462592:12345-192.168.202.4@tcp:101:cat.0 Request processed in 3433us (4836us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129582.483898:0:22480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16928 00000100:00100000:1.0:1746129582.484367:0:4385:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e954a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:4385:1830948737639936:192.168.202.4@tcp:106: 00010000:00010000:1.0:1746129582.484388:0:4385:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fab4600/0x40a459093b06bd8c lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f224d7 expref: 26 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129582.484398:0:4385:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fab4600/0x40a459093b06bd8c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f224d7 expref: 26 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129582.484411:0:4385:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fab4600, rc 0) 00000100:00100000:1.0:1746129582.484434:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e956300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+25:1961:x1830948734462464:12345-192.168.202.4@tcp:101:cat.0 Request processed in 3612us (4236us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129582.484440:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16929 00000100:00100000:0.0:1746129582.493773:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129582.493875:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129582.493988:0:22480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734462720 00000100:00100000:3.0:1746129582.493998:0:22480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734462720 00000100:00100000:3.0:1746129582.494036:0:22480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734462848 00000100:00100000:3.0:1746129582.494037:0:22480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734462848 00000100:00100000:3.0:1746129582.494053:0:22480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16930 00000100:00100000:3.0:1746129582.494060:0:22480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e954700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+25:1963:x1830948734462720:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129582.494080:0:22480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129582.494098:0:22480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094956800/0x40a459093b06bd93 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f224e5 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129582.494153:0:22480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094f47480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22480:1830948737640064:192.168.202.4@tcp:106: 00000100:00100000:3.0:1746129582.494239:0:22480:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009518b600 going to sleep for 11 seconds 00000100:00100000:3.0:1746129582.494268:0:31503:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16931 00000100:00100000:3.0:1746129582.494274:0:31503:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e955c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+24:1963:x1830948734462848:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129582.494281:0:31503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129582.494307:0:31503:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094956c00/0x40a459093b06bd9a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f224ec expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129582.494335:0:31503:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094064a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:31503:1830948737640192:192.168.202.4@tcp:106: 00000100:00100000:3.0:1746129582.494367:0:31503:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009518b780 going to sleep for 11 seconds 00000100:00100000:2.0:1746129582.496366:0:31503:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094064a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:31503:1830948737640192:192.168.202.4@tcp:106: 00010000:00010000:2.0:1746129582.496399:0:31503:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094956c00/0x40a459093b06bd9a lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f224ec expref: 25 pid: 31503 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129582.496411:0:31503:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094956c00/0x40a459093b06bd9a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f224ec expref: 25 pid: 31503 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129582.496436:0:31503:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094956c00, rc 0) 00000100:00100000:2.0:1746129582.496475:0:31503:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e955c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+24:1963:x1830948734462848:12345-192.168.202.4@tcp:101:cat.0 Request processed in 2200us (2598us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129582.496483:0:31503:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16931 00000100:00100000:3.0:1746129582.496575:0:22480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094f47480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22480:1830948737640064:192.168.202.4@tcp:106: 00010000:00010000:3.0:1746129582.496592:0:22480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094956800/0x40a459093b06bd93 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f224e5 expref: 26 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129582.496600:0:22480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094956800/0x40a459093b06bd93 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f224e5 expref: 26 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129582.496620:0:22480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094956800, rc 0) 00000100:00100000:3.0:1746129582.496641:0:22480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e954700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+25:1963:x1830948734462720:12345-192.168.202.4@tcp:101:cat.0 Request processed in 2582us (2881us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129582.496646:0:22480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16930 00010000:00010000:3.0:1746129582.506535:0:26224:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746129582.517738:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129582.517954:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734463104 00000100:00100000:2.0:1746129582.517965:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734463104 00000100:00100000:2.0:1746129582.518015:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11377 00000100:00100000:2.0:1746129582.518023:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e957b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ada2ffba-8920-4ecb-8068-68caa9806978+298:32734:x1830948734463104:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129582.518054:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129582.518074:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008dcd7200/0x40a459093b06bda1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f224f3 expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129582.518178:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008dcd7400/0x40a459093b06bda8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746129582.518190:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008dcd7400/0x40a459093b06bda8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746129582.518203:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008dcd7400/0x40a459093b06bda8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746129582.518225:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008dcd7600/0x40a459093b06bdaf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746129582.518230:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008dcd7600/0x40a459093b06bdaf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746129582.518235:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008dcd7600/0x40a459093b06bdaf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746129582.518361:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008dcd7800/0x40a459093b06bdb6 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746129582.518368:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008dcd7800/0x40a459093b06bdb6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746129582.518373:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008dcd7800/0x40a459093b06bdb6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000004:00200000:2.0:1746129582.518381:0:14548:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:2.0:1746129582.518456:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008dcd7400/0x40a459093b06bda8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746129582.518462:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008dcd7400/0x40a459093b06bda8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746129582.518468:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008dcd7400/0x40a459093b06bda8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746129582.518474:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008dcd7400 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746129582.518478:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008dcd7400/0x40a459093b06bda8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746129582.518485:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008dcd7400/0x40a459093b06bda8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746129582.518495:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880132ef8f00) 00010000:00010000:2.0:1746129582.518498:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129582.518502:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008dcd7400/0x40a459093b06bda8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746129582.518506:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008dcd7400/0x40a459093b06bda8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746129582.518538:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008dcd7600/0x40a459093b06bdaf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746129582.518543:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008dcd7600/0x40a459093b06bdaf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746129582.518547:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008dcd7600/0x40a459093b06bdaf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746129582.518551:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008dcd7600 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746129582.518552:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008dcd7600/0x40a459093b06bdaf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746129582.518556:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008dcd7600/0x40a459093b06bdaf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746129582.518564:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009d198e00) 00010000:00010000:2.0:1746129582.518566:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129582.518568:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008dcd7600/0x40a459093b06bdaf lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746129582.518571:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008dcd7600/0x40a459093b06bdaf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746129582.518608:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008dcd7200/0x40a459093b06bda1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f224f3 expref: 301 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129582.518618:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008dcd7800/0x40a459093b06bdb6 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f224f3 expref: 300 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129582.518624:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009cffe100) 00010000:00010000:2.0:1746129582.518626:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746129582.518628:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008dcd7800, rc 0) 00000100:00100000:2.0:1746129582.518682:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e957b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ada2ffba-8920-4ecb-8068-68caa9806978+300:32734:x1830948734463104:12345-192.168.202.4@tcp:101:cat.0 Request processed in 659us (955us total) trans 8589945506 rc 0/0 00000100:00100000:2.0:1746129582.522604:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11377 00000100:00100000:0.0:1746129582.524006:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129582.524149:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734463360 00000100:00100000:3.0:1746129582.524158:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734463360 00000100:00100000:3.0:1746129582.524206:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4857 00000100:00100000:3.0:1746129582.524222:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e954000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ada2ffba-8920-4ecb-8068-68caa9806978+300:32734:x1830948734463360:12345-192.168.202.4@tcp:35:cat.0 00000100:00100000:3.0:1746129582.524786:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e954000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ada2ffba-8920-4ecb-8068-68caa9806978+301:32734:x1830948734463360:12345-192.168.202.4@tcp:35:cat.0 Request processed in 571us (783us total) trans 8589945507 rc 0/0 00000100:00100000:3.0:1746129582.524793:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4857 00000100:00100000:0.0:1746129582.536867:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129582.537704:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129582.538944:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734463616 00000100:00100000:2.0:1746129582.538958:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734463616 00002000:00100000:2.0:1746129582.539009:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f4:0x0] (1048576->2043903) req@ffff88012e954a80 x1830948734463616/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:323/0 lens 488/0 e 0 to 0 dl 1746129593 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129582.539019:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e954a80 with x1830948734463616 ext(1048576->2043903) 00002000:00010000:2.0:1746129582.539024:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e954a80 00000100:00100000:2.0:1746129582.539042:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734463872 00000100:00100000:2.0:1746129582.539045:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734463872 00002000:00100000:2.0:1746129582.539057:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ee:0x0] (1097728->2097151) req@ffff88009016b100 x1830948734463872/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:323/0 lens 488/0 e 0 to 0 dl 1746129593 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129582.539063:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009016b100 with x1830948734463872 ext(1097728->2097151) 00002000:00010000:2.0:1746129582.539066:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009016b100 00000100:00100000:3.0:1746129582.539070:0:31521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8222 00000100:00100000:3.0:1746129582.539081:0:31521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e954a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ada2ffba-8920-4ecb-8068-68caa9806978+34:1962:x1830948734463616:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:2.0:1746129582.539082:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8223 00000100:00100000:2.0:1746129582.539086:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009016b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+30:1963:x1830948734463872:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:2.0:1746129582.550462:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009016b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+30:1963:x1830948734463872:12345-192.168.202.4@tcp:3:cat.0 Request processed in 11360us (12746us total) trans 0 rc 999424/999424 00000100:00100000:2.0:1746129582.550477:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8223 00002000:00100000:2.0:1746129582.550539:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ee:0x0] (1097728->2097151) req@ffff88009016b100 x1830948734463872/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:323/0 lens 488/440 e 0 to 0 dl 1746129593 ref 1 fl Complete:/200/0 rc 999424/999424 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129582.550550:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009016b100 with x1830948734463872 ext(1097728->2097151) 00002000:00010000:2.0:1746129582.550556:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009016b100 00000100:00100000:3.0:1746129582.555132:0:31521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e954a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ada2ffba-8920-4ecb-8068-68caa9806978+34:1962:x1830948734463616:12345-192.168.202.4@tcp:3:cat.0 Request processed in 16041us (18262us total) trans 0 rc 995328/995328 00000100:00100000:3.0:1746129582.555145:0:31521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8222 00002000:00100000:3.0:1746129582.555157:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f4:0x0] (1048576->2043903) req@ffff88012e954a80 x1830948734463616/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:323/0 lens 488/440 e 0 to 0 dl 1746129593 ref 1 fl Complete:/200/0 rc 995328/995328 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129582.555167:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e954a80 with x1830948734463616 ext(1048576->2043903) 00002000:00010000:3.0:1746129582.555173:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e954a80 00000100:00100000:0.0:1746129582.580793:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129582.582275:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734464128 00000100:00100000:2.0:1746129582.582289:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734464128 00000100:00100000:2.0:1746129582.582362:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11378 00000100:00100000:2.0:1746129582.582370:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090169f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+15:32737:x1830948734464128:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:2.0:1746129582.582396:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129582.582414:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0c4800/0x40a459093b06bdc4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f224fa expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129582.582527:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0c4a00/0x40a459093b06bdcb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746129582.582540:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0c4a00/0x40a459093b06bdcb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746129582.582551:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0c4a00/0x40a459093b06bdcb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746129582.582564:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0c4c00/0x40a459093b06bdd2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746129582.582569:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0c4c00/0x40a459093b06bdd2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746129582.582578:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0c4c00/0x40a459093b06bdd2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746129582.582688:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0c4e00/0x40a459093b06bdd9 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746129582.582698:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0c4e00/0x40a459093b06bdd9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746129582.582703:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0c4e00/0x40a459093b06bdd9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000004:00200000:2.0:1746129582.582712:0:14548:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:2.0:1746129582.582798:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0c4a00/0x40a459093b06bdcb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746129582.582804:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0c4a00/0x40a459093b06bdcb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746129582.582810:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0c4a00/0x40a459093b06bdcb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746129582.582815:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e0c4a00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746129582.582818:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0c4a00/0x40a459093b06bdcb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746129582.582823:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0c4a00/0x40a459093b06bdcb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746129582.582832:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880132ef8f00) 00010000:00010000:2.0:1746129582.582834:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129582.582837:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0c4a00/0x40a459093b06bdcb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746129582.582845:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0c4a00/0x40a459093b06bdcb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746129582.583018:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0c4c00/0x40a459093b06bdd2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746129582.583023:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0c4c00/0x40a459093b06bdd2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746129582.583027:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0c4c00/0x40a459093b06bdd2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746129582.583031:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e0c4c00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746129582.583033:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0c4c00/0x40a459093b06bdd2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746129582.583036:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0c4c00/0x40a459093b06bdd2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746129582.583041:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880093ba8e00) 00010000:00010000:2.0:1746129582.583043:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129582.583045:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0c4c00/0x40a459093b06bdd2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746129582.583048:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0c4c00/0x40a459093b06bdd2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746129582.583084:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0c4800/0x40a459093b06bdc4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f224fa expref: 18 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129582.583094:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0c4e00/0x40a459093b06bdd9 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f224fa expref: 17 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129582.583104:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009cffe100) 00010000:00010000:2.0:1746129582.583105:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746129582.583107:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e0c4e00, rc 0) 00000100:00100000:2.0:1746129582.583521:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090169f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+17:32737:x1830948734464128:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 1151us (2739us total) trans 8589945508 rc 0/0 00000100:00100000:2.0:1746129582.583528:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11378 00000100:00100000:0.0:1746129582.635870:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129582.635927:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129582.635997:0:31503:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734464256 00000100:00100000:2.0:1746129582.636006:0:31503:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734464256 00000100:00100000:3.0:1746129582.636023:0:22480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734464384 00000100:00100000:3.0:1746129582.636035:0:22480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734464384 00000100:00100000:2.0:1746129582.636068:0:31503:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16932 00000100:00100000:2.0:1746129582.636077:0:31503:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009016b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+25:1960:x1830948734464256:12345-192.168.202.4@tcp:101:cat.0 00000100:00100000:3.0:1746129582.636095:0:22480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16933 00000100:00100000:3.0:1746129582.636103:0:22480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009016ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+24:1960:x1830948734464384:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129582.636117:0:22480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129582.636131:0:22480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094956200/0x40a459093b06bde7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f22508 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129582.636155:0:31503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129582.636169:0:31503:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e0c5000/0x40a459093b06bdee lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f22501 expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129582.636180:0:22480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094064e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22480:1830948737640320:192.168.202.4@tcp:106: 00000100:00100000:2.0:1746129582.636222:0:31503:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900f6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:31503:1830948737640448:192.168.202.4@tcp:106: 00000100:00100000:3.0:1746129582.636277:0:22480:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009518b540 going to sleep for 11 seconds 00000100:00100000:2.0:1746129582.636283:0:31503:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132dadf00 going to sleep for 11 seconds 00000100:00100000:2.0:1746129582.641343:0:31503:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900f6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:31503:1830948737640448:192.168.202.4@tcp:106: 00010000:00010000:2.0:1746129582.641387:0:31503:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012e0c5000/0x40a459093b06bdee lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22501 expref: 26 pid: 31503 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129582.641402:0:31503:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e0c5000/0x40a459093b06bdee lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22501 expref: 26 pid: 31503 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746129582.641689:0:22480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094064e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22480:1830948737640320:192.168.202.4@tcp:106: 00010000:00010000:2.0:1746129582.641698:0:31503:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e0c5000, rc 0) 00010000:00010000:3.0:1746129582.641709:0:22480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094956200/0x40a459093b06bde7 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22508 expref: 25 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129582.641717:0:22480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094956200/0x40a459093b06bde7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22508 expref: 25 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129582.641728:0:22480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094956200, rc 0) 00000100:00100000:3.0:1746129582.641754:0:22480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009016ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+24:1960:x1830948734464384:12345-192.168.202.4@tcp:101:cat.0 Request processed in 5652us (5825us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129582.641764:0:22480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16933 00000100:00100000:2.0:1746129582.641873:0:31503:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009016b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+25:1960:x1830948734464256:12345-192.168.202.4@tcp:101:cat.0 Request processed in 5796us (6012us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129582.641879:0:31503:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16932 00000100:00100000:0.0:1746129582.656165:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129582.658667:0:31503:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734464512 00000100:00100000:2.0:1746129582.658684:0:31503:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734464512 00000100:00100000:2.0:1746129582.658951:0:31503:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16934 00000100:00100000:2.0:1746129582.658961:0:31503:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009016aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+25:32740:x1830948734464512:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129582.658980:0:31503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129582.658999:0:31503:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e0c5200/0x40a459093b06bdf5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2250f expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129582.659032:0:31503:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094956e00/0x40a459093b06bd4d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2043904->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f224a6 expref: 33 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129582.659040:0:31503:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129582.659042:0:31503:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129582.659045:0:31503:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e0c5200/0x40a459093b06bdf5 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2250f expref: 26 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129582.659078:0:31503:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094956e00/0x40a459093b06bd4d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2043904->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f224a6 expref: 33 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129582.659091:0:31503:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094956e00/0x40a459093b06bd4d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2043904->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f224a6 expref: 33 pid: 11014 timeout: 937 lvb_type: 0 00000100:00100000:2.0:1746129582.659102:0:31503:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900f6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:31503:1830948737640576:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129582.660198:0:31503:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132dadf00 going to sleep for 11 seconds 00000100:00100000:0.0:1746129582.668040:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129582.668446:0:31503:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900f6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:31503:1830948737640576:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129582.668482:0:31503:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012e0c5200/0x40a459093b06bdf5 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2250f expref: 26 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129582.668501:0:31503:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e0c5200, rc 0) 00000100:00100000:2.0:1746129582.668554:0:31503:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009016aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+26:32740:x1830948734464512:12345-192.168.202.4@tcp:101:cat.0 Request processed in 9594us (12400us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129582.668562:0:31503:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16934 00000100:00100000:3.0:1746129582.669001:0:31521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734464640 00000100:00100000:3.0:1746129582.669009:0:31521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734464640 00002000:00100000:3.0:1746129582.669060:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f4:0x0] (2043904->2097151) req@ffff880090168a80 x1830948734464640/t0(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:323/0 lens 488/0 e 0 to 0 dl 1746129593 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129582.669069:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090168a80 with x1830948734464640 ext(2043904->2097151) 00010000:00010000:3.0:1746129582.669076:0:31521:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094956e00/0x40a459093b06bd4d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2043904->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f224a6 expref: 34 pid: 11014 timeout: 937 lvb_type: 0 00010000:00010000:3.0:1746129582.669088:0:31521:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094956e00/0x40a459093b06bd4d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2043904->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f224a6 expref: 34 pid: 11014 timeout: 937 lvb_type: 0 00002000:00010000:3.0:1746129582.669099:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880090168a80 00000100:00100000:3.0:1746129582.669118:0:31521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2545 00000100:00100000:3.0:1746129582.669124:0:31521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090168a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ada2ffba-8920-4ecb-8068-68caa9806978+34:1961:x1830948734464640:12345-192.168.202.4@tcp:4:cat.0 00000100:00100000:1.0:1746129582.670387:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129582.670792:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734464896 00000100:00100000:2.0:1746129582.670799:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734464896 00000100:00100000:2.0:1746129582.670835:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11379 00000100:00100000:2.0:1746129582.670840:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129bc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ada2ffba-8920-4ecb-8068-68caa9806978+301:32742:x1830948734464896:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:2.0:1746129582.670863:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129582.670879:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0c5400/0x40a459093b06bdfc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f22516 expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129582.670969:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0c5600/0x40a459093b06be03 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746129582.670984:0:14548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008dcd7800/0x40a459093b06bdb6 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f224f3 expref: 302 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129582.670991:0:14548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0c4e00/0x40a459093b06bdd9 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f224fa expref: 16 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129582.670998:0:14548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0c5600/0x40a459093b06be03 lrc: 5/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746129582.672187:0:14548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0c4e00/0x40a459093b06bdd9 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f224fa expref: 16 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129582.672202:0:14548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0c4e00/0x40a459093b06bdd9 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f224fa expref: 16 pid: 14548 timeout: 937 lvb_type: 0 00000100:00100000:2.0:1746129582.672224:0:14548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900f6680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14548:1830948737640704:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129582.672346:0:14548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008dcd7800/0x40a459093b06bdb6 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f224f3 expref: 302 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129582.672353:0:14548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008dcd7800/0x40a459093b06bdb6 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f224f3 expref: 302 pid: 14548 timeout: 937 lvb_type: 0 00000100:00100000:2.0:1746129582.672361:0:14548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900f6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14548:1830948737640832:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129582.672385:0:14548:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132dadb40 going to sleep for 11 seconds 00000100:00100000:2.0:1746129582.690536:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129582.690570:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129582.690625:0:7086:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734465024 00000100:00100000:2.0:1746129582.690633:0:7086:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734465024 00010000:00010000:2.0:1746129582.690672:0:7086:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0c4e00/0x40a459093b06bdd9 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f224fa expref: 17 pid: 14548 timeout: 937 lvb_type: 0 00000100:00100000:2.0:1746129582.690697:0:7086:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734465152 00000100:00100000:2.0:1746129582.690699:0:7086:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734465152 00010000:00010000:2.0:1746129582.690709:0:7086:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008dcd7800/0x40a459093b06bdb6 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f224f3 expref: 303 pid: 14548 timeout: 937 lvb_type: 0 00000100:00100000:2.0:1746129582.690723:0:7086:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8765 00000100:00100000:2.0:1746129582.690730:0:7086:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+17:1961:x1830948734465024:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129582.690745:0:7086:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746129582.690745:0:7087:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8766 00010000:00010000:2.0:1746129582.690750:0:7086:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0c4e00/0x40a459093b06bdd9 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f224fa expref: 17 pid: 14548 timeout: 937 lvb_type: 0 00000100:00100000:0.0:1746129582.690753:0:7087:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c07b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ada2ffba-8920-4ecb-8068-68caa9806978+303:1961:x1830948734465152:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129582.690760:0:7086:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0c4e00/0x40a459093b06bdd9 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f224fa expref: 17 pid: 14548 timeout: 937 lvb_type: 0 00010000:00010000:0.0:1746129582.690761:0:7087:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129582.690766:0:7087:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff88008dcd7800/0x40a459093b06bdb6 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f224f3 expref: 303 pid: 14548 timeout: 937 lvb_type: 0 00000100:00100000:3.0:1746129582.691072:0:14548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900f6680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14548:1830948737640704:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129582.691083:0:14548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900f6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14548:1830948737640832:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129582.691996:0:7087:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008dcd7800/0x40a459093b06bdb6 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f224f3 expref: 303 pid: 14548 timeout: 937 lvb_type: 0 00010000:00010000:0.0:1746129582.692022:0:7087:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008dcd7800/0x40a459093b06bdb6 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f224f3 expref: 303 pid: 14548 timeout: 937 lvb_type: 0 00010000:00010000:3.0:1746129582.692026:0:14548:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0c5600/0x40a459093b06be03 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746129582.692045:0:7087:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009cffe100) 00010000:00010000:0.0:1746129582.692050:0:7087:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0c5600/0x40a459093b06be03 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746129582.692059:0:7087:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0c5600/0x40a459093b06be03 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746129582.692066:0:7087:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0c5600/0x40a459093b06be03 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746129582.692084:0:7087:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746129582.692091:0:14548:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0c5600/0x40a459093b06be03 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746129582.692096:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0c5600/0x40a459093b06be03 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000004:00200000:3.0:1746129582.692117:0:14548:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00000100:00100000:0.0:1746129582.692126:0:7087:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c07b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ada2ffba-8920-4ecb-8068-68caa9806978+302:1961:x1830948734465152:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 1375us (1555us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129582.692133:0:7087:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8766 00010000:00010000:3.0:1746129582.692275:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0c5400/0x40a459093b06bdfc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22516 expref: 303 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129582.692323:0:7086:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0c4e00/0x40a459093b06bdd9 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f224fa expref: 17 pid: 14548 timeout: 937 lvb_type: 0 00010000:00010000:2.0:1746129582.692336:0:7086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009cffe100) 00010000:00010000:2.0:1746129582.692339:0:7086:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129582.692357:0:7086:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+16:1961:x1830948734465024:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 1628us (1832us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129582.692362:0:7086:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8765 00000100:00100000:0.0:1746129582.692546:0:31521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090168a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ada2ffba-8920-4ecb-8068-68caa9806978+36:1961:x1830948734464640:12345-192.168.202.4@tcp:4:cat.0 Request processed in 23422us (24516us total) trans 17179874213 rc 0/0 00000100:00100000:0.0:1746129582.692553:0:31521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2545 00002000:00100000:0.0:1746129582.692562:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f4:0x0] (2043904->2097151) req@ffff880090168a80 x1830948734464640/t17179874213(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:323/0 lens 488/448 e 0 to 0 dl 1746129593 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129582.692571:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090168a80 with x1830948734464640 ext(2043904->2097151) 00010000:00010000:0.0:1746129582.692578:0:31521:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094956e00/0x40a459093b06bd4d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2043904->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f224a6 expref: 36 pid: 11014 timeout: 937 lvb_type: 0 00010000:00010000:0.0:1746129582.692591:0:31521:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094956e00/0x40a459093b06bd4d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2043904->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f224a6 expref: 36 pid: 11014 timeout: 938 lvb_type: 0 00002000:00010000:0.0:1746129582.692597:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880090168a80 00010000:00010000:3.0:1746129582.693046:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0c5600/0x40a459093b06be03 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22516 expref: 302 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129582.693054:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009cffe100) 00010000:00010000:3.0:1746129582.693056:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746129582.693058:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e0c5600, rc 0) 00000100:00100000:3.0:1746129582.693095:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129bc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ada2ffba-8920-4ecb-8068-68caa9806978+302:32742:x1830948734464896:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 22254us (22714us total) trans 8589945509 rc 0/0 00000100:00100000:3.0:1746129582.693105:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11379 00000100:00100000:0.0:1746129582.704697:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129582.704798:0:31503:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734465280 00000100:00100000:2.0:1746129582.704807:0:31503:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734465280 00000100:00100000:2.0:1746129582.704870:0:31503:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16935 00000100:00100000:2.0:1746129582.704878:0:31503:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090168000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ada2ffba-8920-4ecb-8068-68caa9806978+36:1962:x1830948734465280:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129582.704897:0:31503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129582.704915:0:31503:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e0c4c00/0x40a459093b06be11 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2251d expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129582.704975:0:31503:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800959d5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:31503:1830948737640960:192.168.202.4@tcp:106: 00000100:00100000:2.0:1746129582.706197:0:31503:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132dadf00 going to sleep for 11 seconds 00000100:00100000:2.0:1746129582.717666:0:31503:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800959d5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:31503:1830948737640960:192.168.202.4@tcp:106: 00010000:00010000:2.0:1746129582.717708:0:31503:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012e0c4c00/0x40a459093b06be11 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2251d expref: 37 pid: 31503 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129582.717731:0:31503:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e0c4c00/0x40a459093b06be11 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2251d expref: 37 pid: 31503 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129582.717758:0:31503:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e0c4c00, rc 0) 00000100:00100000:2.0:1746129582.717808:0:31503:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090168000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ada2ffba-8920-4ecb-8068-68caa9806978+36:1962:x1830948734465280:12345-192.168.202.4@tcp:101:cat.0 Request processed in 12930us (13120us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129582.717818:0:31503:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16935 00000100:00100000:1.0:1746129582.722078:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129582.722203:0:7086:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734465408 00000100:00100000:2.0:1746129582.722240:0:7086:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734465408 00010000:00010000:2.0:1746129582.722282:0:7086:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094956e00/0x40a459093b06bd4d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2043904->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f224a6 expref: 36 pid: 11014 timeout: 938 lvb_type: 0 00000100:00100000:2.0:1746129582.722333:0:7086:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8767 00000100:00100000:2.0:1746129582.722341:0:7086:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129bc1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ada2ffba-8920-4ecb-8068-68caa9806978+36:1960:x1830948734465408:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129582.722357:0:7086:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129582.722383:0:7086:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094956e00/0x40a459093b06bd4d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2043904->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f224a6 expref: 36 pid: 11014 timeout: 938 lvb_type: 0 00010000:00010000:2.0:1746129582.722395:0:7086:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094956e00/0x40a459093b06bd4d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2043904->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f224a6 expref: 36 pid: 11014 timeout: 938 lvb_type: 0 00010000:00010000:2.0:1746129582.722423:0:7086:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094956e00/0x40a459093b06bd4d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2043904->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f224a6 expref: 36 pid: 11014 timeout: 938 lvb_type: 0 00010000:00010000:2.0:1746129582.722438:0:7086:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129582.722440:0:7086:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129582.722448:0:7086:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e0c5200/0x40a459093b06bdf5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2250f expref: 25 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129582.722455:0:7086:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e0c5200/0x40a459093b06bdf5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2250f expref: 25 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129582.722489:0:7086:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012e0c5200/0x40a459093b06bdf5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2250f expref: 25 pid: 31503 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129582.722501:0:7086:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800959d5c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7086:1830948737641088:192.168.202.4@tcp:105: 00000100:00100000:2.0:1746129582.722575:0:7086:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132dadf00 going to sleep for 11 seconds 00000100:00100000:3.0:1746129582.724244:0:7086:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800959d5c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7086:1830948737641088:192.168.202.4@tcp:105: 00010000:00010000:3.0:1746129582.724267:0:7086:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129582.728324:0:7086:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129bc1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ada2ffba-8920-4ecb-8068-68caa9806978+35:1960:x1830948734465408:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 5974us (6246us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129582.728336:0:7086:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8767 00000100:00100000:1.0:1746129582.730033:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129582.730164:0:31521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734465664 00000100:00100000:0.0:1746129582.730173:0:31521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734465664 00002000:00100000:0.0:1746129582.730201:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f4:0x0] (1048576->2097151) req@ffff880129bc1880 x1830948734465664/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:323/0 lens 488/0 e 0 to 0 dl 1746129593 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129582.730219:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129bc1880 with x1830948734465664 ext(1048576->2097151) 00002000:00010000:0.0:1746129582.730223:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880129bc1880 00000100:00100000:0.0:1746129582.730251:0:31521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8224 00000100:00100000:0.0:1746129582.730257:0:31521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129bc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+26:1960:x1830948734465664:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129582.734780:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129582.734833:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129582.734926:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734465920 00000100:00100000:2.0:1746129582.734926:0:31503:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734465792 00000100:00100000:3.0:1746129582.734933:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734465920 00000100:00100000:2.0:1746129582.734933:0:31503:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734465792 00000100:00100000:2.0:1746129582.734966:0:31503:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16936 00000100:00100000:3.0:1746129582.734972:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11380 00000100:00100000:2.0:1746129582.734972:0:31503:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009016b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ada2ffba-8920-4ecb-8068-68caa9806978+35:32745:x1830948734465792:12345-192.168.202.4@tcp:101:cat.0 00000100:00100000:3.0:1746129582.734975:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090169c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:068dab75-d300-4ead-a742-d14572ad1e50+10:32746:x1830948734465920:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:2.0:1746129582.734984:0:31503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129582.734988:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129582.734997:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094957600/0x40a459093b06be1f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2252b expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129582.734998:0:31503:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e0c4000/0x40a459093b06be18 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f22524 expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129582.735016:0:31503:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129582.735017:0:31503:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129582.735023:0:31503:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e0c4000/0x40a459093b06be18 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22524 expref: 36 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129582.735033:0:31503:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012e0c4000/0x40a459093b06be18 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22524 expref: 36 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129582.735039:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094957a00/0x40a459093b06be26 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746129582.735046:0:31503:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e0c4000, rc 0) 00010000:00010000:3.0:1746129582.735047:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094957a00/0x40a459093b06be26 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746129582.735054:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094957a00/0x40a459093b06be26 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746129582.735069:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094956e00/0x40a459093b06be2d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746129582.735074:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094956e00/0x40a459093b06be2d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746129582.735078:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094956e00/0x40a459093b06be2d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746129582.735168:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094956000/0x40a459093b06be34 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746129582.735176:0:14548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0c5600/0x40a459093b06be03 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22516 expref: 301 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129582.735182:0:14548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094956000/0x40a459093b06be34 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746129582.735203:0:14548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0c5600/0x40a459093b06be03 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22516 expref: 301 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129582.735224:0:14548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0c5600/0x40a459093b06be03 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22516 expref: 301 pid: 14548 timeout: 938 lvb_type: 0 00000100:00100000:3.0:1746129582.735233:0:14548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094064e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14548:1830948737641216:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129582.735488:0:31503:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009016b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ada2ffba-8920-4ecb-8068-68caa9806978+36:32745:x1830948734465792:12345-192.168.202.4@tcp:101:cat.0 Request processed in 514us (713us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129582.735494:0:31503:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16936 00000100:00100000:3.0:1746129582.735501:0:14548:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009518b540 going to sleep for 11 seconds 00000100:00100000:2.0:1746129582.739565:0:31521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129bc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+26:1960:x1830948734465664:12345-192.168.202.4@tcp:3:cat.0 Request processed in 9300us (9531us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129582.739575:0:31521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8224 00002000:00100000:2.0:1746129582.739584:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f4:0x0] (1048576->2097151) req@ffff880129bc1880 x1830948734465664/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:323/0 lens 488/440 e 0 to 0 dl 1746129593 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129582.739593:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129bc1880 with x1830948734465664 ext(1048576->2097151) 00002000:00010000:2.0:1746129582.739598:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880129bc1880 00000100:00100000:3.0:1746129582.739985:0:14548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094064e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14548:1830948737641216:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129582.740010:0:14548:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880094956000/0x40a459093b06be34 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000100:00100000:0.0:1746129582.740658:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129582.741463:0:7086:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734466048 00000100:00100000:3.0:1746129582.741471:0:7086:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734466048 00010000:00010000:3.0:1746129582.741504:0:7086:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0c5600/0x40a459093b06be03 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22516 expref: 302 pid: 14548 timeout: 938 lvb_type: 0 00000100:00100000:3.0:1746129582.741544:0:7086:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8768 00000100:00100000:3.0:1746129582.741550:0:7086:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a47050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ada2ffba-8920-4ecb-8068-68caa9806978+302:1962:x1830948734466048:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129582.741566:0:7086:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129582.741571:0:7086:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0c5600/0x40a459093b06be03 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22516 expref: 302 pid: 14548 timeout: 938 lvb_type: 0 00010000:00010000:3.0:1746129582.741581:0:7086:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0c5600/0x40a459093b06be03 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22516 expref: 302 pid: 14548 timeout: 938 lvb_type: 0 00010000:00010000:3.0:1746129582.741603:0:7086:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0c5600/0x40a459093b06be03 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22516 expref: 302 pid: 14548 timeout: 938 lvb_type: 0 00010000:00010000:3.0:1746129582.743058:0:7086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009cffe100) 00010000:00010000:3.0:1746129582.743067:0:7086:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880094956000/0x40a459093b06be34 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746129582.743079:0:7086:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094956000/0x40a459093b06be34 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746129582.743087:0:7086:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094956000/0x40a459093b06be34 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746129582.743127:0:7086:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746129582.743491:0:14548:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880094956000/0x40a459093b06be34 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746129582.743503:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094956000/0x40a459093b06be34 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000004:00200000:2.0:1746129582.743542:0:14548:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00000004:00200000:2.0:1746129582.743545:0:14548:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746129582.743557:0:14548:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880094956000/0x40a459093b06be34 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746129582.743568:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094956000/0x40a459093b06be34 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746129582.743576:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094957a00/0x40a459093b06be26 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746129582.743585:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094957a00/0x40a459093b06be26 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746129582.743590:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094957a00/0x40a459093b06be26 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746129582.743595:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094957a00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746129582.743599:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094957a00/0x40a459093b06be26 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746129582.743604:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094957a00/0x40a459093b06be26 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746129582.743617:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880132ef8f00) 00010000:00010000:2.0:1746129582.743619:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129582.743622:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094957a00/0x40a459093b06be26 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746129582.743627:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094957a00/0x40a459093b06be26 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746129582.743655:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094956e00/0x40a459093b06be2d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746129582.743660:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094956e00/0x40a459093b06be2d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746129582.743666:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094956e00/0x40a459093b06be2d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746129582.743669:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094956e00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746129582.743671:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094956e00/0x40a459093b06be2d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746129582.743680:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094956e00/0x40a459093b06be2d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746129582.743685:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880090643f00) 00010000:00010000:2.0:1746129582.743687:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129582.743689:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094956e00/0x40a459093b06be2d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746129582.743693:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094956e00/0x40a459093b06be2d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746129582.743725:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094957600/0x40a459093b06be1f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2252b expref: 12 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129582.743735:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094956000/0x40a459093b06be34 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2252b expref: 11 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129582.743741:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009cffe100) 00010000:00010000:2.0:1746129582.743742:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746129582.743744:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094956000, rc 0) 00000100:00100000:3.0:1746129582.743814:0:7086:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a47050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ada2ffba-8920-4ecb-8068-68caa9806978+301:1962:x1830948734466048:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 2254us (3148us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129582.743827:0:7086:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8768 00000100:00100000:2.0:1746129582.743969:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090169c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:068dab75-d300-4ead-a742-d14572ad1e50+11:32746:x1830948734465920:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 8991us (9134us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129582.743977:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11380 00000100:00100000:0.0:1746129582.744081:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129582.744467:0:31503:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734466176 00000100:00100000:2.0:1746129582.744475:0:31503:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734466176 00000100:00100000:2.0:1746129582.744509:0:31503:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16937 00000100:00100000:2.0:1746129582.744514:0:31503:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090169880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+24:32740:x1830948734466176:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129582.744530:0:31503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129582.744546:0:31503:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e0c4e00/0x40a459093b06be3b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f22532 expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129582.744571:0:31503:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f85bc00/0x40a459093b06bd70 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1097727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f224c2 expref: 29 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129582.744578:0:31503:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129582.744580:0:31503:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129582.744583:0:31503:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e0c4e00/0x40a459093b06be3b lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22532 expref: 25 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129582.744609:0:31503:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f85bc00/0x40a459093b06bd70 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1097727) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f224c2 expref: 29 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129582.744621:0:31503:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f85bc00/0x40a459093b06bd70 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1097727) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f224c2 expref: 29 pid: 11014 timeout: 938 lvb_type: 0 00000100:00100000:2.0:1746129582.744632:0:31503:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800959d7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:31503:1830948737641344:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129582.744682:0:31503:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132dad780 going to sleep for 11 seconds 00000100:00100000:2.0:1746129582.745643:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129582.748967:0:31521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734466432 00000100:00100000:0.0:1746129582.748981:0:31521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734466432 00002000:00100000:0.0:1746129582.749032:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f4:0x0] (1048576->2097151) req@ffff8800959d4a80 x1830948734466432/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:323/0 lens 488/0 e 0 to 0 dl 1746129593 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129582.749042:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800959d4a80 with x1830948734466432 ext(1048576->2097151) 00002000:00010000:0.0:1746129582.749047:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800959d4a80 00000100:00100000:0.0:1746129582.749085:0:31521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8225 00000100:00100000:0.0:1746129582.749092:0:31521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ada2ffba-8920-4ecb-8068-68caa9806978+36:1963:x1830948734466432:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:3.0:1746129582.749482:0:31503:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800959d7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:31503:1830948737641344:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129582.749511:0:31503:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012e0c4e00/0x40a459093b06be3b lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22532 expref: 25 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129582.749528:0:31503:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e0c4e00, rc 0) 00000100:00100000:3.0:1746129582.749638:0:31503:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090169880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+25:32740:x1830948734466176:12345-192.168.202.4@tcp:101:cat.0 Request processed in 5123us (5557us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129582.749645:0:31503:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16937 00000100:00100000:2.0:1746129582.753325:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129582.754194:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129582.754252:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129582.754276:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734466560 00000100:00100000:2.0:1746129582.754284:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734466560 00002000:00100000:2.0:1746129582.754341:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ee:0x0] (1048576->1097727) req@ffff8800959d5c00 x1830948734466560/t0(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:323/0 lens 488/0 e 0 to 0 dl 1746129593 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129582.754350:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800959d5c00 with x1830948734466560 ext(1048576->1097727) 00010000:00010000:2.0:1746129582.754360:0:25745:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f85bc00/0x40a459093b06bd70 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1097727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f224c2 expref: 30 pid: 11014 timeout: 938 lvb_type: 0 00010000:00010000:2.0:1746129582.754373:0:25745:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f85bc00/0x40a459093b06bd70 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1097727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f224c2 expref: 30 pid: 11014 timeout: 938 lvb_type: 0 00002000:00010000:2.0:1746129582.754380:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800959d5c00 00000100:00100000:2.0:1746129582.754398:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2546 00000100:00100000:2.0:1746129582.754405:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+30:1961:x1830948734466560:12345-192.168.202.4@tcp:4:cat.0 00000100:00100000:3.0:1746129582.754605:0:31503:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734466688 00000100:00100000:3.0:1746129582.754609:0:31503:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734466688 00000100:00100000:3.0:1746129582.754636:0:11014:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734466816 00000100:00100000:3.0:1746129582.754637:0:11014:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734466816 00000100:00100000:3.0:1746129582.754651:0:11014:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16938 00000100:00100000:3.0:1746129582.754655:0:11014:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:068dab75-d300-4ead-a742-d14572ad1e50+10:1960:x1830948734466688:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:3.0:1746129582.754665:0:11014:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129582.754681:0:11014:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094956c00/0x40a459093b06be42 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f22539 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129582.754698:0:11014:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129582.754700:0:11014:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129582.754709:0:11014:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094956c00/0x40a459093b06be42 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22539 expref: 11 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129582.754723:0:11014:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094956c00/0x40a459093b06be42 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22539 expref: 11 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129582.754733:0:11014:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094956c00, rc 0) 00000100:00100000:3.0:1746129582.754766:0:11014:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:068dab75-d300-4ead-a742-d14572ad1e50+11:1960:x1830948734466688:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 110us (1451us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129582.754772:0:11014:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16938 00000100:00100000:3.0:1746129582.754787:0:11014:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16939 00000100:00100000:3.0:1746129582.754790:0:11014:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:068dab75-d300-4ead-a742-d14572ad1e50+10:1960:x1830948734466816:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:3.0:1746129582.754798:0:11014:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129582.754805:0:11014:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094957400/0x40a459093b06be49 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f22540 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129582.754840:0:11014:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094064e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11014:1830948737641472:192.168.202.4@tcp:106: 00000100:00100000:3.0:1746129582.754885:0:11014:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009518bf00 going to sleep for 11 seconds 00000100:00100000:0.0:1746129582.760934:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129582.761419:0:11014:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094064e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11014:1830948737641472:192.168.202.4@tcp:106: 00010000:00010000:3.0:1746129582.761455:0:11014:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094957400/0x40a459093b06be49 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22540 expref: 11 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129582.761470:0:11014:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094957400/0x40a459093b06be49 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22540 expref: 11 pid: 11014 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746129582.761564:0:22480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734466944 00000100:00100000:1.0:1746129582.761661:0:22480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734466944 00000100:00100000:1.0:1746129582.761851:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16940 00000100:00100000:1.0:1746129582.761859:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090169180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ada2ffba-8920-4ecb-8068-68caa9806978+38:32742:x1830948734466944:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:1.0:1746129582.761877:0:4385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129582.761892:0:4385:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f85b000/0x40a459093b06be50 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f22547 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129582.761916:0:4385:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095d0c000/0x40a459093b06bbbe lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f223c6 expref: 39 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129582.761925:0:4385:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f118800/0x40a459093b06bcd6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2246e expref: 10 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129582.761932:0:4385:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fab5000/0x40a459093b06bbc5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f223cd expref: 25 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129582.761938:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129582.761940:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129582.761943:0:4385:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f85b000/0x40a459093b06be50 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [2318336->2830335] (req 2318336->2830335) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22547 expref: 39 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129582.761971:0:4385:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fab5000/0x40a459093b06bbc5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f223cd expref: 25 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129582.761984:0:4385:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fab5000/0x40a459093b06bbc5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f223cd expref: 25 pid: 31503 timeout: 938 lvb_type: 0 00000100:00100000:1.0:1746129582.761996:0:4385:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129bc1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:4385:1830948737641600:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129582.762066:0:11014:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094957400, rc 0) 00010000:00010000:1.0:1746129582.762229:0:4385:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f118800/0x40a459093b06bcd6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2246e expref: 10 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129582.762237:0:4385:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f118800/0x40a459093b06bcd6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2246e expref: 10 pid: 4385 timeout: 938 lvb_type: 1 00000100:00100000:1.0:1746129582.762245:0:4385:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129bc1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:4385:1830948737641728:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129582.762273:0:11014:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:068dab75-d300-4ead-a742-d14572ad1e50+10:1960:x1830948734466816:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 7479us (8078us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129582.762504:0:11014:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16939 00010000:00010000:1.0:1746129582.763347:0:4385:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095d0c000/0x40a459093b06bbbe lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f223c6 expref: 39 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129582.763357:0:4385:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095d0c000/0x40a459093b06bbbe lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f223c6 expref: 39 pid: 31503 timeout: 938 lvb_type: 0 00000100:00100000:1.0:1746129582.763366:0:4385:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129bc2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:4385:1830948737641856:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129582.763863:0:4385:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a91c5540 going to sleep for 11 seconds 00000100:00100000:2.0:1746129582.764483:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+32:1961:x1830948734466560:12345-192.168.202.4@tcp:4:cat.0 Request processed in 10074us (10226us total) trans 21474841462 rc 0/0 00000100:00100000:2.0:1746129582.764492:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2546 00002000:00100000:2.0:1746129582.764502:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ee:0x0] (1048576->1097727) req@ffff8800959d5c00 x1830948734466560/t21474841462(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:323/0 lens 488/448 e 0 to 0 dl 1746129593 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129582.764511:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800959d5c00 with x1830948734466560 ext(1048576->1097727) 00010000:00010000:2.0:1746129582.764520:0:25745:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f85bc00/0x40a459093b06bd70 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1097727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f224c2 expref: 32 pid: 11014 timeout: 938 lvb_type: 0 00010000:00010000:2.0:1746129582.764530:0:25745:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f85bc00/0x40a459093b06bd70 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1097727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f224c2 expref: 32 pid: 11014 timeout: 938 lvb_type: 0 00002000:00010000:2.0:1746129582.764535:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800959d5c00 00000100:00100000:2.0:1746129582.767144:0:4385:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129bc1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:4385:1830948737641600:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129582.767616:0:31521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ada2ffba-8920-4ecb-8068-68caa9806978+38:1963:x1830948734466432:12345-192.168.202.4@tcp:3:cat.0 Request processed in 18522us (21973us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129582.767627:0:31521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8225 00002000:00100000:1.0:1746129582.767639:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f4:0x0] (1048576->2097151) req@ffff8800959d4a80 x1830948734466432/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:323/0 lens 488/440 e 0 to 0 dl 1746129593 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129582.767648:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800959d4a80 with x1830948734466432 ext(1048576->2097151) 00002000:00010000:1.0:1746129582.767653:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800959d4a80 00000100:00100000:1.0:1746129582.767980:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129582.768046:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734467200 00000100:00100000:1.0:1746129582.768056:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129582.768057:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734467200 00000100:00100000:3.0:1746129582.768101:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11381 00000100:00100000:3.0:1746129582.768108:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129bc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:068dab75-d300-4ead-a742-d14572ad1e50+11:32746:x1830948734467200:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:3.0:1746129582.768124:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129582.768143:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094956800/0x40a459093b06be57 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2254e expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129582.768146:0:22480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734467328 00000100:00100000:0.0:1746129582.768150:0:22480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734467328 00000100:00100000:0.0:1746129582.768173:0:22480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16941 00000100:00100000:0.0:1746129582.768178:0:22480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129bc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+26:32737:x1830948734467328:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:0.0:1746129582.768186:0:22480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129582.768196:0:22480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fab5c00/0x40a459093b06be5e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f22555 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129582.768226:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129582.768229:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129582.768232:0:22480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fab5c00/0x40a459093b06be5e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [3469312->4194303] (req 3469312->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22555 expref: 27 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129582.768244:0:22480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fab5c00/0x40a459093b06be5e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [3469312->4194303] (req 3469312->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22555 expref: 27 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129582.768254:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880094956a00/0x40a459093b06be65 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746129582.768258:0:22480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fab5c00, rc 0) 00010000:00010000:3.0:1746129582.768267:0:14548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094956000/0x40a459093b06be34 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2252b expref: 12 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129582.768272:0:14548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094956a00/0x40a459093b06be65 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00000100:00100000:0.0:1746129582.768276:0:22480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129bc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+27:32737:x1830948734467328:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 98us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129582.768282:0:22480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16941 00010000:00010000:3.0:1746129582.768317:0:14548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094956000/0x40a459093b06be34 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2252b expref: 12 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129582.768328:0:14548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094956000/0x40a459093b06be34 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2252b expref: 12 pid: 14548 timeout: 938 lvb_type: 0 00000100:00100000:3.0:1746129582.768339:0:14548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094064e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14548:1830948737641984:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129582.768406:0:14548:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009518bf00 going to sleep for 11 seconds 00000100:00100000:0.0:1746129582.772337:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129582.772373:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129582.772392:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129582.772418:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129582.772466:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129582.772916:0:4385:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129bc1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:4385:1830948737641728:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129582.772932:0:4385:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129bc2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:4385:1830948737641856:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129582.772973:0:4385:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f85b000/0x40a459093b06be50 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [2318336->2830335] (req 2318336->2830335) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22547 expref: 37 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129582.772994:0:4385:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f85b000, rc 0) 00000100:00100000:2.0:1746129582.773049:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090169180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ada2ffba-8920-4ecb-8068-68caa9806978+37:32742:x1830948734466944:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 11189us (12124us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129582.773058:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16940 00000100:00100000:2.0:1746129582.773666:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734467456 00000100:00100000:2.0:1746129582.773674:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734467456 00010000:00010000:2.0:1746129582.773705:0:9823:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fab5000/0x40a459093b06bbc5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f223cd expref: 27 pid: 31503 timeout: 938 lvb_type: 0 00000100:00100000:2.0:1746129582.773741:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734467840 00000100:00100000:2.0:1746129582.773744:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734467840 00010000:00010000:2.0:1746129582.773757:0:9823:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f85bc00/0x40a459093b06bd70 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1097727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f224c2 expref: 32 pid: 11014 timeout: 938 lvb_type: 0 00000100:00100000:2.0:1746129582.773766:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734467712 00000100:00100000:2.0:1746129582.773768:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734467712 00010000:00010000:2.0:1746129582.773774:0:9823:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095d0c000/0x40a459093b06bbbe lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f223c6 expref: 37 pid: 31503 timeout: 938 lvb_type: 0 00000100:00100000:2.0:1746129582.773782:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734467584 00000100:00100000:2.0:1746129582.773783:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734467584 00010000:00010000:2.0:1746129582.773790:0:9823:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f118800/0x40a459093b06bcd6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2246e expref: 11 pid: 4385 timeout: 938 lvb_type: 1 00000100:00100000:2.0:1746129582.773797:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734467968 00000100:00100000:2.0:1746129582.773799:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734467968 00010000:00010000:2.0:1746129582.773809:0:9823:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094956000/0x40a459093b06be34 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2252b expref: 13 pid: 14548 timeout: 938 lvb_type: 0 00000100:00100000:1.0:1746129582.773850:0:7087:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8769 00000100:00100000:1.0:1746129582.773860:0:7087:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090169500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+27:1962:x1830948734467456:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129582.773873:0:7087:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129582.773897:0:7087:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fab5000/0x40a459093b06bbc5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f223cd expref: 27 pid: 31503 timeout: 938 lvb_type: 0 00010000:00010000:1.0:1746129582.773908:0:7087:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fab5000/0x40a459093b06bbc5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f223cd expref: 27 pid: 31503 timeout: 938 lvb_type: 0 00010000:00010000:1.0:1746129582.773934:0:7087:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fab5000/0x40a459093b06bbc5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f223cd expref: 27 pid: 31503 timeout: 938 lvb_type: 0 00010000:00010000:1.0:1746129582.773950:0:7087:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129582.773972:0:7087:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090169500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+26:1962:x1830948734467456:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 115us (1685us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129582.773978:0:7087:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8769 00000100:00100000:3.0:1746129582.773986:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8770 00000100:00100000:3.0:1746129582.773995:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009016bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ada2ffba-8920-4ecb-8068-68caa9806978+32:1961:x1830948734467840:12345-192.168.202.4@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746129582.773995:0:7087:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8771 00000100:00100000:1.0:1746129582.773999:0:7087:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090168e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ada2ffba-8920-4ecb-8068-68caa9806978+37:1962:x1830948734467712:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129582.774004:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129582.774006:0:7087:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129582.774012:0:7087:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095d0c000/0x40a459093b06bbbe lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f223c6 expref: 37 pid: 31503 timeout: 938 lvb_type: 0 00010000:00010000:3.0:1746129582.774018:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f85bc00/0x40a459093b06bd70 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1097727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f224c2 expref: 32 pid: 11014 timeout: 938 lvb_type: 0 00010000:00010000:1.0:1746129582.774020:0:7087:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095d0c000/0x40a459093b06bbbe lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f223c6 expref: 37 pid: 31503 timeout: 938 lvb_type: 0 00010000:00010000:3.0:1746129582.774025:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f85bc00/0x40a459093b06bd70 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1097727) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f224c2 expref: 32 pid: 11014 timeout: 938 lvb_type: 0 00010000:00010000:1.0:1746129582.774031:0:7087:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095d0c000/0x40a459093b06bbbe lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f223c6 expref: 37 pid: 31503 timeout: 938 lvb_type: 0 00010000:00010000:1.0:1746129582.774039:0:7087:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746129582.774041:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f85bc00/0x40a459093b06bd70 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1097727) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f224c2 expref: 32 pid: 11014 timeout: 938 lvb_type: 0 00000100:00100000:1.0:1746129582.774050:0:7087:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090168e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ada2ffba-8920-4ecb-8068-68caa9806978+36:1962:x1830948734467712:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 51us (1658us total) trans 0 rc 0/0 00010000:00010000:3.0:1746129582.774055:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746129582.774055:0:7087:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8771 00010000:00010000:3.0:1746129582.774057:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746129582.774063:0:7087:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8772 00010000:00010000:3.0:1746129582.774064:0:7085:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012e0c4e00/0x40a459093b06be3b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22532 expref: 24 pid: 31503 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129582.774067:0:7087:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009016a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:068dab75-d300-4ead-a742-d14572ad1e50+11:1962:x1830948734467584:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129582.774072:0:7085:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e0c4e00/0x40a459093b06be3b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22532 expref: 24 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129582.774072:0:7087:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129582.774077:0:7087:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f118800/0x40a459093b06bcd6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2246e expref: 11 pid: 4385 timeout: 938 lvb_type: 1 00010000:00010000:1.0:1746129582.774084:0:7087:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f118800/0x40a459093b06bcd6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2246e expref: 11 pid: 4385 timeout: 938 lvb_type: 1 00010000:00010000:1.0:1746129582.774092:0:7087:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f118800/0x40a459093b06bcd6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2246e expref: 11 pid: 4385 timeout: 938 lvb_type: 1 00010000:00010000:3.0:1746129582.774100:0:7085:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012e0c4e00/0x40a459093b06be3b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22532 expref: 24 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129582.774100:0:7087:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129582.774102:0:7087:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129582.774105:0:7087:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f85b000/0x40a459093b06be50 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->3469311] (req 2318336->2830335) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22547 expref: 35 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129582.774111:0:7087:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f85b000/0x40a459093b06be50 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->3469311] (req 2318336->2830335) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22547 expref: 35 pid: 4385 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129582.774112:0:7085:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094066a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7085:1830948737642112:192.168.202.4@tcp:105: 00010000:00010000:1.0:1746129582.774117:0:7087:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129582.774117:0:7087:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129582.774120:0:7087:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fab5c00/0x40a459093b06be5e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [3469312->18446744073709551615] (req 3469312->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22555 expref: 25 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129582.774126:0:7087:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fab5c00/0x40a459093b06be5e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [3469312->18446744073709551615] (req 3469312->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22555 expref: 25 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129582.774141:0:7087:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fab5c00/0x40a459093b06be5e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [3469312->18446744073709551615] (req 3469312->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22555 expref: 25 pid: 22480 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129582.774153:0:7087:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129bc3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7087:1830948737642240:192.168.202.4@tcp:105: 00000100:00100000:3.0:1746129582.774160:0:7085:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009518ba80 going to sleep for 11 seconds 00000100:00100000:3.0:1746129582.774176:0:7086:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8773 00010000:00010000:1.0:1746129582.774176:0:7087:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f85b000/0x40a459093b06be50 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->3469311] (req 2318336->2830335) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22547 expref: 35 pid: 4385 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129582.774181:0:7086:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092fd0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:068dab75-d300-4ead-a742-d14572ad1e50+13:1960:x1830948734467968:12345-192.168.202.4@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746129582.774182:0:7087:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129bc2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7087:1830948737642368:192.168.202.4@tcp:105: 00010000:00010000:3.0:1746129582.774190:0:7086:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746129582.774193:0:7087:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a91c5540 going to sleep for 11 seconds 00010000:00010000:3.0:1746129582.774195:0:7086:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094956000/0x40a459093b06be34 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2252b expref: 13 pid: 14548 timeout: 938 lvb_type: 0 00010000:00010000:3.0:1746129582.774204:0:7086:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094956000/0x40a459093b06be34 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2252b expref: 13 pid: 14548 timeout: 938 lvb_type: 0 00010000:00010000:3.0:1746129582.774228:0:7086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009cffe100) 00010000:00010000:3.0:1746129582.774232:0:7086:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880094956a00/0x40a459093b06be65 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746129582.774240:0:7086:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094956a00/0x40a459093b06be65 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50290000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746129582.774245:0:7086:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094956a00/0x40a459093b06be65 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50290000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746129582.774255:0:7086:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129582.774270:0:7086:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092fd0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:068dab75-d300-4ead-a742-d14572ad1e50+13:1960:x1830948734467968:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 89us (1804us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129582.774275:0:7086:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8773 00010000:00010000:3.0:1746129582.774322:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094956000/0x40a459093b06be34 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2252b expref: 12 pid: 14548 timeout: 938 lvb_type: 0 00000100:00100000:3.0:1746129582.774333:0:14548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094064e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14548:1830948737641984:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129582.774345:0:14548:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880094956a00/0x40a459093b06be65 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746129582.774353:0:14548:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880094956a00/0x40a459093b06be65 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746129582.774358:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094956a00/0x40a459093b06be65 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000004:00200000:3.0:1746129582.774376:0:14548:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:3.0:1746129582.774514:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094956800/0x40a459093b06be57 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2254e expref: 13 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129582.774525:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094956a00/0x40a459093b06be65 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2254e expref: 12 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129582.774530:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009cffe100) 00010000:00010000:3.0:1746129582.774533:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746129582.774534:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094956a00, rc 0) 00000100:00100000:3.0:1746129582.774554:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129bc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:068dab75-d300-4ead-a742-d14572ad1e50+12:32746:x1830948734467200:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 6447us (6575us total) trans 8589945510 rc 0/0 00000100:00100000:3.0:1746129582.774563:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11381 00000100:00100000:0.0:1746129582.775360:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129582.775575:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734468096 00000100:00100000:2.0:1746129582.775581:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734468096 00000100:00100000:2.0:1746129582.775611:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16942 00000100:00100000:2.0:1746129582.775617:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092fd2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ada2ffba-8920-4ecb-8068-68caa9806978+32:32745:x1830948734468096:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129582.775630:0:4385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129582.775642:0:4385:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093c0c200/0x40a459093b06be73 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2255c expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129582.775658:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129582.775660:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129582.775666:0:4385:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093c0c200/0x40a459093b06be73 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2255c expref: 33 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129582.775677:0:4385:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093c0c200/0x40a459093b06be73 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2255c expref: 33 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129582.775684:0:4385:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093c0c200, rc 0) 00000100:00100000:2.0:1746129582.776370:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092fd2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ada2ffba-8920-4ecb-8068-68caa9806978+33:32745:x1830948734468096:12345-192.168.202.4@tcp:101:cat.0 Request processed in 748us (1009us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129582.776377:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16942 00000100:00100000:0.0:1746129582.784287:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129582.784346:0:7085:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094066a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7085:1830948737642112:192.168.202.4@tcp:105: 00010000:00010000:3.0:1746129582.784369:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129582.784413:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009016bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ada2ffba-8920-4ecb-8068-68caa9806978+32:1961:x1830948734467840:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 10420us (12038us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129582.784423:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8770 00000100:00100000:0.0:1746129582.785186:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129582.785241:0:11014:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734468224 00000100:00100000:0.0:1746129582.785246:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129582.785247:0:11014:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734468224 00000100:00100000:3.0:1746129582.785284:0:11014:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734468352 00000100:00100000:3.0:1746129582.785286:0:11014:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734468352 00000100:00100000:0.0:1746129582.785305:0:22480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16943 00000100:00100000:3.0:1746129582.785321:0:11014:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16944 00000100:00100000:3.0:1746129582.785327:0:11014:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092fd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:068dab75-d300-4ead-a742-d14572ad1e50+11:1960:x1830948734468352:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:3.0:1746129582.785345:0:11014:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129582.785363:0:11014:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094956600/0x40a459093b06be7a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2256a expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129582.785377:0:7087:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129bc3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7087:1830948737642240:192.168.202.4@tcp:105: 00000100:00100000:1.0:1746129582.785386:0:7087:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129bc2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7087:1830948737642368:192.168.202.4@tcp:105: 00010000:00010000:1.0:1746129582.785400:0:7087:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129582.785419:0:11014:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094066a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11014:1830948737642496:192.168.202.4@tcp:106: 00000100:00100000:1.0:1746129582.785422:0:7087:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009016a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:068dab75-d300-4ead-a742-d14572ad1e50+12:1962:x1830948734467584:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 11355us (13004us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129582.785427:0:7087:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8772 00000100:00100000:1.0:1746129582.785447:0:31521:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734468608 00000100:00100000:1.0:1746129582.785450:0:31521:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734468608 00000100:00100000:3.0:1746129582.785461:0:11014:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009518ba80 going to sleep for 11 seconds 00002000:00100000:1.0:1746129582.785475:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f5:0x0] (2318336->2322431) req@ffff880092fd3b80 x1830948734468608/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:323/0 lens 488/0 e 0 to 0 dl 1746129593 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129582.785485:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092fd3b80 with x1830948734468608 ext(2318336->2322431) 00002000:00010000:1.0:1746129582.785488:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092fd3b80 00000100:00100000:1.0:1746129582.785514:0:31521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8226 00000100:00100000:1.0:1746129582.785519:0:31521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092fd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ada2ffba-8920-4ecb-8068-68caa9806978+36:1962:x1830948734468608:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:1.0:1746129582.785663:0:31521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092fd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ada2ffba-8920-4ecb-8068-68caa9806978+36:1962:x1830948734468608:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 144us (415us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746129582.785672:0:31521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8226 00002000:00100000:1.0:1746129582.785676:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f5:0x0] (2318336->2322431) req@ffff880092fd3b80 x1830948734468608/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:323/0 lens 488/4536 e 0 to 0 dl 1746129593 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129582.785682:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092fd3b80 with x1830948734468608 ext(2318336->2322431) 00002000:00010000:1.0:1746129582.785685:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092fd3b80 00000100:00100000:0.0:1746129582.786063:0:22480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092fd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:068dab75-d300-4ead-a742-d14572ad1e50+10:1961:x1830948734468224:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:0.0:1746129582.786073:0:22480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129582.786085:0:22480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fab5a00/0x40a459093b06be81 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f22563 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129582.786099:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129582.786101:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129582.786111:0:22480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fab5a00/0x40a459093b06be81 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22563 expref: 11 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129582.786125:0:22480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fab5a00/0x40a459093b06be81 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22563 expref: 11 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129582.786140:0:22480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fab5a00, rc 0) 00000100:00100000:0.0:1746129582.786162:0:22480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092fd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:068dab75-d300-4ead-a742-d14572ad1e50+11:1961:x1830948734468224:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 852us (1889us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129582.786167:0:22480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16943 00000100:00100000:0.0:1746129582.788335:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129582.788387:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129582.788807:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734468864 00000100:00100000:3.0:1746129582.788817:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734468864 00002000:00100000:3.0:1746129582.788867:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ee:0x0] (1048576->2097151) req@ffff880092fd1880 x1830948734468864/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:323/0 lens 488/0 e 0 to 0 dl 1746129593 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129582.788878:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092fd1880 with x1830948734468864 ext(1048576->2097151) 00002000:00010000:3.0:1746129582.788884:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092fd1880 00000100:00100000:3.0:1746129582.788901:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734469120 00000100:00100000:3.0:1746129582.788904:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734469120 00002000:00100000:3.0:1746129582.788917:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f5:0x0] (3469312->3473407) req@ffff880092fd0380 x1830948734469120/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:323/0 lens 488/0 e 0 to 0 dl 1746129593 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129582.788924:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092fd0380 with x1830948734469120 ext(3469312->3473407) 00002000:00010000:3.0:1746129582.788927:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092fd0380 00000100:00100000:3.0:1746129582.789228:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8227 00000100:00100000:1.0:1746129582.789234:0:31521:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8228 00000100:00100000:3.0:1746129582.789236:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092fd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+25:1963:x1830948734468864:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:1.0:1746129582.789241:0:31521:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092fd0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+26:1963:x1830948734469120:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:1.0:1746129582.789436:0:31521:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092fd0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+26:1963:x1830948734469120:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 195us (1048us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746129582.789442:0:31521:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8228 00002000:00100000:1.0:1746129582.789447:0:31521:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f5:0x0] (3469312->3473407) req@ffff880092fd0380 x1830948734469120/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:323/0 lens 488/4536 e 0 to 0 dl 1746129593 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129582.789454:0:31521:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092fd0380 with x1830948734469120 ext(3469312->3473407) 00002000:00010000:1.0:1746129582.789456:0:31521:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092fd0380 00002000:00010000:2.0:1746129582.789806:0:11014:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3f5:0x0] updating lvb mtime: 1746129582 -> 1746129583 00002000:00010000:2.0:1746129582.789810:0:11014:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3f5:0x0] updating lvb atime: 1746129582 -> 1746129583 00002000:00010000:2.0:1746129582.789812:0:11014:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3f5:0x0] updating lvb ctime: 1746129582 -> 1746129583 00000100:00100000:2.0:1746129582.789823:0:11014:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094066a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11014:1830948737642496:192.168.202.4@tcp:106: 00010000:00010000:2.0:1746129582.789854:0:11014:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094956600/0x40a459093b06be7a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2256a expref: 11 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129582.789866:0:11014:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094956600/0x40a459093b06be7a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2256a expref: 11 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129582.789890:0:11014:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094956600, rc 0) 00000100:00100000:2.0:1746129582.789914:0:11014:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092fd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:068dab75-d300-4ead-a742-d14572ad1e50+10:1960:x1830948734468352:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 4587us (4729us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129582.789920:0:11014:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16944 00000100:00100000:0.0:1746129582.791455:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129582.792962:0:8417:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734469376 00000100:00100000:2.0:1746129582.792976:0:8417:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734469376 00002000:00100000:2.0:1746129582.793025:0:8417:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3ee:0x0] (1048576->2097151) req@ffff880092fd0e00 x1830948734469376/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:323/0 lens 488/0 e 0 to 0 dl 1746129593 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129582.793035:0:8417:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092fd0e00 with x1830948734469376 ext(1048576->2097151) 00002000:00010000:2.0:1746129582.793041:0:8417:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092fd0e00 00000100:00100000:2.0:1746129582.793082:0:8417:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8229 00000100:00100000:2.0:1746129582.793090:0:8417:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092fd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ada2ffba-8920-4ecb-8068-68caa9806978+32:1963:x1830948734469376:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:0.0:1746129582.796349:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129582.796940:0:11014:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734469504 00000100:00100000:1.0:1746129582.797634:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129582.797822:0:11014:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734469504 00000100:00100000:2.0:1746129582.797878:0:11014:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16945 00000100:00100000:2.0:1746129582.797887:0:11014:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092fd0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+27:32737:x1830948734469504:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:2.0:1746129582.797907:0:11014:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129582.797927:0:11014:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093c0c800/0x40a459093b06be88 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f22571 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129582.797962:0:11014:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ec79800/0x40a459093b06bc5f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22421 expref: 33 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129582.797969:0:11014:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f118a00/0x40a459093b06bccf lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22467 expref: 10 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129582.797975:0:11014:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a058f800/0x40a459093b06bc82 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2243d expref: 28 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129582.797982:0:11014:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129582.797983:0:11014:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129582.797986:0:11014:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093c0c800/0x40a459093b06be88 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [4194304->4448255] (req 4194304->4448255) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22571 expref: 28 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129582.798018:0:11014:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a058f800/0x40a459093b06bc82 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2243d expref: 28 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129582.798029:0:11014:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a058f800/0x40a459093b06bc82 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2243d expref: 28 pid: 8412 timeout: 938 lvb_type: 1 00000100:00100000:2.0:1746129582.798041:0:11014:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009507dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11014:1830948737642624:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129582.798112:0:11014:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f118a00/0x40a459093b06bccf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22467 expref: 10 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129582.798120:0:11014:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f118a00/0x40a459093b06bccf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22467 expref: 10 pid: 4385 timeout: 938 lvb_type: 1 00000100:00100000:2.0:1746129582.798128:0:11014:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009507d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11014:1830948737642752:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129582.798152:0:11014:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012ec79800/0x40a459093b06bc5f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22421 expref: 33 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129582.798159:0:11014:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012ec79800/0x40a459093b06bc5f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22421 expref: 33 pid: 22480 timeout: 938 lvb_type: 0 00000100:00100000:2.0:1746129582.798166:0:11014:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009507ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11014:1830948737642880:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129582.798180:0:11014:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132dad900 going to sleep for 11 seconds 00000100:00100000:3.0:1746129582.799251:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734469760 00000100:00100000:3.0:1746129582.799262:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734469760 00000100:00100000:3.0:1746129582.799519:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11382 00000100:00100000:3.0:1746129582.799528:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129bc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:068dab75-d300-4ead-a742-d14572ad1e50+12:32746:x1830948734469760:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:3.0:1746129582.799549:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129582.799552:0:14548:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746129582.799576:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094956a00/0x40a459093b06be65 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2254e expref: 12 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129582.799684:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009cffe100) 00010000:00010000:3.0:1746129582.799689:0:14548:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746129582.799701:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f92e200/0x40a459093b06be8f lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f22578 expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129582.799796:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f92e400/0x40a459093b06be96 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746129582.799809:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f92e400/0x40a459093b06be96 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746129582.799817:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f92e400/0x40a459093b06be96 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746129582.799829:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f92e400/0x40a459093b06be96 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746129582.799835:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f92e400/0x40a459093b06be96 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746129582.799841:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f92e400/0x40a459093b06be96 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746129582.799846:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f92e400 already unused, calling callback (ffffffffa136e690) 00010000:00010000:3.0:1746129582.799850:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f92e400/0x40a459093b06be96 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746129582.799855:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f92e400/0x40a459093b06be96 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746129582.799861:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009cffe100) 00010000:00010000:3.0:1746129582.799864:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746129582.799866:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f92e400/0x40a459093b06be96 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746129582.799870:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f92e400/0x40a459093b06be96 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746129582.799890:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f92e200/0x40a459093b06be8f lrc: 1/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22578 expref: 12 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129582.799895:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f92e200/0x40a459093b06be8f lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22578 expref: 12 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129582.799901:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f92e200, rc 0) 00000100:00100000:3.0:1746129582.800317:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129bc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:068dab75-d300-4ead-a742-d14572ad1e50+11:32746:x1830948734469760:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 789us (2685us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129582.800323:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11382 00000100:00100000:0.0:1746129582.802433:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129582.802568:0:21725:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734470016 00000100:00100000:1.0:1746129582.802576:0:21725:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734470016 00002000:00100000:1.0:1746129582.802613:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f5:0x0] (2826240->2830335) req@ffff880092fd3480 x1830948734470016/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:323/0 lens 488/0 e 0 to 0 dl 1746129593 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129582.802623:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092fd3480 with x1830948734470016 ext(2826240->2830335) 00002000:00010000:1.0:1746129582.802628:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092fd3480 00000100:00100000:1.0:1746129582.802646:0:21725:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8230 00000100:00100000:1.0:1746129582.802652:0:21725:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092fd3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ada2ffba-8920-4ecb-8068-68caa9806978+36:1962:x1830948734470016:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:1.0:1746129582.802788:0:21725:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092fd3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ada2ffba-8920-4ecb-8068-68caa9806978+36:1962:x1830948734470016:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 136us (500us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746129582.802794:0:21725:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8230 00002000:00100000:1.0:1746129582.802798:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f5:0x0] (2826240->2830335) req@ffff880092fd3480 x1830948734470016/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:323/0 lens 488/4536 e 0 to 0 dl 1746129593 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129582.802805:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092fd3480 with x1830948734470016 ext(2826240->2830335) 00002000:00010000:1.0:1746129582.802807:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092fd3480 00000100:00100000:2.0:1746129582.813338:0:11014:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009507dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11014:1830948737642624:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129582.824540:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129582.824712:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734470272 00000100:00100000:1.0:1746129582.824719:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734470272 00010000:00010000:1.0:1746129582.824746:0:7087:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f118a00/0x40a459093b06bccf lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22467 expref: 11 pid: 4385 timeout: 938 lvb_type: 1 00000100:00100000:1.0:1746129582.824774:0:7087:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8774 00000100:00100000:1.0:1746129582.824780:0:7087:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092fd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:068dab75-d300-4ead-a742-d14572ad1e50+11:1960:x1830948734470272:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129582.824790:0:7087:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129582.824806:0:7087:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f118a00/0x40a459093b06bccf lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22467 expref: 11 pid: 4385 timeout: 938 lvb_type: 1 00010000:00010000:1.0:1746129582.824815:0:7087:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f118a00/0x40a459093b06bccf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22467 expref: 11 pid: 4385 timeout: 938 lvb_type: 1 00010000:00010000:1.0:1746129582.824834:0:7087:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746129582.824869:0:11014:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f118a00/0x40a459093b06bccf lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22467 expref: 11 pid: 4385 timeout: 938 lvb_type: 1 00000100:00100000:0.0:1746129582.824889:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129582.824891:0:11014:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009507d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11014:1830948737642752:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129582.824905:0:15749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734470144 00000100:00100000:2.0:1746129582.824908:0:15749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734470144 00010000:00010000:2.0:1746129582.824920:0:15749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a058f800/0x40a459093b06bc82 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2243d expref: 29 pid: 8412 timeout: 938 lvb_type: 1 00000100:00100000:2.0:1746129582.824934:0:15749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8775 00000100:00100000:2.0:1746129582.824938:0:15749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a46c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+29:1960:x1830948734470144:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129582.824943:0:15749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129582.824950:0:15749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a058f800/0x40a459093b06bc82 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2243d expref: 29 pid: 8412 timeout: 938 lvb_type: 1 00010000:00010000:2.0:1746129582.824958:0:15749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a058f800/0x40a459093b06bc82 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2243d expref: 29 pid: 8412 timeout: 938 lvb_type: 1 00010000:00010000:2.0:1746129582.824967:0:15749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a058f800/0x40a459093b06bc82 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2243d expref: 29 pid: 8412 timeout: 938 lvb_type: 1 00010000:00010000:2.0:1746129582.824973:0:15749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129582.824998:0:15749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a46c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+28:1960:x1830948734470144:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 59us (109us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129582.825002:0:15749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8775 00000100:00100000:2.0:1746129582.825056:0:11014:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009507ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11014:1830948737642880:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129582.825077:0:11014:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093c0c800/0x40a459093b06be88 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [4194304->4448255] (req 4194304->4448255) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22571 expref: 27 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129582.825085:0:11014:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093c0c800, rc 0) 00000100:00100000:2.0:1746129582.825098:0:11014:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092fd0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+27:32737:x1830948734469504:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 27214us (28758us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129582.825103:0:11014:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16945 00000100:00100000:3.0:1746129582.825410:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092fd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+25:1963:x1830948734468864:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 36175us (37084us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129582.825410:0:8417:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092fd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ada2ffba-8920-4ecb-8068-68caa9806978+32:1963:x1830948734469376:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 32321us (33961us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129582.825417:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8227 00000100:00100000:0.0:1746129582.825419:0:8417:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8229 00002000:00100000:3.0:1746129582.825425:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ee:0x0] (1048576->2097151) req@ffff880092fd1880 x1830948734468864/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:323/0 lens 488/440 e 0 to 0 dl 1746129593 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129582.825425:0:8417:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3ee:0x0] (1048576->2097151) req@ffff880092fd0e00 x1830948734469376/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:323/0 lens 488/440 e 0 to 0 dl 1746129593 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129582.825432:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092fd1880 with x1830948734468864 ext(1048576->2097151) 00002000:00100000:0.0:1746129582.825432:0:8417:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092fd0e00 with x1830948734469376 ext(1048576->2097151) 00002000:00010000:3.0:1746129582.825435:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092fd1880 00002000:00010000:0.0:1746129582.825435:0:8417:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092fd0e00 00000100:00100000:1.0:1746129582.825524:0:7087:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092fd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:068dab75-d300-4ead-a742-d14572ad1e50+10:1960:x1830948734470272:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 743us (991us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129582.825529:0:7087:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8774 00000100:00100000:0.0:1746129582.826150:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129582.826262:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129582.826403:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129582.826423:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734470528 00000100:00100000:3.0:1746129582.826428:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734470528 00000100:00100000:1.0:1746129582.826437:0:14551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734470784 00000100:00100000:1.0:1746129582.826439:0:14551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734470784 00000100:00100000:3.0:1746129582.826459:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4858 00000100:00100000:1.0:1746129582.826463:0:14551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4859 00000100:00100000:3.0:1746129582.826464:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092fd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ada2ffba-8920-4ecb-8068-68caa9806978+301:32742:x1830948734470528:12345-192.168.202.4@tcp:35:multiop.0 00000100:00100000:1.0:1746129582.826467:0:14551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092fd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:068dab75-d300-4ead-a742-d14572ad1e50+11:32746:x1830948734470784:12345-192.168.202.4@tcp:35:lfs.0 00000100:00100000:0.0:1746129582.826593:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734470912 00000100:00100000:0.0:1746129582.826596:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734470912 00000100:00100000:3.0:1746129582.826606:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092fd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ada2ffba-8920-4ecb-8068-68caa9806978+302:32742:x1830948734470528:12345-192.168.202.4@tcp:35:multiop.0 Request processed in 141us (457us total) trans 8589945511 rc 0/0 00010000:00010000:0.0:1746129582.826608:0:7087:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012ec79800/0x40a459093b06bc5f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22421 expref: 32 pid: 22480 timeout: 938 lvb_type: 0 00000100:00100000:3.0:1746129582.826612:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4858 00000100:00100000:1.0:1746129582.826703:0:14551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092fd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:068dab75-d300-4ead-a742-d14572ad1e50+12:32746:x1830948734470784:12345-192.168.202.4@tcp:35:lfs.0 Request processed in 235us (441us total) trans 8589945512 rc 0/0 00000100:00100000:1.0:1746129582.826708:0:14551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4859 00000100:00100000:0.0:1746129582.826756:0:7087:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8776 00000100:00100000:0.0:1746129582.826762:0:7087:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092fd3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ada2ffba-8920-4ecb-8068-68caa9806978+32:1962:x1830948734470912:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129582.826770:0:7087:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129582.826781:0:7087:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012ec79800/0x40a459093b06bc5f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22421 expref: 32 pid: 22480 timeout: 938 lvb_type: 0 00010000:00010000:0.0:1746129582.826794:0:7087:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012ec79800/0x40a459093b06bc5f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22421 expref: 32 pid: 22480 timeout: 938 lvb_type: 0 00010000:00010000:0.0:1746129582.826807:0:7087:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ec79800/0x40a459093b06bc5f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22421 expref: 32 pid: 22480 timeout: 938 lvb_type: 0 00010000:00010000:0.0:1746129582.826829:0:7087:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129582.826831:0:7087:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129582.826836:0:7087:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880093c0c800/0x40a459093b06be88 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4448255) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22571 expref: 24 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129582.826843:0:7087:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093c0c800/0x40a459093b06be88 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4448255) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22571 expref: 24 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129582.826865:0:7087:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880093c0c800/0x40a459093b06be88 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4448255) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22571 expref: 24 pid: 11014 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129582.826874:0:7087:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092fd2a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7087:1830948737643008:192.168.202.4@tcp:105: 00000100:00100000:0.0:1746129582.826925:0:7087:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa3ef540 going to sleep for 11 seconds 00000100:00100000:2.0:1746129582.830901:0:7087:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092fd2a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7087:1830948737643008:192.168.202.4@tcp:105: 00010000:00010000:2.0:1746129582.830920:0:7087:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129582.830963:0:7087:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092fd3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ada2ffba-8920-4ecb-8068-68caa9806978+31:1962:x1830948734470912:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 4199us (4562us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129582.830972:0:7087:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8776 00000100:00100000:0.0:1746129582.835865:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129582.835902:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129582.835925:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129582.836043:0:22480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734471168 00000100:00100000:1.0:1746129582.836051:0:22480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734471168 00000100:00100000:0.0:1746129582.836061:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129582.836192:0:22480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734471296 00000100:00100000:1.0:1746129582.836194:0:22480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734471296 00000100:00100000:2.0:1746129582.836235:0:11014:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734471040 00000100:00100000:2.0:1746129582.836239:0:11014:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734471040 00000100:00100000:2.0:1746129582.836263:0:8412:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16946 00000100:00100000:2.0:1746129582.836269:0:8412:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092fd2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ada2ffba-8920-4ecb-8068-68caa9806978+31:1962:x1830948734471168:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129582.836286:0:8412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129582.836319:0:8412:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093c0ca00/0x40a459093b06be9d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f22586 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129582.836359:0:8412:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009507ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8412:1830948737643136:192.168.202.4@tcp:106: 00000100:00100000:2.0:1746129582.836412:0:8412:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132dad900 going to sleep for 11 seconds 00000100:00100000:2.0:1746129582.836424:0:11014:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16947 00000100:00100000:2.0:1746129582.836429:0:11014:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092fd1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ada2ffba-8920-4ecb-8068-68caa9806978+36:1962:x1830948734471296:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129582.836435:0:11014:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129582.836442:0:11014:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093c0c600/0x40a459093b06bea4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2258d expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129582.836460:0:11014:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009507d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11014:1830948737643264:192.168.202.4@tcp:106: 00000100:00100000:2.0:1746129582.836473:0:11014:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132dadcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746129582.836768:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16948 00000100:00100000:3.0:1746129582.836830:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092fd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+25:32740:x1830948734471040:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129582.836837:0:4385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129582.836843:0:4385:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f92e000/0x40a459093b06beab lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2257f expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129582.836857:0:4385:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093c0c800/0x40a459093b06be88 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4448255) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22571 expref: 26 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129582.836868:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129582.836869:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129582.836872:0:4385:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f92e000/0x40a459093b06beab lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2257f expref: 26 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129582.836886:0:4385:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093c0c800/0x40a459093b06be88 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4448255) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22571 expref: 26 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129582.836895:0:4385:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093c0c800/0x40a459093b06be88 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4448255) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22571 expref: 26 pid: 11014 timeout: 938 lvb_type: 0 00000100:00100000:3.0:1746129582.836903:0:4385:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094064e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:4385:1830948737643392:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129582.836927:0:4385:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009518b600 going to sleep for 11 seconds 00000100:00100000:3.0:1746129582.836938:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734471552 00000100:00100000:3.0:1746129582.836940:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734471552 00002000:00100000:3.0:1746129582.836962:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ef:0x0] (4444160->4448255) req@ffff880092fd0a80 x1830948734471552/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:323/0 lens 488/0 e 0 to 0 dl 1746129593 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129582.836968:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092fd0a80 with x1830948734471552 ext(4444160->4448255) 00010000:00010000:3.0:1746129582.836973:0:25745:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093c0c800/0x40a459093b06be88 lrc: 6/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4448255) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22571 expref: 27 pid: 11014 timeout: 938 lvb_type: 0 00010000:00010000:3.0:1746129582.836980:0:25745:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093c0c800/0x40a459093b06be88 lrc: 6/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4448255) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22571 expref: 27 pid: 11014 timeout: 938 lvb_type: 0 00002000:00010000:3.0:1746129582.836986:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092fd0a80 00000100:00100000:3.0:1746129582.837004:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2547 00000100:00100000:3.0:1746129582.837009:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092fd0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+27:1961:x1830948734471552:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:3.0:1746129582.837175:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092fd0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+27:1961:x1830948734471552:12345-192.168.202.4@tcp:3:cat.0 Request processed in 165us (1112us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129582.837181:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2547 00002000:00100000:3.0:1746129582.837187:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ef:0x0] (4444160->4448255) req@ffff880092fd0a80 x1830948734471552/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:323/0 lens 488/4536 e 0 to 0 dl 1746129593 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129582.837193:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092fd0a80 with x1830948734471552 ext(4444160->4448255) 00010000:00010000:3.0:1746129582.837197:0:25745:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093c0c800/0x40a459093b06be88 lrc: 6/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4448255) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22571 expref: 27 pid: 11014 timeout: 938 lvb_type: 0 00010000:00010000:3.0:1746129582.837223:0:25745:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093c0c800/0x40a459093b06be88 lrc: 6/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4448255) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22571 expref: 27 pid: 11014 timeout: 938 lvb_type: 0 00002000:00010000:3.0:1746129582.837229:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092fd0a80 00002000:00010000:2.0:1746129582.840225:0:8412:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb mtime: 1746129582 -> 1746129583 00002000:00010000:2.0:1746129582.840232:0:8412:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb atime: 1746129582 -> 1746129583 00002000:00010000:2.0:1746129582.840234:0:8412:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb ctime: 1746129582 -> 1746129583 00000100:00100000:2.0:1746129582.840257:0:8412:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009507ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8412:1830948737643136:192.168.202.4@tcp:106: 00010000:00010000:2.0:1746129582.840316:0:8412:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093c0ca00/0x40a459093b06be9d lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22586 expref: 32 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129582.840331:0:8412:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093c0ca00/0x40a459093b06be9d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22586 expref: 32 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129582.840360:0:8412:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093c0ca00, rc 0) 00000100:00100000:2.0:1746129582.840415:0:8412:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092fd2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ada2ffba-8920-4ecb-8068-68caa9806978+31:1962:x1830948734471168:12345-192.168.202.4@tcp:101:cat.0 Request processed in 4144us (4556us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129582.840424:0:8412:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16946 00000100:00100000:3.0:1746129582.840654:0:11014:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009507d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11014:1830948737643264:192.168.202.4@tcp:106: 00010000:00010000:3.0:1746129582.840673:0:11014:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093c0c600/0x40a459093b06bea4 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2258d expref: 37 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129582.840682:0:11014:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093c0c600/0x40a459093b06bea4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2258d expref: 37 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129582.840784:0:11014:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093c0c600, rc 0) 00000100:00100000:3.0:1746129582.840809:0:11014:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092fd1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ada2ffba-8920-4ecb-8068-68caa9806978+36:1962:x1830948734471296:12345-192.168.202.4@tcp:101:cat.0 Request processed in 4379us (4906us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129582.840817:0:11014:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16947 00000100:00100000:3.0:1746129582.840843:0:4385:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094064e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:4385:1830948737643392:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129582.840857:0:4385:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f92e000/0x40a459093b06beab lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2257f expref: 26 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129582.840870:0:4385:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f92e000, rc 0) 00000100:00100000:3.0:1746129582.840886:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092fd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+26:32740:x1830948734471040:12345-192.168.202.4@tcp:101:cat.0 Request processed in 4057us (4960us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129582.840891:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16948 00000100:00100000:0.0:1746129582.841063:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129582.841162:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129582.841222:0:14551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734471936 00000100:00100000:2.0:1746129582.841229:0:14551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734471936 00000100:00100000:3.0:1746129582.841406:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734472064 00000100:00100000:3.0:1746129582.841410:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734472064 00002000:00100000:3.0:1746129582.841437:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ef:0x0] (4194304->4448255) req@ffff880092fd1c00 x1830948734472064/t0(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:323/0 lens 488/0 e 0 to 0 dl 1746129593 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129582.841446:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092fd1c00 with x1830948734472064 ext(4194304->4448255) 00010000:00010000:3.0:1746129582.841452:0:25745:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093c0c800/0x40a459093b06be88 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4448255) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22571 expref: 26 pid: 11014 timeout: 938 lvb_type: 0 00010000:00010000:3.0:1746129582.841464:0:25745:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093c0c800/0x40a459093b06be88 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4448255) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22571 expref: 26 pid: 11014 timeout: 938 lvb_type: 0 00002000:00010000:3.0:1746129582.841470:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092fd1c00 00000100:00100000:3.0:1746129582.841491:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2548 00000100:00100000:3.0:1746129582.841498:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092fd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+26:1962:x1830948734472064:12345-192.168.202.4@tcp:4:cat.0 00000100:00100000:2.0:1746129582.842063:0:14551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4860 00000100:00100000:2.0:1746129582.842070:0:14551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934cb450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+16:32737:x1830948734471936:12345-192.168.202.4@tcp:35:multiop.0 00000100:00100000:2.0:1746129582.842269:0:14551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934cb450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+17:32737:x1830948734471936:12345-192.168.202.4@tcp:35:multiop.0 Request processed in 199us (1205us total) trans 8589945513 rc 0/0 00000100:00100000:2.0:1746129582.842275:0:14551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4860 00000100:00100000:2.0:1746129582.843924:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129582.844276:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734472192 00000100:00100000:3.0:1746129582.844285:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734472192 00000100:00100000:3.0:1746129582.844355:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16949 00000100:00100000:3.0:1746129582.844362:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009507ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ada2ffba-8920-4ecb-8068-68caa9806978+31:32745:x1830948734472192:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129582.844378:0:4385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129582.844395:0:4385:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f92ea00/0x40a459093b06beb2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f22594 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129582.844421:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129582.844426:0:4385:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f92ea00/0x40a459093b06beb2 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22594 expref: 32 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129582.844436:0:4385:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f92ea00/0x40a459093b06beb2 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22594 expref: 32 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129582.844446:0:4385:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f92ea00, rc 0) 00000100:00100000:3.0:1746129582.844494:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009507ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ada2ffba-8920-4ecb-8068-68caa9806978+32:32745:x1830948734472192:12345-192.168.202.4@tcp:101:cat.0 Request processed in 132us (578us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129582.844500:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16949 00000100:00100000:2.0:1746129582.847648:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092fd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+28:1962:x1830948734472064:12345-192.168.202.4@tcp:4:cat.0 Request processed in 6139us (6473us total) trans 21474841463 rc 0/0 00000100:00100000:2.0:1746129582.847660:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2548 00002000:00100000:2.0:1746129582.847672:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ef:0x0] (4194304->4448255) req@ffff880092fd1c00 x1830948734472064/t21474841463(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:323/0 lens 488/448 e 0 to 0 dl 1746129593 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129582.847680:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092fd1c00 with x1830948734472064 ext(4194304->4448255) 00010000:00010000:2.0:1746129582.847690:0:25745:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093c0c800/0x40a459093b06be88 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4448255) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22571 expref: 28 pid: 11014 timeout: 938 lvb_type: 0 00010000:00010000:2.0:1746129582.847704:0:25745:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093c0c800/0x40a459093b06be88 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4448255) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22571 expref: 28 pid: 11014 timeout: 938 lvb_type: 0 00002000:00010000:2.0:1746129582.847716:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092fd1c00 00000100:00100000:0.0:1746129582.852263:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129582.852491:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734472320 00000100:00100000:2.0:1746129582.852502:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734472320 00010000:00010000:2.0:1746129582.852543:0:7087:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093c0c800/0x40a459093b06be88 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4448255) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22571 expref: 28 pid: 11014 timeout: 938 lvb_type: 0 00000100:00100000:2.0:1746129582.852597:0:7087:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8777 00000100:00100000:2.0:1746129582.852607:0:7087:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092fd3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+28:1961:x1830948734472320:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129582.852624:0:7087:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129582.852652:0:7087:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093c0c800/0x40a459093b06be88 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4448255) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22571 expref: 28 pid: 11014 timeout: 938 lvb_type: 0 00010000:00010000:2.0:1746129582.852666:0:7087:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093c0c800/0x40a459093b06be88 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4448255) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22571 expref: 28 pid: 11014 timeout: 938 lvb_type: 0 00010000:00010000:2.0:1746129582.852693:0:7087:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093c0c800/0x40a459093b06be88 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4448255) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22571 expref: 28 pid: 11014 timeout: 938 lvb_type: 0 00010000:00010000:2.0:1746129582.852709:0:7087:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129582.852711:0:7087:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129582.852719:0:7087:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f92e000/0x40a459093b06beab lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2257f expref: 27 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129582.852729:0:7087:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f92e000/0x40a459093b06beab lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2257f expref: 27 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129582.852742:0:7087:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129582.852744:0:7087:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129582.852748:0:7087:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f92ea00/0x40a459093b06beb2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22594 expref: 31 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129582.852755:0:7087:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f92ea00/0x40a459093b06beb2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22594 expref: 31 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129582.852790:0:7087:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f92ea00/0x40a459093b06beb2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22594 expref: 31 pid: 4385 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129582.852803:0:7087:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009507dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7087:1830948737643520:192.168.202.4@tcp:105: 00010000:00010000:2.0:1746129582.852909:0:7087:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f92e000/0x40a459093b06beab lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2257f expref: 27 pid: 4385 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129582.852917:0:7087:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009507d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7087:1830948737643648:192.168.202.4@tcp:105: 00000100:00100000:2.0:1746129582.852934:0:7087:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132dade40 going to sleep for 11 seconds 00000100:00100000:2.0:1746129582.856012:0:7087:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009507dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7087:1830948737643520:192.168.202.4@tcp:105: 00000100:00100000:2.0:1746129582.856027:0:7087:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009507d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7087:1830948737643648:192.168.202.4@tcp:105: 00010000:00010000:2.0:1746129582.856053:0:7087:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129582.856111:0:7087:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092fd3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+27:1961:x1830948734472320:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 3505us (3859us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129582.856121:0:7087:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8777 00000100:00100000:0.0:1746129582.858463:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129582.858570:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734472576 00000100:00100000:2.0:1746129582.858581:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734472576 00002000:00100000:2.0:1746129582.858627:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ef:0x0] (2097152->3145727) req@ffff880092fd0700 x1830948734472576/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:323/0 lens 488/0 e 0 to 0 dl 1746129593 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129582.858636:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092fd0700 with x1830948734472576 ext(2097152->3145727) 00002000:00010000:2.0:1746129582.858641:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092fd0700 00000100:00100000:2.0:1746129582.858667:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8231 00000100:00100000:2.0:1746129582.858674:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092fd0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+27:1963:x1830948734472576:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129582.862777:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129582.862812:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129582.862950:0:8417:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734472832 00000100:00100000:1.0:1746129582.862962:0:8417:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734472832 00000100:00100000:0.0:1746129582.862989:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00002000:00100000:1.0:1746129582.863005:0:8417:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3ef:0x0] (2097152->3145727) req@ffff88009c7d9180 x1830948734472832/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:323/0 lens 488/0 e 0 to 0 dl 1746129593 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129582.863015:0:8417:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7d9180 with x1830948734472832 ext(2097152->3145727) 00002000:00010000:1.0:1746129582.863019:0:8417:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c7d9180 00000100:00100000:1.0:1746129582.863043:0:8417:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734473088 00000100:00100000:1.0:1746129582.863046:0:8417:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734473088 00002000:00100000:1.0:1746129582.863057:0:8417:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->4194303) req@ffff880131454380 x1830948734473088/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:323/0 lens 488/0 e 0 to 0 dl 1746129593 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129582.863063:0:8417:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131454380 with x1830948734473088 ext(3145728->4194303) 00002000:00010000:1.0:1746129582.863065:0:8417:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880131454380 00000100:00100000:2.0:1746129582.863071:0:31522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734473344 00000100:00100000:2.0:1746129582.863078:0:31522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734473344 00000100:00100000:1.0:1746129582.863094:0:8417:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8232 00000100:00100000:1.0:1746129582.863100:0:8417:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ada2ffba-8920-4ecb-8068-68caa9806978+33:1962:x1830948734472832:12345-192.168.202.4@tcp:3:cat.0 00002000:00100000:2.0:1746129582.863111:0:31522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f5:0x0] (2097152->3469311) req@ffff880131454e00 x1830948734473344/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:323/0 lens 504/0 e 0 to 0 dl 1746129593 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129582.863119:0:31522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131454e00 with x1830948734473344 ext(2097152->3469311) 00002000:00010000:2.0:1746129582.863124:0:31522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880131454e00 00000100:00100000:2.0:1746129582.863149:0:31522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8233 00000100:00100000:2.0:1746129582.863156:0:31522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131454380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ada2ffba-8920-4ecb-8068-68caa9806978+33:1962:x1830948734473088:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:3.0:1746129582.863712:0:31518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8234 00000100:00100000:3.0:1746129582.863721:0:31518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131454e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ada2ffba-8920-4ecb-8068-68caa9806978+36:1962:x1830948734473344:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:2.0:1746129582.879886:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092fd0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+27:1963:x1830948734472576:12345-192.168.202.4@tcp:3:cat.0 Request processed in 21199us (21416us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129582.879899:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8231 00002000:00100000:2.0:1746129582.879911:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ef:0x0] (2097152->3145727) req@ffff880092fd0700 x1830948734472576/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:323/0 lens 488/440 e 0 to 0 dl 1746129593 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129582.879921:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092fd0700 with x1830948734472576 ext(2097152->3145727) 00002000:00010000:2.0:1746129582.879927:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092fd0700 00000100:00100000:0.0:1746129582.884919:0:8417:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ada2ffba-8920-4ecb-8068-68caa9806978+34:1962:x1830948734472832:12345-192.168.202.4@tcp:3:cat.0 Request processed in 21804us (22140us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129582.884933:0:8417:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8232 00002000:00100000:0.0:1746129582.884950:0:8417:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3ef:0x0] (2097152->3145727) req@ffff88009c7d9180 x1830948734472832/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:323/0 lens 488/440 e 0 to 0 dl 1746129593 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129582.884960:0:8417:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7d9180 with x1830948734472832 ext(2097152->3145727) 00002000:00010000:0.0:1746129582.884966:0:8417:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c7d9180 00000100:00100000:0.0:1746129582.892481:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129582.892640:0:11014:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734473472 00000100:00100000:2.0:1746129582.892649:0:11014:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734473472 00000100:00100000:2.0:1746129582.892696:0:11014:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16950 00000100:00100000:2.0:1746129582.892703:0:11014:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131454a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+26:32740:x1830948734473472:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129582.892721:0:11014:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129582.892739:0:11014:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e0c4200/0x40a459093b06beb9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2259b expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129582.892769:0:11014:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f85b000/0x40a459093b06be50 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->3469311] (req 2318336->2830335) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22547 expref: 37 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129582.892777:0:11014:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129582.892779:0:11014:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129582.892782:0:11014:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e0c4200/0x40a459093b06beb9 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2259b expref: 27 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129582.892812:0:11014:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f85b000/0x40a459093b06be50 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->3469311] (req 2318336->2830335) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22547 expref: 37 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129582.892824:0:11014:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f85b000/0x40a459093b06be50 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->3469311] (req 2318336->2830335) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22547 expref: 37 pid: 4385 timeout: 938 lvb_type: 0 00000100:00100000:2.0:1746129582.892835:0:11014:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009507d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11014:1830948737643776:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129582.892921:0:11014:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132dade40 going to sleep for 11 seconds 00000100:00100000:3.0:1746129582.892945:0:31522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131454380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ada2ffba-8920-4ecb-8068-68caa9806978+32:1962:x1830948734473088:12345-192.168.202.4@tcp:3:cat.0 Request processed in 29787us (30129us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129582.892956:0:31522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8233 00002000:00100000:3.0:1746129582.892966:0:31522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->4194303) req@ffff880131454380 x1830948734473088/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:323/0 lens 488/440 e 0 to 0 dl 1746129593 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129582.892975:0:31522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131454380 with x1830948734473088 ext(3145728->4194303) 00002000:00010000:3.0:1746129582.892980:0:31522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880131454380 00000100:00100000:2.0:1746129582.896436:0:11014:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009507d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11014:1830948737643776:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129582.896474:0:11014:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012e0c4200/0x40a459093b06beb9 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2259b expref: 27 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129582.896493:0:11014:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e0c4200, rc 0) 00000100:00100000:2.0:1746129582.896542:0:11014:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131454a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+27:32740:x1830948734473472:12345-192.168.202.4@tcp:101:cat.0 Request processed in 3838us (4071us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129582.896551:0:11014:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16950 00000100:00100000:3.0:1746129582.897617:0:31518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131454e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ada2ffba-8920-4ecb-8068-68caa9806978+36:1962:x1830948734473344:12345-192.168.202.4@tcp:3:cat.0 Request processed in 33893us (34623us total) trans 0 rc 860160/860160 00000100:00100000:3.0:1746129582.897626:0:31518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8234 00002000:00100000:3.0:1746129582.897637:0:31518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3f5:0x0] (2097152->3469311) req@ffff880131454e00 x1830948734473344/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:323/0 lens 504/440 e 0 to 0 dl 1746129593 ref 1 fl Complete:/200/0 rc 860160/860160 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129582.897647:0:31518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131454e00 with x1830948734473344 ext(2097152->3469311) 00010000:00010000:3.0:1746129582.897656:0:31518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f85b000/0x40a459093b06be50 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->3469311] (req 2318336->2830335) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22547 expref: 36 pid: 4385 timeout: 938 lvb_type: 0 00010000:00010000:3.0:1746129582.897668:0:31518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f85b000/0x40a459093b06be50 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->3469311] (req 2318336->2830335) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22547 expref: 36 pid: 4385 timeout: 938 lvb_type: 0 00002000:00010000:3.0:1746129582.897675:0:31518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880131454e00 00000100:00100000:0.0:1746129582.898835:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129582.898992:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129582.899058:0:31518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734473600 00000100:00100000:3.0:1746129582.899066:0:31518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734473600 00002000:00100000:3.0:1746129582.899103:0:31518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3f5:0x0] (2318336->2830335) req@ffff880131454000 x1830948734473600/t0(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:323/0 lens 488/0 e 0 to 0 dl 1746129593 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129582.899111:0:31518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131454000 with x1830948734473600 ext(2318336->2830335) 00010000:00010000:3.0:1746129582.899118:0:31518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f85b000/0x40a459093b06be50 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->3469311] (req 2318336->2830335) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22547 expref: 36 pid: 4385 timeout: 938 lvb_type: 0 00010000:00010000:3.0:1746129582.899127:0:31518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f85b000/0x40a459093b06be50 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->3469311] (req 2318336->2830335) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22547 expref: 36 pid: 4385 timeout: 938 lvb_type: 0 00002000:00010000:3.0:1746129582.899134:0:31518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880131454000 00000100:00100000:3.0:1746129582.899151:0:31518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2549 00000100:00100000:3.0:1746129582.899158:0:31518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131454000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ada2ffba-8920-4ecb-8068-68caa9806978+36:1963:x1830948734473600:12345-192.168.202.4@tcp:4:cat.0 00000100:00100000:2.0:1746129582.899972:0:11014:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734473728 00000100:00100000:2.0:1746129582.899978:0:11014:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734473728 00000100:00100000:2.0:1746129582.900009:0:11014:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16951 00000100:00100000:2.0:1746129582.900014:0:11014:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131455880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ada2ffba-8920-4ecb-8068-68caa9806978+38:32745:x1830948734473728:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129582.900023:0:11014:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129582.900038:0:11014:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e0c5800/0x40a459093b06bec0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f225a2 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129582.900060:0:11014:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129582.900064:0:11014:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e0c5800/0x40a459093b06bec0 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f225a2 expref: 39 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129582.900075:0:11014:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012e0c5800/0x40a459093b06bec0 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f225a2 expref: 39 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129582.900085:0:11014:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e0c5800, rc 0) 00000100:00100000:2.0:1746129582.901610:0:11014:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131455880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ada2ffba-8920-4ecb-8068-68caa9806978+39:32745:x1830948734473728:12345-192.168.202.4@tcp:101:cat.0 Request processed in 1585us (2607us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129582.901619:0:11014:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16951 00000100:00100000:3.0:1746129582.907672:0:31518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131454000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ada2ffba-8920-4ecb-8068-68caa9806978+39:1963:x1830948734473600:12345-192.168.202.4@tcp:4:cat.0 Request processed in 8500us (8828us total) trans 17179874214 rc 0/0 00000100:00100000:3.0:1746129582.907685:0:31518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2549 00002000:00100000:3.0:1746129582.907700:0:31518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3f5:0x0] (2318336->2830335) req@ffff880131454000 x1830948734473600/t17179874214(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:323/0 lens 488/448 e 0 to 0 dl 1746129593 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129582.907709:0:31518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131454000 with x1830948734473600 ext(2318336->2830335) 00010000:00010000:3.0:1746129582.907720:0:31518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f85b000/0x40a459093b06be50 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->3469311] (req 2318336->2830335) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22547 expref: 39 pid: 4385 timeout: 938 lvb_type: 0 00010000:00010000:3.0:1746129582.907736:0:31518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f85b000/0x40a459093b06be50 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->3469311] (req 2318336->2830335) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22547 expref: 39 pid: 4385 timeout: 938 lvb_type: 0 00002000:00010000:3.0:1746129582.907743:0:31518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880131454000 00000100:00100000:0.0:1746129582.912757:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129582.913116:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734473856 00000100:00100000:2.0:1746129582.913124:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734473856 00010000:00010000:2.0:1746129582.913162:0:7087:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f85b000/0x40a459093b06be50 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->3469311] (req 2318336->2830335) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22547 expref: 39 pid: 4385 timeout: 938 lvb_type: 0 00000100:00100000:2.0:1746129582.913203:0:7087:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8778 00000100:00100000:2.0:1746129582.913221:0:7087:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131455500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ada2ffba-8920-4ecb-8068-68caa9806978+39:1963:x1830948734473856:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129582.913236:0:7087:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129582.913260:0:7087:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f85b000/0x40a459093b06be50 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [0->3469311] (req 2318336->2830335) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22547 expref: 39 pid: 4385 timeout: 938 lvb_type: 0 00010000:00010000:2.0:1746129582.913272:0:7087:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f85b000/0x40a459093b06be50 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [0->3469311] (req 2318336->2830335) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22547 expref: 39 pid: 4385 timeout: 938 lvb_type: 0 00010000:00010000:2.0:1746129582.913324:0:7087:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f85b000/0x40a459093b06be50 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [0->3469311] (req 2318336->2830335) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22547 expref: 39 pid: 4385 timeout: 938 lvb_type: 0 00010000:00010000:2.0:1746129582.913355:0:7087:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129582.913356:0:7087:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129582.913363:0:7087:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e0c4200/0x40a459093b06beb9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2259b expref: 26 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129582.913371:0:7087:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e0c4200/0x40a459093b06beb9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2259b expref: 26 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129582.913379:0:7087:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129582.913380:0:7087:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129582.913384:0:7087:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e0c5800/0x40a459093b06bec0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f225a2 expref: 38 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129582.913389:0:7087:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e0c5800/0x40a459093b06bec0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f225a2 expref: 38 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129582.913419:0:7087:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012e0c5800/0x40a459093b06bec0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f225a2 expref: 38 pid: 11014 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129582.913432:0:7087:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009507d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7087:1830948737643904:192.168.202.4@tcp:105: 00010000:00010000:2.0:1746129582.913532:0:7087:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012e0c4200/0x40a459093b06beb9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2259b expref: 26 pid: 11014 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129582.913540:0:7087:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009507dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7087:1830948737644032:192.168.202.4@tcp:105: 00000100:00100000:2.0:1746129582.913558:0:7087:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132dade40 going to sleep for 11 seconds 00000100:00100000:2.0:1746129582.914965:0:7087:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009507d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7087:1830948737643904:192.168.202.4@tcp:105: 00000100:00100000:2.0:1746129582.914976:0:7087:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009507dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7087:1830948737644032:192.168.202.4@tcp:105: 00010000:00010000:2.0:1746129582.914998:0:7087:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129582.915030:0:7087:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131455500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ada2ffba-8920-4ecb-8068-68caa9806978+38:1963:x1830948734473856:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 1810us (2283us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129582.915039:0:7087:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8778 00000100:00100000:0.0:1746129582.922812:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129582.922869:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129582.923029:0:31518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734474496 00000100:00100000:3.0:1746129582.923039:0:31518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734474496 00002000:00100000:3.0:1746129582.923090:0:31518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->4194303) req@ffff880131455c00 x1830948734474496/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:323/0 lens 488/0 e 0 to 0 dl 1746129593 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129582.923101:0:31518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131455c00 with x1830948734474496 ext(3145728->4194303) 00002000:00010000:3.0:1746129582.923106:0:31518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880131455c00 00000100:00100000:3.0:1746129582.923121:0:31518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734474368 00000100:00100000:3.0:1746129582.923123:0:31518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734474368 00002000:00100000:3.0:1746129582.923133:0:31518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3f5:0x0] (2097152->3145727) req@ffff88009f327b80 x1830948734474368/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:323/0 lens 488/0 e 0 to 0 dl 1746129593 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129582.923139:0:31518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f327b80 with x1830948734474368 ext(2097152->3145727) 00002000:00010000:3.0:1746129582.923142:0:31518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f327b80 00000100:00100000:3.0:1746129582.923167:0:31518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8235 00000100:00100000:3.0:1746129582.923174:0:31518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131455c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+27:1963:x1830948734474496:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:1.0:1746129582.924609:0:31522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8236 00000100:00100000:1.0:1746129582.924623:0:31522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f327b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+27:1962:x1830948734474368:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129582.925374:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129582.925401:0:8417:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734474624 00000100:00100000:0.0:1746129582.925408:0:8417:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734474624 00002000:00100000:0.0:1746129582.926041:0:8417:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3f5:0x0] (2097152->3145727) req@ffff88009f324700 x1830948734474624/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:323/0 lens 488/0 e 0 to 0 dl 1746129593 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129582.926051:0:8417:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f324700 with x1830948734474624 ext(2097152->3145727) 00002000:00010000:0.0:1746129582.926056:0:8417:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f324700 00000100:00100000:0.0:1746129582.926076:0:8417:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8237 00000100:00100000:0.0:1746129582.926083:0:8417:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f324700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ada2ffba-8920-4ecb-8068-68caa9806978+38:1963:x1830948734474624:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:3.0:1746129582.937999:0:31518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131455c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+27:1963:x1830948734474496:12345-192.168.202.4@tcp:3:cat.0 Request processed in 14810us (15183us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129582.938012:0:31518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8235 00002000:00100000:3.0:1746129582.938027:0:31518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->4194303) req@ffff880131455c00 x1830948734474496/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:323/0 lens 488/440 e 0 to 0 dl 1746129593 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129582.938037:0:31518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131455c00 with x1830948734474496 ext(3145728->4194303) 00002000:00010000:3.0:1746129582.938044:0:31518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880131455c00 00000100:00100000:1.0:1746129582.946826:0:31522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f327b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+27:1962:x1830948734474368:12345-192.168.202.4@tcp:3:cat.0 Request processed in 22194us (23942us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129582.946839:0:31522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8236 00002000:00100000:1.0:1746129582.946851:0:31522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f5:0x0] (2097152->3145727) req@ffff88009f327b80 x1830948734474368/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:323/0 lens 488/440 e 0 to 0 dl 1746129593 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129582.946861:0:31522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f327b80 with x1830948734474368 ext(2097152->3145727) 00002000:00010000:1.0:1746129582.946875:0:31522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f327b80 00000100:00100000:2.0:1746129582.952694:0:8417:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f324700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ada2ffba-8920-4ecb-8068-68caa9806978+38:1963:x1830948734474624:12345-192.168.202.4@tcp:3:cat.0 Request processed in 26597us (27308us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129582.952707:0:8417:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8237 00002000:00100000:2.0:1746129582.952720:0:8417:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3f5:0x0] (2097152->3145727) req@ffff88009f324700 x1830948734474624/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:323/0 lens 488/440 e 0 to 0 dl 1746129593 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129582.952729:0:8417:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f324700 with x1830948734474624 ext(2097152->3145727) 00002000:00010000:2.0:1746129582.952735:0:8417:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f324700 00000100:00100000:0.0:1746129582.960812:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129582.961071:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734474880 00000100:00100000:3.0:1746129582.961082:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734474880 00000100:00100000:3.0:1746129582.961147:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11383 00000100:00100000:3.0:1746129582.961155:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800912ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ada2ffba-8920-4ecb-8068-68caa9806978+302:32751:x1830948734474880:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:3.0:1746129582.961181:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129582.961201:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f92e800/0x40a459093b06bec7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f225a9 expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129582.961374:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa7e000/0x40a459093b06bece lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746129582.961389:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa7e000/0x40a459093b06bece lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746129582.961402:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa7e000/0x40a459093b06bece lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000004:00200000:3.0:1746129582.961414:0:14548:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:3.0:1746129582.961536:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f92e800/0x40a459093b06bec7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f225a9 expref: 305 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129582.961570:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa7e000/0x40a459093b06bece lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f225a9 expref: 304 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129582.961577:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009cffe100) 00010000:00010000:3.0:1746129582.961580:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746129582.961584:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fa7e000, rc 0) 00000100:00100000:3.0:1746129582.961638:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800912ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ada2ffba-8920-4ecb-8068-68caa9806978+304:32751:x1830948734474880:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 483us (984us total) trans 8589945514 rc 0/0 00000100:00100000:3.0:1746129582.961643:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11383 00000100:00100000:3.0:1746129582.963473:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129582.963534:0:11014:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734475008 00000100:00100000:2.0:1746129582.963542:0:11014:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734475008 00000100:00100000:3.0:1746129582.963632:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129582.963774:0:11014:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734475136 00000100:00100000:2.0:1746129582.963777:0:11014:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734475136 00000100:00100000:2.0:1746129582.963807:0:11014:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16952 00000100:00100000:2.0:1746129582.963815:0:11014:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094064e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ada2ffba-8920-4ecb-8068-68caa9806978+38:32745:x1830948734475008:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129582.963830:0:11014:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129582.963844:0:11014:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800952b0e00/0x40a459093b06bedc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f225b0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129582.963871:0:11014:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fab5c00/0x40a459093b06be5e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [3469312->18446744073709551615] (req 3469312->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22555 expref: 27 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129582.963878:0:11014:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129582.963880:0:11014:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129582.963884:0:11014:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800952b0e00/0x40a459093b06bedc lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f225b0 expref: 39 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129582.963914:0:11014:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fab5c00/0x40a459093b06be5e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [3469312->18446744073709551615] (req 3469312->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22555 expref: 27 pid: 22480 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129582.963915:0:22480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16953 00000100:00100000:0.0:1746129582.963923:0:22480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094065880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+27:32740:x1830948734475136:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129582.963925:0:11014:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fab5c00/0x40a459093b06be5e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [3469312->18446744073709551615] (req 3469312->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22555 expref: 27 pid: 22480 timeout: 938 lvb_type: 0 00010000:00010000:0.0:1746129582.963930:0:22480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129582.963936:0:22480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800919f0200/0x40a459093b06bee3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f225b7 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129582.963937:0:11014:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009507dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11014:1830948737644160:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129582.963947:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129582.963950:0:22480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800919f0200/0x40a459093b06bee3 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f225b7 expref: 28 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129582.963958:0:22480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800919f0200/0x40a459093b06bee3 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f225b7 expref: 28 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129582.963966:0:22480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800919f0200, rc 0) 00000100:00100000:0.0:1746129582.964007:0:22480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094065880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+28:32740:x1830948734475136:12345-192.168.202.4@tcp:101:cat.0 Request processed in 83us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129582.964013:0:22480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16953 00000100:00100000:2.0:1746129582.964509:0:11014:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132dade40 going to sleep for 11 seconds 00000100:00100000:2.0:1746129582.965618:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129582.965667:0:8412:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734475264 00000100:00100000:3.0:1746129582.965674:0:8412:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734475264 00000100:00100000:3.0:1746129582.965704:0:8412:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16954 00000100:00100000:3.0:1746129582.965710:0:8412:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009507d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ada2ffba-8920-4ecb-8068-68caa9806978+32:32751:x1830948734475264:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:3.0:1746129582.965723:0:8412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129582.965737:0:8412:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fa7e400/0x40a459093b06beea lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f225be expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129582.965758:0:8412:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ec72000/0x40a459093b06bb78 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22380 expref: 33 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129582.965766:0:8412:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5897a00/0x40a459093b06bcba lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2244b expref: 9 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129582.965777:0:8412:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f119e00/0x40a459093b06bbef lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f223db expref: 26 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129582.965783:0:8412:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129582.965785:0:8412:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129582.965789:0:8412:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fa7e400/0x40a459093b06beea lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [704512->753663] (req 704512->753663) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f225be expref: 33 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129582.965814:0:8412:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f119e00/0x40a459093b06bbef lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f223db expref: 26 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129582.965823:0:8412:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f119e00/0x40a459093b06bbef lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f223db expref: 26 pid: 22480 timeout: 938 lvb_type: 1 00000100:00100000:3.0:1746129582.965833:0:8412:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094067100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8412:1830948737644288:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129582.965893:0:8412:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5897a00/0x40a459093b06bcba lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2244b expref: 9 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129582.965901:0:8412:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5897a00/0x40a459093b06bcba lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2244b expref: 9 pid: 8412 timeout: 938 lvb_type: 1 00000100:00100000:3.0:1746129582.965909:0:8412:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094064380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8412:1830948737644416:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129582.965935:0:8412:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012ec72000/0x40a459093b06bb78 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22380 expref: 33 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129582.965946:0:8412:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012ec72000/0x40a459093b06bb78 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22380 expref: 33 pid: 4385 timeout: 938 lvb_type: 0 00000100:00100000:3.0:1746129582.965954:0:8412:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094065f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8412:1830948737644544:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129582.966245:0:8412:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009518b9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129582.969677:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129582.969799:0:11014:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009507dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11014:1830948737644160:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129582.969835:0:11014:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800952b0e00/0x40a459093b06bedc lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f225b0 expref: 39 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129582.969857:0:11014:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800952b0e00, rc 0) 00000100:00100000:2.0:1746129582.969919:0:11014:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094064e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ada2ffba-8920-4ecb-8068-68caa9806978+39:32745:x1830948734475008:12345-192.168.202.4@tcp:101:cat.0 Request processed in 6103us (6452us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129582.969928:0:11014:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16952 00000100:00100000:3.0:1746129582.970163:0:8417:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734475392 00000100:00100000:3.0:1746129582.970170:0:8417:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734475392 00002000:00100000:3.0:1746129582.970220:0:8417:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3f5:0x0] (3469312->4194303) req@ffff8800912ac380 x1830948734475392/t0(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:323/0 lens 488/0 e 0 to 0 dl 1746129593 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129582.970229:0:8417:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800912ac380 with x1830948734475392 ext(3469312->4194303) 00010000:00010000:3.0:1746129582.970236:0:8417:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fab5c00/0x40a459093b06be5e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [3469312->18446744073709551615] (req 3469312->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22555 expref: 28 pid: 22480 timeout: 938 lvb_type: 0 00010000:00010000:3.0:1746129582.970247:0:8417:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fab5c00/0x40a459093b06be5e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [3469312->18446744073709551615] (req 3469312->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22555 expref: 28 pid: 22480 timeout: 938 lvb_type: 0 00002000:00010000:3.0:1746129582.970254:0:8417:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800912ac380 00000100:00100000:3.0:1746129582.970271:0:8417:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2550 00000100:00100000:3.0:1746129582.970278:0:8417:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800912ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+28:1962:x1830948734475392:12345-192.168.202.4@tcp:4:cat.0 00000100:00100000:0.0:1746129582.971685:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129582.971721:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734475648 00000100:00100000:0.0:1746129582.971726:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734475648 00010000:00010000:0.0:1746129582.971750:0:7087:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f119e00/0x40a459093b06bbef lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f223db expref: 27 pid: 22480 timeout: 938 lvb_type: 1 00000100:00100000:0.0:1746129582.971786:0:7087:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8779 00000100:00100000:0.0:1746129582.971793:0:7087:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013145f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+27:1963:x1830948734475648:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129582.971805:0:7087:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746129582.971821:0:8412:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094067100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8412:1830948737644288:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129582.971825:0:7087:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f119e00/0x40a459093b06bbef lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f223db expref: 27 pid: 22480 timeout: 938 lvb_type: 1 00000100:00100000:2.0:1746129582.971830:0:8412:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094064380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8412:1830948737644416:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129582.971836:0:7087:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f119e00/0x40a459093b06bbef lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f223db expref: 27 pid: 22480 timeout: 938 lvb_type: 1 00000100:00100000:2.0:1746129582.971840:0:8412:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094065f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8412:1830948737644544:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129582.971859:0:7087:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f119e00/0x40a459093b06bbef lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f223db expref: 27 pid: 22480 timeout: 938 lvb_type: 1 00010000:00010000:2.0:1746129582.971873:0:8412:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fa7e400/0x40a459093b06beea lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [704512->753663] (req 704512->753663) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f225be expref: 33 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129582.971883:0:8412:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fa7e400, rc 0) 00000100:00100000:2.0:1746129582.971922:0:8412:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009507d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ada2ffba-8920-4ecb-8068-68caa9806978+33:32751:x1830948734475264:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 6212us (6309us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129582.971928:0:8412:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16954 00010000:00010000:0.0:1746129582.972696:0:7087:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129582.972722:0:7087:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013145f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+26:1963:x1830948734475648:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 927us (1040us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129582.972729:0:7087:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8779 00000100:00100000:2.0:1746129582.972748:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129582.972770:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734475520 00000100:00100000:0.0:1746129582.972774:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734475520 00010000:00010000:0.0:1746129582.972790:0:7087:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5897a00/0x40a459093b06bcba lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2244b expref: 10 pid: 8412 timeout: 938 lvb_type: 1 00000100:00100000:0.0:1746129582.972806:0:7087:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8780 00000100:00100000:0.0:1746129582.972811:0:7087:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009507dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:068dab75-d300-4ead-a742-d14572ad1e50+10:1961:x1830948734475520:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129582.972820:0:7087:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129582.972830:0:7087:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5897a00/0x40a459093b06bcba lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2244b expref: 10 pid: 8412 timeout: 938 lvb_type: 1 00010000:00010000:0.0:1746129582.972839:0:7087:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5897a00/0x40a459093b06bcba lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2244b expref: 10 pid: 8412 timeout: 938 lvb_type: 1 00010000:00010000:0.0:1746129582.972852:0:7087:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5897a00/0x40a459093b06bcba lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2244b expref: 10 pid: 8412 timeout: 938 lvb_type: 1 00010000:00010000:0.0:1746129582.972861:0:7087:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129582.972892:0:7087:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009507dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:068dab75-d300-4ead-a742-d14572ad1e50+9:1961:x1830948734475520:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 80us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129582.972897:0:7087:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8780 00000100:00100000:0.0:1746129582.973662:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129582.974404:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734475776 00000100:00100000:2.0:1746129582.974413:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734475776 00010000:00010000:2.0:1746129582.974445:0:7087:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012ec72000/0x40a459093b06bb78 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22380 expref: 33 pid: 4385 timeout: 938 lvb_type: 0 00000100:00100000:2.0:1746129582.974800:0:7087:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8781 00000100:00100000:2.0:1746129582.974808:0:7087:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013145d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ada2ffba-8920-4ecb-8068-68caa9806978+33:1960:x1830948734475776:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129582.974823:0:7087:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129582.974846:0:7087:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012ec72000/0x40a459093b06bb78 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22380 expref: 33 pid: 4385 timeout: 938 lvb_type: 0 00010000:00010000:2.0:1746129582.974857:0:7087:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012ec72000/0x40a459093b06bb78 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22380 expref: 33 pid: 4385 timeout: 938 lvb_type: 0 00010000:00010000:2.0:1746129582.974878:0:7087:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ec72000/0x40a459093b06bb78 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22380 expref: 33 pid: 4385 timeout: 938 lvb_type: 0 00010000:00010000:2.0:1746129582.974912:0:7087:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129582.974914:0:7087:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129582.974922:0:7087:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fa7e400/0x40a459093b06beea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 704512->753663) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f225be expref: 32 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129582.974930:0:7087:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fa7e400/0x40a459093b06beea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 704512->753663) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f225be expref: 32 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129582.974966:0:7087:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009fa7e400/0x40a459093b06beea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 704512->753663) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f225be expref: 32 pid: 8412 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129582.974976:0:7087:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009507c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7087:1830948737644672:192.168.202.4@tcp:105: 00000100:00100000:2.0:1746129582.975051:0:7087:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132dade40 going to sleep for 11 seconds 00000100:00100000:2.0:1746129582.980900:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129582.981012:0:7087:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009507c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7087:1830948737644672:192.168.202.4@tcp:105: 00010000:00010000:3.0:1746129582.981037:0:7087:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129582.981084:0:7087:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013145d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ada2ffba-8920-4ecb-8068-68caa9806978+32:1960:x1830948734475776:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 6275us (7424us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129582.981096:0:7087:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8781 00000100:00100000:0.0:1746129582.981147:0:31522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734476032 00000100:00100000:0.0:1746129582.981154:0:31522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734476032 00002000:00100000:0.0:1746129582.981192:0:31522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3ec:0x0] (704512->708607) req@ffff88009507d880 x1830948734476032/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:323/0 lens 488/0 e 0 to 0 dl 1746129593 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129582.981199:0:31522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009507d880 with x1830948734476032 ext(704512->708607) 00002000:00010000:0.0:1746129582.981203:0:31522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009507d880 00000100:00100000:0.0:1746129582.981240:0:31522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8238 00000100:00100000:0.0:1746129582.981246:0:31522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009507d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ada2ffba-8920-4ecb-8068-68caa9806978+32:1963:x1830948734476032:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:0.0:1746129582.981491:0:31522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009507d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ada2ffba-8920-4ecb-8068-68caa9806978+32:1963:x1830948734476032:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 244us (601us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746129582.981498:0:31522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8238 00002000:00100000:0.0:1746129582.981503:0:31522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3ec:0x0] (704512->708607) req@ffff88009507d880 x1830948734476032/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:323/0 lens 488/4536 e 0 to 0 dl 1746129593 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129582.981511:0:31522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009507d880 with x1830948734476032 ext(704512->708607) 00002000:00010000:0.0:1746129582.981514:0:31522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009507d880 00000100:00100000:0.0:1746129582.984050:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129582.984148:0:31518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734476288 00000100:00100000:2.0:1746129582.984157:0:31518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734476288 00002000:00100000:2.0:1746129582.984199:0:31518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3ec:0x0] (749568->753663) req@ffff88013145f480 x1830948734476288/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:323/0 lens 488/0 e 0 to 0 dl 1746129593 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129582.984220:0:31518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013145f480 with x1830948734476288 ext(749568->753663) 00002000:00010000:2.0:1746129582.984230:0:31518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013145f480 00000100:00100000:2.0:1746129582.984260:0:31518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8239 00000100:00100000:2.0:1746129582.984268:0:31518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013145f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ada2ffba-8920-4ecb-8068-68caa9806978+32:1960:x1830948734476288:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:2.0:1746129582.984465:0:31518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013145f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ada2ffba-8920-4ecb-8068-68caa9806978+32:1960:x1830948734476288:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 197us (424us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129582.984472:0:31518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8239 00002000:00100000:2.0:1746129582.984478:0:31518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3ec:0x0] (749568->753663) req@ffff88013145f480 x1830948734476288/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:323/0 lens 488/4536 e 0 to 0 dl 1746129593 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129582.984485:0:31518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013145f480 with x1830948734476288 ext(749568->753663) 00002000:00010000:2.0:1746129582.984488:0:31518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013145f480 00000100:00100000:3.0:1746129582.989239:0:8417:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800912ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+30:1962:x1830948734475392:12345-192.168.202.4@tcp:4:cat.0 Request processed in 18948us (19558us total) trans 17179874215 rc 0/0 00000100:00100000:3.0:1746129582.989252:0:8417:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2550 00002000:00100000:3.0:1746129582.989264:0:8417:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3f5:0x0] (3469312->4194303) req@ffff8800912ac380 x1830948734475392/t17179874215(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:323/0 lens 488/448 e 0 to 0 dl 1746129593 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129582.989273:0:8417:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800912ac380 with x1830948734475392 ext(3469312->4194303) 00010000:00010000:3.0:1746129582.989284:0:8417:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fab5c00/0x40a459093b06be5e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [3469312->18446744073709551615] (req 3469312->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22555 expref: 30 pid: 22480 timeout: 938 lvb_type: 0 00010000:00010000:3.0:1746129582.989502:0:8417:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fab5c00/0x40a459093b06be5e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [3469312->18446744073709551615] (req 3469312->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22555 expref: 30 pid: 22480 timeout: 938 lvb_type: 0 00002000:00010000:3.0:1746129582.989510:0:8417:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800912ac380 00000100:00100000:0.0:1746129582.995235:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129582.995366:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734476416 00000100:00100000:3.0:1746129582.995376:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734476416 00010000:00010000:3.0:1746129582.995416:0:7087:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fab5c00/0x40a459093b06be5e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [3469312->18446744073709551615] (req 3469312->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22555 expref: 30 pid: 22480 timeout: 938 lvb_type: 0 00000100:00100000:3.0:1746129582.995467:0:7087:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8782 00000100:00100000:3.0:1746129582.995474:0:7087:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a46850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+30:1961:x1830948734476416:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129582.995488:0:7087:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129582.995512:0:7087:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fab5c00/0x40a459093b06be5e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 7 type: EXT [3469312->18446744073709551615] (req 3469312->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22555 expref: 30 pid: 22480 timeout: 938 lvb_type: 0 00010000:00010000:3.0:1746129582.995524:0:7087:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fab5c00/0x40a459093b06be5e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 7 type: EXT [3469312->18446744073709551615] (req 3469312->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22555 expref: 30 pid: 22480 timeout: 938 lvb_type: 0 00010000:00010000:3.0:1746129582.995551:0:7087:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fab5c00/0x40a459093b06be5e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 7 type: EXT [3469312->18446744073709551615] (req 3469312->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22555 expref: 30 pid: 22480 timeout: 938 lvb_type: 0 00010000:00010000:3.0:1746129582.995581:0:7087:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129582.995583:0:7087:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129582.995591:0:7087:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800952b0e00/0x40a459093b06bedc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f225b0 expref: 38 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129582.995598:0:7087:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800952b0e00/0x40a459093b06bedc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f225b0 expref: 38 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129582.995606:0:7087:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129582.995606:0:7087:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129582.995609:0:7087:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800919f0200/0x40a459093b06bee3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f225b7 expref: 29 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129582.995614:0:7087:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800919f0200/0x40a459093b06bee3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f225b7 expref: 29 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129582.995644:0:7087:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800919f0200/0x40a459093b06bee3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f225b7 expref: 29 pid: 22480 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129582.995654:0:7087:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094064700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7087:1830948737644800:192.168.202.4@tcp:105: 00010000:00010000:3.0:1746129582.996085:0:7087:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800952b0e00/0x40a459093b06bedc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f225b0 expref: 38 pid: 11014 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129582.996098:0:7087:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094065500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7087:1830948737644928:192.168.202.4@tcp:105: 00000100:00100000:3.0:1746129582.996118:0:7087:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009518bc00 going to sleep for 11 seconds 00000100:00100000:3.0:1746129583.000403:0:7087:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094064700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7087:1830948737644800:192.168.202.4@tcp:105: 00000100:00100000:3.0:1746129583.000419:0:7087:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094065500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7087:1830948737644928:192.168.202.4@tcp:105: 00010000:00010000:3.0:1746129583.000440:0:7087:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129583.000491:0:7087:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a46850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+29:1961:x1830948734476416:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 5017us (5267us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129583.000501:0:7087:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8782 00000100:00100000:0.0:1746129583.001181:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129583.001444:0:8417:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734476672 00000100:00100000:2.0:1746129583.001452:0:8417:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734476672 00002000:00100000:2.0:1746129583.002245:0:8417:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3f5:0x0] (3145728->4194303) req@ffff88013145f800 x1830948734476672/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:324/0 lens 488/0 e 0 to 0 dl 1746129594 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129583.002256:0:8417:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013145f800 with x1830948734476672 ext(3145728->4194303) 00002000:00010000:2.0:1746129583.002262:0:8417:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013145f800 00000100:00100000:2.0:1746129583.002286:0:8417:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8240 00000100:00100000:2.0:1746129583.002317:0:8417:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013145f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+29:1963:x1830948734476672:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:3.0:1746129583.004589:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129583.005072:0:31522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734476928 00000100:00100000:0.0:1746129583.005082:0:31522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734476928 00002000:00100000:0.0:1746129583.005140:0:31522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f5:0x0] (3145728->4194303) req@ffff880094065500 x1830948734476928/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:324/0 lens 488/0 e 0 to 0 dl 1746129594 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129583.005150:0:31522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094065500 with x1830948734476928 ext(3145728->4194303) 00002000:00010000:0.0:1746129583.005155:0:31522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094065500 00000100:00100000:0.0:1746129583.005188:0:31522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8241 00000100:00100000:0.0:1746129583.005196:0:31522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094065500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ada2ffba-8920-4ecb-8068-68caa9806978+39:1962:x1830948734476928:12345-192.168.202.4@tcp:3:multiop.0 00000100:00080000:2.0:1746129583.005426:0:7097:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746129583.017495:0:8417:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013145f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+29:1963:x1830948734476672:12345-192.168.202.4@tcp:3:cat.0 Request processed in 15190us (16304us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129583.017508:0:8417:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8240 00002000:00100000:2.0:1746129583.017522:0:8417:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3f5:0x0] (3145728->4194303) req@ffff88013145f800 x1830948734476672/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:324/0 lens 488/440 e 0 to 0 dl 1746129594 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129583.017538:0:8417:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013145f800 with x1830948734476672 ext(3145728->4194303) 00002000:00010000:2.0:1746129583.017544:0:8417:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013145f800 00000100:00100000:1.0:1746129583.021509:0:31522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094065500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ada2ffba-8920-4ecb-8068-68caa9806978+39:1962:x1830948734476928:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 16303us (16921us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129583.021521:0:31522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8241 00002000:00100000:1.0:1746129583.021533:0:31522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f5:0x0] (3145728->4194303) req@ffff880094065500 x1830948734476928/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:324/0 lens 488/440 e 0 to 0 dl 1746129594 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129583.021541:0:31522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094065500 with x1830948734476928 ext(3145728->4194303) 00002000:00010000:1.0:1746129583.021547:0:31522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094065500 00000100:00100000:0.0:1746129583.025480:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129583.028364:0:8412:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734477056 00000100:00100000:2.0:1746129583.028379:0:8412:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734477056 00000100:00100000:2.0:1746129583.028468:0:8412:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16955 00000100:00100000:2.0:1746129583.028479:0:8412:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013145d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+26:1963:x1830948734477056:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129583.028500:0:8412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129583.028517:0:8412:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800952b1e00/0x40a459093b06bef1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f225c5 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129583.028580:0:8412:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009507fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8412:1830948737645056:192.168.202.4@tcp:106: 00000100:00100000:2.0:1746129583.028691:0:8412:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132dad6c0 going to sleep for 11 seconds 00000100:00080000:0.0:1746129583.030000:0:7097:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746129583.031590:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129583.034201:0:31522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734477312 00000100:00100000:1.0:1746129583.034231:0:31522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734477312 00002000:00100000:1.0:1746129583.034314:0:31522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3ef:0x0] (4194304->5148671) req@ffff880093edf100 x1830948734477312/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:324/0 lens 488/0 e 0 to 0 dl 1746129594 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00080000:0.0:1746129583.034383:0:7097:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:2.0:1746129583.034515:0:8412:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3ec:0x0] updating lvb mtime: 1746129582 -> 1746129583 00002000:00010000:2.0:1746129583.034519:0:8412:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3ec:0x0] updating lvb atime: 1746129582 -> 1746129583 00002000:00010000:2.0:1746129583.034522:0:8412:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3ec:0x0] updating lvb ctime: 1746129582 -> 1746129583 00000100:00100000:2.0:1746129583.034543:0:8412:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009507fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8412:1830948737645056:192.168.202.4@tcp:106: 00002000:00100000:1.0:1746129583.034567:0:31522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093edf100 with x1830948734477312 ext(4194304->5148671) 00002000:00010000:1.0:1746129583.034574:0:31522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093edf100 00010000:00010000:2.0:1746129583.034582:0:8412:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800952b1e00/0x40a459093b06bef1 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f225c5 expref: 27 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129583.034596:0:8412:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800952b1e00/0x40a459093b06bef1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f225c5 expref: 27 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129583.034612:0:8412:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800952b1e00, rc 0) 00000100:00100000:1.0:1746129583.034613:0:31522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8242 00000100:00100000:1.0:1746129583.034622:0:31522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093edf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ada2ffba-8920-4ecb-8068-68caa9806978+32:1962:x1830948734477312:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:2.0:1746129583.034670:0:8412:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013145d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+26:1963:x1830948734477056:12345-192.168.202.4@tcp:101:cat.0 Request processed in 6193us (9199us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129583.034680:0:8412:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16955 00000100:00100000:0.0:1746129583.040529:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129583.042689:0:8417:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734477568 00000100:00100000:3.0:1746129583.042702:0:8417:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734477568 00002000:00100000:3.0:1746129583.042752:0:8417:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3ef:0x0] (4194304->5148671) req@ffff880093edfb80 x1830948734477568/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:324/0 lens 488/0 e 0 to 0 dl 1746129594 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129583.042763:0:8417:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093edfb80 with x1830948734477568 ext(4194304->5148671) 00002000:00010000:3.0:1746129583.042768:0:8417:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093edfb80 00000100:00100000:3.0:1746129583.042801:0:8417:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8243 00000100:00100000:3.0:1746129583.042809:0:8417:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093edfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+26:1962:x1830948734477568:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:1.0:1746129583.049735:0:31522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093edf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ada2ffba-8920-4ecb-8068-68caa9806978+32:1962:x1830948734477312:12345-192.168.202.4@tcp:3:cat.0 Request processed in 15100us (18138us total) trans 0 rc 954368/954368 00000100:00100000:1.0:1746129583.049748:0:31522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8242 00002000:00100000:1.0:1746129583.049761:0:31522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3ef:0x0] (4194304->5148671) req@ffff880093edf100 x1830948734477312/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:324/0 lens 488/440 e 0 to 0 dl 1746129594 ref 1 fl Complete:/200/0 rc 954368/954368 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129583.049770:0:31522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093edf100 with x1830948734477312 ext(4194304->5148671) 00002000:00010000:1.0:1746129583.049776:0:31522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093edf100 00000100:00100000:3.0:1746129583.063471:0:8417:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093edfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+26:1962:x1830948734477568:12345-192.168.202.4@tcp:3:cat.0 Request processed in 20642us (22931us total) trans 0 rc 954368/954368 00000100:00100000:3.0:1746129583.063488:0:8417:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8243 00002000:00100000:3.0:1746129583.063505:0:8417:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3ef:0x0] (4194304->5148671) req@ffff880093edfb80 x1830948734477568/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:324/0 lens 488/440 e 0 to 0 dl 1746129594 ref 1 fl Complete:/200/0 rc 954368/954368 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129583.063522:0:8417:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093edfb80 with x1830948734477568 ext(4194304->5148671) 00002000:00010000:3.0:1746129583.063530:0:8417:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093edfb80 00000100:00100000:0.0:1746129583.072559:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129583.072673:0:8412:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734477696 00000100:00100000:2.0:1746129583.072683:0:8412:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734477696 00000100:00100000:2.0:1746129583.072743:0:8412:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16956 00000100:00100000:2.0:1746129583.072752:0:8412:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ede300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+26:1962:x1830948734477696:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129583.072773:0:8412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129583.072795:0:8412:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093c0c600/0x40a459093b06bef8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f225cc expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129583.072855:0:8412:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009507fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8412:1830948737645184:192.168.202.4@tcp:106: 00000100:00100000:2.0:1746129583.074413:0:8412:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132dad6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746129583.075384:0:8412:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009507fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8412:1830948737645184:192.168.202.4@tcp:106: 00010000:00010000:2.0:1746129583.075420:0:8412:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093c0c600/0x40a459093b06bef8 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f225cc expref: 27 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129583.075432:0:8412:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093c0c600/0x40a459093b06bef8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f225cc expref: 27 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129583.075458:0:8412:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093c0c600, rc 0) 00000100:00100000:2.0:1746129583.075509:0:8412:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ede300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+26:1962:x1830948734477696:12345-192.168.202.4@tcp:101:cat.0 Request processed in 2757us (2962us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129583.075517:0:8412:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16956 00000100:00100000:0.0:1746129583.078660:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129583.078767:0:8412:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734477824 00000100:00100000:2.0:1746129583.078777:0:8412:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734477824 00000100:00100000:2.0:1746129583.078832:0:8412:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16957 00000100:00100000:2.0:1746129583.078839:0:8412:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ede680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+26:1960:x1830948734477824:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129583.078860:0:8412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129583.078877:0:8412:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e0c5e00/0x40a459093b06beff lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f225d3 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129583.078940:0:8412:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009507fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8412:1830948737645312:192.168.202.4@tcp:106: 00000100:00100000:2.0:1746129583.080602:0:8412:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132dad6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746129583.082284:0:8412:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009507fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8412:1830948737645312:192.168.202.4@tcp:106: 00010000:00010000:2.0:1746129583.082341:0:8412:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012e0c5e00/0x40a459093b06beff lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f225d3 expref: 27 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129583.082355:0:8412:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e0c5e00/0x40a459093b06beff lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f225d3 expref: 27 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129583.082366:0:8412:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e0c5e00, rc 0) 00000100:00100000:2.0:1746129583.082425:0:8412:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ede680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+26:1960:x1830948734477824:12345-192.168.202.4@tcp:101:cat.0 Request processed in 3584us (3776us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129583.082434:0:8412:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16957 00000100:00100000:0.0:1746129583.088354:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129583.089417:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734478080 00000100:00100000:1.0:1746129583.089429:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734478080 00000100:00100000:1.0:1746129583.089494:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11384 00000100:00100000:1.0:1746129583.089502:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093edc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+17:32754:x1830948734478080:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:1.0:1746129583.089535:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129583.089554:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800915d5600/0x40a459093b06bf06 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f225da expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129583.089667:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800915d4000/0x40a459093b06bf0d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129583.089681:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800915d4000/0x40a459093b06bf0d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129583.089692:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800915d4000/0x40a459093b06bf0d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129583.089706:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800915d4200/0x40a459093b06bf14 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129583.089711:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800915d4200/0x40a459093b06bf14 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129583.089720:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800915d4200/0x40a459093b06bf14 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129583.089827:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800915d4400/0x40a459093b06bf1b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129583.089836:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800915d4400/0x40a459093b06bf1b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129583.089841:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800915d4400/0x40a459093b06bf1b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00200000:1.0:1746129583.089850:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:1.0:1746129583.089938:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800915d4000/0x40a459093b06bf0d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129583.089944:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800915d4000/0x40a459093b06bf0d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129583.089950:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800915d4000/0x40a459093b06bf0d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129583.089955:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800915d4000 already unused, calling callback (ffffffffa136e690) 00010000:00010000:1.0:1746129583.089959:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800915d4000/0x40a459093b06bf0d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129583.089965:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800915d4000/0x40a459093b06bf0d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129583.089975:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880132ef8f00) 00010000:00010000:1.0:1746129583.089978:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129583.089981:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800915d4000/0x40a459093b06bf0d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129583.089990:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800915d4000/0x40a459093b06bf0d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129583.090019:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800915d4200/0x40a459093b06bf14 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129583.090024:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800915d4200/0x40a459093b06bf14 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129583.090028:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800915d4200/0x40a459093b06bf14 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129583.090032:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800915d4200 already unused, calling callback (ffffffffa136e690) 00010000:00010000:1.0:1746129583.090034:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800915d4200/0x40a459093b06bf14 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129583.090038:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800915d4200/0x40a459093b06bf14 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129583.090043:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009cffee00) 00010000:00010000:1.0:1746129583.090045:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129583.090047:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800915d4200/0x40a459093b06bf14 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129583.090051:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800915d4200/0x40a459093b06bf14 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129583.090083:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800915d5600/0x40a459093b06bf06 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f225da expref: 20 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129583.090095:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800915d4400/0x40a459093b06bf1b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f225da expref: 19 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129583.090105:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009cffe100) 00010000:00010000:1.0:1746129583.090107:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746129583.090109:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800915d4400, rc 0) 00000100:00100000:1.0:1746129583.090159:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093edc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+19:32754:x1830948734478080:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 658us (1817us total) trans 8589945515 rc 0/0 00000100:00100000:1.0:1746129583.090165:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11384 00000100:00100000:0.0:1746129583.128840:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129583.129405:0:8412:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734478208 00000100:00100000:2.0:1746129583.129419:0:8412:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734478208 00000100:00100000:2.0:1746129583.131097:0:8412:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16958 00000100:00100000:2.0:1746129583.131113:0:8412:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c29d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+26:32754:x1830948734478208:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:2.0:1746129583.131136:0:8412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129583.131155:0:8412:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e0c4400/0x40a459093b06bf29 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f225e1 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129583.131190:0:8412:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f92e000/0x40a459093b06beab lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2257f expref: 27 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129583.131201:0:8412:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f92ea00/0x40a459093b06beb2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22594 expref: 31 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129583.131216:0:8412:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129583.131218:0:8412:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129583.131221:0:8412:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e0c4400/0x40a459093b06bf29 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [2285568->2711551] (req 2285568->2711551) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f225e1 expref: 27 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129583.131256:0:8412:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f92ea00/0x40a459093b06beb2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22594 expref: 31 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129583.131268:0:8412:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f92ea00/0x40a459093b06beb2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22594 expref: 31 pid: 4385 timeout: 938 lvb_type: 0 00000100:00100000:2.0:1746129583.131280:0:8412:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009507fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8412:1830948737645440:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129583.131410:0:8412:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f92e000/0x40a459093b06beab lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2257f expref: 27 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129583.131417:0:8412:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f92e000/0x40a459093b06beab lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2257f expref: 27 pid: 4385 timeout: 938 lvb_type: 0 00000100:00100000:2.0:1746129583.131424:0:8412:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009507e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8412:1830948737645568:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129583.131438:0:8412:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132dad6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746129583.139446:0:8412:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009507fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8412:1830948737645440:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129583.140982:0:8412:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009507e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8412:1830948737645568:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129583.141026:0:8412:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012e0c4400/0x40a459093b06bf29 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [2285568->2711551] (req 2285568->2711551) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f225e1 expref: 27 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129583.141048:0:8412:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e0c4400, rc 0) 00000100:00100000:0.0:1746129583.141694:0:8412:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c29d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+27:32754:x1830948734478208:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 10584us (12857us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129583.141704:0:8412:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16958 00000100:00100000:0.0:1746129583.148140:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129583.148260:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734478336 00000100:00100000:3.0:1746129583.148271:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734478336 00010000:00010000:3.0:1746129583.148666:0:7087:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f92ea00/0x40a459093b06beb2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22594 expref: 32 pid: 4385 timeout: 938 lvb_type: 0 00000100:00100000:3.0:1746129583.148951:0:7087:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8783 00000100:00100000:3.0:1746129583.148960:0:7087:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ede300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ada2ffba-8920-4ecb-8068-68caa9806978+32:1963:x1830948734478336:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129583.148975:0:7087:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129583.149002:0:7087:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f92ea00/0x40a459093b06beb2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22594 expref: 32 pid: 4385 timeout: 938 lvb_type: 0 00010000:00010000:3.0:1746129583.149016:0:7087:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f92ea00/0x40a459093b06beb2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22594 expref: 32 pid: 4385 timeout: 938 lvb_type: 0 00010000:00010000:3.0:1746129583.149039:0:7087:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f92ea00/0x40a459093b06beb2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22594 expref: 32 pid: 4385 timeout: 938 lvb_type: 0 00010000:00010000:3.0:1746129583.150445:0:7087:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129583.150528:0:7087:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ede300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ada2ffba-8920-4ecb-8068-68caa9806978+31:1963:x1830948734478336:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 1565us (2397us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129583.150538:0:7087:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8783 00000100:00100000:0.0:1746129583.152580:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129583.152666:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734478464 00000100:00100000:3.0:1746129583.152676:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734478464 00010000:00010000:3.0:1746129583.152711:0:7087:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f92e000/0x40a459093b06beab lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2257f expref: 27 pid: 4385 timeout: 938 lvb_type: 0 00000100:00100000:3.0:1746129583.152753:0:7087:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8784 00000100:00100000:3.0:1746129583.152760:0:7087:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ede680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+27:1961:x1830948734478464:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129583.152774:0:7087:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129583.152798:0:7087:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f92e000/0x40a459093b06beab lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2257f expref: 27 pid: 4385 timeout: 938 lvb_type: 0 00010000:00010000:3.0:1746129583.152810:0:7087:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f92e000/0x40a459093b06beab lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2257f expref: 27 pid: 4385 timeout: 938 lvb_type: 0 00010000:00010000:3.0:1746129583.152833:0:7087:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f92e000/0x40a459093b06beab lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2257f expref: 27 pid: 4385 timeout: 938 lvb_type: 0 00010000:00010000:3.0:1746129583.152847:0:7087:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129583.152850:0:7087:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129583.152857:0:7087:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012e0c4400/0x40a459093b06bf29 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2285568->2711551) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f225e1 expref: 26 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129583.152866:0:7087:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e0c4400/0x40a459093b06bf29 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2285568->2711551) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f225e1 expref: 26 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129583.152899:0:7087:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012e0c4400/0x40a459093b06bf29 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2285568->2711551) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f225e1 expref: 26 pid: 8412 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129583.152912:0:7087:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094064700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7087:1830948737645696:192.168.202.4@tcp:105: 00000100:00100000:3.0:1746129583.152999:0:7087:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009518be40 going to sleep for 11 seconds 00000100:00100000:0.0:1746129583.161002:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129583.161176:0:7087:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094064700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7087:1830948737645696:192.168.202.4@tcp:105: 00010000:00010000:3.0:1746129583.161198:0:7087:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129583.161259:0:7087:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ede680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+26:1961:x1830948734478464:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 8498us (8686us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129583.161270:0:7087:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8784 00000100:00100000:2.0:1746129583.161468:0:8417:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734478720 00000100:00100000:2.0:1746129583.161476:0:8417:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734478720 00002000:00100000:2.0:1746129583.161519:0:8417:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3ef:0x0] (2707456->2711551) req@ffff880093eded80 x1830948734478720/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:324/0 lens 488/0 e 0 to 0 dl 1746129594 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129583.161528:0:8417:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093eded80 with x1830948734478720 ext(2707456->2711551) 00002000:00010000:2.0:1746129583.161533:0:8417:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093eded80 00000100:00100000:2.0:1746129583.161560:0:8417:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8244 00000100:00100000:2.0:1746129583.161566:0:8417:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093eded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+26:1962:x1830948734478720:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:2.0:1746129583.161732:0:8417:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093eded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+26:1962:x1830948734478720:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 165us (741us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129583.161738:0:8417:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8244 00002000:00100000:2.0:1746129583.161743:0:8417:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3ef:0x0] (2707456->2711551) req@ffff880093eded80 x1830948734478720/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:324/0 lens 488/4536 e 0 to 0 dl 1746129594 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129583.161750:0:8417:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093eded80 with x1830948734478720 ext(2707456->2711551) 00002000:00010000:2.0:1746129583.161753:0:8417:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093eded80 00000100:00100000:0.0:1746129583.165515:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129583.165596:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734478976 00000100:00100000:3.0:1746129583.165606:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734478976 00000100:00100000:3.0:1746129583.165672:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4861 00000100:00100000:3.0:1746129583.165680:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+19:32754:x1830948734478976:12345-192.168.202.4@tcp:35:multiop.0 00000100:00100000:3.0:1746129583.165961:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:32754:x1830948734478976:12345-192.168.202.4@tcp:35:multiop.0 Request processed in 281us (455us total) trans 8589945516 rc 0/0 00000100:00100000:3.0:1746129583.167226:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4861 00000100:00100000:0.0:1746129583.191763:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129583.192477:0:8412:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734479104 00000100:00100000:2.0:1746129583.192487:0:8412:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734479104 00000100:00100000:2.0:1746129583.193078:0:8412:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16959 00000100:00100000:2.0:1746129583.193088:0:8412:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800912afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ada2ffba-8920-4ecb-8068-68caa9806978+31:1961:x1830948734479104:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129583.193111:0:8412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129583.193130:0:8412:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e0c5a00/0x40a459093b06bf30 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f225e8 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129583.193198:0:8412:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009507ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8412:1830948737645824:192.168.202.4@tcp:106: 00000100:00100000:2.0:1746129583.193360:0:8412:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132dad240 going to sleep for 11 seconds 00000100:00100000:2.0:1746129583.196179:0:8412:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009507ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8412:1830948737645824:192.168.202.4@tcp:106: 00010000:00010000:2.0:1746129583.196260:0:8412:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012e0c5a00/0x40a459093b06bf30 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f225e8 expref: 32 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129583.196275:0:8412:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e0c5a00/0x40a459093b06bf30 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f225e8 expref: 32 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129583.196330:0:8412:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e0c5a00, rc 0) 00000100:00100000:2.0:1746129583.196403:0:8412:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800912afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ada2ffba-8920-4ecb-8068-68caa9806978+31:1961:x1830948734479104:12345-192.168.202.4@tcp:101:cat.0 Request processed in 3316us (4649us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129583.196416:0:8412:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16959 00000100:00100000:0.0:1746129583.204492:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129583.204815:0:31522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734479360 00000100:00100000:1.0:1746129583.204826:0:31522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734479360 00002000:00100000:1.0:1746129583.204878:0:31522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3ec:0x0] (0->1048575) req@ffff8800912af800 x1830948734479360/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:324/0 lens 504/0 e 0 to 0 dl 1746129594 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129583.204888:0:31522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800912af800 with x1830948734479360 ext(0->1048575) 00002000:00010000:1.0:1746129583.204894:0:31522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800912af800 00000100:00100000:1.0:1746129583.204933:0:31522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8245 00000100:00100000:1.0:1746129583.204941:0:31522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800912af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ada2ffba-8920-4ecb-8068-68caa9806978+31:1960:x1830948734479360:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129583.214183:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129583.214274:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734479616 00000100:00100000:3.0:1746129583.214285:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734479616 00000100:00100000:3.0:1746129583.214400:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11385 00000100:00100000:3.0:1746129583.214412:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a64d5050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+20:32765:x1830948734479616:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129583.214443:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129583.214466:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095d82c00/0x40a459093b06bf37 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f225ef expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129583.214600:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095d82e00/0x40a459093b06bf3e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746129583.214616:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095d82e00/0x40a459093b06bf3e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746129583.214628:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095d82e00/0x40a459093b06bf3e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746129583.214648:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095d82800/0x40a459093b06bf45 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746129583.214654:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095d82800/0x40a459093b06bf45 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746129583.214660:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095d82800/0x40a459093b06bf45 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746129583.214792:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095d82a00/0x40a459093b06bf4c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746129583.214803:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095d82a00/0x40a459093b06bf4c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746129583.214810:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095d82a00/0x40a459093b06bf4c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000004:00200000:3.0:1746129583.214821:0:14548:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:3.0:1746129583.214931:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095d82e00/0x40a459093b06bf3e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746129583.214940:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095d82e00/0x40a459093b06bf3e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746129583.214945:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095d82e00/0x40a459093b06bf3e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746129583.214952:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095d82e00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:3.0:1746129583.214956:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095d82e00/0x40a459093b06bf3e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746129583.214962:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095d82e00/0x40a459093b06bf3e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746129583.214976:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880132ef8f00) 00010000:00010000:3.0:1746129583.214979:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129583.214984:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095d82e00/0x40a459093b06bf3e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746129583.214989:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095d82e00/0x40a459093b06bf3e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746129583.215037:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095d82800/0x40a459093b06bf45 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746129583.215050:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095d82800/0x40a459093b06bf45 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746129583.215055:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095d82800/0x40a459093b06bf45 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746129583.215059:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095d82800 already unused, calling callback (ffffffffa136e690) 00010000:00010000:3.0:1746129583.215061:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095d82800/0x40a459093b06bf45 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746129583.215066:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095d82800/0x40a459093b06bf45 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746129583.215074:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880090643400) 00010000:00010000:3.0:1746129583.215075:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129583.215078:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095d82800/0x40a459093b06bf45 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746129583.215082:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095d82800/0x40a459093b06bf45 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746129583.215129:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095d82c00/0x40a459093b06bf37 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f225ef expref: 23 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129583.215142:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095d82a00/0x40a459093b06bf4c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f225ef expref: 22 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129583.215148:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009cffe100) 00010000:00010000:3.0:1746129583.215150:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746129583.215152:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095d82a00, rc 0) 00000100:00100000:3.0:1746129583.215245:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a64d5050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+22:32765:x1830948734479616:12345-192.168.202.4@tcp:101:cat.0 Request processed in 835us (1070us total) trans 8589945517 rc 0/0 00000100:00100000:3.0:1746129583.215253:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11385 00000100:00100000:0.0:1746129583.219529:0:31522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800912af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ada2ffba-8920-4ecb-8068-68caa9806978+31:1960:x1830948734479360:12345-192.168.202.4@tcp:3:cat.0 Request processed in 14577us (15038us total) trans 0 rc 999424/999424 00000100:00100000:0.0:1746129583.219540:0:31522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8245 00002000:00100000:0.0:1746129583.219551:0:31522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3ec:0x0] (0->1048575) req@ffff8800912af800 x1830948734479360/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:324/0 lens 504/440 e 0 to 0 dl 1746129594 ref 1 fl Complete:/200/0 rc 999424/999424 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129583.219560:0:31522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800912af800 with x1830948734479360 ext(0->1048575) 00002000:00010000:0.0:1746129583.219566:0:31522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800912af800 00000100:00100000:0.0:1746129583.220170:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129583.220226:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129583.220249:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734479872 00000100:00100000:3.0:1746129583.220258:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734479872 00000100:00100000:2.0:1746129583.220291:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734480000 00000100:00100000:2.0:1746129583.220308:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734480000 00000100:00100000:3.0:1746129583.220366:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4862 00000100:00100000:3.0:1746129583.220372:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800912aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+23:32765:x1830948734479872:12345-192.168.202.4@tcp:35:cat.0 00000100:00100000:2.0:1746129583.220430:0:7087:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 806 00000100:00100000:2.0:1746129583.220436:0:7087:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800912adc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+23:1962:x1830948734480000:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129583.220449:0:7087:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129583.220474:0:7087:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095d82a00/0x40a459093b06bf4c lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f225ef expref: 23 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129583.220492:0:7087:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009cffe100) 00010000:00010000:2.0:1746129583.220496:0:7087:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129583.220518:0:7087:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800912adc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+22:1962:x1830948734480000:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 83us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129583.220524:0:7087:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 806 00000100:00100000:3.0:1746129583.220832:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800912aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+22:32765:x1830948734479872:12345-192.168.202.4@tcp:35:cat.0 Request processed in 459us (662us total) trans 8589945518 rc 0/0 00000100:00100000:3.0:1746129583.220838:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4862 00000100:00100000:0.0:1746129583.227997:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129583.228113:0:8412:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734480128 00000100:00100000:2.0:1746129583.228123:0:8412:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734480128 00000100:00100000:2.0:1746129583.228174:0:8412:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16960 00000100:00100000:2.0:1746129583.228181:0:8412:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800912ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+26:1961:x1830948734480128:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129583.228202:0:8412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129583.228241:0:8412:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e0c5400/0x40a459093b06bf5a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f225f6 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129583.228320:0:8412:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009507ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8412:1830948737645952:192.168.202.4@tcp:106: 00000100:00100000:2.0:1746129583.228399:0:8412:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132dad240 going to sleep for 11 seconds 00000100:00100000:0.0:1746129583.246269:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129583.246468:0:11014:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734480256 00000100:00100000:3.0:1746129583.246478:0:11014:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734480256 00000100:00100000:3.0:1746129583.246537:0:11014:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16961 00000100:00100000:3.0:1746129583.246708:0:11014:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ada2ffba-8920-4ecb-8068-68caa9806978+31:32761:x1830948734480256:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129583.246729:0:11014:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129583.246748:0:11014:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095d83000/0x40a459093b06bf61 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f225fd expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129583.246781:0:11014:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012e0c4400/0x40a459093b06bf29 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2285568->2711551) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f225e1 expref: 27 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129583.246790:0:11014:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129583.246792:0:11014:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129583.246795:0:11014:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095d83000/0x40a459093b06bf61 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f225fd expref: 32 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129583.246826:0:11014:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012e0c4400/0x40a459093b06bf29 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2285568->2711551) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f225e1 expref: 27 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129583.246836:0:11014:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012e0c4400/0x40a459093b06bf29 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2285568->2711551) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f225e1 expref: 27 pid: 8412 timeout: 938 lvb_type: 0 00000100:00100000:3.0:1746129583.246848:0:11014:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094064000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11014:1830948737646080:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129583.247496:0:8412:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009507ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8412:1830948737645952:192.168.202.4@tcp:106: 00010000:00010000:2.0:1746129583.247525:0:8412:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012e0c5400/0x40a459093b06bf5a lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f225f6 expref: 27 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129583.247534:0:8412:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e0c5400/0x40a459093b06bf5a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f225f6 expref: 27 pid: 8412 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746129583.247672:0:11014:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009518b9c0 going to sleep for 11 seconds 00010000:00010000:2.0:1746129583.247705:0:8412:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e0c5400, rc 0) 00000100:00100000:2.0:1746129583.247733:0:8412:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800912ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+26:1961:x1830948734480128:12345-192.168.202.4@tcp:101:cat.0 Request processed in 19552us (19747us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129583.247740:0:8412:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16960 00000100:00100000:2.0:1746129583.255865:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129583.255912:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129583.255938:0:8412:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734480512 00000100:00100000:2.0:1746129583.255948:0:8412:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734480512 00000100:00100000:0.0:1746129583.256030:0:31522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734480384 00000100:00100000:0.0:1746129583.256035:0:31522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734480384 00002000:00100000:0.0:1746129583.256070:0:31522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3ef:0x0] (2285568->2711551) req@ffff88009507ed80 x1830948734480384/t0(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:324/0 lens 488/0 e 0 to 0 dl 1746129594 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129583.256082:0:31522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009507ed80 with x1830948734480384 ext(2285568->2711551) 00010000:00010000:0.0:1746129583.256091:0:31522:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012e0c4400/0x40a459093b06bf29 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2285568->2711551) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f225e1 expref: 27 pid: 8412 timeout: 938 lvb_type: 0 00010000:00010000:0.0:1746129583.256105:0:31522:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012e0c4400/0x40a459093b06bf29 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2285568->2711551) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f225e1 expref: 27 pid: 8412 timeout: 938 lvb_type: 0 00002000:00010000:0.0:1746129583.256112:0:31522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009507ed80 00000100:00100000:0.0:1746129583.256135:0:31522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2551 00000100:00100000:0.0:1746129583.256142:0:31522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009507ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+27:1963:x1830948734480384:12345-192.168.202.4@tcp:4:multiop.0 00000100:00100000:3.0:1746129583.256482:0:11014:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094064000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11014:1830948737646080:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129583.256510:0:11014:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095d83000/0x40a459093b06bf61 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f225fd expref: 32 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129583.256525:0:11014:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095d83000, rc 0) 00000100:00100000:3.0:1746129583.256568:0:11014:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ada2ffba-8920-4ecb-8068-68caa9806978+32:32761:x1830948734480256:12345-192.168.202.4@tcp:101:cat.0 Request processed in 10024us (10312us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129583.256574:0:11014:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16961 00000100:00100000:3.0:1746129583.256593:0:11014:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16962 00000100:00100000:3.0:1746129583.256597:0:11014:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009507df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+27:32765:x1830948734480512:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129583.256604:0:11014:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129583.256618:0:11014:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095d82600/0x40a459093b06bf68 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f22604 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129583.256636:0:11014:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fa7e400/0x40a459093b06beea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 704512->753663) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f225be expref: 31 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129583.256642:0:11014:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129583.256643:0:11014:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129583.256646:0:11014:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095d82600/0x40a459093b06bf68 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22604 expref: 28 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129583.256670:0:11014:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fa7e400/0x40a459093b06beea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 704512->753663) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f225be expref: 31 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129583.256679:0:11014:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fa7e400/0x40a459093b06beea lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 704512->753663) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f225be expref: 31 pid: 8412 timeout: 938 lvb_type: 0 00000100:00100000:3.0:1746129583.256689:0:11014:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094064000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11014:1830948737646208:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129583.256728:0:11014:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009518b9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746129583.258872:0:11014:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094064000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11014:1830948737646208:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129583.258901:0:11014:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095d82600/0x40a459093b06bf68 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22604 expref: 29 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129583.258918:0:11014:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095d82600, rc 0) 00000100:00100000:3.0:1746129583.258941:0:11014:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009507df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+29:32765:x1830948734480512:12345-192.168.202.4@tcp:101:cat.0 Request processed in 2342us (3026us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129583.258950:0:11014:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16962 00000100:00100000:3.0:1746129583.259458:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129583.263138:0:8417:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734480640 00000100:00100000:0.0:1746129583.263153:0:8417:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734480640 00002000:00100000:0.0:1746129583.263216:0:8417:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3ec:0x0] (704512->753663) req@ffff880094064000 x1830948734480640/t0(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:324/0 lens 488/0 e 0 to 0 dl 1746129594 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129583.263226:0:8417:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094064000 with x1830948734480640 ext(704512->753663) 00010000:00010000:0.0:1746129583.263236:0:8417:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fa7e400/0x40a459093b06beea lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 704512->753663) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f225be expref: 32 pid: 8412 timeout: 938 lvb_type: 0 00010000:00010000:0.0:1746129583.263249:0:8417:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fa7e400/0x40a459093b06beea lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 704512->753663) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f225be expref: 32 pid: 8412 timeout: 938 lvb_type: 0 00002000:00010000:0.0:1746129583.263256:0:8417:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094064000 00000100:00100000:0.0:1746129583.263323:0:8417:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2552 00000100:00100000:0.0:1746129583.263332:0:8417:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094064000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ada2ffba-8920-4ecb-8068-68caa9806978+32:1962:x1830948734480640:12345-192.168.202.4@tcp:4:cat.0 00000100:00100000:1.0:1746129583.272656:0:8417:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094064000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ada2ffba-8920-4ecb-8068-68caa9806978+34:1962:x1830948734480640:12345-192.168.202.4@tcp:4:cat.0 Request processed in 9308us (13182us total) trans 21474841464 rc 0/0 00000100:00100000:1.0:1746129583.272672:0:8417:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2552 00002000:00100000:1.0:1746129583.272686:0:8417:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3ec:0x0] (704512->753663) req@ffff880094064000 x1830948734480640/t21474841464(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:324/0 lens 488/448 e 0 to 0 dl 1746129594 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129583.272697:0:8417:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094064000 with x1830948734480640 ext(704512->753663) 00010000:00010000:1.0:1746129583.272710:0:8417:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fa7e400/0x40a459093b06beea lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 704512->753663) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f225be expref: 34 pid: 8412 timeout: 938 lvb_type: 0 00010000:00010000:1.0:1746129583.272728:0:8417:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fa7e400/0x40a459093b06beea lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 704512->753663) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f225be expref: 34 pid: 8412 timeout: 938 lvb_type: 0 00002000:00010000:1.0:1746129583.272736:0:8417:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094064000 00000100:00100000:2.0:1746129583.276496:0:31522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009507ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+29:1963:x1830948734480384:12345-192.168.202.4@tcp:4:multiop.0 Request processed in 20340us (20628us total) trans 21474841465 rc 0/0 00000100:00100000:2.0:1746129583.276510:0:31522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2551 00002000:00100000:2.0:1746129583.276527:0:31522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3ef:0x0] (2285568->2711551) req@ffff88009507ed80 x1830948734480384/t21474841465(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:324/0 lens 488/448 e 0 to 0 dl 1746129594 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129583.276542:0:31522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009507ed80 with x1830948734480384 ext(2285568->2711551) 00010000:00010000:2.0:1746129583.276553:0:31522:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012e0c4400/0x40a459093b06bf29 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2285568->2711551) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f225e1 expref: 29 pid: 8412 timeout: 938 lvb_type: 0 00010000:00010000:2.0:1746129583.276566:0:31522:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012e0c4400/0x40a459093b06bf29 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2285568->2711551) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f225e1 expref: 29 pid: 8412 timeout: 938 lvb_type: 0 00002000:00010000:2.0:1746129583.276572:0:31522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009507ed80 00000100:00100000:0.0:1746129583.281520:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129583.281695:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734480768 00000100:00100000:1.0:1746129583.281705:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734480768 00010000:00010000:1.0:1746129583.281745:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fa7e400/0x40a459093b06beea lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 704512->753663) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f225be expref: 34 pid: 8412 timeout: 938 lvb_type: 0 00000100:00100000:1.0:1746129583.282553:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8785 00000100:00100000:1.0:1746129583.282565:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ada2ffba-8920-4ecb-8068-68caa9806978+34:1962:x1830948734480768:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129583.282582:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129583.282609:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fa7e400/0x40a459093b06beea lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 704512->753663) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f225be expref: 34 pid: 8412 timeout: 938 lvb_type: 0 00010000:00010000:1.0:1746129583.282622:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fa7e400/0x40a459093b06beea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 704512->753663) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f225be expref: 34 pid: 8412 timeout: 938 lvb_type: 0 00010000:00010000:1.0:1746129583.282645:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fa7e400/0x40a459093b06beea lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 704512->753663) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f225be expref: 34 pid: 8412 timeout: 938 lvb_type: 0 00010000:00010000:1.0:1746129583.282672:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129583.282675:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129583.282683:0:7085:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880095d82600/0x40a459093b06bf68 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22604 expref: 28 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129583.282691:0:7085:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095d82600/0x40a459093b06bf68 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22604 expref: 28 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129583.282731:0:7085:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880095d82600/0x40a459093b06bf68 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22604 expref: 28 pid: 11014 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129583.282744:0:7085:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129bc3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7085:1830948737646336:192.168.202.4@tcp:105: 00000100:00100000:1.0:1746129583.286877:0:7085:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a91c5d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746129583.302591:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129583.303105:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734480896 00000100:00100000:3.0:1746129583.303116:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734480896 00010000:00010000:3.0:1746129583.303158:0:7087:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012e0c4400/0x40a459093b06bf29 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2285568->2711551) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f225e1 expref: 29 pid: 8412 timeout: 938 lvb_type: 0 00000100:00100000:0.0:1746129583.303197:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129583.303198:0:7087:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8786 00000100:00100000:3.0:1746129583.303215:0:7087:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959d4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+29:1963:x1830948734480896:12345-192.168.202.4@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746129583.303240:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734481152 00000100:00100000:3.0:1746129583.303242:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734481152 00000100:00100000:3.0:1746129583.303841:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11386 00000100:00100000:3.0:1746129583.303848:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+22:300:x1830948734481152:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:3.0:1746129583.303871:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129583.303887:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095d83800/0x40a459093b06bf6f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2260b expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129583.304004:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095d83a00/0x40a459093b06bf76 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746129583.304018:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095d83a00/0x40a459093b06bf76 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746129583.304030:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095d83a00/0x40a459093b06bf76 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746129583.304042:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095d83c00/0x40a459093b06bf7d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746129583.304046:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095d83c00/0x40a459093b06bf7d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746129583.304055:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095d83c00/0x40a459093b06bf7d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000100:00100000:1.0:1746129583.304289:0:7085:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129bc3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7085:1830948737646336:192.168.202.4@tcp:105: 00000100:00100000:0.0:1746129583.304319:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00010000:00010000:1.0:1746129583.304326:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129583.304350:0:31522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734481408 00010000:00010000:0.0:1746129583.304355:0:7087:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746129583.304356:0:31522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734481408 00000100:00100000:1.0:1746129583.304368:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ada2ffba-8920-4ecb-8068-68caa9806978+33:1962:x1830948734480768:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 21807us (22858us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129583.304376:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8785 00010000:00010000:0.0:1746129583.304377:0:7087:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012e0c4400/0x40a459093b06bf29 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2285568->2711551) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f225e1 expref: 30 pid: 8412 timeout: 938 lvb_type: 0 00002000:00100000:2.0:1746129583.304384:0:31522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3ec:0x0] (0->1048575) req@ffff8800959d6680 x1830948734481408/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:324/0 lens 488/0 e 0 to 0 dl 1746129594 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:0.0:1746129583.304388:0:7087:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012e0c4400/0x40a459093b06bf29 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2285568->2711551) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f225e1 expref: 30 pid: 8412 timeout: 938 lvb_type: 0 00002000:00100000:2.0:1746129583.304393:0:31522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800959d6680 with x1830948734481408 ext(0->1048575) 00002000:00010000:2.0:1746129583.304397:0:31522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800959d6680 00010000:00010000:0.0:1746129583.304406:0:7087:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e0c4400/0x40a459093b06bf29 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2285568->2711551) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f225e1 expref: 30 pid: 8412 timeout: 938 lvb_type: 0 00000100:00100000:2.0:1746129583.304411:0:31522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8246 00000100:00100000:2.0:1746129583.304415:0:31522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+29:1963:x1830948734481408:12345-192.168.202.4@tcp:3:cat.0 00010000:00010000:0.0:1746129583.304423:0:7087:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129583.304425:0:7087:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129583.304432:0:7087:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880095d83000/0x40a459093b06bf61 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f225fd expref: 32 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129583.304440:0:7087:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095d83000/0x40a459093b06bf61 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f225fd expref: 32 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129583.304487:0:7087:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880095d83000/0x40a459093b06bf61 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f225fd expref: 32 pid: 11014 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129583.304502:0:7087:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129bc3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7087:1830948737646464:192.168.202.4@tcp:105: 00000100:00100000:1.0:1746129583.304546:0:7087:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a91c5d80 going to sleep for 11 seconds 00010000:00010000:3.0:1746129583.304879:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095d83e00/0x40a459093b06bf84 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746129583.304890:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095d83e00/0x40a459093b06bf84 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746129583.304897:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095d83e00/0x40a459093b06bf84 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000004:00200000:3.0:1746129583.304906:0:14548:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:3.0:1746129583.305002:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095d83a00/0x40a459093b06bf76 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746129583.305008:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095d83a00/0x40a459093b06bf76 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746129583.305014:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095d83a00/0x40a459093b06bf76 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746129583.305019:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095d83a00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:3.0:1746129583.305022:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095d83a00/0x40a459093b06bf76 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746129583.305029:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095d83a00/0x40a459093b06bf76 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746129583.305038:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880132ef8f00) 00010000:00010000:3.0:1746129583.305040:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129583.305044:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095d83a00/0x40a459093b06bf76 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746129583.305052:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095d83a00/0x40a459093b06bf76 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746129583.305097:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095d83c00/0x40a459093b06bf7d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746129583.305102:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095d83c00/0x40a459093b06bf7d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746129583.305107:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095d83c00/0x40a459093b06bf7d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746129583.305110:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095d83c00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:3.0:1746129583.305112:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095d83c00/0x40a459093b06bf7d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746129583.305116:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095d83c00/0x40a459093b06bf7d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746129583.305121:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880090643f00) 00010000:00010000:3.0:1746129583.305123:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129583.305125:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095d83c00/0x40a459093b06bf7d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746129583.305128:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095d83c00/0x40a459093b06bf7d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746129583.305172:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095d83800/0x40a459093b06bf6f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2260b expref: 25 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129583.305182:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095d83e00/0x40a459093b06bf84 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2260b expref: 24 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129583.305192:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009cffe100) 00010000:00010000:3.0:1746129583.305195:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746129583.305197:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095d83e00, rc 0) 00000100:00100000:3.0:1746129583.305231:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+24:300:x1830948734481152:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 1384us (2034us total) trans 8589945519 rc 0/0 00000100:00100000:3.0:1746129583.305237:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11386 00000100:00100000:0.0:1746129583.320092:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129583.320190:0:11014:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734481536 00000100:00100000:3.0:1746129583.320200:0:11014:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734481536 00000100:00100000:3.0:1746129583.320269:0:11014:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16963 00000100:00100000:3.0:1746129583.320278:0:11014:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ada2ffba-8920-4ecb-8068-68caa9806978+39:32766:x1830948734481536:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:3.0:1746129583.320580:0:11014:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129583.320630:0:11014:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095d83c00/0x40a459093b06bf92 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f22612 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129583.320664:0:11014:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800952b0e00/0x40a459093b06bedc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f225b0 expref: 40 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129583.320673:0:11014:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800919f0200/0x40a459093b06bee3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f225b7 expref: 28 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129583.320680:0:11014:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e0c4200/0x40a459093b06beb9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2259b expref: 28 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129583.320687:0:11014:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e0c5800/0x40a459093b06bec0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f225a2 expref: 40 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129583.320699:0:11014:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746129583.320701:0:11014:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746129583.320705:0:11014:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095d83c00/0x40a459093b06bf92 lrc: 7/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [2822144->3145727] (req 2822144->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22612 expref: 40 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129583.320735:0:11014:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012e0c5800/0x40a459093b06bec0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f225a2 expref: 40 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129583.320747:0:11014:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012e0c5800/0x40a459093b06bec0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f225a2 expref: 40 pid: 11014 timeout: 938 lvb_type: 0 00000100:00100000:3.0:1746129583.320759:0:11014:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094065180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11014:1830948737646592:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129583.320877:0:11014:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012e0c4200/0x40a459093b06beb9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2259b expref: 28 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129583.320886:0:11014:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012e0c4200/0x40a459093b06beb9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2259b expref: 28 pid: 11014 timeout: 938 lvb_type: 0 00000100:00100000:3.0:1746129583.320894:0:11014:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094064700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11014:1830948737646720:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129583.320915:0:11014:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800919f0200/0x40a459093b06bee3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f225b7 expref: 28 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129583.320923:0:11014:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800919f0200/0x40a459093b06bee3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f225b7 expref: 28 pid: 22480 timeout: 938 lvb_type: 0 00000100:00100000:3.0:1746129583.320936:0:11014:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094066300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11014:1830948737646848:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129583.320953:0:11014:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800952b0e00/0x40a459093b06bedc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f225b0 expref: 40 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129583.320961:0:11014:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800952b0e00/0x40a459093b06bedc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f225b0 expref: 40 pid: 11014 timeout: 938 lvb_type: 0 00000100:00100000:3.0:1746129583.320968:0:11014:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094066d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11014:1830948737646976:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129583.320981:0:11014:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009518b6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746129583.334969:0:7087:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129bc3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7087:1830948737646464:192.168.202.4@tcp:105: 00010000:00010000:1.0:1746129583.335001:0:7087:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129583.335086:0:7087:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959d4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+30:1963:x1830948734480896:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 31875us (32502us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129583.335099:0:7087:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8786 00000100:00100000:0.0:1746129583.341808:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129583.341848:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129583.341900:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129583.342017:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129583.342075:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734482176 00000100:00100000:0.0:1746129583.342086:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734482176 00000100:00100000:0.0:1746129583.342143:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734482304 00000100:00100000:0.0:1746129583.342147:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734482304 00010000:00010000:0.0:1746129583.342166:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012e0c5800/0x40a459093b06bec0 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f225a2 expref: 41 pid: 11014 timeout: 938 lvb_type: 0 00000100:00100000:0.0:1746129583.342193:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8787 00000100:00100000:0.0:1746129583.342213:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a46450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ada2ffba-8920-4ecb-8068-68caa9806978+41:1961:x1830948734482304:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129583.342231:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129583.342262:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012e0c5800/0x40a459093b06bec0 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f225a2 expref: 41 pid: 11014 timeout: 938 lvb_type: 0 00000100:00100000:3.0:1746129583.342272:0:11014:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094065180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11014:1830948737646592:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129583.342275:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012e0c5800/0x40a459093b06bec0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f225a2 expref: 41 pid: 11014 timeout: 938 lvb_type: 0 00000100:00100000:2.0:1746129583.342276:0:31518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734481792 00000100:00100000:2.0:1746129583.342281:0:31518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734481792 00010000:00010000:0.0:1746129583.342323:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e0c5800/0x40a459093b06bec0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f225a2 expref: 41 pid: 11014 timeout: 938 lvb_type: 0 00002000:00100000:2.0:1746129583.342327:0:31518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3ef:0x0] (2097152->3145727) req@ffff8800959d7b80 x1830948734481792/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:324/0 lens 488/0 e 0 to 0 dl 1746129594 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129583.342336:0:31518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800959d7b80 with x1830948734481792 ext(2097152->3145727) 00002000:00010000:2.0:1746129583.342341:0:31518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800959d7b80 00010000:00010000:0.0:1746129583.342347:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129583.342353:0:31518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734481920 00000100:00100000:2.0:1746129583.342355:0:31518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734481920 00002000:00100000:2.0:1746129583.342366:0:31518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->4194303) req@ffff88013145df80 x1830948734481920/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:324/0 lens 488/0 e 0 to 0 dl 1746129594 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129583.342373:0:31518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013145df80 with x1830948734481920 ext(3145728->4194303) 00002000:00010000:2.0:1746129583.342375:0:31518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013145df80 00000100:00100000:2.0:1746129583.342386:0:31518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8247 00000100:00100000:2.0:1746129583.342391:0:31518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ada2ffba-8920-4ecb-8068-68caa9806978+34:1962:x1830948734481792:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:0.0:1746129583.342403:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a46450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ada2ffba-8920-4ecb-8068-68caa9806978+40:1961:x1830948734482304:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 200us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129583.342411:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8787 00000100:00100000:0.0:1746129583.342433:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 807 00000100:00100000:0.0:1746129583.342440:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013145d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+24:1962:x1830948734482176:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129583.342451:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129583.342469:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095d83e00/0x40a459093b06bf84 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2260b expref: 24 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129583.342487:0:7085:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009cffe100) 00010000:00010000:0.0:1746129583.342490:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129583.342511:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013145d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+23:1962:x1830948734482176:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 71us (610us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129583.342517:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 807 00000100:00100000:3.0:1746129583.342680:0:31522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+28:1963:x1830948734481408:12345-192.168.202.4@tcp:3:cat.0 Request processed in 38263us (38384us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129583.342686:0:31522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8246 00002000:00100000:3.0:1746129583.342692:0:31522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3ec:0x0] (0->1048575) req@ffff8800959d6680 x1830948734481408/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:324/0 lens 488/440 e 0 to 0 dl 1746129594 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129583.342698:0:31522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800959d6680 with x1830948734481408 ext(0->1048575) 00002000:00010000:3.0:1746129583.342702:0:31522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800959d6680 00000100:00100000:3.0:1746129583.342714:0:31522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8248 00000100:00100000:3.0:1746129583.342719:0:31522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013145df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ada2ffba-8920-4ecb-8068-68caa9806978+34:1962:x1830948734481920:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:3.0:1746129583.352367:0:11014:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094064700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11014:1830948737646720:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129583.352388:0:11014:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094066300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11014:1830948737646848:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129583.352827:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129583.352846:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129583.353594:0:15749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734482432 00000100:00100000:2.0:1746129583.353603:0:15749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734482432 00010000:00010000:2.0:1746129583.353639:0:15749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012e0c4200/0x40a459093b06beb9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2259b expref: 29 pid: 11014 timeout: 938 lvb_type: 0 00000100:00100000:2.0:1746129583.353662:0:15749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734482560 00000100:00100000:2.0:1746129583.353664:0:15749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734482560 00010000:00010000:2.0:1746129583.353674:0:15749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800919f0200/0x40a459093b06bee3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f225b7 expref: 30 pid: 22480 timeout: 938 lvb_type: 0 00000100:00100000:2.0:1746129583.353687:0:15749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8788 00000100:00100000:2.0:1746129583.353694:0:15749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009507ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+30:1960:x1830948734482432:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129583.353706:0:15749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129583.353731:0:15749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012e0c4200/0x40a459093b06beb9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2259b expref: 30 pid: 11014 timeout: 938 lvb_type: 0 00010000:00010000:2.0:1746129583.353742:0:15749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012e0c4200/0x40a459093b06beb9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2259b expref: 30 pid: 11014 timeout: 938 lvb_type: 0 00000100:00100000:1.0:1746129583.353747:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8789 00000100:00100000:1.0:1746129583.353758:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009507f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+30:1962:x1830948734482560:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129583.353769:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129583.353771:0:15749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e0c4200/0x40a459093b06beb9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2259b expref: 30 pid: 11014 timeout: 938 lvb_type: 0 00010000:00010000:1.0:1746129583.353784:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800919f0200/0x40a459093b06bee3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f225b7 expref: 29 pid: 22480 timeout: 938 lvb_type: 0 00010000:00010000:2.0:1746129583.353789:0:15749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746129583.353794:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800919f0200/0x40a459093b06bee3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f225b7 expref: 29 pid: 22480 timeout: 938 lvb_type: 0 00010000:00010000:1.0:1746129583.353808:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800919f0200/0x40a459093b06bee3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f225b7 expref: 29 pid: 22480 timeout: 938 lvb_type: 0 00010000:00010000:1.0:1746129583.353826:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129583.353896:0:11014:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094066d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11014:1830948737646976:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129583.353937:0:11014:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095d83c00/0x40a459093b06bf92 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [2822144->3145727] (req 2822144->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22612 expref: 39 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129583.353948:0:11014:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095d83c00, rc 0) 00000100:00100000:2.0:1746129583.353985:0:15749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009507ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+28:1960:x1830948734482432:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 290us (1159us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129583.353992:0:15749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8788 00000100:00100000:1.0:1746129583.354353:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009507f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+27:1962:x1830948734482560:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 594us (1502us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129583.354361:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8789 00000100:00100000:3.0:1746129583.355465:0:11014:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ada2ffba-8920-4ecb-8068-68caa9806978+39:32766:x1830948734481536:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 35182us (35378us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129583.355474:0:11014:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16963 00000100:00100000:1.0:1746129583.367762:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129583.367993:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734482688 00000100:00100000:2.0:1746129583.368005:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734482688 00010000:00010000:2.0:1746129583.368065:0:7087:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800952b0e00/0x40a459093b06bedc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f225b0 expref: 39 pid: 11014 timeout: 938 lvb_type: 0 00000100:00100000:2.0:1746129583.368112:0:7087:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8790 00000100:00100000:2.0:1746129583.368121:0:7087:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129bc3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ada2ffba-8920-4ecb-8068-68caa9806978+39:1960:x1830948734482688:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129583.368137:0:7087:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129583.368165:0:7087:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800952b0e00/0x40a459093b06bedc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f225b0 expref: 39 pid: 11014 timeout: 938 lvb_type: 0 00010000:00010000:2.0:1746129583.368179:0:7087:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800952b0e00/0x40a459093b06bedc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f225b0 expref: 39 pid: 11014 timeout: 938 lvb_type: 0 00010000:00010000:2.0:1746129583.368214:0:7087:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800952b0e00/0x40a459093b06bedc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f225b0 expref: 39 pid: 11014 timeout: 938 lvb_type: 0 00000100:00100000:0.0:1746129583.371527:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00010000:00010000:2.0:1746129583.371625:0:7087:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129583.371629:0:7087:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129583.371640:0:7087:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880095d83c00/0x40a459093b06bf92 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2822144->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22612 expref: 38 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129583.371651:0:7087:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095d83c00/0x40a459093b06bf92 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2822144->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22612 expref: 38 pid: 11014 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129583.372071:0:31518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ada2ffba-8920-4ecb-8068-68caa9806978+35:1962:x1830948734481792:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 29678us (30272us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129583.372082:0:31518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8247 00002000:00100000:2.0:1746129583.372094:0:31518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3ef:0x0] (2097152->3145727) req@ffff8800959d7b80 x1830948734481792/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:324/0 lens 488/440 e 0 to 0 dl 1746129594 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129583.372103:0:31518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800959d7b80 with x1830948734481792 ext(2097152->3145727) 00002000:00010000:2.0:1746129583.372109:0:31518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800959d7b80 00010000:00010000:2.0:1746129583.372165:0:7087:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880095d83c00/0x40a459093b06bf92 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2822144->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22612 expref: 38 pid: 11014 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129583.372180:0:7087:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009507ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7087:1830948737647104:192.168.202.4@tcp:105: 00000100:00100000:2.0:1746129583.372264:0:7087:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132dad240 going to sleep for 11 seconds 00000100:00100000:3.0:1746129583.373087:0:11014:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734482816 00000100:00100000:3.0:1746129583.373097:0:11014:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734482816 00000100:00100000:3.0:1746129583.373153:0:11014:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16964 00000100:00100000:3.0:1746129583.373160:0:11014:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013145d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+28:1963:x1830948734482816:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129583.373175:0:11014:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129583.373196:0:11014:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fa7e400/0x40a459093b06bf99 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f22619 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129583.373347:0:11014:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129583.373349:0:11014:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129583.373356:0:11014:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fa7e400/0x40a459093b06bf99 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22619 expref: 29 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129583.373370:0:11014:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fa7e400/0x40a459093b06bf99 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22619 expref: 29 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129583.373378:0:11014:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fa7e400, rc 0) 00000100:00100000:3.0:1746129583.373409:0:11014:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013145d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+29:1963:x1830948734482816:12345-192.168.202.4@tcp:101:cat.0 Request processed in 250us (1897us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129583.373415:0:11014:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16964 00000100:00100000:0.0:1746129583.375681:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129583.375782:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129583.375827:0:31518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734483200 00000100:00100000:0.0:1746129583.375835:0:31518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734483200 00002000:00100000:0.0:1746129583.375882:0:31518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3f5:0x0] (2822144->2826239) req@ffff88013145d500 x1830948734483200/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:324/0 lens 488/0 e 0 to 0 dl 1746129594 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129583.375892:0:31518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013145d500 with x1830948734483200 ext(2822144->2826239) 00002000:00010000:0.0:1746129583.375897:0:31518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013145d500 00000100:00100000:0.0:1746129583.375936:0:31518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8249 00000100:00100000:0.0:1746129583.375943:0:31518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013145d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ada2ffba-8920-4ecb-8068-68caa9806978+39:1961:x1830948734483200:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:2.0:1746129583.376173:0:22480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734482944 00000100:00100000:2.0:1746129583.376178:0:22480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734482944 00000100:00100000:2.0:1746129583.376216:0:22480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16965 00000100:00100000:2.0:1746129583.376222:0:22480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013145ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+27:1962:x1830948734482944:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129583.376234:0:22480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129583.376252:0:22480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f598a00/0x40a459093b06bfa0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f22620 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129583.376339:0:22480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009507d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22480:1830948737647232:192.168.202.4@tcp:106: 00000100:00100000:3.0:1746129583.376443:0:7087:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009507ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7087:1830948737647104:192.168.202.4@tcp:105: 00010000:00010000:3.0:1746129583.376466:0:7087:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129583.376519:0:7087:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129bc3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ada2ffba-8920-4ecb-8068-68caa9806978+39:1960:x1830948734482688:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 8400us (8772us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129583.376528:0:7087:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8790 00000100:00100000:2.0:1746129583.378504:0:22480:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132dad3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746129583.378739:0:31518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013145d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ada2ffba-8920-4ecb-8068-68caa9806978+38:1961:x1830948734483200:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 2791us (2951us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746129583.378750:0:31518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8249 00002000:00100000:1.0:1746129583.378759:0:31518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3f5:0x0] (2822144->2826239) req@ffff88013145d500 x1830948734483200/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:324/0 lens 488/4536 e 0 to 0 dl 1746129594 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129583.378769:0:31518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013145d500 with x1830948734483200 ext(2822144->2826239) 00002000:00010000:1.0:1746129583.378773:0:31518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013145d500 00000100:00100000:2.0:1746129583.379355:0:31522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013145df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ada2ffba-8920-4ecb-8068-68caa9806978+33:1962:x1830948734481920:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 36633us (37504us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129583.379362:0:31522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8248 00002000:00100000:2.0:1746129583.379368:0:31522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->4194303) req@ffff88013145df80 x1830948734481920/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:324/0 lens 488/440 e 0 to 0 dl 1746129594 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129583.379375:0:31522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013145df80 with x1830948734481920 ext(3145728->4194303) 00002000:00010000:2.0:1746129583.379378:0:31522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013145df80 00000100:00100000:0.0:1746129583.380710:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00002000:00010000:2.0:1746129583.381161:0:22480:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3f5:0x0] updating lvb mtime: 1746129583 -> 1746129584 00002000:00010000:2.0:1746129583.381165:0:22480:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3f5:0x0] updating lvb atime: 1746129583 -> 1746129584 00002000:00010000:2.0:1746129583.381167:0:22480:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3f5:0x0] updating lvb ctime: 1746129583 -> 1746129584 00000100:00100000:2.0:1746129583.381189:0:22480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009507d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22480:1830948737647232:192.168.202.4@tcp:106: 00010000:00010000:2.0:1746129583.381236:0:22480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f598a00/0x40a459093b06bfa0 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22620 expref: 28 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129583.381249:0:22480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f598a00/0x40a459093b06bfa0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22620 expref: 28 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129583.381266:0:22480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f598a00, rc 0) 00000100:00100000:2.0:1746129583.381344:0:22480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013145ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+27:1962:x1830948734482944:12345-192.168.202.4@tcp:101:cat.0 Request processed in 5120us (5669us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129583.381353:0:22480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16965 00000100:00100000:3.0:1746129583.382095:0:31522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734483456 00000100:00100000:3.0:1746129583.382105:0:31522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734483456 00002000:00100000:3.0:1746129583.382155:0:31522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f5:0x0] (2097152->3145727) req@ffff8800912adc00 x1830948734483456/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:324/0 lens 504/0 e 0 to 0 dl 1746129594 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129583.382165:0:31522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800912adc00 with x1830948734483456 ext(2097152->3145727) 00002000:00010000:3.0:1746129583.382170:0:31522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800912adc00 00000100:00100000:3.0:1746129583.382196:0:31522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8250 00000100:00100000:3.0:1746129583.382219:0:31522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800912adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ada2ffba-8920-4ecb-8068-68caa9806978+38:1961:x1830948734483456:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:0.0:1746129583.396909:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129583.399614:0:31518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734483712 00000100:00100000:1.0:1746129583.399630:0:31518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734483712 00002000:00100000:1.0:1746129583.399688:0:31518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3ef:0x0] (2097152->3145727) req@ffff8800959d6d80 x1830948734483712/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:324/0 lens 488/0 e 0 to 0 dl 1746129594 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129583.399698:0:31518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800959d6d80 with x1830948734483712 ext(2097152->3145727) 00002000:00010000:1.0:1746129583.399705:0:31518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800959d6d80 00000100:00100000:1.0:1746129583.400460:0:31518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8251 00000100:00100000:1.0:1746129583.400473:0:31518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+29:1961:x1830948734483712:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129583.403459:0:31522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800912adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ada2ffba-8920-4ecb-8068-68caa9806978+38:1961:x1830948734483456:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 21244us (22742us total) trans 0 rc 1044480/1044480 00000100:00100000:0.0:1746129583.403473:0:31522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8250 00002000:00100000:0.0:1746129583.403486:0:31522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f5:0x0] (2097152->3145727) req@ffff8800912adc00 x1830948734483456/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:324/0 lens 504/440 e 0 to 0 dl 1746129594 ref 1 fl Complete:/200/0 rc 1044480/1044480 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129583.403495:0:31522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800912adc00 with x1830948734483456 ext(2097152->3145727) 00002000:00010000:0.0:1746129583.403502:0:31522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800912adc00 00000100:00100000:0.0:1746129583.415950:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129583.415992:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129583.416028:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129583.416503:0:22480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734484096 00000100:00100000:3.0:1746129583.416513:0:22480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734484096 00000100:00100000:3.0:1746129583.416557:0:22480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16966 00000100:00100000:3.0:1746129583.416564:0:22480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800915d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ada2ffba-8920-4ecb-8068-68caa9806978+33:32766:x1830948734484096:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:3.0:1746129583.416582:0:22480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129583.416599:0:22480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fab5000/0x40a459093b06bfa7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f22627 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129583.416628:0:22480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095d83000/0x40a459093b06bf61 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f225fd expref: 34 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129583.416641:0:22480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fa7e400/0x40a459093b06bf99 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22619 expref: 30 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129583.416647:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129583.416649:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129583.416651:0:22480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fab5000/0x40a459093b06bfa7 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [3145728->3588095] (req 3145728->3588095) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22627 expref: 34 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129583.416681:0:22480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fa7e400/0x40a459093b06bf99 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22619 expref: 30 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129583.416690:0:22480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fa7e400/0x40a459093b06bf99 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22619 expref: 30 pid: 11014 timeout: 938 lvb_type: 1 00000100:00100000:3.0:1746129583.416764:0:22480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094066d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22480:1830948737647360:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129583.416832:0:8417:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734483968 00000100:00100000:2.0:1746129583.416836:0:8417:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734483968 00002000:00100000:2.0:1746129583.416863:0:8417:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3f5:0x0] (2822144->3145727) req@ffff8800959d4000 x1830948734483968/t0(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:324/0 lens 488/0 e 0 to 0 dl 1746129594 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00010000:00010000:3.0:1746129583.416867:0:22480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095d83000/0x40a459093b06bf61 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f225fd expref: 34 pid: 11014 timeout: 0 lvb_type: 0 00002000:00100000:2.0:1746129583.416873:0:8417:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800959d4000 with x1830948734483968 ext(2822144->3145727) 00010000:00010000:3.0:1746129583.416875:0:22480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095d83000/0x40a459093b06bf61 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f225fd expref: 34 pid: 11014 timeout: 938 lvb_type: 0 00002000:00010000:2.0:1746129583.416879:0:8417:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800959d4000 00000100:00100000:3.0:1746129583.416882:0:22480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094066300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22480:1830948737647488:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129583.416891:0:8417:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734484352 00000100:00100000:2.0:1746129583.416893:0:8417:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734484352 00000100:00100000:3.0:1746129583.416901:0:22480:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009518b6c0 going to sleep for 11 seconds 00002000:00100000:2.0:1746129583.416903:0:8417:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3f5:0x0] (3145728->4194303) req@ffff8800915d3b80 x1830948734484352/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:324/0 lens 488/0 e 0 to 0 dl 1746129594 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129583.416908:0:8417:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800915d3b80 with x1830948734484352 ext(3145728->4194303) 00002000:00010000:2.0:1746129583.416911:0:8417:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800915d3b80 00000100:00100000:2.0:1746129583.416921:0:8417:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8252 00000100:00100000:2.0:1746129583.416925:0:8417:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ada2ffba-8920-4ecb-8068-68caa9806978+39:1961:x1830948734483968:12345-192.168.202.4@tcp:4:multiop.0 00000100:00100000:3.0:1746129583.416929:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8253 00000100:00100000:3.0:1746129583.416936:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800915d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+39:1960:x1830948734484352:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:3.0:1746129583.425504:0:22480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094066d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22480:1830948737647360:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129583.425518:0:22480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094066300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22480:1830948737647488:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129583.425552:0:22480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fab5000/0x40a459093b06bfa7 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [3145728->3588095] (req 3145728->3588095) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22627 expref: 34 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129583.425574:0:22480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fab5000, rc 0) 00000100:00100000:3.0:1746129583.425625:0:22480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800915d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ada2ffba-8920-4ecb-8068-68caa9806978+34:32766:x1830948734484096:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 9060us (9631us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129583.425633:0:22480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16966 00000100:00100000:0.0:1746129583.427529:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129583.427589:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734484480 00000100:00100000:3.0:1746129583.427598:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734484480 00010000:00010000:3.0:1746129583.427637:0:7087:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095d83000/0x40a459093b06bf61 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f225fd expref: 34 pid: 11014 timeout: 938 lvb_type: 0 00000100:00100000:3.0:1746129583.427682:0:7087:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8791 00000100:00100000:3.0:1746129583.427688:0:7087:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800915d1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ada2ffba-8920-4ecb-8068-68caa9806978+34:1962:x1830948734484480:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129583.427702:0:7087:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129583.427727:0:7087:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095d83000/0x40a459093b06bf61 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f225fd expref: 34 pid: 11014 timeout: 938 lvb_type: 0 00010000:00010000:3.0:1746129583.427738:0:7087:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095d83000/0x40a459093b06bf61 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f225fd expref: 34 pid: 11014 timeout: 938 lvb_type: 0 00010000:00010000:3.0:1746129583.427767:0:7087:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095d83000/0x40a459093b06bf61 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f225fd expref: 34 pid: 11014 timeout: 938 lvb_type: 0 00010000:00010000:3.0:1746129583.427801:0:7087:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129583.427842:0:7087:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800915d1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ada2ffba-8920-4ecb-8068-68caa9806978+33:1962:x1830948734484480:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 154us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129583.427849:0:7087:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8791 00000100:00100000:1.0:1746129583.428186:0:31518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+29:1961:x1830948734483712:12345-192.168.202.4@tcp:3:cat.0 Request processed in 23559us (27134us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129583.428196:0:31518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8251 00002000:00100000:1.0:1746129583.428216:0:31518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3ef:0x0] (2097152->3145727) req@ffff8800959d6d80 x1830948734483712/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:324/0 lens 488/440 e 0 to 0 dl 1746129594 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129583.428225:0:31518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800959d6d80 with x1830948734483712 ext(2097152->3145727) 00010000:00010000:1.0:1746129583.428232:0:31518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fa7e400/0x40a459093b06bf99 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22619 expref: 29 pid: 11014 timeout: 938 lvb_type: 1 00010000:00010000:1.0:1746129583.428243:0:31518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fa7e400/0x40a459093b06bf99 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22619 expref: 29 pid: 11014 timeout: 938 lvb_type: 1 00002000:00010000:1.0:1746129583.428249:0:31518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800959d6d80 00000100:00100000:0.0:1746129583.434978:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129583.435333:0:22480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734484736 00000100:00100000:3.0:1746129583.435344:0:22480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734484736 00000100:00100000:3.0:1746129583.435412:0:22480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16967 00000100:00100000:3.0:1746129583.435421:0:22480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800915d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+27:32765:x1830948734484736:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129583.435439:0:22480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129583.435457:0:22480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fab4000/0x40a459093b06bfae lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2262e expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129583.435488:0:22480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095d83c00/0x40a459093b06bf92 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2822144->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22612 expref: 41 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129583.435496:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129583.435497:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129583.435501:0:22480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fab4000/0x40a459093b06bfae lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2262e expref: 28 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129583.435533:0:22480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095d83c00/0x40a459093b06bf92 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2822144->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22612 expref: 42 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129583.435543:0:22480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095d83c00/0x40a459093b06bf92 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2822144->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22612 expref: 42 pid: 11014 timeout: 938 lvb_type: 0 00000100:00100000:2.0:1746129583.435659:0:8417:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ada2ffba-8920-4ecb-8068-68caa9806978+42:1961:x1830948734483968:12345-192.168.202.4@tcp:4:multiop.0 Request processed in 18730us (19719us total) trans 17179874216 rc 0/0 00000100:00100000:2.0:1746129583.435668:0:8417:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8252 00002000:00100000:2.0:1746129583.435678:0:8417:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3f5:0x0] (2822144->3145727) req@ffff8800959d4000 x1830948734483968/t17179874216(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:324/0 lens 488/448 e 0 to 0 dl 1746129594 ref 1 fl Complete:/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129583.435686:0:8417:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800959d4000 with x1830948734483968 ext(2822144->3145727) 00010000:00010000:2.0:1746129583.435692:0:8417:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095d83c00/0x40a459093b06bf92 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2822144->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22612 expref: 42 pid: 11014 timeout: 938 lvb_type: 0 00010000:00010000:2.0:1746129583.435701:0:8417:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095d83c00/0x40a459093b06bf92 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2822144->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22612 expref: 42 pid: 11014 timeout: 938 lvb_type: 0 00002000:00010000:2.0:1746129583.435711:0:8417:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800959d4000 00000100:00100000:3.0:1746129583.435889:0:22480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094066300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22480:1830948737647616:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129583.435976:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129583.436001:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734484608 00000100:00100000:0.0:1746129583.436004:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734484608 00010000:00010000:0.0:1746129583.436022:0:7087:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fa7e400/0x40a459093b06bf99 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22619 expref: 29 pid: 11014 timeout: 938 lvb_type: 1 00000100:00100000:0.0:1746129583.436041:0:7087:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8792 00000100:00100000:0.0:1746129583.436047:0:7087:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800915d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+29:1963:x1830948734484608:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129583.436057:0:7087:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129583.436079:0:7087:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fa7e400/0x40a459093b06bf99 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22619 expref: 29 pid: 11014 timeout: 938 lvb_type: 1 00010000:00010000:0.0:1746129583.436089:0:7087:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fa7e400/0x40a459093b06bf99 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22619 expref: 29 pid: 11014 timeout: 938 lvb_type: 1 00010000:00010000:0.0:1746129583.436110:0:7087:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fa7e400/0x40a459093b06bf99 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22619 expref: 29 pid: 11014 timeout: 938 lvb_type: 1 00010000:00010000:0.0:1746129583.436131:0:7087:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129583.436132:0:7087:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129583.436140:0:7087:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fab5000/0x40a459093b06bfa7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3588095) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22627 expref: 32 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129583.436153:0:7087:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fab5000/0x40a459093b06bfa7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3588095) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22627 expref: 32 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129583.436193:0:7087:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009fab5000/0x40a459093b06bfa7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3588095) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22627 expref: 32 pid: 22480 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129583.436216:0:7087:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800915d1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7087:1830948737647744:192.168.202.4@tcp:105: 00000100:00100000:3.0:1746129583.436217:0:22480:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009518b6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746129583.436523:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800915d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+40:1960:x1830948734484352:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 19587us (20494us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129583.436529:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8253 00002000:00100000:2.0:1746129583.436535:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f5:0x0] (3145728->4194303) req@ffff8800915d3b80 x1830948734484352/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:324/0 lens 488/440 e 0 to 0 dl 1746129594 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129583.436541:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800915d3b80 with x1830948734484352 ext(3145728->4194303) 00010000:00010000:2.0:1746129583.436546:0:25745:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095d83c00/0x40a459093b06bf92 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2822144->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22612 expref: 40 pid: 11014 timeout: 938 lvb_type: 0 00010000:00010000:2.0:1746129583.436555:0:25745:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095d83c00/0x40a459093b06bf92 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2822144->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22612 expref: 40 pid: 11014 timeout: 938 lvb_type: 0 00002000:00010000:2.0:1746129583.436560:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800915d3b80 00000100:00100000:0.0:1746129583.436677:0:7087:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa3ef000 going to sleep for 11 seconds 00000100:00100000:0.0:1746129583.443029:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129583.443063:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129583.443074:0:22480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094066300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22480:1830948737647616:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129583.443093:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129583.443103:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734484992 00010000:00010000:3.0:1746129583.443105:0:22480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fab4000/0x40a459093b06bfae lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2262e expref: 28 pid: 22480 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129583.443110:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734484992 00010000:00010000:3.0:1746129583.443124:0:22480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fab4000, rc 0) 00000100:00100000:0.0:1746129583.443130:0:11014:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734485120 00000100:00100000:0.0:1746129583.443133:0:11014:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734485120 00002000:00100000:2.0:1746129583.443152:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ef:0x0] (3584000->3588095) req@ffff8800915d0a80 x1830948734484992/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:324/0 lens 488/0 e 0 to 0 dl 1746129594 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:0.0:1746129583.443154:0:11014:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734485248 00000100:00100000:0.0:1746129583.443156:0:11014:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734485248 00002000:00100000:2.0:1746129583.443160:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800915d0a80 with x1830948734484992 ext(3584000->3588095) 00002000:00010000:2.0:1746129583.443164:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800915d0a80 00000100:00100000:3.0:1746129583.443170:0:22480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800915d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+28:32765:x1830948734484736:12345-192.168.202.4@tcp:101:cat.0 Request processed in 7750us (8203us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129583.443171:0:11014:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16968 00000100:00100000:3.0:1746129583.443176:0:22480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16967 00000100:00100000:2.0:1746129583.443177:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8254 00000100:00100000:0.0:1746129583.443178:0:11014:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800915d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ada2ffba-8920-4ecb-8068-68caa9806978+34:1960:x1830948734485120:12345-192.168.202.4@tcp:101:cat.0 00000100:00100000:2.0:1746129583.443181:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800915d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+34:1960:x1830948734484992:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:3.0:1746129583.443191:0:22480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16969 00010000:00010000:0.0:1746129583.443195:0:11014:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746129583.443196:0:22480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800915d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ada2ffba-8920-4ecb-8068-68caa9806978+40:1960:x1830948734485248:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129583.443224:0:11014:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008fa79000/0x40a459093b06bfb5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f22635 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129583.443244:0:11014:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129583.443246:0:11014:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129583.443257:0:11014:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008fa79000/0x40a459093b06bfb5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22635 expref: 35 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129583.443274:0:11014:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008fa79000/0x40a459093b06bfb5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22635 expref: 35 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129583.443284:0:11014:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fa79000, rc 0) 00000100:00100000:0.0:1746129583.443326:0:11014:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800915d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ada2ffba-8920-4ecb-8068-68caa9806978+35:1960:x1830948734485120:12345-192.168.202.4@tcp:101:cat.0 Request processed in 148us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129583.443331:0:11014:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16968 00000100:00100000:2.0:1746129583.443397:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800915d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+35:1960:x1830948734484992:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 214us (377us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746129583.443402:0:7087:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800915d1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7087:1830948737647744:192.168.202.4@tcp:105: 00000100:00100000:2.0:1746129583.443404:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8254 00002000:00100000:2.0:1746129583.443409:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ef:0x0] (3584000->3588095) req@ffff8800915d0a80 x1830948734484992/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:324/0 lens 488/4536 e 0 to 0 dl 1746129594 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129583.443415:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800915d0a80 with x1830948734484992 ext(3584000->3588095) 00010000:00010000:1.0:1746129583.443415:0:7087:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00010000:2.0:1746129583.443418:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800915d0a80 00000100:00100000:1.0:1746129583.443436:0:7087:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800915d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+28:1963:x1830948734484608:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 7389us (7460us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129583.443444:0:7087:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8792 00010000:00010000:3.0:1746129583.443855:0:22480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129583.443865:0:22480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fab5200/0x40a459093b06bfbc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2263c expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129583.443898:0:22480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094066300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22480:1830948737647872:192.168.202.4@tcp:106: 00000100:00100000:3.0:1746129583.443947:0:22480:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009518b6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129583.450073:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129583.450172:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734485376 00000100:00100000:1.0:1746129583.450181:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734485376 00010000:00010000:1.0:1746129583.450228:0:7087:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095d83c00/0x40a459093b06bf92 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2822144->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22612 expref: 42 pid: 11014 timeout: 938 lvb_type: 0 00000100:00100000:1.0:1746129583.450275:0:7087:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8793 00000100:00100000:1.0:1746129583.450282:0:7087:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800915d3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ada2ffba-8920-4ecb-8068-68caa9806978+42:1960:x1830948734485376:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129583.450328:0:7087:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129583.450352:0:7087:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095d83c00/0x40a459093b06bf92 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2822144->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22612 expref: 42 pid: 11014 timeout: 938 lvb_type: 0 00010000:00010000:1.0:1746129583.450364:0:7087:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095d83c00/0x40a459093b06bf92 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2822144->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22612 expref: 42 pid: 11014 timeout: 938 lvb_type: 0 00010000:00010000:1.0:1746129583.450388:0:7087:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129583.450391:0:7087:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129583.450398:0:7087:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fab4000/0x40a459093b06bfae lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2262e expref: 27 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129583.450406:0:7087:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fab4000/0x40a459093b06bfae lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2262e expref: 27 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129583.450437:0:7087:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fab4000/0x40a459093b06bfae lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2262e expref: 27 pid: 22480 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129583.450449:0:7087:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129bc3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7087:1830948737648000:192.168.202.4@tcp:105: 00000100:00100000:1.0:1746129583.450540:0:7087:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a91c5d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746129583.451436:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129583.451500:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734485632 00000100:00100000:3.0:1746129583.451505:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734485632 00000100:00100000:3.0:1746129583.451547:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11387 00000100:00100000:3.0:1746129583.451553:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800915d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:068dab75-d300-4ead-a742-d14572ad1e50+12:301:x1830948734485632:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:3.0:1746129583.451573:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129583.451590:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab4800/0x40a459093b06bfc3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2264a expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129583.451648:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab5400/0x40a459093b06bfca lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746129583.451659:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab5400/0x40a459093b06bfca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746129583.451669:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab5400/0x40a459093b06bfca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746129583.451680:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab4600/0x40a459093b06bfd1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746129583.451685:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab4600/0x40a459093b06bfd1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746129583.451689:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab4600/0x40a459093b06bfd1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746129583.451810:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab4c00/0x40a459093b06bfd8 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746129583.451821:0:14548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa7e000/0x40a459093b06bece lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f225a9 expref: 303 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129583.451827:0:14548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab4c00/0x40a459093b06bfd8 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746129583.451850:0:14548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa7e000/0x40a459093b06bece lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f225a9 expref: 303 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129583.451863:0:14548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa7e000/0x40a459093b06bece lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f225a9 expref: 303 pid: 14548 timeout: 938 lvb_type: 0 00000100:00100000:3.0:1746129583.451872:0:14548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094066d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14548:1830948737648128:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129583.453130:0:14548:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009518bcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746129583.453340:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129583.453390:0:31503:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734485504 00000100:00100000:0.0:1746129583.453396:0:31503:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734485504 00000100:00100000:0.0:1746129583.453439:0:31503:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16970 00000100:00100000:0.0:1746129583.453447:0:31503:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009507d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+28:300:x1830948734485504:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:0.0:1746129583.453459:0:31503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129583.453473:0:31503:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008fa79e00/0x40a459093b06bfdf lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f22643 expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129583.453495:0:31503:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095d82600/0x40a459093b06bf68 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22604 expref: 29 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129583.453501:0:22480:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.202.4@tcp) returned -22 from glimpse AST (req@ffff880094066300 x1830948737647872) - normal race ns: filter-lustre-OST0001_UUID lock: ffff880095d83c00/0x40a459093b06bf92 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2822144->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22612 expref: 42 pid: 11014 timeout: 938 lvb_type: 0 00010000:00010000:0.0:1746129583.453503:0:31503:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008fa79000/0x40a459093b06bfb5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22635 expref: 33 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129583.453509:0:31503:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129583.453511:0:31503:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129583.453515:0:31503:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008fa79e00/0x40a459093b06bfdf lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [581632->1048575] (req 581632->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22643 expref: 29 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129583.453532:0:22480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095d83c00/0x40a459093b06bf92 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2822144->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22612 expref: 42 pid: 11014 timeout: 938 lvb_type: 0 00010000:00010000:0.0:1746129583.453536:0:31503:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008fa79000/0x40a459093b06bfb5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22635 expref: 33 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129583.453545:0:31503:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008fa79000/0x40a459093b06bfb5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22635 expref: 33 pid: 11014 timeout: 938 lvb_type: 1 00000100:00100000:3.0:1746129583.453548:0:22480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094066300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22480:1830948737647872:192.168.202.4@tcp:106: 00000100:00100000:0.0:1746129583.453553:0:31503:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800915d2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:31503:1830948737648256:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129583.453570:0:22480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fab5200/0x40a459093b06bfbc lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2263c expref: 41 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129583.453579:0:22480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fab5200/0x40a459093b06bfbc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2263c expref: 41 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129583.453586:0:22480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fab5200, rc 0) 00010000:00010000:0.0:1746129583.453604:0:31503:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095d82600/0x40a459093b06bf68 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22604 expref: 29 pid: 11014 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129583.453606:0:22480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800915d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ada2ffba-8920-4ecb-8068-68caa9806978+40:1960:x1830948734485248:12345-192.168.202.4@tcp:101:cat.0 Request processed in 10410us (10513us total) trans 0 rc 301/301 00010000:00010000:0.0:1746129583.453611:0:31503:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095d82600/0x40a459093b06bf68 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22604 expref: 29 pid: 11014 timeout: 938 lvb_type: 0 00000100:00100000:3.0:1746129583.453613:0:22480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16969 00000100:00100000:0.0:1746129583.453618:0:31503:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800915d0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:31503:1830948737648384:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129583.453632:0:31503:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa3ef000 going to sleep for 11 seconds 00000100:00100000:1.0:1746129583.453686:0:7087:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129bc3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7087:1830948737648000:192.168.202.4@tcp:105: 00010000:00010000:1.0:1746129583.453698:0:7087:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129583.453719:0:7087:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800915d3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ada2ffba-8920-4ecb-8068-68caa9806978+39:1960:x1830948734485376:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 3438us (3656us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129583.453727:0:7087:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8793 00000100:00100000:0.0:1746129583.454389:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129583.454492:0:14551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734485888 00000100:00100000:1.0:1746129583.454497:0:14551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734485888 00000100:00100000:1.0:1746129583.454542:0:14551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4863 00000100:00100000:1.0:1746129583.454548:0:14551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800915d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ada2ffba-8920-4ecb-8068-68caa9806978+304:15417:x1830948734485888:12345-192.168.202.4@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746129583.454779:0:14551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800915d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ada2ffba-8920-4ecb-8068-68caa9806978+305:15417:x1830948734485888:12345-192.168.202.4@tcp:35:ldlm_bl.0 Request processed in 230us (390us total) trans 8589945520 rc 0/0 00000100:00100000:1.0:1746129583.454784:0:14551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4863 00000100:00100000:3.0:1746129583.454904:0:14548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094066d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14548:1830948737648128:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129583.454923:0:14548:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab4c00/0x40a459093b06bfd8 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000100:00080000:0.0:1746129583.455274:0:7097:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746129583.455936:0:31503:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800915d2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:31503:1830948737648256:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129583.457351:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129583.457548:0:31503:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800915d0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:31503:1830948737648384:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129583.457580:0:31503:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008fa79e00/0x40a459093b06bfdf lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [581632->1048575] (req 581632->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22643 expref: 29 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129583.457597:0:31503:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fa79e00, rc 0) 00000100:00100000:0.0:1746129583.457637:0:31503:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009507d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+29:300:x1830948734485504:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 4191us (4298us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129583.457647:0:31503:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16970 00000100:00100000:1.0:1746129583.457826:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734486016 00000100:00100000:1.0:1746129583.457833:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734486016 00000100:00100000:2.0:1746129583.457854:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00010000:00010000:1.0:1746129583.457862:0:7087:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008fa79000/0x40a459093b06bfb5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22635 expref: 34 pid: 11014 timeout: 938 lvb_type: 1 00000100:00100000:1.0:1746129583.458282:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734486144 00000100:00100000:1.0:1746129583.458286:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734486144 00010000:00010000:1.0:1746129583.458320:0:7087:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa7e000/0x40a459093b06bece lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f225a9 expref: 305 pid: 14548 timeout: 938 lvb_type: 0 00000100:00100000:1.0:1746129583.458337:0:7087:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8794 00000100:00100000:1.0:1746129583.458343:0:7087:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a46050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ada2ffba-8920-4ecb-8068-68caa9806978+34:1962:x1830948734486016:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129583.458356:0:7087:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129583.458378:0:7087:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008fa79000/0x40a459093b06bfb5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22635 expref: 34 pid: 11014 timeout: 938 lvb_type: 1 00000100:00100000:2.0:1746129583.458683:0:15749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8795 00000100:00100000:2.0:1746129583.458691:0:15749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009507e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ada2ffba-8920-4ecb-8068-68caa9806978+305:1961:x1830948734486144:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129583.458698:0:15749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129583.458704:0:15749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa7e000/0x40a459093b06bece lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f225a9 expref: 305 pid: 14548 timeout: 938 lvb_type: 0 00010000:00010000:2.0:1746129583.458714:0:15749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa7e000/0x40a459093b06bece lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f225a9 expref: 305 pid: 14548 timeout: 938 lvb_type: 0 00010000:00010000:2.0:1746129583.458736:0:15749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa7e000/0x40a459093b06bece lrc: 0/0,0 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f225a9 expref: 305 pid: 14548 timeout: 938 lvb_type: 0 00010000:00010000:2.0:1746129583.458757:0:15749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009cffe100) 00010000:00010000:2.0:1746129583.458761:0:15749:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab4c00/0x40a459093b06bfd8 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746129583.458772:0:15749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab4c00/0x40a459093b06bfd8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746129583.458779:0:15749:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab4c00/0x40a459093b06bfd8 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746129583.458803:0:15749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129583.458827:0:15749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009507e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ada2ffba-8920-4ecb-8068-68caa9806978+304:1961:x1830948734486144:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 137us (972us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129583.458833:0:15749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8795 00010000:00010000:1.0:1746129583.458999:0:7087:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008fa79000/0x40a459093b06bfb5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22635 expref: 34 pid: 11014 timeout: 938 lvb_type: 1 00010000:00010000:3.0:1746129583.459000:0:14548:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab4c00/0x40a459093b06bfd8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746129583.459010:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab4c00/0x40a459093b06bfd8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746129583.459013:0:7087:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008fa79000/0x40a459093b06bfb5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22635 expref: 34 pid: 11014 timeout: 938 lvb_type: 1 00010000:00010000:1.0:1746129583.459022:0:7087:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129583.459041:0:7087:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a46050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ada2ffba-8920-4ecb-8068-68caa9806978+33:1962:x1830948734486016:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 699us (1696us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129583.459047:0:7087:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8794 00000004:00200000:3.0:1746129583.459051:0:14548:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00000004:00200000:3.0:1746129583.459055:0:14548:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746129583.459070:0:14548:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab4c00/0x40a459093b06bfd8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746129583.459079:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab4c00/0x40a459093b06bfd8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746129583.459088:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab5400/0x40a459093b06bfca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746129583.459094:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab5400/0x40a459093b06bfca lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746129583.459099:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab5400/0x40a459093b06bfca lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746129583.459104:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fab5400 already unused, calling callback (ffffffffa136e690) 00010000:00010000:3.0:1746129583.459108:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab5400/0x40a459093b06bfca lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746129583.459114:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab5400/0x40a459093b06bfca lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00000100:00100000:1.0:1746129583.459115:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00010000:00010000:3.0:1746129583.459123:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880132ef8f00) 00010000:00010000:3.0:1746129583.459126:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129583.459129:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab5400/0x40a459093b06bfca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746129583.459134:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab5400/0x40a459093b06bfca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746129583.459147:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab4600/0x40a459093b06bfd1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746129583.459152:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab4600/0x40a459093b06bfd1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746129583.459157:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab4600/0x40a459093b06bfd1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746129583.459160:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fab4600 already unused, calling callback (ffffffffa136e690) 00010000:00010000:3.0:1746129583.459162:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab4600/0x40a459093b06bfd1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746129583.459166:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab4600/0x40a459093b06bfd1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746129583.459171:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880090643f00) 00010000:00010000:3.0:1746129583.459173:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129583.459175:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab4600/0x40a459093b06bfd1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746129583.459179:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab4600/0x40a459093b06bfd1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746129583.459220:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab4800/0x40a459093b06bfc3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2264a expref: 14 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129583.459230:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab4c00/0x40a459093b06bfd8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2264a expref: 13 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129583.459236:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009cffe100) 00010000:00010000:3.0:1746129583.459239:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746129583.459241:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fab4c00, rc 0) 00000100:00100000:0.0:1746129583.459251:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734486272 00000100:00100000:0.0:1746129583.459255:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734486272 00010000:00010000:0.0:1746129583.459268:0:7087:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095d82600/0x40a459093b06bf68 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22604 expref: 29 pid: 11014 timeout: 938 lvb_type: 0 00000100:00100000:3.0:1746129583.459277:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800915d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:068dab75-d300-4ead-a742-d14572ad1e50+13:301:x1830948734485632:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 7723us (7843us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129583.459284:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11387 00000100:00100000:0.0:1746129583.459286:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8796 00000100:00100000:0.0:1746129583.459305:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129bc3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+29:1962:x1830948734486272:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129583.459312:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129583.459323:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095d82600/0x40a459093b06bf68 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22604 expref: 29 pid: 11014 timeout: 938 lvb_type: 0 00010000:00010000:0.0:1746129583.459331:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095d82600/0x40a459093b06bf68 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22604 expref: 29 pid: 11014 timeout: 938 lvb_type: 0 00010000:00010000:0.0:1746129583.459697:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095d82600/0x40a459093b06bf68 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22604 expref: 29 pid: 11014 timeout: 938 lvb_type: 0 00010000:00010000:0.0:1746129583.459960:0:9823:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129583.459962:0:9823:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129583.459969:0:9823:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008fa79e00/0x40a459093b06bfdf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 581632->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22643 expref: 28 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129583.459977:0:9823:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008fa79e00/0x40a459093b06bfdf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 581632->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22643 expref: 28 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129583.460004:0:9823:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008fa79e00/0x40a459093b06bfdf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 581632->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22643 expref: 28 pid: 31503 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129583.460016:0:9823:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800915d0380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9823:1830948737648512:192.168.202.4@tcp:105: 00000100:00100000:0.0:1746129583.460083:0:9823:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa3ef000 going to sleep for 11 seconds 00000100:00100000:3.0:1746129583.460145:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129583.460254:0:8417:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734486528 00000100:00100000:2.0:1746129583.460259:0:8417:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734486528 00002000:00100000:2.0:1746129583.460291:0:8417:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3f5:0x0] (2097152->3145727) req@ffff880094066d80 x1830948734486528/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:324/0 lens 488/0 e 0 to 0 dl 1746129594 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129583.460366:0:8417:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094066d80 with x1830948734486528 ext(2097152->3145727) 00002000:00010000:2.0:1746129583.460370:0:8417:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094066d80 00000100:00100000:2.0:1746129583.460385:0:8417:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8255 00000100:00100000:2.0:1746129583.460391:0:8417:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094066d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+28:1960:x1830948734486528:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:0.0:1746129583.469435:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129583.469486:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129583.469513:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129583.469536:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129583.470270:0:31503:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734487040 00000100:00100000:1.0:1746129583.470279:0:31503:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734487040 00000100:00100000:1.0:1746129583.470359:0:31503:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734486912 00000100:00100000:1.0:1746129583.470361:0:31503:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734486912 00000100:00100000:1.0:1746129583.470374:0:31503:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734487168 00000100:00100000:1.0:1746129583.470375:0:31503:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734487168 00000100:00100000:1.0:1746129583.470394:0:31503:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16971 00000100:00100000:1.0:1746129583.470401:0:31503:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800915d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:068dab75-d300-4ead-a742-d14572ad1e50+10:1962:x1830948734487040:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:1.0:1746129583.470419:0:31503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129583.470436:0:31503:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095d83400/0x40a459093b06bfe6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f22658 expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129583.470487:0:31503:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129bc3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:31503:1830948737648640:192.168.202.4@tcp:106: 00000100:00100000:1.0:1746129583.470564:0:31503:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a91c5a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746129583.470584:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16972 00000100:00100000:1.0:1746129583.470589:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800915d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:068dab75-d300-4ead-a742-d14572ad1e50+11:1962:x1830948734486912:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:1.0:1746129583.470595:0:4385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129583.470602:0:4385:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095d82a00/0x40a459093b06bfed lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f22651 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129583.470623:0:4385:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129bc0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:4385:1830948737648768:192.168.202.4@tcp:106: 00000100:00100000:1.0:1746129583.470639:0:4385:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a91c5540 going to sleep for 11 seconds 00000100:00100000:1.0:1746129583.470654:0:11014:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16973 00000100:00100000:1.0:1746129583.470658:0:11014:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800915d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:068dab75-d300-4ead-a742-d14572ad1e50+10:1962:x1830948734487168:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:1.0:1746129583.470664:0:11014:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129583.470674:0:11014:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095d82c00/0x40a459093b06bff4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2265f expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129583.470684:0:11014:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129583.470686:0:11014:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129583.470694:0:11014:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095d82c00/0x40a459093b06bff4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2265f expref: 11 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129583.470708:0:11014:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095d82c00/0x40a459093b06bff4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2265f expref: 11 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129583.470718:0:11014:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095d82c00, rc 0) 00000100:00100000:1.0:1746129583.470737:0:11014:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800915d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:068dab75-d300-4ead-a742-d14572ad1e50+11:1962:x1830948734487168:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 78us (1200us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129583.470743:0:11014:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16973 00000100:00100000:2.0:1746129583.470779:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734486784 00000100:00100000:2.0:1746129583.470784:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734486784 00002000:00100000:2.0:1746129583.470812:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ef:0x0] (4194304->5148671) req@ffff8800915d2d80 x1830948734486784/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:324/0 lens 488/0 e 0 to 0 dl 1746129594 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129583.470822:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800915d2d80 with x1830948734486784 ext(4194304->5148671) 00002000:00010000:2.0:1746129583.470827:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800915d2d80 00000100:00100000:2.0:1746129583.470840:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8256 00000100:00100000:2.0:1746129583.470846:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800915d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+33:1960:x1830948734486784:12345-192.168.202.4@tcp:3:cat.0 00000100:00080000:0.0:1746129583.471651:0:7097:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1746129583.471657:0:7097:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746129583.472943:0:9823:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800915d0380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9823:1830948737648512:192.168.202.4@tcp:105: 00010000:00010000:0.0:1746129583.472965:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129583.472994:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129bc3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+28:1962:x1830948734486272:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 13701us (13878us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129583.473003:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8796 00002000:00010000:2.0:1746129583.474638:0:31503:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb mtime: 1746129583 -> 1746129584 00002000:00010000:2.0:1746129583.474646:0:31503:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb atime: 1746129583 -> 1746129584 00002000:00010000:2.0:1746129583.474649:0:31503:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb ctime: 1746129583 -> 1746129584 00000100:00100000:2.0:1746129583.474670:0:31503:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129bc3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:31503:1830948737648640:192.168.202.4@tcp:106: 00010000:00010000:2.0:1746129583.474700:0:31503:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095d83400/0x40a459093b06bfe6 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22658 expref: 12 pid: 31503 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129583.474713:0:31503:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095d83400/0x40a459093b06bfe6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22658 expref: 12 pid: 31503 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129583.474745:0:31503:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095d83400, rc 0) 00000100:00100000:2.0:1746129583.474787:0:31503:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800915d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:068dab75-d300-4ead-a742-d14572ad1e50+11:1962:x1830948734487040:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 4385us (5299us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129583.474795:0:31503:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16971 00002000:00010000:1.0:1746129583.474946:0:4385:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3ec:0x0] updating lvb mtime: 1746129583 -> 1746129584 00002000:00010000:1.0:1746129583.474949:0:4385:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3ec:0x0] updating lvb atime: 1746129583 -> 1746129584 00002000:00010000:1.0:1746129583.474950:0:4385:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3ec:0x0] updating lvb ctime: 1746129583 -> 1746129584 00000100:00100000:1.0:1746129583.474961:0:4385:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129bc0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:4385:1830948737648768:192.168.202.4@tcp:106: 00010000:00010000:1.0:1746129583.474977:0:4385:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095d82a00/0x40a459093b06bfed lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22651 expref: 10 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129583.474985:0:4385:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095d82a00/0x40a459093b06bfed lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22651 expref: 10 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129583.474997:0:4385:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095d82a00, rc 0) 00000100:00100000:1.0:1746129583.475018:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800915d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:068dab75-d300-4ead-a742-d14572ad1e50+9:1962:x1830948734486912:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 4428us (5504us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129583.475023:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16972 00000100:00100000:2.0:1746129583.477783:0:8417:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094066d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+28:1960:x1830948734486528:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 17379us (17625us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129583.477797:0:8417:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8255 00002000:00100000:2.0:1746129583.477810:0:8417:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3f5:0x0] (2097152->3145727) req@ffff880094066d80 x1830948734486528/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:324/0 lens 488/440 e 0 to 0 dl 1746129594 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129583.477818:0:8417:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094066d80 with x1830948734486528 ext(2097152->3145727) 00002000:00010000:2.0:1746129583.477824:0:8417:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094066d80 00000100:00100000:0.0:1746129583.479248:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129583.479288:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129583.479402:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734487552 00000100:00100000:3.0:1746129583.479410:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734487552 00000100:00100000:3.0:1746129583.479457:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11388 00000100:00100000:3.0:1746129583.479464:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800915d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:068dab75-d300-4ead-a742-d14572ad1e50+13:301:x1830948734487552:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:3.0:1746129583.479484:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129583.479502:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f5e4400/0x40a459093b06bffb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2266d expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129583.480027:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800915d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+33:1960:x1830948734486784:12345-192.168.202.4@tcp:3:cat.0 Request processed in 9177us (10599us total) trans 0 rc 954368/954368 00000100:00100000:2.0:1746129583.480035:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8256 00002000:00100000:2.0:1746129583.480043:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ef:0x0] (4194304->5148671) req@ffff8800915d2d80 x1830948734486784/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:324/0 lens 488/440 e 0 to 0 dl 1746129594 ref 1 fl Complete:/200/0 rc 954368/954368 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129583.480051:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800915d2d80 with x1830948734486784 ext(4194304->5148671) 00002000:00010000:2.0:1746129583.480057:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800915d2d80 00010000:00010000:3.0:1746129583.480190:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f5e4600/0x40a459093b06c002 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746129583.480220:0:14548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab4c00/0x40a459093b06bfd8 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2264a expref: 14 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129583.480228:0:14548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f5e4600/0x40a459093b06c002 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746129583.480263:0:14548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab4c00/0x40a459093b06bfd8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2264a expref: 14 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129583.480275:0:14548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab4c00/0x40a459093b06bfd8 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2264a expref: 14 pid: 14548 timeout: 938 lvb_type: 0 00000100:00100000:3.0:1746129583.480287:0:14548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094066300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14548:1830948737648896:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129583.480382:0:14548:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009518bcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746129583.480512:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734487296 00000100:00100000:1.0:1746129583.480517:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734487296 00000100:00100000:1.0:1746129583.480551:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16974 00000100:00100000:1.0:1746129583.480556:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800915d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+28:300:x1830948734487296:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:1.0:1746129583.480565:0:4385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129583.480577:0:4385:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800915d4c00/0x40a459093b06c009 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f22666 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129583.480596:0:4385:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f384a00/0x40a459093b06ba44 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f222e6 expref: 10 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129583.480603:0:4385:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b4e0de00/0x40a459093b06bb7f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22387 expref: 29 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129583.480612:0:4385:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095f6ca00/0x40a459093b06bb55 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2235d expref: 38 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129583.480623:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129583.480625:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129583.480628:0:4385:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800915d4c00/0x40a459093b06c009 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [1048576->1437695] (req 1048576->1437695) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22666 expref: 29 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129583.480645:0:4385:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095f6ca00/0x40a459093b06bb55 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2235d expref: 38 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129583.480654:0:4385:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095f6ca00/0x40a459093b06bb55 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2235d expref: 38 pid: 8410 timeout: 938 lvb_type: 1 00000100:00100000:1.0:1746129583.480662:0:4385:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129bc0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:4385:1830948737649024:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129583.480692:0:4385:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b4e0de00/0x40a459093b06bb7f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22387 expref: 29 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129583.480698:0:4385:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b4e0de00/0x40a459093b06bb7f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22387 expref: 29 pid: 31503 timeout: 938 lvb_type: 0 00000100:00100000:1.0:1746129583.480704:0:4385:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129bc0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:4385:1830948737649152:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129583.480721:0:4385:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f384a00/0x40a459093b06ba44 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f222e6 expref: 10 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129583.480728:0:4385:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f384a00/0x40a459093b06ba44 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f222e6 expref: 10 pid: 7148 timeout: 938 lvb_type: 1 00000100:00100000:1.0:1746129583.480739:0:4385:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129bc3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:4385:1830948737649280:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129583.480753:0:4385:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a91c5540 going to sleep for 11 seconds 00000100:00100000:1.0:1746129583.487431:0:4385:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129bc0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:4385:1830948737649024:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129583.487487:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129583.487501:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129583.487520:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129583.487574:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129583.487599:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734487680 00000100:00100000:1.0:1746129583.487606:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734487680 00010000:00010000:1.0:1746129583.487644:0:7087:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab4c00/0x40a459093b06bfd8 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2264a expref: 15 pid: 14548 timeout: 938 lvb_type: 0 00000100:00100000:1.0:1746129583.487670:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734487808 00000100:00100000:1.0:1746129583.487672:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734487808 00010000:00010000:1.0:1746129583.487683:0:7087:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095f6ca00/0x40a459093b06bb55 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2235d expref: 39 pid: 8410 timeout: 938 lvb_type: 1 00000100:00100000:1.0:1746129583.487702:0:7086:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734488064 00000100:00100000:1.0:1746129583.487705:0:7086:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734488064 00010000:00010000:1.0:1746129583.487717:0:7086:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f384a00/0x40a459093b06ba44 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f222e6 expref: 11 pid: 7148 timeout: 938 lvb_type: 1 00000100:00100000:1.0:1746129583.487733:0:7086:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8797 00000100:00100000:1.0:1746129583.487741:0:7086:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129bc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:068dab75-d300-4ead-a742-d14572ad1e50+15:1963:x1830948734487680:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129583.487757:0:7086:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129583.487764:0:7086:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab4c00/0x40a459093b06bfd8 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2264a expref: 15 pid: 14548 timeout: 938 lvb_type: 0 00010000:00010000:1.0:1746129583.487776:0:7086:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab4c00/0x40a459093b06bfd8 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2264a expref: 15 pid: 14548 timeout: 938 lvb_type: 0 00010000:00010000:1.0:1746129583.487799:0:7086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009cffe100) 00010000:00010000:1.0:1746129583.487804:0:7086:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f5e4600/0x40a459093b06c002 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746129583.487814:0:7086:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f5e4600/0x40a459093b06c002 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50290000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746129583.487822:0:7086:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f5e4600/0x40a459093b06c002 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50290000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746129583.487840:0:7086:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129583.487862:0:4385:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129bc0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:4385:1830948737649152:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129583.487872:0:4385:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129bc3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:4385:1830948737649280:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129583.487875:0:7086:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129bc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:068dab75-d300-4ead-a742-d14572ad1e50+15:1963:x1830948734487680:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 135us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129583.487881:0:7086:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8797 00000100:00100000:1.0:1746129583.487895:0:7086:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8798 00010000:00010000:0.0:1746129583.487897:0:4385:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800915d4c00/0x40a459093b06c009 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [1048576->1437695] (req 1048576->1437695) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22666 expref: 29 pid: 4385 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129583.487899:0:7086:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129bc1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ada2ffba-8920-4ecb-8068-68caa9806978+39:1963:x1830948734487808:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129583.487906:0:7086:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129583.487912:0:4385:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800915d4c00, rc 0) 00010000:00010000:1.0:1746129583.487926:0:7086:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095f6ca00/0x40a459093b06bb55 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2235d expref: 39 pid: 8410 timeout: 938 lvb_type: 1 00000100:00100000:0.0:1746129583.487930:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800915d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+29:300:x1830948734487296:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 7375us (8641us total) trans 0 rc 0/0 00010000:00010000:1.0:1746129583.487933:0:7086:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095f6ca00/0x40a459093b06bb55 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2235d expref: 39 pid: 8410 timeout: 938 lvb_type: 1 00000100:00100000:0.0:1746129583.487936:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16974 00010000:00010000:1.0:1746129583.487947:0:7086:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095f6ca00/0x40a459093b06bb55 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2235d expref: 39 pid: 8410 timeout: 938 lvb_type: 1 00000100:00100000:0.0:1746129583.487950:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734487936 00000100:00100000:0.0:1746129583.487952:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734487936 00010000:00010000:1.0:1746129583.487962:0:7086:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129583.487971:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16975 00000100:00100000:1.0:1746129583.487972:0:7086:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129bc1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ada2ffba-8920-4ecb-8068-68caa9806978+38:1963:x1830948734487808:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 73us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129583.487975:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129bc2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+28:32765:x1830948734487936:12345-192.168.202.4@tcp:101:cat.0 00000100:00100000:1.0:1746129583.487977:0:7086:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8798 00000100:00100000:1.0:1746129583.487984:0:7086:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8799 00000100:00100000:1.0:1746129583.487987:0:7086:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129bc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:068dab75-d300-4ead-a742-d14572ad1e50+11:1963:x1830948734488064:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129583.487988:0:4385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129583.487992:0:7086:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129583.487997:0:7086:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f384a00/0x40a459093b06ba44 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f222e6 expref: 11 pid: 7148 timeout: 938 lvb_type: 1 00010000:00010000:0.0:1746129583.488000:0:4385:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095d82600/0x40a459093b06c010 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f22674 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129583.488004:0:7086:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f384a00/0x40a459093b06ba44 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f222e6 expref: 11 pid: 7148 timeout: 938 lvb_type: 1 00010000:00010000:1.0:1746129583.488013:0:7086:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f384a00/0x40a459093b06ba44 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f222e6 expref: 11 pid: 7148 timeout: 938 lvb_type: 1 00010000:00010000:0.0:1746129583.488015:0:4385:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fab5000/0x40a459093b06bfa7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3588095) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22627 expref: 32 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129583.488021:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129583.488022:0:7086:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746129583.488022:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129583.488025:0:4385:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095d82600/0x40a459093b06c010 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22674 expref: 29 pid: 4385 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129583.488032:0:7086:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129bc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:068dab75-d300-4ead-a742-d14572ad1e50+10:1963:x1830948734488064:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 44us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129583.488036:0:7086:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8799 00010000:00010000:0.0:1746129583.488049:0:4385:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fab5000/0x40a459093b06bfa7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3588095) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22627 expref: 32 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129583.488059:0:4385:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fab5000/0x40a459093b06bfa7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3588095) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22627 expref: 32 pid: 22480 timeout: 938 lvb_type: 0 00000100:00100000:0.0:1746129583.488071:0:4385:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fbadf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:4385:1830948737649408:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129583.488120:0:4385:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa3ef000 going to sleep for 11 seconds 00000100:00100000:2.0:1746129583.488197:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129583.488223:0:31503:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734488192 00000100:00100000:2.0:1746129583.488226:0:31503:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734488192 00000100:00100000:2.0:1746129583.488243:0:31503:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16976 00000100:00100000:2.0:1746129583.488248:0:31503:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009507fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ada2ffba-8920-4ecb-8068-68caa9806978+33:1961:x1830948734488192:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129583.488255:0:31503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129583.488262:0:31503:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fe02800/0x40a459093b06c017 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2267b expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129583.488291:0:31503:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009507dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:31503:1830948737649536:192.168.202.4@tcp:106: 00000100:00100000:2.0:1746129583.488344:0:31503:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132dad3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746129583.488364:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129583.488377:0:22480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734488448 00000100:00100000:2.0:1746129583.488380:0:22480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734488448 00000100:00100000:2.0:1746129583.488396:0:22480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16977 00000100:00100000:2.0:1746129583.488401:0:22480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009507c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ada2ffba-8920-4ecb-8068-68caa9806978+38:1961:x1830948734488448:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129583.488407:0:22480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129583.488414:0:22480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fe03400/0x40a459093b06c01e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f22689 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129583.488424:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129583.488425:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129583.488432:0:22480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fe03400/0x40a459093b06c01e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22689 expref: 39 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129583.488440:0:22480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fe03400/0x40a459093b06c01e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22689 expref: 39 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129583.488453:0:22480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe03400, rc 0) 00000100:00100000:2.0:1746129583.488467:0:22480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009507c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ada2ffba-8920-4ecb-8068-68caa9806978+39:1961:x1830948734488448:12345-192.168.202.4@tcp:101:cat.0 Request processed in 66us (103us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129583.488471:0:22480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16977 00000100:00100000:2.0:1746129583.488503:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129583.488512:0:22480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734488320 00000100:00100000:2.0:1746129583.488515:0:22480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734488320 00000100:00100000:2.0:1746129583.488528:0:22480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16978 00000100:00100000:2.0:1746129583.488532:0:22480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009507d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ada2ffba-8920-4ecb-8068-68caa9806978+39:1961:x1830948734488320:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129583.488537:0:22480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129583.488543:0:22480:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fe03600/0x40a459093b06c025 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f22682 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129583.488554:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129583.488559:0:22480:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fe03600/0x40a459093b06c025 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22682 expref: 40 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129583.488567:0:22480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fe03600/0x40a459093b06c025 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22682 expref: 40 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129583.488578:0:22480:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe03600, rc 0) 00000100:00100000:2.0:1746129583.488596:0:22480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009507d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ada2ffba-8920-4ecb-8068-68caa9806978+39:1961:x1830948734488320:12345-192.168.202.4@tcp:101:cat.0 Request processed in 63us (93us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129583.488601:0:22480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16978 00010000:00010000:3.0:1746129583.488688:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab4c00/0x40a459093b06bfd8 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2264a expref: 14 pid: 14548 timeout: 938 lvb_type: 0 00000100:00100000:3.0:1746129583.488709:0:14548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094066300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14548:1830948737648896:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129583.488724:0:14548:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008f5e4600/0x40a459093b06c002 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746129583.488731:0:14548:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008f5e4600/0x40a459093b06c002 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746129583.488736:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f5e4600/0x40a459093b06c002 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000004:00200000:3.0:1746129583.488756:0:14548:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:3.0:1746129583.488907:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f5e4400/0x40a459093b06bffb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2266d expref: 15 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129583.488917:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f5e4600/0x40a459093b06c002 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2266d expref: 14 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129583.488923:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009cffe100) 00010000:00010000:3.0:1746129583.488926:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746129583.488928:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f5e4600, rc 0) 00000100:00100000:3.0:1746129583.488948:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800915d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:068dab75-d300-4ead-a742-d14572ad1e50+14:301:x1830948734487552:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 9485us (9708us total) trans 8589945521 rc 0/0 00000100:00100000:3.0:1746129583.488954:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11388 00000100:00100000:0.0:1746129583.489838:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129583.491185:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734488576 00000100:00100000:3.0:1746129583.491196:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734488576 00010000:00010000:3.0:1746129583.491244:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b4e0de00/0x40a459093b06bb7f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22387 expref: 29 pid: 31503 timeout: 938 lvb_type: 0 00000100:00100000:3.0:1746129583.491279:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8800 00000100:00100000:3.0:1746129583.491286:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbaed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+29:1963:x1830948734488576:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129583.491316:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129583.491337:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b4e0de00/0x40a459093b06bb7f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22387 expref: 29 pid: 31503 timeout: 938 lvb_type: 0 00000100:00100000:2.0:1746129583.491342:0:31503:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009507dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:31503:1830948737649536:192.168.202.4@tcp:106: 00010000:00010000:3.0:1746129583.491347:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b4e0de00/0x40a459093b06bb7f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22387 expref: 29 pid: 31503 timeout: 938 lvb_type: 0 00010000:00010000:3.0:1746129583.491367:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b4e0de00/0x40a459093b06bb7f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22387 expref: 29 pid: 31503 timeout: 938 lvb_type: 0 00010000:00010000:2.0:1746129583.491370:0:31503:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fe02800/0x40a459093b06c017 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2267b expref: 34 pid: 31503 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129583.491380:0:31503:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fe02800/0x40a459093b06c017 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2267b expref: 34 pid: 31503 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129583.491382:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129583.491383:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129583.491388:0:31503:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe02800, rc 0) 00010000:00010000:3.0:1746129583.491390:0:7085:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800915d4c00/0x40a459093b06c009 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1437695) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22666 expref: 28 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129583.491399:0:7085:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800915d4c00/0x40a459093b06c009 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1437695) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22666 expref: 28 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129583.491425:0:7085:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800915d4c00/0x40a459093b06c009 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1437695) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22666 expref: 28 pid: 4385 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129583.491427:0:31503:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009507fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ada2ffba-8920-4ecb-8068-68caa9806978+33:1961:x1830948734488192:12345-192.168.202.4@tcp:101:cat.0 Request processed in 3178us (3230us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129583.491433:0:31503:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16976 00000100:00100000:3.0:1746129583.491436:0:7085:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094066300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7085:1830948737649664:192.168.202.4@tcp:105: 00000100:00100000:3.0:1746129583.491496:0:7085:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009518bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129583.492550:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129583.492590:0:4385:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fbadf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:4385:1830948737649408:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129583.492613:0:4385:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095d82600/0x40a459093b06c010 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22674 expref: 29 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129583.492627:0:4385:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095d82600, rc 0) 00000100:00100000:3.0:1746129583.492798:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734488704 00000100:00100000:3.0:1746129583.492805:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734488704 00002000:00100000:3.0:1746129583.492842:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->3588095) req@ffff88009fbaca80 x1830948734488704/t0(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:324/0 lens 488/0 e 0 to 0 dl 1746129594 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746129583.492844:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129bc2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+29:32765:x1830948734487936:12345-192.168.202.4@tcp:101:cat.0 Request processed in 4866us (5320us total) trans 0 rc 0/0 00002000:00100000:3.0:1746129583.492851:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbaca80 with x1830948734488704 ext(3145728->3588095) 00000100:00100000:2.0:1746129583.492851:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16975 00010000:00010000:3.0:1746129583.492858:0:25745:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fab5000/0x40a459093b06bfa7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3588095) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22627 expref: 33 pid: 22480 timeout: 938 lvb_type: 0 00010000:00010000:3.0:1746129583.492868:0:25745:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fab5000/0x40a459093b06bfa7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3588095) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22627 expref: 33 pid: 22480 timeout: 938 lvb_type: 0 00002000:00010000:3.0:1746129583.492874:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fbaca80 00000100:00100000:3.0:1746129583.492893:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2553 00000100:00100000:3.0:1746129583.492897:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+33:1961:x1830948734488704:12345-192.168.202.4@tcp:4:cat.0 00000100:00100000:0.0:1746129583.493837:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129583.494019:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129583.494401:0:31503:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734488832 00000100:00100000:2.0:1746129583.494406:0:31503:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734488832 00000100:00100000:2.0:1746129583.494433:0:31503:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734488960 00000100:00100000:2.0:1746129583.494435:0:31503:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734488960 00000100:00100000:2.0:1746129583.494450:0:31503:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16979 00000100:00100000:2.0:1746129583.494455:0:31503:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:068dab75-d300-4ead-a742-d14572ad1e50+9:1961:x1830948734488832:12345-192.168.202.4@tcp:101:lfs.0 00000100:00100000:1.0:1746129583.494463:0:8411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16980 00010000:00010000:2.0:1746129583.494466:0:31503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746129583.494471:0:8411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbaea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:068dab75-d300-4ead-a742-d14572ad1e50+10:1961:x1830948734488960:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:1.0:1746129583.494478:0:8411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129583.494480:0:31503:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fe03200/0x40a459093b06c033 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f22690 expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129583.494489:0:8411:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800915d5200/0x40a459093b06c03a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f22697 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129583.494521:0:31503:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009507dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:31503:1830948737649792:192.168.202.4@tcp:106: 00000100:00100000:1.0:1746129583.494521:0:8411:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129bc2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8411:1830948737649920:192.168.202.4@tcp:106: 00000100:00100000:2.0:1746129583.494579:0:31503:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132dad3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746129583.494585:0:8411:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a91c5a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746129583.494833:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129583.494901:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734489088 00000100:00100000:3.0:1746129583.494905:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734489088 00000100:00100000:3.0:1746129583.494938:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16981 00000100:00100000:3.0:1746129583.494942:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ada2ffba-8920-4ecb-8068-68caa9806978+35:32761:x1830948734489088:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129583.494950:0:4385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129583.494957:0:4385:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f5e5000/0x40a459093b06c041 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2269e expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129583.494974:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129583.494976:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129583.494980:0:4385:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f5e5000/0x40a459093b06c041 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [5144576->5242879] (req 5144576->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2269e expref: 36 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129583.494994:0:4385:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f5e5000/0x40a459093b06c041 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [5144576->5242879] (req 5144576->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2269e expref: 36 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129583.495003:0:4385:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f5e5000, rc 0) 00000100:00100000:3.0:1746129583.495028:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ada2ffba-8920-4ecb-8068-68caa9806978+36:32761:x1830948734489088:12345-192.168.202.4@tcp:101:cat.0 Request processed in 85us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129583.495034:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16981 00000100:00100000:2.0:1746129583.499260:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129583.499457:0:11014:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734489216 00000100:00100000:3.0:1746129583.499467:0:11014:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734489216 00000100:00100000:3.0:1746129583.499516:0:11014:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16982 00000100:00100000:3.0:1746129583.499524:0:11014:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009507ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:068dab75-d300-4ead-a742-d14572ad1e50+11:1960:x1830948734489216:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:3.0:1746129583.499546:0:11014:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129583.499566:0:11014:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f5e5200/0x40a459093b06c048 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f226a5 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129583.499625:0:11014:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094064700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11014:1830948737650048:192.168.202.4@tcp:106: 00000100:00100000:3.0:1746129583.499700:0:11014:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009518ba80 going to sleep for 11 seconds 00002000:00010000:1.0:1746129583.501705:0:8411:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb mtime: 1746129582 -> 1746129584 00002000:00010000:1.0:1746129583.501712:0:8411:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb atime: 1746129582 -> 1746129584 00002000:00010000:1.0:1746129583.501714:0:8411:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb ctime: 1746129582 -> 1746129584 00000100:00100000:1.0:1746129583.501739:0:8411:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129bc2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8411:1830948737649920:192.168.202.4@tcp:106: 00010000:00010000:1.0:1746129583.501772:0:8411:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800915d5200/0x40a459093b06c03a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22697 expref: 11 pid: 8411 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129583.501785:0:8411:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800915d5200/0x40a459093b06c03a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22697 expref: 11 pid: 8411 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129583.501800:0:8411:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800915d5200, rc 0) 00000100:00100000:1.0:1746129583.501838:0:8411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbaea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:068dab75-d300-4ead-a742-d14572ad1e50+10:1961:x1830948734488960:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 7368us (7819us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129583.501846:0:8411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16980 00000100:00100000:2.0:1746129583.502070:0:31503:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009507dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:31503:1830948737649792:192.168.202.4@tcp:106: 00010000:00010000:2.0:1746129583.502091:0:31503:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fe03200/0x40a459093b06c033 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22690 expref: 12 pid: 31503 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129583.502100:0:31503:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fe03200/0x40a459093b06c033 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22690 expref: 12 pid: 31503 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129583.502108:0:31503:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe03200, rc 0) 00000100:00100000:2.0:1746129583.502127:0:31503:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:068dab75-d300-4ead-a742-d14572ad1e50+11:1961:x1830948734488832:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 7672us (8292us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129583.502132:0:31503:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16979 00000100:00100000:3.0:1746129583.502243:0:7085:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094066300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7085:1830948737649664:192.168.202.4@tcp:105: 00010000:00010000:3.0:1746129583.502255:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129583.502275:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbaed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+28:1963:x1830948734488576:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 10990us (12440us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129583.502282:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8800 00000100:00100000:1.0:1746129583.503327:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129583.503640:0:8417:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734489472 00000100:00100000:3.0:1746129583.503647:0:8417:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734489472 00002000:00100000:3.0:1746129583.503685:0:8417:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3f3:0x0] (1433600->1437695) req@ffff880129bc2300 x1830948734489472/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:324/0 lens 488/0 e 0 to 0 dl 1746129594 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129583.503696:0:8417:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129bc2300 with x1830948734489472 ext(1433600->1437695) 00002000:00010000:3.0:1746129583.503700:0:8417:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880129bc2300 00000100:00100000:3.0:1746129583.503716:0:8417:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8257 00000100:00100000:3.0:1746129583.503721:0:8417:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129bc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+28:1962:x1830948734489472:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:3.0:1746129583.503879:0:8417:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129bc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+28:1962:x1830948734489472:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 158us (556us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129583.503884:0:8417:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8257 00002000:00100000:3.0:1746129583.503889:0:8417:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3f3:0x0] (1433600->1437695) req@ffff880129bc2300 x1830948734489472/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:324/0 lens 488/4536 e 0 to 0 dl 1746129594 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129583.503896:0:8417:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129bc2300 with x1830948734489472 ext(1433600->1437695) 00002000:00010000:3.0:1746129583.503898:0:8417:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880129bc2300 00010000:00010000:2.0:1746129583.506752:0:9822:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1746129583.507485:0:11014:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094064700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11014:1830948737650048:192.168.202.4@tcp:106: 00010000:00010000:2.0:1746129583.507519:0:11014:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f5e5200/0x40a459093b06c048 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f226a5 expref: 10 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129583.507533:0:11014:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f5e5200/0x40a459093b06c048 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f226a5 expref: 10 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129583.507543:0:11014:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f5e5200, rc 0) 00000100:00100000:2.0:1746129583.507600:0:11014:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009507ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:068dab75-d300-4ead-a742-d14572ad1e50+9:1960:x1830948734489216:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 8076us (8350us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129583.507609:0:11014:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16982 00000100:00100000:0.0:1746129583.509047:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129583.509315:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129583.509562:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734489728 00000100:00100000:2.0:1746129583.509570:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734489728 00000100:00100000:2.0:1746129583.509612:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4864 00000100:00100000:2.0:1746129583.509618:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+23:300:x1830948734489728:12345-192.168.202.4@tcp:35:multiop.0 00000100:00100000:2.0:1746129583.509810:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+24:300:x1830948734489728:12345-192.168.202.4@tcp:35:multiop.0 Request processed in 192us (770us total) trans 8589945522 rc 0/0 00000100:00100000:2.0:1746129583.509816:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4864 00000100:00100000:3.0:1746129583.509991:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734489984 00000100:00100000:3.0:1746129583.509995:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734489984 00000100:00100000:3.0:1746129583.510400:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11389 00000100:00100000:3.0:1746129583.510635:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:068dab75-d300-4ead-a742-d14572ad1e50+14:301:x1830948734489984:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:3.0:1746129583.510650:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129583.510653:0:14548:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746129583.510677:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f5e4600/0x40a459093b06c002 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2266d expref: 14 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129583.510696:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009cffe100) 00010000:00010000:3.0:1746129583.510701:0:14548:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746129583.510711:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f5e4e00/0x40a459093b06c04f lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f226ac expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129583.510783:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f5e5400/0x40a459093b06c056 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746129583.510795:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f5e5400/0x40a459093b06c056 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746129583.510802:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f5e5400/0x40a459093b06c056 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000004:00200000:3.0:1746129583.510811:0:14548:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:3.0:1746129583.510877:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f5e4e00/0x40a459093b06c04f lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x1/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f226ac expref: 16 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129583.510887:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f5e5400/0x40a459093b06c056 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f226ac expref: 15 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129583.510893:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009cffe100) 00010000:00010000:3.0:1746129583.510895:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746129583.510897:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f5e5400, rc 0) 00000100:00100000:3.0:1746129583.510923:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:068dab75-d300-4ead-a742-d14572ad1e50+15:301:x1830948734489984:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 517us (1609us total) trans 8589945523 rc 0/0 00000100:00100000:3.0:1746129583.510928:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11389 00000100:00100000:3.0:1746129583.511032:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+36:1961:x1830948734488704:12345-192.168.202.4@tcp:4:cat.0 Request processed in 18134us (18486us total) trans 21474841466 rc 0/0 00000100:00100000:3.0:1746129583.511039:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2553 00002000:00100000:3.0:1746129583.511047:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->3588095) req@ffff88009fbaca80 x1830948734488704/t21474841466(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:324/0 lens 488/448 e 0 to 0 dl 1746129594 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129583.511062:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbaca80 with x1830948734488704 ext(3145728->3588095) 00010000:00010000:3.0:1746129583.511069:0:25745:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fab5000/0x40a459093b06bfa7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3588095) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22627 expref: 36 pid: 22480 timeout: 938 lvb_type: 0 00010000:00010000:3.0:1746129583.511080:0:25745:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fab5000/0x40a459093b06bfa7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3588095) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22627 expref: 36 pid: 22480 timeout: 938 lvb_type: 0 00002000:00010000:3.0:1746129583.511086:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fbaca80 00000100:00100000:0.0:1746129583.516552:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129583.518194:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129583.518247:0:11014:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734490240 00000100:00100000:2.0:1746129583.518258:0:11014:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734490240 00000100:00100000:2.0:1746129583.518330:0:11014:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16983 00000100:00100000:2.0:1746129583.518339:0:11014:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:068dab75-d300-4ead-a742-d14572ad1e50+10:1963:x1830948734490240:12345-192.168.202.4@tcp:1:lfs.0 00010000:00010000:2.0:1746129583.518388:0:11014:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009fe03a00/0x40a459093b06c064 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129583.518407:0:11014:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800915d4c00/0x40a459093b06c009 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1437695) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22666 expref: 27 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129583.518414:0:11014:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129583.518416:0:11014:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129583.518419:0:11014:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fe03a00/0x40a459093b06c064 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129583.518453:0:11014:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800915d4c00/0x40a459093b06c009 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1437695) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22666 expref: 27 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129583.518470:0:11014:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800915d4c00/0x40a459093b06c009 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1437695) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22666 expref: 27 pid: 4385 timeout: 938 lvb_type: 0 00000100:00100000:2.0:1746129583.518485:0:11014:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009507dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11014:1830948737650176:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129583.518567:0:11014:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132dad3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746129583.518846:0:31503:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734490496 00000100:00100000:3.0:1746129583.518850:0:31503:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734490496 00000100:00100000:3.0:1746129583.518871:0:31503:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16984 00000100:00100000:3.0:1746129583.518876:0:31503:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:068dab75-d300-4ead-a742-d14572ad1e50+9:1963:x1830948734490496:12345-192.168.202.4@tcp:1:lfs.0 00010000:00010000:3.0:1746129583.518898:0:31503:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008f5e4600/0x40a459093b06c06b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129583.518909:0:31503:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012e0c4e00/0x40a459093b06be3b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22532 expref: 28 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129583.518921:0:31503:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fab5a00/0x40a459093b06be81 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22563 expref: 9 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129583.518928:0:31503:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093c0c200/0x40a459093b06be73 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2255c expref: 35 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129583.518933:0:31503:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129583.518934:0:31503:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129583.518937:0:31503:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f5e4600/0x40a459093b06c06b lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129583.518988:0:31503:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093c0c200/0x40a459093b06be73 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2255c expref: 35 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129583.518996:0:31503:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093c0c200/0x40a459093b06be73 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2255c expref: 35 pid: 4385 timeout: 938 lvb_type: 0 00000100:00100000:3.0:1746129583.519005:0:31503:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094066300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:31503:1830948737650304:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129583.519054:0:31503:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fab5a00/0x40a459093b06be81 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22563 expref: 9 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129583.519061:0:31503:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fab5a00/0x40a459093b06be81 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22563 expref: 9 pid: 22480 timeout: 938 lvb_type: 1 00000100:00100000:3.0:1746129583.519068:0:31503:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094065180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:31503:1830948737650432:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129583.519085:0:31503:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012e0c4e00/0x40a459093b06be3b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22532 expref: 28 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129583.519091:0:31503:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012e0c4e00/0x40a459093b06be3b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22532 expref: 28 pid: 31503 timeout: 938 lvb_type: 0 00000100:00100000:3.0:1746129583.519098:0:31503:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094067480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:31503:1830948737650560:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129583.519110:0:31503:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009518b780 going to sleep for 11 seconds 00000100:00100000:0.0:1746129583.519197:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129583.519219:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129583.519233:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129583.519245:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129583.519281:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129583.519324:0:8410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734490752 00000100:00100000:0.0:1746129583.519327:0:8410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734490752 00000100:00100000:0.0:1746129583.519343:0:8410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734490112 00000100:00100000:0.0:1746129583.519345:0:8410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734490112 00000100:00100000:0.0:1746129583.519354:0:8410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734490368 00000100:00100000:0.0:1746129583.519356:0:8410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734490368 00000100:00100000:0.0:1746129583.519363:0:8410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734490624 00000100:00100000:0.0:1746129583.519364:0:8410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734490624 00000100:00100000:0.0:1746129583.519374:0:8410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16985 00000100:00100000:0.0:1746129583.519379:0:8410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:068dab75-d300-4ead-a742-d14572ad1e50+12:1963:x1830948734490752:12345-192.168.202.4@tcp:1:lfs.0 00010000:00010000:0.0:1746129583.519395:0:8410:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880095d83200/0x40a459093b06c072 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129583.519405:0:8410:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fab4000/0x40a459093b06bfae lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2262e expref: 27 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129583.519411:0:8410:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fe03400/0x40a459093b06c01e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22689 expref: 38 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129583.519421:0:8410:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095d82c00/0x40a459093b06bff4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2265f expref: 12 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129583.519426:0:8410:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129583.519428:0:8410:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129583.519430:0:8410:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095d83200/0x40a459093b06c072 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129583.519445:0:8410:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095d82c00/0x40a459093b06bff4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2265f expref: 12 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129583.519453:0:8410:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095d82c00/0x40a459093b06bff4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2265f expref: 12 pid: 11014 timeout: 938 lvb_type: 1 00000100:00100000:0.0:1746129583.519462:0:8410:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095625f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8410:1830948737650688:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129583.519502:0:8410:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fe03400/0x40a459093b06c01e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22689 expref: 38 pid: 22480 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129583.519510:0:8410:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fe03400/0x40a459093b06c01e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22689 expref: 38 pid: 22480 timeout: 938 lvb_type: 1 00000100:00100000:2.0:1746129583.519518:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16986 00000100:00100000:0.0:1746129583.519518:0:8410:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095624000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8410:1830948737650816:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129583.519525:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:068dab75-d300-4ead-a742-d14572ad1e50+11:1963:x1830948734490112:12345-192.168.202.4@tcp:1:lfs.0 00010000:00010000:0.0:1746129583.519540:0:8410:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fab4000/0x40a459093b06bfae lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2262e expref: 27 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129583.519543:0:7149:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009fe02e00/0x40a459093b06c079 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129583.519553:0:8410:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fab4000/0x40a459093b06bfae lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2262e expref: 27 pid: 22480 timeout: 938 lvb_type: 0 00010000:00010000:2.0:1746129583.519555:0:7149:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008fa79e00/0x40a459093b06bfdf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 581632->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22643 expref: 28 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129583.519561:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00000100:00100000:0.0:1746129583.519561:0:8410:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095625880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8410:1830948737650944:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129583.519563:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129583.519565:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fe02e00/0x40a459093b06c079 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129583.519577:0:8410:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa3ef240 going to sleep for 11 seconds 00010000:00010000:2.0:1746129583.519580:0:7149:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008fa79e00/0x40a459093b06bfdf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 581632->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22643 expref: 28 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129583.519588:0:7149:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008fa79e00/0x40a459093b06bfdf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 581632->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22643 expref: 28 pid: 31503 timeout: 938 lvb_type: 0 00000100:00100000:0.0:1746129583.519592:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734490880 00000100:00100000:0.0:1746129583.519594:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734490880 00000100:00100000:2.0:1746129583.519596:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009507f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7149:1830948737651072:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129583.519614:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fab5000/0x40a459093b06bfa7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3588095) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22627 expref: 36 pid: 22480 timeout: 938 lvb_type: 0 00000100:00100000:2.0:1746129583.519618:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132dad840 going to sleep for 11 seconds 00000100:00100000:0.0:1746129583.519632:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8801 00000100:00100000:2.0:1746129583.519635:0:22480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16987 00000100:00100000:0.0:1746129583.519636:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a45c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ada2ffba-8920-4ecb-8068-68caa9806978+36:1961:x1830948734490880:12345-192.168.202.4@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746129583.519640:0:22480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095627800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:068dab75-d300-4ead-a742-d14572ad1e50+12:1963:x1830948734490368:12345-192.168.202.4@tcp:1:lfs.0 00010000:00010000:0.0:1746129583.519644:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129583.519655:0:22480:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009fe03600/0x40a459093b06c080 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129583.519665:0:22480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e0c5200/0x40a459093b06bdf5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2250f expref: 27 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129583.519668:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fab5000/0x40a459093b06bfa7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3588095) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22627 expref: 36 pid: 22480 timeout: 938 lvb_type: 0 00010000:00010000:2.0:1746129583.519671:0:22480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094956c00/0x40a459093b06be42 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22539 expref: 12 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129583.519677:0:22480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e0c4000/0x40a459093b06be18 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22524 expref: 38 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129583.519679:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fab5000/0x40a459093b06bfa7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3588095) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22627 expref: 36 pid: 22480 timeout: 938 lvb_type: 0 00010000:00010000:2.0:1746129583.519682:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129583.519683:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129583.519685:0:22480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fe03600/0x40a459093b06c080 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129583.519697:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fab5000/0x40a459093b06bfa7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3588095) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22627 expref: 36 pid: 22480 timeout: 938 lvb_type: 0 00010000:00010000:2.0:1746129583.519698:0:22480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012e0c4000/0x40a459093b06be18 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22524 expref: 38 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129583.519704:0:22480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012e0c4000/0x40a459093b06be18 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22524 expref: 38 pid: 31503 timeout: 938 lvb_type: 0 00000100:00100000:2.0:1746129583.519711:0:22480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009507ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22480:1830948737651200:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129583.519714:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129583.519715:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129583.519721:0:7085:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880095d82600/0x40a459093b06c010 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22674 expref: 28 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129583.519728:0:7085:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095d82600/0x40a459093b06c010 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22674 expref: 28 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129583.519735:0:22480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094956c00/0x40a459093b06be42 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22539 expref: 12 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129583.519735:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129583.519736:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129583.519739:0:7085:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f5e5000/0x40a459093b06c041 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5144576->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2269e expref: 35 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129583.519741:0:22480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094956c00/0x40a459093b06be42 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22539 expref: 12 pid: 11014 timeout: 938 lvb_type: 1 00010000:00010000:0.0:1746129583.519744:0:7085:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f5e5000/0x40a459093b06c041 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5144576->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2269e expref: 35 pid: 4385 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129583.519747:0:22480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e957b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22480:1830948737651328:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129583.519762:0:22480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012e0c5200/0x40a459093b06bdf5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2250f expref: 27 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129583.519762:0:7085:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008f5e5000/0x40a459093b06c041 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5144576->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2269e expref: 35 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129583.519768:0:22480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012e0c5200/0x40a459093b06bdf5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2250f expref: 27 pid: 31503 timeout: 938 lvb_type: 0 00000100:00100000:0.0:1746129583.519771:0:7085:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095625500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7085:1830948737651456:192.168.202.4@tcp:105: 00000100:00100000:2.0:1746129583.519775:0:22480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e955180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22480:1830948737651584:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129583.519789:0:22480:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132dadd80 going to sleep for 11 seconds 00010000:00010000:0.0:1746129583.519794:0:7085:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880095d82600/0x40a459093b06c010 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22674 expref: 28 pid: 4385 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129583.519801:0:7085:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095626a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7085:1830948737651712:192.168.202.4@tcp:105: 00000100:00100000:0.0:1746129583.519815:0:7085:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa3ef000 going to sleep for 11 seconds 00000100:00100000:3.0:1746129583.520233:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16988 00000100:00100000:3.0:1746129583.520241:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095625c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:068dab75-d300-4ead-a742-d14572ad1e50+11:1963:x1830948734490624:12345-192.168.202.4@tcp:1:lfs.0 00010000:00010000:3.0:1746129583.520260:0:7148:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009fab4c00/0x40a459093b06c087 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129583.520269:0:7148:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095d82600/0x40a459093b06c010 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22674 expref: 28 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129583.520275:0:7148:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f5e5000/0x40a459093b06c041 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 5144576->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2269e expref: 35 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129583.520279:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129583.520280:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129583.520282:0:7148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fab4c00/0x40a459093b06c087 lrc: 5/0,1 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129583.520336:0:7148:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f5e5000/0x40a459093b06c041 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 5144576->5242879) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2269e expref: 35 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129583.520344:0:7148:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f5e5000/0x40a459093b06c041 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 5144576->5242879) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2269e expref: 35 pid: 4385 timeout: 938 lvb_type: 0 00000100:00100000:3.0:1746129583.520353:0:7148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094066680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7148:1830948737651840:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129583.520389:0:7148:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095d82600/0x40a459093b06c010 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22674 expref: 28 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129583.520396:0:7148:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095d82600/0x40a459093b06c010 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22674 expref: 28 pid: 4385 timeout: 938 lvb_type: 0 00000100:00100000:3.0:1746129583.520407:0:7148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094065c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7148:1830948737651968:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129583.520419:0:7148:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009518be40 going to sleep for 11 seconds 00000100:00100000:2.0:1746129583.521331:0:11014:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009507dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11014:1830948737650176:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129583.521362:0:11014:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009fe03a00/0x40a459093b06c064 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129583.525800:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129583.525836:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129583.525837:0:8410:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095625f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8410:1830948737650688:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129583.525860:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734491264 00000100:00100000:3.0:1746129583.525914:0:31503:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094066300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:31503:1830948737650304:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129583.525924:0:31503:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094065180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:31503:1830948737650432:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129583.525932:0:31503:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094067480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:31503:1830948737650560:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129583.525964:0:31503:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88008f5e4600/0x40a459093b06c06b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129583.526037:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734491008 00000100:00100000:2.0:1746129583.526044:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734491008 00002000:00100000:2.0:1746129583.526090:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->1437695) req@ffff880095624e00 x1830948734491008/t0(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:324/0 lens 488/0 e 0 to 0 dl 1746129594 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129583.526098:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095624e00 with x1830948734491008 ext(1048576->1437695) 00010000:00010000:2.0:1746129583.526106:0:25745:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800915d4c00/0x40a459093b06c009 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1437695) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22666 expref: 28 pid: 4385 timeout: 938 lvb_type: 0 00010000:00010000:2.0:1746129583.526118:0:25745:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800915d4c00/0x40a459093b06c009 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1437695) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22666 expref: 28 pid: 4385 timeout: 938 lvb_type: 0 00002000:00010000:2.0:1746129583.526124:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880095624e00 00000100:00100000:2.0:1746129583.526155:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2554 00000100:00100000:2.0:1746129583.526163:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095624e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+28:1963:x1830948734491008:12345-192.168.202.4@tcp:4:multiop.0 00000100:00100000:0.0:1746129583.526359:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734491264 00010000:00010000:0.0:1746129583.526378:0:9823:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fab5a00/0x40a459093b06be81 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22563 expref: 12 pid: 22480 timeout: 938 lvb_type: 1 00000100:00100000:0.0:1746129583.526402:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8802 00000100:00100000:0.0:1746129583.526407:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095626300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:068dab75-d300-4ead-a742-d14572ad1e50+12:1963:x1830948734491264:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129583.526415:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129583.526435:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fab5a00/0x40a459093b06be81 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22563 expref: 12 pid: 22480 timeout: 938 lvb_type: 1 00010000:00010000:0.0:1746129583.526444:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fab5a00/0x40a459093b06be81 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22563 expref: 12 pid: 22480 timeout: 938 lvb_type: 1 00010000:00010000:0.0:1746129583.526464:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fab5a00/0x40a459093b06be81 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22563 expref: 12 pid: 22480 timeout: 938 lvb_type: 1 00010000:00010000:0.0:1746129583.526479:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129583.526705:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095626300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:068dab75-d300-4ead-a742-d14572ad1e50+11:1963:x1830948734491264:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 295us (865us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129583.526711:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8802 00000100:00100000:0.0:1746129583.526758:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129583.527895:0:7085:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095626a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7085:1830948737651712:192.168.202.4@tcp:105: 00000100:00100000:1.0:1746129583.527998:0:8410:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095624000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8410:1830948737650816:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129583.528008:0:8410:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095625880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8410:1830948737650944:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129583.528035:0:8410:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880095d83200/0x40a459093b06c072 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129583.528136:0:7148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094066680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7148:1830948737651840:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129583.528839:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734491136 00000100:00100000:2.0:1746129583.528847:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734491136 00010000:00010000:2.0:1746129583.528878:0:9823:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012e0c4e00/0x40a459093b06be3b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22532 expref: 29 pid: 31503 timeout: 938 lvb_type: 0 00000100:00100000:2.0:1746129583.528904:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8803 00000100:00100000:2.0:1746129583.528912:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa25880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+29:1961:x1830948734491136:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129583.528925:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129583.528947:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012e0c4e00/0x40a459093b06be3b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22532 expref: 29 pid: 31503 timeout: 938 lvb_type: 0 00010000:00010000:2.0:1746129583.528957:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012e0c4e00/0x40a459093b06be3b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22532 expref: 29 pid: 31503 timeout: 938 lvb_type: 0 00010000:00010000:2.0:1746129583.528980:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e0c4e00/0x40a459093b06be3b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22532 expref: 29 pid: 31503 timeout: 938 lvb_type: 0 00010000:00010000:2.0:1746129583.528997:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129583.529050:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa25880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+28:1961:x1830948734491136:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 138us (2291us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129583.529056:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8803 00000100:00100000:3.0:1746129583.529475:0:7148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094065c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7148:1830948737651968:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129583.529496:0:7148:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009fab4c00/0x40a459093b06c087 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129583.529744:0:7085:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095625500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7085:1830948737651456:192.168.202.4@tcp:105: 00010000:00010000:1.0:1746129583.529758:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129583.529787:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a45c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ada2ffba-8920-4ecb-8068-68caa9806978+35:1961:x1830948734490880:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 10149us (10504us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129583.529794:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8801 00000100:00100000:2.0:1746129583.530025:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009507f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7149:1830948737651072:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129583.530039:0:7149:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009fe02e00/0x40a459093b06c079 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129583.530068:0:22480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009507ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22480:1830948737651200:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129583.530078:0:22480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e957b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22480:1830948737651328:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129583.530085:0:22480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e955180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22480:1830948737651584:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129583.530099:0:22480:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009fe03600/0x40a459093b06c080 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129583.530231:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129583.530274:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129583.530488:0:15749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734492032 00000100:00100000:3.0:1746129583.530493:0:15749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734492032 00000100:00100000:2.0:1746129583.530505:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129583.530519:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00010000:00010000:3.0:1746129583.530521:0:15749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094956c00/0x40a459093b06be42 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22539 expref: 13 pid: 11014 timeout: 938 lvb_type: 1 00000100:00100000:2.0:1746129583.530532:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129583.530543:0:15749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734491392 00000100:00100000:3.0:1746129583.530545:0:15749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734491392 00000100:00100000:2.0:1746129583.530551:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8804 00010000:00010000:3.0:1746129583.530554:0:15749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095d82c00/0x40a459093b06bff4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2265f expref: 14 pid: 11014 timeout: 938 lvb_type: 1 00000100:00100000:2.0:1746129583.530556:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e955180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:068dab75-d300-4ead-a742-d14572ad1e50+14:1963:x1830948734492032:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129583.530566:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746129583.530571:0:15749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8805 00000100:00100000:3.0:1746129583.530576:0:15749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e957b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:068dab75-d300-4ead-a742-d14572ad1e50+14:1962:x1830948734491392:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129583.530583:0:15749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129583.530584:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094956c00/0x40a459093b06be42 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22539 expref: 14 pid: 11014 timeout: 938 lvb_type: 1 00010000:00010000:3.0:1746129583.530593:0:15749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095d82c00/0x40a459093b06bff4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2265f expref: 14 pid: 11014 timeout: 938 lvb_type: 1 00010000:00010000:2.0:1746129583.530596:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094956c00/0x40a459093b06be42 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22539 expref: 14 pid: 11014 timeout: 938 lvb_type: 1 00010000:00010000:3.0:1746129583.530600:0:15749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095d82c00/0x40a459093b06bff4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2265f expref: 14 pid: 11014 timeout: 938 lvb_type: 1 00010000:00010000:3.0:1746129583.530613:0:15749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095d82c00/0x40a459093b06bff4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2265f expref: 14 pid: 11014 timeout: 938 lvb_type: 1 00010000:00010000:2.0:1746129583.530613:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094956c00/0x40a459093b06be42 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22539 expref: 14 pid: 11014 timeout: 938 lvb_type: 1 00000100:00100000:1.0:1746129583.530620:0:8411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734492160 00010000:00010000:2.0:1746129583.530624:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129583.530625:0:8411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734492160 00010000:00010000:3.0:1746129583.530626:0:15749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129583.530640:0:15749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e957b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:068dab75-d300-4ead-a742-d14572ad1e50+12:1962:x1830948734491392:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 64us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129583.530640:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e955180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:068dab75-d300-4ead-a742-d14572ad1e50+12:1963:x1830948734492032:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 84us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129583.530645:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8804 00000100:00100000:1.0:1746129583.530646:0:8411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734492416 00000100:00100000:3.0:1746129583.530648:0:15749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8805 00000100:00100000:1.0:1746129583.530648:0:8411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734492416 00000100:00100000:1.0:1746129583.530662:0:8411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734492672 00000100:00100000:1.0:1746129583.530663:0:8411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734492672 00000100:00100000:3.0:1746129583.530668:0:4699:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16989 00000100:00100000:2.0:1746129583.530668:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129583.530673:0:4699:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e954e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ada2ffba-8920-4ecb-8068-68caa9806978+35:1962:x1830948734492160:12345-192.168.202.4@tcp:101:cat.0 00000100:00100000:2.0:1746129583.530681:0:22481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734492288 00000100:00100000:2.0:1746129583.530684:0:22481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734492288 00000100:00100000:0.0:1746129583.531234:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00010000:00010000:3.0:1746129583.531244:0:4699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746129583.531248:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00010000:00010000:3.0:1746129583.531258:0:4699:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fab4e00/0x40a459093b06c08e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f226b3 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129583.531263:0:15749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734491648 00000100:00100000:0.0:1746129583.531266:0:15749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734491648 00010000:00010000:0.0:1746129583.531281:0:15749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093c0c200/0x40a459093b06be73 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2255c expref: 37 pid: 4385 timeout: 938 lvb_type: 0 00000100:00100000:0.0:1746129583.531323:0:15749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8806 00000100:00100000:3.0:1746129583.531325:0:4699:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094065c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4699:1830948737652096:192.168.202.4@tcp:106: 00000100:00100000:0.0:1746129583.531328:0:15749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa24e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ada2ffba-8920-4ecb-8068-68caa9806978+37:1961:x1830948734491648:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129583.531335:0:15749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129583.531350:0:15749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093c0c200/0x40a459093b06be73 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2255c expref: 37 pid: 4385 timeout: 938 lvb_type: 0 00010000:00010000:0.0:1746129583.531358:0:15749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093c0c200/0x40a459093b06be73 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2255c expref: 37 pid: 4385 timeout: 938 lvb_type: 0 00010000:00010000:0.0:1746129583.531369:0:15749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093c0c200/0x40a459093b06be73 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2255c expref: 37 pid: 4385 timeout: 938 lvb_type: 0 00000100:00100000:3.0:1746129583.531373:0:4699:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009518be40 going to sleep for 11 seconds 00010000:00010000:0.0:1746129583.531378:0:15749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129583.531380:0:15749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129583.531384:0:15749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f5e4600/0x40a459093b06c06b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129583.531388:0:20577:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734492544 00000100:00100000:3.0:1746129583.531391:0:20577:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734492544 00010000:00010000:0.0:1746129583.531391:0:15749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f5e4600/0x40a459093b06c06b lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129583.533021:0:8411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16990 00000100:00100000:1.0:1746129583.533158:0:8411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e957800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ada2ffba-8920-4ecb-8068-68caa9806978+41:1962:x1830948734492416:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129583.533180:0:8411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129583.533198:0:8411:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800915d5000/0x40a459093b06c095 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f226c1 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129583.533233:0:8411:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129583.533242:0:8411:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800915d5000/0x40a459093b06c095 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f226c1 expref: 42 pid: 8411 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129583.533251:0:8411:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800915d5000/0x40a459093b06c095 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f226c1 expref: 42 pid: 8411 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129583.533281:0:8411:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800915d5000, rc 0) 00000100:00100000:1.0:1746129583.533340:0:8411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e957800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ada2ffba-8920-4ecb-8068-68caa9806978+41:1962:x1830948734492416:12345-192.168.202.4@tcp:101:cat.0 Request processed in 192us (2819us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129583.533347:0:8411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16990 00000100:00100000:1.0:1746129583.533366:0:8411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16991 00000100:00100000:1.0:1746129583.533372:0:8411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e956680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ada2ffba-8920-4ecb-8068-68caa9806978+40:1962:x1830948734492672:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129583.533378:0:8411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129583.533384:0:8411:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800915d5800/0x40a459093b06c09c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f226cf expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129583.533394:0:8411:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129583.533400:0:8411:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800915d5800/0x40a459093b06c09c lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f226cf expref: 41 pid: 8411 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129583.533406:0:8411:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800915d5800/0x40a459093b06c09c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f226cf expref: 41 pid: 8411 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129583.533414:0:8411:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800915d5800, rc 0) 00000100:00100000:1.0:1746129583.533427:0:8411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e956680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ada2ffba-8920-4ecb-8068-68caa9806978+40:1962:x1830948734492672:12345-192.168.202.4@tcp:101:cat.0 Request processed in 56us (2894us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129583.533432:0:8411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16991 00000100:00100000:1.0:1746129583.533545:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129583.533569:0:31518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734491904 00000100:00100000:1.0:1746129583.533576:0:31518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734491904 00002000:00100000:1.0:1746129583.533606:0:31518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3ec:0x0] (581632->1048575) req@ffff880129bc3800 x1830948734491904/t0(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:324/0 lens 488/0 e 0 to 0 dl 1746129594 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129583.533616:0:31518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129bc3800 with x1830948734491904 ext(581632->1048575) 00010000:00010000:1.0:1746129583.533625:0:31518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008fa79e00/0x40a459093b06bfdf lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 581632->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22643 expref: 28 pid: 31503 timeout: 938 lvb_type: 0 00010000:00010000:1.0:1746129583.533637:0:31518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008fa79e00/0x40a459093b06bfdf lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 581632->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22643 expref: 28 pid: 31503 timeout: 938 lvb_type: 0 00002000:00010000:1.0:1746129583.533643:0:31518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880129bc3800 00000100:00100000:3.0:1746129583.533652:0:20577:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16992 00000100:00100000:3.0:1746129583.533661:0:20577:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e956300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ada2ffba-8920-4ecb-8068-68caa9806978+39:1963:x1830948734492288:12345-192.168.202.4@tcp:101:cat.0 00000100:00100000:1.0:1746129583.533661:0:31518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2555 00000100:00100000:1.0:1746129583.533666:0:31518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129bc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+28:1961:x1830948734491904:12345-192.168.202.4@tcp:4:multiop.0 00000100:00100000:2.0:1746129583.533800:0:22481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16993 00000100:00100000:2.0:1746129583.533809:0:22481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ada2ffba-8920-4ecb-8068-68caa9806978+37:1963:x1830948734492544:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129583.533818:0:22481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129583.533827:0:22481:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fe02c00/0x40a459093b06c0a3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f226c8 expref: -99 pid: 22481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129583.533874:0:22481:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fe02c00/0x40a459093b06c0a3 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f226c8 expref: 38 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129583.533882:0:22481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fe02c00/0x40a459093b06c0a3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f226c8 expref: 38 pid: 22481 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129583.533890:0:22481:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe02c00, rc 0) 00000100:00100000:2.0:1746129583.533910:0:22481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ada2ffba-8920-4ecb-8068-68caa9806978+37:1963:x1830948734492544:12345-192.168.202.4@tcp:101:cat.0 Request processed in 103us (2676us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129583.533918:0:22481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16993 00010000:00010000:3.0:1746129583.534146:0:20577:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129583.534154:0:20577:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fab5c00/0x40a459093b06c0aa lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f226ba expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129583.534186:0:20577:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094066680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20577:1830948737652224:192.168.202.4@tcp:106: 00000100:00100000:3.0:1746129583.534241:0:20577:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009518b780 going to sleep for 11 seconds 00000100:00100000:2.0:1746129583.535443:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129583.535459:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734491520 00000100:00100000:2.0:1746129583.535465:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734491520 00010000:00010000:2.0:1746129583.535486:0:9823:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fe03400/0x40a459093b06c01e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22689 expref: 41 pid: 22480 timeout: 938 lvb_type: 1 00000100:00100000:2.0:1746129583.535505:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8807 00000100:00100000:2.0:1746129583.535509:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e955c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ada2ffba-8920-4ecb-8068-68caa9806978+41:1961:x1830948734491520:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129583.535519:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129583.535536:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fe03400/0x40a459093b06c01e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22689 expref: 41 pid: 22480 timeout: 938 lvb_type: 1 00010000:00010000:2.0:1746129583.535546:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fe03400/0x40a459093b06c01e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22689 expref: 41 pid: 22480 timeout: 938 lvb_type: 1 00010000:00010000:0.0:1746129583.535548:0:15749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746129583.535563:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fe03400/0x40a459093b06c01e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22689 expref: 41 pid: 22480 timeout: 938 lvb_type: 1 00010000:00010000:2.0:1746129583.535572:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129583.535577:0:15749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa24e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ada2ffba-8920-4ecb-8068-68caa9806978+36:1961:x1830948734491648:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 4247us (4326us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129583.535584:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e955c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ada2ffba-8920-4ecb-8068-68caa9806978+40:1961:x1830948734491520:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 74us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129583.535585:0:15749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8806 00000100:00100000:2.0:1746129583.535590:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8807 00010000:00010000:3.0:1746129583.535651:0:31503:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88008f5e4600/0x40a459093b06c06b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129583.535659:0:31503:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f5e4600/0x40a459093b06c06b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129583.535680:0:31503:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008f5e4600/0x40a459093b06c06b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129583.535686:0:31503:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008f5e4600/0x40a459093b06c06b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129583.535693:0:31503:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008f5e4600/0x40a459093b06c06b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129583.535698:0:31503:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f5e4600 already unused, calling callback (ffffffffa086ed70) 00010000:00010000:3.0:1746129583.535701:0:31503:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008f5e4600/0x40a459093b06c06b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129583.535709:0:31503:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008f5e4600/0x40a459093b06c06b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129583.535719:0:31503:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008f5e4600/0x40a459093b06c06b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129583.535724:0:31503:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f5e4600/0x40a459093b06c06b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129583.535762:0:31503:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:068dab75-d300-4ead-a742-d14572ad1e50+10:1963:x1830948734490496:12345-192.168.202.4@tcp:1:lfs.0 Request processed in 16886us (17574us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129583.535769:0:31503:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16984 00000100:00100000:0.0:1746129583.537972:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129583.537979:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095624e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+30:1963:x1830948734491008:12345-192.168.202.4@tcp:4:multiop.0 Request processed in 11815us (12189us total) trans 17179874217 rc 0/0 00000100:00100000:3.0:1746129583.537992:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2554 00002000:00100000:3.0:1746129583.538005:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->1437695) req@ffff880095624e00 x1830948734491008/t17179874217(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:324/0 lens 488/448 e 0 to 0 dl 1746129594 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129583.538013:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095624e00 with x1830948734491008 ext(1048576->1437695) 00010000:00010000:3.0:1746129583.538023:0:25745:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800915d4c00/0x40a459093b06c009 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1437695) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22666 expref: 30 pid: 4385 timeout: 938 lvb_type: 0 00010000:00010000:3.0:1746129583.538473:0:25745:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800915d4c00/0x40a459093b06c009 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1437695) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22666 expref: 30 pid: 4385 timeout: 938 lvb_type: 0 00002000:00010000:3.0:1746129583.538481:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880095624e00 00000100:00100000:0.0:1746129583.538733:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129583.538763:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129583.538797:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129583.538818:0:15749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734491776 00000100:00100000:2.0:1746129583.538827:0:15749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734491776 00010000:00010000:2.0:1746129583.538853:0:15749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fab4000/0x40a459093b06bfae lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2262e expref: 30 pid: 22480 timeout: 938 lvb_type: 0 00000100:00100000:2.0:1746129583.538875:0:15749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734492800 00000100:00100000:2.0:1746129583.538877:0:15749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734492800 00000100:00100000:0.0:1746129583.538886:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734492928 00010000:00010000:2.0:1746129583.538888:0:15749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012e0c4000/0x40a459093b06be18 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22524 expref: 40 pid: 31503 timeout: 938 lvb_type: 0 00000100:00100000:0.0:1746129583.538890:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734492928 00000100:00100000:2.0:1746129583.538903:0:15749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8808 00010000:00010000:0.0:1746129583.538905:0:7087:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012e0c5200/0x40a459093b06bdf5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2250f expref: 31 pid: 31503 timeout: 938 lvb_type: 0 00000100:00100000:2.0:1746129583.538909:0:15749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a45850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+31:1961:x1830948734491776:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129583.538922:0:15749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746129583.538922:0:7087:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8809 00000100:00100000:0.0:1746129583.538927:0:7087:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa25c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ada2ffba-8920-4ecb-8068-68caa9806978+40:1961:x1830948734492800:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129583.538935:0:7087:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129583.538942:0:15749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fab4000/0x40a459093b06bfae lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2262e expref: 31 pid: 22480 timeout: 938 lvb_type: 0 00010000:00010000:0.0:1746129583.538946:0:7087:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012e0c4000/0x40a459093b06be18 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22524 expref: 40 pid: 31503 timeout: 938 lvb_type: 0 00010000:00010000:2.0:1746129583.538952:0:15749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fab4000/0x40a459093b06bfae lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2262e expref: 31 pid: 22480 timeout: 938 lvb_type: 0 00010000:00010000:0.0:1746129583.538954:0:7087:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012e0c4000/0x40a459093b06be18 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22524 expref: 40 pid: 31503 timeout: 938 lvb_type: 0 00010000:00010000:2.0:1746129583.538974:0:15749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fab4000/0x40a459093b06bfae lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2262e expref: 31 pid: 22480 timeout: 938 lvb_type: 0 00010000:00010000:0.0:1746129583.538974:0:7087:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e0c4000/0x40a459093b06be18 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22524 expref: 40 pid: 31503 timeout: 938 lvb_type: 0 00010000:00010000:2.0:1746129583.538987:0:15749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129583.538987:0:7087:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746129583.538989:0:15749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129583.538993:0:15749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880095d83200/0x40a459093b06c072 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129583.539002:0:15749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095d83200/0x40a459093b06c072 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129583.539028:0:15749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129583.539051:0:15749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a45850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+30:1961:x1830948734491776:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 143us (1090us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129583.539057:0:15749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8808 00000100:00100000:2.0:1746129583.539092:0:15749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8810 00000100:00100000:2.0:1746129583.539097:0:15749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa25180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+29:1962:x1830948734492928:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129583.539102:0:15749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129583.539109:0:15749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012e0c5200/0x40a459093b06bdf5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2250f expref: 29 pid: 31503 timeout: 938 lvb_type: 0 00010000:00010000:2.0:1746129583.539117:0:15749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012e0c5200/0x40a459093b06bdf5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2250f expref: 29 pid: 31503 timeout: 938 lvb_type: 0 00010000:00010000:2.0:1746129583.539127:0:15749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e0c5200/0x40a459093b06bdf5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2250f expref: 29 pid: 31503 timeout: 938 lvb_type: 0 00010000:00010000:2.0:1746129583.539135:0:15749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129583.539136:0:15749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129583.539139:0:15749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fe03600/0x40a459093b06c080 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129583.539144:0:15749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fe03600/0x40a459093b06c080 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129583.539158:0:15749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129583.539173:0:15749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa25180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+28:1962:x1830948734492928:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 75us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129583.539178:0:15749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8810 00010000:00010000:2.0:1746129583.539198:0:8410:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880095d83200/0x40a459093b06c072 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129583.539214:0:8410:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095d83200/0x40a459093b06c072 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129583.539233:0:8410:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880095d83200/0x40a459093b06c072 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129583.539241:0:8410:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880095d83200/0x40a459093b06c072 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129583.539248:0:8410:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880095d83200/0x40a459093b06c072 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129583.539254:0:8410:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095d83200 already unused, calling callback (ffffffffa086ed70) 00010000:00010000:2.0:1746129583.539257:0:8410:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880095d83200/0x40a459093b06c072 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129583.539265:0:8410:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880095d83200/0x40a459093b06c072 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129583.539274:0:8410:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880095d83200/0x40a459093b06c072 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129583.539278:0:8410:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095d83200/0x40a459093b06c072 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129583.539348:0:8410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:068dab75-d300-4ead-a742-d14572ad1e50+10:1963:x1830948734490752:12345-192.168.202.4@tcp:1:lfs.0 Request processed in 19967us (20150us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129583.539352:0:7087:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa25c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ada2ffba-8920-4ecb-8068-68caa9806978+39:1961:x1830948734492800:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 423us (617us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129583.539355:0:8410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16985 00000100:00100000:0.0:1746129583.539358:0:7087:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8809 00010000:00010000:2.0:1746129583.539377:0:22480:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009fe03600/0x40a459093b06c080 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129583.539384:0:22480:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fe03600/0x40a459093b06c080 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129583.539396:0:22480:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009fe03600/0x40a459093b06c080 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129583.539402:0:22480:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009fe03600/0x40a459093b06c080 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129583.539407:0:22480:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009fe03600/0x40a459093b06c080 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129583.539412:0:22480:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fe03600 already unused, calling callback (ffffffffa086ed70) 00010000:00010000:2.0:1746129583.539415:0:22480:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009fe03600/0x40a459093b06c080 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129583.539421:0:22480:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009fe03600/0x40a459093b06c080 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129583.539429:0:22480:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009fe03600/0x40a459093b06c080 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129583.539434:0:22480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fe03600/0x40a459093b06c080 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129583.539463:0:22480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095627800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:068dab75-d300-4ead-a742-d14572ad1e50+9:1963:x1830948734490368:12345-192.168.202.4@tcp:1:lfs.0 Request processed in 19822us (20229us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129583.539468:0:22480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16987 00000100:00100000:3.0:1746129583.539822:0:4699:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094065c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4699:1830948737652096:192.168.202.4@tcp:106: 00010000:00010000:3.0:1746129583.539847:0:4699:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fab4e00/0x40a459093b06c08e lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f226b3 expref: 35 pid: 4699 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129583.539858:0:4699:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fab4e00/0x40a459093b06c08e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f226b3 expref: 35 pid: 4699 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129583.539866:0:4699:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fab4e00, rc 0) 00000100:00100000:3.0:1746129583.539893:0:4699:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e954e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ada2ffba-8920-4ecb-8068-68caa9806978+34:1962:x1830948734492160:12345-192.168.202.4@tcp:101:cat.0 Request processed in 9219us (9387us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129583.539898:0:4699:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16989 00000100:00100000:3.0:1746129583.539935:0:20577:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094066680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20577:1830948737652224:192.168.202.4@tcp:106: 00010000:00010000:3.0:1746129583.539949:0:20577:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fab5c00/0x40a459093b06c0aa lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f226ba expref: 38 pid: 20577 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129583.539957:0:20577:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fab5c00/0x40a459093b06c0aa lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f226ba expref: 38 pid: 20577 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129583.539964:0:20577:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fab5c00, rc 0) 00000100:00100000:3.0:1746129583.539979:0:20577:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e956300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ada2ffba-8920-4ecb-8068-68caa9806978+37:1963:x1830948734492288:12345-192.168.202.4@tcp:101:cat.0 Request processed in 6320us (9310us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129583.539984:0:20577:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16992 00000100:00100000:3.0:1746129583.540008:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734493184 00000100:00100000:3.0:1746129583.540011:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734493184 00002000:00100000:3.0:1746129583.540037:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->4194303) req@ffff88009fa27b80 x1830948734493184/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:324/0 lens 488/0 e 0 to 0 dl 1746129594 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129583.540051:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fa27b80 with x1830948734493184 ext(3145728->4194303) 00010000:00010000:3.0:1746129583.540058:0:25745:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880095d82600/0x40a459093b06c010 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22674 expref: 30 pid: 4385 timeout: 938 lvb_type: 0 00010000:00010000:3.0:1746129583.540066:0:25745:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880095d82600/0x40a459093b06c010 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22674 expref: 30 pid: 4385 timeout: 938 lvb_type: 0 00002000:00010000:3.0:1746129583.540072:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fa27b80 00000100:00100000:3.0:1746129583.540094:0:8417:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2556 00000100:00100000:3.0:1746129583.540099:0:8417:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+30:1963:x1830948734493184:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:0.0:1746129583.544015:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129583.544053:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734493312 00000100:00100000:0.0:1746129583.544062:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734493312 00010000:00010000:0.0:1746129583.544098:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800915d4c00/0x40a459093b06c009 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1437695) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22666 expref: 28 pid: 4385 timeout: 938 lvb_type: 0 00000100:00100000:0.0:1746129583.544148:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8811 00000100:00100000:0.0:1746129583.544156:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa24700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+28:1963:x1830948734493312:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129583.544170:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129583.544193:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800915d4c00/0x40a459093b06c009 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1437695) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22666 expref: 28 pid: 4385 timeout: 938 lvb_type: 0 00010000:00010000:0.0:1746129583.544217:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800915d4c00/0x40a459093b06c009 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1437695) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22666 expref: 28 pid: 4385 timeout: 938 lvb_type: 0 00010000:00010000:0.0:1746129583.544241:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800915d4c00/0x40a459093b06c009 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1437695) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22666 expref: 28 pid: 4385 timeout: 938 lvb_type: 0 00010000:00010000:0.0:1746129583.544258:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129583.544260:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129583.544264:0:7085:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fe03a00/0x40a459093b06c064 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129583.544272:0:7085:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fe03a00/0x40a459093b06c064 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129583.544334:0:11014:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009fe03a00/0x40a459093b06c064 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129583.544345:0:11014:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fe03a00/0x40a459093b06c064 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129583.544365:0:11014:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009fe03a00/0x40a459093b06c064 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129583.544372:0:11014:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009fe03a00/0x40a459093b06c064 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129583.544378:0:11014:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009fe03a00/0x40a459093b06c064 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129583.544388:0:11014:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fe03a00 already unused, calling callback (ffffffffa086ed70) 00010000:00010000:3.0:1746129583.544392:0:11014:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009fe03a00/0x40a459093b06c064 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129583.544398:0:11014:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009fe03a00/0x40a459093b06c064 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129583.544407:0:11014:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009fe03a00/0x40a459093b06c064 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129583.544412:0:11014:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fe03a00/0x40a459093b06c064 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129583.544434:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129583.544467:0:11014:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:068dab75-d300-4ead-a742-d14572ad1e50+8:1963:x1830948734490240:12345-192.168.202.4@tcp:1:lfs.0 Request processed in 26129us (27927us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129583.544475:0:11014:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16983 00000100:00100000:3.0:1746129583.544498:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734493568 00000100:00100000:3.0:1746129583.544501:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734493568 00002000:00100000:3.0:1746129583.544525:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ef:0x0] (5144576->5148671) req@ffff88012e955180 x1830948734493568/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:324/0 lens 488/0 e 0 to 0 dl 1746129594 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129583.544534:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e955180 with x1830948734493568 ext(5144576->5148671) 00010000:00010000:3.0:1746129583.544541:0:25745:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008f5e5000/0x40a459093b06c041 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5144576->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2269e expref: 34 pid: 4385 timeout: 938 lvb_type: 0 00010000:00010000:3.0:1746129583.544549:0:25745:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008f5e5000/0x40a459093b06c041 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5144576->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2269e expref: 34 pid: 4385 timeout: 938 lvb_type: 0 00002000:00010000:3.0:1746129583.544556:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012e955180 00000100:00100000:3.0:1746129583.544566:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2557 00000100:00100000:3.0:1746129583.544570:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e955180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+34:1963:x1830948734493568:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:3.0:1746129583.544705:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e955180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+34:1963:x1830948734493568:12345-192.168.202.4@tcp:3:cat.0 Request processed in 133us (270us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129583.544710:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2557 00002000:00100000:3.0:1746129583.544715:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ef:0x0] (5144576->5148671) req@ffff88012e955180 x1830948734493568/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:324/0 lens 488/4536 e 0 to 0 dl 1746129594 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129583.544721:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e955180 with x1830948734493568 ext(5144576->5148671) 00010000:00010000:3.0:1746129583.544725:0:25745:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008f5e5000/0x40a459093b06c041 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5144576->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2269e expref: 34 pid: 4385 timeout: 938 lvb_type: 0 00010000:00010000:3.0:1746129583.544733:0:25745:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008f5e5000/0x40a459093b06c041 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5144576->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2269e expref: 34 pid: 4385 timeout: 938 lvb_type: 0 00002000:00010000:3.0:1746129583.544738:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012e955180 00000100:00100000:1.0:1746129583.544920:0:31518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129bc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+32:1961:x1830948734491904:12345-192.168.202.4@tcp:4:multiop.0 Request processed in 11252us (11373us total) trans 21474841467 rc 0/0 00000100:00100000:1.0:1746129583.544927:0:31518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2555 00002000:00100000:1.0:1746129583.544932:0:31518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3ec:0x0] (581632->1048575) req@ffff880129bc3800 x1830948734491904/t21474841467(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:324/0 lens 488/448 e 0 to 0 dl 1746129594 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129583.544940:0:31518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129bc3800 with x1830948734491904 ext(581632->1048575) 00010000:00010000:1.0:1746129583.544946:0:31518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008fa79e00/0x40a459093b06bfdf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 581632->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22643 expref: 32 pid: 31503 timeout: 938 lvb_type: 0 00010000:00010000:1.0:1746129583.544954:0:31518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008fa79e00/0x40a459093b06bfdf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 581632->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22643 expref: 32 pid: 31503 timeout: 938 lvb_type: 0 00002000:00010000:1.0:1746129583.544960:0:31518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880129bc3800 00010000:00010000:0.0:1746129583.547370:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129583.547451:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa24700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+27:1963:x1830948734493312:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 3288us (3440us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129583.547462:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8811 00000100:00100000:1.0:1746129583.549077:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129583.549161:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734493696 00000100:00100000:0.0:1746129583.549170:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734493696 00010000:00010000:0.0:1746129583.549773:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008fa79e00/0x40a459093b06bfdf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 581632->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22643 expref: 32 pid: 31503 timeout: 938 lvb_type: 0 00000100:00100000:0.0:1746129583.549817:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8812 00000100:00100000:0.0:1746129583.549827:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129bc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+32:1960:x1830948734493696:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129583.549846:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129583.549870:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008fa79e00/0x40a459093b06bfdf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 581632->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22643 expref: 32 pid: 31503 timeout: 938 lvb_type: 0 00010000:00010000:0.0:1746129583.549882:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008fa79e00/0x40a459093b06bfdf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 581632->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22643 expref: 32 pid: 31503 timeout: 938 lvb_type: 0 00010000:00010000:0.0:1746129583.549906:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008fa79e00/0x40a459093b06bfdf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 581632->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22643 expref: 32 pid: 31503 timeout: 938 lvb_type: 0 00010000:00010000:0.0:1746129583.549920:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129583.549922:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129583.549927:0:7085:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fe02e00/0x40a459093b06c079 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129583.549935:0:7085:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fe02e00/0x40a459093b06c079 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129583.550886:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129583.550960:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129bc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+31:1960:x1830948734493696:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 1132us (1888us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129583.550970:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8812 00010000:00010000:2.0:1746129583.551193:0:7149:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009fe02e00/0x40a459093b06c079 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129583.551212:0:7149:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fe02e00/0x40a459093b06c079 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129583.551238:0:7149:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009fe02e00/0x40a459093b06c079 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129583.551245:0:7149:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009fe02e00/0x40a459093b06c079 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129583.551252:0:7149:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009fe02e00/0x40a459093b06c079 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129583.551259:0:7149:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fe02e00 already unused, calling callback (ffffffffa086ed70) 00010000:00010000:2.0:1746129583.551264:0:7149:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009fe02e00/0x40a459093b06c079 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129583.551276:0:7149:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009fe02e00/0x40a459093b06c079 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129583.551289:0:7149:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009fe02e00/0x40a459093b06c079 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129583.551322:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fe02e00/0x40a459093b06c079 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129583.551389:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:068dab75-d300-4ead-a742-d14572ad1e50+9:1963:x1830948734490112:12345-192.168.202.4@tcp:1:lfs.0 Request processed in 31865us (32168us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129583.551397:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16986 00000100:00100000:3.0:1746129583.554722:0:8417:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+29:1963:x1830948734493184:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 14608us (15909us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129583.554734:0:8417:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2556 00002000:00100000:3.0:1746129583.554748:0:8417:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->4194303) req@ffff88009fa27b80 x1830948734493184/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:324/0 lens 488/440 e 0 to 0 dl 1746129594 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129583.554758:0:8417:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fa27b80 with x1830948734493184 ext(3145728->4194303) 00010000:00010000:3.0:1746129583.554768:0:8417:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880095d82600/0x40a459093b06c010 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22674 expref: 29 pid: 4385 timeout: 938 lvb_type: 0 00010000:00010000:3.0:1746129583.554783:0:8417:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880095d82600/0x40a459093b06c010 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22674 expref: 29 pid: 4385 timeout: 938 lvb_type: 0 00002000:00010000:3.0:1746129583.554790:0:8417:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fa27b80 00000100:00100000:0.0:1746129583.556715:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129583.556931:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734493824 00000100:00100000:2.0:1746129583.556943:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734493824 00010000:00010000:2.0:1746129583.556984:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f5e5000/0x40a459093b06c041 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5144576->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2269e expref: 34 pid: 4385 timeout: 938 lvb_type: 0 00000100:00100000:2.0:1746129583.557027:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8813 00000100:00100000:2.0:1746129583.557036:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa24a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ada2ffba-8920-4ecb-8068-68caa9806978+34:1963:x1830948734493824:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129583.557050:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129583.557075:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f5e5000/0x40a459093b06c041 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 5144576->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2269e expref: 34 pid: 4385 timeout: 938 lvb_type: 0 00010000:00010000:2.0:1746129583.557086:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f5e5000/0x40a459093b06c041 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 5144576->5242879) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2269e expref: 34 pid: 4385 timeout: 938 lvb_type: 0 00010000:00010000:2.0:1746129583.557114:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f5e5000/0x40a459093b06c041 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 5144576->5242879) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f2269e expref: 34 pid: 4385 timeout: 938 lvb_type: 0 00010000:00010000:2.0:1746129583.557131:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129583.557172:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa24a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ada2ffba-8920-4ecb-8068-68caa9806978+33:1963:x1830948734493824:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 138us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129583.557178:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8813 00000100:00100000:0.0:1746129583.561745:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129583.561881:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129583.561976:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734493952 00000100:00100000:2.0:1746129583.561987:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734493952 00000100:00100000:3.0:1746129583.562321:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734494080 00000100:00100000:3.0:1746129583.562325:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734494080 00010000:00010000:3.0:1746129583.562350:0:9823:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095d82600/0x40a459093b06c010 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22674 expref: 29 pid: 4385 timeout: 938 lvb_type: 0 00000100:00100000:3.0:1746129583.562380:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8814 00000100:00100000:3.0:1746129583.562386:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa24380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+29:1962:x1830948734494080:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129583.562399:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129583.562423:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095d82600/0x40a459093b06c010 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22674 expref: 29 pid: 4385 timeout: 938 lvb_type: 0 00010000:00010000:3.0:1746129583.562435:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095d82600/0x40a459093b06c010 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22674 expref: 29 pid: 4385 timeout: 938 lvb_type: 0 00010000:00010000:3.0:1746129583.562464:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095d82600/0x40a459093b06c010 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22674 expref: 29 pid: 4385 timeout: 938 lvb_type: 0 00000100:00100000:2.0:1746129583.562626:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16994 00000100:00100000:2.0:1746129583.562633:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+27:32765:x1830948734493952:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129583.562648:0:7149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129583.562664:0:7149:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fe03e00/0x40a459093b06c0b1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f226d6 expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746129583.562682:0:7149:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3f5:0x0] initial LVB size: 4194304, mtime: 0x6813d2b0, atime: 0x6813d2af, ctime: 0x6813d2b0, blocks: 0x1029 00010000:00010000:2.0:1746129583.562698:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129583.562700:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129583.562707:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fe03e00/0x40a459093b06c0b1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f226d6 expref: 28 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129583.562720:0:7149:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fe03e00/0x40a459093b06c0b1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f226d6 expref: 28 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129583.562731:0:7149:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe03e00, rc 0) 00000100:00100000:2.0:1746129583.563109:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+28:32765:x1830948734493952:12345-192.168.202.4@tcp:101:cat.0 Request processed in 474us (1375us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129583.563116:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16994 00010000:00010000:3.0:1746129583.563415:0:9823:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129583.563417:0:9823:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129583.563421:0:9823:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fab4c00/0x40a459093b06c087 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129583.563434:0:9823:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fab4c00/0x40a459093b06c087 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129583.563457:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129583.563476:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa24380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+28:1962:x1830948734494080:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 1090us (1597us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129583.563482:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8814 00010000:00010000:2.0:1746129583.563550:0:7148:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009fab4c00/0x40a459093b06c087 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129583.563559:0:7148:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fab4c00/0x40a459093b06c087 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129583.563581:0:7148:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009fab4c00/0x40a459093b06c087 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129583.563588:0:7148:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009fab4c00/0x40a459093b06c087 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129583.563594:0:7148:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009fab4c00/0x40a459093b06c087 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129583.563600:0:7148:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fab4c00 already unused, calling callback (ffffffffa086ed70) 00010000:00010000:2.0:1746129583.563603:0:7148:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009fab4c00/0x40a459093b06c087 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129583.563610:0:7148:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009fab4c00/0x40a459093b06c087 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129583.563619:0:7148:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009fab4c00/0x40a459093b06c087 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129583.563625:0:7148:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fab4c00/0x40a459093b06c087 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129583.563663:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095625c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:068dab75-d300-4ead-a742-d14572ad1e50+8:1963:x1830948734490624:12345-192.168.202.4@tcp:1:lfs.0 Request processed in 43423us (44416us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129583.563669:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16988 00000100:00100000:1.0:1746129583.570945:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129583.571365:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734494336 00000100:00100000:0.0:1746129583.571376:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734494336 00000100:00100000:1.0:1746129583.571514:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129583.571535:0:8417:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734494592 00000100:00100000:1.0:1746129583.571539:0:8417:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734494592 00002000:00100000:1.0:1746129583.571574:0:8417:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3f5:0x0] (3145728->4194303) req@ffff880129bc2d80 x1830948734494592/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:324/0 lens 488/0 e 0 to 0 dl 1746129594 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129583.571584:0:8417:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129bc2d80 with x1830948734494592 ext(3145728->4194303) 00002000:00010000:1.0:1746129583.571591:0:8417:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880129bc2d80 00000100:00100000:1.0:1746129583.571611:0:8417:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8258 00000100:00100000:1.0:1746129583.571620:0:8417:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129bc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+28:1960:x1830948734494592:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:0.0:1746129583.573435:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11390 00000100:00100000:0.0:1746129583.573452:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129bc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:068dab75-d300-4ead-a742-d14572ad1e50+15:301:x1830948734494336:12345-192.168.202.4@tcp:36:lfs.0 00010000:00010000:0.0:1746129583.573511:0:14548:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1746129583.573540:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919f1600/0x40a459093b06bd07 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22483 expref: 15 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129583.573562:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091199800/0x40a459093b06bce4 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22475 expref: 14 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129583.573572:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009cffe100) 00010000:00010000:0.0:1746129583.573576:0:14548:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746129583.573606:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fa78000/0x40a459093b06c0b8 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746129583.573617:0:14548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab4400/0x40a459093b06bae5 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2231e expref: 303 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129583.573624:0:14548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0b5800/0x40a459093b06bb24 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2233a expref: 23 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129583.573629:0:14548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095eeca00/0x40a459093b06bc3c lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22405 expref: 303 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129583.573635:0:14548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba38a00/0x40a459093b06bc6d lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22428 expref: 23 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129583.573642:0:14548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919f1e00/0x40a459093b06bd31 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2249f expref: 303 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129583.573648:0:14548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800915d4400/0x40a459093b06bf1b lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f225da expref: 23 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129583.573655:0:14548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fa78000/0x40a459093b06c0b8 lrc: 9/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746129583.573692:0:14548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800915d4400/0x40a459093b06bf1b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f225da expref: 23 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129583.573703:0:14548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800915d4400/0x40a459093b06bf1b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f225da expref: 23 pid: 14549 timeout: 938 lvb_type: 0 00000100:00100000:0.0:1746129583.573716:0:14548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fa26d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14548:1830948737652352:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129583.573806:0:14548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800919f1e00/0x40a459093b06bd31 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2249f expref: 303 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129583.573813:0:14548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919f1e00/0x40a459093b06bd31 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2249f expref: 303 pid: 14549 timeout: 938 lvb_type: 0 00000100:00100000:0.0:1746129583.573820:0:14548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fa24000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14548:1830948737652480:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129583.573865:0:14548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba38a00/0x40a459093b06bc6d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22428 expref: 23 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129583.573873:0:14548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba38a00/0x40a459093b06bc6d lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22428 expref: 23 pid: 14549 timeout: 938 lvb_type: 0 00000100:00100000:0.0:1746129583.573881:0:14548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fa27800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14548:1830948737652608:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129583.573909:0:14548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880095eeca00/0x40a459093b06bc3c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22405 expref: 303 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129583.573916:0:14548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880095eeca00/0x40a459093b06bc3c lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22405 expref: 303 pid: 14548 timeout: 938 lvb_type: 0 00000100:00100000:0.0:1746129583.573923:0:14548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fa26a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14548:1830948737652736:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129583.573943:0:14548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0b5800/0x40a459093b06bb24 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2233a expref: 23 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129583.573950:0:14548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0b5800/0x40a459093b06bb24 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2233a expref: 23 pid: 2271 timeout: 938 lvb_type: 0 00000100:00100000:0.0:1746129583.573958:0:14548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fa27480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14548:1830948737652864:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129583.573979:0:14548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab4400/0x40a459093b06bae5 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2231e expref: 303 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129583.573986:0:14548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab4400/0x40a459093b06bae5 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2231e expref: 303 pid: 16908 timeout: 938 lvb_type: 0 00000100:00100000:0.0:1746129583.573993:0:14548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fa25880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14548:1830948737652992:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129583.574008:0:14548:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa3ef000 going to sleep for 11 seconds 00000100:00100000:0.0:1746129583.578890:0:14548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fa26d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14548:1830948737652352:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129583.581273:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129583.581348:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129583.581371:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129583.581390:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129583.581412:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129583.581435:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129583.581458:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734494976 00000100:00100000:0.0:1746129583.581466:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734494976 00010000:00010000:0.0:1746129583.581502:0:7087:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba38a00/0x40a459093b06bc6d lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22428 expref: 24 pid: 14549 timeout: 938 lvb_type: 0 00000100:00100000:0.0:1746129583.581527:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734494720 00000100:00100000:0.0:1746129583.581530:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734494720 00010000:00010000:0.0:1746129583.581539:0:7087:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800915d4400/0x40a459093b06bf1b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f225da expref: 25 pid: 14549 timeout: 938 lvb_type: 0 00000100:00100000:0.0:1746129583.581547:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734494848 00000100:00100000:0.0:1746129583.581549:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734494848 00000100:00100000:1.0:1746129583.581604:0:7086:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734495104 00000100:00100000:1.0:1746129583.581607:0:7086:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734495104 00010000:00010000:1.0:1746129583.581621:0:7086:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0b5800/0x40a459093b06bb24 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2233a expref: 26 pid: 2271 timeout: 938 lvb_type: 0 00000100:00100000:1.0:1746129583.581630:0:7086:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734495488 00000100:00100000:1.0:1746129583.581632:0:7086:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734495488 00010000:00010000:1.0:1746129583.581639:0:7086:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab4400/0x40a459093b06bae5 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2231e expref: 305 pid: 16908 timeout: 938 lvb_type: 0 00000100:00100000:1.0:1746129583.581649:0:7086:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8815 00000100:00100000:1.0:1746129583.581655:0:7086:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a45450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+26:1960:x1830948734494976:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129583.581670:0:7086:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129583.581675:0:7086:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba38a00/0x40a459093b06bc6d lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22428 expref: 26 pid: 14549 timeout: 938 lvb_type: 0 00010000:00010000:1.0:1746129583.581685:0:7086:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba38a00/0x40a459093b06bc6d lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22428 expref: 26 pid: 14549 timeout: 938 lvb_type: 0 00010000:00010000:1.0:1746129583.581708:0:7086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009cffe100) 00010000:00010000:1.0:1746129583.581713:0:7086:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008fa78000/0x40a459093b06c0b8 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746129583.581721:0:7086:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129583.581764:0:7086:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a45450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+26:1960:x1830948734494976:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 109us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129583.581770:0:7086:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8815 00000100:00100000:1.0:1746129583.581817:0:7086:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8816 00000100:00100000:1.0:1746129583.581822:0:7086:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa24e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+25:1963:x1830948734494720:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129583.581828:0:7086:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129583.581832:0:7086:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800915d4400/0x40a459093b06bf1b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f225da expref: 25 pid: 14549 timeout: 938 lvb_type: 0 00010000:00010000:1.0:1746129583.581839:0:7086:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800915d4400/0x40a459093b06bf1b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f225da expref: 25 pid: 14549 timeout: 938 lvb_type: 0 00010000:00010000:1.0:1746129583.581848:0:7086:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800915d4400/0x40a459093b06bf1b lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f225da expref: 25 pid: 14549 timeout: 938 lvb_type: 0 00010000:00010000:1.0:1746129583.581866:0:7086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009cffe100) 00010000:00010000:1.0:1746129583.581869:0:7086:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008fa78000/0x40a459093b06c0b8 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746129583.581874:0:7086:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129583.581888:0:7086:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa24e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+24:1963:x1830948734494720:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 65us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129583.581893:0:7086:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8816 00000100:00100000:1.0:1746129583.581902:0:7086:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8817 00000100:00100000:1.0:1746129583.581906:0:7086:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135725500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+23:1962:x1830948734495104:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129583.581914:0:7086:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129583.581917:0:7086:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0b5800/0x40a459093b06bb24 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2233a expref: 23 pid: 2271 timeout: 938 lvb_type: 0 00010000:00010000:1.0:1746129583.581924:0:7086:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0b5800/0x40a459093b06bb24 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2233a expref: 23 pid: 2271 timeout: 938 lvb_type: 0 00010000:00010000:1.0:1746129583.581932:0:7086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009cffe100) 00010000:00010000:1.0:1746129583.581934:0:7086:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008fa78000/0x40a459093b06c0b8 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746129583.581938:0:7086:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129583.581950:0:7086:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135725500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+23:1962:x1830948734495104:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 44us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129583.581954:0:7086:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8817 00000100:00100000:1.0:1746129583.581963:0:7086:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8818 00000100:00100000:1.0:1746129583.581967:0:7086:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135725880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ada2ffba-8920-4ecb-8068-68caa9806978+305:1960:x1830948734495488:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129583.581974:0:7086:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129583.581977:0:7086:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab4400/0x40a459093b06bae5 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2231e expref: 305 pid: 16908 timeout: 938 lvb_type: 0 00010000:00010000:1.0:1746129583.581983:0:7086:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab4400/0x40a459093b06bae5 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2231e expref: 305 pid: 16908 timeout: 938 lvb_type: 0 00010000:00010000:1.0:1746129583.581992:0:7086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009cffe100) 00010000:00010000:1.0:1746129583.581994:0:7086:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008fa78000/0x40a459093b06c0b8 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746129583.582002:0:7086:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129583.582014:0:7086:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135725880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ada2ffba-8920-4ecb-8068-68caa9806978+305:1960:x1830948734495488:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 47us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129583.582019:0:7086:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8818 00000100:00100000:1.0:1746129583.582041:0:14551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734495360 00000100:00100000:1.0:1746129583.582044:0:14551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734495360 00000100:00100000:1.0:1746129583.582063:0:14551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4865 00000100:00100000:1.0:1746129583.582067:0:14551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135725f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ada2ffba-8920-4ecb-8068-68caa9806978+305:27694:x1830948734495360:12345-192.168.202.4@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746129583.582257:0:14551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135725f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ada2ffba-8920-4ecb-8068-68caa9806978+306:27694:x1830948734495360:12345-192.168.202.4@tcp:35:ldlm_bl.0 Request processed in 189us (843us total) trans 8589945524 rc 0/0 00000100:00100000:1.0:1746129583.582263:0:14551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4865 00000100:00100000:1.0:1746129583.582603:0:8417:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129bc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+28:1960:x1830948734494592:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 10984us (11088us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129583.582610:0:8417:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8258 00002000:00100000:1.0:1746129583.582619:0:8417:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3f5:0x0] (3145728->4194303) req@ffff880129bc2d80 x1830948734494592/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:324/0 lens 488/440 e 0 to 0 dl 1746129594 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129583.582628:0:8417:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129bc2d80 with x1830948734494592 ext(3145728->4194303) 00002000:00010000:1.0:1746129583.582632:0:8417:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880129bc2d80 00000100:00100000:2.0:1746129583.582925:0:14548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fa24000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14548:1830948737652480:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129583.582937:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba38a00/0x40a459093b06bc6d lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22428 expref: 22 pid: 14549 timeout: 938 lvb_type: 0 00000100:00100000:2.0:1746129583.582952:0:14548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fa27800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14548:1830948737652608:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129583.582961:0:14548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fa26a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14548:1830948737652736:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129583.582968:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0b5800/0x40a459093b06bb24 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2233a expref: 21 pid: 2271 timeout: 938 lvb_type: 0 00000100:00100000:2.0:1746129583.582975:0:14548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fa27480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14548:1830948737652864:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129583.582982:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab4400/0x40a459093b06bae5 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2231e expref: 305 pid: 16908 timeout: 938 lvb_type: 0 00000100:00100000:2.0:1746129583.582989:0:14548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fa25880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14548:1830948737652992:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129583.583013:0:14548:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008fa78000/0x40a459093b06c0b8 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746129583.583848:0:7087:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919f1e00/0x40a459093b06bd31 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2249f expref: 304 pid: 14549 timeout: 938 lvb_type: 0 00000100:00100000:0.0:1746129583.583880:0:7087:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8819 00000100:00100000:0.0:1746129583.583891:0:7087:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135724e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ada2ffba-8920-4ecb-8068-68caa9806978+304:1962:x1830948734494848:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129583.583904:0:7087:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129583.583909:0:7087:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800919f1e00/0x40a459093b06bd31 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2249f expref: 304 pid: 14549 timeout: 938 lvb_type: 0 00010000:00010000:0.0:1746129583.583918:0:7087:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800919f1e00/0x40a459093b06bd31 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2249f expref: 304 pid: 14549 timeout: 938 lvb_type: 0 00010000:00010000:0.0:1746129583.583935:0:7087:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919f1e00/0x40a459093b06bd31 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2249f expref: 304 pid: 14549 timeout: 938 lvb_type: 0 00010000:00010000:0.0:1746129583.583953:0:7087:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009cffe100) 00010000:00010000:0.0:1746129583.583957:0:7087:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008fa78000/0x40a459093b06c0b8 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746129583.583963:0:7087:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129583.583999:0:7087:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135724e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ada2ffba-8920-4ecb-8068-68caa9806978+303:1962:x1830948734494848:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 112us (2626us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129583.584004:0:7087:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8819 00000100:00100000:0.0:1746129583.585119:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129583.586417:0:15749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734495616 00000100:00100000:2.0:1746129583.586428:0:15749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734495616 00010000:00010000:2.0:1746129583.586463:0:15749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095eeca00/0x40a459093b06bc3c lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22405 expref: 303 pid: 14548 timeout: 938 lvb_type: 0 00000100:00100000:2.0:1746129583.586496:0:15749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8820 00000100:00100000:2.0:1746129583.586505:0:15749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135726680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ada2ffba-8920-4ecb-8068-68caa9806978+303:1962:x1830948734495616:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129583.586518:0:15749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129583.586523:0:15749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880095eeca00/0x40a459093b06bc3c lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22405 expref: 303 pid: 14548 timeout: 938 lvb_type: 0 00010000:00010000:2.0:1746129583.586536:0:15749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880095eeca00/0x40a459093b06bc3c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22405 expref: 303 pid: 14548 timeout: 938 lvb_type: 0 00010000:00010000:2.0:1746129583.586556:0:15749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095eeca00/0x40a459093b06bc3c lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22405 expref: 303 pid: 14548 timeout: 938 lvb_type: 0 00010000:00010000:2.0:1746129583.586569:0:15749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009cffe100) 00010000:00010000:2.0:1746129583.586575:0:15749:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008fa78000/0x40a459093b06c0b8 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746129583.586583:0:15749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fa78000/0x40a459093b06c0b8 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746129583.586590:0:15749:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fa78000/0x40a459093b06c0b8 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746129583.586616:0:15749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129583.586655:0:15749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135726680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ada2ffba-8920-4ecb-8068-68caa9806978+302:1962:x1830948734495616:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 152us (1624us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129583.586661:0:15749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8820 00010000:00010000:2.0:1746129583.586684:0:14548:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008fa78000/0x40a459093b06c0b8 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746129583.586694:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fa78000/0x40a459093b06c0b8 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000040:00080000:2.0:1746129583.587334:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3518, 88 off296320 00000004:00080000:2.0:1746129583.587343:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 838904049056ns, next at 776349687452ns, rc = 0 00000100:00100000:3.0:1746129583.589998:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129583.590754:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734495744 00000100:00100000:1.0:1746129583.590765:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734495744 00000100:00100000:1.0:1746129583.590822:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11391 00000100:00100000:1.0:1746129583.590831:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094066680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+21:32765:x1830948734495744:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129583.590854:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129583.590873:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f84d000/0x40a459093b06c0bf lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f226dd expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00000040:00080000:2.0:1746129583.591145:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3525, 88 off296848 00000004:00080000:2.0:1746129583.591160:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 838907865121ns, next at 776375382381ns, rc = 0 00000040:00080000:2.0:1746129583.591676:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3526, 88 off296936 00000004:00080000:2.0:1746129583.591680:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 838908386082ns, next at 776375382381ns, rc = 0 00000040:00080000:2.0:1746129583.591693:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3519, 88 off296408 00000004:00080000:2.0:1746129583.591696:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 838908401954ns, next at 776349687452ns, rc = 0 00000040:00080000:2.0:1746129583.591716:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3520, 88 off296496 00000004:00080000:2.0:1746129583.591719:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 838908425174ns, next at 776349687452ns, rc = 0 00000040:00080000:2.0:1746129583.591726:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3527, 88 off297024 00000004:00080000:2.0:1746129583.591728:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 838908434114ns, next at 776375382381ns, rc = 0 00000040:00080000:2.0:1746129583.591734:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3528, 88 off297112 00000004:00080000:2.0:1746129583.591736:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 838908442731ns, next at 776375382381ns, rc = 0 00000040:00080000:2.0:1746129583.591742:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3529, 88 off297200 00000004:00080000:2.0:1746129583.591745:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 838908451076ns, next at 776375382381ns, rc = 0 00000040:00080000:2.0:1746129583.591751:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3521, 88 off296584 00000004:00080000:2.0:1746129583.591753:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 838908459138ns, next at 776349687452ns, rc = 0 00000040:00080000:2.0:1746129583.591759:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3530, 88 off297288 00000004:00080000:2.0:1746129583.591762:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 838908467758ns, next at 776375382381ns, rc = 0 00000040:00080000:2.0:1746129583.591768:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3522, 88 off296672 00000004:00080000:2.0:1746129583.591770:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 838908476283ns, next at 776349687452ns, rc = 0 00000040:00080000:2.0:1746129583.591776:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3531, 88 off297376 00000004:00080000:2.0:1746129583.591779:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 838908485526ns, next at 776375382381ns, rc = 0 00000040:00080000:2.0:1746129583.591786:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3523, 88 off296760 00000004:00080000:2.0:1746129583.591789:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 838908495282ns, next at 776349687452ns, rc = 0 00000040:00080000:2.0:1746129583.591795:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3524, 88 off296848 00000004:00080000:2.0:1746129583.591798:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 838908504207ns, next at 776349687452ns, rc = 0 00000040:00080000:2.0:1746129583.591804:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3525, 88 off296936 00000004:00080000:2.0:1746129583.591806:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 838908512406ns, next at 776349687452ns, rc = 0 00000040:00080000:2.0:1746129583.591812:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3526, 88 off297024 00000004:00080000:2.0:1746129583.591814:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 838908520348ns, next at 776349687452ns, rc = 0 00000040:00080000:2.0:1746129583.591820:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3532, 88 off297464 00000004:00080000:2.0:1746129583.591823:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 838908528984ns, next at 776375382381ns, rc = 0 00010000:00010000:1.0:1746129583.592429:0:14549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fa78000/0x40a459093b06c0b8 lrc: 2/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746129583.592445:0:14549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f84d000/0x40a459093b06c0bf lrc: 4/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f226dd expref: 22 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129583.592463:0:14549:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88008fa78000/0x40a459093b06c0b8 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746129583.592476:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f84d000/0x40a459093b06c0bf lrc: 3/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f226dd expref: 22 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129583.592488:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009cffe100) 00010000:00010000:1.0:1746129583.592491:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746129583.592494:0:14549:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f84d000/0x40a459093b06c0bf lrc: 3/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f226dd expref: 22 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129583.592501:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f84d000, rc 0) 00000100:00100000:1.0:1746129583.592560:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094066680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+22:32765:x1830948734495744:12345-192.168.202.4@tcp:101:cat.0 Request processed in 1729us (2573us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129583.592568:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11391 00000001:00080000:1.0:1746129583.611777:0:14619:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945493 is committed 00000001:00080000:1.0:1746129583.611800:0:14619:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945524 is committed 00000001:00080000:1.0:1746129583.611809:0:14619:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945515 is committed 00000001:00080000:1.0:1746129583.611814:0:14619:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945512 is committed 00000001:00080000:1.0:1746129583.611823:0:14619:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945525 is committed 00000004:00080000:1.0:1746129583.611828:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2701 committed 00000004:00080000:1.0:1746129583.611837:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2695 committed 00000004:00080000:1.0:1746129583.611844:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2694 committed 00000004:00080000:1.0:1746129583.611846:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2693 committed 00000004:00080000:1.0:1746129583.611848:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2692 committed 00000004:00080000:1.0:1746129583.611849:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2700 committed 00000004:00080000:1.0:1746129583.611851:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2691 committed 00000004:00080000:1.0:1746129583.611852:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2699 committed 00000004:00080000:1.0:1746129583.611854:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2690 committed 00000004:00080000:1.0:1746129583.611855:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2698 committed 00000004:00080000:1.0:1746129583.611857:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2697 committed 00000004:00080000:1.0:1746129583.611858:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2696 committed 00000004:00080000:1.0:1746129583.611860:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2689 committed 00000004:00080000:1.0:1746129583.611861:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2688 committed 00000004:00080000:1.0:1746129583.611863:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2695 committed 00000004:00080000:1.0:1746129583.611864:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2694 committed 00000004:00080000:1.0:1746129583.611866:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2687 committed 00000001:00080000:1.0:1746129583.611873:0:14619:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945522 is committed 00000100:00100000:1.0:1746129583.612062:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129bc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1830948737653248:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129583.612133:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129583.612177:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129bc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1830948737653760:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129583.612192:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129583.612216:0:3303:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1746129583.612220:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129bc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1830948737653120:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129583.612232:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129583.612242:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129bc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1830948737653632:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129583.612251:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129583.612268:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129bc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737653376:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129583.612285:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129583.612323:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129bc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737653888:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129583.612342:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129583.612356:0:3300:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1746129583.612359:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129bc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737653504:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129583.612376:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129583.612387:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fa25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737654016:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129583.612401:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129583.612426:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737653248 00000100:00100000:1.0:1746129583.612436:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737653248 00000100:00100000:1.0:1746129583.612483:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737653760 00000100:00100000:1.0:1746129583.612485:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737653760 00000100:00100000:1.0:1746129583.612496:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737653120 00000100:00100000:1.0:1746129583.612497:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737653120 00000100:00100000:1.0:1746129583.612505:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737653632 00000100:00100000:1.0:1746129583.612507:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737653632 00000100:00100000:1.0:1746129583.612514:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737653376 00000100:00100000:1.0:1746129583.612515:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737653376 00000100:00100000:1.0:1746129583.612520:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737653888 00000100:00100000:1.0:1746129583.612522:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737653888 00000100:00100000:1.0:1746129583.612526:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737653504 00000100:00100000:1.0:1746129583.612528:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737653504 00000100:00100000:1.0:1746129583.612532:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737654016 00000100:00100000:1.0:1746129583.612534:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737654016 00000100:00100000:1.0:1746129583.612543:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16995 00000100:00100000:1.0:1746129583.612549:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+36:3303:x1830948737653248:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129583.612769:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+37:3303:x1830948737653248:12345-0@lo:2:osp-syn-1-0.0 Request processed in 220us (636us total) trans 17179874218 rc 0/0 00000100:00100000:1.0:1746129583.612776:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16995 00000100:00100000:1.0:1746129583.612791:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16996 00000100:00100000:1.0:1746129583.612795:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+36:3303:x1830948737653760:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129583.612875:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+37:3303:x1830948737653760:12345-0@lo:2:osp-syn-1-0.0 Request processed in 80us (682us total) trans 17179874219 rc 0/0 00000100:00100000:1.0:1746129583.612881:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16996 00000100:00100000:1.0:1746129583.612890:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16997 00000100:00100000:1.0:1746129583.612894:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+36:3303:x1830948737653120:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129583.612974:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+37:3303:x1830948737653120:12345-0@lo:2:osp-syn-1-0.0 Request processed in 79us (740us total) trans 17179874220 rc 0/0 00000100:00100000:1.0:1746129583.612979:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16997 00000100:00100000:1.0:1746129583.612987:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16998 00000100:00100000:1.0:1746129583.612990:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+36:3303:x1830948737653632:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129583.613052:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+37:3303:x1830948737653632:12345-0@lo:2:osp-syn-1-0.0 Request processed in 61us (799us total) trans 17179874221 rc 0/0 00000100:00100000:1.0:1746129583.613057:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16998 00000100:00100000:1.0:1746129583.613065:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16999 00000100:00100000:1.0:1746129583.613069:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+36:3300:x1830948737653376:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746129583.613136:0:7148:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3f5:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746129583.613139:0:7148:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f5:0x0] updating lvb mtime from disk: 1746129584 -> 1746129584 00002000:00010000:1.0:1746129583.613142:0:7148:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f5:0x0] updating lvb atime from disk: 1746129583 -> 1746129583 00002000:00010000:1.0:1746129583.613144:0:7148:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f5:0x0] updating lvb ctime from disk: 1746129584 -> 1746129584 00002000:00010000:1.0:1746129583.613146:0:7148:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f5:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:1.0:1746129583.613165:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+37:3300:x1830948737653376:12345-0@lo:2:osp-syn-1-0.0 Request processed in 96us (879us total) trans 17179874222 rc 0/0 00000100:00100000:1.0:1746129583.613170:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16999 00000100:00100000:1.0:1746129583.613178:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17000 00000100:00100000:1.0:1746129583.613182:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+36:3300:x1830948737653888:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129583.613265:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+37:3300:x1830948737653888:12345-0@lo:2:osp-syn-1-0.0 Request processed in 81us (921us total) trans 17179874223 rc 0/0 00000100:00100000:1.0:1746129583.613270:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17000 00000100:00100000:1.0:1746129583.613278:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17001 00000100:00100000:1.0:1746129583.613282:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c29d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+36:3300:x1830948737653504:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746129583.613369:0:7148:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746129583.613372:0:7148:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb mtime from disk: 1746129523 -> 1746129523 00002000:00010000:1.0:1746129583.613374:0:7148:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb atime from disk: 1746129523 -> 1746129523 00002000:00010000:1.0:1746129583.613375:0:7148:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb ctime from disk: 1746129524 -> 1746129524 00002000:00010000:1.0:1746129583.613377:0:7148:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1746129583.613394:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c29d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+37:3300:x1830948737653504:12345-0@lo:2:osp-syn-1-0.0 Request processed in 112us (1017us total) trans 17179874224 rc 0/0 00000100:00100000:1.0:1746129583.613399:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17001 00000100:00100000:1.0:1746129583.613526:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17002 00000100:00100000:1.0:1746129583.613531:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+36:3300:x1830948737654016:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129583.613591:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+37:3300:x1830948737654016:12345-0@lo:2:osp-syn-1-0.0 Request processed in 60us (1189us total) trans 17179874225 rc 0/0 00000100:00100000:1.0:1746129583.613595:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17002 00000100:00080000:1.0:1746129583.613617:0:7097:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:1.0:1746129583.613646:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880129bc1180/2, rc 0, transno 17179874224 00000100:00100000:1.0:1746129583.613650:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129bc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737653504:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746129583.613656:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fa25880/2, rc 0, transno 17179874225 00000100:00100000:1.0:1746129583.613658:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fa25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737654016:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746129583.613664:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880129bc1c00/2, rc 0, transno 17179874222 00000100:00100000:1.0:1746129583.613666:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129bc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737653376:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746129583.613671:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880129bc0380/2, rc 0, transno 17179874223 00000100:00100000:1.0:1746129583.613673:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129bc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737653888:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746129583.613684:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880129bc0e00/2, rc 0, transno 17179874220 00000100:00100000:1.0:1746129583.613686:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129bc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1830948737653120:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746129583.613690:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880129bc3100/2, rc 0, transno 17179874221 00000100:00100000:1.0:1746129583.613692:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129bc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1830948737653632:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746129583.613697:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880129bc1f80/2, rc 0, transno 17179874218 00000100:00100000:1.0:1746129583.613699:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129bc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1830948737653248:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746129583.613703:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880129bc0000/2, rc 0, transno 17179874219 00000100:00100000:1.0:1746129583.613705:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129bc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1830948737653760:0@lo:2:osp-syn-1-0.0 00000004:00010000:2.0:1746129583.613965:0:14548:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880129bc1500 reply state ffff88009064b000 transno 8589945525 ns: mdt-lustre-MDT0000_UUID lock: ffff88008fa78000/0x40a459093b06c0b8 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14548 initiator: MDT0 00000100:00100000:2.0:1746129583.613976:0:14548:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1746129583.614055:0:14548:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1746129583.614068:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129bc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:068dab75-d300-4ead-a742-d14572ad1e50+8:301:x1830948734494336:12345-192.168.202.4@tcp:36:lfs.0 Request processed in 40621us (43132us total) trans 8589945525 rc 0/0 00000100:00100000:2.0:1746129583.614075:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11390 00010000:00010000:3.0:1746129583.614722:0:3287:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fa78000/0x40a459093b06c0b8 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746129583.614731:0:3287:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fa78000/0x40a459093b06c0b8 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746129583.614738:0:3287:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008fa78000/0x40a459093b06c0b8 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746129583.614743:0:3287:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008fa78000 already unused, calling callback (ffffffffa136e690) 00010000:00010000:3.0:1746129583.614748:0:3287:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fa78000/0x40a459093b06c0b8 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746129583.614754:0:3287:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fa78000/0x40a459093b06c0b8 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746129583.614772:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009cffe100) 00010000:00010000:3.0:1746129583.614775:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746129583.614781:0:3287:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f84d000/0x40a459093b06c0bf lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f226dd expref: 6 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129583.614791:0:3287:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f84d000/0x40a459093b06c0bf lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f226dd expref: 6 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129583.614800:0:3287:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f84d000/0x40a459093b06c0bf lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f226dd expref: 6 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129583.614824:0:3287:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f84d000/0x40a459093b06c0bf lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f226dd expref: 6 pid: 14549 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129583.614834:0:3287:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094065f80 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_001:lustre-MDT0000_UUID:3287:1830948737655168:192.168.202.4@tcp:105: 00000100:00100000:3.0:1746129583.614891:0:3287:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009518be40 going to sleep for 11 seconds 00000100:00100000:0.0:1746129583.615089:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094067480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1830948737654272:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129583.615123:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129583.615144:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094064700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1830948737654784:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129583.615158:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129583.615171:0:3303:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1746129583.615176:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094065c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1830948737654144:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129583.615189:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129583.615198:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094067800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1830948737654656:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129583.615222:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129583.615240:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737654272 00000100:00100000:0.0:1746129583.615246:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737654272 00000100:00100000:0.0:1746129583.615276:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737654784 00000100:00100000:0.0:1746129583.615278:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737654784 00000100:00100000:0.0:1746129583.615287:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737654144 00000100:00100000:0.0:1746129583.615289:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737654144 00000100:00100000:0.0:1746129583.615319:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737654656 00000100:00100000:0.0:1746129583.615321:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737654656 00000100:00100000:0.0:1746129583.615332:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17003 00000100:00100000:0.0:1746129583.615338:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135725180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+35:3303:x1830948737654272:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129583.615516:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135725180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+36:3303:x1830948737654272:12345-0@lo:2:osp-syn-0-0.0 Request processed in 177us (392us total) trans 21474841468 rc 0/0 00000100:00100000:0.0:1746129583.615522:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17003 00000100:00100000:0.0:1746129583.615534:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17004 00000100:00100000:0.0:1746129583.615538:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135725c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+35:3303:x1830948737654784:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129583.615614:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135725c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+36:3303:x1830948737654784:12345-0@lo:2:osp-syn-0-0.0 Request processed in 75us (455us total) trans 21474841469 rc 0/0 00000100:00100000:0.0:1746129583.615620:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17004 00000100:00100000:0.0:1746129583.615629:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17005 00000100:00100000:0.0:1746129583.615633:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135724a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+35:3303:x1830948737654144:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129583.615714:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135724a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+36:3303:x1830948737654144:12345-0@lo:2:osp-syn-0-0.0 Request processed in 80us (523us total) trans 21474841470 rc 0/0 00000100:00100000:0.0:1746129583.615719:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17005 00000100:00100000:0.0:1746129583.615728:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17006 00000100:00100000:0.0:1746129583.615732:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135724000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+35:3303:x1830948737654656:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129583.615801:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135724000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+36:3303:x1830948737654656:12345-0@lo:2:osp-syn-0-0.0 Request processed in 69us (577us total) trans 21474841471 rc 0/0 00000100:00100000:0.0:1746129583.615806:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17006 00000004:00080000:0.0:1746129583.615846:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094065c00/2, rc 0, transno 21474841470 00000100:00100000:0.0:1746129583.615854:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094065c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1830948737654144:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129583.615861:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094067800/2, rc 0, transno 21474841471 00000100:00100000:0.0:1746129583.615863:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094067800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1830948737654656:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129583.615869:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094067480/2, rc 0, transno 21474841468 00000100:00100000:0.0:1746129583.615872:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094067480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1830948737654272:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129583.615876:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094064700/2, rc 0, transno 21474841469 00000100:00100000:0.0:1746129583.615879:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094064700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1830948737654784:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129583.615909:0:3303:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1746129583.615913:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135724700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1830948737655296:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129583.615929:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129583.615945:0:20577:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737655296 00000100:00100000:0.0:1746129583.615948:0:20577:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737655296 00000100:00100000:0.0:1746129583.615961:0:20577:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17007 00000100:00100000:0.0:1746129583.615964:0:20577:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135726a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+36:3303:x1830948737655296:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129583.616045:0:20577:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135726a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+37:3303:x1830948737655296:12345-0@lo:2:osp-syn-0-0.0 Request processed in 79us (115us total) trans 21474841472 rc 0/0 00000100:00100000:0.0:1746129583.616050:0:20577:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17007 00000004:00080000:0.0:1746129583.616069:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135724700/2, rc 0, transno 21474841472 00000100:00100000:0.0:1746129583.616073:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135724700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1830948737655296:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129583.616343:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094066300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737654528:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129583.616368:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129583.616382:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094064e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737655040:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129583.616397:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129583.616408:0:3301:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1746129583.616412:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094065180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737654400:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129583.616425:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129583.616433:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094065880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737654912:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129583.616446:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129583.616464:0:8410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737654528 00000100:00100000:2.0:1746129583.616467:0:8410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737654528 00000100:00100000:2.0:1746129583.616482:0:8410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737655040 00000100:00100000:2.0:1746129583.616484:0:8410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737655040 00000100:00100000:2.0:1746129583.616492:0:8410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737654400 00000100:00100000:2.0:1746129583.616494:0:8410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737654400 00000100:00100000:2.0:1746129583.616500:0:8410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737654912 00000100:00100000:2.0:1746129583.616502:0:8410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737654912 00000100:00100000:2.0:1746129583.616513:0:8410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17008 00000100:00100000:2.0:1746129583.616517:0:8410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e957b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+40:3301:x1830948737654528:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129583.616611:0:8410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e957b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+41:3301:x1830948737654528:12345-0@lo:2:osp-syn-0-0.0 Request processed in 93us (242us total) trans 21474841473 rc 0/0 00000100:00100000:2.0:1746129583.616616:0:8410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17008 00000100:00100000:2.0:1746129583.616626:0:8410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17009 00000100:00100000:2.0:1746129583.616630:0:8410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e955c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+40:3301:x1830948737655040:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129583.616698:0:8410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e955c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+41:3301:x1830948737655040:12345-0@lo:2:osp-syn-0-0.0 Request processed in 68us (299us total) trans 21474841474 rc 0/0 00000100:00100000:2.0:1746129583.616703:0:8410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17009 00000100:00100000:2.0:1746129583.616711:0:8410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17010 00000100:00100000:2.0:1746129583.616715:0:8410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e954700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+40:3301:x1830948737654400:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129583.616795:0:8410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e954700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+41:3301:x1830948737654400:12345-0@lo:2:osp-syn-0-0.0 Request processed in 78us (367us total) trans 21474841475 rc 0/0 00000100:00100000:2.0:1746129583.616799:0:8410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17010 00000100:00100000:2.0:1746129583.616807:0:8410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17011 00000100:00100000:2.0:1746129583.616811:0:8410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e955500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+40:3301:x1830948737654912:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746129583.616873:0:8410:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746129583.616876:0:8410:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1746129583.616878:0:8410:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746129583.616880:0:8410:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1746129583.616881:0:8410:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1746129583.616898:0:8410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e955500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+41:3301:x1830948737654912:12345-0@lo:2:osp-syn-0-0.0 Request processed in 86us (451us total) trans 21474841476 rc 0/0 00000100:00100000:2.0:1746129583.616902:0:8410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17011 00000004:00080000:2.0:1746129583.616927:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094065180/2, rc 0, transno 21474841475 00000100:00100000:2.0:1746129583.616930:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094065180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737654400:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746129583.616937:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094065880/2, rc 0, transno 21474841476 00000100:00100000:2.0:1746129583.616939:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094065880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737654912:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746129583.616944:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094066300/2, rc 0, transno 21474841473 00000100:00100000:2.0:1746129583.616946:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094066300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737654528:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746129583.616952:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094064e00/2, rc 0, transno 21474841474 00000100:00100000:2.0:1746129583.616954:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094064e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737655040:0@lo:2:osp-syn-0-0.0 00000100:00080000:1.0:1746129583.619436:0:7097:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1746129583.619542:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129583.619628:0:3287:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094065f80 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_001:lustre-MDT0000_UUID:3287:1830948737655168:192.168.202.4@tcp:105: 00010000:00010000:3.0:1746129583.619655:0:3287:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008fa78000/0x40a459093b06c0b8 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746129583.619664:0:3287:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fa78000/0x40a459093b06c0b8 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 14548 initiator: MDT0 00000100:00100000:2.0:1746129583.619916:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734495872 00000100:00100000:2.0:1746129583.619923:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734495872 00000100:00100000:2.0:1746129583.620136:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11392 00000100:00100000:2.0:1746129583.620144:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094064380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:068dab75-d300-4ead-a742-d14572ad1e50+7:301:x1830948734495872:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:2.0:1746129583.620164:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129583.620179:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe03800/0x40a459093b06c0c6 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f226e4 expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129583.620249:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe03800/0x40a459093b06c0c6 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f226e4 expref: 8 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129583.620266:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe03800/0x40a459093b06c0c6 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f226e4 expref: 8 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129583.620283:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009cffe100) 00010000:00010000:2.0:1746129583.620286:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746129583.620289:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe03800, rc 0) 00000100:00100000:2.0:1746129583.620893:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094064380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:068dab75-d300-4ead-a742-d14572ad1e50+8:301:x1830948734495872:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 746us (1354us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129583.620899:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11392 00000100:00100000:0.0:1746129583.622262:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129583.623933:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734496000 00000100:00100000:2.0:1746129583.623948:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734496000 00000100:00100000:2.0:1746129583.624010:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4866 00000100:00100000:2.0:1746129583.624020:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934c8c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+7:32765:x1830948734496000:12345-192.168.202.4@tcp:49:cat.0 00000100:00100000:2.0:1746129583.624164:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934c8c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+7:32765:x1830948734496000:12345-192.168.202.4@tcp:49:cat.0 Request processed in 145us (1907us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129583.624171:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4866 00000100:00100000:2.0:1746129583.629747:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129583.629970:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129583.630039:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734496128 00000100:00100000:0.0:1746129583.630050:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734496128 00000100:00100000:1.0:1746129583.630585:0:8411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734496256 00000100:00100000:1.0:1746129583.630589:0:8411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734496256 00000100:00100000:1.0:1746129583.630626:0:8411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 17012 00000100:00100000:1.0:1746129583.630633:0:8411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e957800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+28:32765:x1830948734496256:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129583.630651:0:8411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129583.630669:0:8411:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094bb3400/0x40a459093b06c0cd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f226f2 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746129583.630694:0:8411:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3ef:0x0] initial LVB size: 5146336, mtime: 0x6813d2b0, atime: 0x6813d2b0, ctime: 0x6813d2b0, blocks: 0x1791 00010000:00010000:1.0:1746129583.630714:0:8411:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129583.630716:0:8411:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129583.630723:0:8411:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094bb3400/0x40a459093b06c0cd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 4194304->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f226f2 expref: 29 pid: 8411 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129583.630742:0:8411:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094bb3400/0x40a459093b06c0cd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 4194304->5242879) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f226f2 expref: 29 pid: 8411 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129583.630751:0:8411:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094bb3400, rc 0) 00000100:00100000:1.0:1746129583.630798:0:8411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e957800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+29:32765:x1830948734496256:12345-192.168.202.4@tcp:101:cat.0 Request processed in 166us (828us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129583.630804:0:8411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 17012 00000100:00100000:0.0:1746129583.630891:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11393 00000100:00100000:0.0:1746129583.630897:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e954000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:068dab75-d300-4ead-a742-d14572ad1e50+8:301:x1830948734496128:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:0.0:1746129583.630906:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129583.630917:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd19c00/0x40a459093b06c0d4 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f226eb expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129583.630991:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd19e00/0x40a459093b06c0db lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746129583.631006:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd19e00/0x40a459093b06c0db lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746129583.631015:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd19e00/0x40a459093b06c0db lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000004:00200000:0.0:1746129583.631040:0:14548:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00000004:00200000:0.0:1746129583.631044:0:14548:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746129583.631060:0:14548:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd19e00/0x40a459093b06c0db lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746129583.631082:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd19c00/0x40a459093b06c0d4 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f226eb expref: 10 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129583.631094:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd19e00/0x40a459093b06c0db lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f226eb expref: 9 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129583.631100:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009cffe100) 00010000:00010000:0.0:1746129583.631102:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746129583.631104:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd19e00, rc 0) 00000100:00100000:0.0:1746129583.631140:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e954000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:068dab75-d300-4ead-a742-d14572ad1e50+9:301:x1830948734496128:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 242us (1405us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129583.631145:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11393 00000100:00100000:0.0:1746129583.636938:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129583.636977:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129583.637002:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129583.637036:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129583.637063:0:4699:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734496512 00000100:00100000:0.0:1746129583.637070:0:4699:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734496512 00000100:00100000:0.0:1746129583.637109:0:4699:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734496768 00000100:00100000:0.0:1746129583.637111:0:4699:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734496768 00000100:00100000:0.0:1746129583.643746:0:4699:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734496384 00000100:00100000:0.0:1746129583.643765:0:4699:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734496384 00000100:00100000:1.0:1746129583.643889:0:8411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734496640 00000100:00100000:1.0:1746129583.643894:0:8411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734496640 00000100:00100000:1.0:1746129583.643928:0:8411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 17013 00000100:00100000:1.0:1746129583.643936:0:8411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135727800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+29:1962:x1830948734496512:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129583.643957:0:8411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129583.643982:0:8411:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f84c000/0x40a459093b06c0e2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f22700 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746129583.644009:0:8411:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3f3:0x0] initial LVB size: 2097152, mtime: 0x6813d2b0, atime: 0x6813d2ae, ctime: 0x6813d2b0, blocks: 0x821 00010000:00010000:1.0:1746129583.644033:0:8411:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129583.644036:0:8411:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129583.644046:0:8411:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f84c000/0x40a459093b06c0e2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22700 expref: 30 pid: 8411 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129583.644062:0:8411:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f84c000/0x40a459093b06c0e2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22700 expref: 30 pid: 8411 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129583.644073:0:8411:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f84c000, rc 0) 00000100:00100000:2.0:1746129583.644211:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 17014 00000100:00100000:2.0:1746129583.644220:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135727b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+30:1962:x1830948734496768:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129583.644229:0:4385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129583.644242:0:4385:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fe02e00/0x40a459093b06c0e9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2270e expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746129583.644261:0:4385:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3ee:0x0] initial LVB size: 2097152, mtime: 0x6813d2af, atime: 0x6813d2af, ctime: 0x6813d2af, blocks: 0x81f 00010000:00010000:2.0:1746129583.644272:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129583.644273:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129583.644278:0:4385:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fe02e00/0x40a459093b06c0e9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2270e expref: 31 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129583.644287:0:4385:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fe02e00/0x40a459093b06c0e9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2270e expref: 31 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129583.644316:0:4385:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe02e00, rc 0) 00000100:00100000:0.0:1746129583.644380:0:4699:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 17015 00000100:00100000:0.0:1746129583.644387:0:4699:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135725f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+31:1962:x1830948734496384:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129583.644395:0:4699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129583.644403:0:4699:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fd19600/0x40a459093b06c0f0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f226f9 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746129583.644415:0:4699:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3ec:0x0] initial LVB size: 1048576, mtime: 0x6813d2b0, atime: 0x6813d2af, ctime: 0x6813d2b0, blocks: 0x819 00010000:00010000:0.0:1746129583.644423:0:4699:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129583.644424:0:4699:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129583.644428:0:4699:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd19600/0x40a459093b06c0f0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f226f9 expref: 32 pid: 4699 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129583.644437:0:4699:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fd19600/0x40a459093b06c0f0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f226f9 expref: 32 pid: 4699 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129583.644444:0:4699:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd19600, rc 0) 00000100:00100000:3.0:1746129583.646231:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 17016 00000100:00100000:3.0:1746129583.646249:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132c24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+30:1962:x1830948734496640:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129583.646267:0:7149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129583.646288:0:7149:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f5e4600/0x40a459093b06c0f7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f22707 expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746129583.646325:0:7149:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3f4:0x0] initial LVB size: 2097152, mtime: 0x6813d2af, atime: 0x6813d2af, ctime: 0x6813d2af, blocks: 0x821 00010000:00010000:3.0:1746129583.646342:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129583.646344:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129583.646351:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f5e4600/0x40a459093b06c0f7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22707 expref: 31 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129583.646368:0:7149:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f5e4600/0x40a459093b06c0f7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22707 expref: 31 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129583.646377:0:7149:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f5e4600, rc 0) 00000100:00100000:1.0:1746129583.646468:0:8411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135727800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+31:1962:x1830948734496512:12345-192.168.202.4@tcp:101:cat.0 Request processed in 2530us (9540us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129583.646475:0:8411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 17013 00000100:00100000:2.0:1746129583.646605:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135727b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+32:1962:x1830948734496768:12345-192.168.202.4@tcp:101:cat.0 Request processed in 2385us (9625us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129583.646610:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 17014 00000100:00100000:0.0:1746129583.646785:0:4699:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135725f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+31:1962:x1830948734496384:12345-192.168.202.4@tcp:101:cat.0 Request processed in 2397us (9781us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129583.646790:0:4699:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 17015 00000100:00100000:0.0:1746129583.646912:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129583.646970:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129583.647002:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129583.647011:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129583.647019:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129583.647032:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129583.647048:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129583.647061:0:4699:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734496896 00000100:00100000:0.0:1746129583.647068:0:4699:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734496896 00000100:00100000:0.0:1746129583.647089:0:4699:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734497152 00000100:00100000:0.0:1746129583.647091:0:4699:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734497152 00000100:00100000:0.0:1746129583.647101:0:4699:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734497024 00000100:00100000:0.0:1746129583.647103:0:4699:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734497024 00000100:00100000:0.0:1746129583.647112:0:4699:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734497280 00000100:00100000:0.0:1746129583.647114:0:4699:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734497280 00000100:00100000:0.0:1746129583.647123:0:4699:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734497408 00000100:00100000:0.0:1746129583.647125:0:4699:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734497408 00000100:00100000:0.0:1746129583.647133:0:4699:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734497536 00000100:00100000:0.0:1746129583.647135:0:4699:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734497536 00000100:00100000:0.0:1746129583.647143:0:4699:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 17017 00000100:00100000:0.0:1746129583.647147:0:4699:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132c24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:068dab75-d300-4ead-a742-d14572ad1e50+10:1963:x1830948734496896:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:0.0:1746129583.647155:0:4699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129583.647165:0:4699:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fd18c00/0x40a459093b06c0fe lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f22715 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129583.647177:0:4699:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129583.647179:0:4699:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129583.647183:0:4699:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd18c00/0x40a459093b06c0fe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22715 expref: 11 pid: 4699 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129583.647192:0:4699:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fd18c00/0x40a459093b06c0fe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22715 expref: 11 pid: 4699 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129583.647209:0:4699:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd18c00, rc 0) 00000100:00100000:0.0:1746129583.647228:0:4699:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132c24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:068dab75-d300-4ead-a742-d14572ad1e50+11:1963:x1830948734496896:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 80us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129583.647234:0:4699:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 17017 00000100:00100000:0.0:1746129583.647243:0:4699:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 17018 00000100:00100000:0.0:1746129583.647247:0:4699:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132c24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:068dab75-d300-4ead-a742-d14572ad1e50+10:1963:x1830948734497152:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:0.0:1746129583.647253:0:4699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129583.647259:0:4699:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fd19400/0x40a459093b06c105 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f22723 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129583.647269:0:4699:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129583.647270:0:4699:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129583.647274:0:4699:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fd19400/0x40a459093b06c105 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22723 expref: 11 pid: 4699 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129583.647282:0:4699:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fd19400/0x40a459093b06c105 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22723 expref: 11 pid: 4699 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129583.647289:0:4699:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd19400, rc 0) 00000100:00100000:0.0:1746129583.647320:0:4699:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132c24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:068dab75-d300-4ead-a742-d14572ad1e50+11:1963:x1830948734497152:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 72us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129583.647325:0:4699:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 17018 00000100:00100000:0.0:1746129583.647334:0:4699:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 17019 00000100:00100000:0.0:1746129583.647338:0:4699:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132c25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:068dab75-d300-4ead-a742-d14572ad1e50+10:1963:x1830948734497024:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:0.0:1746129583.647344:0:4699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129583.647350:0:4699:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fd19200/0x40a459093b06c10c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2271c expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129583.647361:0:4699:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129583.647362:0:4699:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129583.647366:0:4699:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fd19200/0x40a459093b06c10c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2271c expref: 11 pid: 4699 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129583.647374:0:4699:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fd19200/0x40a459093b06c10c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2271c expref: 11 pid: 4699 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129583.647380:0:4699:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd19200, rc 0) 00000100:00100000:0.0:1746129583.647394:0:4699:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132c25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:068dab75-d300-4ead-a742-d14572ad1e50+11:1963:x1830948734497024:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 55us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129583.647398:0:4699:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 17019 00000100:00100000:0.0:1746129583.647407:0:4699:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 17020 00000100:00100000:0.0:1746129583.647411:0:4699:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132c25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:068dab75-d300-4ead-a742-d14572ad1e50+10:1963:x1830948734497280:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:0.0:1746129583.647416:0:4699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129583.647421:0:4699:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fd19000/0x40a459093b06c113 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2272a expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129583.647431:0:4699:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129583.647432:0:4699:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129583.647435:0:4699:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd19000/0x40a459093b06c113 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2272a expref: 11 pid: 4699 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129583.647441:0:4699:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fd19000/0x40a459093b06c113 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2272a expref: 11 pid: 4699 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129583.647447:0:4699:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd19000, rc 0) 00000100:00100000:0.0:1746129583.647461:0:4699:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132c25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:068dab75-d300-4ead-a742-d14572ad1e50+11:1963:x1830948734497280:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 50us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129583.647469:0:4699:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 17020 00000100:00100000:0.0:1746129583.647478:0:4699:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 17021 00000100:00100000:0.0:1746129583.647482:0:4699:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132c25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:068dab75-d300-4ead-a742-d14572ad1e50+10:1963:x1830948734497408:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:0.0:1746129583.647487:0:4699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129583.647494:0:4699:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fd18e00/0x40a459093b06c11a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f22731 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129583.647504:0:4699:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129583.647505:0:4699:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129583.647508:0:4699:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd18e00/0x40a459093b06c11a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22731 expref: 11 pid: 4699 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129583.647515:0:4699:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fd18e00/0x40a459093b06c11a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22731 expref: 11 pid: 4699 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129583.647522:0:4699:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd18e00, rc 0) 00000100:00100000:0.0:1746129583.647535:0:4699:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132c25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:068dab75-d300-4ead-a742-d14572ad1e50+11:1963:x1830948734497408:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 53us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129583.647540:0:4699:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 17021 00000100:00100000:0.0:1746129583.647549:0:4699:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 17022 00000100:00100000:0.0:1746129583.647553:0:4699:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132c25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:068dab75-d300-4ead-a742-d14572ad1e50+10:1962:x1830948734497536:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:0.0:1746129583.647558:0:4699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129583.647565:0:4699:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fd18800/0x40a459093b06c121 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f22738 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129583.647576:0:4699:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129583.647577:0:4699:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129583.647580:0:4699:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fd18800/0x40a459093b06c121 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22738 expref: 11 pid: 4699 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129583.647587:0:4699:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fd18800/0x40a459093b06c121 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22738 expref: 11 pid: 4699 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129583.647592:0:4699:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd18800, rc 0) 00000100:00100000:0.0:1746129583.647604:0:4699:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132c25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:068dab75-d300-4ead-a742-d14572ad1e50+11:1962:x1830948734497536:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 51us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129583.647607:0:4699:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 17022 00000100:00100000:3.0:1746129583.647785:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132c24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+30:1962:x1830948734496640:12345-192.168.202.4@tcp:101:cat.0 Request processed in 1543us (10748us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129583.647790:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 17016 00000100:00100000:1.0:1746129583.647856:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734497792 00000100:00100000:1.0:1746129583.647859:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734497792 00000100:00100000:1.0:1746129583.647887:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11394 00000100:00100000:1.0:1746129583.647892:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132c24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+7:306:x1830948734497792:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:1.0:1746129583.647900:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129583.647911:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f84c400/0x40a459093b06c128 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2273f expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129583.648015:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f84c600/0x40a459093b06c12f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129583.648026:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f84c600/0x40a459093b06c12f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129583.648036:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f84c600/0x40a459093b06c12f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129583.648046:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f84c800/0x40a459093b06c136 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129583.648051:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f84c800/0x40a459093b06c136 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129583.648056:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f84c800/0x40a459093b06c136 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129583.648163:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f84ca00/0x40a459093b06c13d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129583.648172:0:14549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f5e5400/0x40a459093b06c056 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f226ac expref: 8 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129583.648181:0:14549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f84ca00/0x40a459093b06c13d lrc: 4/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129583.648229:0:14549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008f5e5400/0x40a459093b06c056 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f226ac expref: 8 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129583.648240:0:14549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f5e5400/0x40a459093b06c056 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f226ac expref: 8 pid: 14548 timeout: 938 lvb_type: 0 00000100:00100000:1.0:1746129583.648252:0:14549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fa26680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830948737655424:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129583.648328:0:14549:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa23ba80 going to sleep for 11 seconds 00000100:00100000:1.0:1746129583.651741:0:14549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fa26680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14549:1830948737655424:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129583.651767:0:14549:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009f84ca00/0x40a459093b06c13d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000100:00100000:0.0:1746129583.657501:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129583.657625:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129583.657879:0:8417:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734498560 00000100:00100000:2.0:1746129583.657890:0:8417:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734498560 00002000:00100000:2.0:1746129583.657943:0:8417:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3ef:0x0] (4194304->5148671) req@ffff880132c27b80 x1830948734498560/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:324/0 lens 488/0 e 0 to 0 dl 1746129594 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129583.657954:0:8417:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880132c27b80 with x1830948734498560 ext(4194304->5148671) 00002000:00010000:2.0:1746129583.657960:0:8417:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880132c27b80 00000100:00100000:2.0:1746129583.657996:0:8417:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8259 00000100:00100000:2.0:1746129583.658003:0:8417:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132c27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+31:1961:x1830948734498560:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:1.0:1746129583.658288:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734497920 00000100:00100000:1.0:1746129583.658317:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734497920 00010000:00010000:1.0:1746129583.658342:0:7087:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f5e5400/0x40a459093b06c056 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f226ac expref: 9 pid: 14548 timeout: 938 lvb_type: 0 00000100:00100000:0.0:1746129583.658366:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129583.658398:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129583.658414:0:31522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734498432 00000100:00100000:0.0:1746129583.658418:0:31522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734498432 00000100:00100000:1.0:1746129583.661178:0:7087:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8821 00000100:00100000:1.0:1746129583.661195:0:7087:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132c27480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:068dab75-d300-4ead-a742-d14572ad1e50+9:1963:x1830948734497920:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129583.661224:0:7087:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129583.661235:0:7087:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008f5e5400/0x40a459093b06c056 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f226ac expref: 9 pid: 14548 timeout: 938 lvb_type: 0 00010000:00010000:1.0:1746129583.661250:0:7087:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008f5e5400/0x40a459093b06c056 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f226ac expref: 9 pid: 14548 timeout: 938 lvb_type: 0 00010000:00010000:1.0:1746129583.661275:0:7087:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f5e5400/0x40a459093b06c056 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f226ac expref: 9 pid: 14548 timeout: 938 lvb_type: 0 00010000:00010000:1.0:1746129583.661307:0:7087:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009cffe100) 00010000:00010000:1.0:1746129583.661311:0:7087:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f84ca00/0x40a459093b06c13d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129583.661320:0:7087:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f84ca00/0x40a459093b06c13d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129583.661326:0:7087:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f84ca00/0x40a459093b06c13d lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129583.661347:0:7087:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129583.661386:0:7087:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132c27480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:068dab75-d300-4ead-a742-d14572ad1e50+8:1963:x1830948734497920:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 198us (3897us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129583.661393:0:7087:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8821 00000100:00100000:0.0:1746129583.661491:0:31522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734498688 00000100:00100000:0.0:1746129583.661500:0:31522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734498688 00000100:00100000:0.0:1746129583.661540:0:31522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8260 00000100:00100000:0.0:1746129583.661547:0:31522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132c25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:068dab75-d300-4ead-a742-d14572ad1e50+11:1963:x1830948734498432:12345-192.168.202.4@tcp:3:lfs.0 00010000:00010000:0.0:1746129583.661575:0:31522:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009fd19c00/0x40a459093b06c144 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31522 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129583.661587:0:31522:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129583.661589:0:31522:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129583.661594:0:31522:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fd19c00/0x40a459093b06c144 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31522 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129583.661609:0:31522:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fd19c00/0x40a459093b06c144 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31522 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129583.661828:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8261 00000100:00100000:3.0:1746129583.661836:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132c26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:068dab75-d300-4ead-a742-d14572ad1e50+11:1963:x1830948734498688:12345-192.168.202.4@tcp:3:lfs.0 00010000:00010000:3.0:1746129583.661857:0:25745:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88008f5e4800/0x40a459093b06c14b lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25745 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129583.661866:0:25745:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129583.661867:0:25745:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129583.661870:0:25745:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f5e4800/0x40a459093b06c14b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25745 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129583.661877:0:25745:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f5e4800/0x40a459093b06c14b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25745 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129583.663012:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129583.663875:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129583.663961:0:31520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734499072 00000100:00100000:1.0:1746129583.663981:0:31520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734499072 00000100:00100000:1.0:1746129583.664045:0:31520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734499200 00000100:00100000:1.0:1746129583.664048:0:31520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734499200 00000100:00100000:1.0:1746129583.664069:0:31520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8262 00000100:00100000:1.0:1746129583.664077:0:31520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132c26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:068dab75-d300-4ead-a742-d14572ad1e50+13:1963:x1830948734499072:12345-192.168.202.4@tcp:3:lfs.0 00010000:00010000:1.0:1746129583.664113:0:31520:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009d106600/0x40a459093b06c152 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129583.664127:0:31520:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129583.664129:0:31520:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129583.664133:0:31520:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d106600/0x40a459093b06c152 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129583.664145:0:31520:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d106600/0x40a459093b06c152 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31520 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129583.665513:0:31518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8263 00000100:00100000:1.0:1746129583.665525:0:31518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132c24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:068dab75-d300-4ead-a742-d14572ad1e50+13:1963:x1830948734499200:12345-192.168.202.4@tcp:3:lfs.0 00010000:00010000:1.0:1746129583.665560:0:31518:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009f84ce00/0x40a459093b06c159 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129583.665570:0:31518:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129583.665572:0:31518:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129583.665575:0:31518:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f84ce00/0x40a459093b06c159 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129583.665585:0:31518:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f84ce00/0x40a459093b06c159 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129583.666998:0:14549:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f84ca00/0x40a459093b06c13d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129583.667010:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f84ca00/0x40a459093b06c13d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00200000:1.0:1746129583.667027:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:1.0:1746129583.667186:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f84ca00/0x40a459093b06c13d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129583.667192:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f84ca00/0x40a459093b06c13d lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129583.667215:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f84ca00/0x40a459093b06c13d lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129583.667220:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f84ca00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:1.0:1746129583.667224:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f84ca00/0x40a459093b06c13d lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129583.667230:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f84ca00/0x40a459093b06c13d lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129583.667246:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009cffe100) 00010000:00010000:1.0:1746129583.667249:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746129583.667252:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f84ca00/0x40a459093b06c13d lrc: 2/0,0 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129583.667256:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f84ca00/0x40a459093b06c13d lrc: 0/0,0 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129583.667274:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f84c600/0x40a459093b06c12f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129583.667278:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f84c600/0x40a459093b06c12f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129583.667282:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f84c600/0x40a459093b06c12f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129583.667286:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f84c600 already unused, calling callback (ffffffffa136e690) 00010000:00010000:1.0:1746129583.667287:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f84c600/0x40a459093b06c12f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129583.667291:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f84c600/0x40a459093b06c12f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129583.667326:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880132ef8f00) 00010000:00010000:1.0:1746129583.667327:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129583.667330:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f84c600/0x40a459093b06c12f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129583.667334:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f84c600/0x40a459093b06c12f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129583.667344:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f84c800/0x40a459093b06c136 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129583.667349:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f84c800/0x40a459093b06c136 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129583.667353:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f84c800/0x40a459093b06c136 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129583.667357:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f84c800 already unused, calling callback (ffffffffa136e690) 00010000:00010000:1.0:1746129583.667359:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f84c800/0x40a459093b06c136 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129583.667362:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f84c800/0x40a459093b06c136 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129583.667368:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009cffe600) 00010000:00010000:1.0:1746129583.667369:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129583.667371:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f84c800/0x40a459093b06c136 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129583.667374:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f84c800/0x40a459093b06c136 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129583.667430:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f84c400/0x40a459093b06c128 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2273f expref: 9 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129583.667437:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f84c400/0x40a459093b06c128 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2273f expref: 9 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129583.667444:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f84c400, rc 0) 00000100:00100000:1.0:1746129583.667474:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132c24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+8:306:x1830948734497792:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 19580us (20560us total) trans 8589945526 rc 301/301 00000100:00100000:1.0:1746129583.667483:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11394 00000100:00100000:1.0:1746129583.671023:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129583.671065:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129583.671411:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129583.671590:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129583.671611:0:31519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734499456 00000100:00100000:3.0:1746129583.671621:0:31519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734499456 00000100:00100000:3.0:1746129583.673810:0:31519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734499712 00000100:00100000:3.0:1746129583.673821:0:31519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734499712 00000100:00100000:3.0:1746129583.673838:0:31519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734500096 00000100:00100000:3.0:1746129583.673841:0:31519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734500096 00000100:00100000:0.0:1746129583.673849:0:21725:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8264 00000100:00100000:0.0:1746129583.673860:0:21725:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:068dab75-d300-4ead-a742-d14572ad1e50+16:1963:x1830948734499456:12345-192.168.202.4@tcp:3:lfs.0 00010000:00010000:0.0:1746129583.673897:0:21725:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880095d83e00/0x40a459093b06c167 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129583.673913:0:21725:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129583.673915:0:21725:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129583.673919:0:21725:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095d83e00/0x40a459093b06c167 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21725 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129583.673932:0:21725:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095d83e00/0x40a459093b06c167 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21725 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129583.673988:0:8416:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734500224 00000100:00100000:1.0:1746129583.673991:0:8416:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734500224 00000100:00100000:3.0:1746129583.674243:0:31519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8265 00000100:00100000:3.0:1746129583.674250:0:31519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:068dab75-d300-4ead-a742-d14572ad1e50+16:1963:x1830948734499712:12345-192.168.202.4@tcp:3:lfs.0 00010000:00010000:3.0:1746129583.674271:0:31519:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009fab5a00/0x40a459093b06c16e lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129583.674280:0:31519:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129583.674281:0:31519:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129583.674284:0:31519:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fab5a00/0x40a459093b06c16e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129583.674305:0:31519:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fab5a00/0x40a459093b06c16e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31519 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129583.675267:0:21463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8266 00000100:00100000:0.0:1746129583.675275:0:21463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:068dab75-d300-4ead-a742-d14572ad1e50+17:1962:x1830948734500096:12345-192.168.202.4@tcp:3:lfs.0 00010000:00010000:0.0:1746129583.675308:0:21463:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880095d82a00/0x40a459093b06c175 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129583.675315:0:21463:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129583.675316:0:21463:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129583.675320:0:21463:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095d82a00/0x40a459093b06c175 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129583.675329:0:21463:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095d82a00/0x40a459093b06c175 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21463 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129583.675709:0:8416:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8267 00000100:00100000:1.0:1746129583.675718:0:8416:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:068dab75-d300-4ead-a742-d14572ad1e50+17:1962:x1830948734500224:12345-192.168.202.4@tcp:3:lfs.0 00010000:00010000:1.0:1746129583.675736:0:8416:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88008fa79c00/0x40a459093b06c17c lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8416 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129583.675743:0:8416:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129583.675744:0:8416:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129583.675748:0:8416:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fa79c00/0x40a459093b06c17c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8416 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129583.675754:0:8416:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008fa79c00/0x40a459093b06c17c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8416 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129583.678215:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129583.678246:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734500480 00000100:00100000:1.0:1746129583.678255:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734500480 00000100:00100000:1.0:1746129583.678318:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11395 00000100:00100000:1.0:1746129583.678325:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ada2ffba-8920-4ecb-8068-68caa9806978+288:308:x1830948734500480:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:1.0:1746129583.678347:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129583.678364:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fa78200/0x40a459093b06c183 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f22746 expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129583.678473:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fa79000/0x40a459093b06c18a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129583.678485:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fa79000/0x40a459093b06c18a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129583.678494:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fa79000/0x40a459093b06c18a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129583.678504:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fa79400/0x40a459093b06c191 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129583.678509:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fa79400/0x40a459093b06c191 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129583.678514:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fa79400/0x40a459093b06c191 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129583.678617:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fa79800/0x40a459093b06c198 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129583.678625:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fa79800/0x40a459093b06c198 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129583.678630:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fa79800/0x40a459093b06c198 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00200000:1.0:1746129583.678639:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:1.0:1746129583.678719:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fa79800/0x40a459093b06c198 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129583.678726:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fa79800/0x40a459093b06c198 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129583.678732:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008fa79800/0x40a459093b06c198 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129583.678738:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008fa79800 already unused, calling callback (ffffffffa136e690) 00010000:00010000:1.0:1746129583.678741:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fa79800/0x40a459093b06c198 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129583.678748:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fa79800/0x40a459093b06c198 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129583.678759:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009cffe100) 00010000:00010000:1.0:1746129583.678762:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746129583.678765:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008fa79800/0x40a459093b06c198 lrc: 2/0,0 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129583.678770:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fa79800/0x40a459093b06c198 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129583.678785:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fa79000/0x40a459093b06c18a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129583.678790:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fa79000/0x40a459093b06c18a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129583.678794:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008fa79000/0x40a459093b06c18a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129583.678801:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008fa79000 already unused, calling callback (ffffffffa136e690) 00010000:00010000:1.0:1746129583.678804:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fa79000/0x40a459093b06c18a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129583.678808:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fa79000/0x40a459093b06c18a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129583.678813:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880132ef8f00) 00010000:00010000:1.0:1746129583.678816:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129583.678818:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008fa79000/0x40a459093b06c18a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129583.678822:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fa79000/0x40a459093b06c18a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129583.678828:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fa79400/0x40a459093b06c191 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129583.678832:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fa79400/0x40a459093b06c191 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129583.678836:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008fa79400/0x40a459093b06c191 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129583.678841:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008fa79400 already unused, calling callback (ffffffffa136e690) 00010000:00010000:1.0:1746129583.678843:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fa79400/0x40a459093b06c191 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129583.678847:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fa79400/0x40a459093b06c191 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129583.678852:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009cffe900) 00010000:00010000:1.0:1746129583.678853:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129583.678856:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008fa79400/0x40a459093b06c191 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129583.678860:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fa79400/0x40a459093b06c191 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746129583.678893:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fa78200/0x40a459093b06c183 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22746 expref: 290 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129583.678900:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fa78200/0x40a459093b06c183 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22746 expref: 290 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129583.678907:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fa78200, rc 0) 00000100:00100000:1.0:1746129583.678940:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ada2ffba-8920-4ecb-8068-68caa9806978+289:308:x1830948734500480:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 615us (743us total) trans 8589945527 rc 301/301 00000100:00100000:1.0:1746129583.678946:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11395 00000100:00100000:3.0:1746129583.681676:0:8417:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132c27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+31:1961:x1830948734498560:12345-192.168.202.4@tcp:3:cat.0 Request processed in 23660us (24037us total) trans 0 rc 954368/954368 00000100:00100000:3.0:1746129583.681689:0:8417:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8259 00002000:00100000:3.0:1746129583.681702:0:8417:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3ef:0x0] (4194304->5148671) req@ffff880132c27b80 x1830948734498560/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:324/0 lens 488/440 e 0 to 0 dl 1746129594 ref 1 fl Complete:/200/0 rc 954368/954368 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129583.681711:0:8417:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880132c27b80 with x1830948734498560 ext(4194304->5148671) 00002000:00010000:3.0:1746129583.681717:0:8417:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880132c27b80 00010000:00010000:1.0:1746129583.697870:0:31522:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009fd19c00/0x40a459093b06c144 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31522 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129583.697890:0:31522:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009fd19c00/0x40a459093b06c144 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31522 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129583.697899:0:31522:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009fd19c00/0x40a459093b06c144 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31522 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129583.697905:0:31522:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fd19c00 already unused, calling callback (ffffffffa086ed70) 00010000:00010000:1.0:1746129583.697909:0:31522:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009fd19c00/0x40a459093b06c144 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31522 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129583.697916:0:31522:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009fd19c00/0x40a459093b06c144 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31522 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129583.697941:0:31522:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009fd19c00/0x40a459093b06c144 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31522 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129583.697947:0:31522:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fd19c00/0x40a459093b06c144 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31522 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129583.698333:0:31522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132c25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:068dab75-d300-4ead-a742-d14572ad1e50+17:1963:x1830948734498432:12345-192.168.202.4@tcp:3:lfs.0 Request processed in 36779us (39959us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129583.698344:0:31522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8260 00000100:00100000:2.0:1746129583.702692:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129583.703618:0:14551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734500736 00000100:00100000:1.0:1746129583.703630:0:14551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734500736 00000100:00100000:1.0:1746129583.703689:0:14551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4867 00000100:00100000:1.0:1746129583.703699:0:14551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e956680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+8:32765:x1830948734500736:12345-192.168.202.4@tcp:35:cat.0 00000100:00100000:1.0:1746129583.703950:0:14551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e956680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+9:32765:x1830948734500736:12345-192.168.202.4@tcp:35:cat.0 Request processed in 252us (1270us total) trans 8589945528 rc 0/0 00000100:00100000:1.0:1746129583.703957:0:14551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4867 00010000:00010000:3.0:1746129583.708861:0:25745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88008f5e4800/0x40a459093b06c14b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25745 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129583.708879:0:25745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008f5e4800/0x40a459093b06c14b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25745 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129583.708888:0:25745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008f5e4800/0x40a459093b06c14b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25745 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129583.708898:0:25745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f5e4800 already unused, calling callback (ffffffffa086ed70) 00010000:00010000:3.0:1746129583.708902:0:25745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008f5e4800/0x40a459093b06c14b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25745 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129583.708910:0:25745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008f5e4800/0x40a459093b06c14b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25745 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129583.708933:0:25745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008f5e4800/0x40a459093b06c14b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25745 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129583.708938:0:25745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f5e4800/0x40a459093b06c14b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25745 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129583.709056:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132c26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:068dab75-d300-4ead-a742-d14572ad1e50+17:1963:x1830948734498688:12345-192.168.202.4@tcp:3:lfs.0 Request processed in 47214us (50650us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129583.709067:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8261 00010000:00010000:1.0:1746129583.713509:0:31520:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009d106600/0x40a459093b06c152 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129583.713527:0:31520:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009d106600/0x40a459093b06c152 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129583.713536:0:31520:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009d106600/0x40a459093b06c152 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129583.713542:0:31520:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009d106600 already unused, calling callback (ffffffffa086ed70) 00010000:00010000:1.0:1746129583.713547:0:31520:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d106600/0x40a459093b06c152 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129583.713554:0:31520:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d106600/0x40a459093b06c152 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129583.713574:0:31520:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009d106600/0x40a459093b06c152 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129583.713580:0:31520:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d106600/0x40a459093b06c152 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31520 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129583.713691:0:31520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132c26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:068dab75-d300-4ead-a742-d14572ad1e50+15:1963:x1830948734499072:12345-192.168.202.4@tcp:3:lfs.0 Request processed in 49608us (50679us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129583.713701:0:31520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8262 00010000:00010000:1.0:1746129583.720213:0:31518:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009f84ce00/0x40a459093b06c159 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129583.720236:0:31518:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009f84ce00/0x40a459093b06c159 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129583.720244:0:31518:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009f84ce00/0x40a459093b06c159 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129583.720251:0:31518:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f84ce00 already unused, calling callback (ffffffffa086ed70) 00010000:00010000:1.0:1746129583.720256:0:31518:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f84ce00/0x40a459093b06c159 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129583.720263:0:31518:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f84ce00/0x40a459093b06c159 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129583.720285:0:31518:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009f84ce00/0x40a459093b06c159 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129583.720327:0:31518:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f84ce00/0x40a459093b06c159 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31518 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129583.720515:0:31518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132c24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:068dab75-d300-4ead-a742-d14572ad1e50+15:1963:x1830948734499200:12345-192.168.202.4@tcp:3:lfs.0 Request processed in 54987us (56636us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129583.720526:0:31518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8263 00000100:00100000:2.0:1746129583.724635:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129583.725084:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734500992 00000100:00100000:3.0:1746129583.725095:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734500992 00000100:00100000:3.0:1746129583.725162:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11396 00000100:00100000:3.0:1746129583.725170:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e954e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+9:306:x1830948734500992:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:3.0:1746129583.725211:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129583.725215:0:14548:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746129583.725247:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f84d000/0x40a459093b06c0bf lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f226dd expref: 9 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129583.725279:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009cffe100) 00010000:00010000:3.0:1746129583.725284:0:14548:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746129583.725333:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab4600/0x40a459093b06c1a6 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2274d expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129583.725447:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab4400/0x40a459093b06c1ad lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746129583.725459:0:14548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe03800/0x40a459093b06c0c6 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f226e4 expref: 7 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129583.725467:0:14548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd19e00/0x40a459093b06c0db lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f226eb expref: 7 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129583.725473:0:14548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab4400/0x40a459093b06c1ad lrc: 5/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746129583.725571:0:14548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd19e00/0x40a459093b06c0db lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f226eb expref: 7 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129583.725582:0:14548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd19e00/0x40a459093b06c0db lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f226eb expref: 7 pid: 14548 timeout: 939 lvb_type: 0 00000100:00100000:3.0:1746129583.725595:0:14548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094065f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14548:1830948737655552:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129583.726050:0:14548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe03800/0x40a459093b06c0c6 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f226e4 expref: 7 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129583.726060:0:14548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe03800/0x40a459093b06c0c6 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f226e4 expref: 7 pid: 14548 timeout: 939 lvb_type: 0 00000100:00100000:3.0:1746129583.726227:0:14548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094067100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14548:1830948737655680:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129583.726264:0:14548:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009518b600 going to sleep for 11 seconds 00010000:00010000:1.0:1746129583.728687:0:21725:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880095d83e00/0x40a459093b06c167 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129583.728704:0:21725:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880095d83e00/0x40a459093b06c167 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129583.728712:0:21725:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880095d83e00/0x40a459093b06c167 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129583.728718:0:21725:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095d83e00 already unused, calling callback (ffffffffa086ed70) 00010000:00010000:1.0:1746129583.728723:0:21725:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880095d83e00/0x40a459093b06c167 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129583.728731:0:21725:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880095d83e00/0x40a459093b06c167 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129583.728750:0:21725:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880095d83e00/0x40a459093b06c167 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129583.728761:0:21725:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095d83e00/0x40a459093b06c167 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21725 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129583.728832:0:21725:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:068dab75-d300-4ead-a742-d14572ad1e50+13:1963:x1830948734499456:12345-192.168.202.4@tcp:3:lfs.0 Request processed in 54970us (57817us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129583.728842:0:21725:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8264 00000100:00100000:0.0:1746129583.733392:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129583.733946:0:14548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094065f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14548:1830948737655552:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129583.733957:0:14548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094067100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14548:1830948737655680:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129583.734016:0:14548:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab4400/0x40a459093b06c1ad lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000100:00100000:1.0:1746129583.734139:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734501120 00000100:00100000:1.0:1746129583.734145:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734501120 00010000:00010000:1.0:1746129583.734174:0:7087:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd19e00/0x40a459093b06c0db lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f226eb expref: 8 pid: 14548 timeout: 939 lvb_type: 0 00000100:00100000:1.0:1746129583.734254:0:7087:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8822 00000100:00100000:1.0:1746129583.734266:0:7087:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a45050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:068dab75-d300-4ead-a742-d14572ad1e50+8:1963:x1830948734501120:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129583.734277:0:7087:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129583.734282:0:7087:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd19e00/0x40a459093b06c0db lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f226eb expref: 8 pid: 14548 timeout: 939 lvb_type: 0 00010000:00010000:1.0:1746129583.734290:0:7087:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd19e00/0x40a459093b06c0db lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f226eb expref: 8 pid: 14548 timeout: 939 lvb_type: 0 00010000:00010000:1.0:1746129583.734363:0:7087:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd19e00/0x40a459093b06c0db lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f226eb expref: 8 pid: 14548 timeout: 939 lvb_type: 0 00010000:00010000:1.0:1746129583.734375:0:7087:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009cffe100) 00010000:00010000:1.0:1746129583.734379:0:7087:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab4400/0x40a459093b06c1ad lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746129583.734389:0:7087:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab4400/0x40a459093b06c1ad lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746129583.734392:0:7087:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129583.734438:0:7087:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a45050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:068dab75-d300-4ead-a742-d14572ad1e50+7:1963:x1830948734501120:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 172us (1052us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129583.734443:0:7087:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8822 00000100:00100000:0.0:1746129583.735953:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129583.736072:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734501248 00000100:00100000:1.0:1746129583.736079:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734501248 00010000:00010000:1.0:1746129583.736102:0:7087:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe03800/0x40a459093b06c0c6 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f226e4 expref: 7 pid: 14548 timeout: 939 lvb_type: 0 00000100:00100000:1.0:1746129583.736135:0:7087:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8823 00000100:00100000:1.0:1746129583.736141:0:7087:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132c27480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:068dab75-d300-4ead-a742-d14572ad1e50+7:1962:x1830948734501248:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129583.736148:0:7087:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129583.736152:0:7087:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe03800/0x40a459093b06c0c6 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f226e4 expref: 7 pid: 14548 timeout: 939 lvb_type: 0 00010000:00010000:1.0:1746129583.736159:0:7087:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe03800/0x40a459093b06c0c6 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f226e4 expref: 7 pid: 14548 timeout: 939 lvb_type: 0 00010000:00010000:1.0:1746129583.736172:0:7087:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe03800/0x40a459093b06c0c6 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f226e4 expref: 7 pid: 14548 timeout: 939 lvb_type: 0 00010000:00010000:1.0:1746129583.736183:0:7087:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009cffe100) 00010000:00010000:1.0:1746129583.736187:0:7087:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab4400/0x40a459093b06c1ad lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746129583.736196:0:7087:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab4400/0x40a459093b06c1ad lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746129583.736212:0:7087:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab4400/0x40a459093b06c1ad lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746129583.736235:0:7087:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129583.736268:0:7087:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132c27480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:068dab75-d300-4ead-a742-d14572ad1e50+6:1962:x1830948734501248:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 127us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129583.736273:0:7087:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8823 00010000:00010000:2.0:1746129583.736289:0:14548:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab4400/0x40a459093b06c1ad lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746129583.736321:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab4400/0x40a459093b06c1ad lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000040:00080000:2.0:1746129583.739514:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3527, 88 off297112 00000004:00080000:2.0:1746129583.739525:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 839056230182ns, next at 776349687452ns, rc = 0 00000040:00080000:2.0:1746129583.739577:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3533, 88 off297552 00000004:00080000:2.0:1746129583.739581:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 839056287548ns, next at 776375382381ns, rc = 0 00000040:00080000:2.0:1746129583.739601:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3534, 88 off297640 00000004:00080000:2.0:1746129583.739604:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 839056310157ns, next at 776375382381ns, rc = 0 00000040:00080000:2.0:1746129583.739610:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3528, 88 off297200 00000004:00080000:2.0:1746129583.739613:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 839056318718ns, next at 776349687452ns, rc = 0 00000040:00080000:2.0:1746129583.739620:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3529, 88 off297288 00000004:00080000:2.0:1746129583.739623:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 839056328665ns, next at 776349687452ns, rc = 0 00000040:00080000:2.0:1746129583.739637:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3535, 88 off297728 00000004:00080000:2.0:1746129583.739639:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 839056345582ns, next at 776375382381ns, rc = 0 00010000:00010000:3.0:1746129583.739799:0:31519:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009fab5a00/0x40a459093b06c16e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129583.739814:0:31519:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009fab5a00/0x40a459093b06c16e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129583.740180:0:31519:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009fab5a00/0x40a459093b06c16e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129583.740219:0:31519:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fab5a00 already unused, calling callback (ffffffffa086ed70) 00010000:00010000:3.0:1746129583.740223:0:31519:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009fab5a00/0x40a459093b06c16e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129583.740230:0:31519:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009fab5a00/0x40a459093b06c16e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129583.740377:0:31519:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009fab5a00/0x40a459093b06c16e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129583.740383:0:31519:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fab5a00/0x40a459093b06c16e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31519 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129583.740600:0:31519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:068dab75-d300-4ead-a742-d14572ad1e50+13:1963:x1830948734499712:12345-192.168.202.4@tcp:3:lfs.0 Request processed in 66346us (69529us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129583.740609:0:31519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8265 00000040:00080000:2.0:1746129583.741724:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3536, 88 off297816 00000004:00080000:2.0:1746129583.741741:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 839058446676ns, next at 776375382381ns, rc = 0 00000040:00080000:2.0:1746129583.741781:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3537, 88 off297904 00000004:00080000:2.0:1746129583.741786:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 839058491829ns, next at 776375382381ns, rc = 0 00000040:00080000:2.0:1746129583.741802:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3530, 88 off297376 00000004:00080000:2.0:1746129583.741805:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 839058511043ns, next at 776349687452ns, rc = 0 00000040:00080000:2.0:1746129583.741822:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3538, 88 off297992 00000004:00080000:2.0:1746129583.741825:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 839058531053ns, next at 776375382381ns, rc = 0 00000040:00080000:2.0:1746129583.741835:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3531, 88 off297464 00000004:00080000:2.0:1746129583.741837:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 839058543148ns, next at 776349687452ns, rc = 0 00000040:00080000:2.0:1746129583.741844:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3539, 88 off298080 00000004:00080000:2.0:1746129583.741847:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 839058552934ns, next at 776375382381ns, rc = 0 00000040:00080000:2.0:1746129583.741853:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3532, 88 off297552 00000004:00080000:2.0:1746129583.741855:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 839058561627ns, next at 776349687452ns, rc = 0 00000040:00080000:2.0:1746129583.741863:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3533, 88 off297640 00000004:00080000:2.0:1746129583.741865:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 839058571213ns, next at 776349687452ns, rc = 0 00000040:00080000:2.0:1746129583.741872:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3534, 88 off297728 00000004:00080000:2.0:1746129583.741874:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 839058580409ns, next at 776349687452ns, rc = 0 00000040:00080000:2.0:1746129583.741880:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3535, 88 off297816 00000004:00080000:2.0:1746129583.741884:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 839058589874ns, next at 776349687452ns, rc = 0 00000040:00080000:2.0:1746129583.741891:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3540, 88 off298168 00000004:00080000:2.0:1746129583.741894:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 839058599928ns, next at 776375382381ns, rc = 0 00010000:00010000:1.0:1746129583.748085:0:8416:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88008fa79c00/0x40a459093b06c17c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8416 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129583.748099:0:8416:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008fa79c00/0x40a459093b06c17c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8416 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129583.748106:0:8416:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008fa79c00/0x40a459093b06c17c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8416 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129583.748112:0:8416:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008fa79c00 already unused, calling callback (ffffffffa086ed70) 00010000:00010000:1.0:1746129583.748116:0:8416:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008fa79c00/0x40a459093b06c17c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8416 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129583.748123:0:8416:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008fa79c00/0x40a459093b06c17c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8416 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129583.748139:0:8416:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008fa79c00/0x40a459093b06c17c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8416 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129583.748150:0:8416:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008fa79c00/0x40a459093b06c17c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8416 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129583.748225:0:8416:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:068dab75-d300-4ead-a742-d14572ad1e50+11:1962:x1830948734500224:12345-192.168.202.4@tcp:3:lfs.0 Request processed in 72505us (76630us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129583.748234:0:8416:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8267 00000100:00100000:1.0:1746129583.749857:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129583.750372:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734501504 00000100:00100000:0.0:1746129583.750380:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734501504 00000100:00100000:0.0:1746129583.750621:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11397 00000100:00100000:0.0:1746129583.750628:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ada2ffba-8920-4ecb-8068-68caa9806978+289:311:x1830948734501504:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129583.750647:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129583.750661:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012984ea00/0x40a459093b06c1b4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f22754 expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129583.750749:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012984e000/0x40a459093b06c1bb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129583.750760:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012984e000/0x40a459093b06c1bb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129583.750768:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012984e000/0x40a459093b06c1bb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129583.750778:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012984e800/0x40a459093b06c1c2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129583.750783:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012984e800/0x40a459093b06c1c2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129583.750788:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012984e800/0x40a459093b06c1c2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129583.750879:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012984e600/0x40a459093b06c1c9 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129583.750885:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012984e600/0x40a459093b06c1c9 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129583.750891:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012984e600/0x40a459093b06c1c9 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00200000:0.0:1746129583.750898:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:0.0:1746129583.750994:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012984e600/0x40a459093b06c1c9 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129583.751000:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012984e600/0x40a459093b06c1c9 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129583.751005:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012984e600/0x40a459093b06c1c9 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129583.751010:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012984e600 already unused, calling callback (ffffffffa136e690) 00010000:00010000:0.0:1746129583.751013:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012984e600/0x40a459093b06c1c9 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129583.751018:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012984e600/0x40a459093b06c1c9 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129583.751027:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009cffe100) 00010000:00010000:0.0:1746129583.751030:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746129583.751032:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012984e600/0x40a459093b06c1c9 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129583.751037:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012984e600/0x40a459093b06c1c9 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129583.751053:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012984e000/0x40a459093b06c1bb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129583.751057:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012984e000/0x40a459093b06c1bb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129583.751061:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012984e000/0x40a459093b06c1bb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129583.751065:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012984e000 already unused, calling callback (ffffffffa136e690) 00010000:00010000:0.0:1746129583.751067:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012984e000/0x40a459093b06c1bb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129583.751071:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012984e000/0x40a459093b06c1bb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129583.751077:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880132ef8f00) 00010000:00010000:0.0:1746129583.751078:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129583.751081:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012984e000/0x40a459093b06c1bb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129583.751084:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012984e000/0x40a459093b06c1bb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129583.751090:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012984e800/0x40a459093b06c1c2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129583.751095:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012984e800/0x40a459093b06c1c2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129583.751100:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012984e800/0x40a459093b06c1c2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129583.751103:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012984e800 already unused, calling callback (ffffffffa136e690) 00010000:00010000:0.0:1746129583.751106:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012984e800/0x40a459093b06c1c2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129583.751111:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012984e800/0x40a459093b06c1c2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129583.751116:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009ce7a500) 00010000:00010000:0.0:1746129583.751118:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129583.751120:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012984e800/0x40a459093b06c1c2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129583.751124:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012984e800/0x40a459093b06c1c2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129583.751155:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012984ea00/0x40a459093b06c1b4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22754 expref: 291 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129583.751162:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012984ea00/0x40a459093b06c1b4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22754 expref: 291 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129583.751168:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012984ea00, rc 0) 00000100:00100000:0.0:1746129583.751240:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ada2ffba-8920-4ecb-8068-68caa9806978+290:311:x1830948734501504:12345-192.168.202.4@tcp:101:cat.0 Request processed in 612us (1386us total) trans 8589945530 rc 301/301 00000100:00100000:0.0:1746129583.751246:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11397 00010000:00010000:0.0:1746129583.753799:0:21463:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880095d82a00/0x40a459093b06c175 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129583.753817:0:21463:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880095d82a00/0x40a459093b06c175 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129583.753826:0:21463:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880095d82a00/0x40a459093b06c175 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129583.753832:0:21463:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095d82a00 already unused, calling callback (ffffffffa086ed70) 00010000:00010000:0.0:1746129583.753836:0:21463:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880095d82a00/0x40a459093b06c175 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129583.753843:0:21463:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880095d82a00/0x40a459093b06c175 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129583.753858:0:21463:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880095d82a00/0x40a459093b06c175 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129583.753864:0:21463:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095d82a00/0x40a459093b06c175 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21463 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129583.753921:0:21463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:068dab75-d300-4ead-a742-d14572ad1e50+11:1962:x1830948734500096:12345-192.168.202.4@tcp:3:lfs.0 Request processed in 78644us (82507us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129583.753931:0:21463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8266 00000100:00100000:0.0:1746129583.755898:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129583.756570:0:16908:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734501632 00000100:00100000:2.0:1746129583.756578:0:16908:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734501632 00000100:00100000:2.0:1746129583.756613:0:16908:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11398 00000100:00100000:2.0:1746129583.756620:0:16908:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ada2ffba-8920-4ecb-8068-68caa9806978+290:311:x1830948734501632:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129583.756642:0:16908:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129583.756657:0:16908:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe03a00/0x40a459093b06c1d7 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2275b expref: -99 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129583.756721:0:16908:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe03000/0x40a459093b06c1de lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129583.757192:0:16908:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab4400/0x40a459093b06c1ad lrc: 2/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746129583.757197:0:16908:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe03000/0x40a459093b06c1de lrc: 4/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:2.0:1746129583.757219:0:16908:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab4400/0x40a459093b06c1ad lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746129583.757231:0:16908:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe03000/0x40a459093b06c1de lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00000100:00100000:1.0:1746129583.762934:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129583.763009:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734501888 00000100:00100000:0.0:1746129583.763032:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734501888 00000100:00100000:0.0:1746129583.763079:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11399 00000100:00100000:0.0:1746129583.763089:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:068dab75-d300-4ead-a742-d14572ad1e50+6:301:x1830948734501888:12345-192.168.202.4@tcp:36:lfs.0 00010000:00010000:0.0:1746129583.763170:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012984f800/0x40a459093b06c1e5 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129583.763194:0:14549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe03000/0x40a459093b06c1de lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129583.763221:0:14549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012984f800/0x40a459093b06c1e5 lrc: 4/0,1 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129583.763235:0:14549:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe03000/0x40a459093b06c1de lrc: 4/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 16908 initiator: MDT0 00010000:00010000:0.0:1746129583.763244:0:14549:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012984f800/0x40a459093b06c1e5 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000001:00080000:1.0:1746129583.771839:0:14619:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945528 is committed 00000001:00080000:1.0:1746129583.771851:0:14619:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945527 is committed 00000001:00080000:1.0:1746129583.771857:0:14619:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945529 is committed 00000004:00080000:1.0:1746129583.771860:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2709 committed 00000004:00080000:1.0:1746129583.771867:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2704 committed 00000004:00080000:1.0:1746129583.771872:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2703 committed 00000004:00080000:1.0:1746129583.771874:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2702 committed 00000004:00080000:1.0:1746129583.771876:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2701 committed 00000004:00080000:1.0:1746129583.771877:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2708 committed 00000004:00080000:1.0:1746129583.771879:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2700 committed 00000004:00080000:1.0:1746129583.771880:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2707 committed 00000004:00080000:1.0:1746129583.771881:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2699 committed 00000004:00080000:1.0:1746129583.771883:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2706 committed 00000004:00080000:1.0:1746129583.771884:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2705 committed 00000004:00080000:1.0:1746129583.771886:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2704 committed 00000004:00080000:1.0:1746129583.771887:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2698 committed 00000004:00080000:1.0:1746129583.771888:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2697 committed 00000004:00080000:1.0:1746129583.771890:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2703 committed 00000004:00080000:1.0:1746129583.771891:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2702 committed 00000004:00080000:1.0:1746129583.771892:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2696 committed 00000100:00100000:1.0:1746129583.772020:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fa26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1830948737655808:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129583.772074:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129583.772110:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fa24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1830948737656320:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129583.772125:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129583.772141:0:3303:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1746129583.772146:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fa24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1830948737656192:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129583.772159:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129583.772168:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135724e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1830948737656704:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129583.772179:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129583.772194:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fa25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737655936:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129583.772223:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129583.772235:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135725500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737656448:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129583.772246:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129583.772256:0:3300:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1746129583.772259:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fa24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737656064:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129583.772271:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129583.772280:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135725880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737656576:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129583.772313:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129583.772340:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737655808 00000100:00100000:1.0:1746129583.772346:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737655808 00000100:00100000:1.0:1746129583.772371:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737656320 00000100:00100000:1.0:1746129583.772373:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737656320 00000100:00100000:1.0:1746129583.772390:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737656192 00000100:00100000:1.0:1746129583.772391:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737656192 00000100:00100000:1.0:1746129583.772401:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737656704 00000100:00100000:1.0:1746129583.772402:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737656704 00000100:00100000:1.0:1746129583.772409:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737655936 00000100:00100000:1.0:1746129583.772411:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737655936 00000100:00100000:1.0:1746129583.772416:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737656448 00000100:00100000:1.0:1746129583.772418:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737656448 00000100:00100000:1.0:1746129583.772423:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737656064 00000100:00100000:1.0:1746129583.772424:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737656064 00000100:00100000:1.0:1746129583.772428:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737656576 00000100:00100000:1.0:1746129583.772430:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737656576 00000100:00100000:1.0:1746129583.772438:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17023 00000100:00100000:1.0:1746129583.772444:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135726680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+44:3303:x1830948737655808:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129583.772571:0:8411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17024 00000100:00100000:0.0:1746129583.772578:0:8411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800912aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+45:3303:x1830948737656320:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746129583.772600:0:7148:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746129583.772604:0:7148:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb mtime from disk: 1746129584 -> 1746129584 00002000:00010000:1.0:1746129583.772606:0:7148:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb atime from disk: 1746129582 -> 1746129582 00002000:00010000:1.0:1746129583.772608:0:7148:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb ctime from disk: 1746129584 -> 1746129584 00002000:00010000:1.0:1746129583.772609:0:7148:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746129583.772633:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135726680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+46:3303:x1830948737655808:12345-0@lo:2:osp-syn-1-0.0 Request processed in 190us (560us total) trans 17179874226 rc 0/0 00000100:00100000:1.0:1746129583.772639:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17023 00000100:00100000:1.0:1746129583.772651:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17025 00000100:00100000:1.0:1746129583.772655:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800912afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+45:3303:x1830948737656192:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129583.772658:0:8411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800912aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+45:3303:x1830948737656320:12345-0@lo:2:osp-syn-1-0.0 Request processed in 81us (532us total) trans 17179874227 rc 0/0 00000100:00100000:0.0:1746129583.772663:0:8411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17024 00000100:00100000:0.0:1746129583.772670:0:8411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17026 00000100:00100000:0.0:1746129583.772674:0:8411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800912ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+44:3303:x1830948737656704:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746129583.772713:0:7148:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746129583.772715:0:7148:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb mtime from disk: 1746129523 -> 1746129523 00002000:00010000:1.0:1746129583.772717:0:7148:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb atime from disk: 1746129523 -> 1746129523 00002000:00010000:1.0:1746129583.772719:0:7148:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb ctime from disk: 1746129524 -> 1746129524 00002000:00010000:1.0:1746129583.772720:0:7148:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1746129583.772733:0:8411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800912ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+46:3303:x1830948737656704:12345-0@lo:2:osp-syn-1-0.0 Request processed in 58us (552us total) trans 17179874229 rc 0/0 00000100:00100000:1.0:1746129583.772734:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800912afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+46:3303:x1830948737656192:12345-0@lo:2:osp-syn-1-0.0 Request processed in 80us (575us total) trans 17179874228 rc 0/0 00000100:00100000:0.0:1746129583.772738:0:8411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17026 00000100:00100000:1.0:1746129583.772740:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17025 00000100:00100000:0.0:1746129583.772746:0:8411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17027 00000100:00100000:1.0:1746129583.772748:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17028 00000100:00100000:0.0:1746129583.772749:0:8411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+44:3300:x1830948737655936:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129583.772751:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+44:3300:x1830948737656448:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129583.772800:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091b04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737657216:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129583.772825:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:0.0:1746129583.772829:0:8411:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746129583.772831:0:8411:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb mtime from disk: 1746129583 -> 1746129583 00002000:00010000:0.0:1746129583.772833:0:8411:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb atime from disk: 1746129583 -> 1746129583 00000100:00100000:2.0:1746129583.772835:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091b04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737657728:0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746129583.772835:0:8411:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb ctime from disk: 1746129583 -> 1746129583 00002000:00010000:0.0:1746129583.772836:0:8411:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:2.0:1746129583.772848:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129583.772851:0:8411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+45:3300:x1830948737655936:12345-0@lo:2:osp-syn-1-0.0 Request processed in 101us (627us total) trans 17179874230 rc 0/0 00000100:00100000:2.0:1746129583.772855:0:3302:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1746129583.772856:0:8411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17027 00000100:00100000:2.0:1746129583.772859:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091b07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737656832:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129583.772863:0:8411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737657216 00000100:00100000:0.0:1746129583.772866:0:8411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737657216 00000100:00100000:2.0:1746129583.772871:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129583.772876:0:8411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737657728 00000100:00100000:2.0:1746129583.772877:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091b05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737657344:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129583.772877:0:8411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737657728 00000100:00100000:0.0:1746129583.772882:0:8411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737656832 00000100:00100000:0.0:1746129583.772884:0:8411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737656832 00000100:00100000:2.0:1746129583.772888:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129583.772890:0:8411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17029 00000100:00100000:0.0:1746129583.772894:0:8411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013145d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+44:3300:x1830948737656064:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129583.772900:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091b04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737657088:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129583.772914:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129583.772920:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091b04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737657600:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129583.772932:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129583.772939:0:3301:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1746129583.772942:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091b07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737656960:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129583.772953:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129583.772958:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091b05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737657472:0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746129583.772958:0:8411:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3f5:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746129583.772961:0:8411:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f5:0x0] updating lvb mtime from disk: 1746129584 -> 1746129584 00002000:00010000:0.0:1746129583.772962:0:8411:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f5:0x0] updating lvb atime from disk: 1746129583 -> 1746129583 00002000:00010000:0.0:1746129583.772964:0:8411:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f5:0x0] updating lvb ctime from disk: 1746129584 -> 1746129584 00002000:00010000:0.0:1746129583.772966:0:8411:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f5:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:2.0:1746129583.772968:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129583.772979:0:8411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013145d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+45:3300:x1830948737656064:12345-0@lo:2:osp-syn-1-0.0 Request processed in 85us (707us total) trans 17179874231 rc 0/0 00000100:00100000:2.0:1746129583.772981:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737657344 00000100:00100000:2.0:1746129583.772983:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737657344 00000100:00100000:0.0:1746129583.772984:0:8411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17029 00000100:00100000:0.0:1746129583.772990:0:8411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737657088 00000100:00100000:0.0:1746129583.772992:0:8411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737657088 00000100:00100000:2.0:1746129583.772995:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737657600 00000100:00100000:2.0:1746129583.772996:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737657600 00000100:00100000:0.0:1746129583.772999:0:8411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17030 00000100:00100000:2.0:1746129583.773002:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737656960 00000100:00100000:0.0:1746129583.773002:0:8411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013145ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+44:3300:x1830948737656576:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129583.773003:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737656960 00000100:00100000:2.0:1746129583.773008:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737657472 00000100:00100000:2.0:1746129583.773011:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737657472 00000100:00100000:2.0:1746129583.773017:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17031 00000100:00100000:2.0:1746129583.773021:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e956300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+48:3302:x1830948737657216:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129583.773071:0:8411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013145ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+45:3300:x1830948737656576:12345-0@lo:2:osp-syn-1-0.0 Request processed in 68us (778us total) trans 17179874232 rc 0/0 00000100:00100000:0.0:1746129583.773076:0:8411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17030 00000100:00100000:0.0:1746129583.773084:0:8411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17032 00000100:00100000:0.0:1746129583.773088:0:8411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009507df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+49:3302:x1830948737657728:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129583.773116:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e956300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+49:3302:x1830948737657216:12345-0@lo:2:osp-syn-0-0.0 Request processed in 94us (290us total) trans 21474841477 rc 0/0 00000100:00100000:2.0:1746129583.773120:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17031 00000100:00100000:2.0:1746129583.773130:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17033 00000100:00100000:2.0:1746129583.773133:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009507d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+49:3302:x1830948737656832:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129583.773152:0:8411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009507df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+49:3302:x1830948737657728:12345-0@lo:2:osp-syn-0-0.0 Request processed in 64us (303us total) trans 21474841478 rc 0/0 00000100:00100000:0.0:1746129583.773157:0:8411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17032 00000100:00100000:0.0:1746129583.773165:0:8411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17034 00000100:00100000:0.0:1746129583.773169:0:8411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009507c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+48:3302:x1830948737657344:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746129583.773195:0:4385:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3ec:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:2.0:1746129583.773197:0:4385:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ec:0x0] updating lvb mtime from disk: 1746129584 -> 1746129584 00002000:00010000:2.0:1746129583.773211:0:4385:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3ec:0x0] updating lvb atime from disk: 1746129583 -> 1746129583 00002000:00010000:2.0:1746129583.773213:0:4385:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ec:0x0] updating lvb ctime from disk: 1746129584 -> 1746129584 00002000:00010000:2.0:1746129583.773215:0:4385:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3ec:0x0] updating lvb blocks from disk: 2073 -> 2073 00000100:00100000:2.0:1746129583.773232:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009507d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+50:3302:x1830948737656832:12345-0@lo:2:osp-syn-0-0.0 Request processed in 98us (360us total) trans 21474841479 rc 0/0 00000100:00100000:2.0:1746129583.773237:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17033 00000100:00100000:2.0:1746129583.773246:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17035 00000100:00100000:0.0:1746129583.773246:0:8411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009507c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+49:3302:x1830948737657344:12345-0@lo:2:osp-syn-0-0.0 Request processed in 77us (357us total) trans 21474841480 rc 0/0 00000100:00100000:2.0:1746129583.773250:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009507d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+49:3301:x1830948737657088:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129583.773250:0:8411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17034 00000100:00100000:0.0:1746129583.773258:0:8411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17036 00000100:00100000:0.0:1746129583.773261:0:8411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009507fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+48:3301:x1830948737657600:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129583.773326:0:22481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17037 00000100:00100000:2.0:1746129583.773330:0:22481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009507ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+50:3301:x1830948737656960:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746129583.773333:0:8411:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746129583.773335:0:8411:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1746129583.773336:0:8411:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746129583.773338:0:8411:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746129583.773339:0:8411:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1746129583.773358:0:8411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009507fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+50:3301:x1830948737657600:12345-0@lo:2:osp-syn-0-0.0 Request processed in 97us (426us total) trans 21474841481 rc 0/0 00000100:00100000:0.0:1746129583.773363:0:8411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17036 00000100:00100000:0.0:1746129583.773371:0:8411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17038 00000100:00100000:0.0:1746129583.773375:0:8411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009507ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+49:3301:x1830948737657472:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746129583.773394:0:22481:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746129583.773396:0:22481:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb mtime from disk: 1746129583 -> 1746129583 00002000:00010000:2.0:1746129583.773398:0:22481:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb atime from disk: 1746129583 -> 1746129583 00002000:00010000:2.0:1746129583.773400:0:22481:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb ctime from disk: 1746129583 -> 1746129583 00002000:00010000:2.0:1746129583.773402:0:22481:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:2.0:1746129583.773420:0:22481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009507ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+51:3301:x1830948737656960:12345-0@lo:2:osp-syn-0-0.0 Request processed in 89us (466us total) trans 21474841483 rc 0/0 00000100:00100000:2.0:1746129583.773424:0:22481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17037 00000100:00100000:0.0:1746129583.773434:0:8411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009507ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+50:3301:x1830948737657472:12345-0@lo:2:osp-syn-0-0.0 Request processed in 58us (465us total) trans 21474841484 rc 0/0 00000100:00100000:0.0:1746129583.773438:0:8411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17038 00000004:00080000:2.0:1746129583.773453:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091b07100/2, rc 0, transno 21474841483 00000100:00100000:2.0:1746129583.773460:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091b07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737656960:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746129583.773467:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091b05f80/2, rc 0, transno 21474841484 00000100:00100000:2.0:1746129583.773469:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091b05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737657472:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746129583.773475:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091b04380/2, rc 0, transno 21474841481 00000100:00100000:2.0:1746129583.773477:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091b04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737657600:0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746129583.773500:0:4385:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb size from disk: 5146336 -> 5146336 00002000:00010000:2.0:1746129583.773502:0:4385:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb mtime from disk: 1746129584 -> 1746129584 00002000:00010000:2.0:1746129583.773504:0:4385:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb atime from disk: 1746129584 -> 1746129584 00000100:00100000:0.0:1746129583.773505:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+45:3300:x1830948737656448:12345-0@lo:2:osp-syn-1-0.0 Request processed in 753us (1258us total) trans 17179874233 rc 0/0 00002000:00010000:2.0:1746129583.773506:0:4385:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb ctime from disk: 1746129584 -> 1746129584 00002000:00010000:2.0:1746129583.773508:0:4385:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb blocks from disk: 6033 -> 6033 00000100:00100000:0.0:1746129583.773513:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17028 00000100:00100000:2.0:1746129583.773522:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009507d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+49:3301:x1830948737657088:12345-0@lo:2:osp-syn-0-0.0 Request processed in 273us (608us total) trans 21474841482 rc 0/0 00000100:00100000:2.0:1746129583.773526:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17035 00000004:00080000:2.0:1746129583.773540:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091b04e00/2, rc 0, transno 21474841482 00000100:00100000:2.0:1746129583.773543:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091b04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737657088:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746129583.773554:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091b07800/2, rc 0, transno 21474841479 00000100:00100000:2.0:1746129583.773556:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091b07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737656832:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746129583.773561:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091b05500/2, rc 0, transno 21474841480 00000100:00100000:2.0:1746129583.773563:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091b05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737657344:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746129583.773568:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091b04a80/2, rc 0, transno 21474841477 00000100:00100000:2.0:1746129583.773571:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091b04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737657216:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746129583.773575:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091b04000/2, rc 0, transno 21474841478 00000100:00100000:2.0:1746129583.773577:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091b04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737657728:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129583.773581:0:3302:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1746129583.773584:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091b05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737657856:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129583.773602:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129583.773614:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737657856 00000100:00100000:2.0:1746129583.773616:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737657856 00000100:00100000:2.0:1746129583.773628:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17039 00000100:00100000:2.0:1746129583.773632:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c29cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+49:3302:x1830948737657856:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129583.773697:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c29cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+50:3302:x1830948737657856:12345-0@lo:2:osp-syn-0-0.0 Request processed in 65us (94us total) trans 21474841485 rc 0/0 00000100:00100000:2.0:1746129583.773702:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17039 00010000:00010000:3.0:1746129583.773787:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab4400/0x40a459093b06c1ad lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2274d expref: 8 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129583.773799:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009cffe100) 00010000:00010000:3.0:1746129583.773802:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1746129583.773805:0:14548:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe03000/0x40a459093b06c1de lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129583.773813:0:14548:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe03000/0x40a459093b06c1de lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40290400000020 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129583.773817:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe03000/0x40a459093b06c1de lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40290400000020 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129583.773822:0:14548:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012984f800/0x40a459093b06c1e5 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00080000:1.0:1746129583.773826:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fa24700/2, rc 0, transno 17179874231 00000100:00100000:1.0:1746129583.773830:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fa24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737656064:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746129583.773835:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135725880/2, rc 0, transno 17179874232 00000100:00100000:1.0:1746129583.773837:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135725880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737656576:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746129583.773844:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fa25180/2, rc 0, transno 17179874230 00000100:00100000:1.0:1746129583.773846:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fa25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737655936:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746129583.773851:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135725500/2, rc 0, transno 17179874233 00000100:00100000:1.0:1746129583.773853:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135725500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737656448:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1746129583.773854:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab4600/0x40a459093b06c1a6 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2274d expref: 8 pid: 14548 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1746129583.773866:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab4400/0x40a459093b06c1ad lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2274d expref: 7 pid: 14548 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1746129583.773866:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fa24a80/2, rc 0, transno 17179874228 00000100:00100000:1.0:1746129583.773868:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fa24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1830948737656192:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746129583.773874:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135724e00/2, rc 0, transno 17179874229 00000100:00100000:1.0:1746129583.773876:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135724e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1830948737656704:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746129583.773882:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fa26d80/2, rc 0, transno 17179874226 00000100:00100000:1.0:1746129583.773884:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fa26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1830948737655808:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1746129583.773888:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fab4400, rc 0) 00000004:00080000:1.0:1746129583.773889:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fa24380/2, rc 0, transno 17179874227 00000100:00100000:1.0:1746129583.773891:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fa24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1830948737656320:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129583.773933:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e954e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+7:306:x1830948734500992:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 48764us (49310us total) trans 8589945529 rc 0/0 00000100:00100000:3.0:1746129583.773943:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11396 00010000:00010000:3.0:1746129583.773963:0:16908:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe03000/0x40a459093b06c1de lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129583.773968:0:16908:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe03000/0x40a459093b06c1de lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 16908 initiator: MDT0 00000004:00200000:3.0:1746129583.773992:0:16908:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00000004:00200000:3.0:1746129583.773995:0:16908:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746129583.774006:0:16908:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe03000/0x40a459093b06c1de lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 16908 initiator: MDT0 00010000:00010000:3.0:1746129583.774028:0:16908:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe03a00/0x40a459093b06c1d7 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2275b expref: 291 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129583.774045:0:16908:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe03000/0x40a459093b06c1de lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2275b expref: 290 pid: 16908 timeout: 939 lvb_type: 0 00010000:00010000:3.0:1746129583.774051:0:16908:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe03000/0x40a459093b06c1de lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2275b expref: 290 pid: 16908 timeout: 939 lvb_type: 0 00010000:00010000:3.0:1746129583.774055:0:16908:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe03000, rc 0) 00000100:00100000:3.0:1746129583.774071:0:16908:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ada2ffba-8920-4ecb-8068-68caa9806978+290:311:x1830948734501632:12345-192.168.202.4@tcp:101:cat.0 Request processed in 17453us (18178us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129583.774076:0:16908:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11398 00000004:00080000:2.0:1746129583.774658:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091b05180/2, rc 0, transno 21474841485 00000100:00100000:2.0:1746129583.774663:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091b05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737657856:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129583.780108:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129583.780150:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129583.780577:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129583.780849:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734502144 00000100:00100000:2.0:1746129583.780859:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734502144 00000100:00100000:3.0:1746129583.781280:0:15749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734502272 00000100:00100000:3.0:1746129583.781332:0:15749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734502272 00010000:00010000:3.0:1746129583.781375:0:15749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe03000/0x40a459093b06c1de lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2275b expref: 290 pid: 16908 timeout: 939 lvb_type: 0 00000100:00100000:3.0:1746129583.781415:0:15749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8824 00000100:00100000:3.0:1746129583.781422:0:15749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b06d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ada2ffba-8920-4ecb-8068-68caa9806978+290:1961:x1830948734502272:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129583.781436:0:15749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129583.781441:0:15749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe03000/0x40a459093b06c1de lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2275b expref: 290 pid: 16908 timeout: 939 lvb_type: 0 00010000:00010000:3.0:1746129583.781451:0:15749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe03000/0x40a459093b06c1de lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2275b expref: 290 pid: 16908 timeout: 939 lvb_type: 0 00010000:00010000:3.0:1746129583.781469:0:15749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe03000/0x40a459093b06c1de lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2275b expref: 290 pid: 16908 timeout: 939 lvb_type: 0 00010000:00010000:3.0:1746129583.781485:0:15749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009cffe100) 00010000:00010000:3.0:1746129583.781490:0:15749:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012984f800/0x40a459093b06c1e5 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129583.781497:0:15749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012984f800/0x40a459093b06c1e5 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129583.781502:0:15749:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012984f800/0x40a459093b06c1e5 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14549 initiator: MDT0 00000100:00100000:2.0:1746129583.781521:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 17040 00010000:00010000:3.0:1746129583.781527:0:15749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129583.781533:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+31:306:x1830948734502144:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:2.0:1746129583.781555:0:4385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129583.781575:0:4385:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fe03200/0x40a459093b06c1ec lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f22769 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129583.781582:0:15749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b06d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ada2ffba-8920-4ecb-8068-68caa9806978+289:1961:x1830948734502272:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 159us (1004us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129583.781588:0:15749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8824 00010000:00010000:2.0:1746129583.781609:0:4385:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094bb3400/0x40a459093b06c0cd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5242879) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f226f2 expref: 32 pid: 8411 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129583.781614:0:16908:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734502016 00000100:00100000:3.0:1746129583.781617:0:16908:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734502016 00010000:00010000:2.0:1746129583.781623:0:4385:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fd18e00/0x40a459093b06c11a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22731 expref: 10 pid: 4699 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129583.781631:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129583.781633:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746129583.781635:0:16908:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11400 00010000:00010000:2.0:1746129583.781637:0:4385:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fe03200/0x40a459093b06c1ec lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [4009984->4034559] (req 4009984->4034559) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22769 expref: 32 pid: 4385 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129583.781639:0:16908:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ada2ffba-8920-4ecb-8068-68caa9806978+289:311:x1830948734502016:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129583.781652:0:16908:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129583.781660:0:16908:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab4a00/0x40a459093b06c1f3 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f22762 expref: -99 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129583.781670:0:4385:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fd18e00/0x40a459093b06c11a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22731 expref: 10 pid: 4699 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129583.781684:0:4385:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fd18e00/0x40a459093b06c11a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22731 expref: 10 pid: 4699 timeout: 939 lvb_type: 1 00010000:00010000:3.0:1746129583.781698:0:16908:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab4a00/0x40a459093b06c1f3 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22762 expref: 290 pid: 16908 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129583.781698:0:4385:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009507df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:4385:1830948737657984:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129583.781707:0:16908:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab4a00/0x40a459093b06c1f3 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22762 expref: 290 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129583.781720:0:16908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009cffe100) 00010000:00010000:3.0:1746129583.781722:0:16908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746129583.781724:0:16908:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fab4a00, rc 0) 00010000:00010000:0.0:1746129583.781850:0:14549:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012984f800/0x40a459093b06c1e5 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129583.781860:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012984f800/0x40a459093b06c1e5 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00010000:0.0:1746129583.782110:0:14549:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009fa24000 reply state ffff8800a0823000 transno 8589945531 ns: mdt-lustre-MDT0000_UUID lock: ffff88012984f800/0x40a459093b06c1e5 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000100:00100000:0.0:1746129583.782118:0:14549:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1746129583.782229:0:16908:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ada2ffba-8920-4ecb-8068-68caa9806978+290:311:x1830948734502016:12345-192.168.202.4@tcp:101:cat.0 Request processed in 587us (2133us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129583.782234:0:16908:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11400 00010000:00010000:2.0:1746129583.782535:0:4385:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094bb3400/0x40a459093b06c0cd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5242879) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f226f2 expref: 32 pid: 8411 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129583.782545:0:4385:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094bb3400/0x40a459093b06c0cd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5242879) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f226f2 expref: 32 pid: 8411 timeout: 939 lvb_type: 0 00000100:00100000:2.0:1746129583.782554:0:4385:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009507d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:4385:1830948737658112:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129583.782879:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:068dab75-d300-4ead-a742-d14572ad1e50+8:301:x1830948734501888:12345-192.168.202.4@tcp:36:lfs.0 Request processed in 19789us (19949us total) trans 8589945531 rc 0/0 00000100:00100000:0.0:1746129583.782887:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11399 00000100:00100000:2.0:1746129583.783369:0:4385:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132dad000 going to sleep for 11 seconds 00000100:00100000:0.0:1746129583.787460:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129583.787784:0:4385:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009507df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:4385:1830948737657984:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129583.787799:0:4385:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009507d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:4385:1830948737658112:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129583.787841:0:4385:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fe03200/0x40a459093b06c1ec lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [4009984->4034559] (req 4009984->4034559) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22769 expref: 32 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129583.787860:0:4385:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe03200, rc 0) 00000100:00100000:2.0:1746129583.787919:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+32:306:x1830948734502144:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 6388us (7766us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129583.787928:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 17040 00000100:00100000:0.0:1746129583.788861:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129583.789122:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734502400 00000100:00100000:2.0:1746129583.789130:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734502400 00000100:00100000:2.0:1746129583.789673:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 17041 00000100:00100000:2.0:1746129583.789682:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ada2ffba-8920-4ecb-8068-68caa9806978+33:1961:x1830948734502400:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129583.789701:0:4385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129583.789718:0:4385:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fe03600/0x40a459093b06c1fa lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f22770 expref: -99 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129583.789741:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129583.789743:0:4385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129583.789752:0:4385:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fe03600/0x40a459093b06c1fa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22770 expref: 34 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129583.789767:0:4385:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fe03600/0x40a459093b06c1fa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22770 expref: 34 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129583.789776:0:4385:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe03600, rc 0) 00000100:00100000:2.0:1746129583.789815:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:ada2ffba-8920-4ecb-8068-68caa9806978+34:1961:x1830948734502400:12345-192.168.202.4@tcp:101:cat.0 Request processed in 135us (2369us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129583.789820:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 17041 00000100:00100000:0.0:1746129583.790727:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129583.790775:0:11014:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734502528 00000100:00100000:1.0:1746129583.790780:0:11014:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734502528 00000100:00100000:1.0:1746129583.790811:0:11014:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 17042 00000100:00100000:1.0:1746129583.790817:0:11014:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ada2ffba-8920-4ecb-8068-68caa9806978+37:1961:x1830948734502528:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1746129583.790827:0:11014:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129583.790840:0:11014:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5bbb200/0x40a459093b06c201 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f22777 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129583.790854:0:11014:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129583.790856:0:11014:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129583.790861:0:11014:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5bbb200/0x40a459093b06c201 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22777 expref: 38 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129583.790871:0:11014:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5bbb200/0x40a459093b06c201 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22777 expref: 38 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129583.790878:0:11014:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5bbb200, rc 0) 00000100:00100000:1.0:1746129583.790915:0:11014:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ada2ffba-8920-4ecb-8068-68caa9806978+38:1961:x1830948734502528:12345-192.168.202.4@tcp:101:cat.0 Request processed in 98us (2059us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129583.790920:0:11014:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 17042 00000100:00100000:0.0:1746129583.791066:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129583.791108:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129583.791122:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129583.791154:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00010000:00010000:3.0:1746129583.791166:0:3286:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88012984f800/0x40a459093b06c1e5 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00000100:00100000:0.0:1746129583.791174:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00010000:00010000:3.0:1746129583.791182:0:3286:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012984f800/0x40a459093b06c1e5 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129583.791189:0:3286:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012984f800/0x40a459093b06c1e5 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00000100:00100000:0.0:1746129583.791190:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734503424 00000100:00100000:0.0:1746129583.791193:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734503424 00010000:00010000:3.0:1746129583.791194:0:3286:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012984f800 already unused, calling callback (ffffffffa136e690) 00010000:00010000:3.0:1746129583.791211:0:3286:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012984f800/0x40a459093b06c1e5 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129583.791218:0:7087:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094bb3400/0x40a459093b06c0cd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f226f2 expref: 32 pid: 8411 timeout: 939 lvb_type: 0 00010000:00010000:3.0:1746129583.791222:0:3286:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012984f800/0x40a459093b06c1e5 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746129583.791237:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009cffe100) 00010000:00010000:3.0:1746129583.791240:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1746129583.791241:0:7087:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8825 00010000:00010000:3.0:1746129583.791243:0:3286:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012984f800/0x40a459093b06c1e5 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00000100:00100000:0.0:1746129583.791246:0:7087:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f324000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+32:1963:x1830948734503424:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129583.791248:0:3286:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012984f800/0x40a459093b06c1e5 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129583.791254:0:7087:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129583.791279:0:7087:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094bb3400/0x40a459093b06c0cd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f226f2 expref: 32 pid: 8411 timeout: 939 lvb_type: 0 00010000:00010000:0.0:1746129583.791288:0:7087:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094bb3400/0x40a459093b06c0cd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->5242879) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f226f2 expref: 32 pid: 8411 timeout: 939 lvb_type: 0 00010000:00010000:0.0:1746129583.791321:0:7087:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094bb3400/0x40a459093b06c0cd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->5242879) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f226f2 expref: 32 pid: 8411 timeout: 939 lvb_type: 0 00010000:00010000:0.0:1746129583.791333:0:7087:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129583.791351:0:7087:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f324000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+31:1963:x1830948734503424:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 105us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129583.791356:0:7087:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8825 00000100:00100000:2.0:1746129583.791412:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734502656 00000100:00100000:2.0:1746129583.791415:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734502656 00000100:00100000:2.0:1746129583.791427:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734502784 00000100:00100000:2.0:1746129583.791429:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734502784 00000100:00100000:2.0:1746129583.791437:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734502912 00000100:00100000:2.0:1746129583.791439:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734502912 00000100:00100000:2.0:1746129583.791452:0:7148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734503040 00000100:00100000:2.0:1746129583.791453:0:7148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734503040 00000100:00100000:2.0:1746129583.791464:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 17043 00000100:00100000:2.0:1746129583.791468:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ada2ffba-8920-4ecb-8068-68caa9806978+39:1961:x1830948734502656:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129583.791473:0:7148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129583.791480:0:7148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fe03a00/0x40a459093b06c208 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2277e expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129583.791490:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129583.791492:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129583.791496:0:7148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fe03a00/0x40a459093b06c208 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2277e expref: 40 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129583.791515:0:7148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fe03a00/0x40a459093b06c208 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2277e expref: 40 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129583.791521:0:7148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe03a00, rc 0) 00000100:00100000:2.0:1746129583.791535:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ada2ffba-8920-4ecb-8068-68caa9806978+40:1961:x1830948734502656:12345-192.168.202.4@tcp:101:cat.0 Request processed in 67us (812us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129583.791539:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 17043 00000100:00100000:2.0:1746129583.791546:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 17044 00000100:00100000:2.0:1746129583.791549:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ada2ffba-8920-4ecb-8068-68caa9806978+35:1961:x1830948734502784:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129583.791558:0:7148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129583.791565:0:7148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fe02400/0x40a459093b06c20f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f22785 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129583.791568:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 17045 00010000:00010000:2.0:1746129583.791574:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129583.791575:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129583.791579:0:7148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fe02400/0x40a459093b06c20f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22785 expref: 36 pid: 7148 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746129583.791581:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f325c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ada2ffba-8920-4ecb-8068-68caa9806978+36:1961:x1830948734502912:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129583.791587:0:7148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fe02400/0x40a459093b06c20f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22785 expref: 36 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129583.791593:0:7148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe02400, rc 0) 00010000:00010000:3.0:1746129583.791601:0:7149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746129583.791603:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ada2ffba-8920-4ecb-8068-68caa9806978+36:1961:x1830948734502784:12345-192.168.202.4@tcp:101:cat.0 Request processed in 53us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129583.791607:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 17044 00010000:00010000:3.0:1746129583.791614:0:7149:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fab4000/0x40a459093b06c216 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2278c expref: -99 pid: 7149 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129583.791615:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 17046 00000100:00100000:2.0:1746129583.791618:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f326300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ada2ffba-8920-4ecb-8068-68caa9806978+39:1961:x1830948734503040:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129583.791622:0:7148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129583.791627:0:7148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fe02a00/0x40a459093b06c21d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f22793 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129583.791633:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129583.791637:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129583.791638:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129583.791642:0:7149:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fab4000/0x40a459093b06c216 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2278c expref: 36 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129583.791642:0:7148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fe02a00/0x40a459093b06c21d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22793 expref: 40 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129583.791650:0:7148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fe02a00/0x40a459093b06c21d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22793 expref: 40 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129583.791653:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fab4000/0x40a459093b06c216 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2278c expref: 36 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129583.791657:0:7148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe02a00, rc 0) 00010000:00010000:3.0:1746129583.791660:0:7149:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fab4000, rc 0) 00000100:00100000:2.0:1746129583.791671:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f326300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ada2ffba-8920-4ecb-8068-68caa9806978+40:1961:x1830948734503040:12345-192.168.202.4@tcp:101:cat.0 Request processed in 52us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129583.791675:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 17046 00000100:00100000:3.0:1746129583.791703:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f325c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ada2ffba-8920-4ecb-8068-68caa9806978+35:1961:x1830948734502912:12345-192.168.202.4@tcp:101:cat.0 Request processed in 126us (594us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129583.791709:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 17045 00000100:00100000:0.0:1746129583.792025:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129583.792317:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734503296 00000100:00100000:2.0:1746129583.792322:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734503296 00010000:00010000:2.0:1746129583.792336:0:7087:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd18e00/0x40a459093b06c11a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22731 expref: 11 pid: 4699 timeout: 939 lvb_type: 1 00000100:00100000:2.0:1746129583.792359:0:7087:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8826 00000100:00100000:2.0:1746129583.792364:0:7087:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b553100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:068dab75-d300-4ead-a742-d14572ad1e50+11:1963:x1830948734503296:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129583.792372:0:7087:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129583.792383:0:7087:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fd18e00/0x40a459093b06c11a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22731 expref: 11 pid: 4699 timeout: 939 lvb_type: 1 00010000:00010000:2.0:1746129583.792393:0:7087:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fd18e00/0x40a459093b06c11a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22731 expref: 11 pid: 4699 timeout: 939 lvb_type: 1 00010000:00010000:2.0:1746129583.792405:0:7087:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fd18e00/0x40a459093b06c11a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22731 expref: 11 pid: 4699 timeout: 939 lvb_type: 1 00010000:00010000:2.0:1746129583.792418:0:7087:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129583.792419:0:7087:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129583.792424:0:7087:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fe03200/0x40a459093b06c1ec lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4009984->4034559) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22769 expref: 30 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129583.792436:0:7087:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fe03200/0x40a459093b06c1ec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4009984->4034559) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22769 expref: 30 pid: 4385 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129583.792585:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734503168 00000100:00100000:0.0:1746129583.792588:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734503168 00000100:00100000:0.0:1746129583.792613:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11401 00000100:00100000:0.0:1746129583.792618:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f324a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:068dab75-d300-4ead-a742-d14572ad1e50+7:301:x1830948734503168:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:0.0:1746129583.792634:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129583.792644:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1fa800/0x40a459093b06c224 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2279a expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129583.792697:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1fa800/0x40a459093b06c224 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2279a expref: 8 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129583.792708:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1fa800/0x40a459093b06c224 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2279a expref: 8 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129583.792722:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009cffe100) 00010000:00010000:0.0:1746129583.792725:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746129583.792728:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e1fa800, rc 0) 00010000:00010000:2.0:1746129583.792892:0:7087:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009fe03200/0x40a459093b06c1ec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4009984->4034559) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22769 expref: 30 pid: 4385 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129583.792904:0:7087:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009507d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7087:1830948737658240:192.168.202.4@tcp:105: 00000100:00100000:2.0:1746129583.793043:0:7087:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132dad000 going to sleep for 11 seconds 00000100:00100000:0.0:1746129583.793523:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f324a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:068dab75-d300-4ead-a742-d14572ad1e50+8:301:x1830948734503168:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 902us (2364us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129583.793529:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11401 00000100:00100000:2.0:1746129583.797911:0:7087:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009507d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7087:1830948737658240:192.168.202.4@tcp:105: 00010000:00010000:2.0:1746129583.797941:0:7087:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129583.798010:0:7087:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b553100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:068dab75-d300-4ead-a742-d14572ad1e50+10:1963:x1830948734503296:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 5643us (5983us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129583.798021:0:7087:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8826 00000100:00100000:0.0:1746129583.798785:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129583.799059:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129583.799086:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129583.799097:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129583.799107:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129583.799776:0:21463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734504448 00000100:00100000:2.0:1746129583.799786:0:21463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734504448 00002000:00100000:2.0:1746129583.799828:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3ef:0x0] (4009984->4014079) req@ffff88012b551500 x1830948734504448/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:324/0 lens 488/0 e 0 to 0 dl 1746129594 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129583.799837:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b551500 with x1830948734504448 ext(4009984->4014079) 00002000:00010000:2.0:1746129583.799842:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b551500 00000100:00100000:2.0:1746129583.799863:0:21463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8268 00000100:00100000:2.0:1746129583.799868:0:21463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b551500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+31:1960:x1830948734504448:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:2.0:1746129583.800045:0:21463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b551500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+31:1960:x1830948734504448:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 175us (1261us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129583.800054:0:21463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8268 00002000:00100000:2.0:1746129583.800059:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3ef:0x0] (4009984->4014079) req@ffff88012b551500 x1830948734504448/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:324/0 lens 488/4536 e 0 to 0 dl 1746129594 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129583.800064:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b551500 with x1830948734504448 ext(4009984->4014079) 00002000:00010000:2.0:1746129583.800067:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b551500 00000100:00100000:0.0:1746129583.800227:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129583.800967:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129583.800994:0:20577:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734503680 00000100:00100000:1.0:1746129583.801000:0:20577:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734503680 00000100:00100000:3.0:1746129583.801106:0:11014:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734503936 00000100:00100000:3.0:1746129583.801109:0:11014:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734503936 00000100:00100000:3.0:1746129583.801127:0:11014:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734504192 00000100:00100000:3.0:1746129583.801129:0:11014:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734504192 00000100:00100000:3.0:1746129583.801141:0:11014:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734503552 00000100:00100000:3.0:1746129583.801143:0:11014:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734503552 00000100:00100000:3.0:1746129583.801153:0:11014:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734503808 00000100:00100000:3.0:1746129583.801154:0:11014:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734503808 00000100:00100000:3.0:1746129583.801168:0:11014:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 17047 00000100:00100000:3.0:1746129583.801173:0:11014:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b551c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:068dab75-d300-4ead-a742-d14572ad1e50+13:1963:x1830948734503680:12345-192.168.202.4@tcp:2:lfs.0 00002000:00010000:3.0:1746129583.801380:0:11014:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746129583.801383:0:11014:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb mtime from disk: 1746129584 -> 1746129584 00002000:00010000:3.0:1746129583.801384:0:11014:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb atime from disk: 1746129582 -> 1746129584 00002000:00010000:3.0:1746129583.801386:0:11014:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb ctime from disk: 1746129584 -> 1746129584 00002000:00010000:3.0:1746129583.801387:0:11014:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:3.0:1746129583.801423:0:11014:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b551c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:068dab75-d300-4ead-a742-d14572ad1e50+14:1963:x1830948734503680:12345-192.168.202.4@tcp:2:lfs.0 Request processed in 249us (2363us total) trans 17179874234 rc 0/0 00000100:00100000:3.0:1746129583.801429:0:11014:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 17047 00000100:00100000:3.0:1746129583.801444:0:11014:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 17048 00000100:00100000:3.0:1746129583.801448:0:11014:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a77b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:068dab75-d300-4ead-a742-d14572ad1e50+11:1963:x1830948734503936:12345-192.168.202.4@tcp:2:lfs.0 00002000:00010000:3.0:1746129583.801542:0:11014:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746129583.801545:0:11014:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb mtime from disk: 1746129583 -> 1746129584 00002000:00010000:3.0:1746129583.801547:0:11014:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb atime from disk: 1746129583 -> 1746129584 00002000:00010000:3.0:1746129583.801549:0:11014:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb ctime from disk: 1746129583 -> 1746129584 00002000:00010000:3.0:1746129583.801551:0:11014:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:3.0:1746129583.801567:0:11014:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a77b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:068dab75-d300-4ead-a742-d14572ad1e50+12:1963:x1830948734503936:12345-192.168.202.4@tcp:2:lfs.0 Request processed in 119us (2481us total) trans 21474841486 rc 0/0 00000100:00100000:3.0:1746129583.801576:0:11014:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 17048 00000100:00100000:3.0:1746129583.801586:0:11014:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 17049 00000100:00100000:3.0:1746129583.801590:0:11014:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a77b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:068dab75-d300-4ead-a742-d14572ad1e50+13:1963:x1830948734504192:12345-192.168.202.4@tcp:2:lfs.0 00002000:00010000:3.0:1746129583.801652:0:11014:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3f5:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746129583.801654:0:11014:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f5:0x0] updating lvb mtime from disk: 1746129584 -> 1746129584 00002000:00010000:3.0:1746129583.801656:0:11014:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f5:0x0] updating lvb atime from disk: 1746129583 -> 1746129584 00002000:00010000:3.0:1746129583.801658:0:11014:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f5:0x0] updating lvb ctime from disk: 1746129584 -> 1746129584 00002000:00010000:3.0:1746129583.801659:0:11014:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f5:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:3.0:1746129583.801675:0:11014:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a77b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:068dab75-d300-4ead-a742-d14572ad1e50+14:1963:x1830948734504192:12345-192.168.202.4@tcp:2:lfs.0 Request processed in 84us (2576us total) trans 17179874235 rc 0/0 00000100:00100000:3.0:1746129583.801680:0:11014:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 17049 00000100:00100000:3.0:1746129583.801689:0:11014:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 17050 00000100:00100000:3.0:1746129583.801692:0:11014:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a77b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:068dab75-d300-4ead-a742-d14572ad1e50+11:1962:x1830948734503552:12345-192.168.202.4@tcp:2:lfs.0 00002000:00010000:3.0:1746129583.801751:0:11014:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3ec:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:3.0:1746129583.801754:0:11014:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ec:0x0] updating lvb mtime from disk: 1746129584 -> 1746129584 00002000:00010000:3.0:1746129583.801756:0:11014:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3ec:0x0] updating lvb atime from disk: 1746129583 -> 1746129584 00002000:00010000:3.0:1746129583.801758:0:11014:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ec:0x0] updating lvb ctime from disk: 1746129584 -> 1746129584 00002000:00010000:3.0:1746129583.801759:0:11014:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3ec:0x0] updating lvb blocks from disk: 2073 -> 2073 00000100:00100000:3.0:1746129583.801774:0:11014:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a77b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:068dab75-d300-4ead-a742-d14572ad1e50+12:1962:x1830948734503552:12345-192.168.202.4@tcp:2:lfs.0 Request processed in 81us (2665us total) trans 21474841487 rc 0/0 00000100:00100000:3.0:1746129583.801779:0:11014:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 17050 00000100:00100000:3.0:1746129583.801788:0:11014:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 17051 00000100:00100000:3.0:1746129583.801792:0:11014:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a77b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:068dab75-d300-4ead-a742-d14572ad1e50+13:1962:x1830948734503808:12345-192.168.202.4@tcp:2:lfs.0 00002000:00010000:3.0:1746129583.801850:0:11014:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746129583.801853:0:11014:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb mtime from disk: 1746129583 -> 1746129584 00002000:00010000:3.0:1746129583.801854:0:11014:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb atime from disk: 1746129583 -> 1746129584 00002000:00010000:3.0:1746129583.801856:0:11014:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb ctime from disk: 1746129583 -> 1746129584 00002000:00010000:3.0:1746129583.801858:0:11014:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:3.0:1746129583.801873:0:11014:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a77b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:068dab75-d300-4ead-a742-d14572ad1e50+14:1962:x1830948734503808:12345-192.168.202.4@tcp:2:lfs.0 Request processed in 80us (1647us total) trans 17179874236 rc 0/0 00000100:00100000:3.0:1746129583.801878:0:11014:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 17051 00000100:00100000:0.0:1746129583.802081:0:8410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734504064 00000100:00100000:0.0:1746129583.802086:0:8410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734504064 00000100:00100000:0.0:1746129583.802106:0:8410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 17052 00000100:00100000:0.0:1746129583.802111:0:8410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a77b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:068dab75-d300-4ead-a742-d14572ad1e50+12:1962:x1830948734504064:12345-192.168.202.4@tcp:2:lfs.0 00002000:00010000:0.0:1746129583.802177:0:8410:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb size from disk: 5146336 -> 5146336 00002000:00010000:0.0:1746129583.802180:0:8410:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb mtime from disk: 1746129584 -> 1746129584 00002000:00010000:0.0:1746129583.802181:0:8410:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb atime from disk: 1746129584 -> 1746129584 00002000:00010000:0.0:1746129583.802184:0:8410:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb ctime from disk: 1746129584 -> 1746129584 00002000:00010000:0.0:1746129583.802186:0:8410:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb blocks from disk: 6033 -> 6033 00000100:00100000:0.0:1746129583.802217:0:8410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a77b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:068dab75-d300-4ead-a742-d14572ad1e50+13:1962:x1830948734504064:12345-192.168.202.4@tcp:2:lfs.0 Request processed in 105us (1251us total) trans 21474841488 rc 0/0 00000100:00100000:0.0:1746129583.802221:0:8410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 17052 00000100:00100000:0.0:1746129583.804469:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129583.804573:0:8416:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734504704 00000100:00100000:2.0:1746129583.804582:0:8416:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734504704 00002000:00100000:2.0:1746129583.804617:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3ef:0x0] (4030464->4034559) req@ffff88008f449500 x1830948734504704/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:324/0 lens 488/0 e 0 to 0 dl 1746129594 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129583.804627:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f449500 with x1830948734504704 ext(4030464->4034559) 00002000:00010000:2.0:1746129583.804633:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f449500 00000100:00100000:2.0:1746129583.804650:0:8416:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8269 00000100:00100000:2.0:1746129583.804655:0:8416:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f449500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+31:1960:x1830948734504704:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:2.0:1746129583.805070:0:8416:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f449500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+31:1960:x1830948734504704:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 412us (606us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129583.805076:0:8416:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8269 00002000:00100000:2.0:1746129583.805083:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3ef:0x0] (4030464->4034559) req@ffff88008f449500 x1830948734504704/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:324/0 lens 488/4536 e 0 to 0 dl 1746129594 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129583.805090:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f449500 with x1830948734504704 ext(4030464->4034559) 00002000:00010000:2.0:1746129583.805093:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f449500 00000100:00100000:0.0:1746129583.808920:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129583.810361:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129583.810465:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129583.810622:0:14551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734504960 00000100:00100000:1.0:1746129583.810632:0:14551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734504960 00000100:00100000:3.0:1746129583.810707:0:8416:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734505472 00000100:00100000:3.0:1746129583.810710:0:8416:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734505472 00002000:00100000:3.0:1746129583.810744:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3ec:0x0] (0->1048575) req@ffff88008f44b100 x1830948734505472/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:324/0 lens 488/0 e 0 to 0 dl 1746129594 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129583.810752:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f44b100 with x1830948734505472 ext(0->1048575) 00002000:00010000:3.0:1746129583.810758:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f44b100 00000100:00100000:3.0:1746129583.810775:0:8416:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8270 00000100:00100000:3.0:1746129583.810781:0:8416:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f44b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ada2ffba-8920-4ecb-8068-68caa9806978+35:1960:x1830948734505472:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:1.0:1746129583.811066:0:14551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734505216 00000100:00100000:1.0:1746129583.811069:0:14551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734505216 00000100:00100000:2.0:1746129583.811070:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4868 00000100:00100000:2.0:1746129583.811080:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f449180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+7:306:x1830948734504960:12345-192.168.202.4@tcp:35:multiop.0 00000100:00100000:1.0:1746129583.811089:0:14551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4869 00000100:00100000:1.0:1746129583.811094:0:14551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f448380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:068dab75-d300-4ead-a742-d14572ad1e50+8:301:x1830948734505216:12345-192.168.202.4@tcp:35:lfs.0 00000100:00100000:1.0:1746129583.811327:0:14551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f448380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:068dab75-d300-4ead-a742-d14572ad1e50+9:301:x1830948734505216:12345-192.168.202.4@tcp:35:lfs.0 Request processed in 231us (971us total) trans 8589945532 rc 0/0 00000100:00100000:1.0:1746129583.811333:0:14551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4869 00000100:00100000:1.0:1746129583.811389:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f449180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+8:306:x1830948734504960:12345-192.168.202.4@tcp:35:multiop.0 Request processed in 312us (2479us total) trans 8589945533 rc 0/0 00000100:00100000:1.0:1746129583.811398:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4868 00000100:00100000:2.0:1746129583.818271:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129583.818349:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129583.818376:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129583.818542:0:21725:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734505856 00000100:00100000:1.0:1746129583.818552:0:21725:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734505856 00002000:00100000:1.0:1746129583.818603:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff88009507d180 x1830948734505856/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:324/0 lens 488/0 e 0 to 0 dl 1746129594 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129583.818614:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009507d180 with x1830948734505856 ext(1048576->2097151) 00002000:00010000:1.0:1746129583.818619:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009507d180 00000100:00100000:1.0:1746129583.818636:0:21725:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734505984 00000100:00100000:1.0:1746129583.818639:0:21725:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734505984 00002000:00100000:1.0:1746129583.818647:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f4:0x0] (1048576->2097151) req@ffff88009507df80 x1830948734505984/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:324/0 lens 488/0 e 0 to 0 dl 1746129594 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129583.818653:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009507df80 with x1830948734505984 ext(1048576->2097151) 00002000:00010000:1.0:1746129583.818656:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009507df80 00000100:00100000:3.0:1746129583.818665:0:31519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734506240 00000100:00100000:1.0:1746129583.818668:0:21725:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8271 00000100:00100000:3.0:1746129583.818669:0:31519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734506240 00000100:00100000:1.0:1746129583.818675:0:21725:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009507d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ada2ffba-8920-4ecb-8068-68caa9806978+41:1961:x1830948734505856:12345-192.168.202.4@tcp:3:cat.0 00002000:00100000:3.0:1746129583.818691:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3ee:0x0] (1048576->2097151) req@ffff88009507c700 x1830948734506240/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:324/0 lens 488/0 e 0 to 0 dl 1746129594 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129583.818699:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009507c700 with x1830948734506240 ext(1048576->2097151) 00002000:00010000:3.0:1746129583.818702:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009507c700 00000100:00100000:3.0:1746129583.818716:0:31519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8272 00000100:00100000:3.0:1746129583.818721:0:31519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009507df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ada2ffba-8920-4ecb-8068-68caa9806978+41:1961:x1830948734505984:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129583.818874:0:21463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8273 00000100:00100000:0.0:1746129583.818883:0:21463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009507c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ada2ffba-8920-4ecb-8068-68caa9806978+37:1961:x1830948734506240:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:1.0:1746129583.822715:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129583.822752:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734506496 00000100:00100000:1.0:1746129583.822760:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734506496 00000100:00100000:1.0:1746129583.822800:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4870 00000100:00100000:1.0:1746129583.822808:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013145d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:068dab75-d300-4ead-a742-d14572ad1e50+9:301:x1830948734506496:12345-192.168.202.4@tcp:35:lfs.0 00000100:00100000:1.0:1746129583.823027:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013145d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:068dab75-d300-4ead-a742-d14572ad1e50+10:301:x1830948734506496:12345-192.168.202.4@tcp:35:lfs.0 Request processed in 219us (323us total) trans 8589945534 rc 0/0 00000100:00100000:1.0:1746129583.823034:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4870 00000100:00100000:3.0:1746129583.840621:0:8416:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f44b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ada2ffba-8920-4ecb-8068-68caa9806978+37:1960:x1830948734505472:12345-192.168.202.4@tcp:3:cat.0 Request processed in 29826us (30143us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129583.840634:0:8416:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8270 00002000:00100000:3.0:1746129583.840648:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3ec:0x0] (0->1048575) req@ffff88008f44b100 x1830948734505472/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:324/0 lens 488/440 e 0 to 0 dl 1746129594 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129583.840656:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f44b100 with x1830948734505472 ext(0->1048575) 00002000:00010000:3.0:1746129583.840663:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f44b100 00000100:00100000:0.0:1746129583.849479:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129583.849510:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734506752 00000100:00100000:0.0:1746129583.849519:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734506752 00000100:00100000:0.0:1746129583.849585:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11402 00000100:00100000:0.0:1746129583.849592:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f449880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+8:317:x1830948734506752:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1746129583.849621:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746129583.849853:0:21725:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009507d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ada2ffba-8920-4ecb-8068-68caa9806978+42:1961:x1830948734505856:12345-192.168.202.4@tcp:3:cat.0 Request processed in 31176us (31592us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129583.849863:0:21725:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8271 00002000:00100000:1.0:1746129583.849871:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff88009507d180 x1830948734505856/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:324/0 lens 488/440 e 0 to 0 dl 1746129594 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129583.849882:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009507d180 with x1830948734505856 ext(1048576->2097151) 00002000:00010000:1.0:1746129583.849887:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009507d180 00010000:00010000:0.0:1746129583.850262:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa7e000/0x40a459093b06c22b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f227a1 expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129583.850419:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa7f200/0x40a459093b06c232 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129583.850432:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa7f200/0x40a459093b06c232 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129583.850444:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa7f200/0x40a459093b06c232 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129583.850459:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f458e00/0x40a459093b06c239 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129583.850464:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f458e00/0x40a459093b06c239 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129583.850469:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f458e00/0x40a459093b06c239 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129583.850575:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f458c00/0x40a459093b06c240 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129583.850582:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f458c00/0x40a459093b06c240 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129583.850588:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f458c00/0x40a459093b06c240 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00200000:0.0:1746129583.850596:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:0.0:1746129583.850679:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa7f200/0x40a459093b06c232 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129583.850686:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa7f200/0x40a459093b06c232 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129583.850692:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa7f200/0x40a459093b06c232 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129583.850698:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fa7f200 already unused, calling callback (ffffffffa136e690) 00010000:00010000:0.0:1746129583.850701:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa7f200/0x40a459093b06c232 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129583.850708:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa7f200/0x40a459093b06c232 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129583.850720:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880132ef8f00) 00010000:00010000:0.0:1746129583.850723:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129583.850729:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa7f200/0x40a459093b06c232 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129583.850734:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa7f200/0x40a459093b06c232 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129583.850762:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f458e00/0x40a459093b06c239 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129583.850767:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f458e00/0x40a459093b06c239 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129583.850772:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f458e00/0x40a459093b06c239 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129583.850776:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f458e00 already unused, calling callback (ffffffffa136e690) 00010000:00010000:0.0:1746129583.850778:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f458e00/0x40a459093b06c239 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129583.850783:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f458e00/0x40a459093b06c239 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129583.850789:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880090643400) 00010000:00010000:0.0:1746129583.850791:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129583.850793:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f458e00/0x40a459093b06c239 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129583.850796:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f458e00/0x40a459093b06c239 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746129583.851105:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa7e000/0x40a459093b06c22b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f227a1 expref: 11 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129583.851122:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f458c00/0x40a459093b06c240 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f227a1 expref: 10 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129583.851128:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009cffe100) 00010000:00010000:0.0:1746129583.851131:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746129583.851134:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f458c00, rc 0) 00000100:00100000:0.0:1746129583.851168:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f449880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+10:317:x1830948734506752:12345-192.168.202.4@tcp:101:cat.0 Request processed in 1575us (1700us total) trans 8589945535 rc 0/0 00000100:00100000:0.0:1746129583.851176:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11402 00000100:00100000:2.0:1746129583.868450:0:21463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009507c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ada2ffba-8920-4ecb-8068-68caa9806978+35:1961:x1830948734506240:12345-192.168.202.4@tcp:3:cat.0 Request processed in 49552us (50056us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129583.868465:0:21463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8273 00002000:00100000:2.0:1746129583.868480:0:21463:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3ee:0x0] (1048576->2097151) req@ffff88009507c700 x1830948734506240/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:324/0 lens 488/440 e 0 to 0 dl 1746129594 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129583.868490:0:21463:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009507c700 with x1830948734506240 ext(1048576->2097151) 00002000:00010000:2.0:1746129583.868497:0:21463:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009507c700 00000100:00100000:3.0:1746129583.872234:0:31519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009507df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ada2ffba-8920-4ecb-8068-68caa9806978+40:1961:x1830948734505984:12345-192.168.202.4@tcp:3:cat.0 Request processed in 53499us (53870us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129583.872246:0:31519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8272 00002000:00100000:3.0:1746129583.872259:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f4:0x0] (1048576->2097151) req@ffff88009507df80 x1830948734505984/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:324/0 lens 488/440 e 0 to 0 dl 1746129594 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129583.872269:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009507df80 with x1830948734505984 ext(1048576->2097151) 00002000:00010000:3.0:1746129583.872276:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009507df80 00000100:00100000:0.0:1746129583.883288:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129583.884153:0:11014:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734506880 00000100:00100000:3.0:1746129583.884165:0:11014:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734506880 00000100:00100000:3.0:1746129583.884523:0:11014:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 17053 00000100:00100000:3.0:1746129583.884533:0:11014:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f44ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ada2ffba-8920-4ecb-8068-68caa9806978+35:311:x1830948734506880:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129583.884556:0:11014:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129583.884574:0:11014:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fab5e00/0x40a459093b06c24e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f227a8 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129583.884682:0:11014:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fe03200/0x40a459093b06c1ec lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4009984->4034559) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22769 expref: 30 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129583.884700:0:11014:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129583.884702:0:11014:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129583.884706:0:11014:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fab5e00/0x40a459093b06c24e lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f227a8 expref: 36 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129583.884751:0:11014:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fe03200/0x40a459093b06c1ec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4009984->4034559) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22769 expref: 30 pid: 4385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129583.884764:0:11014:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fe03200/0x40a459093b06c1ec lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4009984->4034559) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22769 expref: 30 pid: 4385 timeout: 939 lvb_type: 0 00000100:00100000:3.0:1746129583.884779:0:11014:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094067100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11014:1830948737658368:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129583.886566:0:11014:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5c68f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746129583.890758:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129583.890805:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129583.890830:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129583.890851:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129583.890955:0:31519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734507136 00000100:00100000:3.0:1746129583.890966:0:31519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734507136 00002000:00100000:3.0:1746129583.891018:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3ec:0x0] (0->1048575) req@ffff88012baed500 x1830948734507136/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:324/0 lens 488/0 e 0 to 0 dl 1746129594 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129583.891028:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012baed500 with x1830948734507136 ext(0->1048575) 00002000:00010000:3.0:1746129583.891034:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012baed500 00000100:00100000:3.0:1746129583.891053:0:31519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734507392 00000100:00100000:3.0:1746129583.891055:0:31519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734507392 00002000:00100000:3.0:1746129583.891067:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff88012baef800 x1830948734507392/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:324/0 lens 488/0 e 0 to 0 dl 1746129594 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129583.891075:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012baef800 with x1830948734507392 ext(1048576->2097151) 00002000:00010000:3.0:1746129583.891079:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012baef800 00000100:00100000:3.0:1746129583.891087:0:31519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734507648 00000100:00100000:3.0:1746129583.891089:0:31519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734507648 00002000:00100000:3.0:1746129583.891097:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f4:0x0] (1048576->2097151) req@ffff88012baef480 x1830948734507648/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:324/0 lens 488/0 e 0 to 0 dl 1746129594 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129583.891103:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012baef480 with x1830948734507648 ext(1048576->2097151) 00002000:00010000:3.0:1746129583.891106:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012baef480 00000100:00100000:3.0:1746129583.891122:0:31519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734507904 00000100:00100000:3.0:1746129583.891124:0:31519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734507904 00002000:00100000:3.0:1746129583.891134:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3ee:0x0] (1048576->2097151) req@ffff88009f37c000 x1830948734507904/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:324/0 lens 488/0 e 0 to 0 dl 1746129594 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129583.891141:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f37c000 with x1830948734507904 ext(1048576->2097151) 00002000:00010000:3.0:1746129583.891144:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f37c000 00000100:00100000:3.0:1746129583.891163:0:31522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8274 00000100:00100000:3.0:1746129583.891170:0:31522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+32:1962:x1830948734507136:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129583.892322:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129583.892342:0:14545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734508160 00000100:00100000:0.0:1746129583.892346:0:14545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734508160 00000100:00100000:0.0:1746129583.892372:0:14545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 223 00000100:00100000:0.0:1746129583.892378:0:14545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c767050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8b5f81a-2f18-4d7f-accf-308742f5a04f+15:1963:x1830948734508160:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:0.0:1746129583.892427:0:14545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c767050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8b5f81a-2f18-4d7f-accf-308742f5a04f+15:1963:x1830948734508160:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 49us (112us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129583.892433:0:14545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 223 00000100:00100000:0.0:1746129583.892490:0:11014:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094067100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11014:1830948737658368:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129583.892524:0:11014:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fab5e00/0x40a459093b06c24e lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f227a8 expref: 36 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129583.892545:0:11014:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fab5e00, rc 0) 00000100:00100000:0.0:1746129583.892563:0:11014:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f44ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ada2ffba-8920-4ecb-8068-68caa9806978+36:311:x1830948734506880:12345-192.168.202.4@tcp:101:cat.0 Request processed in 8033us (9289us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129583.892569:0:11014:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 17053 00000100:00100000:0.0:1746129583.893681:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129583.893871:0:31518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734508032 00000100:00100000:0.0:1746129583.893876:0:31518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734508032 00002000:00100000:0.0:1746129583.893905:0:31518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3ef:0x0] (4009984->4034559) req@ffff88009f37e680 x1830948734508032/t0(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:324/0 lens 488/0 e 0 to 0 dl 1746129594 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129583.893915:0:31518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f37e680 with x1830948734508032 ext(4009984->4034559) 00010000:00010000:0.0:1746129583.893921:0:31518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fe03200/0x40a459093b06c1ec lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4009984->4034559) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22769 expref: 34 pid: 4385 timeout: 939 lvb_type: 0 00010000:00010000:0.0:1746129583.893934:0:31518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fe03200/0x40a459093b06c1ec lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4009984->4034559) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22769 expref: 34 pid: 4385 timeout: 939 lvb_type: 0 00002000:00010000:0.0:1746129583.893940:0:31518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f37e680 00000100:00100000:0.0:1746129583.893954:0:31518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2558 00000100:00100000:0.0:1746129583.893959:0:31518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f37e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+34:1960:x1830948734508032:12345-192.168.202.4@tcp:4:cat.0 00000100:00100000:0.0:1746129583.894100:0:31520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8275 00000100:00100000:0.0:1746129583.894106:0:31520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+31:1962:x1830948734507392:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:2.0:1746129583.894729:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8276 00000100:00100000:2.0:1746129583.894740:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+31:1962:x1830948734507648:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:1.0:1746129583.896856:0:21725:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8277 00000100:00100000:1.0:1746129583.896873:0:21725:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f37c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+35:1962:x1830948734507904:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1746129583.903813:0:31518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f37e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+37:1960:x1830948734508032:12345-192.168.202.4@tcp:4:cat.0 Request processed in 9839us (10124us total) trans 21474841489 rc 0/0 00000100:00100000:0.0:1746129583.903831:0:31518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2558 00002000:00100000:0.0:1746129583.903845:0:31518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3ef:0x0] (4009984->4034559) req@ffff88009f37e680 x1830948734508032/t21474841489(0) o4->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:324/0 lens 488/448 e 0 to 0 dl 1746129594 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129583.903854:0:31518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f37e680 with x1830948734508032 ext(4009984->4034559) 00010000:00010000:0.0:1746129583.903866:0:31518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fe03200/0x40a459093b06c1ec lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4009984->4034559) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22769 expref: 37 pid: 4385 timeout: 939 lvb_type: 0 00010000:00010000:0.0:1746129583.903883:0:31518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fe03200/0x40a459093b06c1ec lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4009984->4034559) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22769 expref: 37 pid: 4385 timeout: 939 lvb_type: 0 00002000:00010000:0.0:1746129583.903890:0:31518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f37e680 00000100:00100000:0.0:1746129583.910887:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129583.910926:0:11014:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734508288 00000100:00100000:0.0:1746129583.910936:0:11014:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734508288 00000100:00100000:0.0:1746129583.911003:0:11014:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 17054 00000100:00100000:0.0:1746129583.911010:0:11014:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f37c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ada2ffba-8920-4ecb-8068-68caa9806978+40:308:x1830948734508288:12345-192.168.202.4@tcp:101:multiop.0 00010000:00010000:0.0:1746129583.911033:0:11014:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129583.911050:0:11014:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f459c00/0x40a459093b06c255 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f227af expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129583.911080:0:11014:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f84c000/0x40a459093b06c0e2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22700 expref: 33 pid: 8411 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129583.911089:0:11014:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5bbb200/0x40a459093b06c201 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22777 expref: 41 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129583.911101:0:11014:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fd19200/0x40a459093b06c10c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2271c expref: 13 pid: 4699 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129583.911107:0:11014:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129583.911109:0:11014:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129583.911112:0:11014:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f459c00/0x40a459093b06c255 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [1187840->2052095] (req 1187840->2052095) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f227af expref: 41 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129583.911146:0:11014:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fd19200/0x40a459093b06c10c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2271c expref: 13 pid: 4699 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129583.911156:0:11014:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fd19200/0x40a459093b06c10c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2271c expref: 13 pid: 4699 timeout: 939 lvb_type: 1 00000100:00100000:0.0:1746129583.911168:0:11014:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f37fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11014:1830948737658496:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129583.911260:0:11014:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5bbb200/0x40a459093b06c201 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22777 expref: 41 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129583.911269:0:11014:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5bbb200/0x40a459093b06c201 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22777 expref: 41 pid: 11014 timeout: 939 lvb_type: 1 00000100:00100000:0.0:1746129583.911277:0:11014:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7d9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11014:1830948737658624:192.168.202.4@tcp:104: 00010000:00010000:0.0:1746129583.911343:0:11014:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f84c000/0x40a459093b06c0e2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22700 expref: 33 pid: 8411 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129583.911355:0:11014:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f84c000/0x40a459093b06c0e2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22700 expref: 33 pid: 8411 timeout: 939 lvb_type: 1 00000100:00100000:0.0:1746129583.911363:0:11014:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7db480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11014:1830948737658752:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129583.911379:0:11014:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a6ce89c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746129583.912856:0:21725:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f37c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+35:1962:x1830948734507904:12345-192.168.202.4@tcp:3:cat.0 Request processed in 15981us (21994us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129583.912867:0:21725:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8277 00002000:00100000:1.0:1746129583.912879:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ee:0x0] (1048576->2097151) req@ffff88009f37c000 x1830948734507904/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:324/0 lens 488/440 e 0 to 0 dl 1746129594 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129583.912888:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f37c000 with x1830948734507904 ext(1048576->2097151) 00002000:00010000:1.0:1746129583.912894:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f37c000 00000100:00100000:1.0:1746129583.914360:0:11014:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f37fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11014:1830948737658496:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129583.914375:0:11014:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7d9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11014:1830948737658624:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129583.914383:0:11014:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7db480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11014:1830948737658752:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129583.914418:0:11014:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f459c00/0x40a459093b06c255 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [1187840->2052095] (req 1187840->2052095) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f227af expref: 41 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129583.914436:0:11014:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f459c00, rc 0) 00000100:00100000:1.0:1746129583.914488:0:11014:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f37c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ada2ffba-8920-4ecb-8068-68caa9806978+41:308:x1830948734508288:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 3476us (3612us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129583.914498:0:11014:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 17054 00000100:00100000:0.0:1746129583.916463:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129583.916508:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129583.916582:0:15749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734508416 00000100:00100000:3.0:1746129583.916594:0:15749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734508416 00010000:00010000:3.0:1746129583.916635:0:15749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fe03200/0x40a459093b06c1ec lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4009984->4034559) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22769 expref: 35 pid: 4385 timeout: 939 lvb_type: 0 00000100:00100000:3.0:1746129583.916664:0:15749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734508544 00000100:00100000:3.0:1746129583.916666:0:15749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734508544 00010000:00010000:3.0:1746129583.916675:0:15749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fd19200/0x40a459093b06c10c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2271c expref: 14 pid: 4699 timeout: 939 lvb_type: 1 00000100:00100000:3.0:1746129583.916708:0:15749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8827 00000100:00100000:3.0:1746129583.916714:0:15749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+35:1963:x1830948734508416:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129583.916735:0:15749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129583.916758:0:15749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fe03200/0x40a459093b06c1ec lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4009984->4034559) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22769 expref: 35 pid: 4385 timeout: 939 lvb_type: 0 00010000:00010000:3.0:1746129583.916768:0:15749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fe03200/0x40a459093b06c1ec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4009984->4034559) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22769 expref: 35 pid: 4385 timeout: 939 lvb_type: 0 00010000:00010000:3.0:1746129583.916797:0:15749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fe03200/0x40a459093b06c1ec lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4009984->4034559) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f22769 expref: 35 pid: 4385 timeout: 939 lvb_type: 0 00010000:00010000:3.0:1746129583.916817:0:15749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129583.916820:0:15749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129583.916828:0:15749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fab5e00/0x40a459093b06c24e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f227a8 expref: 35 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129583.916836:0:15749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fab5e00/0x40a459093b06c24e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f227a8 expref: 35 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129583.916872:0:15749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009fab5e00/0x40a459093b06c24e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f227a8 expref: 35 pid: 11014 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129583.916884:0:15749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094065f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15749:1830948737658880:192.168.202.4@tcp:105: 00000100:00100000:3.0:1746129583.916972:0:15749:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5c68540 going to sleep for 11 seconds 00000100:00100000:0.0:1746129583.916993:0:31522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+33:1962:x1830948734507136:12345-192.168.202.4@tcp:3:cat.0 Request processed in 25822us (26246us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129583.916995:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8828 00000100:00100000:3.0:1746129583.917000:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7dad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:068dab75-d300-4ead-a742-d14572ad1e50+14:1963:x1830948734508544:12345-192.168.202.4@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746129583.917003:0:31522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8274 00010000:00010000:3.0:1746129583.917010:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00100000:0.0:1746129583.917014:0:31522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3ec:0x0] (0->1048575) req@ffff88012baed500 x1830948734507136/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:324/0 lens 488/440 e 0 to 0 dl 1746129594 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129583.917023:0:31522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012baed500 with x1830948734507136 ext(0->1048575) 00010000:00010000:3.0:1746129583.917027:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fd19200/0x40a459093b06c10c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2271c expref: 14 pid: 4699 timeout: 939 lvb_type: 1 00002000:00010000:0.0:1746129583.917028:0:31522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012baed500 00010000:00010000:3.0:1746129583.917035:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fd19200/0x40a459093b06c10c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2271c expref: 14 pid: 4699 timeout: 939 lvb_type: 1 00010000:00010000:3.0:1746129583.917048:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fd19200/0x40a459093b06c10c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2271c expref: 14 pid: 4699 timeout: 939 lvb_type: 1 00010000:00010000:3.0:1746129583.917057:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129583.917072:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7dad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:068dab75-d300-4ead-a742-d14572ad1e50+13:1963:x1830948734508544:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 72us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129583.917078:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8828 00000100:00100000:1.0:1746129583.918358:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129583.918422:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734508672 00000100:00100000:2.0:1746129583.918430:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734508672 00010000:00010000:2.0:1746129583.918459:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5bbb200/0x40a459093b06c201 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22777 expref: 41 pid: 11014 timeout: 939 lvb_type: 1 00000100:00100000:2.0:1746129583.918496:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8829 00000100:00100000:2.0:1746129583.918504:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a44c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ada2ffba-8920-4ecb-8068-68caa9806978+41:1962:x1830948734508672:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129583.918513:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129583.918525:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5bbb200/0x40a459093b06c201 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22777 expref: 41 pid: 11014 timeout: 939 lvb_type: 1 00010000:00010000:2.0:1746129583.918534:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5bbb200/0x40a459093b06c201 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22777 expref: 41 pid: 11014 timeout: 939 lvb_type: 1 00010000:00010000:2.0:1746129583.918549:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5bbb200/0x40a459093b06c201 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22777 expref: 41 pid: 11014 timeout: 939 lvb_type: 1 00010000:00010000:2.0:1746129583.918573:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129583.918603:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a44c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ada2ffba-8920-4ecb-8068-68caa9806978+40:1962:x1830948734508672:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 100us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129583.918610:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8829 00000100:00100000:3.0:1746129583.924753:0:15749:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094065f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15749:1830948737658880:192.168.202.4@tcp:105: 00010000:00010000:3.0:1746129583.924782:0:15749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129583.924846:0:15749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+32:1963:x1830948734508416:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 8129us (8391us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129583.924859:0:15749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8827 00000100:00100000:2.0:1746129583.925753:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+32:1962:x1830948734507648:12345-192.168.202.4@tcp:3:cat.0 Request processed in 31011us (34917us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129583.925764:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8276 00002000:00100000:2.0:1746129583.925776:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f4:0x0] (1048576->2097151) req@ffff88012baef480 x1830948734507648/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:324/0 lens 488/440 e 0 to 0 dl 1746129594 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129583.925786:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012baef480 with x1830948734507648 ext(1048576->2097151) 00002000:00010000:2.0:1746129583.925792:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012baef480 00000100:00100000:0.0:1746129583.930179:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129583.930231:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129583.931077:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734508928 00000100:00100000:2.0:1746129583.931088:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734508928 00000100:00100000:0.0:1746129583.931095:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00002000:00100000:2.0:1746129583.931137:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ef:0x0] (2097152->3145727) req@ffff88009c7d8700 x1830948734508928/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:324/0 lens 488/0 e 0 to 0 dl 1746129594 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129583.931147:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7d8700 with x1830948734508928 ext(2097152->3145727) 00002000:00010000:2.0:1746129583.931153:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c7d8700 00000100:00100000:0.0:1746129583.931627:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129583.932000:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734509440 00000100:00100000:1.0:1746129583.932001:0:31522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734509184 00000100:00100000:2.0:1746129583.932005:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734509440 00000100:00100000:1.0:1746129583.932005:0:31522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734509184 00002000:00100000:2.0:1746129583.932026:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f5:0x0] (2097152->3145727) req@ffff88009c7d9c00 x1830948734509440/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:324/0 lens 488/0 e 0 to 0 dl 1746129594 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129583.932026:0:31522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->4194303) req@ffff88009c7d9880 x1830948734509184/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:324/0 lens 488/0 e 0 to 0 dl 1746129594 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129583.932034:0:31522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7d9880 with x1830948734509184 ext(3145728->4194303) 00002000:00010000:1.0:1746129583.932037:0:31522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c7d9880 00002000:00100000:2.0:1746129583.932039:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7d9c00 with x1830948734509440 ext(2097152->3145727) 00002000:00010000:2.0:1746129583.932042:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c7d9c00 00000100:00100000:1.0:1746129583.932055:0:31522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734509696 00000100:00100000:1.0:1746129583.932057:0:31522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734509696 00000100:00100000:2.0:1746129583.932060:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8278 00002000:00100000:1.0:1746129583.932065:0:31522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f5:0x0] (3145728->4194303) req@ffff88009c7dad80 x1830948734509696/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:324/0 lens 488/0 e 0 to 0 dl 1746129594 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:2.0:1746129583.932067:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+37:1960:x1830948734508928:12345-192.168.202.4@tcp:3:multiop.0 00002000:00100000:1.0:1746129583.932071:0:31522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7dad80 with x1830948734509696 ext(3145728->4194303) 00002000:00010000:1.0:1746129583.932073:0:31522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c7dad80 00000100:00100000:1.0:1746129583.932082:0:31522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8279 00000100:00100000:1.0:1746129583.932086:0:31522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ada2ffba-8920-4ecb-8068-68caa9806978+37:1960:x1830948734509184:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:2.0:1746129583.932139:0:31519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8280 00000100:00100000:2.0:1746129583.932144:0:31519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ada2ffba-8920-4ecb-8068-68caa9806978+41:1960:x1830948734509440:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:0.0:1746129583.933157:0:31518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8281 00000100:00100000:0.0:1746129583.933167:0:31518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ada2ffba-8920-4ecb-8068-68caa9806978+42:1960:x1830948734509696:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:2.0:1746129583.934399:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129583.934424:0:11014:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734509824 00000100:00100000:2.0:1746129583.934430:0:11014:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734509824 00000100:00100000:2.0:1746129583.934471:0:11014:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 17055 00000100:00100000:2.0:1746129583.934477:0:11014:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009507fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+32:317:x1830948734509824:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129583.934488:0:11014:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129583.934505:0:11014:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095d83000/0x40a459093b06c25c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f227b6 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129583.934530:0:11014:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129583.934536:0:11014:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f459c00/0x40a459093b06c255 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [1187840->2052095] (req 1187840->2052095) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f227af expref: 43 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129583.934542:0:11014:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129583.934545:0:11014:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095d83000/0x40a459093b06c25c lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f227b6 expref: 33 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129583.934581:0:11014:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f459c00/0x40a459093b06c255 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [1187840->2052095] (req 1187840->2052095) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f227af expref: 43 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129583.934599:0:11014:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095d83000/0x40a459093b06c25c lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f227b6 expref: 33 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129583.934610:0:11014:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095d83000, rc 0) 00000100:00100000:2.0:1746129583.934644:0:11014:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009507fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+33:317:x1830948734509824:12345-192.168.202.4@tcp:101:cat.0 Request processed in 167us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129583.934649:0:11014:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 17055 00000100:00100000:2.0:1746129583.934978:0:31520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+31:1962:x1830948734507392:12345-192.168.202.4@tcp:3:cat.0 Request processed in 40871us (44172us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129583.934985:0:31520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8275 00002000:00100000:2.0:1746129583.934994:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff88012baef800 x1830948734507392/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:324/0 lens 488/440 e 0 to 0 dl 1746129594 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129583.935002:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012baef800 with x1830948734507392 ext(1048576->2097151) 00010000:00010000:2.0:1746129583.935008:0:31520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f84c000/0x40a459093b06c0e2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22700 expref: 31 pid: 8411 timeout: 939 lvb_type: 1 00010000:00010000:2.0:1746129583.935021:0:31520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f84c000/0x40a459093b06c0e2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22700 expref: 31 pid: 8411 timeout: 939 lvb_type: 1 00002000:00010000:2.0:1746129583.935026:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012baef800 00000100:00100000:0.0:1746129583.939657:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129583.939735:0:15749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734509952 00000100:00100000:3.0:1746129583.939745:0:15749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734509952 00010000:00010000:3.0:1746129583.939787:0:15749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f84c000/0x40a459093b06c0e2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22700 expref: 31 pid: 8411 timeout: 939 lvb_type: 1 00000100:00100000:3.0:1746129583.939836:0:15749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8830 00000100:00100000:3.0:1746129583.939846:0:15749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+31:1960:x1830948734509952:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129583.939862:0:15749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129583.939887:0:15749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f84c000/0x40a459093b06c0e2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22700 expref: 31 pid: 8411 timeout: 939 lvb_type: 1 00010000:00010000:3.0:1746129583.939903:0:15749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f84c000/0x40a459093b06c0e2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22700 expref: 31 pid: 8411 timeout: 939 lvb_type: 1 00010000:00010000:3.0:1746129583.939928:0:15749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f84c000/0x40a459093b06c0e2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22700 expref: 31 pid: 8411 timeout: 939 lvb_type: 1 00010000:00010000:3.0:1746129583.939956:0:15749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129583.939958:0:15749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129583.939965:0:15749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f459c00/0x40a459093b06c255 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1187840->2052095) gid 0 flags: 0x60080000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f227af expref: 43 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129583.939974:0:15749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f459c00/0x40a459093b06c255 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1187840->2052095) gid 0 flags: 0x60080000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f227af expref: 43 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129583.940010:0:15749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008f459c00/0x40a459093b06c255 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1187840->2052095) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f227af expref: 43 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129583.940022:0:15749:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f459c00/0x40a459093b06c255 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1187840->2052095) gid 0 flags: 0x70000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f227af expref: 43 pid: 11014 timeout: 939 lvb_type: 0 00000100:00100000:3.0:1746129583.940035:0:15749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094065f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15749:1830948737659136:192.168.202.4@tcp:105: 00000100:00100000:3.0:1746129583.940530:0:15749:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5c68e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746129583.942399:0:31519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ada2ffba-8920-4ecb-8068-68caa9806978+42:1960:x1830948734509440:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 10242us (11292us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129583.942410:0:31519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8280 00002000:00100000:2.0:1746129583.942423:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f5:0x0] (2097152->3145727) req@ffff88009c7d9c00 x1830948734509440/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:324/0 lens 488/440 e 0 to 0 dl 1746129594 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00000100:00100000:0.0:1746129583.942614:0:15749:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094065f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15749:1830948737659136:192.168.202.4@tcp:105: 00010000:00010000:0.0:1746129583.942638:0:15749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:2.0:1746129583.942944:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7d9c00 with x1830948734509440 ext(2097152->3145727) 00002000:00010000:2.0:1746129583.942951:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c7d9c00 00000100:00100000:0.0:1746129583.943423:0:15749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+30:1960:x1830948734509952:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 3576us (3776us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129583.943433:0:15749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8830 00000100:00100000:3.0:1746129583.943471:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129583.943492:0:31519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734510208 00000100:00100000:3.0:1746129583.943500:0:31519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734510208 00002000:00100000:3.0:1746129583.943535:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f3:0x0] (1187840->1191935) req@ffff880094066a00 x1830948734510208/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:324/0 lens 488/0 e 0 to 0 dl 1746129594 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129583.943544:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094066a00 with x1830948734510208 ext(1187840->1191935) 00010000:00010000:3.0:1746129583.943552:0:31519:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008f459c00/0x40a459093b06c255 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1187840->2052095) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f227af expref: 42 pid: 11014 timeout: 939 lvb_type: 0 00010000:00010000:3.0:1746129583.943565:0:31519:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008f459c00/0x40a459093b06c255 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1187840->2052095) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f227af expref: 42 pid: 11014 timeout: 939 lvb_type: 0 00002000:00010000:3.0:1746129583.943572:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094066a00 00000100:00100000:3.0:1746129583.943587:0:31519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2559 00000100:00100000:3.0:1746129583.943594:0:31519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094066a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ada2ffba-8920-4ecb-8068-68caa9806978+42:1963:x1830948734510208:12345-192.168.202.4@tcp:3:multiop.0 00000100:00100000:3.0:1746129583.943747:0:31519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094066a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ada2ffba-8920-4ecb-8068-68caa9806978+42:1963:x1830948734510208:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 154us (276us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129583.943752:0:31519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2559 00002000:00100000:3.0:1746129583.943757:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f3:0x0] (1187840->1191935) req@ffff880094066a00 x1830948734510208/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:324/0 lens 488/4536 e 0 to 0 dl 1746129594 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129583.943763:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094066a00 with x1830948734510208 ext(1187840->1191935) 00010000:00010000:3.0:1746129583.943768:0:31519:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008f459c00/0x40a459093b06c255 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1187840->2052095) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f227af expref: 42 pid: 11014 timeout: 939 lvb_type: 0 00010000:00010000:3.0:1746129583.943776:0:31519:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008f459c00/0x40a459093b06c255 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1187840->2052095) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f227af expref: 42 pid: 11014 timeout: 939 lvb_type: 0 00002000:00010000:3.0:1746129583.943782:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094066a00 00000100:00100000:3.0:1746129583.947263:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+38:1960:x1830948734508928:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 15182us (17083us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129583.947277:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8278 00002000:00100000:3.0:1746129583.947289:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ef:0x0] (2097152->3145727) req@ffff88009c7d8700 x1830948734508928/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:324/0 lens 488/440 e 0 to 0 dl 1746129594 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129583.947325:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7d8700 with x1830948734508928 ext(2097152->3145727) 00002000:00010000:3.0:1746129583.947331:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c7d8700 00000100:00100000:1.0:1746129583.949681:0:31522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ada2ffba-8920-4ecb-8068-68caa9806978+36:1960:x1830948734509184:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 17578us (19433us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129583.949696:0:31522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8279 00002000:00100000:1.0:1746129583.949712:0:31522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->4194303) req@ffff88009c7d9880 x1830948734509184/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:324/0 lens 488/440 e 0 to 0 dl 1746129594 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129583.949723:0:31522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7d9880 with x1830948734509184 ext(3145728->4194303) 00002000:00010000:1.0:1746129583.949730:0:31522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c7d9880 00000100:00100000:2.0:1746129583.955460:0:31518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ada2ffba-8920-4ecb-8068-68caa9806978+40:1960:x1830948734509696:12345-192.168.202.4@tcp:3:multiop.0 Request processed in 22282us (23818us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129583.955474:0:31518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8281 00002000:00100000:2.0:1746129583.955488:0:31518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3f5:0x0] (3145728->4194303) req@ffff88009c7dad80 x1830948734509696/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:324/0 lens 488/440 e 0 to 0 dl 1746129594 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129583.955499:0:31518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7dad80 with x1830948734509696 ext(3145728->4194303) 00002000:00010000:2.0:1746129583.955506:0:31518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c7dad80 00000100:00100000:0.0:1746129583.965682:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129583.965741:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129583.965777:0:31518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734510464 00000100:00100000:2.0:1746129583.965787:0:31518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734510464 00000100:00100000:1.0:1746129583.965826:0:31522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734510720 00000100:00100000:1.0:1746129583.965831:0:31522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734510720 00002000:00100000:2.0:1746129583.965844:0:31518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3f3:0x0] (2048000->2052095) req@ffff88009c7db480 x1830948734510464/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:324/0 lens 488/0 e 0 to 0 dl 1746129594 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129583.965853:0:31522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3ef:0x0] (4194304->5148671) req@ffff88009c7d9500 x1830948734510720/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:324/0 lens 488/0 e 0 to 0 dl 1746129594 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129583.965854:0:31518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7db480 with x1830948734510464 ext(2048000->2052095) 00002000:00100000:1.0:1746129583.965861:0:31522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7d9500 with x1830948734510720 ext(4194304->5148671) 00010000:00010000:2.0:1746129583.965864:0:31518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008f459c00/0x40a459093b06c255 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1187840->2052095) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f227af expref: 40 pid: 11014 timeout: 939 lvb_type: 0 00002000:00010000:1.0:1746129583.965866:0:31522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c7d9500 00010000:00010000:2.0:1746129583.965880:0:31518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008f459c00/0x40a459093b06c255 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1187840->2052095) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f227af expref: 40 pid: 11014 timeout: 939 lvb_type: 0 00002000:00010000:2.0:1746129583.965886:0:31518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c7db480 00000100:00100000:1.0:1746129583.966370:0:31522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2560 00000100:00100000:1.0:1746129583.966381:0:31522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ada2ffba-8920-4ecb-8068-68caa9806978+40:1961:x1830948734510464:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:1.0:1746129583.966581:0:31522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ada2ffba-8920-4ecb-8068-68caa9806978+40:1961:x1830948734510464:12345-192.168.202.4@tcp:3:cat.0 Request processed in 202us (909us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129583.966870:0:31518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8282 00000100:00100000:2.0:1746129583.966878:0:31518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ada2ffba-8920-4ecb-8068-68caa9806978+36:1962:x1830948734510720:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:1.0:1746129583.967156:0:31522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2560 00002000:00100000:1.0:1746129583.967165:0:31522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f3:0x0] (2048000->2052095) req@ffff88009c7db480 x1830948734510464/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:324/0 lens 488/4536 e 0 to 0 dl 1746129594 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129583.967172:0:31522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7db480 with x1830948734510464 ext(2048000->2052095) 00010000:00010000:1.0:1746129583.967179:0:31522:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008f459c00/0x40a459093b06c255 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1187840->2052095) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f227af expref: 40 pid: 11014 timeout: 939 lvb_type: 0 00010000:00010000:1.0:1746129583.967190:0:31522:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008f459c00/0x40a459093b06c255 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1187840->2052095) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f227af expref: 40 pid: 11014 timeout: 939 lvb_type: 0 00002000:00010000:1.0:1746129583.967209:0:31522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c7db480 00000100:00100000:0.0:1746129583.969148:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129583.969240:0:31522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734510976 00000100:00100000:1.0:1746129583.969248:0:31522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734510976 00002000:00100000:1.0:1746129583.969285:0:31522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f3:0x0] (1187840->2052095) req@ffff880093ede300 x1830948734510976/t0(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:324/0 lens 488/0 e 0 to 0 dl 1746129594 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129583.969308:0:31522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ede300 with x1830948734510976 ext(1187840->2052095) 00010000:00010000:1.0:1746129583.969317:0:31522:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008f459c00/0x40a459093b06c255 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1187840->2052095) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f227af expref: 40 pid: 11014 timeout: 939 lvb_type: 0 00010000:00010000:1.0:1746129583.969330:0:31522:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008f459c00/0x40a459093b06c255 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1187840->2052095) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f227af expref: 40 pid: 11014 timeout: 939 lvb_type: 0 00002000:00010000:1.0:1746129583.969337:0:31522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093ede300 00000100:00100000:1.0:1746129583.969366:0:31522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2561 00000100:00100000:1.0:1746129583.969373:0:31522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ede300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ada2ffba-8920-4ecb-8068-68caa9806978+40:1962:x1830948734510976:12345-192.168.202.4@tcp:4:cat.0 00000100:00100000:0.0:1746129583.970221:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129583.970239:0:14551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734511232 00000100:00100000:1.0:1746129583.970243:0:14551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734511232 00000100:00100000:1.0:1746129583.970283:0:14551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4871 00000100:00100000:1.0:1746129583.970288:0:14551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ede680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ada2ffba-8920-4ecb-8068-68caa9806978+290:308:x1830948734511232:12345-192.168.202.4@tcp:35:multiop.0 00000100:00100000:1.0:1746129583.970501:0:14551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ede680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ada2ffba-8920-4ecb-8068-68caa9806978+291:308:x1830948734511232:12345-192.168.202.4@tcp:35:multiop.0 Request processed in 212us (281us total) trans 8589945536 rc 0/0 00000100:00100000:1.0:1746129583.970507:0:14551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4871 00000100:00100000:2.0:1746129583.981157:0:31518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ada2ffba-8920-4ecb-8068-68caa9806978+36:1962:x1830948734510720:12345-192.168.202.4@tcp:3:cat.0 Request processed in 14268us (15403us total) trans 0 rc 954368/954368 00000100:00100000:2.0:1746129583.981171:0:31518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8282 00002000:00100000:2.0:1746129583.981185:0:31518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3ef:0x0] (4194304->5148671) req@ffff88009c7d9500 x1830948734510720/t0(0) o3->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:324/0 lens 488/440 e 0 to 0 dl 1746129594 ref 1 fl Complete:/200/0 rc 954368/954368 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129583.981195:0:31518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7d9500 with x1830948734510720 ext(4194304->5148671) 00002000:00010000:2.0:1746129583.981211:0:31518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c7d9500 00000100:00100000:0.0:1746129583.985391:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129583.986014:0:11014:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734511360 00000100:00100000:2.0:1746129583.986025:0:11014:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734511360 00000100:00100000:2.0:1746129583.986087:0:11014:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 17056 00000100:00100000:2.0:1746129583.986096:0:11014:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093edc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ada2ffba-8920-4ecb-8068-68caa9806978+42:1963:x1830948734511360:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1746129583.986115:0:11014:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129583.986131:0:11014:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e1faa00/0x40a459093b06c263 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f227bd expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129583.986184:0:11014:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009507ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11014:1830948737659264:192.168.202.4@tcp:106: 00000100:00100000:2.0:1746129583.986278:0:11014:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132dad9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746129583.987690:0:11014:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009507ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11014:1830948737659264:192.168.202.4@tcp:106: 00010000:00010000:2.0:1746129583.987721:0:11014:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012e1faa00/0x40a459093b06c263 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f227bd expref: 43 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129583.987735:0:11014:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e1faa00/0x40a459093b06c263 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f227bd expref: 43 pid: 11014 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129583.987762:0:11014:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e1faa00, rc 0) 00000100:00100000:2.0:1746129583.987799:0:11014:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093edc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ada2ffba-8920-4ecb-8068-68caa9806978+42:1963:x1830948734511360:12345-192.168.202.4@tcp:101:cat.0 Request processed in 1703us (2418us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129583.987807:0:11014:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 17056 00000100:00100000:1.0:1746129583.988096:0:31522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ede300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ada2ffba-8920-4ecb-8068-68caa9806978+42:1962:x1830948734510976:12345-192.168.202.4@tcp:4:cat.0 Request processed in 18722us (18956us total) trans 17179874237 rc 0/0 00000100:00100000:1.0:1746129583.988106:0:31522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2561 00002000:00100000:1.0:1746129583.988114:0:31522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f3:0x0] (1187840->2052095) req@ffff880093ede300 x1830948734510976/t17179874237(0) o4->ada2ffba-8920-4ecb-8068-68caa9806978@192.168.202.4@tcp:324/0 lens 488/448 e 0 to 0 dl 1746129594 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129583.988122:0:31522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ede300 with x1830948734510976 ext(1187840->2052095) 00010000:00010000:1.0:1746129583.988130:0:31522:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008f459c00/0x40a459093b06c255 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1187840->2052095) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f227af expref: 42 pid: 11014 timeout: 939 lvb_type: 0 00010000:00010000:1.0:1746129583.988147:0:31522:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008f459c00/0x40a459093b06c255 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1187840->2052095) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f227af expref: 42 pid: 11014 timeout: 939 lvb_type: 0 00002000:00010000:1.0:1746129583.988153:0:31522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093ede300 00000100:00100000:0.0:1746129583.990510:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129583.990571:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129583.990640:0:15749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734511488 00000100:00100000:2.0:1746129583.990650:0:15749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734511488 00010000:00010000:2.0:1746129583.990687:0:15749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f459c00/0x40a459093b06c255 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1187840->2052095) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f227af expref: 42 pid: 11014 timeout: 939 lvb_type: 0 00000100:00100000:2.0:1746129583.990714:0:15749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8831 00000100:00100000:2.0:1746129583.990721:0:15749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093edd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ada2ffba-8920-4ecb-8068-68caa9806978+42:1960:x1830948734511488:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129583.990733:0:15749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129583.990757:0:15749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f459c00/0x40a459093b06c255 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1187840->2052095) gid 0 flags: 0x60000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f227af expref: 42 pid: 11014 timeout: 939 lvb_type: 0 00010000:00010000:2.0:1746129583.990769:0:15749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f459c00/0x40a459093b06c255 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1187840->2052095) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f227af expref: 42 pid: 11014 timeout: 939 lvb_type: 0 00010000:00010000:2.0:1746129583.990794:0:15749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f459c00/0x40a459093b06c255 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1187840->2052095) gid 0 flags: 0x44801000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f227af expref: 42 pid: 11014 timeout: 939 lvb_type: 0 00000100:00100000:3.0:1746129583.990918:0:11014:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734511744 00000100:00100000:3.0:1746129583.990922:0:11014:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734511744 00000100:00100000:3.0:1746129583.990953:0:4699:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 17057 00000100:00100000:3.0:1746129583.990958:0:4699:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093edc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ada2ffba-8920-4ecb-8068-68caa9806978+42:1961:x1830948734511744:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129583.990972:0:4699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129583.990982:0:4699:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fab4600/0x40a459093b06c26a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f227c4 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129583.990997:0:15749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129583.991000:0:15749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129583.991078:0:15749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880095d83000/0x40a459093b06c25c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f227b6 expref: 29 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129583.991087:0:15749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095d83000/0x40a459093b06c25c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f227b6 expref: 29 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129583.991096:0:4699:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129583.991097:0:4699:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129583.991102:0:4699:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fab4600/0x40a459093b06c26a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f227c4 expref: 43 pid: 4699 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129583.991171:0:4699:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fab4600/0x40a459093b06c26a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f227c4 expref: 43 pid: 4699 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129583.991180:0:4699:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fab4600, rc 0) 00010000:00010000:2.0:1746129583.991221:0:15749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880095d83000/0x40a459093b06c25c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f227b6 expref: 29 pid: 11014 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129583.991233:0:4699:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093edc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ada2ffba-8920-4ecb-8068-68caa9806978+43:1961:x1830948734511744:12345-192.168.202.4@tcp:101:cat.0 Request processed in 274us (661us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129583.991238:0:4699:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 17057 00000100:00100000:2.0:1746129583.991241:0:15749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009507ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15749:1830948737659392:192.168.202.4@tcp:105: 00000100:00100000:2.0:1746129583.991368:0:15749:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132dad9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129583.994067:0:15749:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009507ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15749:1830948737659392:192.168.202.4@tcp:105: 00010000:00010000:0.0:1746129583.994095:0:15749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129583.994153:0:15749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093edd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ada2ffba-8920-4ecb-8068-68caa9806978+42:1960:x1830948734511488:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 3431us (3706us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129583.994164:0:15749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8831 00000100:00100000:0.0:1746129583.996183:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129583.996800:0:14551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734512000 00000100:00100000:1.0:1746129583.996811:0:14551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734512000 00000100:00100000:1.0:1746129583.996871:0:14551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4872 00000100:00100000:1.0:1746129583.996879:0:14551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934c9450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ada2ffba-8920-4ecb-8068-68caa9806978+291:311:x1830948734512000:12345-192.168.202.4@tcp:35:cat.0 00000100:00100000:0.0:1746129583.997064:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129583.997106:0:31522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734512256 00000100:00100000:2.0:1746129583.997117:0:31522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734512256 00002000:00100000:2.0:1746129583.997156:0:31522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff880093eddc00 x1830948734512256/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:324/0 lens 488/0 e 0 to 0 dl 1746129594 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129583.997165:0:31522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093eddc00 with x1830948734512256 ext(1048576->2097151) 00002000:00010000:2.0:1746129583.997169:0:31522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093eddc00 00000100:00100000:2.0:1746129583.997267:0:31522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8283 00000100:00100000:2.0:1746129583.997274:0:31522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093eddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+30:1962:x1830948734512256:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:1.0:1746129583.997758:0:14551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934c9450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ada2ffba-8920-4ecb-8068-68caa9806978+292:311:x1830948734512000:12345-192.168.202.4@tcp:35:cat.0 Request processed in 878us (1584us total) trans 8589945537 rc 0/0 00000100:00100000:1.0:1746129583.997766:0:14551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4872 00000100:00100000:2.0:1746129584.006135:0:31522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093eddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+30:1962:x1830948734512256:12345-192.168.202.4@tcp:3:cat.0 Request processed in 8854us (9063us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129584.006146:0:31522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8283 00002000:00100000:2.0:1746129584.006155:0:31522:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff880093eddc00 x1830948734512256/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:324/0 lens 488/440 e 0 to 0 dl 1746129594 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129584.006165:0:31522:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093eddc00 with x1830948734512256 ext(1048576->2097151) 00002000:00010000:2.0:1746129584.006169:0:31522:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093eddc00 00000100:00100000:1.0:1746129584.016495:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129584.016585:0:11014:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734512384 00000100:00100000:3.0:1746129584.016593:0:11014:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734512384 00000100:00100000:3.0:1746129584.016645:0:11014:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 17058 00000100:00100000:3.0:1746129584.016653:0:11014:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013145d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+32:317:x1830948734512384:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1746129584.016668:0:11014:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129584.016682:0:11014:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fab4800/0x40a459093b06c271 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f227cb expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129584.016705:0:11014:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129584.016707:0:11014:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129584.016712:0:11014:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fab4800/0x40a459093b06c271 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f227cb expref: 33 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129584.016724:0:11014:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fab4800/0x40a459093b06c271 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f227cb expref: 33 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129584.016733:0:11014:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fab4800, rc 0) 00000100:00100000:3.0:1746129584.016783:0:11014:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013145d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+33:317:x1830948734512384:12345-192.168.202.4@tcp:101:cat.0 Request processed in 131us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129584.016788:0:11014:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 17058 00000100:00100000:0.0:1746129584.026619:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129584.026659:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129584.026687:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129584.026718:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129584.026764:0:31519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734512768 00000100:00100000:0.0:1746129584.026772:0:31519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734512768 00002000:00100000:0.0:1746129584.026808:0:31519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3ef:0x0] (2097152->3145727) req@ffff880093edc000 x1830948734512768/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:325/0 lens 488/0 e 0 to 0 dl 1746129595 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129584.026817:0:31519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093edc000 with x1830948734512768 ext(2097152->3145727) 00002000:00010000:0.0:1746129584.026822:0:31519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093edc000 00000100:00100000:0.0:1746129584.026842:0:21725:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734512896 00000100:00100000:0.0:1746129584.026845:0:21725:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734512896 00002000:00100000:0.0:1746129584.026856:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->4194303) req@ffff880093ede680 x1830948734512896/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:325/0 lens 488/0 e 0 to 0 dl 1746129595 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129584.026862:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ede680 with x1830948734512896 ext(3145728->4194303) 00002000:00010000:0.0:1746129584.026865:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093ede680 00000100:00100000:0.0:1746129584.026872:0:21725:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734513280 00000100:00100000:0.0:1746129584.026874:0:21725:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734513280 00002000:00100000:0.0:1746129584.026896:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f5:0x0] (3145728->4194303) req@ffff880092fd1500 x1830948734513280/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:325/0 lens 488/0 e 0 to 0 dl 1746129595 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129584.026903:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092fd1500 with x1830948734513280 ext(3145728->4194303) 00002000:00010000:0.0:1746129584.026906:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092fd1500 00000100:00100000:0.0:1746129584.026913:0:21725:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734513152 00000100:00100000:0.0:1746129584.026915:0:21725:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734513152 00002000:00100000:0.0:1746129584.026922:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f5:0x0] (2097152->3145727) req@ffff880092fd2680 x1830948734513152/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:325/0 lens 488/0 e 0 to 0 dl 1746129595 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129584.026928:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092fd2680 with x1830948734513152 ext(2097152->3145727) 00002000:00010000:0.0:1746129584.026931:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092fd2680 00000100:00100000:0.0:1746129584.026939:0:21725:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8284 00000100:00100000:0.0:1746129584.026945:0:21725:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093edc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+34:1961:x1830948734512768:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:2.0:1746129584.027338:0:31520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8285 00000100:00100000:2.0:1746129584.027349:0:31520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ede680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+34:1961:x1830948734512896:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:3.0:1746129584.028390:0:8416:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8286 00000100:00100000:3.0:1746129584.028398:0:8416:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092fd1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+31:1961:x1830948734513280:12345-192.168.202.4@tcp:3:cat.0 00000100:00080000:1.0:1746129584.028616:0:7097:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746129584.028663:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8287 00000100:00100000:1.0:1746129584.028675:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092fd2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+31:1961:x1830948734513152:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:2.0:1746129584.043871:0:21725:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093edc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+35:1961:x1830948734512768:12345-192.168.202.4@tcp:3:cat.0 Request processed in 16917us (17252us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129584.043880:0:21725:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8284 00002000:00100000:2.0:1746129584.043891:0:21725:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ef:0x0] (2097152->3145727) req@ffff880093edc000 x1830948734512768/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:325/0 lens 488/440 e 0 to 0 dl 1746129595 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129584.043899:0:21725:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093edc000 with x1830948734512768 ext(2097152->3145727) 00002000:00010000:2.0:1746129584.043904:0:21725:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093edc000 00000100:00100000:1.0:1746129584.058709:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092fd2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+32:1961:x1830948734513152:12345-192.168.202.4@tcp:3:cat.0 Request processed in 30029us (31982us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129584.058719:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8287 00002000:00100000:1.0:1746129584.058730:0:25745:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f5:0x0] (2097152->3145727) req@ffff880092fd2680 x1830948734513152/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:325/0 lens 488/440 e 0 to 0 dl 1746129595 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129584.058738:0:25745:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092fd2680 with x1830948734513152 ext(2097152->3145727) 00002000:00010000:1.0:1746129584.058743:0:25745:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092fd2680 00000100:00100000:2.0:1746129584.062861:0:31520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ede680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+33:1961:x1830948734512896:12345-192.168.202.4@tcp:3:cat.0 Request processed in 35508us (36192us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129584.062872:0:31520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8285 00002000:00100000:2.0:1746129584.062882:0:31520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3ef:0x0] (3145728->4194303) req@ffff880093ede680 x1830948734512896/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:325/0 lens 488/440 e 0 to 0 dl 1746129595 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129584.062889:0:31520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ede680 with x1830948734512896 ext(3145728->4194303) 00002000:00010000:2.0:1746129584.062894:0:31520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093ede680 00000100:00100000:3.0:1746129584.068100:0:8416:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092fd1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+30:1961:x1830948734513280:12345-192.168.202.4@tcp:3:cat.0 Request processed in 39694us (41403us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129584.068110:0:8416:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8286 00002000:00100000:3.0:1746129584.068119:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3f5:0x0] (3145728->4194303) req@ffff880092fd1500 x1830948734513280/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:325/0 lens 488/440 e 0 to 0 dl 1746129595 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129584.068134:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092fd1500 with x1830948734513280 ext(3145728->4194303) 00002000:00010000:3.0:1746129584.068140:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092fd1500 00000100:00100000:0.0:1746129584.076384:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129584.077232:0:8416:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734513664 00000100:00100000:3.0:1746129584.077245:0:8416:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734513664 00002000:00100000:3.0:1746129584.077286:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3ef:0x0] (4194304->5148671) req@ffff880092fd2d80 x1830948734513664/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:325/0 lens 488/0 e 0 to 0 dl 1746129595 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129584.077315:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092fd2d80 with x1830948734513664 ext(4194304->5148671) 00002000:00010000:3.0:1746129584.077320:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092fd2d80 00000100:00100000:3.0:1746129584.077353:0:8416:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8288 00000100:00100000:3.0:1746129584.077360:0:8416:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092fd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+33:1962:x1830948734513664:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:3.0:1746129584.086941:0:8416:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092fd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+33:1962:x1830948734513664:12345-192.168.202.4@tcp:3:cat.0 Request processed in 9573us (10555us total) trans 0 rc 954368/954368 00000100:00100000:3.0:1746129584.086952:0:8416:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8288 00002000:00100000:3.0:1746129584.086962:0:8416:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3ef:0x0] (4194304->5148671) req@ffff880092fd2d80 x1830948734513664/t0(0) o3->8c95e64d-12cd-4ec3-ad4c-ce0620076de1@192.168.202.4@tcp:325/0 lens 488/440 e 0 to 0 dl 1746129595 ref 1 fl Complete:/200/0 rc 954368/954368 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129584.086970:0:8416:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092fd2d80 with x1830948734513664 ext(4194304->5148671) 00002000:00010000:3.0:1746129584.086975:0:8416:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092fd2d80 00000100:00100000:0.0:1746129584.094047:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129584.094137:0:14551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734513920 00000100:00100000:1.0:1746129584.094144:0:14551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734513920 00000100:00080000:2.0:1746129584.094207:0:7097:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746129584.094213:0:14551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4873 00000100:00100000:1.0:1746129584.094221:0:14551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092fd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+10:317:x1830948734513920:12345-192.168.202.4@tcp:35:cat.0 00000100:00100000:1.0:1746129584.094499:0:14551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092fd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+11:317:x1830948734513920:12345-192.168.202.4@tcp:35:cat.0 Request processed in 278us (457us total) trans 8589945538 rc 0/0 00000100:00100000:1.0:1746129584.094506:0:14551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4873 00000001:00080000:3.0:1746129584.254800:0:2276:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874233 is committed 00000001:00080000:3.0:1746129584.254826:0:2276:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874213 is committed 00000001:00080000:3.0:1746129584.254839:0:2276:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874193 is committed 00000001:00080000:3.0:1746129584.254855:0:2276:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874237 is committed 00000001:00080000:3.0:1746129584.255034:0:2276:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874212 is committed 00000001:00080000:3.0:1746129584.255076:0:2276:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874236 is committed 00000001:00080000:3.0:1746129584.255086:0:2276:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874217 is committed 00010000:00010000:2.0:1746129584.508488:0:7088:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1746129584.821834:0:564:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841489 is committed 00000001:00080000:1.0:1746129584.821863:0:564:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841488 is committed 00000001:00080000:1.0:1746129584.821868:0:564:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841484 is committed 00000001:00080000:1.0:1746129584.821897:0:564:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841425 is committed 00000001:00080000:1.0:1746129584.821918:0:564:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841464 is committed 00000001:00080000:1.0:1746129584.821958:0:564:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841485 is committed 00000001:00080000:1.0:1746129584.822037:0:564:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841466 is committed 00000100:00100000:0.0:1746129585.048442:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129585.048531:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129585.048555:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129585.048588:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129585.048613:0:4699:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734514816 00000100:00100000:0.0:1746129585.048619:0:4699:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734514816 00000100:00100000:0.0:1746129585.048649:0:4699:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 17059 00000100:00100000:0.0:1746129585.048655:0:4699:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092fd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+8:1959:x1830948734514816:12345-192.168.202.4@tcp:9:umount.0 00000020:00000080:0.0:1746129585.048678:0:4699:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0x40a459093b060bc2 00000020:00010000:0.0:1746129585.048684:0:4699:0:(genops.c:1938:obd_stale_export_put()) Put export ffff88012ee0e800: total 0 00000100:00080000:0.0:1746129585.048687:0:4699:0:(import.c:66:import_set_state_nolock()) ffff88012ee0a000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1746129585.048792:0:15749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734514176 00000100:00100000:2.0:1746129585.048795:0:15749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734514176 00000100:00100000:2.0:1746129585.048818:0:15749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734514048 00000100:00100000:2.0:1746129585.048820:0:15749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734514048 00000100:00100000:2.0:1746129585.048829:0:15749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734514304 00000100:00100000:2.0:1746129585.048831:0:15749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734514304 00000100:00100000:2.0:1746129585.048839:0:15749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 808 00000100:00100000:2.0:1746129585.048844:0:15749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092fd0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a8b5f81a-2f18-4d7f-accf-308742f5a04f+17:1962:x1830948734514176:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129585.048851:0:15749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129585.048864:0:15749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff880132fc3200/0x40a459093b060ba6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f1b9bc expref: 17 pid: 14543 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129585.048868:0:7087:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 809 00000100:00100000:3.0:1746129585.048877:0:7087:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092fd2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a8b5f81a-2f18-4d7f-accf-308742f5a04f+16:1962:x1830948734514048:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129585.048884:0:7087:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129585.048890:0:15749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746129585.048893:0:7087:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff880132fc2800/0x40a459093b060b9f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f1b992 expref: 16 pid: 14543 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129585.048916:0:7087:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129585.048922:0:15749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092fd0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a8b5f81a-2f18-4d7f-accf-308742f5a04f+15:1962:x1830948734514176:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 78us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129585.048927:0:15749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 808 00000100:00100000:3.0:1746129585.048935:0:7087:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092fd2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a8b5f81a-2f18-4d7f-accf-308742f5a04f+14:1962:x1830948734514048:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 61us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129585.048937:0:15749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 810 00000100:00100000:3.0:1746129585.048940:0:7087:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 809 00000100:00100000:2.0:1746129585.048941:0:15749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092fd1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a8b5f81a-2f18-4d7f-accf-308742f5a04f+14:1962:x1830948734514304:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129585.048946:0:15749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129585.048952:0:15749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff880132fc3e00/0x40a459093b060bad lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f1b9c3 expref: 13 pid: 14543 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129585.048962:0:15749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129585.048976:0:15749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092fd1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a8b5f81a-2f18-4d7f-accf-308742f5a04f+12:1962:x1830948734514304:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 34us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129585.048981:0:15749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 810 00000001:00000004:0.0:1746129585.050230:0:4699:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 4, last_transno is 17179874237 00000100:00100000:0.0:1746129585.050450:0:4699:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092fd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+6:1959:x1830948734514816:12345-192.168.202.4@tcp:9:umount.0 Request processed in 1793us (1858us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129585.050457:0:4699:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 17059 00000020:00010000:2.0:1746129585.051485:0:7089:0:(genops.c:1924:obd_stale_export_get()) Get export ffff88012ee0e800: total 0 00010000:00010000:2.0:1746129585.051490:0:7089:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746129585.051526:0:7089:0:(ldlm_lock.c:2647:ldlm_export_cancel_blocked_locks()) Export ffff88012ee0e800, canceled 0 locks, left on hash table 3. 00010000:00010000:2.0:1746129585.051564:0:7089:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095d83000/0x40a459093b06c25c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f227b6 expref: 5 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129585.051582:0:7089:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f5e4600/0x40a459093b06c0f7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22707 expref: 4 pid: 7149 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129585.051598:0:7089:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fe03e00/0x40a459093b06c0b1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f226d6 expref: 3 pid: 7149 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129585.051605:0:7089:0:(ldlm_lock.c:2675:ldlm_export_cancel_locks()) Export ffff88012ee0e800, canceled 3 locks, left on hash table 0. 00010000:00010000:2.0:1746129585.051613:0:7089:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746129585.051614:0:7089:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746129585.051617:0:7089:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746129585.071391:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129585.072899:0:4699:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734515456 00000100:00100000:2.0:1746129585.072908:0:4699:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734515456 00000100:00100000:2.0:1746129585.074065:0:4699:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 17060 00000100:00100000:2.0:1746129585.074076:0:4699:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092fd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+9:1959:x1830948734515456:12345-192.168.202.4@tcp:9:umount.0 00000020:00000080:2.0:1746129585.074102:0:4699:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0x40a459093b060bbb 00000020:00010000:2.0:1746129585.074107:0:4699:0:(genops.c:1938:obd_stale_export_put()) Put export ffff88012d424000: total 0 00000100:00080000:2.0:1746129585.074110:0:4699:0:(import.c:66:import_set_state_nolock()) ffff88012d422800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1746129585.074137:0:4699:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 5, last_transno is 21474841489 00000100:00080000:0.0:1746129585.074276:0:7097:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00010000:3.0:1746129585.074360:0:26224:0:(genops.c:1924:obd_stale_export_get()) Get export ffff88012d424000: total 0 00010000:00010000:3.0:1746129585.074413:0:26224:0:(ldlm_lock.c:2647:ldlm_export_cancel_blocked_locks()) Export ffff88012d424000, canceled 0 locks, left on hash table 4. 00010000:00010000:3.0:1746129585.074454:0:26224:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fab4200/0x40a459093b060ce8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f1ba9c expref: 9 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129585.074479:0:26224:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fd19600/0x40a459093b06c0f0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f226f9 expref: 8 pid: 4699 timeout: 0 lvb_type: 1 00002000:00010000:3.0:1746129585.074491:0:26224:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb blocks from disk: 2079 -> 2081 00010000:00010000:3.0:1746129585.074496:0:26224:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fe02e00/0x40a459093b06c0e9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2270e expref: 7 pid: 4385 timeout: 0 lvb_type: 1 00002000:00010000:3.0:1746129585.074506:0:26224:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb blocks from disk: 6033 -> 6035 00010000:00010000:3.0:1746129585.074510:0:26224:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fab4800/0x40a459093b06c271 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f227cb expref: 6 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129585.074522:0:26224:0:(ldlm_lock.c:2675:ldlm_export_cancel_locks()) Export ffff88012d424000, canceled 4 locks, left on hash table 0. 00010000:00010000:3.0:1746129585.074533:0:26224:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746129585.074534:0:26224:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746129585.074536:0:26224:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1746129585.074713:0:4699:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092fd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+2:1959:x1830948734515456:12345-192.168.202.4@tcp:9:umount.0 Request processed in 640us (3327us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129585.074719:0:4699:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 17060 00000100:00100000:1.0:1746129585.087246:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129585.089538:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734515840 00000100:00100000:0.0:1746129585.089549:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734515840 00000100:00100000:0.0:1746129585.089614:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11403 00000100:00100000:0.0:1746129585.089627:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013145ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+11:1959:x1830948734515840:12345-192.168.202.4@tcp:39:umount.0 00000020:00000080:0.0:1746129585.089656:0:14549:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0x40a459093b060bb4 00000020:00010000:0.0:1746129585.089664:0:14549:0:(genops.c:1938:obd_stale_export_put()) Put export ffff8801319ab800: total 0 00000100:00080000:0.0:1746129585.089667:0:14549:0:(import.c:66:import_set_state_nolock()) ffff8801319a8800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1746129585.089695:0:14549:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589945538 00000100:00100000:0.0:1746129585.089960:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013145ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c95e64d-12cd-4ec3-ad4c-ce0620076de1+10:1959:x1830948734515840:12345-192.168.202.4@tcp:39:umount.0 Request processed in 339us (2724us total) trans 8589945539 rc 0/0 00000100:00100000:0.0:1746129585.089966:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11403 00000020:00010000:2.0:1746129585.090037:0:9822:0:(genops.c:1924:obd_stale_export_get()) Get export ffff8801319ab800: total 0 00010000:00010000:2.0:1746129585.090073:0:9822:0:(ldlm_lock.c:2647:ldlm_export_cancel_blocked_locks()) Export ffff8801319ab800, canceled 0 locks, left on hash table 3. 00010000:00010000:2.0:1746129585.090099:0:9822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009cffe100) 00010000:00010000:2.0:1746129585.090101:0:9822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746129585.090107:0:9822:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f458c00/0x40a459093b06c240 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f227a1 expref: 9 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129585.090127:0:9822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880132ef8f00) 00010000:00010000:2.0:1746129585.090129:0:9822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1746129585.090132:0:9822:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135a35200/0x40a459093b060c32 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f1ba56 expref: 8 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129585.090142:0:9822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009cffe100) 00010000:00010000:2.0:1746129585.090144:0:9822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1746129585.090146:0:9822:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab4400/0x40a459093b06c1ad lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2274d expref: 7 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129585.090157:0:9822:0:(ldlm_lock.c:2675:ldlm_export_cancel_locks()) Export ffff8801319ab800, canceled 3 locks, left on hash table 0. 00010000:00010000:2.0:1746129585.090166:0:9822:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746129585.090167:0:9822:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746129585.090169:0:9822:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1746129585.131181:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f448380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737659520:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1746129585.131247:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129585.131400:0:12977:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737659520 00000100:00100000:0.0:1746129585.131407:0:12977:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737659520 00000100:00100000:0.0:1746129585.131441:0:12977:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:0.0:1746129585.131447:0:12977:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009507ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1830948737659520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1746129585.131478:0:12977:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 500498432 pending 0 free 3852468224 avail 3850371072 00000100:00100000:0.0:1746129585.131509:0:12977:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009507ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1830948737659520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 63us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129585.131515:0:12977:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:3.0:1746129585.131539:0:3300:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474841485 gen 2 00000004:00080000:3.0:1746129585.131547:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b552a00, transno 21474841427 00000004:00080000:3.0:1746129585.131563:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b552d80, transno 21474841428 00000004:00080000:3.0:1746129585.131566:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b550e00, transno 21474841429 00000004:00080000:3.0:1746129585.131568:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012baece00, transno 21474841430 00000004:00080000:3.0:1746129585.131570:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b552680, transno 21474841431 00000004:00080000:3.0:1746129585.131572:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012baedc00, transno 21474841432 00000100:00080000:2.0:1746129585.131573:0:7097:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:3.0:1746129585.131575:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012baefb80, transno 21474841433 00000004:00080000:3.0:1746129585.131577:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b550380, transno 21474841434 00000004:00080000:3.0:1746129585.131579:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fc2c700, transno 21474841435 00000004:00080000:3.0:1746129585.131582:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013575c380, transno 21474841439 00000004:00080000:3.0:1746129585.131584:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013575c000, transno 21474841440 00000004:00080000:3.0:1746129585.131586:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013575fb80, transno 21474841441 00000004:00080000:3.0:1746129585.131588:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013575c700, transno 21474841442 00000004:00080000:3.0:1746129585.131590:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013575d180, transno 21474841443 00000004:00080000:3.0:1746129585.131592:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013575e300, transno 21474841444 00000004:00080000:3.0:1746129585.131594:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013575ce00, transno 21474841445 00000004:00080000:3.0:1746129585.131596:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013575ca80, transno 21474841446 00000004:00080000:3.0:1746129585.131598:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b550a80, transno 21474841447 00000004:00080000:3.0:1746129585.131601:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f3e4a80, transno 21474841448 00000004:00080000:3.0:1746129585.131604:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800903a0a80, transno 21474841449 00000004:00080000:3.0:1746129585.131606:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f3e4700, transno 21474841450 00000004:00080000:3.0:1746129585.131609:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f3e4380, transno 21474841451 00000004:00080000:3.0:1746129585.131612:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f3e5500, transno 21474841452 00000004:00080000:3.0:1746129585.131614:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f3e5880, transno 21474841453 00000004:00080000:3.0:1746129585.131621:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800903a0700, transno 21474841454 00000004:00080000:3.0:1746129585.131623:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f3e6300, transno 21474841455 00000004:00080000:3.0:1746129585.131627:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800947bdc00, transno 21474841456 00000004:00080000:3.0:1746129585.131629:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094067480, transno 21474841468 00000004:00080000:3.0:1746129585.131631:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094064700, transno 21474841469 00000004:00080000:3.0:1746129585.131633:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094065c00, transno 21474841470 00000004:00080000:3.0:1746129585.131636:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094067800, transno 21474841471 00000004:00080000:3.0:1746129585.131638:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135724700, transno 21474841472 00000004:00080000:3.0:1746129585.131640:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094066300, transno 21474841473 00000004:00080000:3.0:1746129585.131642:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094064e00, transno 21474841474 00000004:00080000:3.0:1746129585.131644:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094065180, transno 21474841475 00000004:00080000:3.0:1746129585.131646:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094065880, transno 21474841476 00000004:00080000:3.0:1746129585.131648:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091b04a80, transno 21474841477 00000004:00080000:3.0:1746129585.131650:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091b04000, transno 21474841478 00000004:00080000:3.0:1746129585.131652:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091b07800, transno 21474841479 00000004:00080000:3.0:1746129585.131654:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091b05500, transno 21474841480 00000004:00080000:3.0:1746129585.131656:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091b04380, transno 21474841481 00000004:00080000:3.0:1746129585.131658:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091b04e00, transno 21474841482 00000004:00080000:3.0:1746129585.131659:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091b07100, transno 21474841483 00000004:00080000:3.0:1746129585.131661:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091b05f80, transno 21474841484 00000004:00080000:3.0:1746129585.131663:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091b05180, transno 21474841485 00000100:00100000:3.0:1746129585.131950:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f448380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737659520:0@lo:13:osp-pre-0-0.0 00000004:00080000:0.0:1746129585.131977:0:14586:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 26 in progress, 0 in flight, 19 done 00000004:00080000:0.0:1746129585.132116:0:14586:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 26 done 00000100:00100000:2.0:1746129585.162994:0:3300:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1746129585.163018:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f449180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737659648:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1746129585.163077:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129585.163135:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012baedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1830948737660032:0@lo:400:kworker.0 00000100:00100000:0.0:1746129585.163150:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012baece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1830948737659904:0@lo:400:kworker.0 00000100:00100000:2.0:1746129585.163158:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129585.163178:0:3300:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1746129585.163184:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012baefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1830948737660160:0@lo:400:kworker.0 00000100:00100000:2.0:1746129585.163219:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129585.163240:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737660032 00000100:00100000:0.0:1746129585.163246:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737660032 00000100:00100000:2.0:1746129585.163264:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737660160 00000100:00100000:2.0:1746129585.163271:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737660160 00000100:00100000:3.0:1746129585.163492:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092fd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f03f6bde-e986-4df5-86c3-48805e205677:3302:1830948737659776:0@lo:400:kworker.0 00000100:00100000:3.0:1746129585.163531:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1746129585.163575:0:7097:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746129585.163591:0:14543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737659776 00000100:00100000:3.0:1746129585.163594:0:14543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737659776 00000100:00100000:3.0:1746129585.163620:0:14543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1746129585.163627:0:14543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095fbc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f03f6bde-e986-4df5-86c3-48805e205677+18:3302:x1830948737659776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746129585.163664:0:14543:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095fbc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f03f6bde-e986-4df5-86c3-48805e205677+18:3302:x1830948737659776:12345-0@lo:400:kworker.0 Request processed in 37us (133us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129585.163790:0:8414:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737659648 00000100:00100000:1.0:1746129585.163794:0:8414:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737659648 00000100:00100000:1.0:1746129585.163821:0:8414:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:1.0:1746129585.163826:0:8414:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009507d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1830948737659648:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1746129585.163855:0:8414:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 457768960 pending 0 free 3853516800 avail 3851419648 00000100:00100000:1.0:1746129585.163887:0:8414:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009507d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1830948737659648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (811us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129585.163893:0:8414:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00080000:1.0:1746129585.163909:0:7097:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746129585.163927:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129585.163951:0:16908:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737659904 00000100:00100000:1.0:1746129585.163953:0:16908:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737659904 00000100:00100000:3.0:1746129585.163992:0:14543:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1746129585.164047:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092fd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f03f6bde-e986-4df5-86c3-48805e205677:3302:1830948737659776:0@lo:400:kworker.0 00000100:00100000:3.0:1746129585.164075:0:3300:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179874233 gen 2 00000004:00080000:3.0:1746129585.164080:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f3e6d80, transno 17179874183 00000004:00080000:3.0:1746129585.164086:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800903a3480, transno 17179874184 00000004:00080000:3.0:1746129585.164089:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f3e5f80, transno 17179874185 00000004:00080000:3.0:1746129585.164091:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800903a3b80, transno 17179874186 00000004:00080000:3.0:1746129585.164093:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f3e6a00, transno 17179874187 00000004:00080000:3.0:1746129585.164095:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800903a2680, transno 17179874188 00000004:00080000:3.0:1746129585.164098:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f3e6680, transno 17179874189 00000004:00080000:3.0:1746129585.164100:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800903a2300, transno 17179874190 00000004:00080000:3.0:1746129585.164102:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e38b800, transno 17179874194 00000004:00080000:3.0:1746129585.164104:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e389180, transno 17179874195 00000004:00080000:3.0:1746129585.164106:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e388e00, transno 17179874196 00000004:00080000:3.0:1746129585.164109:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e38a680, transno 17179874197 00000004:00080000:3.0:1746129585.164111:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f44b480, transno 17179874198 00000004:00080000:3.0:1746129585.164114:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f448a80, transno 17179874199 00000004:00080000:3.0:1746129585.164116:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e388700, transno 17179874200 00000004:00080000:3.0:1746129585.164118:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e389f80, transno 17179874201 00000004:00080000:3.0:1746129585.164120:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a77b0a80, transno 17179874202 00000004:00080000:3.0:1746129585.164123:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a77b3800, transno 17179874203 00000004:00080000:3.0:1746129585.164125:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a77b0700, transno 17179874204 00000004:00080000:3.0:1746129585.164127:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a77b0e00, transno 17179874205 00000004:00080000:3.0:1746129585.164130:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a77b1f80, transno 17179874206 00000004:00080000:3.0:1746129585.164132:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a77b3480, transno 17179874207 00000004:00080000:3.0:1746129585.164135:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a77b1500, transno 17179874208 00000004:00080000:3.0:1746129585.164137:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a77b3100, transno 17179874209 00000004:00080000:3.0:1746129585.164140:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880129bc1f80, transno 17179874218 00000004:00080000:3.0:1746129585.164143:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880129bc0000, transno 17179874219 00000004:00080000:3.0:1746129585.164145:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880129bc0e00, transno 17179874220 00000004:00080000:3.0:1746129585.164147:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880129bc3100, transno 17179874221 00000004:00080000:3.0:1746129585.164150:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880129bc1c00, transno 17179874222 00000004:00080000:3.0:1746129585.164152:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880129bc0380, transno 17179874223 00000004:00080000:3.0:1746129585.164153:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880129bc1180, transno 17179874224 00000004:00080000:3.0:1746129585.164155:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fa25880, transno 17179874225 00000004:00080000:3.0:1746129585.164158:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fa26d80, transno 17179874226 00000004:00080000:3.0:1746129585.164160:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fa24380, transno 17179874227 00000004:00080000:3.0:1746129585.164162:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fa24a80, transno 17179874228 00000004:00080000:3.0:1746129585.164164:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135724e00, transno 17179874229 00000004:00080000:3.0:1746129585.164166:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fa25180, transno 17179874230 00000004:00080000:3.0:1746129585.164168:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fa24700, transno 17179874231 00000004:00080000:3.0:1746129585.164170:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135725880, transno 17179874232 00000004:00080000:3.0:1746129585.164172:0:3300:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135725500, transno 17179874233 00000100:00100000:3.0:1746129585.164179:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f449180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737659648:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1746129585.164526:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1746129585.164536:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009507f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1830948737660032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746129585.164556:0:16908:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1746129585.164563:0:16908:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009507e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1830948737660160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746129585.164594:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009507f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1830948737660032:12345-0@lo:400:kworker.0 Request processed in 60us (1434us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129585.164596:0:16908:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009507e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1830948737660160:12345-0@lo:400:kworker.0 Request processed in 34us (1376us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129585.164601:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1746129585.164619:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1746129585.164624:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f448380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1830948737659904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746129585.164652:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f448380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1830948737659904:12345-0@lo:400:kworker.0 Request processed in 28us (724us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129585.164658:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1746129585.164722:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012baece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1830948737659904:0@lo:400:kworker.0 00000100:00080000:2.0:1746129585.164739:0:7097:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746129585.165028:0:16908:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000004:00080000:3.0:1746129585.165081:0:14589:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 40 done 00000100:00100000:3.0:1746129585.165109:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012baefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1830948737660160:0@lo:400:kworker.0 00000100:00100000:3.0:1746129585.165122:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012baedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1830948737660032:0@lo:400:kworker.0 00010000:00010000:2.0:1746129585.510611:0:7088:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746129585.597586:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129585.599445:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129585.599484:0:4699:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734516224 00000100:00100000:2.0:1746129585.599491:0:4699:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734516224 00000100:00100000:2.0:1746129585.599644:0:4699:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 17061 00000100:00100000:2.0:1746129585.599652:0:4699:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:068dab75-d300-4ead-a742-d14572ad1e50+7:1959:x1830948734516224:12345-192.168.202.4@tcp:9:umount.0 00000020:00000080:2.0:1746129585.599679:0:4699:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0x40a459093b060bec 00000020:00010000:2.0:1746129585.599685:0:4699:0:(genops.c:1938:obd_stale_export_put()) Put export ffff8800b4db9000: total 0 00000100:00080000:2.0:1746129585.599689:0:4699:0:(import.c:66:import_set_state_nolock()) ffff880094b13800 : changing import state from FULL to CLOSED 00000020:00010000:2.0:1746129585.599705:0:7089:0:(genops.c:1924:obd_stale_export_get()) Get export ffff8800b4db9000: total 0 00010000:00010000:2.0:1746129585.599742:0:7089:0:(ldlm_lock.c:2647:ldlm_export_cancel_blocked_locks()) Export ffff8800b4db9000, canceled 0 locks, left on hash table 2. 00010000:00010000:2.0:1746129585.599784:0:7089:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fd18800/0x40a459093b06c121 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22738 expref: 6 pid: 4699 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129585.599809:0:7089:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fd19400/0x40a459093b06c105 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22723 expref: 5 pid: 4699 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129585.599819:0:7089:0:(ldlm_lock.c:2675:ldlm_export_cancel_locks()) Export ffff8800b4db9000, canceled 2 locks, left on hash table 0. 00010000:00010000:2.0:1746129585.599827:0:7089:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746129585.599829:0:7089:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746129585.599830:0:7089:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:2.0:1746129585.599841:0:4699:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 4, last_transno is 17179874237 00000100:00080000:3.0:1746129585.600052:0:7097:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746129585.600323:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734516352 00000100:00100000:1.0:1746129585.600327:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734516352 00000100:00100000:1.0:1746129585.600360:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 811 00000100:00100000:1.0:1746129585.600365:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baefb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a8b5f81a-2f18-4d7f-accf-308742f5a04f+12:1961:x1830948734516352:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129585.600372:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129585.600381:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88009d105e00/0x40a459093b060bc9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f1b9ed expref: 12 pid: 14543 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129585.600394:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129585.601170:0:4699:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:068dab75-d300-4ead-a742-d14572ad1e50+2:1959:x1830948734516224:12345-192.168.202.4@tcp:9:umount.0 Request processed in 1516us (3587us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129585.601177:0:4699:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 17061 00000100:00100000:0.0:1746129585.601344:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129585.601374:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129585.601395:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734516480 00000100:00100000:0.0:1746129585.601398:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734516480 00000100:00100000:0.0:1746129585.601418:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734516608 00000100:00100000:0.0:1746129585.601420:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734516608 00000100:00100000:0.0:1746129585.601433:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 812 00000100:00100000:0.0:1746129585.601437:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a44850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a8b5f81a-2f18-4d7f-accf-308742f5a04f+13:1963:x1830948734516480:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129585.601444:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129585.601453:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88009d105400/0x40a459093b060bd7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f1ba1e expref: 13 pid: 14543 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129585.601464:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129585.601482:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a44850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a8b5f81a-2f18-4d7f-accf-308742f5a04f+12:1963:x1830948734516480:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 44us (138us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129585.601487:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 812 00000100:00100000:0.0:1746129585.601499:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 813 00000100:00100000:0.0:1746129585.601503:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baece00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a8b5f81a-2f18-4d7f-accf-308742f5a04f+11:1960:x1830948734516608:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129585.601509:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129585.601515:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8800945c3c00/0x40a459093b060bd0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f1ba17 expref: 11 pid: 14545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129585.601521:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129585.602023:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baefb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a8b5f81a-2f18-4d7f-accf-308742f5a04f+10:1961:x1830948734516352:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 1656us (2579us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129585.602028:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 811 00000100:00100000:0.0:1746129585.602569:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baece00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a8b5f81a-2f18-4d7f-accf-308742f5a04f+9:1960:x1830948734516608:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 1063us (1193us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129585.602575:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 813 00000100:00100000:0.0:1746129585.606941:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129585.607099:0:4699:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734516992 00000100:00100000:2.0:1746129585.607108:0:4699:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734516992 00000100:00100000:2.0:1746129585.607161:0:4699:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 17062 00000100:00100000:2.0:1746129585.607168:0:4699:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:068dab75-d300-4ead-a742-d14572ad1e50+7:1959:x1830948734516992:12345-192.168.202.4@tcp:9:umount.0 00000020:00000080:2.0:1746129585.607205:0:4699:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0x40a459093b060be5 00000020:00010000:2.0:1746129585.607210:0:4699:0:(genops.c:1938:obd_stale_export_put()) Put export ffff88012d425000: total 0 00000100:00080000:2.0:1746129585.607213:0:4699:0:(import.c:66:import_set_state_nolock()) ffff88012d421800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1746129585.607240:0:4699:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 5, last_transno is 21474841489 00000100:00100000:2.0:1746129585.607402:0:4699:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:068dab75-d300-4ead-a742-d14572ad1e50+5:1959:x1830948734516992:12345-192.168.202.4@tcp:9:umount.0 Request processed in 233us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129585.607408:0:4699:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 17062 00000020:00010000:2.0:1746129585.607490:0:26224:0:(genops.c:1924:obd_stale_export_get()) Get export ffff88012d425000: total 0 00010000:00010000:2.0:1746129585.607493:0:26224:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746129585.607508:0:26224:0:(ldlm_lock.c:2647:ldlm_export_cancel_blocked_locks()) Export ffff88012d425000, canceled 0 locks, left on hash table 2. 00010000:00010000:2.0:1746129585.607553:0:26224:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fd18c00/0x40a459093b06c0fe lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22715 expref: 4 pid: 4699 timeout: 0 lvb_type: 1 00000100:00080000:3.0:1746129585.607681:0:7097:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1746129585.610067:0:26224:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fd19000/0x40a459093b06c113 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2272a expref: 3 pid: 4699 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129585.610081:0:26224:0:(ldlm_lock.c:2675:ldlm_export_cancel_locks()) Export ffff88012d425000, canceled 2 locks, left on hash table 0. 00010000:00010000:2.0:1746129585.610104:0:26224:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746129585.610106:0:26224:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746129585.610108:0:26224:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746129585.613969:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129585.614716:0:16908:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734517376 00000100:00100000:1.0:1746129585.614723:0:16908:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734517376 00000100:00080000:3.0:1746129585.614849:0:7097:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746129585.615105:0:16908:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11404 00000100:00100000:1.0:1746129585.615114:0:16908:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131456680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:068dab75-d300-4ead-a742-d14572ad1e50+10:1959:x1830948734517376:12345-192.168.202.4@tcp:39:umount.0 00000020:00000080:1.0:1746129585.615140:0:16908:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0x40a459093b060bde 00000020:00010000:1.0:1746129585.615146:0:16908:0:(genops.c:1938:obd_stale_export_put()) Put export ffff88012ee0d000: total 0 00000100:00080000:1.0:1746129585.615149:0:16908:0:(import.c:66:import_set_state_nolock()) ffff880129f39000 : changing import state from FULL to CLOSED 00000020:00010000:2.0:1746129585.616065:0:9822:0:(genops.c:1924:obd_stale_export_get()) Get export ffff88012ee0d000: total 0 00000001:00000004:1.0:1746129585.616082:0:16908:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589945539 00010000:00010000:2.0:1746129585.616103:0:9822:0:(ldlm_lock.c:2647:ldlm_export_cancel_blocked_locks()) Export ffff88012ee0d000, canceled 0 locks, left on hash table 2. 00010000:00010000:2.0:1746129585.616129:0:9822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880132ef8f00) 00010000:00010000:2.0:1746129585.616132:0:9822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1746129585.616138:0:9822:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ecbf600/0x40a459093b060bfa lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f1ba48 expref: 9 pid: 2271 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129585.616153:0:9822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009cffe100) 00010000:00010000:2.0:1746129585.616155:0:9822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746129585.616158:0:9822:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1fa800/0x40a459093b06c224 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2279a expref: 8 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129585.616166:0:9822:0:(ldlm_lock.c:2675:ldlm_export_cancel_locks()) Export ffff88012ee0d000, canceled 2 locks, left on hash table 0. 00010000:00010000:2.0:1746129585.616172:0:9822:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746129585.616174:0:9822:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746129585.616175:0:9822:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1746129585.616305:0:16908:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131456680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:068dab75-d300-4ead-a742-d14572ad1e50+6:1959:x1830948734517376:12345-192.168.202.4@tcp:39:umount.0 Request processed in 1180us (2330us total) trans 8589945540 rc 0/0 00000100:00100000:1.0:1746129585.616312:0:16908:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11404 00000100:00100000:0.0:1746129585.654602:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129585.654703:0:16908:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734517504 00000100:00100000:1.0:1746129585.654710:0:16908:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734517504 00000100:00100000:1.0:1746129585.655690:0:16908:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11405 00000100:00100000:1.0:1746129585.655697:0:16908:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131457100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ada2ffba-8920-4ecb-8068-68caa9806978+292:363:x1830948734517504:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:1.0:1746129585.655716:0:16908:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129585.655730:0:16908:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0c4a00/0x40a459093b06c278 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f227d2 expref: -99 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129585.655774:0:16908:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0c4200/0x40a459093b06c27f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129585.655783:0:16908:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0c4200/0x40a459093b06c27f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129585.655791:0:16908:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0c4200/0x40a459093b06c27f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129585.655801:0:16908:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0c5000/0x40a459093b06c286 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129585.655805:0:16908:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0c5000/0x40a459093b06c286 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129585.655809:0:16908:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0c5000/0x40a459093b06c286 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129585.656019:0:16908:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0c4800/0x40a459093b06c28d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129585.656025:0:16908:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0c4800/0x40a459093b06c28d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129585.656030:0:16908:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0c4800/0x40a459093b06c28d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00000004:00200000:1.0:1746129585.656056:0:16908:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00000004:00200000:1.0:1746129585.656059:0:16908:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746129585.656070:0:16908:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0c4800/0x40a459093b06c28d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129585.656077:0:16908:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0c4800/0x40a459093b06c28d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129585.656083:0:16908:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0c4200/0x40a459093b06c27f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129585.656087:0:16908:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0c4200/0x40a459093b06c27f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129585.656092:0:16908:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0c4200/0x40a459093b06c27f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129585.656096:0:16908:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e0c4200 already unused, calling callback (ffffffffa136e690) 00010000:00010000:1.0:1746129585.656100:0:16908:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0c4200/0x40a459093b06c27f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129585.656105:0:16908:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0c4200/0x40a459093b06c27f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129585.656114:0:16908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880132ef8f00) 00010000:00010000:1.0:1746129585.656116:0:16908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129585.656119:0:16908:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0c4200/0x40a459093b06c27f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129585.656124:0:16908:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0c4200/0x40a459093b06c27f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129585.656147:0:16908:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0c5000/0x40a459093b06c286 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129585.656152:0:16908:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0c5000/0x40a459093b06c286 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129585.656156:0:16908:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0c5000/0x40a459093b06c286 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129585.656160:0:16908:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e0c5000 already unused, calling callback (ffffffffa136e690) 00010000:00010000:1.0:1746129585.656162:0:16908:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0c5000/0x40a459093b06c286 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129585.656166:0:16908:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0c5000/0x40a459093b06c286 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129585.656172:0:16908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009cffe300) 00010000:00010000:1.0:1746129585.656174:0:16908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129585.656175:0:16908:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0c5000/0x40a459093b06c286 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129585.656179:0:16908:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0c5000/0x40a459093b06c286 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16908 initiator: MDT0 00010000:00010000:1.0:1746129585.656208:0:16908:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0c4a00/0x40a459093b06c278 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f227d2 expref: 294 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129585.656218:0:16908:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0c4800/0x40a459093b06c28d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f227d2 expref: 293 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129585.656223:0:16908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009cffe100) 00010000:00010000:1.0:1746129585.656225:0:16908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746129585.656227:0:16908:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e0c4800, rc 0) 00000100:00100000:1.0:1746129585.656266:0:16908:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131457100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ada2ffba-8920-4ecb-8068-68caa9806978+293:363:x1830948734517504:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 569us (1979us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129585.656272:0:16908:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11405 00000100:00080000:3.0:1746129585.656793:0:7097:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746129585.660595:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129585.660933:0:15096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734517760 00000100:00100000:2.0:1746129585.660940:0:15096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734517760 00000100:00100000:2.0:1746129585.660993:0:15096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11406 00000100:00100000:2.0:1746129585.661000:0:15096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131456d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ada2ffba-8920-4ecb-8068-68caa9806978+293:363:x1830948734517760:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:2.0:1746129585.661015:0:15096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129585.661032:0:15096:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a062c400/0x40a459093b06c294 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f227d9 expref: -99 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129585.661109:0:15096:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a062d400/0x40a459093b06c29b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129585.661125:0:15096:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0c4800/0x40a459093b06c28d lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f227d2 expref: 294 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129585.661130:0:15096:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a062d400/0x40a459093b06c29b lrc: 4/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129585.661155:0:15096:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0c4800/0x40a459093b06c28d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f227d2 expref: 294 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129585.661168:0:15096:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0c4800/0x40a459093b06c28d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f227d2 expref: 294 pid: 16908 timeout: 940 lvb_type: 0 00000100:00100000:2.0:1746129585.661178:0:15096:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009507dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15096:1830948737660288:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129585.661264:0:15096:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132dadf00 going to sleep for 11 seconds 00000100:00100000:2.0:1746129585.663737:0:15096:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009507dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15096:1830948737660288:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129585.663757:0:15096:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a062d400/0x40a459093b06c29b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15096 initiator: MDT0 00000100:00100000:0.0:1746129585.664579:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129585.664817:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734517888 00000100:00100000:2.0:1746129585.664822:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734517888 00010000:00010000:2.0:1746129585.664845:0:9823:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0c4800/0x40a459093b06c28d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f227d2 expref: 295 pid: 16908 timeout: 940 lvb_type: 0 00000100:00100000:2.0:1746129585.665340:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8832 00000100:00100000:2.0:1746129585.665348:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131457b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ada2ffba-8920-4ecb-8068-68caa9806978+295:1963:x1830948734517888:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129585.665359:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129585.665365:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0c4800/0x40a459093b06c28d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f227d2 expref: 295 pid: 16908 timeout: 940 lvb_type: 0 00010000:00010000:2.0:1746129585.665374:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0c4800/0x40a459093b06c28d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f227d2 expref: 295 pid: 16908 timeout: 940 lvb_type: 0 00010000:00010000:2.0:1746129585.665397:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e0c4800/0x40a459093b06c28d lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f227d2 expref: 295 pid: 16908 timeout: 940 lvb_type: 0 00010000:00010000:2.0:1746129585.665422:0:9823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009cffe100) 00010000:00010000:2.0:1746129585.665426:0:9823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a062d400/0x40a459093b06c29b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129585.665433:0:9823:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a062d400/0x40a459093b06c29b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129585.665439:0:9823:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a062d400/0x40a459093b06c29b lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 15096 initiator: MDT0 00010000:00010000:2.0:1746129585.665468:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746129585.665498:0:15096:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a062d400/0x40a459093b06c29b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15096 initiator: MDT0 00000100:00100000:2.0:1746129585.665504:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131457b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ada2ffba-8920-4ecb-8068-68caa9806978+294:1963:x1830948734517888:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 157us (926us total) trans 0 rc 0/0 00010000:00010000:3.0:1746129585.665506:0:15096:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a062d400/0x40a459093b06c29b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15096 initiator: MDT0 00000100:00100000:2.0:1746129585.665510:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8832 00000004:00200000:3.0:1746129585.665526:0:15096:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:3.0:1746129585.666529:0:15096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a062c400/0x40a459093b06c294 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f227d9 expref: 295 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129585.666552:0:15096:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a062d400/0x40a459093b06c29b lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f227d9 expref: 294 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129585.666557:0:15096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009cffe100) 00010000:00010000:3.0:1746129585.666559:0:15096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746129585.666560:0:15096:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a062d400, rc 0) 00000100:00100000:3.0:1746129585.666587:0:15096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131456d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ada2ffba-8920-4ecb-8068-68caa9806978+294:363:x1830948734517760:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 5589us (6000us total) trans 8589945541 rc 0/0 00000100:00100000:3.0:1746129585.666592:0:15096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11406 00000100:00100000:0.0:1746129585.669741:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129585.669820:0:15096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734518016 00000100:00100000:3.0:1746129585.669827:0:15096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734518016 00000100:00100000:3.0:1746129585.670467:0:15096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11407 00000100:00100000:3.0:1746129585.670476:0:15096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131457480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ada2ffba-8920-4ecb-8068-68caa9806978+294:363:x1830948734518016:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:3.0:1746129585.670493:0:15096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129585.670512:0:15096:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880132fc2400/0x40a459093b06c2a9 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f227e0 expref: -99 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129585.670602:0:15096:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880132fc2600/0x40a459093b06c2b0 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15096 initiator: MDT0 00010000:00010000:3.0:1746129585.670613:0:15096:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a062d400/0x40a459093b06c29b lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f227d9 expref: 295 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129585.670619:0:15096:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880132fc2600/0x40a459093b06c2b0 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15096 initiator: MDT0 00010000:00010000:3.0:1746129585.670646:0:15096:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a062d400/0x40a459093b06c29b lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f227d9 expref: 295 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129585.670656:0:15096:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a062d400/0x40a459093b06c29b lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f227d9 expref: 295 pid: 15096 timeout: 940 lvb_type: 0 00000100:00100000:3.0:1746129585.670666:0:15096:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094064a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15096:1830948737660416:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129585.670749:0:15096:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ec90e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746129585.673347:0:15096:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094064a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15096:1830948737660416:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129585.673390:0:15096:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880132fc2600/0x40a459093b06c2b0 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15096 initiator: MDT0 00000100:00100000:0.0:1746129585.673978:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129585.674059:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734518144 00000100:00100000:1.0:1746129585.674066:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734518144 00010000:00010000:1.0:1746129585.674092:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a062d400/0x40a459093b06c29b lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f227d9 expref: 296 pid: 15096 timeout: 940 lvb_type: 0 00000100:00100000:1.0:1746129585.674204:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8833 00000100:00100000:1.0:1746129585.674211:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131454a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ada2ffba-8920-4ecb-8068-68caa9806978+296:1962:x1830948734518144:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129585.674222:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129585.674226:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a062d400/0x40a459093b06c29b lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f227d9 expref: 296 pid: 15096 timeout: 940 lvb_type: 0 00010000:00010000:1.0:1746129585.674235:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a062d400/0x40a459093b06c29b lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f227d9 expref: 296 pid: 15096 timeout: 940 lvb_type: 0 00010000:00010000:1.0:1746129585.674252:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a062d400/0x40a459093b06c29b lrc: 0/0,0 mode: --/CW res: [0x200000403:0x368:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f227d9 expref: 296 pid: 15096 timeout: 940 lvb_type: 0 00010000:00010000:1.0:1746129585.674279:0:7085:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009cffe100) 00010000:00010000:1.0:1746129585.674283:0:7085:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880132fc2600/0x40a459093b06c2b0 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15096 initiator: MDT0 00010000:00010000:1.0:1746129585.674291:0:7085:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880132fc2600/0x40a459093b06c2b0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 15096 initiator: MDT0 00010000:00010000:1.0:1746129585.674320:0:7085:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880132fc2600/0x40a459093b06c2b0 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 15096 initiator: MDT0 00010000:00010000:1.0:1746129585.674336:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746129585.674345:0:15096:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880132fc2600/0x40a459093b06c2b0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15096 initiator: MDT0 00010000:00010000:3.0:1746129585.674352:0:15096:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880132fc2600/0x40a459093b06c2b0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15096 initiator: MDT0 00000100:00100000:1.0:1746129585.674377:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131454a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ada2ffba-8920-4ecb-8068-68caa9806978+295:1962:x1830948734518144:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 167us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129585.674383:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8833 00000004:00200000:3.0:1746129585.674384:0:15096:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00000004:00200000:3.0:1746129585.674387:0:15096:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746129585.674398:0:15096:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880132fc2600/0x40a459093b06c2b0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15096 initiator: MDT0 00010000:00010000:3.0:1746129585.674420:0:15096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880132fc2400/0x40a459093b06c2a9 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f227e0 expref: 295 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129585.674442:0:15096:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880132fc2600/0x40a459093b06c2b0 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f227e0 expref: 294 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129585.674451:0:15096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009cffe100) 00010000:00010000:3.0:1746129585.674454:0:15096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746129585.674456:0:15096:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132fc2600, rc 0) 00000100:00100000:3.0:1746129585.674487:0:15096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131457480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ada2ffba-8920-4ecb-8068-68caa9806978+294:363:x1830948734518016:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 4013us (4751us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129585.674494:0:15096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11407 00000100:00100000:1.0:1746129585.678514:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129585.678598:0:15096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734518400 00000100:00100000:3.0:1746129585.678605:0:15096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734518400 00000100:00100000:3.0:1746129585.678710:0:15096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11408 00000100:00100000:3.0:1746129585.678718:0:15096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f44b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ada2ffba-8920-4ecb-8068-68caa9806978+294:363:x1830948734518400:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:3.0:1746129585.678732:0:15096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129585.678746:0:15096:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb5fe00/0x40a459093b06c2b7 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f227e7 expref: -99 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129585.678814:0:15096:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb5ea00/0x40a459093b06c2be lrc: 3/0,1 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15096 initiator: MDT0 00010000:00010000:3.0:1746129585.678825:0:15096:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb5ea00/0x40a459093b06c2be lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15096 initiator: MDT0 00010000:00010000:3.0:1746129585.678833:0:15096:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb5ea00/0x40a459093b06c2be lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15096 initiator: MDT0 00000004:00200000:3.0:1746129585.678843:0:15096:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00010000:00010000:3.0:1746129585.678929:0:15096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb5fe00/0x40a459093b06c2b7 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f227e7 expref: 297 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129585.678941:0:15096:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb5ea00/0x40a459093b06c2be lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f227e7 expref: 296 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129585.678947:0:15096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009cffe100) 00010000:00010000:3.0:1746129585.678949:0:15096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746129585.678952:0:15096:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012eb5ea00, rc 0) 00000100:00100000:3.0:1746129585.679575:0:15096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f44b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ada2ffba-8920-4ecb-8068-68caa9806978+296:363:x1830948734518400:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 856us (1065us total) trans 8589945542 rc 0/0 00000100:00100000:3.0:1746129585.679582:0:15096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11408 00000100:00100000:0.0:1746129585.683810:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129585.683847:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129585.683899:0:11014:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734518528 00000100:00100000:0.0:1746129585.683906:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129585.683907:0:11014:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734518528 00000100:00080000:3.0:1746129585.683933:0:7097:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746129585.684032:0:11014:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734518656 00000100:00100000:0.0:1746129585.684033:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129585.684035:0:11014:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734518656 00000100:00100000:0.0:1746129585.684839:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129585.684870:0:4699:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734518784 00000100:00100000:3.0:1746129585.684874:0:4699:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734518784 00000100:00080000:3.0:1746129585.684881:0:7097:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746129585.684906:0:20577:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734518912 00000100:00100000:3.0:1746129585.684908:0:20577:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734518912 00000100:00100000:3.0:1746129585.684923:0:20577:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 17063 00000100:00100000:3.0:1746129585.684929:0:20577:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131455880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ada2ffba-8920-4ecb-8068-68caa9806978+15:1960:x1830948734518528:12345-192.168.202.4@tcp:1:lfs.0 00010000:00010000:3.0:1746129585.684964:0:20577:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880132fc2800/0x40a459093b06c2cc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129585.684979:0:20577:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fe03600/0x40a459093b06c1fa lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22770 expref: 15 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129585.684987:0:20577:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129585.684988:0:20577:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129585.684991:0:20577:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880132fc2800/0x40a459093b06c2cc lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129585.685018:0:20577:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fe03600/0x40a459093b06c1fa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22770 expref: 15 pid: 4385 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129585.685033:0:20577:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fe03600/0x40a459093b06c1fa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22770 expref: 15 pid: 4385 timeout: 941 lvb_type: 1 00000100:00100000:3.0:1746129585.685044:0:20577:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094064a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20577:1830948737660544:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129585.685098:0:20577:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ec90e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746129585.685115:0:7148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 17064 00000100:00100000:3.0:1746129585.685121:0:7148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131455500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ada2ffba-8920-4ecb-8068-68caa9806978+23:1960:x1830948734518656:12345-192.168.202.4@tcp:1:lfs.0 00010000:00010000:3.0:1746129585.685138:0:7148:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009fab4200/0x40a459093b06c2d3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129585.685147:0:7148:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fab4600/0x40a459093b06c26a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f227c4 expref: 23 pid: 4699 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129585.685153:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129585.685154:0:7148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129585.685156:0:7148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fab4200/0x40a459093b06c2d3 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129585.685170:0:7148:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fab4600/0x40a459093b06c26a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f227c4 expref: 23 pid: 4699 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129585.685177:0:7148:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fab4600/0x40a459093b06c26a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f227c4 expref: 23 pid: 4699 timeout: 941 lvb_type: 1 00000100:00100000:3.0:1746129585.685194:0:7148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094067480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:7148:1830948737660672:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129585.685212:0:7148:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ec90780 going to sleep for 11 seconds 00000100:00100000:3.0:1746129585.685225:0:4699:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 17065 00000100:00100000:3.0:1746129585.685230:0:4699:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ada2ffba-8920-4ecb-8068-68caa9806978+23:1960:x1830948734518784:12345-192.168.202.4@tcp:1:lfs.0 00010000:00010000:3.0:1746129585.685242:0:4699:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009fab5200/0x40a459093b06c2da lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129585.685250:0:4699:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fe03a00/0x40a459093b06c208 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2277e expref: 23 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129585.685255:0:4699:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746129585.685255:0:31503:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 17066 00010000:00010000:3.0:1746129585.685256:0:4699:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129585.685257:0:4699:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fab5200/0x40a459093b06c2da lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129585.685263:0:31503:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ada2ffba-8920-4ecb-8068-68caa9806978+15:1960:x1830948734518912:12345-192.168.202.4@tcp:1:lfs.0 00010000:00010000:3.0:1746129585.685269:0:4699:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fe03a00/0x40a459093b06c208 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2277e expref: 23 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129585.685275:0:4699:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fe03a00/0x40a459093b06c208 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2277e expref: 23 pid: 7148 timeout: 941 lvb_type: 1 00010000:00010000:1.0:1746129585.685280:0:31503:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012e0c5c00/0x40a459093b06c2e1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129585.685283:0:4699:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094064700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4699:1830948737660800:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129585.685303:0:31503:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fe02400/0x40a459093b06c20f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22785 expref: 15 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129585.685309:0:31503:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129585.685311:0:31503:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129585.685313:0:31503:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e0c5c00/0x40a459093b06c2e1 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129585.685320:0:4699:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ec90d80 going to sleep for 11 seconds 00010000:00010000:1.0:1746129585.685327:0:31503:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fe02400/0x40a459093b06c20f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22785 expref: 15 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129585.685345:0:31503:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fe02400/0x40a459093b06c20f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22785 expref: 15 pid: 7148 timeout: 941 lvb_type: 1 00000100:00100000:1.0:1746129585.685353:0:31503:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f448a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:31503:1830948737660928:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129585.685374:0:31503:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a673e480 going to sleep for 11 seconds 00000100:00100000:2.0:1746129585.685858:0:11014:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734519040 00000100:00100000:2.0:1746129585.685863:0:11014:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734519040 00000100:00100000:2.0:1746129585.685892:0:11014:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 17067 00000100:00100000:2.0:1746129585.685897:0:11014:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ada2ffba-8920-4ecb-8068-68caa9806978+16:1960:x1830948734519040:12345-192.168.202.4@tcp:1:lfs.0 00010000:00010000:2.0:1746129585.685912:0:11014:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a062c400/0x40a459093b06c2e8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129585.685922:0:11014:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fab5e00/0x40a459093b06c24e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f227a8 expref: 16 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129585.685927:0:11014:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129585.685929:0:11014:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129585.685931:0:11014:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a062c400/0x40a459093b06c2e8 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129585.685948:0:11014:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fab5e00/0x40a459093b06c24e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0xda91008773f227a8 expref: 16 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129585.685958:0:11014:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fab5e00/0x40a459093b06c24e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f227a8 expref: 16 pid: 11014 timeout: 941 lvb_type: 0 00000100:00100000:2.0:1746129585.685966:0:11014:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009507dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11014:1830948737661056:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129585.685987:0:11014:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132dadf00 going to sleep for 11 seconds 00000100:00100000:1.0:1746129585.686011:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129585.686024:0:22480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734519168 00000100:00100000:2.0:1746129585.686027:0:22480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734519168 00000100:00100000:2.0:1746129585.686048:0:22480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 17068 00000100:00100000:2.0:1746129585.686053:0:22480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f449180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ada2ffba-8920-4ecb-8068-68caa9806978+24:1960:x1830948734519168:12345-192.168.202.4@tcp:1:lfs.0 00010000:00010000:2.0:1746129585.686065:0:22480:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800b5263800/0x40a459093b06c2ef lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129585.686074:0:22480:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fe02a00/0x40a459093b06c21d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22793 expref: 24 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129585.686079:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129585.686080:0:22480:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129585.686082:0:22480:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b5263800/0x40a459093b06c2ef lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129585.686094:0:22480:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fe02a00/0x40a459093b06c21d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22793 expref: 24 pid: 7148 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129585.686102:0:22480:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fe02a00/0x40a459093b06c21d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22793 expref: 24 pid: 7148 timeout: 941 lvb_type: 1 00000100:00100000:2.0:1746129585.686109:0:22480:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009507ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22480:1830948737661184:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129585.686126:0:22480:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132dad9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746129585.688889:0:4699:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094064700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4699:1830948737660800:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129585.688911:0:4699:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009fab5200/0x40a459093b06c2da lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129585.693218:0:7148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094067480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:7148:1830948737660672:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129585.693218:0:31503:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f448a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:31503:1830948737660928:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129585.693235:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00010000:00010000:3.0:1746129585.693237:0:7148:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009fab4200/0x40a459093b06c2d3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129585.693237:0:31503:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012e0c5c00/0x40a459093b06c2e1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129585.693250:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129585.693262:0:20577:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094064a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20577:1830948737660544:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129585.693264:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734519424 00000100:00100000:0.0:1746129585.693264:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734519296 00000100:00100000:1.0:1746129585.693268:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734519424 00000100:00100000:0.0:1746129585.693268:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734519296 00010000:00010000:3.0:1746129585.693272:0:20577:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880132fc2800/0x40a459093b06c2cc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129585.693290:0:9823:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fab4600/0x40a459093b06c26a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f227c4 expref: 25 pid: 4699 timeout: 941 lvb_type: 1 00010000:00010000:1.0:1746129585.693309:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fe02400/0x40a459093b06c20f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22785 expref: 17 pid: 7148 timeout: 941 lvb_type: 1 00000100:00100000:3.0:1746129585.693312:0:11014:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009507dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11014:1830948737661056:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129585.693313:0:22480:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009507ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22480:1830948737661184:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129585.693323:0:11014:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800a062c400/0x40a459093b06c2e8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129585.693324:0:22480:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800b5263800/0x40a459093b06c2ef lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129585.693332:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8834 00000100:00100000:0.0:1746129585.693336:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8835 00000100:00100000:1.0:1746129585.693338:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947bed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ada2ffba-8920-4ecb-8068-68caa9806978+17:1962:x1830948734519424:12345-192.168.202.4@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746129585.693342:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947bd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ada2ffba-8920-4ecb-8068-68caa9806978+25:1962:x1830948734519296:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129585.693349:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129585.693349:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129585.693365:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fab4600/0x40a459093b06c26a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f227c4 expref: 25 pid: 4699 timeout: 941 lvb_type: 1 00010000:00010000:1.0:1746129585.693366:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fe02400/0x40a459093b06c20f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22785 expref: 17 pid: 7148 timeout: 941 lvb_type: 1 00010000:00010000:0.0:1746129585.693374:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fab4600/0x40a459093b06c26a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f227c4 expref: 25 pid: 4699 timeout: 941 lvb_type: 1 00010000:00010000:1.0:1746129585.693375:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fe02400/0x40a459093b06c20f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22785 expref: 17 pid: 7148 timeout: 941 lvb_type: 1 00010000:00010000:1.0:1746129585.693391:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fe02400/0x40a459093b06c20f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22785 expref: 17 pid: 7148 timeout: 941 lvb_type: 1 00010000:00010000:0.0:1746129585.693391:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fab4600/0x40a459093b06c26a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f227c4 expref: 25 pid: 4699 timeout: 941 lvb_type: 1 00010000:00010000:1.0:1746129585.693415:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129585.693415:0:9823:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129585.693417:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129585.693417:0:9823:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129585.693420:0:7085:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012e0c5c00/0x40a459093b06c2e1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129585.693420:0:9823:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fab4200/0x40a459093b06c2d3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129585.693426:0:9823:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fab4200/0x40a459093b06c2d3 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129585.693427:0:7085:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e0c5c00/0x40a459093b06c2e1 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129585.693439:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746129585.693443:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129585.693467:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947bd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ada2ffba-8920-4ecb-8068-68caa9806978+24:1962:x1830948734519296:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 126us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129585.693472:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8835 00010000:00010000:3.0:1746129585.693715:0:7148:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009fab4200/0x40a459093b06c2d3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129585.693722:0:7148:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fab4200/0x40a459093b06c2d3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129585.693739:0:7148:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009fab4200/0x40a459093b06c2d3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129585.693746:0:7148:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009fab4200/0x40a459093b06c2d3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129585.693751:0:7148:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009fab4200/0x40a459093b06c2d3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129585.693761:0:7148:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fab4200 already unused, calling callback (ffffffffa086ed70) 00010000:00010000:3.0:1746129585.693763:0:7148:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009fab4200/0x40a459093b06c2d3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129585.693770:0:7148:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009fab4200/0x40a459093b06c2d3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129585.693780:0:7148:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009fab4200/0x40a459093b06c2d3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129585.693786:0:7148:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fab4200/0x40a459093b06c2d3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129585.694125:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129585.694431:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947bed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ada2ffba-8920-4ecb-8068-68caa9806978+16:1962:x1830948734519424:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 1092us (1196us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129585.694437:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8834 00000100:00100000:1.0:1746129585.694448:0:7085:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734519552 00000100:00100000:1.0:1746129585.694451:0:7085:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734519552 00010000:00010000:1.0:1746129585.694468:0:7085:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fe03a00/0x40a459093b06c208 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2277e expref: 24 pid: 7148 timeout: 941 lvb_type: 1 00000100:00100000:1.0:1746129585.694484:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8836 00000100:00100000:1.0:1746129585.694489:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947bd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ada2ffba-8920-4ecb-8068-68caa9806978+24:1962:x1830948734519552:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129585.694495:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129585.694505:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fe03a00/0x40a459093b06c208 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2277e expref: 24 pid: 7148 timeout: 941 lvb_type: 1 00000100:00100000:0.0:1746129585.694701:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129585.694761:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129585.694776:0:20578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734519680 00000100:00100000:0.0:1746129585.694779:0:20578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734519680 00010000:00010000:0.0:1746129585.694791:0:20578:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fe03600/0x40a459093b06c1fa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22770 expref: 16 pid: 4385 timeout: 941 lvb_type: 1 00000100:00100000:0.0:1746129585.694804:0:20578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734519808 00000100:00100000:0.0:1746129585.694806:0:20578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734519808 00010000:00010000:0.0:1746129585.694814:0:20578:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fe02a00/0x40a459093b06c21d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22793 expref: 25 pid: 7148 timeout: 941 lvb_type: 1 00000100:00100000:0.0:1746129585.694822:0:20578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8837 00000100:00100000:0.0:1746129585.694826:0:20578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a44450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ada2ffba-8920-4ecb-8068-68caa9806978+16:1961:x1830948734519680:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129585.694832:0:20578:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129585.694842:0:20578:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fe03600/0x40a459093b06c1fa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22770 expref: 16 pid: 4385 timeout: 941 lvb_type: 1 00010000:00010000:0.0:1746129585.694849:0:20578:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fe03600/0x40a459093b06c1fa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22770 expref: 16 pid: 4385 timeout: 941 lvb_type: 1 00010000:00010000:0.0:1746129585.694860:0:20578:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fe03600/0x40a459093b06c1fa lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22770 expref: 16 pid: 4385 timeout: 941 lvb_type: 1 00010000:00010000:0.0:1746129585.694868:0:20578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129585.694871:0:20578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129585.694873:0:20578:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880132fc2800/0x40a459093b06c2cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129585.694879:0:20578:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880132fc2800/0x40a459093b06c2cc lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129585.694892:0:20578:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129585.694910:0:20578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a44450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ada2ffba-8920-4ecb-8068-68caa9806978+15:1961:x1830948734519680:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 83us (210us total) trans 0 rc 0/0 00010000:00010000:1.0:1746129585.694977:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fe03a00/0x40a459093b06c208 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2277e expref: 25 pid: 7148 timeout: 941 lvb_type: 1 00010000:00010000:1.0:1746129585.694991:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fe03a00/0x40a459093b06c208 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2277e expref: 25 pid: 7148 timeout: 941 lvb_type: 1 00010000:00010000:1.0:1746129585.694999:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129585.695000:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129585.695002:0:7085:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fab5200/0x40a459093b06c2da lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129585.695012:0:7085:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fab5200/0x40a459093b06c2da lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129585.695025:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129585.695040:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947bd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ada2ffba-8920-4ecb-8068-68caa9806978+24:1962:x1830948734519552:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 550us (915us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129585.695045:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8836 00000100:00100000:1.0:1746129585.695056:0:7085:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8838 00000100:00100000:1.0:1746129585.695060:0:7085:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c079500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ada2ffba-8920-4ecb-8068-68caa9806978+23:1962:x1830948734519808:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129585.695066:0:7085:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129585.695075:0:7085:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fe02a00/0x40a459093b06c21d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22793 expref: 23 pid: 7148 timeout: 941 lvb_type: 1 00000100:00100000:3.0:1746129585.695079:0:7148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131455500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ada2ffba-8920-4ecb-8068-68caa9806978+23:1960:x1830948734518656:12345-192.168.202.4@tcp:1:lfs.0 Request processed in 9956us (11228us total) trans 0 rc 0/0 00010000:00010000:1.0:1746129585.695083:0:7085:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fe02a00/0x40a459093b06c21d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22793 expref: 23 pid: 7148 timeout: 941 lvb_type: 1 00000100:00100000:3.0:1746129585.695086:0:7148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 17064 00010000:00010000:1.0:1746129585.695092:0:7085:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fe02a00/0x40a459093b06c21d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22793 expref: 23 pid: 7148 timeout: 941 lvb_type: 1 00010000:00010000:1.0:1746129585.695100:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129585.695101:0:7085:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129585.695104:0:7085:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b5263800/0x40a459093b06c2ef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129585.695109:0:7085:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b5263800/0x40a459093b06c2ef lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129585.695126:0:7085:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746129585.695136:0:22480:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800b5263800/0x40a459093b06c2ef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129585.695140:0:7085:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c079500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ada2ffba-8920-4ecb-8068-68caa9806978+21:1962:x1830948734519808:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 80us (378us total) trans 0 rc 0/0 00010000:00010000:3.0:1746129585.695143:0:22480:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b5263800/0x40a459093b06c2ef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129585.695145:0:7085:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8838 00010000:00010000:3.0:1746129585.695158:0:22480:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800b5263800/0x40a459093b06c2ef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129585.695160:0:31503:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012e0c5c00/0x40a459093b06c2e1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129585.695164:0:22480:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800b5263800/0x40a459093b06c2ef lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129585.695166:0:31503:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e0c5c00/0x40a459093b06c2e1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129585.695170:0:22480:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800b5263800/0x40a459093b06c2ef lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129585.695175:0:22480:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b5263800 already unused, calling callback (ffffffffa086ed70) 00010000:00010000:3.0:1746129585.695178:0:22480:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800b5263800/0x40a459093b06c2ef lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129585.695179:0:31503:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012e0c5c00/0x40a459093b06c2e1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129585.695199:0:31503:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012e0c5c00/0x40a459093b06c2e1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129585.695205:0:31503:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012e0c5c00/0x40a459093b06c2e1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129585.695208:0:22480:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800b5263800/0x40a459093b06c2ef lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129585.695210:0:31503:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e0c5c00 already unused, calling callback (ffffffffa086ed70) 00010000:00010000:1.0:1746129585.695213:0:31503:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012e0c5c00/0x40a459093b06c2e1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129585.695217:0:22480:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800b5263800/0x40a459093b06c2ef lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129585.695218:0:31503:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012e0c5c00/0x40a459093b06c2e1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129585.695222:0:22480:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b5263800/0x40a459093b06c2ef lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 22480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129585.695231:0:31503:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012e0c5c00/0x40a459093b06c2e1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129585.695237:0:31503:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e0c5c00/0x40a459093b06c2e1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129585.695252:0:22480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f449180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ada2ffba-8920-4ecb-8068-68caa9806978+20:1960:x1830948734519168:12345-192.168.202.4@tcp:1:lfs.0 Request processed in 9198us (9241us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129585.695257:0:22480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 17068 00000100:00100000:1.0:1746129585.695269:0:31503:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ada2ffba-8920-4ecb-8068-68caa9806978+15:1960:x1830948734518912:12345-192.168.202.4@tcp:1:lfs.0 Request processed in 10008us (11300us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129585.695275:0:31503:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 17066 00010000:00010000:1.0:1746129585.695323:0:4699:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009fab5200/0x40a459093b06c2da lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129585.695329:0:4699:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fab5200/0x40a459093b06c2da lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129585.695341:0:4699:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009fab5200/0x40a459093b06c2da lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129585.695346:0:4699:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009fab5200/0x40a459093b06c2da lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129585.695351:0:4699:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009fab5200/0x40a459093b06c2da lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129585.695356:0:4699:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fab5200 already unused, calling callback (ffffffffa086ed70) 00010000:00010000:1.0:1746129585.695358:0:4699:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009fab5200/0x40a459093b06c2da lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129585.695363:0:4699:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009fab5200/0x40a459093b06c2da lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129585.695372:0:4699:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009fab5200/0x40a459093b06c2da lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129585.695377:0:4699:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fab5200/0x40a459093b06c2da lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129585.695403:0:4699:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ada2ffba-8920-4ecb-8068-68caa9806978+19:1960:x1830948734518784:12345-192.168.202.4@tcp:1:lfs.0 Request processed in 10173us (11497us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129585.695408:0:4699:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 17065 00000100:00100000:0.0:1746129585.695577:0:20578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8837 00010000:00010000:0.0:1746129585.695610:0:20577:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880132fc2800/0x40a459093b06c2cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129585.695617:0:20577:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880132fc2800/0x40a459093b06c2cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129585.695629:0:20577:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880132fc2800/0x40a459093b06c2cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129585.695634:0:20577:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880132fc2800/0x40a459093b06c2cc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129585.695640:0:20577:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880132fc2800/0x40a459093b06c2cc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129585.695644:0:20577:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880132fc2800 already unused, calling callback (ffffffffa086ed70) 00010000:00010000:0.0:1746129585.695647:0:20577:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880132fc2800/0x40a459093b06c2cc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129585.695723:0:20577:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880132fc2800/0x40a459093b06c2cc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129585.695736:0:20577:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880132fc2800/0x40a459093b06c2cc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129585.695741:0:20577:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880132fc2800/0x40a459093b06c2cc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129585.695772:0:20577:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131455880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ada2ffba-8920-4ecb-8068-68caa9806978+13:1960:x1830948734518528:12345-192.168.202.4@tcp:1:lfs.0 Request processed in 10843us (11970us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129585.695777:0:20577:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 17063 00000100:00100000:1.0:1746129585.695846:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129585.695923:0:20578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734519936 00000100:00100000:0.0:1746129585.695927:0:20578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734519936 00010000:00010000:0.0:1746129585.695938:0:20578:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fab5e00/0x40a459093b06c24e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f227a8 expref: 13 pid: 11014 timeout: 941 lvb_type: 0 00000100:00100000:0.0:1746129585.696418:0:20578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8839 00000100:00100000:0.0:1746129585.696424:0:20578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f448a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ada2ffba-8920-4ecb-8068-68caa9806978+13:1960:x1830948734519936:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129585.696431:0:20578:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129585.696441:0:20578:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fab5e00/0x40a459093b06c24e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f227a8 expref: 13 pid: 11014 timeout: 941 lvb_type: 0 00010000:00010000:0.0:1746129585.696449:0:20578:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fab5e00/0x40a459093b06c24e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f227a8 expref: 13 pid: 11014 timeout: 941 lvb_type: 0 00010000:00010000:0.0:1746129585.696459:0:20578:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fab5e00/0x40a459093b06c24e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0xda91008773f227a8 expref: 13 pid: 11014 timeout: 941 lvb_type: 0 00010000:00010000:0.0:1746129585.696472:0:20578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129585.696474:0:20578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129585.696476:0:20578:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a062c400/0x40a459093b06c2e8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129585.696483:0:20578:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a062c400/0x40a459093b06c2e8 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129585.696498:0:20578:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746129585.696595:0:11014:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a062c400/0x40a459093b06c2e8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129585.696602:0:11014:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a062c400/0x40a459093b06c2e8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129585.696614:0:11014:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a062c400/0x40a459093b06c2e8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129585.696619:0:11014:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a062c400/0x40a459093b06c2e8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129585.696624:0:11014:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a062c400/0x40a459093b06c2e8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129585.696629:0:11014:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a062c400 already unused, calling callback (ffffffffa086ed70) 00010000:00010000:2.0:1746129585.696633:0:11014:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a062c400/0x40a459093b06c2e8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129585.696638:0:11014:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a062c400/0x40a459093b06c2e8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129585.696647:0:11014:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a062c400/0x40a459093b06c2e8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129585.696658:0:11014:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a062c400/0x40a459093b06c2e8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129585.696663:0:20578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f448a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ada2ffba-8920-4ecb-8068-68caa9806978+12:1960:x1830948734519936:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 238us (815us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129585.696668:0:20578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8839 00000100:00100000:2.0:1746129585.696693:0:11014:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ada2ffba-8920-4ecb-8068-68caa9806978+11:1960:x1830948734519040:12345-192.168.202.4@tcp:1:lfs.0 Request processed in 10795us (11854us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129585.696703:0:11014:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 17067 00000100:00100000:0.0:1746129585.704001:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129585.704079:0:15096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734520192 00000100:00100000:3.0:1746129585.704088:0:15096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734520192 00000100:00100000:3.0:1746129585.704215:0:15096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11409 00000100:00100000:3.0:1746129585.704223:0:15096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c07a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ada2ffba-8920-4ecb-8068-68caa9806978+296:363:x1830948734520192:12345-192.168.202.4@tcp:36:lfs.0 00010000:00010000:3.0:1746129585.704267:0:15096:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1746129585.704290:0:15096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880132fc2600/0x40a459093b06c2b0 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f227e0 expref: 296 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129585.704561:0:15096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab4a00/0x40a459093b06c1f3 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22762 expref: 295 pid: 16908 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129585.704571:0:15096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009cffe100) 00010000:00010000:3.0:1746129585.704575:0:15096:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746129585.704597:0:15096:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c40b600/0x40a459093b06c2f6 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15096 initiator: MDT0 00010000:00010000:3.0:1746129585.704605:0:15096:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c40b600/0x40a459093b06c2f6 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15096 initiator: MDT0 00010000:00010000:3.0:1746129585.704612:0:15096:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c40b600/0x40a459093b06c2f6 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15096 initiator: MDT0 00000040:00080000:3.0:1746129585.705146:0:15096:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3536, 88 off297904 00000004:00080000:3.0:1746129585.705152:0:15096:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 841021858177ns, next at 776349687452ns, rc = 0 00000040:00080000:3.0:1746129585.705207:0:15096:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3541, 88 off298256 00000004:00080000:3.0:1746129585.705212:0:15096:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 841021918304ns, next at 776375382381ns, rc = 0 00000040:00080000:3.0:1746129585.705237:0:15096:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3542, 88 off298344 00000004:00080000:3.0:1746129585.705240:0:15096:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 841021945774ns, next at 776375382381ns, rc = 0 00000040:00080000:3.0:1746129585.705246:0:15096:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3537, 88 off297992 00000004:00080000:3.0:1746129585.705249:0:15096:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 841021954974ns, next at 776349687452ns, rc = 0 00000040:00080000:3.0:1746129585.705254:0:15096:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3538, 88 off298080 00000004:00080000:3.0:1746129585.705257:0:15096:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 841021962871ns, next at 776349687452ns, rc = 0 00000040:00080000:3.0:1746129585.705263:0:15096:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3543, 88 off298432 00000004:00080000:3.0:1746129585.705266:0:15096:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 841021972044ns, next at 776375382381ns, rc = 0 00000040:00080000:3.0:1746129585.705272:0:15096:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3544, 88 off298520 00000004:00080000:3.0:1746129585.705274:0:15096:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 841021980742ns, next at 776375382381ns, rc = 0 00000040:00080000:3.0:1746129585.705281:0:15096:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3545, 88 off298608 00000004:00080000:3.0:1746129585.705284:0:15096:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 841021990031ns, next at 776375382381ns, rc = 0 00000040:00080000:3.0:1746129585.705290:0:15096:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3539, 88 off298168 00000004:00080000:3.0:1746129585.705313:0:15096:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 841022019162ns, next at 776349687452ns, rc = 0 00000040:00080000:3.0:1746129585.705322:0:15096:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3546, 88 off298696 00000004:00080000:3.0:1746129585.705324:0:15096:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 841022030741ns, next at 776375382381ns, rc = 0 00000040:00080000:3.0:1746129585.705331:0:15096:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3540, 88 off298256 00000004:00080000:3.0:1746129585.705334:0:15096:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 841022040009ns, next at 776349687452ns, rc = 0 00000040:00080000:3.0:1746129585.705340:0:15096:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3547, 88 off298784 00000004:00080000:3.0:1746129585.705342:0:15096:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 841022048577ns, next at 776375382381ns, rc = 0 00000040:00080000:3.0:1746129585.705348:0:15096:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3541, 88 off298344 00000004:00080000:3.0:1746129585.705350:0:15096:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 841022056481ns, next at 776349687452ns, rc = 0 00000040:00080000:3.0:1746129585.705356:0:15096:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3542, 88 off298432 00000004:00080000:3.0:1746129585.705358:0:15096:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 841022064359ns, next at 776349687452ns, rc = 0 00000040:00080000:3.0:1746129585.705363:0:15096:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3543, 88 off298520 00000004:00080000:3.0:1746129585.705366:0:15096:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 841022072004ns, next at 776349687452ns, rc = 0 00000040:00080000:3.0:1746129585.705371:0:15096:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3544, 88 off298608 00000004:00080000:3.0:1746129585.705373:0:15096:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 841022079576ns, next at 776349687452ns, rc = 0 00000040:00080000:3.0:1746129585.705380:0:15096:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3548, 88 off298872 00000004:00080000:3.0:1746129585.705382:0:15096:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 841022088462ns, next at 776375382381ns, rc = 0 00000001:00100000:1.0:1746129585.740670:0:14619:0:(tgt_lastrcvd.c:532:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 8c95e64d-12cd-4ec3-ad4c-ce0620076de1 00000001:00080000:1.0:1746129585.740679:0:14619:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945539 is committed 00000001:00080000:1.0:1746129585.740688:0:14619:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945531 is committed 00000001:00080000:1.0:1746129585.740692:0:14619:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945530 is committed 00000001:00100000:1.0:1746129585.740697:0:14619:0:(tgt_lastrcvd.c:532:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 068dab75-d300-4ead-a742-d14572ad1e50 00000001:00080000:1.0:1746129585.740701:0:14619:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945540 is committed 00000001:00080000:1.0:1746129585.740706:0:14619:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945537 is committed 00000020:00000080:1.0:1746129585.740713:0:14619:0:(genops.c:904:class_export_put()) final put ffff88012ee0d000/068dab75-d300-4ead-a742-d14572ad1e50 00000020:00000080:1.0:1746129585.740723:0:14619:0:(genops.c:904:class_export_put()) final put ffff8801319ab800/8c95e64d-12cd-4ec3-ad4c-ce0620076de1 00000001:00080000:1.0:1746129585.740728:0:14619:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945543 is committed 00000004:00080000:1.0:1746129585.740731:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2717 committed 00000004:00080000:1.0:1746129585.740746:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2713 committed 00000004:00080000:1.0:1746129585.740752:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2712 committed 00000004:00080000:1.0:1746129585.740754:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2711 committed 00000004:00080000:1.0:1746129585.740755:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2710 committed 00000004:00080000:1.0:1746129585.740757:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2716 committed 00000004:00080000:1.0:1746129585.740758:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2709 committed 00000004:00080000:1.0:1746129585.740759:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2715 committed 00000004:00080000:1.0:1746129585.740761:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2708 committed 00000004:00080000:1.0:1746129585.740762:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2714 committed 00000004:00080000:1.0:1746129585.740764:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2713 committed 00000004:00080000:1.0:1746129585.740766:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2712 committed 00000004:00080000:1.0:1746129585.740767:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2707 committed 00000004:00080000:1.0:1746129585.740769:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2706 committed 00000004:00080000:1.0:1746129585.740770:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2711 committed 00000004:00080000:1.0:1746129585.740771:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2710 committed 00000004:00080000:1.0:1746129585.740773:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2705 committed 00000020:00000080:0.0:1746129585.740831:0:256:0:(genops.c:863:class_export_destroy()) destroying export ffff88012ee0d000/068dab75-d300-4ead-a742-d14572ad1e50 for lustre-MDT0000 00000004:00010000:3.0:1746129585.740908:0:15096:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009c07a680 reply state ffff88009c813800 transno 8589945543 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c40b600/0x40a459093b06c2f6 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15096 initiator: MDT0 00000100:00100000:3.0:1746129585.740917:0:15096:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1746129585.740936:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fa24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1830948737662080:0@lo:2:osp-syn-1-0.0 00010000:00080000:3.0:1746129585.740986:0:15096:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1746129585.740987:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129585.740995:0:15096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c07a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ada2ffba-8920-4ecb-8068-68caa9806978+290:363:x1830948734520192:12345-192.168.202.4@tcp:36:lfs.0 Request processed in 36772us (37001us total) trans 8589945543 rc 0/0 00000100:00100000:3.0:1746129585.741002:0:15096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11409 00000100:00100000:2.0:1746129585.741019:0:3303:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:2.0:1746129585.741023:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009507ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1830948737661312:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129585.741027:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009507dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737661696:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129585.741039:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1746129585.741046:0:3287:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c40b600/0x40a459093b06c2f6 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15096 initiator: MDT0 00000100:00100000:2.0:1746129585.741050:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1830948737661440:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1746129585.741052:0:3287:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c40b600/0x40a459093b06c2f6 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15096 initiator: MDT0 00010000:00010000:3.0:1746129585.741059:0:3287:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c40b600/0x40a459093b06c2f6 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15096 initiator: MDT0 00000100:00100000:2.0:1746129585.741063:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1746129585.741064:0:3287:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c40b600 already unused, calling callback (ffffffffa136e690) 00010000:00010000:3.0:1746129585.741067:0:3287:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c40b600/0x40a459093b06c2f6 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15096 initiator: MDT0 00000100:00100000:2.0:1746129585.741071:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fa26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1830948737661952:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1746129585.741074:0:3287:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c40b600/0x40a459093b06c2f6 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15096 initiator: MDT0 00000100:00100000:2.0:1746129585.741080:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1746129585.741085:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009cffe100) 00010000:00010000:3.0:1746129585.741088:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:2.0:1746129585.741088:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fa24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1830948737662464:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1746129585.741091:0:3287:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c40b600/0x40a459093b06c2f6 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15096 initiator: MDT0 00010000:00010000:3.0:1746129585.741096:0:3287:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c40b600/0x40a459093b06c2f6 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15096 initiator: MDT0 00000100:00100000:2.0:1746129585.741097:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129585.741110:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fa25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737661824:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129585.741111:0:22480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737662080 00000100:00100000:3.0:1746129585.741116:0:22480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737662080 00000100:00100000:2.0:1746129585.741123:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129585.741132:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fa25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737662336:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129585.741135:0:22480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737661312 00000100:00100000:3.0:1746129585.741137:0:22480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737661312 00000100:00100000:2.0:1746129585.741142:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129585.741146:0:22480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737661440 00000100:00100000:3.0:1746129585.741148:0:22480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737661440 00000100:00100000:3.0:1746129585.741157:0:22480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737661952 00000100:00100000:2.0:1746129585.741158:0:11014:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737662464 00000100:00100000:3.0:1746129585.741159:0:22480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737661952 00000100:00100000:2.0:1746129585.741160:0:11014:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737662464 00000100:00100000:3.0:1746129585.741166:0:22480:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737661824 00000100:00100000:3.0:1746129585.741168:0:22480:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737661824 00000100:00100000:2.0:1746129585.741170:0:11014:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737662336 00000100:00100000:2.0:1746129585.741171:0:11014:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737662336 00000100:00100000:3.0:1746129585.741176:0:22480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17069 00000100:00100000:3.0:1746129585.741193:0:22480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+10:3303:x1830948737662080:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129585.741193:0:11014:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17070 00000100:00100000:2.0:1746129585.741197:0:11014:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132c27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+10:3303:x1830948737661312:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129585.741209:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17071 00000100:00100000:2.0:1746129585.741212:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132c24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3303:x1830948737661440:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129585.741365:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132c24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:3303:x1830948737661440:12345-0@lo:2:osp-syn-0-0.0 Request processed in 151us (299us total) trans 21474841490 rc 0/0 00000100:00100000:2.0:1746129585.741370:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17071 00000100:00100000:2.0:1746129585.741381:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17072 00000100:00100000:2.0:1746129585.741385:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132c24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+11:3303:x1830948737661952:12345-0@lo:2:osp-syn-1-0.0 00000020:00000080:0.0:1746129585.741407:0:256:0:(genops.c:863:class_export_destroy()) destroying export ffff8801319ab800/8c95e64d-12cd-4ec3-ad4c-ce0620076de1 for lustre-MDT0000 00000020:00000080:0.0:1746129585.741442:0:256:0:(genops.c:1202:obd_zombie_import_free()) destroying import ffff880129f39000 for lustre-MDT0000 00000020:00000080:0.0:1746129585.741445:0:256:0:(genops.c:1202:obd_zombie_import_free()) destroying import ffff8801319a8800 for lustre-MDT0000 00002000:00010000:2.0:1746129585.741449:0:7149:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746129585.741451:0:7149:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb mtime from disk: 1746129523 -> 1746129523 00002000:00010000:2.0:1746129585.741454:0:7149:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb atime from disk: 1746129523 -> 1746129523 00002000:00010000:2.0:1746129585.741455:0:7149:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb ctime from disk: 1746129524 -> 1746129524 00002000:00010000:2.0:1746129585.741457:0:7149:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1746129585.741462:0:20577:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17073 00000100:00100000:0.0:1746129585.741467:0:20577:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132c25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+12:3303:x1830948737662464:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129585.742062:0:22480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+13:3303:x1830948737662080:12345-0@lo:2:osp-syn-1-0.0 Request processed in 881us (1075us total) trans 17179874238 rc 0/0 00000100:00100000:3.0:1746129585.742068:0:22480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17069 00000100:00100000:3.0:1746129585.742079:0:22480:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17074 00000100:00100000:3.0:1746129585.742084:0:22480:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132c25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+12:3301:x1830948737661824:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129585.742151:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132c24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+12:3303:x1830948737661952:12345-0@lo:2:osp-syn-1-0.0 Request processed in 765us (1068us total) trans 17179874239 rc 0/0 00000100:00100000:2.0:1746129585.742156:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17072 00000100:00100000:2.0:1746129585.742165:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17075 00000100:00100000:2.0:1746129585.742170:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132c25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+12:3301:x1830948737662336:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129585.742210:0:22480:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132c25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+12:3301:x1830948737661824:12345-0@lo:2:osp-syn-1-0.0 Request processed in 127us (1086us total) trans 17179874241 rc 0/0 00000100:00100000:3.0:1746129585.742214:0:22480:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17074 00000100:00100000:3.0:1746129585.742232:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129585.742250:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fa24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737662208:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129585.742256:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132c25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+12:3301:x1830948737662336:12345-0@lo:2:osp-syn-1-0.0 Request processed in 86us (1113us total) trans 17179874242 rc 0/0 00000100:00100000:2.0:1746129585.742260:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17075 00000100:00100000:3.0:1746129585.742265:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129585.742268:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737661696 00000100:00100000:2.0:1746129585.742272:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737661696 00000100:00100000:3.0:1746129585.742281:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737662208 00000100:00100000:3.0:1746129585.742283:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737662208 00000100:00100000:2.0:1746129585.742284:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17076 00000100:00100000:2.0:1746129585.742287:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094064a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:3300:x1830948737661696:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129585.742306:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17077 00000100:00100000:3.0:1746129585.742311:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094067480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+13:3300:x1830948737662208:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129585.742386:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094067480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+15:3300:x1830948737662208:12345-0@lo:2:osp-syn-1-0.0 Request processed in 74us (119us total) trans 17179874243 rc 0/0 00000100:00100000:3.0:1746129585.742391:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17077 00000100:00100000:2.0:1746129585.742393:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094064a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+15:3300:x1830948737661696:12345-0@lo:2:osp-syn-1-0.0 Request processed in 106us (161us total) trans 17179874244 rc 0/0 00000100:00100000:2.0:1746129585.742398:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17076 00000004:00080000:3.0:1746129585.742416:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fa25880/2, rc 0, transno 17179874241 00000100:00100000:3.0:1746129585.742420:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fa25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737661824:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746129585.742426:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fa25180/2, rc 0, transno 17179874242 00000100:00100000:3.0:1746129585.742429:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fa25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737662336:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746129585.742440:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009507dc00/2, rc 0, transno 17179874244 00000100:00100000:3.0:1746129585.742443:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009507dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737661696:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746129585.742449:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fa24a80/2, rc 0, transno 17179874243 00000100:00100000:3.0:1746129585.742451:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fa24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737662208:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129585.742521:0:11014:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132c27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+14:3303:x1830948737661312:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1322us (1481us total) trans 17179874245 rc 0/0 00000100:00100000:2.0:1746129585.742525:0:11014:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17070 00000100:00100000:2.0:1746129585.742539:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093edd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1830948737661568:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129585.742554:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1746129585.742574:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009507ca80/2, rc 0, transno 17179874245 00000100:00100000:2.0:1746129585.742577:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009507ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1830948737661312:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746129585.742583:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c7d9f80/2, rc 0, transno 21474841490 00000100:00100000:2.0:1746129585.742585:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1830948737661440:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746129585.742590:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fa26d80/2, rc 0, transno 17179874239 00000100:00100000:2.0:1746129585.742592:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fa26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1830948737661952:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129585.742638:0:20577:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132c25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+13:3303:x1830948737662464:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1170us (1538us total) trans 17179874240 rc 0/0 00000100:00100000:0.0:1746129585.742643:0:20577:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17073 00000100:00100000:0.0:1746129585.742652:0:20577:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737661568 00000100:00100000:0.0:1746129585.742655:0:20577:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737661568 00000100:00100000:0.0:1746129585.742669:0:20577:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17078 00000100:00100000:0.0:1746129585.742672:0:20577:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132c25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:3303:x1830948737661568:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129585.742770:0:20577:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132c25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+7:3303:x1830948737661568:12345-0@lo:2:osp-syn-0-0.0 Request processed in 97us (215us total) trans 21474841491 rc 0/0 00000100:00100000:0.0:1746129585.742775:0:20577:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17078 00000004:00080000:2.0:1746129585.743753:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fa24700/2, rc 0, transno 17179874240 00000100:00100000:2.0:1746129585.743757:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fa24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1830948737662464:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746129585.743768:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fa24380/2, rc 0, transno 17179874238 00000100:00100000:2.0:1746129585.743771:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fa24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1830948737662080:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129585.743779:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f37fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1830948737662592:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129585.743799:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129585.743828:0:31503:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737662592 00000100:00100000:2.0:1746129585.743830:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800915d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1830948737663104:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129585.743831:0:31503:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737662592 00000100:00100000:2.0:1746129585.743846:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129585.743849:0:31503:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737663104 00000100:00100000:1.0:1746129585.743851:0:31503:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737663104 00000004:00080000:2.0:1746129585.743859:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093edd500/2, rc 0, transno 21474841491 00000100:00100000:1.0:1746129585.743861:0:31503:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17079 00000100:00100000:2.0:1746129585.743862:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093edd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1830948737661568:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129585.743865:0:31503:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132c24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3303:x1830948737662592:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129585.743867:0:3303:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1746129585.743870:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800915d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1830948737662976:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129585.743883:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129585.743898:0:22481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737662976 00000100:00100000:2.0:1746129585.743901:0:22481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737662976 00000100:00100000:2.0:1746129585.743913:0:22481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17080 00000100:00100000:2.0:1746129585.743917:0:22481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c29c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+9:3303:x1830948737663104:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129585.743974:0:31503:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132c24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+11:3303:x1830948737662592:12345-0@lo:2:osp-syn-0-0.0 Request processed in 108us (173us total) trans 21474841492 rc 0/0 00000100:00100000:1.0:1746129585.743979:0:31503:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17079 00002000:00010000:2.0:1746129585.743981:0:22481:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746129585.743984:0:22481:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1746129585.743986:0:22481:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746129585.743987:0:22481:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1746129585.743989:0:22481:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1746129585.743989:0:31503:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17081 00000100:00100000:1.0:1746129585.743993:0:31503:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135724e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+10:3303:x1830948737662976:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129585.744004:0:22481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c29c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+10:3303:x1830948737663104:12345-0@lo:2:osp-syn-0-0.0 Request processed in 87us (158us total) trans 21474841493 rc 0/0 00000100:00100000:2.0:1746129585.744009:0:22481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17080 00000100:00100000:1.0:1746129585.744060:0:31503:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135724e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+10:3303:x1830948737662976:12345-0@lo:2:osp-syn-0-0.0 Request processed in 67us (175us total) trans 21474841494 rc 0/0 00000100:00100000:1.0:1746129585.744064:0:31503:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17081 00000004:00080000:1.0:1746129585.744090:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800915d2680/2, rc 0, transno 21474841494 00000100:00100000:1.0:1746129585.744094:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800915d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1830948737662976:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746129585.744099:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f37fb80/2, rc 0, transno 21474841492 00000100:00100000:1.0:1746129585.744101:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f37fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1830948737662592:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746129585.744106:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800915d2300/2, rc 0, transno 21474841493 00000100:00100000:1.0:1746129585.744108:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800915d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1830948737663104:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129585.744216:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800915d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737662848:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129585.744236:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129585.744263:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800915d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737663360:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129585.744277:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129585.744288:0:3301:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1746129585.744291:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800915d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737662720:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129585.744323:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129585.744342:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800915d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737663232:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129585.744355:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129585.744370:0:8412:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737662848 00000100:00100000:3.0:1746129585.744373:0:8412:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737662848 00000100:00100000:3.0:1746129585.744385:0:8412:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737663360 00000100:00100000:3.0:1746129585.744386:0:8412:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737663360 00000100:00100000:3.0:1746129585.744393:0:8412:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737662720 00000100:00100000:3.0:1746129585.744394:0:8412:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737662720 00000100:00100000:3.0:1746129585.744402:0:8412:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737663232 00000100:00100000:3.0:1746129585.744403:0:8412:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737663232 00000100:00100000:3.0:1746129585.744412:0:8412:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17082 00000100:00100000:3.0:1746129585.744416:0:8412:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094064700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3301:x1830948737662848:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129585.744498:0:8412:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094064700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+14:3301:x1830948737662848:12345-0@lo:2:osp-syn-0-0.0 Request processed in 81us (261us total) trans 21474841495 rc 0/0 00000100:00100000:3.0:1746129585.744503:0:8412:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17082 00000100:00100000:3.0:1746129585.744512:0:8412:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17083 00000100:00100000:3.0:1746129585.744516:0:8412:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094065c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3301:x1830948737663360:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129585.744585:0:8412:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094065c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+14:3301:x1830948737663360:12345-0@lo:2:osp-syn-0-0.0 Request processed in 68us (307us total) trans 21474841496 rc 0/0 00000100:00100000:3.0:1746129585.744590:0:8412:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17083 00000100:00100000:3.0:1746129585.744598:0:8412:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17084 00000100:00100000:3.0:1746129585.744603:0:8412:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094067800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3301:x1830948737662720:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129585.744672:0:8412:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094067800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+14:3301:x1830948737662720:12345-0@lo:2:osp-syn-0-0.0 Request processed in 69us (347us total) trans 21474841497 rc 0/0 00000100:00100000:3.0:1746129585.744676:0:8412:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17084 00000100:00100000:3.0:1746129585.744684:0:8412:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17085 00000100:00100000:3.0:1746129585.744689:0:8412:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094066300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3301:x1830948737663232:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129585.744756:0:8412:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094066300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+14:3301:x1830948737663232:12345-0@lo:2:osp-syn-0-0.0 Request processed in 67us (400us total) trans 21474841498 rc 0/0 00000100:00100000:3.0:1746129585.744761:0:8412:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17085 00000004:00080000:3.0:1746129585.744787:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800915d0e00/2, rc 0, transno 21474841497 00000100:00100000:3.0:1746129585.744791:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800915d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737662720:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746129585.744795:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800915d1f80/2, rc 0, transno 21474841498 00000100:00100000:3.0:1746129585.744798:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800915d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737663232:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746129585.744803:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800915d3100/2, rc 0, transno 21474841495 00000100:00100000:3.0:1746129585.744805:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800915d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737662848:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746129585.744809:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800915d3480/2, rc 0, transno 21474841496 00000100:00100000:3.0:1746129585.744811:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800915d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737663360:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129585.746846:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129585.747468:0:15096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734520320 00000100:00100000:3.0:1746129585.747475:0:15096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734520320 00000100:00100000:3.0:1746129585.747510:0:15096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11410 00000100:00100000:3.0:1746129585.747517:0:15096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c07ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ada2ffba-8920-4ecb-8068-68caa9806978+289:363:x1830948734520320:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:3.0:1746129585.747533:0:15096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129585.747548:0:15096:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d85b800/0x40a459093b06c2fd lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f227ee expref: -99 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129585.747591:0:15096:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d85b800/0x40a459093b06c2fd lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f227ee expref: 290 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129585.747602:0:15096:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d85b800/0x40a459093b06c2fd lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f227ee expref: 290 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129585.747615:0:15096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009cffe100) 00010000:00010000:3.0:1746129585.747617:0:15096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746129585.747620:0:15096:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d85b800, rc 0) 00000100:00100000:3.0:1746129585.748217:0:15096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c07ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ada2ffba-8920-4ecb-8068-68caa9806978+290:363:x1830948734520320:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 698us (1374us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129585.748223:0:15096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11410 00000100:00100000:1.0:1746129585.753514:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129585.755491:0:15096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734520448 00000100:00100000:3.0:1746129585.755502:0:15096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734520448 00000100:00100000:3.0:1746129585.755558:0:15096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11411 00000100:00100000:3.0:1746129585.755566:0:15096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800915d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ada2ffba-8920-4ecb-8068-68caa9806978+290:363:x1830948734520448:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:3.0:1746129585.755582:0:15096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129585.755598:0:15096:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d85a200/0x40a459093b06c304 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f227f5 expref: -99 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129585.755663:0:15096:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab4800/0x40a459093b06c30b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15096 initiator: MDT0 00010000:00010000:3.0:1746129585.755673:0:15096:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab4800/0x40a459093b06c30b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15096 initiator: MDT0 00010000:00010000:3.0:1746129585.755682:0:15096:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab4800/0x40a459093b06c30b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15096 initiator: MDT0 00000004:00200000:3.0:1746129585.755702:0:15096:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x368:0x0]: returning size 9340640 00000004:00200000:3.0:1746129585.755705:0:15096:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746129585.755716:0:15096:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab4800/0x40a459093b06c30b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15096 initiator: MDT0 00010000:00010000:3.0:1746129585.755732:0:15096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d85a200/0x40a459093b06c304 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f227f5 expref: 292 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129585.755751:0:15096:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab4800/0x40a459093b06c30b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f227f5 expref: 291 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129585.755758:0:15096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009cffe100) 00010000:00010000:3.0:1746129585.755760:0:15096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746129585.755763:0:15096:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fab4800, rc 0) 00000100:00100000:3.0:1746129585.755815:0:15096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800915d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ada2ffba-8920-4ecb-8068-68caa9806978+291:363:x1830948734520448:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 250us (2309us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129585.755821:0:15096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11411 00000100:00100000:0.0:1746129585.758414:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129585.758524:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129585.758567:0:20577:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734520576 00000100:00100000:2.0:1746129585.758577:0:20577:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734520576 00000100:00100000:2.0:1746129585.758609:0:20577:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734520832 00000100:00100000:2.0:1746129585.758611:0:20577:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734520832 00000100:00100000:1.0:1746129585.758620:0:4699:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 17086 00000100:00100000:1.0:1746129585.758633:0:4699:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c079f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ada2ffba-8920-4ecb-8068-68caa9806978+11:1962:x1830948734520576:12345-192.168.202.4@tcp:101:lfs.0 00000100:00100000:2.0:1746129585.758641:0:20577:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 17087 00000100:00100000:2.0:1746129585.758648:0:20577:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c078700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ada2ffba-8920-4ecb-8068-68caa9806978+19:1963:x1830948734520832:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:1.0:1746129585.758658:0:4699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129585.758662:0:20577:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129585.758679:0:20577:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880132fc3000/0x40a459093b06c312 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2280a expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129585.758679:0:4699:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094c09800/0x40a459093b06c319 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f227fc expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746129585.758701:0:20577:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3f4:0x0] initial LVB size: 2097152, mtime: 0x6813d2b0, atime: 0x6813d2b0, ctime: 0x6813d2b0, blocks: 0x821 00002000:00010000:1.0:1746129585.758703:0:4699:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3ec:0x0] initial LVB size: 1048576, mtime: 0x6813d2b0, atime: 0x6813d2b0, ctime: 0x6813d2b0, blocks: 0x817 00010000:00010000:2.0:1746129585.758717:0:20577:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129585.758719:0:20577:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129585.758719:0:4699:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129585.758721:0:4699:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129585.758727:0:20577:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880132fc3000/0x40a459093b06c312 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2280a expref: 20 pid: 20577 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129585.758729:0:4699:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094c09800/0x40a459093b06c319 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f227fc expref: 12 pid: 4699 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129585.758741:0:20577:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880132fc3000/0x40a459093b06c312 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2280a expref: 20 pid: 20577 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129585.758741:0:4699:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094c09800/0x40a459093b06c319 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f227fc expref: 12 pid: 4699 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129585.758750:0:20577:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132fc3000, rc 0) 00010000:00010000:1.0:1746129585.758750:0:4699:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094c09800, rc 0) 00000100:00100000:1.0:1746129585.758961:0:4699:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c079f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ada2ffba-8920-4ecb-8068-68caa9806978+12:1962:x1830948734520576:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 330us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129585.758967:0:4699:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 17086 00000100:00100000:2.0:1746129585.761441:0:20577:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c078700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ada2ffba-8920-4ecb-8068-68caa9806978+20:1963:x1830948734520832:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 2784us (2907us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129585.761451:0:20577:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 17087 00000100:00100000:1.0:1746129585.761835:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129585.761858:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129585.761887:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129585.761911:0:4699:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734521088 00000100:00100000:0.0:1746129585.761920:0:4699:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734521088 00000100:00100000:1.0:1746129585.761923:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129585.761940:0:8411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734520704 00000100:00100000:1.0:1746129585.761942:0:8411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734520704 00000100:00100000:0.0:1746129585.762020:0:4699:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734520960 00000100:00100000:0.0:1746129585.762024:0:4699:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734520960 00000100:00100000:1.0:1746129585.762153:0:8411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734521216 00000100:00100000:1.0:1746129585.762157:0:8411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734521216 00000100:00100000:0.0:1746129585.762188:0:4699:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 17088 00000100:00100000:0.0:1746129585.762196:0:4699:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800915d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ada2ffba-8920-4ecb-8068-68caa9806978+13:1963:x1830948734521088:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:0.0:1746129585.762217:0:4699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129585.762240:0:4699:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130140a00/0x40a459093b06c320 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f22818 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746129585.762267:0:4699:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3ef:0x0] initial LVB size: 5146336, mtime: 0x6813d2b0, atime: 0x6813d2b0, ctime: 0x6813d2b0, blocks: 0x1793 00010000:00010000:0.0:1746129585.762287:0:4699:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129585.762289:0:4699:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129585.762321:0:4699:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130140a00/0x40a459093b06c320 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22818 expref: 14 pid: 4699 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129585.762338:0:4699:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130140a00/0x40a459093b06c320 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22818 expref: 14 pid: 4699 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129585.762349:0:4699:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130140a00, rc 0) 00000100:00100000:0.0:1746129585.762388:0:4699:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800915d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ada2ffba-8920-4ecb-8068-68caa9806978+14:1963:x1830948734521088:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 193us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129585.762394:0:4699:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 17088 00000100:00100000:0.0:1746129585.762409:0:4699:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 17089 00000100:00100000:0.0:1746129585.762413:0:4699:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800915d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ada2ffba-8920-4ecb-8068-68caa9806978+21:1963:x1830948734520704:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:0.0:1746129585.762420:0:4699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129585.762431:0:4699:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130140600/0x40a459093b06c327 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f22803 expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746129585.762445:0:4699:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3f3:0x0] initial LVB size: 2097152, mtime: 0x6813d2b0, atime: 0x6813d2b0, ctime: 0x6813d2b0, blocks: 0x821 00010000:00010000:0.0:1746129585.762454:0:4699:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129585.762455:0:4699:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129585.762459:0:4699:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130140600/0x40a459093b06c327 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22803 expref: 22 pid: 4699 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129585.762468:0:4699:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130140600/0x40a459093b06c327 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22803 expref: 22 pid: 4699 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129585.762476:0:4699:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130140600, rc 0) 00000100:00100000:2.0:1746129585.762489:0:20577:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 17090 00000100:00100000:0.0:1746129585.762491:0:4699:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800915d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ada2ffba-8920-4ecb-8068-68caa9806978+22:1963:x1830948734520704:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 78us (632us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129585.762496:0:4699:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 17089 00000100:00100000:2.0:1746129585.762502:0:20577:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129bc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ada2ffba-8920-4ecb-8068-68caa9806978+13:1963:x1830948734520960:12345-192.168.202.4@tcp:101:lfs.0 00000100:00100000:0.0:1746129585.762510:0:4699:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 17091 00000100:00100000:0.0:1746129585.762513:0:4699:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129bc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ada2ffba-8920-4ecb-8068-68caa9806978+21:1963:x1830948734521216:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:2.0:1746129585.762518:0:20577:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129585.762519:0:4699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129585.762527:0:4699:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130141e00/0x40a459093b06c32e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2281f expref: -99 pid: 4699 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129585.762535:0:20577:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880132fc2400/0x40a459093b06c335 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f22811 expref: -99 pid: 20577 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746129585.762543:0:4699:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3f5:0x0] initial LVB size: 4194304, mtime: 0x6813d2b0, atime: 0x6813d2b0, ctime: 0x6813d2b0, blocks: 0x1029 00010000:00010000:0.0:1746129585.762550:0:4699:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129585.762551:0:4699:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129585.762554:0:4699:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130141e00/0x40a459093b06c32e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2281f expref: 22 pid: 4699 timeout: 0 lvb_type: 1 00002000:00010000:2.0:1746129585.762561:0:20577:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3ee:0x0] initial LVB size: 2097152, mtime: 0x6813d2b0, atime: 0x6813d2b0, ctime: 0x6813d2b0, blocks: 0x821 00010000:00010000:0.0:1746129585.762562:0:4699:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130141e00/0x40a459093b06c32e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2281f expref: 22 pid: 4699 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129585.762569:0:4699:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130141e00, rc 0) 00010000:00010000:2.0:1746129585.762577:0:20577:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129585.762579:0:20577:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746129585.762584:0:4699:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129bc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ada2ffba-8920-4ecb-8068-68caa9806978+22:1963:x1830948734521216:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 71us (660us total) trans 0 rc 0/0 00010000:00010000:2.0:1746129585.762586:0:20577:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880132fc2400/0x40a459093b06c335 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22811 expref: 14 pid: 20577 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746129585.762590:0:4699:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 17091 00010000:00010000:2.0:1746129585.762599:0:20577:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880132fc2400/0x40a459093b06c335 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22811 expref: 14 pid: 20577 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129585.762607:0:20577:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132fc2400, rc 0) 00000100:00100000:2.0:1746129585.762650:0:20577:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129bc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ada2ffba-8920-4ecb-8068-68caa9806978+14:1963:x1830948734520960:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 152us (762us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129585.762656:0:20577:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 17090 00000100:00100000:0.0:1746129585.770898:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129585.771080:0:8416:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734521472 00000100:00100000:3.0:1746129585.771090:0:8416:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734521472 00000100:00100000:3.0:1746129585.771168:0:8416:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8289 00000100:00100000:3.0:1746129585.771175:0:8416:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c078a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ada2ffba-8920-4ecb-8068-68caa9806978+14:1962:x1830948734521472:12345-192.168.202.4@tcp:3:lfs.0 00010000:00010000:3.0:1746129585.771227:0:8416:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009fab4200/0x40a459093b06c33c lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8416 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129585.771241:0:8416:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129585.771244:0:8416:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129585.771249:0:8416:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fab4200/0x40a459093b06c33c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8416 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129585.771263:0:8416:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fab4200/0x40a459093b06c33c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8416 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129585.774844:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129585.777018:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129585.778032:0:31520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734521728 00000100:00100000:2.0:1746129585.778042:0:31520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734521728 00000100:00100000:2.0:1746129585.778110:0:31520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734521984 00000100:00100000:2.0:1746129585.778112:0:31520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734521984 00000100:00100000:2.0:1746129585.778130:0:31520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8290 00000100:00100000:2.0:1746129585.778139:0:31520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c07b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ada2ffba-8920-4ecb-8068-68caa9806978+23:1963:x1830948734521728:12345-192.168.202.4@tcp:3:lfs.0 00000100:00100000:3.0:1746129585.778143:0:21725:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8291 00000100:00100000:3.0:1746129585.778152:0:21725:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c07aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ada2ffba-8920-4ecb-8068-68caa9806978+23:1962:x1830948734521984:12345-192.168.202.4@tcp:3:lfs.0 00010000:00010000:3.0:1746129585.778176:0:21725:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009fab4400/0x40a459093b06c343 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129585.778176:0:31520:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800b1b23000/0x40a459093b06c34a lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129585.778200:0:31520:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129585.778201:0:21725:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129585.778202:0:21725:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129585.778202:0:31520:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129585.778207:0:21725:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fab4400/0x40a459093b06c343 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129585.778207:0:31520:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b1b23000/0x40a459093b06c34a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129585.778220:0:21725:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fab4400/0x40a459093b06c343 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21725 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129585.778220:0:31520:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b1b23000/0x40a459093b06c34a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31520 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129585.782234:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129585.784506:0:31518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734522240 00000100:00100000:3.0:1746129585.784520:0:31518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734522240 00000100:00100000:3.0:1746129585.784592:0:31518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8292 00000100:00100000:3.0:1746129585.784601:0:31518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129bc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ada2ffba-8920-4ecb-8068-68caa9806978+16:1962:x1830948734522240:12345-192.168.202.4@tcp:3:lfs.0 00010000:00010000:3.0:1746129585.784642:0:31518:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009fab5000/0x40a459093b06c351 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129585.784657:0:31518:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129585.784659:0:31518:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129585.784666:0:31518:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fab5000/0x40a459093b06c351 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129585.784679:0:31518:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fab5000/0x40a459093b06c351 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31518 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129585.785264:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129585.785401:0:25745:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734522496 00000100:00100000:1.0:1746129585.785405:0:25745:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734522496 00000100:00100000:1.0:1746129585.785432:0:25745:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8293 00000100:00100000:1.0:1746129585.785438:0:25745:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129bc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+17:1963:x1830948734522496:12345-192.168.202.4@tcp:3:lfs.0 00010000:00010000:1.0:1746129585.785453:0:25745:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880132dfd600/0x40a459093b06c358 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25745 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129585.785460:0:25745:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129585.785461:0:25745:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129585.785464:0:25745:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880132dfd600/0x40a459093b06c358 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25745 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129585.785472:0:25745:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880132dfd600/0x40a459093b06c358 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25745 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129585.787406:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129585.787581:0:21463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734522880 00000100:00100000:3.0:1746129585.787592:0:21463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734522880 00000100:00100000:3.0:1746129585.787658:0:21463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8294 00000100:00100000:3.0:1746129585.787666:0:21463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c078e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ada2ffba-8920-4ecb-8068-68caa9806978+25:1963:x1830948734522880:12345-192.168.202.4@tcp:3:lfs.0 00010000:00010000:3.0:1746129585.787694:0:21463:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009fab5e00/0x40a459093b06c35f lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21463 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129585.787705:0:21463:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129585.787707:0:21463:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129585.787711:0:21463:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fab5e00/0x40a459093b06c35f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21463 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129585.787722:0:21463:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fab5e00/0x40a459093b06c35f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21463 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129585.788970:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129585.789610:0:31522:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734523008 00000100:00100000:2.0:1746129585.789618:0:31522:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734523008 00000100:00100000:2.0:1746129585.789675:0:31522:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8295 00000100:00100000:2.0:1746129585.789683:0:31522:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c07b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ada2ffba-8920-4ecb-8068-68caa9806978+19:1963:x1830948734523008:12345-192.168.202.4@tcp:3:lfs.0 00010000:00010000:2.0:1746129585.789717:0:31522:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880095025a00/0x40a459093b06c366 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31522 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129585.789729:0:31522:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129585.789731:0:31522:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129585.789737:0:31522:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095025a00/0x40a459093b06c366 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31522 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129585.789749:0:31522:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095025a00/0x40a459093b06c366 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31522 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129585.791054:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129585.791086:0:31523:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734523264 00000100:00100000:3.0:1746129585.791096:0:31523:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734523264 00000100:00100000:3.0:1746129585.791148:0:31523:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8296 00000100:00100000:3.0:1746129585.791156:0:31523:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ada2ffba-8920-4ecb-8068-68caa9806978+27:1962:x1830948734523264:12345-192.168.202.4@tcp:3:lfs.0 00010000:00010000:3.0:1746129585.791193:0:31523:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012d85a200/0x40a459093b06c36d lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129585.791204:0:31523:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129585.791206:0:31523:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129585.791210:0:31523:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d85a200/0x40a459093b06c36d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129585.791220:0:31523:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d85a200/0x40a459093b06c36d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129585.794572:0:8416:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009fab4200/0x40a459093b06c33c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8416 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129585.794591:0:8416:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009fab4200/0x40a459093b06c33c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8416 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129585.794599:0:8416:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009fab4200/0x40a459093b06c33c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8416 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129585.794606:0:8416:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fab4200 already unused, calling callback (ffffffffa086ed70) 00010000:00010000:2.0:1746129585.794612:0:8416:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009fab4200/0x40a459093b06c33c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8416 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129585.794620:0:8416:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009fab4200/0x40a459093b06c33c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8416 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129585.794641:0:8416:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009fab4200/0x40a459093b06c33c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8416 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129585.794648:0:8416:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fab4200/0x40a459093b06c33c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8416 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129585.794750:0:8416:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c078a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ada2ffba-8920-4ecb-8068-68caa9806978+19:1962:x1830948734521472:12345-192.168.202.4@tcp:3:lfs.0 Request processed in 23569us (23857us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129585.794761:0:8416:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8289 00010000:00010000:0.0:1746129585.803600:0:31520:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800b1b23000/0x40a459093b06c34a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31520 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129585.803620:0:31520:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800b1b23000/0x40a459093b06c34a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31520 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129585.803628:0:31520:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800b1b23000/0x40a459093b06c34a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31520 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129585.803636:0:31520:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b1b23000 already unused, calling callback (ffffffffa086ed70) 00010000:00010000:0.0:1746129585.803639:0:31520:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800b1b23000/0x40a459093b06c34a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31520 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129585.803647:0:31520:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800b1b23000/0x40a459093b06c34a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31520 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129585.803669:0:31520:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800b1b23000/0x40a459093b06c34a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31520 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129585.803676:0:31520:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b1b23000/0x40a459093b06c34a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31520 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129585.803796:0:31520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c07b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ada2ffba-8920-4ecb-8068-68caa9806978+28:1963:x1830948734521728:12345-192.168.202.4@tcp:3:lfs.0 Request processed in 25653us (28957us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129585.803807:0:31520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8290 00010000:00010000:1.0:1746129585.812057:0:25745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880132dfd600/0x40a459093b06c358 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25745 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129585.812076:0:25745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880132dfd600/0x40a459093b06c358 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25745 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129585.812089:0:25745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880132dfd600/0x40a459093b06c358 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25745 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129585.812095:0:25745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880132dfd600 already unused, calling callback (ffffffffa086ed70) 00010000:00010000:1.0:1746129585.812100:0:25745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880132dfd600/0x40a459093b06c358 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25745 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129585.812107:0:25745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880132dfd600/0x40a459093b06c358 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25745 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129585.812128:0:25745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880132dfd600/0x40a459093b06c358 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25745 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129585.812133:0:25745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880132dfd600/0x40a459093b06c358 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25745 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129585.812245:0:25745:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129bc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ada2ffba-8920-4ecb-8068-68caa9806978+18:1963:x1830948734522496:12345-192.168.202.4@tcp:3:lfs.0 Request processed in 26799us (26975us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129585.812255:0:25745:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8293 00010000:00010000:3.0:1746129585.823089:0:21463:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009fab5e00/0x40a459093b06c35f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21463 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129585.823104:0:21463:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009fab5e00/0x40a459093b06c35f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21463 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129585.823111:0:21463:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009fab5e00/0x40a459093b06c35f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21463 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129585.823116:0:21463:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fab5e00 already unused, calling callback (ffffffffa086ed70) 00010000:00010000:3.0:1746129585.823119:0:21463:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009fab5e00/0x40a459093b06c35f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21463 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129585.823125:0:21463:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009fab5e00/0x40a459093b06c35f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21463 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129585.823141:0:21463:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009fab5e00/0x40a459093b06c35f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21463 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129585.823146:0:21463:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fab5e00/0x40a459093b06c35f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21463 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129585.823239:0:21463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c078e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ada2ffba-8920-4ecb-8068-68caa9806978+26:1963:x1830948734522880:12345-192.168.202.4@tcp:3:lfs.0 Request processed in 35570us (35838us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129585.823248:0:21463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8294 00010000:00010000:1.0:1746129585.828794:0:21725:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009fab4400/0x40a459093b06c343 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129585.828810:0:21725:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009fab4400/0x40a459093b06c343 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129585.828818:0:21725:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009fab4400/0x40a459093b06c343 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129585.828826:0:21725:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fab4400 already unused, calling callback (ffffffffa086ed70) 00010000:00010000:1.0:1746129585.828830:0:21725:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009fab4400/0x40a459093b06c343 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129585.828837:0:21725:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009fab4400/0x40a459093b06c343 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129585.828857:0:21725:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009fab4400/0x40a459093b06c343 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21725 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129585.828862:0:21725:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fab4400/0x40a459093b06c343 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21725 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129585.829569:0:21725:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c07aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ada2ffba-8920-4ecb-8068-68caa9806978+24:1962:x1830948734521984:12345-192.168.202.4@tcp:3:lfs.0 Request processed in 51412us (52554us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129585.829579:0:21725:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8291 00010000:00010000:2.0:1746129585.844066:0:31522:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880095025a00/0x40a459093b06c366 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31522 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129585.844085:0:31522:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880095025a00/0x40a459093b06c366 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31522 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129585.844093:0:31522:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880095025a00/0x40a459093b06c366 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31522 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129585.844099:0:31522:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095025a00 already unused, calling callback (ffffffffa086ed70) 00010000:00010000:2.0:1746129585.844104:0:31522:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880095025a00/0x40a459093b06c366 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31522 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129585.844111:0:31522:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880095025a00/0x40a459093b06c366 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31522 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129585.844133:0:31522:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880095025a00/0x40a459093b06c366 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31522 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129585.844139:0:31522:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095025a00/0x40a459093b06c366 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31522 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129585.844279:0:31522:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c07b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ada2ffba-8920-4ecb-8068-68caa9806978+16:1963:x1830948734523008:12345-192.168.202.4@tcp:3:lfs.0 Request processed in 54590us (55307us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129585.844289:0:31522:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8295 00010000:00010000:2.0:1746129585.854144:0:31518:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009fab5000/0x40a459093b06c351 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129585.854161:0:31518:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009fab5000/0x40a459093b06c351 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129585.854168:0:31518:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009fab5000/0x40a459093b06c351 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129585.854173:0:31518:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fab5000 already unused, calling callback (ffffffffa086ed70) 00010000:00010000:2.0:1746129585.854177:0:31518:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009fab5000/0x40a459093b06c351 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129585.854196:0:31518:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009fab5000/0x40a459093b06c351 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129585.854216:0:31518:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009fab5000/0x40a459093b06c351 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129585.854227:0:31518:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fab5000/0x40a459093b06c351 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31518 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129585.855115:0:31518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129bc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ada2ffba-8920-4ecb-8068-68caa9806978+14:1962:x1830948734522240:12345-192.168.202.4@tcp:3:lfs.0 Request processed in 70507us (72884us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129585.855127:0:31518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8292 00010000:00010000:2.0:1746129585.859631:0:31523:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012d85a200/0x40a459093b06c36d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129585.859651:0:31523:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012d85a200/0x40a459093b06c36d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129585.859661:0:31523:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012d85a200/0x40a459093b06c36d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129585.859667:0:31523:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d85a200 already unused, calling callback (ffffffffa086ed70) 00010000:00010000:2.0:1746129585.859671:0:31523:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012d85a200/0x40a459093b06c36d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129585.859679:0:31523:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012d85a200/0x40a459093b06c36d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129585.859701:0:31523:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012d85a200/0x40a459093b06c36d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129585.859708:0:31523:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d85a200/0x40a459093b06c36d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31523 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129585.863872:0:31523:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ada2ffba-8920-4ecb-8068-68caa9806978+22:1962:x1830948734523264:12345-192.168.202.4@tcp:3:lfs.0 Request processed in 72705us (72810us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129585.863885:0:31523:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8296 00000100:00100000:0.0:1746129585.872675:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129585.872793:0:15096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734523520 00000100:00100000:3.0:1746129585.872802:0:15096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734523520 00000100:00100000:3.0:1746129585.872919:0:15096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11412 00000100:00100000:3.0:1746129585.872928:0:15096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ada2ffba-8920-4ecb-8068-68caa9806978+291:363:x1830948734523520:12345-192.168.202.4@tcp:36:lfs.0 00010000:00010000:3.0:1746129585.872987:0:15096:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129585.873016:0:15096:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab4800/0x40a459093b06c30b lrc: 0/0,0 mode: --/PR res: [0x200000403:0x368:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f227f5 expref: 291 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129585.873430:0:15096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009cffe100) 00010000:00010000:3.0:1746129585.873437:0:15096:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746129585.873481:0:15096:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d85a200/0x40a459093b06c374 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15096 initiator: MDT0 00010000:00010000:3.0:1746129585.873493:0:15096:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d85a200/0x40a459093b06c374 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15096 initiator: MDT0 00010000:00010000:3.0:1746129585.873503:0:15096:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d85a200/0x40a459093b06c374 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15096 initiator: MDT0 00000004:00010000:3.0:1746129585.873702:0:15096:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88012baefb80 reply state ffff880094b1f000 transno 8589945544 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d85a200/0x40a459093b06c374 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15096 initiator: MDT0 00000100:00100000:3.0:1746129585.873709:0:15096:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1746129585.874779:0:15096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ada2ffba-8920-4ecb-8068-68caa9806978+292:363:x1830948734523520:12345-192.168.202.4@tcp:36:lfs.0 Request processed in 1846us (2108us total) trans 8589945544 rc 0/0 00000100:00100000:3.0:1746129585.874788:0:15096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11412 00010000:00010000:3.0:1746129585.877756:0:3287:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d85a200/0x40a459093b06c374 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15096 initiator: MDT0 00010000:00010000:3.0:1746129585.877778:0:3287:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d85a200/0x40a459093b06c374 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15096 initiator: MDT0 00010000:00010000:3.0:1746129585.877785:0:3287:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d85a200/0x40a459093b06c374 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15096 initiator: MDT0 00010000:00010000:3.0:1746129585.877791:0:3287:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d85a200 already unused, calling callback (ffffffffa136e690) 00010000:00010000:3.0:1746129585.877795:0:3287:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d85a200/0x40a459093b06c374 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15096 initiator: MDT0 00010000:00010000:3.0:1746129585.877801:0:3287:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d85a200/0x40a459093b06c374 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15096 initiator: MDT0 00010000:00010000:3.0:1746129585.877893:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009cffe100) 00010000:00010000:3.0:1746129585.877896:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129585.877901:0:3287:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d85a200/0x40a459093b06c374 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15096 initiator: MDT0 00010000:00010000:3.0:1746129585.877906:0:3287:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d85a200/0x40a459093b06c374 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15096 initiator: MDT0 00000100:00100000:2.0:1746129585.883406:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129585.883584:0:31503:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734523648 00000100:00100000:0.0:1746129585.883595:0:31503:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734523648 00000100:00100000:0.0:1746129585.883659:0:31503:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 17092 00000100:00100000:0.0:1746129585.883668:0:31503:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135725880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ada2ffba-8920-4ecb-8068-68caa9806978+14:363:x1830948734523648:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:0.0:1746129585.883689:0:31503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129585.883709:0:31503:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009129e000/0x40a459093b06c37b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f22826 expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129585.883740:0:31503:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094c09800/0x40a459093b06c319 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f227fc expref: 15 pid: 4699 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129585.883748:0:31503:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129585.883750:0:31503:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129585.883753:0:31503:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009129e000/0x40a459093b06c37b lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22826 expref: 15 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129585.883785:0:31503:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094c09800/0x40a459093b06c319 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f227fc expref: 15 pid: 4699 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129585.883796:0:31503:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094c09800/0x40a459093b06c319 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f227fc expref: 15 pid: 4699 timeout: 941 lvb_type: 1 00000100:00100000:0.0:1746129585.883809:0:31503:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012baece00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:31503:1830948737663488:192.168.202.4@tcp:104: 00000100:00100000:0.0:1746129585.883915:0:31503:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa23bc00 going to sleep for 11 seconds 00000100:00100000:0.0:1746129585.886418:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129585.886533:0:31503:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012baece00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:31503:1830948737663488:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129585.886562:0:31503:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009129e000/0x40a459093b06c37b lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22826 expref: 15 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129585.886581:0:31503:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009129e000, rc 0) 00000100:00100000:2.0:1746129585.886639:0:31503:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135725880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ada2ffba-8920-4ecb-8068-68caa9806978+15:363:x1830948734523648:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 2971us (3245us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129585.886648:0:31503:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 17092 00000100:00100000:1.0:1746129585.886722:0:20578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734523776 00000100:00100000:1.0:1746129585.886729:0:20578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734523776 00010000:00010000:1.0:1746129585.886756:0:20578:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094c09800/0x40a459093b06c319 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f227fc expref: 15 pid: 4699 timeout: 941 lvb_type: 1 00000100:00100000:1.0:1746129585.886779:0:20578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8840 00000100:00100000:1.0:1746129585.886785:0:20578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131455500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ada2ffba-8920-4ecb-8068-68caa9806978+15:1962:x1830948734523776:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129585.886797:0:20578:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129585.886820:0:20578:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094c09800/0x40a459093b06c319 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f227fc expref: 15 pid: 4699 timeout: 941 lvb_type: 1 00010000:00010000:1.0:1746129585.886837:0:20578:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094c09800/0x40a459093b06c319 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f227fc expref: 15 pid: 4699 timeout: 941 lvb_type: 1 00010000:00010000:1.0:1746129585.886865:0:20578:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094c09800/0x40a459093b06c319 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f227fc expref: 15 pid: 4699 timeout: 941 lvb_type: 1 00010000:00010000:1.0:1746129585.886913:0:20578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129585.886915:0:20578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129585.886922:0:20578:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009129e000/0x40a459093b06c37b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22826 expref: 14 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129585.886930:0:20578:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009129e000/0x40a459093b06c37b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22826 expref: 14 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129585.886957:0:20578:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009129e000/0x40a459093b06c37b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22826 expref: 14 pid: 31503 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129585.886968:0:20578:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129bc1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:20578:1830948737663616:192.168.202.4@tcp:105: 00000100:00100000:1.0:1746129585.887038:0:20578:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a673ee40 going to sleep for 11 seconds 00000100:00100000:1.0:1746129585.888455:0:20578:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129bc1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:20578:1830948737663616:192.168.202.4@tcp:105: 00010000:00010000:1.0:1746129585.888473:0:20578:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129585.888516:0:20578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131455500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ada2ffba-8920-4ecb-8068-68caa9806978+14:1962:x1830948734523776:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 1731us (2106us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129585.888525:0:20578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8840 00000100:00100000:0.0:1746129585.888877:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129585.888944:0:31503:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734523904 00000100:00100000:2.0:1746129585.888950:0:31503:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734523904 00000100:00100000:2.0:1746129585.888986:0:31503:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 17093 00000100:00100000:2.0:1746129585.888992:0:31503:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131455880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ada2ffba-8920-4ecb-8068-68caa9806978+22:363:x1830948734523904:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:2.0:1746129585.889008:0:31503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129585.889024:0:31503:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008fa79c00/0x40a459093b06c382 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2282d expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129585.889049:0:31503:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130140600/0x40a459093b06c327 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22803 expref: 23 pid: 4699 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129585.889056:0:31503:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129585.889057:0:31503:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129585.889061:0:31503:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fa79c00/0x40a459093b06c382 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2282d expref: 23 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129585.889085:0:31503:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130140600/0x40a459093b06c327 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22803 expref: 23 pid: 4699 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129585.889096:0:31503:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130140600/0x40a459093b06c327 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22803 expref: 23 pid: 4699 timeout: 941 lvb_type: 1 00000100:00100000:2.0:1746129585.889106:0:31503:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135725500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:31503:1830948737663744:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129585.889599:0:31503:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132dade40 going to sleep for 11 seconds 00000100:00100000:2.0:1746129585.891351:0:31503:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135725500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:31503:1830948737663744:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129585.891383:0:31503:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008fa79c00/0x40a459093b06c382 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2282d expref: 23 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129585.891399:0:31503:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fa79c00, rc 0) 00000100:00100000:2.0:1746129585.891446:0:31503:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131455880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ada2ffba-8920-4ecb-8068-68caa9806978+23:363:x1830948734523904:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 2453us (2569us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129585.891454:0:31503:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 17093 00000100:00100000:2.0:1746129585.891782:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129585.892100:0:20578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734524032 00000100:00100000:1.0:1746129585.892108:0:20578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734524032 00010000:00010000:1.0:1746129585.892139:0:20578:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130140600/0x40a459093b06c327 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22803 expref: 23 pid: 4699 timeout: 941 lvb_type: 1 00000100:00100000:1.0:1746129585.892214:0:20578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8841 00000100:00100000:1.0:1746129585.892222:0:20578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135725500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ada2ffba-8920-4ecb-8068-68caa9806978+23:1962:x1830948734524032:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129585.892235:0:20578:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129585.892258:0:20578:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130140600/0x40a459093b06c327 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22803 expref: 23 pid: 4699 timeout: 941 lvb_type: 1 00010000:00010000:1.0:1746129585.892270:0:20578:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130140600/0x40a459093b06c327 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22803 expref: 23 pid: 4699 timeout: 941 lvb_type: 1 00010000:00010000:1.0:1746129585.892318:0:20578:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130140600/0x40a459093b06c327 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22803 expref: 23 pid: 4699 timeout: 941 lvb_type: 1 00010000:00010000:1.0:1746129585.892347:0:20578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129585.892349:0:20578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129585.892355:0:20578:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008fa79c00/0x40a459093b06c382 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2282d expref: 22 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129585.892362:0:20578:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fa79c00/0x40a459093b06c382 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2282d expref: 22 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129585.892392:0:20578:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008fa79c00/0x40a459093b06c382 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2282d expref: 22 pid: 31503 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129585.892402:0:20578:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129bc1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:20578:1830948737663872:192.168.202.4@tcp:105: 00000100:00100000:1.0:1746129585.892488:0:20578:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a673ee40 going to sleep for 11 seconds 00000100:00100000:0.0:1746129585.895057:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129585.895173:0:20578:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129bc1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:20578:1830948737663872:192.168.202.4@tcp:105: 00010000:00010000:1.0:1746129585.895206:0:20578:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129585.895266:0:20578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135725500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ada2ffba-8920-4ecb-8068-68caa9806978+22:1962:x1830948734524032:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 3044us (3483us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129585.895276:0:20578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8841 00000100:00100000:2.0:1746129585.895437:0:31503:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734524160 00000100:00100000:2.0:1746129585.895445:0:31503:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734524160 00000100:00100000:2.0:1746129585.895480:0:31503:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 17094 00000100:00100000:2.0:1746129585.895487:0:31503:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131457b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ada2ffba-8920-4ecb-8068-68caa9806978+22:363:x1830948734524160:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:2.0:1746129585.895505:0:31503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129585.895522:0:31503:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008fa78a00/0x40a459093b06c389 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f22834 expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129585.895554:0:31503:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880132fc3000/0x40a459093b06c312 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2280a expref: 23 pid: 20577 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129585.895562:0:31503:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129585.895563:0:31503:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129585.895567:0:31503:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fa78a00/0x40a459093b06c389 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22834 expref: 23 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129585.895595:0:31503:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880132fc3000/0x40a459093b06c312 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2280a expref: 23 pid: 20577 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129585.895606:0:31503:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880132fc3000/0x40a459093b06c312 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2280a expref: 23 pid: 20577 timeout: 941 lvb_type: 1 00000100:00100000:2.0:1746129585.895618:0:31503:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135724700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:31503:1830948737664000:192.168.202.4@tcp:104: 00000100:00100000:2.0:1746129585.895664:0:31503:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132dade40 going to sleep for 11 seconds 00000100:00100000:2.0:1746129585.902543:0:31503:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135724700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:31503:1830948737664000:192.168.202.4@tcp:104: 00010000:00010000:2.0:1746129585.902584:0:31503:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008fa78a00/0x40a459093b06c389 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22834 expref: 23 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129585.902600:0:31503:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fa78a00, rc 0) 00000100:00100000:2.0:1746129585.902661:0:31503:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131457b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ada2ffba-8920-4ecb-8068-68caa9806978+23:363:x1830948734524160:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 7173us (7613us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129585.902670:0:31503:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 17094 00000100:00100000:0.0:1746129585.905928:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129585.906336:0:20578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734524288 00000100:00100000:1.0:1746129585.906346:0:20578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734524288 00010000:00010000:1.0:1746129585.906385:0:20578:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880132fc3000/0x40a459093b06c312 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2280a expref: 23 pid: 20577 timeout: 941 lvb_type: 1 00000100:00100000:1.0:1746129585.906415:0:20578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8842 00000100:00100000:1.0:1746129585.906422:0:20578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131454a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ada2ffba-8920-4ecb-8068-68caa9806978+23:1962:x1830948734524288:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129585.906437:0:20578:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129585.906466:0:20578:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880132fc3000/0x40a459093b06c312 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2280a expref: 23 pid: 20577 timeout: 941 lvb_type: 1 00010000:00010000:1.0:1746129585.906479:0:20578:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880132fc3000/0x40a459093b06c312 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2280a expref: 23 pid: 20577 timeout: 941 lvb_type: 1 00010000:00010000:1.0:1746129585.906502:0:20578:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880132fc3000/0x40a459093b06c312 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2280a expref: 23 pid: 20577 timeout: 941 lvb_type: 1 00010000:00010000:1.0:1746129585.907919:0:20578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129585.907925:0:20578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129585.907935:0:20578:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008fa78a00/0x40a459093b06c389 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22834 expref: 22 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129585.907952:0:20578:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fa78a00/0x40a459093b06c389 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22834 expref: 22 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129585.907994:0:20578:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008fa78a00/0x40a459093b06c389 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22834 expref: 22 pid: 31503 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129585.908008:0:20578:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129bc1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:20578:1830948737664128:192.168.202.4@tcp:105: 00000100:00100000:1.0:1746129585.908457:0:20578:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a673ee40 going to sleep for 11 seconds 00000100:00100000:0.0:1746129585.912845:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129585.912922:0:20578:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129bc1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:20578:1830948737664128:192.168.202.4@tcp:105: 00000100:00100000:3.0:1746129585.912937:0:31503:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734524416 00000100:00100000:3.0:1746129585.912944:0:31503:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734524416 00010000:00010000:0.0:1746129585.912944:0:20578:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129585.912995:0:20578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131454a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ada2ffba-8920-4ecb-8068-68caa9806978+22:1962:x1830948734524288:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 6573us (7077us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129585.912996:0:31503:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 17095 00000100:00100000:3.0:1746129585.913003:0:31503:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ada2ffba-8920-4ecb-8068-68caa9806978+14:363:x1830948734524416:12345-192.168.202.4@tcp:101:lfs.0 00000100:00100000:0.0:1746129585.913004:0:20578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8842 00010000:00010000:3.0:1746129585.913022:0:31503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129585.913039:0:31503:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d85a400/0x40a459093b06c390 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f2283b expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129585.913068:0:31503:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880132fc2400/0x40a459093b06c335 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22811 expref: 15 pid: 20577 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129585.913079:0:31503:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129585.913081:0:31503:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129585.913084:0:31503:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d85a400/0x40a459093b06c390 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2283b expref: 15 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129585.913110:0:31503:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880132fc2400/0x40a459093b06c335 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22811 expref: 15 pid: 20577 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129585.913120:0:31503:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880132fc2400/0x40a459093b06c335 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22811 expref: 15 pid: 20577 timeout: 941 lvb_type: 1 00000100:00100000:3.0:1746129585.913132:0:31503:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094064e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:31503:1830948737664256:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129585.913221:0:31503:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ec90840 going to sleep for 11 seconds 00000100:00100000:0.0:1746129585.917113:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129585.917216:0:20578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734524544 00000100:00100000:1.0:1746129585.917225:0:20578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734524544 00000100:00100000:3.0:1746129585.917240:0:31503:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094064e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:31503:1830948737664256:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129585.917262:0:20578:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880132fc2400/0x40a459093b06c335 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22811 expref: 16 pid: 20577 timeout: 941 lvb_type: 1 00010000:00010000:3.0:1746129585.917276:0:31503:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d85a400/0x40a459093b06c390 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2283b expref: 16 pid: 31503 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129585.917289:0:20578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8843 00010000:00010000:3.0:1746129585.917321:0:31503:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d85a400, rc 0) 00000100:00100000:1.0:1746129585.917323:0:20578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ada2ffba-8920-4ecb-8068-68caa9806978+16:1963:x1830948734524544:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129585.917335:0:20578:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129585.917359:0:20578:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880132fc2400/0x40a459093b06c335 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22811 expref: 16 pid: 20577 timeout: 941 lvb_type: 1 00000100:00100000:3.0:1746129585.917365:0:31503:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ada2ffba-8920-4ecb-8068-68caa9806978+16:363:x1830948734524416:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 4363us (4532us total) trans 0 rc 0/0 00010000:00010000:1.0:1746129585.917369:0:20578:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880132fc2400/0x40a459093b06c335 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22811 expref: 16 pid: 20577 timeout: 941 lvb_type: 1 00000100:00100000:3.0:1746129585.917372:0:31503:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 17095 00010000:00010000:1.0:1746129585.917390:0:20578:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880132fc2400/0x40a459093b06c335 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22811 expref: 15 pid: 20577 timeout: 941 lvb_type: 1 00010000:00010000:1.0:1746129585.921721:0:20578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129585.921727:0:20578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129585.921743:0:20578:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d85a400/0x40a459093b06c390 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2283b expref: 14 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129585.921756:0:20578:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d85a400/0x40a459093b06c390 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2283b expref: 14 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129585.921815:0:20578:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012d85a400/0x40a459093b06c390 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f2283b expref: 14 pid: 31503 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129585.921831:0:20578:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129bc0380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:20578:1830948737664384:192.168.202.4@tcp:105: 00000100:00100000:1.0:1746129585.922564:0:20578:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a673e480 going to sleep for 11 seconds 00000100:00100000:0.0:1746129585.925888:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129585.925895:0:20578:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129bc0380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:20578:1830948737664384:192.168.202.4@tcp:105: 00000100:00100000:3.0:1746129585.925950:0:31503:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734524672 00000100:00100000:3.0:1746129585.925958:0:31503:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734524672 00000100:00100000:3.0:1746129585.926010:0:31503:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 17096 00000100:00100000:3.0:1746129585.926017:0:31503:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ada2ffba-8920-4ecb-8068-68caa9806978+15:363:x1830948734524672:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:3.0:1746129585.926036:0:31503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129585.926053:0:31503:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094fef200/0x40a459093b06c397 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f22842 expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129585.926082:0:31503:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130140a00/0x40a459093b06c320 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22818 expref: 16 pid: 4699 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129585.926090:0:31503:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129585.926092:0:31503:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129585.926095:0:31503:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094fef200/0x40a459093b06c397 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22842 expref: 16 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129585.926127:0:31503:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880130140a00/0x40a459093b06c320 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22818 expref: 16 pid: 4699 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129585.926139:0:31503:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880130140a00/0x40a459093b06c320 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22818 expref: 16 pid: 4699 timeout: 941 lvb_type: 1 00000100:00100000:3.0:1746129585.926150:0:31503:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094064e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:31503:1830948737664512:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129585.926238:0:31503:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ec90840 going to sleep for 11 seconds 00010000:00010000:1.0:1746129585.926280:0:20578:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129585.926321:0:20578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ada2ffba-8920-4ecb-8068-68caa9806978+16:1963:x1830948734524544:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 8999us (9221us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129585.926330:0:20578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8843 00000100:00100000:0.0:1746129585.928784:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129585.928921:0:31503:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094064e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:31503:1830948737664512:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129585.928956:0:31503:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094fef200/0x40a459093b06c397 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22842 expref: 15 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129585.928973:0:31503:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094fef200, rc 0) 00000100:00100000:3.0:1746129585.929021:0:31503:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ada2ffba-8920-4ecb-8068-68caa9806978+15:363:x1830948734524672:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 3003us (3142us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129585.929031:0:31503:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 17096 00000100:00100000:1.0:1746129585.929123:0:20578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734524800 00000100:00100000:1.0:1746129585.929129:0:20578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734524800 00010000:00010000:1.0:1746129585.929160:0:20578:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130140a00/0x40a459093b06c320 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22818 expref: 15 pid: 4699 timeout: 941 lvb_type: 1 00000100:00100000:2.0:1746129585.931361:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8844 00000100:00100000:2.0:1746129585.931377:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a44050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ada2ffba-8920-4ecb-8068-68caa9806978+15:1962:x1830948734524800:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129585.931399:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129585.931428:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130140a00/0x40a459093b06c320 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22818 expref: 15 pid: 4699 timeout: 941 lvb_type: 1 00010000:00010000:2.0:1746129585.931443:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130140a00/0x40a459093b06c320 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22818 expref: 15 pid: 4699 timeout: 941 lvb_type: 1 00010000:00010000:2.0:1746129585.931467:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130140a00/0x40a459093b06c320 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f22818 expref: 15 pid: 4699 timeout: 941 lvb_type: 1 00010000:00010000:2.0:1746129585.931505:0:9823:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129585.931507:0:9823:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129585.931515:0:9823:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094fef200/0x40a459093b06c397 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22842 expref: 14 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129585.931522:0:9823:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094fef200/0x40a459093b06c397 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22842 expref: 14 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129585.931557:0:9823:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094fef200/0x40a459093b06c397 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22842 expref: 14 pid: 31503 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129585.931569:0:9823:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135724700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9823:1830948737664640:192.168.202.4@tcp:105: 00000100:00100000:2.0:1746129585.931647:0:9823:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132dade40 going to sleep for 11 seconds 00000100:00100000:0.0:1746129585.936425:0:9823:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135724700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9823:1830948737664640:192.168.202.4@tcp:105: 00010000:00010000:0.0:1746129585.936453:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129585.936948:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a44050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ada2ffba-8920-4ecb-8068-68caa9806978+14:1962:x1830948734524800:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 5574us (8172us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129585.936960:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8844 00000100:00100000:2.0:1746129585.937241:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129585.937597:0:31503:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734524928 00000100:00100000:3.0:1746129585.937605:0:31503:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734524928 00000100:00100000:3.0:1746129585.937643:0:31503:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 17097 00000100:00100000:3.0:1746129585.937650:0:31503:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135725180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ada2ffba-8920-4ecb-8068-68caa9806978+22:363:x1830948734524928:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:3.0:1746129585.937669:0:31503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129585.937688:0:31503:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094fef800/0x40a459093b06c39e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f22849 expref: -99 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129585.937716:0:31503:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130141e00/0x40a459093b06c32e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f2281f expref: 23 pid: 4699 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129585.937722:0:31503:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129585.937724:0:31503:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129585.937728:0:31503:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094fef800/0x40a459093b06c39e lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22849 expref: 23 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129585.937756:0:31503:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130141e00/0x40a459093b06c32e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2281f expref: 23 pid: 4699 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129585.937767:0:31503:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130141e00/0x40a459093b06c32e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2281f expref: 23 pid: 4699 timeout: 941 lvb_type: 1 00000100:00100000:3.0:1746129585.937778:0:31503:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094064e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:31503:1830948737664768:192.168.202.4@tcp:104: 00000100:00100000:3.0:1746129585.937832:0:31503:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ec90840 going to sleep for 11 seconds 00000100:00100000:3.0:1746129585.941465:0:31503:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094064e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:31503:1830948737664768:192.168.202.4@tcp:104: 00010000:00010000:3.0:1746129585.941507:0:31503:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094fef800/0x40a459093b06c39e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22849 expref: 23 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129585.941526:0:31503:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094fef800, rc 0) 00000100:00100000:3.0:1746129585.942683:0:31503:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135725180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ada2ffba-8920-4ecb-8068-68caa9806978+23:363:x1830948734524928:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 5026us (5435us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129585.942693:0:31503:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 17097 00000100:00100000:0.0:1746129585.942921:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129585.943818:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734525056 00000100:00100000:2.0:1746129585.943827:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734525056 00010000:00010000:2.0:1746129585.943942:0:9823:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130141e00/0x40a459093b06c32e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2281f expref: 23 pid: 4699 timeout: 941 lvb_type: 1 00000100:00100000:2.0:1746129585.944175:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8845 00000100:00100000:2.0:1746129585.944194:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ada2ffba-8920-4ecb-8068-68caa9806978+23:1963:x1830948734525056:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129585.944366:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129585.944392:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130141e00/0x40a459093b06c32e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2281f expref: 23 pid: 4699 timeout: 941 lvb_type: 1 00010000:00010000:2.0:1746129585.944405:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130141e00/0x40a459093b06c32e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2281f expref: 23 pid: 4699 timeout: 941 lvb_type: 1 00010000:00010000:2.0:1746129585.944428:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130141e00/0x40a459093b06c32e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f2281f expref: 23 pid: 4699 timeout: 941 lvb_type: 1 00010000:00010000:2.0:1746129585.944645:0:9823:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129585.944647:0:9823:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129585.944655:0:9823:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094fef800/0x40a459093b06c39e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22849 expref: 22 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129585.944665:0:9823:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094fef800/0x40a459093b06c39e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22849 expref: 22 pid: 31503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129585.944698:0:9823:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880094fef800/0x40a459093b06c39e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0xda91008773f22849 expref: 22 pid: 31503 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129585.944709:0:9823:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135725c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9823:1830948737664896:192.168.202.4@tcp:105: 00000100:00100000:2.0:1746129585.945346:0:9823:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132dad6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129585.947930:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129585.947964:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129585.948168:0:9823:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135725c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9823:1830948737664896:192.168.202.4@tcp:105: 00010000:00010000:2.0:1746129585.948205:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129585.948254:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ada2ffba-8920-4ecb-8068-68caa9806978+22:1963:x1830948734525056:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 4062us (5333us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129585.948266:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8845 00000100:00100000:0.0:1746129585.948497:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129585.949244:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129585.949440:0:31503:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734525312 00000100:00100000:3.0:1746129585.949450:0:31503:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734525312 00000100:00100000:3.0:1746129585.949488:0:31503:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734525568 00000100:00100000:3.0:1746129585.949491:0:31503:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734525568 00000100:00100000:3.0:1746129585.949508:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734525824 00000100:00100000:3.0:1746129585.949510:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734525824 00000100:00100000:3.0:1746129585.949524:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 17098 00000100:00100000:3.0:1746129585.949530:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ada2ffba-8920-4ecb-8068-68caa9806978+23:1962:x1830948734525312:12345-192.168.202.4@tcp:2:lfs.0 00002000:00010000:3.0:1746129585.949732:0:7149:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746129585.949735:0:7149:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb mtime from disk: 1746129584 -> 1746129584 00002000:00010000:3.0:1746129585.949737:0:7149:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb atime from disk: 1746129584 -> 1746129584 00002000:00010000:3.0:1746129585.949739:0:7149:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb ctime from disk: 1746129584 -> 1746129586 00002000:00010000:3.0:1746129585.949741:0:7149:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:3.0:1746129585.949777:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ada2ffba-8920-4ecb-8068-68caa9806978+24:1962:x1830948734525312:12345-192.168.202.4@tcp:2:lfs.0 Request processed in 247us (1858us total) trans 17179874246 rc 0/0 00000100:00100000:3.0:1746129585.949783:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 17098 00000100:00100000:3.0:1746129585.949795:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 17099 00000100:00100000:3.0:1746129585.949799:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ada2ffba-8920-4ecb-8068-68caa9806978+14:1962:x1830948734525568:12345-192.168.202.4@tcp:2:lfs.0 00002000:00010000:3.0:1746129585.949890:0:7149:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746129585.949893:0:7149:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb mtime from disk: 1746129584 -> 1746129584 00002000:00010000:3.0:1746129585.949895:0:7149:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb atime from disk: 1746129584 -> 1746129584 00002000:00010000:3.0:1746129585.949896:0:7149:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb ctime from disk: 1746129584 -> 1746129586 00002000:00010000:3.0:1746129585.949898:0:7149:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:3.0:1746129585.949912:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ada2ffba-8920-4ecb-8068-68caa9806978+15:1962:x1830948734525568:12345-192.168.202.4@tcp:2:lfs.0 Request processed in 113us (1948us total) trans 21474841499 rc 0/0 00000100:00100000:3.0:1746129585.949916:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 17099 00000100:00100000:3.0:1746129585.949924:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 17100 00000100:00100000:3.0:1746129585.949929:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ada2ffba-8920-4ecb-8068-68caa9806978+23:1962:x1830948734525824:12345-192.168.202.4@tcp:2:lfs.0 00002000:00010000:3.0:1746129585.949989:0:7149:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3f5:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746129585.949991:0:7149:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f5:0x0] updating lvb mtime from disk: 1746129584 -> 1746129584 00002000:00010000:3.0:1746129585.949993:0:7149:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f5:0x0] updating lvb atime from disk: 1746129584 -> 1746129584 00002000:00010000:3.0:1746129585.949995:0:7149:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f5:0x0] updating lvb ctime from disk: 1746129584 -> 1746129586 00002000:00010000:3.0:1746129585.949996:0:7149:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f5:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:3.0:1746129585.950009:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ada2ffba-8920-4ecb-8068-68caa9806978+24:1962:x1830948734525824:12345-192.168.202.4@tcp:2:lfs.0 Request processed in 80us (1514us total) trans 17179874247 rc 0/0 00000100:00100000:3.0:1746129585.950013:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 17100 00000100:00100000:0.0:1746129585.950382:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1746129585.950423:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129585.950535:0:20577:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734525184 00000100:00100000:2.0:1746129585.950541:0:20577:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734525184 00000100:00100000:2.0:1746129585.950563:0:20577:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734525440 00000100:00100000:2.0:1746129585.950565:0:20577:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734525440 00000100:00100000:2.0:1746129585.950573:0:20577:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734525696 00000100:00100000:2.0:1746129585.950575:0:20577:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734525696 00000100:00100000:2.0:1746129585.950585:0:20577:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 17101 00000100:00100000:2.0:1746129585.950590:0:20577:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c079500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ada2ffba-8920-4ecb-8068-68caa9806978+16:1962:x1830948734525184:12345-192.168.202.4@tcp:2:lfs.0 00002000:00010000:2.0:1746129585.950685:0:20577:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3ec:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:2.0:1746129585.950688:0:20577:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ec:0x0] updating lvb mtime from disk: 1746129584 -> 1746129584 00002000:00010000:2.0:1746129585.950690:0:20577:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3ec:0x0] updating lvb atime from disk: 1746129584 -> 1746129584 00002000:00010000:2.0:1746129585.950691:0:20577:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ec:0x0] updating lvb ctime from disk: 1746129584 -> 1746129586 00002000:00010000:2.0:1746129585.950693:0:20577:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3ec:0x0] updating lvb blocks from disk: 2071 -> 2071 00000100:00100000:2.0:1746129585.950717:0:20577:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c079500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ada2ffba-8920-4ecb-8068-68caa9806978+17:1962:x1830948734525184:12345-192.168.202.4@tcp:2:lfs.0 Request processed in 127us (1475us total) trans 21474841500 rc 0/0 00000100:00100000:2.0:1746129585.950723:0:20577:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 17101 00000100:00100000:2.0:1746129585.950733:0:20577:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 17102 00000100:00100000:2.0:1746129585.950738:0:20577:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131455500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ada2ffba-8920-4ecb-8068-68caa9806978+24:1962:x1830948734525440:12345-192.168.202.4@tcp:2:lfs.0 00002000:00010000:2.0:1746129585.950805:0:20577:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746129585.950807:0:20577:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb mtime from disk: 1746129584 -> 1746129584 00002000:00010000:2.0:1746129585.950809:0:20577:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb atime from disk: 1746129584 -> 1746129584 00002000:00010000:2.0:1746129585.950811:0:20577:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb ctime from disk: 1746129584 -> 1746129586 00002000:00010000:2.0:1746129585.950813:0:20577:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:2.0:1746129585.950826:0:20577:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131455500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ada2ffba-8920-4ecb-8068-68caa9806978+25:1962:x1830948734525440:12345-192.168.202.4@tcp:2:lfs.0 Request processed in 89us (446us total) trans 17179874248 rc 0/0 00000100:00100000:2.0:1746129585.950832:0:20577:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 17102 00000100:00100000:2.0:1746129585.950840:0:20577:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 17103 00000100:00100000:2.0:1746129585.950844:0:20577:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131454a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ada2ffba-8920-4ecb-8068-68caa9806978+16:1962:x1830948734525696:12345-192.168.202.4@tcp:2:lfs.0 00002000:00010000:2.0:1746129585.950898:0:20577:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb size from disk: 5146336 -> 5146336 00002000:00010000:2.0:1746129585.950901:0:20577:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb mtime from disk: 1746129584 -> 1746129584 00002000:00010000:2.0:1746129585.950903:0:20577:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb atime from disk: 1746129584 -> 1746129584 00002000:00010000:2.0:1746129585.950904:0:20577:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb ctime from disk: 1746129584 -> 1746129586 00002000:00010000:2.0:1746129585.950906:0:20577:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb blocks from disk: 6035 -> 6035 00000100:00100000:2.0:1746129585.950919:0:20577:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131454a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ada2ffba-8920-4ecb-8068-68caa9806978+17:1962:x1830948734525696:12345-192.168.202.4@tcp:2:lfs.0 Request processed in 74us (496us total) trans 21474841501 rc 0/0 00000100:00100000:2.0:1746129585.950923:0:20577:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 17103 00000100:00100000:0.0:1746129585.955524:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129585.957118:0:14551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734526080 00000100:00100000:1.0:1746129585.957131:0:14551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734526080 00000100:00100000:1.0:1746129585.957200:0:14551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4874 00000100:00100000:1.0:1746129585.957209:0:14551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ada2ffba-8920-4ecb-8068-68caa9806978+291:363:x1830948734526080:12345-192.168.202.4@tcp:35:lfs.0 00000004:00010000:1.0:1746129585.957273:0:14551:0:(mdt_open.c:2471:mdt_close_resync_done()) ### [0x200000403:0x368:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb5ea00/0x40a459093b06c2be lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f227e7 expref: 291 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129585.957345:0:14551:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880095eec000/0x40a459093b06c3a5 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14551 initiator: MDT0 00010000:00010000:1.0:1746129585.957357:0:14551:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d85b800/0x40a459093b06c2fd lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f227ee expref: 291 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129585.957364:0:14551:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095eec000/0x40a459093b06c3a5 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14551 initiator: MDT0 00010000:00010000:1.0:1746129585.957396:0:14551:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012d85b800/0x40a459093b06c2fd lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0xda91008773f227ee expref: 291 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129585.957407:0:14551:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d85b800/0x40a459093b06c2fd lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f227ee expref: 291 pid: 15096 timeout: 941 lvb_type: 0 00000100:00100000:1.0:1746129585.957421:0:14551:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129bc0380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:14551:1830948737665024:192.168.202.4@tcp:104: 00000100:00100000:1.0:1746129585.957512:0:14551:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a673ec00 going to sleep for 11 seconds 00000100:00100000:0.0:1746129585.960546:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1746129585.960797:0:14551:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129bc0380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:14551:1830948737665024:192.168.202.4@tcp:104: 00010000:00010000:1.0:1746129585.960823:0:14551:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880095eec000/0x40a459093b06c3a5 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14551 initiator: MDT0 00000100:00100000:2.0:1746129585.960970:0:9823:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734526208 00000100:00100000:2.0:1746129585.960977:0:9823:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734526208 00010000:00010000:2.0:1746129585.961012:0:9823:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d85b800/0x40a459093b06c2fd lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f227ee expref: 292 pid: 15096 timeout: 941 lvb_type: 0 00000100:00100000:2.0:1746129585.961676:0:9823:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8846 00000100:00100000:2.0:1746129585.961686:0:9823:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ada2ffba-8920-4ecb-8068-68caa9806978+292:1962:x1830948734526208:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129585.961702:0:9823:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129585.961708:0:9823:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012d85b800/0x40a459093b06c2fd lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f227ee expref: 292 pid: 15096 timeout: 941 lvb_type: 0 00010000:00010000:2.0:1746129585.961724:0:9823:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012d85b800/0x40a459093b06c2fd lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f227ee expref: 292 pid: 15096 timeout: 941 lvb_type: 0 00010000:00010000:2.0:1746129585.961744:0:9823:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d85b800/0x40a459093b06c2fd lrc: 0/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0xda91008773f227ee expref: 292 pid: 15096 timeout: 941 lvb_type: 0 00010000:00010000:2.0:1746129585.961767:0:9823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009cffe100) 00010000:00010000:2.0:1746129585.961771:0:9823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880095eec000/0x40a459093b06c3a5 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14551 initiator: MDT0 00010000:00010000:2.0:1746129585.961779:0:9823:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095eec000/0x40a459093b06c3a5 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14551 initiator: MDT0 00010000:00010000:2.0:1746129585.961784:0:9823:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095eec000/0x40a459093b06c3a5 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14551 initiator: MDT0 00010000:00010000:2.0:1746129585.961966:0:9823:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129585.962021:0:9823:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ada2ffba-8920-4ecb-8068-68caa9806978+291:1962:x1830948734526208:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 336us (1486us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129585.962027:0:9823:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8846 00010000:00010000:1.0:1746129585.962075:0:14551:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880095eec000/0x40a459093b06c3a5 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14551 initiator: MDT0 00010000:00010000:1.0:1746129585.962081:0:14551:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095eec000/0x40a459093b06c3a5 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14551 initiator: MDT0 00000040:00080000:1.0:1746129585.967116:0:14551:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3545, 88 off298696 00000004:00080000:1.0:1746129585.967129:0:14551:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 841283834188ns, next at 776349687452ns, rc = 0 00000040:00080000:1.0:1746129585.967208:0:14551:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3549, 88 off298960 00000004:00080000:1.0:1746129585.967213:0:14551:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 841283918933ns, next at 776375382381ns, rc = 0 00000040:00080000:1.0:1746129585.967241:0:14551:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3550, 88 off299048 00000004:00080000:1.0:1746129585.967244:0:14551:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 841283950410ns, next at 776375382381ns, rc = 0 00000040:00080000:1.0:1746129585.967256:0:14551:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3546, 88 off298784 00000004:00080000:1.0:1746129585.967259:0:14551:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 841283965336ns, next at 776349687452ns, rc = 0 00000040:00080000:1.0:1746129585.967266:0:14551:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3547, 88 off298872 00000004:00080000:1.0:1746129585.967268:0:14551:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 841283974310ns, next at 776349687452ns, rc = 0 00000040:00080000:1.0:1746129585.967274:0:14551:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3551, 88 off299136 00000004:00080000:1.0:1746129585.967277:0:14551:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 841283982788ns, next at 776375382381ns, rc = 0 00000040:00080000:1.0:1746129585.967282:0:14551:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3552, 88 off299224 00000004:00080000:1.0:1746129585.967285:0:14551:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 841283991121ns, next at 776375382381ns, rc = 0 00000040:00080000:1.0:1746129585.967321:0:14551:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3553, 88 off299312 00000004:00080000:1.0:1746129585.967328:0:14551:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 841284034370ns, next at 776375382381ns, rc = 0 00000040:00080000:1.0:1746129585.967337:0:14551:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3548, 88 off298960 00000004:00080000:1.0:1746129585.967340:0:14551:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 841284046180ns, next at 776349687452ns, rc = 0 00000040:00080000:1.0:1746129585.967346:0:14551:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3554, 88 off299400 00000004:00080000:1.0:1746129585.967349:0:14551:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 841284054828ns, next at 776375382381ns, rc = 0 00000040:00080000:1.0:1746129585.967354:0:14551:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3549, 88 off299048 00000004:00080000:1.0:1746129585.967357:0:14551:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 841284063191ns, next at 776349687452ns, rc = 0 00000040:00080000:1.0:1746129585.967363:0:14551:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3555, 88 off299488 00000004:00080000:1.0:1746129585.967365:0:14551:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 841284071133ns, next at 776375382381ns, rc = 0 00000040:00080000:1.0:1746129585.967370:0:14551:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3550, 88 off299136 00000004:00080000:1.0:1746129585.967373:0:14551:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 841284079033ns, next at 776349687452ns, rc = 0 00000040:00080000:1.0:1746129585.967380:0:14551:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3551, 88 off299224 00000004:00080000:1.0:1746129585.967382:0:14551:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 841284088405ns, next at 776349687452ns, rc = 0 00000040:00080000:1.0:1746129585.967388:0:14551:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3552, 88 off299312 00000004:00080000:1.0:1746129585.967390:0:14551:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 841284096094ns, next at 776349687452ns, rc = 0 00000040:00080000:1.0:1746129585.967395:0:14551:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3553, 88 off299400 00000004:00080000:1.0:1746129585.967398:0:14551:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 841284103720ns, next at 776349687452ns, rc = 0 00000040:00080000:1.0:1746129585.967403:0:14551:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3556, 88 off299576 00000004:00080000:1.0:1746129585.967406:0:14551:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 841284111915ns, next at 776375382381ns, rc = 0 00000004:00010000:2.0:1746129585.998579:0:14551:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8800900f4a80 reply state ffff880090648400 transno 8589945545 ns: mdt-lustre-MDT0000_UUID lock: ffff880095eec000/0x40a459093b06c3a5 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14551 initiator: MDT0 00000100:00100000:2.0:1746129585.998593:0:14551:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1746129585.998606:0:14551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009cffe100) 00010000:00010000:2.0:1746129585.998609:0:14551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746129585.998618:0:14551:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb5ea00/0x40a459093b06c2be lrc: 0/0,0 mode: --/PW res: [0x200000403:0x368:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f227e7 expref: 291 pid: 15096 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129585.998742:0:14551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ada2ffba-8920-4ecb-8068-68caa9806978+291:363:x1830948734526080:12345-192.168.202.4@tcp:35:lfs.0 Request processed in 41532us (43228us total) trans 8589945545 rc 0/0 00000100:00100000:2.0:1746129585.998753:0:14551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4874 00000001:00080000:0.0:1746129585.998976:0:14619:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945545 is committed 00000004:00080000:0.0:1746129585.998983:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2725 committed 00000004:00080000:0.0:1746129585.998997:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2722 committed 00000004:00080000:0.0:1746129585.999002:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2721 committed 00000004:00080000:0.0:1746129585.999004:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2720 committed 00000004:00080000:0.0:1746129585.999006:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2719 committed 00000004:00080000:0.0:1746129585.999007:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2724 committed 00000004:00080000:0.0:1746129585.999009:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2718 committed 00000004:00080000:0.0:1746129585.999011:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2723 committed 00000004:00080000:0.0:1746129585.999012:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2717 committed 00000004:00080000:0.0:1746129585.999013:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2722 committed 00000004:00080000:0.0:1746129585.999015:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2721 committed 00000004:00080000:0.0:1746129585.999017:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2720 committed 00000004:00080000:0.0:1746129585.999018:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2716 committed 00000004:00080000:0.0:1746129585.999021:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2715 committed 00000004:00080000:0.0:1746129585.999022:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2719 committed 00000004:00080000:0.0:1746129585.999024:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2718 committed 00000004:00080000:0.0:1746129585.999026:0:14619:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2714 committed 00000100:00100000:3.0:1746129585.999308:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094065880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737665408:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129585.999362:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129585.999403:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094064a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737665920:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129585.999417:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129585.999431:0:3300:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1746129585.999435:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094065f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737665536:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129585.999446:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129585.999454:0:3300:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a77b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737666048:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129585.999465:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129585.999485:0:31503:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737665408 00000100:00100000:3.0:1746129585.999492:0:31503:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737665408 00000100:00100000:3.0:1746129585.999521:0:31503:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737665920 00000100:00100000:3.0:1746129585.999522:0:31503:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737665920 00000100:00100000:3.0:1746129585.999531:0:31503:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737665536 00000100:00100000:3.0:1746129585.999532:0:31503:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737665536 00000100:00100000:3.0:1746129585.999539:0:31503:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737666048 00000100:00100000:3.0:1746129585.999541:0:31503:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737666048 00000100:00100000:3.0:1746129585.999550:0:31503:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17104 00000100:00100000:3.0:1746129585.999556:0:31503:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a77b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+16:3300:x1830948737665408:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746129585.999746:0:31503:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3f5:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746129585.999748:0:31503:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f5:0x0] updating lvb mtime from disk: 1746129584 -> 1746129584 00002000:00010000:3.0:1746129585.999750:0:31503:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f5:0x0] updating lvb atime from disk: 1746129584 -> 1746129584 00002000:00010000:3.0:1746129585.999752:0:31503:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f5:0x0] updating lvb ctime from disk: 1746129586 -> 1746129586 00002000:00010000:3.0:1746129585.999753:0:31503:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f5:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:3.0:1746129585.999774:0:31503:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a77b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+17:3300:x1830948737665408:12345-0@lo:2:osp-syn-1-0.0 Request processed in 219us (413us total) trans 17179874249 rc 0/0 00000100:00100000:3.0:1746129585.999779:0:31503:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17104 00000100:00100000:3.0:1746129585.999789:0:31503:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17105 00000100:00100000:3.0:1746129585.999793:0:31503:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a77b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+16:3300:x1830948737665920:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129585.999865:0:31503:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a77b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+17:3300:x1830948737665920:12345-0@lo:2:osp-syn-1-0.0 Request processed in 71us (446us total) trans 17179874250 rc 0/0 00000100:00100000:3.0:1746129585.999870:0:31503:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17105 00000100:00100000:3.0:1746129585.999878:0:31503:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17106 00000100:00100000:3.0:1746129585.999883:0:31503:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a77b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+16:3300:x1830948737665536:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746129585.999943:0:31503:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746129585.999946:0:31503:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb mtime from disk: 1746129523 -> 1746129523 00002000:00010000:3.0:1746129585.999948:0:31503:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb atime from disk: 1746129523 -> 1746129523 00002000:00010000:3.0:1746129585.999949:0:31503:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb ctime from disk: 1746129524 -> 1746129524 00002000:00010000:3.0:1746129585.999951:0:31503:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1746129585.999970:0:31503:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a77b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+17:3300:x1830948737665536:12345-0@lo:2:osp-syn-1-0.0 Request processed in 87us (522us total) trans 17179874251 rc 0/0 00000100:00100000:3.0:1746129585.999975:0:31503:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17106 00000100:00100000:3.0:1746129585.999984:0:31503:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17107 00000100:00100000:3.0:1746129585.999988:0:31503:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a77b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+16:3300:x1830948737666048:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129586.000063:0:31503:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a77b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+17:3300:x1830948737666048:12345-0@lo:2:osp-syn-1-0.0 Request processed in 75us (596us total) trans 17179874252 rc 0/0 00000100:00100000:3.0:1746129586.000069:0:31503:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17107 00000004:00080000:3.0:1746129586.000109:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094065f80/2, rc 0, transno 17179874251 00000100:00100000:3.0:1746129586.000114:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094065f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737665536:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746129586.000119:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a77b2300/2, rc 0, transno 17179874252 00000100:00100000:3.0:1746129586.000122:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a77b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737666048:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746129586.000127:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094065880/2, rc 0, transno 17179874249 00000100:00100000:3.0:1746129586.000129:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094065880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737665408:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746129586.000134:0:3300:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094064a80/2, rc 0, transno 17179874250 00000100:00100000:3.0:1746129586.000135:0:3300:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094064a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1830948737665920:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1746129586.000353:0:3286:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880095eec000/0x40a459093b06c3a5 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14551 initiator: MDT0 00010000:00010000:2.0:1746129586.000364:0:3286:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095eec000/0x40a459093b06c3a5 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14551 initiator: MDT0 00010000:00010000:2.0:1746129586.000371:0:3286:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095eec000/0x40a459093b06c3a5 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14551 initiator: MDT0 00010000:00010000:2.0:1746129586.000376:0:3286:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095eec000 already unused, calling callback (ffffffffa136e690) 00010000:00010000:2.0:1746129586.000381:0:3286:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095eec000/0x40a459093b06c3a5 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14551 initiator: MDT0 00010000:00010000:2.0:1746129586.000388:0:3286:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095eec000/0x40a459093b06c3a5 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14551 initiator: MDT0 00010000:00010000:2.0:1746129586.000402:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff88009cffe100) 00010000:00010000:2.0:1746129586.000405:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746129586.000408:0:3286:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095eec000/0x40a459093b06c3a5 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14551 initiator: MDT0 00010000:00010000:2.0:1746129586.000413:0:3286:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095eec000/0x40a459093b06c3a5 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14551 initiator: MDT0 00000100:00100000:0.0:1746129586.000573:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094064e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737665152:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129586.000604:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129586.000640:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094067100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737665664:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129586.000658:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129586.000668:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135725c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737666176:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129586.000684:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129586.000693:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135727800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737666688:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129586.000706:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129586.000715:0:3302:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:0.0:1746129586.000719:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094065180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737665280:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129586.000730:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129586.000737:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094067480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737665792:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129586.000748:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129586.000758:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135724a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737666304:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129586.000772:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129586.000781:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135727b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737666816:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129586.000793:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129586.000812:0:4699:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737665152 00000100:00100000:0.0:1746129586.000816:0:4699:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737665152 00000100:00100000:0.0:1746129586.000836:0:4699:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737665664 00000100:00100000:0.0:1746129586.000839:0:4699:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737665664 00000100:00100000:0.0:1746129586.000848:0:4699:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737666176 00000100:00100000:0.0:1746129586.000850:0:4699:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737666176 00000100:00100000:0.0:1746129586.000858:0:4699:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737666688 00000100:00100000:0.0:1746129586.000859:0:4699:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737666688 00000100:00100000:0.0:1746129586.000864:0:4699:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737665280 00000100:00100000:0.0:1746129586.000866:0:4699:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737665280 00000100:00100000:0.0:1746129586.000873:0:4699:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737665792 00000100:00100000:0.0:1746129586.000874:0:4699:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737665792 00000100:00100000:0.0:1746129586.000880:0:4699:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737666304 00000100:00100000:0.0:1746129586.000881:0:4699:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737666304 00000100:00100000:0.0:1746129586.000887:0:4699:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737666816 00000100:00100000:0.0:1746129586.000889:0:4699:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737666816 00000100:00100000:0.0:1746129586.000896:0:4699:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17108 00000100:00100000:0.0:1746129586.000900:0:4699:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+20:3302:x1830948737665152:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746129586.000999:0:4699:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746129586.001001:0:4699:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb mtime from disk: 1746129584 -> 1746129584 00002000:00010000:0.0:1746129586.001003:0:4699:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb atime from disk: 1746129584 -> 1746129584 00002000:00010000:0.0:1746129586.001005:0:4699:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb ctime from disk: 1746129586 -> 1746129586 00002000:00010000:0.0:1746129586.001006:0:4699:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746129586.001029:0:4699:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+21:3302:x1830948737665152:12345-0@lo:2:osp-syn-1-0.0 Request processed in 129us (425us total) trans 17179874253 rc 0/0 00000100:00100000:0.0:1746129586.001034:0:4699:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17108 00000100:00100000:0.0:1746129586.001045:0:4699:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17109 00000100:00100000:0.0:1746129586.001049:0:4699:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+20:3302:x1830948737665664:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129586.001122:0:4699:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+21:3302:x1830948737665664:12345-0@lo:2:osp-syn-1-0.0 Request processed in 72us (463us total) trans 17179874254 rc 0/0 00000100:00100000:0.0:1746129586.001128:0:4699:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17109 00000100:00100000:0.0:1746129586.001136:0:4699:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17110 00000100:00100000:0.0:1746129586.001140:0:4699:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+17:3302:x1830948737666176:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746129586.001260:0:4699:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3ec:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746129586.001262:0:4699:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ec:0x0] updating lvb mtime from disk: 1746129584 -> 1746129584 00002000:00010000:0.0:1746129586.001264:0:4699:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3ec:0x0] updating lvb atime from disk: 1746129584 -> 1746129584 00002000:00010000:0.0:1746129586.001266:0:4699:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ec:0x0] updating lvb ctime from disk: 1746129586 -> 1746129586 00002000:00010000:0.0:1746129586.001267:0:4699:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3ec:0x0] updating lvb blocks from disk: 2071 -> 2071 00000100:00100000:0.0:1746129586.001286:0:4699:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+18:3302:x1830948737666176:12345-0@lo:2:osp-syn-0-0.0 Request processed in 145us (601us total) trans 21474841502 rc 0/0 00000100:00100000:0.0:1746129586.001290:0:4699:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17110 00000100:00100000:0.0:1746129586.001320:0:4699:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17111 00000100:00100000:0.0:1746129586.001324:0:4699:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+17:3302:x1830948737666688:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129586.001394:0:4699:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+18:3302:x1830948737666688:12345-0@lo:2:osp-syn-0-0.0 Request processed in 69us (686us total) trans 21474841503 rc 0/0 00000100:00100000:0.0:1746129586.001398:0:4699:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17111 00000100:00100000:0.0:1746129586.001406:0:4699:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17112 00000100:00100000:0.0:1746129586.001409:0:4699:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+20:3302:x1830948737665280:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746129586.001464:0:4699:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746129586.001466:0:4699:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb mtime from disk: 1746129584 -> 1746129584 00002000:00010000:0.0:1746129586.001468:0:4699:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb atime from disk: 1746129584 -> 1746129584 00002000:00010000:0.0:1746129586.001469:0:4699:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb ctime from disk: 1746129586 -> 1746129586 00002000:00010000:0.0:1746129586.001471:0:4699:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746129586.001485:0:4699:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+21:3302:x1830948737665280:12345-0@lo:2:osp-syn-1-0.0 Request processed in 76us (754us total) trans 17179874255 rc 0/0 00000100:00100000:0.0:1746129586.001489:0:4699:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17112 00000100:00100000:0.0:1746129586.001498:0:4699:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17113 00000100:00100000:0.0:1746129586.001501:0:4699:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+20:3302:x1830948737665792:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129586.001575:0:4699:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+21:3302:x1830948737665792:12345-0@lo:2:osp-syn-1-0.0 Request processed in 72us (825us total) trans 17179874256 rc 0/0 00000100:00100000:0.0:1746129586.001579:0:4699:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17113 00000100:00100000:0.0:1746129586.001588:0:4699:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17114 00000100:00100000:0.0:1746129586.001592:0:4699:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+17:3302:x1830948737666304:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746129586.001664:0:4699:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746129586.001666:0:4699:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb mtime from disk: 1746129584 -> 1746129584 00002000:00010000:0.0:1746129586.001668:0:4699:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb atime from disk: 1746129584 -> 1746129584 00002000:00010000:0.0:1746129586.001670:0:4699:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb ctime from disk: 1746129586 -> 1746129586 00002000:00010000:0.0:1746129586.001671:0:4699:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746129586.001690:0:4699:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+18:3302:x1830948737666304:12345-0@lo:2:osp-syn-0-0.0 Request processed in 98us (917us total) trans 21474841504 rc 0/0 00000100:00100000:0.0:1746129586.001695:0:4699:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17114 00000100:00100000:0.0:1746129586.001704:0:4699:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17115 00000100:00100000:0.0:1746129586.001708:0:4699:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+17:3302:x1830948737666816:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129586.001780:0:4699:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+18:3302:x1830948737666816:12345-0@lo:2:osp-syn-0-0.0 Request processed in 71us (985us total) trans 21474841505 rc 0/0 00000100:00100000:0.0:1746129586.001784:0:4699:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17115 00000004:00080000:0.0:1746129586.001897:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094065180/2, rc 0, transno 17179874255 00000100:00100000:0.0:1746129586.001902:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094065180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737665280:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129586.001908:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094067480/2, rc 0, transno 17179874256 00000100:00100000:0.0:1746129586.001910:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094067480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737665792:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129586.001917:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135724a80/2, rc 0, transno 21474841504 00000100:00100000:0.0:1746129586.001924:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135724a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737666304:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129586.001931:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135727b80/2, rc 0, transno 21474841505 00000100:00100000:0.0:1746129586.001934:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135727b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737666816:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129586.001939:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094064e00/2, rc 0, transno 17179874253 00000100:00100000:0.0:1746129586.001941:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094064e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737665152:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129586.001947:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094067100/2, rc 0, transno 17179874254 00000100:00100000:0.0:1746129586.001949:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094067100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737665664:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129586.001954:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135725c00/2, rc 0, transno 21474841502 00000100:00100000:0.0:1746129586.001956:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135725c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737666176:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129586.001961:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135727800/2, rc 0, transno 21474841503 00000100:00100000:0.0:1746129586.001963:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135727800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737666688:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129586.002002:0:3302:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737667200:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129586.002024:0:3302:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129586.002056:0:31503:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737667200 00000100:00100000:0.0:1746129586.002060:0:31503:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737667200 00000100:00100000:0.0:1746129586.002075:0:31503:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17116 00000100:00100000:0.0:1746129586.002079:0:31503:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+18:3302:x1830948737667200:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129586.002162:0:31503:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+19:3302:x1830948737667200:12345-0@lo:2:osp-syn-0-0.0 Request processed in 81us (137us total) trans 21474841506 rc 0/0 00000100:00100000:0.0:1746129586.002167:0:31503:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17116 00000004:00080000:0.0:1746129586.002199:0:3302:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800900f6680/2, rc 0, transno 21474841506 00000100:00100000:0.0:1746129586.002202:0:3302:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1830948737667200:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129586.002646:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135726a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737666560:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129586.002673:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129586.003365:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135726680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737667072:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129586.003390:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129586.003441:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737666560 00000100:00100000:2.0:1746129586.003446:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737666560 00000100:00100000:2.0:1746129586.003470:0:4385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737667072 00000100:00100000:2.0:1746129586.003471:0:4385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737667072 00000100:00100000:2.0:1746129586.003481:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17117 00000100:00100000:2.0:1746129586.003485:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a77b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+20:3301:x1830948737666560:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129586.003630:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a77b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+21:3301:x1830948737666560:12345-0@lo:2:osp-syn-0-0.0 Request processed in 143us (955us total) trans 21474841507 rc 0/0 00000100:00100000:2.0:1746129586.003636:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17117 00000100:00100000:2.0:1746129586.003654:0:4385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17118 00000100:00100000:2.0:1746129586.003658:0:4385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c29c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+20:3301:x1830948737667072:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129586.003735:0:4385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c29c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+21:3301:x1830948737667072:12345-0@lo:2:osp-syn-0-0.0 Request processed in 76us (343us total) trans 21474841508 rc 0/0 00000100:00100000:2.0:1746129586.003739:0:4385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17118 00000004:00080000:3.0:1746129586.003928:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135726680/2, rc 0, transno 21474841508 00000100:00100000:3.0:1746129586.003933:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135726680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737667072:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746129586.003946:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135726a00/2, rc 0, transno 21474841507 00000100:00100000:3.0:1746129586.003950:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135726a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737666560:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129586.003955:0:3301:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1746129586.003959:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135724000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737666432:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129586.003979:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129586.003992:0:3301:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135725f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737666944:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129586.004003:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129586.004022:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737666432 00000100:00100000:3.0:1746129586.004024:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737666432 00000100:00100000:3.0:1746129586.004042:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948737666944 00000100:00100000:3.0:1746129586.004044:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948737666944 00000100:00100000:3.0:1746129586.004053:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17119 00000100:00100000:3.0:1746129586.004057:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a77b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+22:3301:x1830948737666432:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746129586.004158:0:7149:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb size from disk: 5146336 -> 5146336 00002000:00010000:3.0:1746129586.004161:0:7149:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb mtime from disk: 1746129584 -> 1746129584 00002000:00010000:3.0:1746129586.004163:0:7149:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb atime from disk: 1746129584 -> 1746129584 00002000:00010000:3.0:1746129586.004165:0:7149:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb ctime from disk: 1746129586 -> 1746129586 00002000:00010000:3.0:1746129586.004167:0:7149:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb blocks from disk: 6035 -> 6035 00000100:00100000:3.0:1746129586.004202:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a77b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+23:3301:x1830948737666432:12345-0@lo:2:osp-syn-0-0.0 Request processed in 144us (221us total) trans 21474841509 rc 0/0 00000100:00100000:3.0:1746129586.004207:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17119 00000100:00100000:3.0:1746129586.004217:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17120 00000100:00100000:3.0:1746129586.004221:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a77b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+22:3301:x1830948737666944:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746129586.004287:0:7149:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746129586.004290:0:7149:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1746129586.004313:0:7149:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746129586.004315:0:7149:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1746129586.004316:0:7149:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1746129586.004335:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a77b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+23:3301:x1830948737666944:12345-0@lo:2:osp-syn-0-0.0 Request processed in 114us (330us total) trans 21474841510 rc 0/0 00000100:00100000:3.0:1746129586.004340:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17120 00000004:00080000:3.0:1746129586.004369:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135724000/2, rc 0, transno 21474841509 00000100:00100000:3.0:1746129586.004372:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135724000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737666432:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746129586.004378:0:3301:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135725f80/2, rc 0, transno 21474841510 00000100:00100000:3.0:1746129586.004380:0:3301:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135725f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1830948737666944:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129586.006798:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1746129586.006881:0:15096:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734526336 00000100:00100000:3.0:1746129586.006890:0:15096:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734526336 00000100:00100000:3.0:1746129586.006940:0:15096:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11413 00000100:00100000:3.0:1746129586.006947:0:15096:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129bc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ada2ffba-8920-4ecb-8068-68caa9806978+288:363:x1830948734526336:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:3.0:1746129586.006971:0:15096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129586.006994:0:15096:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab4200/0x40a459093b06c3ac lrc: 2/0,0 mode: --/CR res: [0x200000403:0x368:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda91008773f22850 expref: -99 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129586.007058:0:15096:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab4200/0x40a459093b06c3ac lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22850 expref: 289 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129586.007071:0:15096:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fab4200/0x40a459093b06c3ac lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x368:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0xda91008773f22850 expref: 289 pid: 15096 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129586.007088:0:15096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x368:0x0].0x0 (ffff880132c4e000) 00010000:00010000:3.0:1746129586.007091:0:15096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746129586.007096:0:15096:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fab4200, rc 0) 00000100:00100000:3.0:1746129586.008018:0:15096:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129bc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ada2ffba-8920-4ecb-8068-68caa9806978+289:363:x1830948734526336:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 1064us (1224us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129586.008026:0:15096:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11413 00000100:00100000:0.0:1746129586.014490:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1746129586.015071:0:14551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830948734526592 00000100:00100000:2.0:1746129586.015081:0:14551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830948734526592 00000100:00100000:2.0:1746129586.015725:0:14551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4875 00000100:00100000:2.0:1746129586.015735:0:14551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ada2ffba-8920-4ecb-8068-68caa9806978+289:363:x1830948734526592:12345-192.168.202.4@tcp:35:lfs.0 00000100:00100000:2.0:1746129586.019895:0:14551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ada2ffba-8920-4ecb-8068-68caa9806978+290:363:x1830948734526592:12345-192.168.202.4@tcp:35:lfs.0 Request processed in 4151us (5405us total) trans 8589945546 rc 0/0 00000100:00100000:2.0:1746129586.019909:0:14551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4875 00010000:00010000:2.0:1746129586.518072:0:7088:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1746129586.973562:0:6495:0:(debug.c:792:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-flr test_200b: @@@@@@ FAIL: final resync failed 00010000:00010000:2.0:1746129587.519484:0:7089:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 68773 lines, 68773 kept, 0 dropped, 0 bad.